EP3528514B1 - Method and apparatus for wireless transmission of audio streams - Google Patents

Method and apparatus for wireless transmission of audio streams Download PDF

Info

Publication number
EP3528514B1
EP3528514B1 EP19168691.4A EP19168691A EP3528514B1 EP 3528514 B1 EP3528514 B1 EP 3528514B1 EP 19168691 A EP19168691 A EP 19168691A EP 3528514 B1 EP3528514 B1 EP 3528514B1
Authority
EP
European Patent Office
Prior art keywords
audio
package
primary
transmitter unit
block
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
EP19168691.4A
Other languages
German (de)
French (fr)
Other versions
EP3528514A1 (en
Inventor
Ole Gudiksen
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
GN Hearing AS
Original Assignee
GN Hearing AS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by GN Hearing AS filed Critical GN Hearing AS
Priority to DK19168691.4T priority Critical patent/DK3528514T3/en
Priority to EP19168691.4A priority patent/EP3528514B1/en
Publication of EP3528514A1 publication Critical patent/EP3528514A1/en
Application granted granted Critical
Publication of EP3528514B1 publication Critical patent/EP3528514B1/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R25/00Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
    • H04R25/55Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception using an external connection, either wireless or wired
    • H04R25/552Binaural
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2227/00Details of public address [PA] systems covered by H04R27/00 but not provided for in any of its subgroups
    • H04R2227/005Audio distribution systems for home, i.e. multi-room use
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2420/00Details of connection covered by H04R, not provided for in its groups
    • H04R2420/03Connection circuits to selectively connect loudspeakers or headphones to amplifiers
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2420/00Details of connection covered by H04R, not provided for in its groups
    • H04R2420/07Applications of wireless loudspeakers or wireless microphones
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2460/00Details of hearing devices, i.e. of ear- or headphones covered by H04R1/10 or H04R5/033 but not provided for in any of their subgroups, or of hearing aids covered by H04R25/00 but not provided for in any of its subgroups
    • H04R2460/03Aspects of the reduction of energy consumption in hearing devices
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R25/00Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
    • H04R25/55Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception using an external connection, either wireless or wired
    • H04R25/554Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception using an external connection, either wireless or wired using a wireless connection, e.g. between microphone and amplifier or using Tcoils
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R27/00Public address systems

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Neurosurgery (AREA)
  • Otolaryngology (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Signal Processing (AREA)
  • Transmitters (AREA)

Description

  • The present disclosure relates to an audio system for audio streaming and associated method. More specifically, the present disclosure describes a method and audio system for transmitting wireless audio streams, in particular to hearing device(s).
  • BACKGROUND
  • Wireless communication to and from hearing devices has been increasing in continuation of the developments within wireless communication technology. In a crowded environment where audio is distributed to the crowd, for example in an airport or in a movie theatre, it is known to stream audio via a telecoil solution having a limited bandwidth with limited possibilities of separating different audio streams.
  • Digital solutions of audio streaming have enhanced possibilities for broadcasting audio. However, the range of a single transmitter unit transmitting an audio stream is limited, thus there is a need for a method that allows reception of the same audio stream from different transmitter units.
  • The limited battery power of hearing devices however requires ways of minimizing data transmission from the hearing device, in an effort to prolong battery life. Hence the shift from receiving the audio stream from one transmitter unit to receiving the same audio stream from an alternative transmitter unit, demands that the transmission of data from the hearing device is eliminated or seriously minimized.
  • Thus, there is a need for an audio system that provides audio streaming to a moving user, without relying on transmission of data back and forth between the audio system and the hearing device during handover between a first and second transmitter unit.
  • WO 2004/110099 discloses a hearing aid comprising a transceiver for interconnection of the hearing aid with a wireless network for communication with a plurality of other devices, and a communication controller that is adapted for controlling data exchange through the network in accordance with a simple network protocol. The hearing aid wireless network facilitates interconnection of a plurality of devices in the network. In an established network, the network master device, in a connected mode, regularly transmits synchronization data, e.g. comprised in a link management package, for synchronization of the slave devices in the network with the master device. During initialization of the network, each device in an acquisition mode transmits interrogation data at a higher rate than the rate of transmission of the synchronization data in the connected mode.
  • GB 2 463 277 discloses a wireless communication system for a karaoke wireless microphone operating within a predetermined frequency band.
  • WO 2012/049311 A1 discloses a hearing device that is able to provide a compensation of the differences between an oscillator crystal in a transmitting participant and an oscillator crystal in a receiving participant in a wireless network.
  • US 2013/042291 A1 relates generally to devices that source and sink video and audio data.
  • US 2012/260295 A1 relates generally to audio dissemination systems, and, more particularly, to a wireless audio dissemination system.
  • The internet tutorial 'GSM Handover or Handoff downloaded at http://www.radio-electronics.com/info/ cellulartelecomms/gsm_technical/handover-handoff.php teaches different forms of handover procedures and information exchange in the context of cellular communication standards.
  • SUMMARY
  • Accordingly, a method for transmitting wireless audio streams to one or more hearing devices in an audio system comprising a first transmitter unit and a second transmitter unit is provided. The method comprises transmitting a first audio block of an audio stream in a first audio frame with the first transmitter unit. The method comprises transmitting the first audio block of the audio stream in the first audio frame with the second transmitter unit. The method further comprises transmitting a first primary pilot package with the first transmitter unit. The first primary pilot package comprises the transmitter unit address of the first transmitter unit, a first primary time offset, and a channel identifier of a first primary audio package of a second audio block of the audio stream in a second audio frame. The method comprises transmitting a first primary audio package of the second audio block at a start time depending on the first primary time offset and the channel identifier. The first audio block comprises a first primary audio package comprising a transmitter unit address of the transmitter unit transmitting the first primary audio package.
  • Also disclosed is an electromagnetic signal for transmitting wireless audio streams to one or more hearing devices, the electromagnetic signal comprising a plurality of audio blocks of an audio stream including a first audio block of the audio stream in a first audio frame and a second audio block of the audio stream in a second audio frame following the first audio frame. The first audio block and the second audio block each comprises a first primary audio package comprising a transmitter unit address. The electromagnetic signal comprises a first primary pilot package in the first audio frame. The first primary pilot package and the first primary audio package of the second audio block are separated by a first primary time offset. The first primary pilot package comprises the transmitter unit address, the first primary time offset, and channel identifier of the first primary audio package of the second audio block.
  • Also disclosed is an audio system for transmitting wireless audio streams to one or more hearing devices. The audio system comprises one or more transmitter units including a first transmitter unit and a second transmitter unit, the one or more transmitter units being configured for transmitting audio blocks. Each audio block of an audio stream includes a first primary audio package. The first primary audio package comprises a transmitter unit address of the respective transmitter. The first transmitter unit is configured to transmit a first audio block of an audio stream in a first audio frame. The first audio block comprises a first primary audio package, and the first primary audio package comprises the transmitter unit address of the first transmitter unit. The second transmitter unit is configured to transmit the first audio block of the audio stream in the first audio frame, the first audio block comprising the first primary audio package comprising the transmitter unit address of the second transmitter unit. The first transmitter unit is further configured to transmit a first primary pilot package. The first primary pilot package comprises the transmitter unit address of the first transmitter unit, a first primary time offset, and a channel identifier of a first primary audio package of a second audio block of the audio stream in a second audio frame. The first transmitter unit is further configured to transmit the first primary audio package of the second audio block at a start time depending on the first primary time offset and the channel identifier of the first primary audio package of the second audio block. Also disclosed is a transmitter unit for transmitting wireless audio streams, wherein the transmitter unit is configured for transmitting an electromagnetic signal as described herein.
  • While receiving at a hearing device an audio stream from a transmitter unit, the user of the hearing device may move away from the transmitter unit or something may interfere with the signal, thus causing the signal strength to decrease. Eventually this may lead to total loss of the signal and failure to receive the audio stream. Enabling the hearing device to switch to, and receive the audio stream, from an alternative transmitter unit, is provided by transmitting pilot packages from the transmitter units.
  • Receiving, at a hearing device, pilot packages from other transmitter units transmitting the same audio stream as the hearing device is already receiving, provides an ability to seamlessly switch to receiving the audio stream from an alternative transmitter unit from the beginning of a subsequent such as the following or next audio frame. This is achieved by transmitting pilot packages comprising information of what channel to receive the first audio package of a subsequent such as the following or next audio block, when to receive it, and which transmitter unit to receive it from.
  • Thereby the need for transmitting data from the hearing device is eliminated or at least reduced, thus reducing power consumption and enhancing battery life of the hearing device. Further, it enables shift to receiving from an alternative transmitter unit to be performed without loss of data.
  • It is an advantage of the present invention that simple switching between different transmitter units is provided.
  • Further, provision of a primary pilot package enables simpler and less power-consuming handover.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • The above and other features and advantages of the present invention will become readily apparent to those skilled in the art by the following detailed description of exemplary embodiments thereof with reference to the attached drawings, in which:
  • Fig. 1
    schematically illustrates use of an exemplary audio system,
    Fig. 2
    schematically illustrates an exemplary audio system,
    Fig. 3
    schematically illustrates an exemplary electromagnetic signal,
    Fig. 4
    schematically illustrates different audio blocks,
    Fig. 5
    is a flow diagram of an exemplary method according to the invention,
    Fig. 6
    schematically illustrates an exemplary audio package, and
    Fig. 7
    schematically illustrates an exemplary pilot package.
  • The figures are schematic and simplified for clarity, and they merely show details which are essential to the understanding of the invention, while other details have been left out. Throughout, the same reference numerals are used for identical or corresponding parts.
  • DETAILED DESCRIPTION
  • The present invention relates to a method and an audio system capable of transmitting or streaming audio stream(s) representing audio track(s) to hearing devices.
  • In an audio system, one or more transmitter units are configured for broadcasting or transmitting an audio stream, e.g. to one or more hearing devices. A transmitter unit transmits one or more audio streams. A transmitter unit is identified by a transmitter unit address.
  • An audio track is an audible signal. Exemplary audible signals are an airport call, a movie sound track, speech or a piece of music.
  • An audio stream is an electromagnetic signal representative of an audio track. An audio stream is represented by a number of audio blocks each comprising one or more audio packages. An audio package comprises a finite part of an audio stream. Further explanation of an audio stream can be found in Fig. 3 and the accompanying description.
  • An audio block comprises one or more audio packages. An audio block comprises one or more primary audio packages and/or one or more secondary audio packages. A secondary audio package constitutes a copy of a primary audio package allowing a hearing device to recover lost packages. Further, an audio block comprises first audio packages and/or second audio packages for example constituting audio stream data for a left or a right ear, respectively. An audio block comprises a first primary audio package and/or a second primary audio package. Further, a first secondary audio package and/or a second secondary audio package may be included in the audio block(s). Sending the same audio data in two or more audio packages provides improved quality of sound at the receiver. Further explanation of audio blocks and audio packages can be found in Fig. 4 and the accompanying description.
  • An audio stream comprises a number of pilot packages. A pilot package comprises information about a subsequent such as the following or next audio block.
  • An audio frame comprises an audio block with one or more audio packages, and one or more pilot packages including a primary and/or a secondary pilot package. An audio frame may comprise a tertiary pilot package to further improve handover between transmitter units. An audio block may have a length between 0.240 ms and 8.0 ms, such as in the range from 0.380 ms to 6.8 ms, such as in the range from 2.0 ms to 3.5 ms, e.g. 2.85 ms. An illustrative example of an audio frame can be found in Fig. 3 and the accompanying description.
  • An audio stream may comprise an audio stream identifier, which may comprise one or more elements such as audio track identification, transmitter unit address, audio group identification etc. Audio track identification may enable selection of audio streams representative of the same audio track, and audio group identification may identify a certain group of audio tracks or audio streams e.g. an audio group may be audio tracks in the same or similar language, e.g. English, Danish or Chinese.
  • An audio package comprises transmitter unit address of the transmitter unit transmitting the audio package, thus enabling the hearing device to sort out audio packages sent from other transmitter units.
  • A pilot package comprises information enabling receipt of a subsequent such as the following or next audio block from the transmitter unit sending the audio stream in question. A pilot package comprises one or more time offsets indicative of timing between packages and/or audio blocks in the audio stream. Further, a pilot package comprises a channel identifier. A channel identifier indicates the channel of audio package(s) in a subsequent such as the following audio block. Even further, a pilot package comprises transmitter unit address and/or audio stream identifier. A pilot package may comprise network identifier or other data indicative of a group of transmitter units, thereby enabling a hearing device to select or limit searching for pilot packages of a group of transmitter units. A pilot package from a transmitter unit enables a hearing device to receive a subsequent such as the following audio block from the transmitter unit in question by configuring the hearing device in accordance with information comprised within the received pilot package. A primary pilot package in an audio block comprises transmitter unit address, a primary time offset, and channel identifier of the first primary audio package of a subsequent such as the following audio block. A secondary pilot package in an audio block comprises transmitter unit address, a secondary time offset, and channel identifier of the first primary audio package of a subsequent such as the following audio block.
  • A time offset comprised within the pilot package indicates the time of transmittal of a subsequent such as the following audio block. The time offset may e.g. be the time from start of transmission of the pilot package to the time of start of transmission of the following audio block and/or to the time of start of transmission of an audio package in the following audio block. An illustrative example of the time offset can be found in Fig. 3 and the accompanying description.
  • The channel identifier comprised within the pilot package, is indicative of the channel where a subsequent such as the following audio block is transmitted. A channel may be a known frequency.
  • The transmitter unit address comprised within the pilot package is transmitter unit address of the transmitter unit from where the pilot package was transmitted, thus enabling the hearing device to identify the transmitter unit from where it may receive following audio packages corresponding to the pilot package in question.
  • An audio frame has a time duration or period length T. T may be defined as being from start of transmission of an audio block to the start of transmission of the following audio block. T is defined as being the time from start of transmission of the first primary audio package of the first audio block to the start of transmission of the first primary audio package of the second audio block. The period length T may be fixed e.g. be a time of between 2 ms and 20 ms, such as between 5 ms and 12 ms or such as between 6 ms and 10.2 ms, or between 6 ms and 6.5 ms, or between 7.2 ms and 7.7 ms, or between 9.8 ms and 10.2 ms. A long period length T may be beneficial for providing increased possibility of power saving in a hearing device, as a long period length T provides for a long duration where the receiver may be switched off. However, a long T leads to an increased latency, meaning that a long T is not sufficient if the audio needs to be synchronized with e.g. a movie. Hence a short T is beneficial if the audio is to be synchronized with another input, or is to be happening as close to real time as possible.
  • The audio system comprises a first transmitter unit and optionally a second transmitter unit or optionally any number of a plurality of transmitter units. See e.g. transmitter units of Fig. 1 for an illustrative example of an audio system comprising a plurality of transmitter units.
  • Transmitting and receiving the wireless audio stream may be achieved by using wireless technology, thus transmitting audio blocks at one or more frequencies, e.g. in the range from 2.4 GHz to 2.5 GHz, in the range from 800 MHz to 1 GHz, in the range from 3.6 GHz to 3.7 GHz, and/or in the range from 4.9 GHz to 5.9 GHz.
  • A pilot package is sent on a pilot channel. Pilot packages may be transmitted on pilot channels selected from one or more available channels. The pilot channel for a pilot package may be selected from a subset of available channels, thus further reducing load on the hearing device during search for available transmitter units, by allowing the hearing device to only need to listen for pilot packages of alternative transmitter units at known channel(s). The channel(s) for pilot packages may be at one or more frequencies, e.g. in the range from 2.4 GHz to 2.5 GHz, in the range from 800 MHz to 1 GHz, in the range from 3.6 GHz to 3.7 GHz, and/or in the range from 4.9 GHz to 5.9 GHz.
  • Pilot package(s) may be transmitted in the same frequency range as audio blocks. Alternatively, pilot packages may be transmitted in a different frequency range than audio blocks and/or by using a different modulation scheme.
  • Transmission of pilot packages may be performed using a frequency hopping scheme, i.e. the pilot channel may be selected according to a frequency hopping scheme between three or more channels. The frequency hopping scheme may be random or pseudo-random or predetermined.
  • The method for transmitting wireless audio streams may comprise transmitting a first secondary pilot package, e.g. in the first audio frame. The first secondary pilot package may comprise transmitter unit address of the first transmitter unit, i.e. the transmitter unit from where it was transmitted, a first secondary time offset, and/or channel identifier of an audio package, such as the first primary audio package, of the second audio block. Provision of a secondary pilot channel enables faster switching between transmitter units, which leads to improved sound quality experienced by a moving user.
  • The first secondary time offset may be indicative of time offset between the first secondary pilot package and an audio package, e.g. the first primary audio package, of the second audio block.
  • Transmission of a secondary pilot package enhances the possibility of a hearing device listening to another transmitter unit to be able to receive a pilot package, since either one may be transmitted concurrently with the audio blocks sent from the other transmitter, or at a time period when the receiver of the hearing device is turned off. Thus faster switching or handover between transmitter units is provided for.
  • Selecting secondary time offsets, e.g. selecting the first secondary time offset may be based on a predetermined offset scheme, a random offset scheme, or a pseudo-random offset scheme. Transmitting the secondary pilot package at times that are not fixed in respect to the audio block or primary pilot package further enhance the possibility of a hearing device searching for possible alternative transmitter units to receive a pilot package of a transmitter unit transmitting a desired audio stream.
  • It may be beneficial to wait for a certain time after transmitting the primary pilot package before transmitting the secondary pilot package to improve the chances of a hearing device being able to receive a pilot package. Thus, the time difference between a primary and a secondary pilot package, e.g. the time difference between the first primary pilot package and the first secondary pilot package, may be selected to be larger than a first time threshold. The first time threshold (Tdif,min) may be a percentage of the period length T. The first time threshold (Tdif,min) may be in the range from 0.05T to 0.8T, such as 0.20T, 0.25T, 0.30T, 0.40T, 0.50T, 0.60T or any ranges there between. In an exemplary method, the first time threshold (Tdif,min) is selected to be larger than 0.5T. The first time threshold (Tdif,min) may be larger than the length of an audio block.
  • The first audio block may comprise a second primary audio package. The second primary audio package may comprise transmitter unit address.
  • Transmitting a first audio block may comprise transmitting a second primary audio package. The second primary audio package may comprise transmitter unit address of the first transmitter unit, i.e. the transmitter unit from where it was transmitted. Further, the first audio block may comprise secondary audio package(s) constituting a copy of the primary audio package(s), and allowing for recovering packages which have been dropped. First and second audio packages enables provision of audio data to the left and right ear respectively, thus providing transmission of audio in stereo. All audio packages (first, second, primary, secondary) transmitted from the first transmitter unit may comprise transmitter unit address of the first transmitter unit, i.e. the transmitter unit from which they were transmitted.
  • A pilot package may comprise an audio stream identifier. The audio stream identifier may be indicative of the audio track within the audio stream, allowing a hearing device receiving the pilot package to identify the audio track of the audio stream corresponding to the received pilot package. The audio stream identifier and/or a network identifier and/or other data indicative of a group of transmitter units in the pilot package may allow the hearing device to only consider switching to alternative transmitter units that transmits one of a group of specific audio streams, e.g. the same audio track as the hearing device is already receiving.
  • In an exemplary audio system, a plurality of audio streams comprising a number of different audio tracks may be transmitted. The hearing device may be provided with information of an audio stream from receiving the corresponding pilot package. When the hearing device wishes to switch to receiving from an alternative transmitter unit, the hearing device examines the audio stream identifiers comprised within the received pilot packages, the hearing device may thus ensure that switching is performed so as to receive the correct audio track from an alternative transmitter unit, i.e. the audio track which is already being received from the first transmitter unit.
  • The method may be utilized by transmitting an electromagnetic signal in accordance with the method as described.
  • The electromagnetic signal comprises a plurality of audio blocks, including a first audio block in a first audio frame and a second audio block in a second audio frame following the first audio frame. Audio blocks of the electromagnetic signal, e.g. the first audio block and the second audio block, each comprise one or more audio packages including a first primary audio package.
  • The electromagnetic signal comprises a first primary pilot package in the first audio frame. The first primary pilot package and the first primary audio package of the second audio block are separated by a first primary time offset. The first primary pilot package comprises transmitter unit address, the first primary time offset, and channel identifier of the first primary audio package of the second audio block.
  • The electromagnetic signal may comprise a first secondary pilot package in the first audio frame. The first secondary pilot package and the first primary audio package of the second audio block may be separated by a first secondary time offset. The first secondary pilot package may comprise transmitter unit address, the first secondary time offset, and channel identifier of the first primary audio package of the second audio block.
  • Transmission of an audio stream as described is performed by a transmitter unit or an audio system comprising one or more transmitter units.
  • An exemplary audio system for transmitting wireless audio streams comprises a first transmitter unit configured for transmitting audio blocks. Each audio block includes one or more audio packages including a first primary audio package. The first primary audio package comprises transmitter unit address of the respective transmitter.
  • The first transmitter unit is configured to transmit a first audio block in a first audio frame. The first audio block comprises a first primary audio package, and the first primary audio package comprises transmitter unit address of the first transmitter unit.
  • The first transmitter unit is further configured to transmit a first primary pilot package. The first primary pilot package comprises transmitter unit address of the first transmitter unit, a first primary time offset, and channel identifier of a first primary audio package of a second audio block in a second audio frame.
  • The first transmitter unit is further configured to transmit the first primary audio package of the second audio block at a start time depending on the first primary time offset and the channel identifier.
  • The second audio block is thus transmitted from the first transmitter unit on a channel according to the channel identifier comprised within the first primary pilot package, and at a time in accordance with the first primary time offset comprised within the first primary pilot package. Thereby a hearing device receiving the first primary pilot package is able to receive the second audio block based on information in the primary pilot package.
  • The first primary time offset and primary time offsets in general may be fixed or randomly or pseudo-randomly selected. However, whether fixed or randomly or pseudo-randomly selected, the time of transmitting the second audio block is known when transmitting the first primary pilot package. In an exemplary method and audio system, the (first) primary pilot package follows directly after the audio block.
  • The first secondary time offset and secondary time offsets in general may be randomly or pseudo-randomly selected. However, whether fixed or randomly or pseudo-randomly selected, the time of transmitting the second audio block is known when transmitting the first secondary pilot package.
  • The audio system may comprise a second transmitter unit, wherein the second transmitter unit may be configured to transmit a first audio block in a first audio frame. The first audio block comprises a first primary audio package, and the first primary audio package comprises transmitter unit address of the second transmitter unit.
  • The second transmitter unit may further be configured to transmit a first primary pilot package. The first primary pilot package comprises transmitter unit address of the second transmitter unit, a first primary time offset, and channel identifier of a first primary audio package of a second audio block in a second audio frame. The second transmitter unit may further be configured to transmit the first primary audio package of the second audio block at a start time depending on the first primary time offset and the channel identifier of the first primary pilot package from the second transmitter.
  • Fig. 1 schematically illustrates the functionality of an exemplary audio system 2. The audio system 2 is illustrated with a plurality of transmitter units 6 connected to a transmitter control unit 4. A user in a first position 50 wearing a hearing device (not shown), receives an audio stream from a first transmitter unit 7. When the user 50, moves to another position or area 50', the audio stream signal transmitted from the first transmitter unit 7 may become weak. The hearing device performs a search, which is facilitated by receiving pilot packages of available transmitter units 6. The hearing device identifies a second transmitter unit 7' transmitting the same audio track and hence change to continue the reception by receiving the audio stream from the second transmitter unit 7'.
  • Fig. 2 schematically illustrates an exemplary audio system 2 in more detail. The audio system 2 comprises one or a plurality of transmitter units 6 as illustrated, a transmitter control unit 4, an audio system control unit 8 and a user interface 10. The transmitter units 6 stream audio data comprising audio packages and pilot packages according to the method described herein. The transmitter control unit 4 controls the transmitter units 6, e.g. controlling for each transmitter unit 6 which audio track to stream and operating parameters of the transmitter units. The audio system control unit 8 controls the transmitter units 6 via the transmitter control unit 4, in accordance with external inputs. External input may in the exemplary audio system 2 be provided by a user interface 10. The user interface may be accessed either by an operator or by a user.
  • Fig. 3 schematically illustrates an exemplary electromagnetic signal 100. The electromagnetic signal 100 may in an exemplary audio system be transmitted from any of the transmitter units 6 as shown in figure 1 and 2. The electromagnetic signal 100 represents an audio stream and is divided into audio frames, whereof a first audio frame 104, a second audio frame 114, and a third audio frame 124 with a fixed period length of T = 10 ms is illustrated. Each audio frame comprises an audio block 101, 111, 121, a primary pilot package 102, 112, 122, and optionally a secondary pilot package 103, 113, 123, respectively. The audio blocks 101, 111, 121 comprise at least a first primary audio package (not shown) and may in addition comprise any number of audio packages. The number of audio packages does not need to be the same for all audio blocks.
  • The first audio frame 104 starts by a first primary audio package of the first audio block 101 being transmitted. After transmitting the first primary audio block 101, a first primary pilot package 102 is transmitted, and optionally a first secondary pilot package 103 is transmitted.
  • The first primary pilot package 102 comprises information as to how (e.g. channel identifier of the first primary audio package of the second audio block) and when (e.g. first primary time offset 106) to receive the first primary audio package of the second audio block 111. The first primary pilot package 102 comprises a first primary time offset 106 indicating the time between transmittal of the first primary pilot package 102 and transmittal of the first primary audio package of the second audio block 111 of the second audio frame 114. The first primary pilot package is transmitted on a first primary pilot channel selected from a subset of three or more available channels according to a pseudo-random frequency hopping scheme.
  • The first secondary pilot package 103 comprises, as the first primary pilot package, information as to how and when to receive the first primary audio package of the second audio block 111. The first secondary pilot package 103 comprises a first secondary time offset 108 indicating the time between transmittal of the first secondary pilot package 103 and transmittal of the first primary audio package of the second audio block 111 of the second audio frame 114.
  • In an exemplary electromagnetic signal, the time duration T of an audio frame 104, 114, 124 is constant, and may e.g. be a time of between 2 ms and 20 ms, such as between 5 ms and 12 ms or such as between 6 ms and 10.2 ms, or between 6 ms and 6.5 ms, or between 7.2 ms and 7.7 ms, or between 9.8 ms and 10.2 ms.
  • The primary pilot packages 102, 112, 122 may be transmitted at a time within the respective audio frames resulting in that the primary time offsets 106, 116, 126 are fixed and equal for all audio frames 104, 114, 124. The secondary pilot packages 103, 113, 123 may be transmitted at a time selected randomly or pseudo-randomly, resulting in a random or pseudo random secondary time offset 108, 118, 128 between the respective secondary pilot packages and first primary audio packages of the following audio blocks.
  • Fig. 4 (a) to (d) illustrate four different exemplary audio blocks 200, 200′, 200", 200‴. Fig. 4(a) illustrates an audio block 200 comprising a primary audio package 202, e.g. a mono audio signal. Fig. 4(b) illustrates an audio block 200' of an exemplary mono signal comprising a primary audio package 202 and a secondary audio package 204. The secondary audio package 204 may be a copy of the primary audio package 202, to enhance chances of a successful reception of data in a hearing device. Fig. 4(c) illustrates an audio block 200" of an exemplary stereo signal. The audio block 200" in Fig. 4(c) comprises a first primary audio package 206 and a second primary audio package 208 for right and left ear, respectively. The audio block 200" illustrated in Fig. 4(c) further comprises a first secondary audio package 210 and a second secondary audio package 212. The first secondary audio package 210 may be a copy of the first primary audio package 206, and the second secondary audio package 212 may be a copy of the second primary audio package 208. Fig. 4(d) illustrates an audio block 200‴ of an exemplary stereo signal. The audio block 200‴ illustrated in Fig. 4d comprises a first tertiary audio package 214 and a second tertiary audio package 216. The first tertiary audio package 214 may be a copy of the first secondary right audio package 210 and/or the first primary audio package 206. The second tertiary audio package 216 may be a copy of the second secondary audio package 212 and/or the second primary audio package 208. A "copy of" means that at least the audio data of the audio packages are identical.
  • Fig. 5 is a flow diagram of an exemplary method 300 according to the invention. The method 300 comprises transmitting 302 a first audio block, transmitting 304 a first primary pilot package and transmitting 308 a second audio block. Optionally, the method 300 comprises transmitting 306 a first secondary pilot package after transmitting 304 the first primary pilot package and before transmitting 308 the second audio block in the second audio frame.
  • Transmitting 302 the first audio block comprises transmitting at least a first primary audio package comprising transmitter unit address of the transmitter unit from which it was transmitted.
  • Transmitting 304 the first primary pilot package comprises transmitting transmitter unit address of the transmitter unit from which it was transmitted, a first primary time offset, and a channel identifier of the first primary audio package of the second audio block in a second audio frame.
  • Optional transmittal 306 of a first secondary pilot package comprises transmitting a first secondary pilot package comprising transmitter unit address of the transmitter unit from which it was transmitted, a first secondary time offset, and a channel identifier of the first primary audio package of the second audio block in a second audio frame.
  • Fig. 6 illustrates an exemplary audio package comprising transmitter unit address, optional audio stream identifier, and audio stream data. Transmitter unit address may be indicative of the transmitter unit from which the audio package was transmitted.
  • Audio stream identifier may comprise data indicative of the audio stream, e.g. audio track identification, audio group identification etc. Audio stream data comprises a finite part of the audible information forming the audio stream.
  • Fig. 7 illustrates an exemplary primary and/or secondary pilot package comprising transmitter unit address, channel identifier, time offset, optional audio stream identifier, and optional network identifier. Transmitter unit address may be indicative of the transmitter unit from which the pilot package was transmitted. Channel identifier may be indicative of the channel where the next audio block of the audio stream is transmitted, i.e. the channel identifier may be a frequency or a number indicating a frequency. Time offset may be indicative of when the next audio block is transmitted.
  • Audio stream identifier may comprise data indicative of the audio stream, e.g. audio track identification, audio group identification etc. Network identifier may be indicative of a group of transmitter units, e.g. a network identifier may comprise a subnet address. The information comprised within a pilot package may enable the hearing device to receive the following audio block from the transmitter unit transmitting the audio stream in question by configuring the hearing device in accordance with the information.
  • LIST OF REFERENCES
  • 2
    audio system
    4
    transmitter control unit
    6
    transmitter unit
    8
    audio system control unit
    10
    audio system user interface
    50, 50'
    user of a hearing device
    100
    electromagnetic signal
    101
    first audio block (A1)
    102
    first primary pilot package (P1,1)
    103
    first secondary pilot package (P1,2)
    104
    first audio frame
    106
    first primary time offset (Δt1,1)
    108
    first secondary time offset (Δt1,2)
    111
    second audio block (A2)
    112
    second primary pilot package (P2,1)
    113
    second secondary pilot package (P2,2)
    114
    second audio frame
    116
    second primary time offset (Δt2,1)
    118
    second secondary time offset (Δt2,2)
    121
    third audio block (A3)
    122
    third primary pilot package (P3,1)
    123
    third secondary pilot package (P3,2)
    124
    third audio frame
    126
    third primary time offset (Δt3,1)
    128
    third secondary time offset (Δt3,2)
    200, 200′, 200", 200‴
    audio block
    202
    primary audio package
    204
    secondary audio package
    206
    first primary audio package
    208
    second primary audio package
    210
    first secondary audio package
    212
    second secondary audio package
    214
    first tertiary audio package
    216
    second tertiary audio package
    300
    method for transmitting
    302
    transmitting first audio block
    304
    transmitting first primary pilot package
    306
    transmitting first secondary pilot package
    308
    transmitting second audio block

Claims (14)

  1. Method for transmitting wireless audio streams to one or more hearing devices in an audio system comprising a first transmitter unit and a second transmitter unit, the method comprising
    - transmitting a first audio block of an audio stream in a first audio frame with the first transmitter unit,
    characterized in that the method comprises
    - transmitting the first audio block of the audio stream in the first audio frame with the second transmitter unit,
    - transmitting a first primary pilot package with the first transmitter unit, the first primary pilot package comprising the transmitter unit address of the first transmitter unit, a first primary time offset, and a channel identifier of a first primary audio package of a second audio block of the audio stream in a second audio frame; and
    - transmitting a first primary audio package of the second audio block at a start time depending on the first primary time offset and the channel identifier;
    and in that the first audio block comprises a first primary audio package comprising a transmitter unit address of the transmitter unit transmitting the first primary audio package.
  2. Method according to claim 1, the method comprising transmitting a first secondary pilot package, the first secondary pilot package comprising the transmitter unit address of the first transmitter unit, a first secondary time offset, and the channel identifier of the first primary audio package of the second audio block, the first secondary time offset being indicative of a time offset between the first secondary pilot package and the first primary audio package of the second audio block.
  3. Method according to claim 2, comprising selecting the first secondary time offset based on a predetermined offset scheme, a random offset scheme, or a pseudo-random offset scheme.
  4. Method according to any of claims 2-3, wherein the time difference between the first primary pilot package and the first secondary pilot package is larger than a first time threshold.
  5. Method according to any of the preceding claims, wherein transmitting the first audio block comprises transmitting a second primary audio package comprising the transmitter unit address of the first transmitter unit.
  6. Method according to any of the preceding claims, wherein the first primary pilot package comprises an audio stream identifier.
  7. An electromagnetic signal for transmitting wireless audio streams to one or more hearing devices, the electromagnetic signal comprising a plurality of audio blocks of an audio stream including a first audio block of the audio stream in a first audio frame and a second audio block of the audio stream in a second audio frame following the first audio frame, characterized in that the first audio block and the second audio block each comprising a first primary audio package comprising a transmitter unit address, the electromagnetic signal comprising a first primary pilot package in the first audio frame, the first primary pilot package and the first primary audio package of the second audio block being separated by a first primary time offset, wherein the first primary pilot package comprises the transmitter unit address, the first primary time offset and a channel identifier of the first primary audio package of the second audio block.
  8. Electromagnetic signal according to claim 7, comprising a first secondary pilot package in the first audio frame, the first secondary pilot package and the first primary audio package of the second audio block being separated by a first secondary time offset, wherein the first secondary pilot package comprises the transmitter unit address, the first secondary time offset and the channel identifier of the first primary audio package of the second audio block.
  9. Electromagnetic signal according to claim 8, wherein the time difference between the first primary pilot package and the first secondary pilot package is larger than a first time threshold.
  10. Electromagnetic signal according to any of claims 7-9, wherein the first audio block comprises a second primary audio package comprising the transmitter unit address.
  11. Electromagnetic signal according to any of claims 7-10, wherein the first primary pilot package comprises an audio stream identifier.
  12. Audio system for transmitting wireless audio streams to one or more hearing devices, the audio system comprising one or more transmitter units including a first transmitter unit and a second transmitter unit, the one or more transmitter units being configured for transmitting audio blocks,
    characterized in that each audio block of an audio stream includes a first primary audio package comprising a transmitter unit address of the respective transmitter, wherein the first transmitter unit is configured to
    - transmit a first audio block of the audio stream in a first audio frame, the first audio block comprising a first primary audio package comprising the transmitter unit address of the first transmitter unit;
    wherein the second transmitter unit is configured to transmit the first audio block of the audio stream in the first audio frame, the first audio block comprising the first primary audio package comprising the transmitter unit address of the second transmitter unit;
    wherein the first transmitter unit is further configured to
    - transmit a first primary pilot package, the first primary pilot package comprising the transmitter unit address of the first transmitter unit, a first primary time offset, and a channel identifier of a first primary audio package of a second audio block of the audio stream in a second audio frame; and
    - transmit the first primary audio package of the second audio block at a start time depending on the first primary time offset and the channel identifier of the first primary audio package of the second audio block.
  13. Audio system according to claim 12, wherein the second transmitter unit is configured to
    - transmit a first primary pilot package, the first primary pilot package comprising the transmitter unit address of the second transmitter unit, a first primary time offset, and the channel identifier of a first primary audio package of a second audio block in a second audio frame; and
    - transmit the first primary audio package of the second audio block at a start time depending on the first primary time offset and the channel identifier of the first primary audio package of the second audio block from the second transmitter.
  14. Transmitter unit for transmitting wireless audio streams, wherein the transmitter unit is configured for transmitting an electromagnetic signal according to any of the claims 7-11.
EP19168691.4A 2013-05-15 2013-05-15 Method and apparatus for wireless transmission of audio streams Active EP3528514B1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
DK19168691.4T DK3528514T3 (en) 2013-05-15 2013-05-15 Method and device for wireless transmission of audio streams
EP19168691.4A EP3528514B1 (en) 2013-05-15 2013-05-15 Method and apparatus for wireless transmission of audio streams

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
EP13167809.6A EP2804399B1 (en) 2013-05-15 2013-05-15 Method and apparatus for transmitting wireless audio streams
EP19168691.4A EP3528514B1 (en) 2013-05-15 2013-05-15 Method and apparatus for wireless transmission of audio streams

Related Parent Applications (2)

Application Number Title Priority Date Filing Date
EP13167809.6A Division EP2804399B1 (en) 2013-05-15 2013-05-15 Method and apparatus for transmitting wireless audio streams
EP13167809.6A Division-Into EP2804399B1 (en) 2013-05-15 2013-05-15 Method and apparatus for transmitting wireless audio streams

Publications (2)

Publication Number Publication Date
EP3528514A1 EP3528514A1 (en) 2019-08-21
EP3528514B1 true EP3528514B1 (en) 2021-11-03

Family

ID=48482912

Family Applications (2)

Application Number Title Priority Date Filing Date
EP13167809.6A Active EP2804399B1 (en) 2013-05-15 2013-05-15 Method and apparatus for transmitting wireless audio streams
EP19168691.4A Active EP3528514B1 (en) 2013-05-15 2013-05-15 Method and apparatus for wireless transmission of audio streams

Family Applications Before (1)

Application Number Title Priority Date Filing Date
EP13167809.6A Active EP2804399B1 (en) 2013-05-15 2013-05-15 Method and apparatus for transmitting wireless audio streams

Country Status (2)

Country Link
EP (2) EP2804399B1 (en)
DK (2) DK2804399T3 (en)

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2004110099A2 (en) * 2003-06-06 2004-12-16 Gn Resound A/S A hearing aid wireless network
GB2463277B (en) * 2008-09-05 2010-09-08 Sony Comp Entertainment Europe Wireless communication system
JP5925209B2 (en) * 2010-10-14 2016-05-25 ジーエヌ リザウンド エー/エスGn Resound A/S Hearing apparatus and method for compensating for frequency difference between transmitter and receiver
WO2013106024A1 (en) * 2011-04-05 2013-07-18 Planetmac, Llc Wireless audio dissemination system
US8918569B2 (en) * 2011-08-10 2014-12-23 Intel Corporation Streaming audio visual content simultaneously to different topologies on a wireless adapter

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
IAN POOLE: "GSM Handover | GSM Handoff | Radio-Electronics.Com", 1 December 2009 (2009-12-01), XP055460652, Retrieved from the Internet <URL:http://www.radio-electronics.com/info/cellulartelecomms/gsm_technical/handover-handoff.php> [retrieved on 20180319] *

Also Published As

Publication number Publication date
EP3528514A1 (en) 2019-08-21
EP2804399B1 (en) 2019-05-15
EP2804399A1 (en) 2014-11-19
DK3528514T3 (en) 2022-01-24
DK2804399T3 (en) 2019-06-03

Similar Documents

Publication Publication Date Title
EP3031218B1 (en) Hearing assistance system and method
US9826320B2 (en) Hearing device and a method for receiving wireless audio streaming
EP3149963B1 (en) Hearing assistance system and method
CN104754468A (en) Hearing device with position data, audio system and related methods
CN110830973B (en) Method for transmitting audio information by using wireless earphone
CN102224699B (en) System and method to implement synchronous channel timing in a wireless communications network
US9232296B2 (en) Method and apparatus for transmitting wireless audio streams
EP3528514B1 (en) Method and apparatus for wireless transmission of audio streams
JP4881454B2 (en) Electronics
US9287998B2 (en) Broadcast device for broadcasting payload data, network device for receiving broadcasted payload data and method for initiating broadcasting payload data
US8666413B2 (en) Base station and handover control method
EP3624356B1 (en) Wireless headset and signal transmission method for the same
EP2804400B1 (en) Hearing device and a method for receiving wireless audio streaming
EP2773135B1 (en) Audio system for audio streaming and associated method
US11381951B2 (en) Wireless Bluetooth (BT) audio output system and control method thereof
CN108632797B (en) Fast Bluetooth connection method and Bluetooth system for reducing interference
CN115996217A (en) Wireless communication method for transmitting and/or receiving audio information and storage medium
CN115967929A (en) Communication method, bluetooth headset and Bluetooth communication system
CN114390404A (en) Synchronous playing recovery method, wireless earphone, earphone and storage medium
EP2890157A1 (en) Hearing device with position data, audio system and related methods
JP2006238122A (en) Radio communication system

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION HAS BEEN PUBLISHED

AC Divisional application: reference to earlier application

Ref document number: 2804399

Country of ref document: EP

Kind code of ref document: P

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20200219

RBV Designated contracting states (corrected)

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

17Q First examination report despatched

Effective date: 20200526

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

INTG Intention to grant announced

Effective date: 20210614

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

AC Divisional application: reference to earlier application

Ref document number: 2804399

Country of ref document: EP

Kind code of ref document: P

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 1445080

Country of ref document: AT

Kind code of ref document: T

Effective date: 20211115

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602013079947

Country of ref document: DE

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: DK

Ref legal event code: T3

Effective date: 20220117

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG9D

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20211103

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 1445080

Country of ref document: AT

Kind code of ref document: T

Effective date: 20211103

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20211103

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20211103

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20211103

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220203

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20211103

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220303

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20211103

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220303

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20211103

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220203

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20211103

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20211103

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20211103

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220204

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20211103

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20211103

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20211103

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20211103

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20211103

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20211103

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602013079947

Country of ref document: DE

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

26N No opposition filed

Effective date: 20220804

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20211103

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20211103

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20220531

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20211103

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20220515

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20220515

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20211103

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20220531

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20230516

Year of fee payment: 11

Ref country code: DK

Payment date: 20230515

Year of fee payment: 11

Ref country code: DE

Payment date: 20230524

Year of fee payment: 11

Ref country code: CH

Payment date: 20230602

Year of fee payment: 11

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20230523

Year of fee payment: 11

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20130515

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20211103

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20211103