EP3528514B1 - Method and apparatus for wireless transmission of audio streams - Google Patents
Method and apparatus for wireless transmission of audio streams Download PDFInfo
- Publication number
- EP3528514B1 EP3528514B1 EP19168691.4A EP19168691A EP3528514B1 EP 3528514 B1 EP3528514 B1 EP 3528514B1 EP 19168691 A EP19168691 A EP 19168691A EP 3528514 B1 EP3528514 B1 EP 3528514B1
- Authority
- EP
- European Patent Office
- Prior art keywords
- audio
- package
- primary
- transmitter unit
- block
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims description 31
- 230000005540 biological transmission Effects 0.000 title description 16
- 238000004891 communication Methods 0.000 description 5
- 230000009286 beneficial effect Effects 0.000 description 3
- 230000001965 increasing effect Effects 0.000 description 3
- 239000013078 crystal Substances 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000001360 synchronised effect Effects 0.000 description 2
- 230000010267 cellular communication Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000018109 developmental process Effects 0.000 description 1
- 230000002708 enhancing effect Effects 0.000 description 1
- 230000005236 sound signal Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R25/00—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
- H04R25/55—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception using an external connection, either wireless or wired
- H04R25/552—Binaural
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R2227/00—Details of public address [PA] systems covered by H04R27/00 but not provided for in any of its subgroups
- H04R2227/005—Audio distribution systems for home, i.e. multi-room use
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R2420/00—Details of connection covered by H04R, not provided for in its groups
- H04R2420/03—Connection circuits to selectively connect loudspeakers or headphones to amplifiers
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R2420/00—Details of connection covered by H04R, not provided for in its groups
- H04R2420/07—Applications of wireless loudspeakers or wireless microphones
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R2460/00—Details of hearing devices, i.e. of ear- or headphones covered by H04R1/10 or H04R5/033 but not provided for in any of their subgroups, or of hearing aids covered by H04R25/00 but not provided for in any of its subgroups
- H04R2460/03—Aspects of the reduction of energy consumption in hearing devices
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R25/00—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
- H04R25/55—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception using an external connection, either wireless or wired
- H04R25/554—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception using an external connection, either wireless or wired using a wireless connection, e.g. between microphone and amplifier or using Tcoils
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R27/00—Public address systems
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Neurosurgery (AREA)
- Otolaryngology (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Signal Processing (AREA)
- Transmitters (AREA)
Description
- The present disclosure relates to an audio system for audio streaming and associated method. More specifically, the present disclosure describes a method and audio system for transmitting wireless audio streams, in particular to hearing device(s).
- Wireless communication to and from hearing devices has been increasing in continuation of the developments within wireless communication technology. In a crowded environment where audio is distributed to the crowd, for example in an airport or in a movie theatre, it is known to stream audio via a telecoil solution having a limited bandwidth with limited possibilities of separating different audio streams.
- Digital solutions of audio streaming have enhanced possibilities for broadcasting audio. However, the range of a single transmitter unit transmitting an audio stream is limited, thus there is a need for a method that allows reception of the same audio stream from different transmitter units.
- The limited battery power of hearing devices however requires ways of minimizing data transmission from the hearing device, in an effort to prolong battery life. Hence the shift from receiving the audio stream from one transmitter unit to receiving the same audio stream from an alternative transmitter unit, demands that the transmission of data from the hearing device is eliminated or seriously minimized.
- Thus, there is a need for an audio system that provides audio streaming to a moving user, without relying on transmission of data back and forth between the audio system and the hearing device during handover between a first and second transmitter unit.
-
WO 2004/110099 discloses a hearing aid comprising a transceiver for interconnection of the hearing aid with a wireless network for communication with a plurality of other devices, and a communication controller that is adapted for controlling data exchange through the network in accordance with a simple network protocol. The hearing aid wireless network facilitates interconnection of a plurality of devices in the network. In an established network, the network master device, in a connected mode, regularly transmits synchronization data, e.g. comprised in a link management package, for synchronization of the slave devices in the network with the master device. During initialization of the network, each device in an acquisition mode transmits interrogation data at a higher rate than the rate of transmission of the synchronization data in the connected mode. -
GB 2 463 277 -
WO 2012/049311 A1 discloses a hearing device that is able to provide a compensation of the differences between an oscillator crystal in a transmitting participant and an oscillator crystal in a receiving participant in a wireless network. -
US 2013/042291 A1 relates generally to devices that source and sink video and audio data. -
US 2012/260295 A1 relates generally to audio dissemination systems, and, more particularly, to a wireless audio dissemination system. - The internet tutorial 'GSM Handover or Handoff downloaded at http://www.radio-electronics.com/info/ cellulartelecomms/gsm_technical/handover-handoff.php teaches different forms of handover procedures and information exchange in the context of cellular communication standards.
- Accordingly, a method for transmitting wireless audio streams to one or more hearing devices in an audio system comprising a first transmitter unit and a second transmitter unit is provided. The method comprises transmitting a first audio block of an audio stream in a first audio frame with the first transmitter unit. The method comprises transmitting the first audio block of the audio stream in the first audio frame with the second transmitter unit. The method further comprises transmitting a first primary pilot package with the first transmitter unit. The first primary pilot package comprises the transmitter unit address of the first transmitter unit, a first primary time offset, and a channel identifier of a first primary audio package of a second audio block of the audio stream in a second audio frame. The method comprises transmitting a first primary audio package of the second audio block at a start time depending on the first primary time offset and the channel identifier. The first audio block comprises a first primary audio package comprising a transmitter unit address of the transmitter unit transmitting the first primary audio package.
- Also disclosed is an electromagnetic signal for transmitting wireless audio streams to one or more hearing devices, the electromagnetic signal comprising a plurality of audio blocks of an audio stream including a first audio block of the audio stream in a first audio frame and a second audio block of the audio stream in a second audio frame following the first audio frame. The first audio block and the second audio block each comprises a first primary audio package comprising a transmitter unit address. The electromagnetic signal comprises a first primary pilot package in the first audio frame. The first primary pilot package and the first primary audio package of the second audio block are separated by a first primary time offset. The first primary pilot package comprises the transmitter unit address, the first primary time offset, and channel identifier of the first primary audio package of the second audio block.
- Also disclosed is an audio system for transmitting wireless audio streams to one or more hearing devices. The audio system comprises one or more transmitter units including a first transmitter unit and a second transmitter unit, the one or more transmitter units being configured for transmitting audio blocks. Each audio block of an audio stream includes a first primary audio package. The first primary audio package comprises a transmitter unit address of the respective transmitter. The first transmitter unit is configured to transmit a first audio block of an audio stream in a first audio frame. The first audio block comprises a first primary audio package, and the first primary audio package comprises the transmitter unit address of the first transmitter unit. The second transmitter unit is configured to transmit the first audio block of the audio stream in the first audio frame, the first audio block comprising the first primary audio package comprising the transmitter unit address of the second transmitter unit. The first transmitter unit is further configured to transmit a first primary pilot package. The first primary pilot package comprises the transmitter unit address of the first transmitter unit, a first primary time offset, and a channel identifier of a first primary audio package of a second audio block of the audio stream in a second audio frame. The first transmitter unit is further configured to transmit the first primary audio package of the second audio block at a start time depending on the first primary time offset and the channel identifier of the first primary audio package of the second audio block. Also disclosed is a transmitter unit for transmitting wireless audio streams, wherein the transmitter unit is configured for transmitting an electromagnetic signal as described herein.
- While receiving at a hearing device an audio stream from a transmitter unit, the user of the hearing device may move away from the transmitter unit or something may interfere with the signal, thus causing the signal strength to decrease. Eventually this may lead to total loss of the signal and failure to receive the audio stream. Enabling the hearing device to switch to, and receive the audio stream, from an alternative transmitter unit, is provided by transmitting pilot packages from the transmitter units.
- Receiving, at a hearing device, pilot packages from other transmitter units transmitting the same audio stream as the hearing device is already receiving, provides an ability to seamlessly switch to receiving the audio stream from an alternative transmitter unit from the beginning of a subsequent such as the following or next audio frame. This is achieved by transmitting pilot packages comprising information of what channel to receive the first audio package of a subsequent such as the following or next audio block, when to receive it, and which transmitter unit to receive it from.
- Thereby the need for transmitting data from the hearing device is eliminated or at least reduced, thus reducing power consumption and enhancing battery life of the hearing device. Further, it enables shift to receiving from an alternative transmitter unit to be performed without loss of data.
- It is an advantage of the present invention that simple switching between different transmitter units is provided.
- Further, provision of a primary pilot package enables simpler and less power-consuming handover.
- The above and other features and advantages of the present invention will become readily apparent to those skilled in the art by the following detailed description of exemplary embodiments thereof with reference to the attached drawings, in which:
- Fig. 1
- schematically illustrates use of an exemplary audio system,
- Fig. 2
- schematically illustrates an exemplary audio system,
- Fig. 3
- schematically illustrates an exemplary electromagnetic signal,
- Fig. 4
- schematically illustrates different audio blocks,
- Fig. 5
- is a flow diagram of an exemplary method according to the invention,
- Fig. 6
- schematically illustrates an exemplary audio package, and
- Fig. 7
- schematically illustrates an exemplary pilot package.
- The figures are schematic and simplified for clarity, and they merely show details which are essential to the understanding of the invention, while other details have been left out. Throughout, the same reference numerals are used for identical or corresponding parts.
- The present invention relates to a method and an audio system capable of transmitting or streaming audio stream(s) representing audio track(s) to hearing devices.
- In an audio system, one or more transmitter units are configured for broadcasting or transmitting an audio stream, e.g. to one or more hearing devices. A transmitter unit transmits one or more audio streams. A transmitter unit is identified by a transmitter unit address.
- An audio track is an audible signal. Exemplary audible signals are an airport call, a movie sound track, speech or a piece of music.
- An audio stream is an electromagnetic signal representative of an audio track. An audio stream is represented by a number of audio blocks each comprising one or more audio packages. An audio package comprises a finite part of an audio stream. Further explanation of an audio stream can be found in
Fig. 3 and the accompanying description. - An audio block comprises one or more audio packages. An audio block comprises one or more primary audio packages and/or one or more secondary audio packages. A secondary audio package constitutes a copy of a primary audio package allowing a hearing device to recover lost packages. Further, an audio block comprises first audio packages and/or second audio packages for example constituting audio stream data for a left or a right ear, respectively. An audio block comprises a first primary audio package and/or a second primary audio package. Further, a first secondary audio package and/or a second secondary audio package may be included in the audio block(s). Sending the same audio data in two or more audio packages provides improved quality of sound at the receiver. Further explanation of audio blocks and audio packages can be found in
Fig. 4 and the accompanying description. - An audio stream comprises a number of pilot packages. A pilot package comprises information about a subsequent such as the following or next audio block.
- An audio frame comprises an audio block with one or more audio packages, and one or more pilot packages including a primary and/or a secondary pilot package. An audio frame may comprise a tertiary pilot package to further improve handover between transmitter units. An audio block may have a length between 0.240 ms and 8.0 ms, such as in the range from 0.380 ms to 6.8 ms, such as in the range from 2.0 ms to 3.5 ms, e.g. 2.85 ms. An illustrative example of an audio frame can be found in
Fig. 3 and the accompanying description. - An audio stream may comprise an audio stream identifier, which may comprise one or more elements such as audio track identification, transmitter unit address, audio group identification etc. Audio track identification may enable selection of audio streams representative of the same audio track, and audio group identification may identify a certain group of audio tracks or audio streams e.g. an audio group may be audio tracks in the same or similar language, e.g. English, Danish or Chinese.
- An audio package comprises transmitter unit address of the transmitter unit transmitting the audio package, thus enabling the hearing device to sort out audio packages sent from other transmitter units.
- A pilot package comprises information enabling receipt of a subsequent such as the following or next audio block from the transmitter unit sending the audio stream in question. A pilot package comprises one or more time offsets indicative of timing between packages and/or audio blocks in the audio stream. Further, a pilot package comprises a channel identifier. A channel identifier indicates the channel of audio package(s) in a subsequent such as the following audio block. Even further, a pilot package comprises transmitter unit address and/or audio stream identifier. A pilot package may comprise network identifier or other data indicative of a group of transmitter units, thereby enabling a hearing device to select or limit searching for pilot packages of a group of transmitter units. A pilot package from a transmitter unit enables a hearing device to receive a subsequent such as the following audio block from the transmitter unit in question by configuring the hearing device in accordance with information comprised within the received pilot package. A primary pilot package in an audio block comprises transmitter unit address, a primary time offset, and channel identifier of the first primary audio package of a subsequent such as the following audio block. A secondary pilot package in an audio block comprises transmitter unit address, a secondary time offset, and channel identifier of the first primary audio package of a subsequent such as the following audio block.
- A time offset comprised within the pilot package indicates the time of transmittal of a subsequent such as the following audio block. The time offset may e.g. be the time from start of transmission of the pilot package to the time of start of transmission of the following audio block and/or to the time of start of transmission of an audio package in the following audio block. An illustrative example of the time offset can be found in
Fig. 3 and the accompanying description. - The channel identifier comprised within the pilot package, is indicative of the channel where a subsequent such as the following audio block is transmitted. A channel may be a known frequency.
- The transmitter unit address comprised within the pilot package is transmitter unit address of the transmitter unit from where the pilot package was transmitted, thus enabling the hearing device to identify the transmitter unit from where it may receive following audio packages corresponding to the pilot package in question.
- An audio frame has a time duration or period length T. T may be defined as being from start of transmission of an audio block to the start of transmission of the following audio block. T is defined as being the time from start of transmission of the first primary audio package of the first audio block to the start of transmission of the first primary audio package of the second audio block. The period length T may be fixed e.g. be a time of between 2 ms and 20 ms, such as between 5 ms and 12 ms or such as between 6 ms and 10.2 ms, or between 6 ms and 6.5 ms, or between 7.2 ms and 7.7 ms, or between 9.8 ms and 10.2 ms. A long period length T may be beneficial for providing increased possibility of power saving in a hearing device, as a long period length T provides for a long duration where the receiver may be switched off. However, a long T leads to an increased latency, meaning that a long T is not sufficient if the audio needs to be synchronized with e.g. a movie. Hence a short T is beneficial if the audio is to be synchronized with another input, or is to be happening as close to real time as possible.
- The audio system comprises a first transmitter unit and optionally a second transmitter unit or optionally any number of a plurality of transmitter units. See e.g. transmitter units of
Fig. 1 for an illustrative example of an audio system comprising a plurality of transmitter units. - Transmitting and receiving the wireless audio stream may be achieved by using wireless technology, thus transmitting audio blocks at one or more frequencies, e.g. in the range from 2.4 GHz to 2.5 GHz, in the range from 800 MHz to 1 GHz, in the range from 3.6 GHz to 3.7 GHz, and/or in the range from 4.9 GHz to 5.9 GHz.
- A pilot package is sent on a pilot channel. Pilot packages may be transmitted on pilot channels selected from one or more available channels. The pilot channel for a pilot package may be selected from a subset of available channels, thus further reducing load on the hearing device during search for available transmitter units, by allowing the hearing device to only need to listen for pilot packages of alternative transmitter units at known channel(s). The channel(s) for pilot packages may be at one or more frequencies, e.g. in the range from 2.4 GHz to 2.5 GHz, in the range from 800 MHz to 1 GHz, in the range from 3.6 GHz to 3.7 GHz, and/or in the range from 4.9 GHz to 5.9 GHz.
- Pilot package(s) may be transmitted in the same frequency range as audio blocks. Alternatively, pilot packages may be transmitted in a different frequency range than audio blocks and/or by using a different modulation scheme.
- Transmission of pilot packages may be performed using a frequency hopping scheme, i.e. the pilot channel may be selected according to a frequency hopping scheme between three or more channels. The frequency hopping scheme may be random or pseudo-random or predetermined.
- The method for transmitting wireless audio streams may comprise transmitting a first secondary pilot package, e.g. in the first audio frame. The first secondary pilot package may comprise transmitter unit address of the first transmitter unit, i.e. the transmitter unit from where it was transmitted, a first secondary time offset, and/or channel identifier of an audio package, such as the first primary audio package, of the second audio block. Provision of a secondary pilot channel enables faster switching between transmitter units, which leads to improved sound quality experienced by a moving user.
- The first secondary time offset may be indicative of time offset between the first secondary pilot package and an audio package, e.g. the first primary audio package, of the second audio block.
- Transmission of a secondary pilot package enhances the possibility of a hearing device listening to another transmitter unit to be able to receive a pilot package, since either one may be transmitted concurrently with the audio blocks sent from the other transmitter, or at a time period when the receiver of the hearing device is turned off. Thus faster switching or handover between transmitter units is provided for.
- Selecting secondary time offsets, e.g. selecting the first secondary time offset may be based on a predetermined offset scheme, a random offset scheme, or a pseudo-random offset scheme. Transmitting the secondary pilot package at times that are not fixed in respect to the audio block or primary pilot package further enhance the possibility of a hearing device searching for possible alternative transmitter units to receive a pilot package of a transmitter unit transmitting a desired audio stream.
- It may be beneficial to wait for a certain time after transmitting the primary pilot package before transmitting the secondary pilot package to improve the chances of a hearing device being able to receive a pilot package. Thus, the time difference between a primary and a secondary pilot package, e.g. the time difference between the first primary pilot package and the first secondary pilot package, may be selected to be larger than a first time threshold. The first time threshold (Tdif,min) may be a percentage of the period length T. The first time threshold (Tdif,min) may be in the range from 0.05T to 0.8T, such as 0.20T, 0.25T, 0.30T, 0.40T, 0.50T, 0.60T or any ranges there between. In an exemplary method, the first time threshold (Tdif,min) is selected to be larger than 0.5T. The first time threshold (Tdif,min) may be larger than the length of an audio block.
- The first audio block may comprise a second primary audio package. The second primary audio package may comprise transmitter unit address.
- Transmitting a first audio block may comprise transmitting a second primary audio package. The second primary audio package may comprise transmitter unit address of the first transmitter unit, i.e. the transmitter unit from where it was transmitted. Further, the first audio block may comprise secondary audio package(s) constituting a copy of the primary audio package(s), and allowing for recovering packages which have been dropped. First and second audio packages enables provision of audio data to the left and right ear respectively, thus providing transmission of audio in stereo. All audio packages (first, second, primary, secondary) transmitted from the first transmitter unit may comprise transmitter unit address of the first transmitter unit, i.e. the transmitter unit from which they were transmitted.
- A pilot package may comprise an audio stream identifier. The audio stream identifier may be indicative of the audio track within the audio stream, allowing a hearing device receiving the pilot package to identify the audio track of the audio stream corresponding to the received pilot package. The audio stream identifier and/or a network identifier and/or other data indicative of a group of transmitter units in the pilot package may allow the hearing device to only consider switching to alternative transmitter units that transmits one of a group of specific audio streams, e.g. the same audio track as the hearing device is already receiving.
- In an exemplary audio system, a plurality of audio streams comprising a number of different audio tracks may be transmitted. The hearing device may be provided with information of an audio stream from receiving the corresponding pilot package. When the hearing device wishes to switch to receiving from an alternative transmitter unit, the hearing device examines the audio stream identifiers comprised within the received pilot packages, the hearing device may thus ensure that switching is performed so as to receive the correct audio track from an alternative transmitter unit, i.e. the audio track which is already being received from the first transmitter unit.
- The method may be utilized by transmitting an electromagnetic signal in accordance with the method as described.
- The electromagnetic signal comprises a plurality of audio blocks, including a first audio block in a first audio frame and a second audio block in a second audio frame following the first audio frame. Audio blocks of the electromagnetic signal, e.g. the first audio block and the second audio block, each comprise one or more audio packages including a first primary audio package.
- The electromagnetic signal comprises a first primary pilot package in the first audio frame. The first primary pilot package and the first primary audio package of the second audio block are separated by a first primary time offset. The first primary pilot package comprises transmitter unit address, the first primary time offset, and channel identifier of the first primary audio package of the second audio block.
- The electromagnetic signal may comprise a first secondary pilot package in the first audio frame. The first secondary pilot package and the first primary audio package of the second audio block may be separated by a first secondary time offset. The first secondary pilot package may comprise transmitter unit address, the first secondary time offset, and channel identifier of the first primary audio package of the second audio block.
- Transmission of an audio stream as described is performed by a transmitter unit or an audio system comprising one or more transmitter units.
- An exemplary audio system for transmitting wireless audio streams comprises a first transmitter unit configured for transmitting audio blocks. Each audio block includes one or more audio packages including a first primary audio package. The first primary audio package comprises transmitter unit address of the respective transmitter.
- The first transmitter unit is configured to transmit a first audio block in a first audio frame. The first audio block comprises a first primary audio package, and the first primary audio package comprises transmitter unit address of the first transmitter unit.
- The first transmitter unit is further configured to transmit a first primary pilot package. The first primary pilot package comprises transmitter unit address of the first transmitter unit, a first primary time offset, and channel identifier of a first primary audio package of a second audio block in a second audio frame.
- The first transmitter unit is further configured to transmit the first primary audio package of the second audio block at a start time depending on the first primary time offset and the channel identifier.
- The second audio block is thus transmitted from the first transmitter unit on a channel according to the channel identifier comprised within the first primary pilot package, and at a time in accordance with the first primary time offset comprised within the first primary pilot package. Thereby a hearing device receiving the first primary pilot package is able to receive the second audio block based on information in the primary pilot package.
- The first primary time offset and primary time offsets in general may be fixed or randomly or pseudo-randomly selected. However, whether fixed or randomly or pseudo-randomly selected, the time of transmitting the second audio block is known when transmitting the first primary pilot package. In an exemplary method and audio system, the (first) primary pilot package follows directly after the audio block.
- The first secondary time offset and secondary time offsets in general may be randomly or pseudo-randomly selected. However, whether fixed or randomly or pseudo-randomly selected, the time of transmitting the second audio block is known when transmitting the first secondary pilot package.
- The audio system may comprise a second transmitter unit, wherein the second transmitter unit may be configured to transmit a first audio block in a first audio frame. The first audio block comprises a first primary audio package, and the first primary audio package comprises transmitter unit address of the second transmitter unit.
- The second transmitter unit may further be configured to transmit a first primary pilot package. The first primary pilot package comprises transmitter unit address of the second transmitter unit, a first primary time offset, and channel identifier of a first primary audio package of a second audio block in a second audio frame. The second transmitter unit may further be configured to transmit the first primary audio package of the second audio block at a start time depending on the first primary time offset and the channel identifier of the first primary pilot package from the second transmitter.
-
Fig. 1 schematically illustrates the functionality of anexemplary audio system 2. Theaudio system 2 is illustrated with a plurality oftransmitter units 6 connected to atransmitter control unit 4. A user in afirst position 50 wearing a hearing device (not shown), receives an audio stream from afirst transmitter unit 7. When theuser 50, moves to another position or area 50', the audio stream signal transmitted from thefirst transmitter unit 7 may become weak. The hearing device performs a search, which is facilitated by receiving pilot packages ofavailable transmitter units 6. The hearing device identifies a second transmitter unit 7' transmitting the same audio track and hence change to continue the reception by receiving the audio stream from the second transmitter unit 7'. -
Fig. 2 schematically illustrates anexemplary audio system 2 in more detail. Theaudio system 2 comprises one or a plurality oftransmitter units 6 as illustrated, atransmitter control unit 4, an audiosystem control unit 8 and auser interface 10. Thetransmitter units 6 stream audio data comprising audio packages and pilot packages according to the method described herein. Thetransmitter control unit 4 controls thetransmitter units 6, e.g. controlling for eachtransmitter unit 6 which audio track to stream and operating parameters of the transmitter units. The audiosystem control unit 8 controls thetransmitter units 6 via thetransmitter control unit 4, in accordance with external inputs. External input may in theexemplary audio system 2 be provided by auser interface 10. The user interface may be accessed either by an operator or by a user. -
Fig. 3 schematically illustrates an exemplaryelectromagnetic signal 100. Theelectromagnetic signal 100 may in an exemplary audio system be transmitted from any of thetransmitter units 6 as shown infigure 1 and2 . Theelectromagnetic signal 100 represents an audio stream and is divided into audio frames, whereof afirst audio frame 104, asecond audio frame 114, and athird audio frame 124 with a fixed period length of T = 10 ms is illustrated. Each audio frame comprises anaudio block primary pilot package secondary pilot package - The
first audio frame 104 starts by a first primary audio package of thefirst audio block 101 being transmitted. After transmitting the firstprimary audio block 101, a firstprimary pilot package 102 is transmitted, and optionally a firstsecondary pilot package 103 is transmitted. - The first
primary pilot package 102 comprises information as to how (e.g. channel identifier of the first primary audio package of the second audio block) and when (e.g. first primary time offset 106) to receive the first primary audio package of thesecond audio block 111. The firstprimary pilot package 102 comprises a first primary time offset 106 indicating the time between transmittal of the firstprimary pilot package 102 and transmittal of the first primary audio package of thesecond audio block 111 of thesecond audio frame 114. The first primary pilot package is transmitted on a first primary pilot channel selected from a subset of three or more available channels according to a pseudo-random frequency hopping scheme. - The first
secondary pilot package 103 comprises, as the first primary pilot package, information as to how and when to receive the first primary audio package of thesecond audio block 111. The firstsecondary pilot package 103 comprises a first secondary time offset 108 indicating the time between transmittal of the firstsecondary pilot package 103 and transmittal of the first primary audio package of thesecond audio block 111 of thesecond audio frame 114. - In an exemplary electromagnetic signal, the time duration T of an
audio frame - The primary pilot packages 102, 112, 122 may be transmitted at a time within the respective audio frames resulting in that the primary time offsets 106, 116, 126 are fixed and equal for all
audio frames -
Fig. 4 (a) to (d) illustrate four different exemplary audio blocks 200, 200′, 200", 200‴.Fig. 4(a) illustrates anaudio block 200 comprising aprimary audio package 202, e.g. a mono audio signal.Fig. 4(b) illustrates an audio block 200' of an exemplary mono signal comprising aprimary audio package 202 and asecondary audio package 204. Thesecondary audio package 204 may be a copy of theprimary audio package 202, to enhance chances of a successful reception of data in a hearing device.Fig. 4(c) illustrates anaudio block 200" of an exemplary stereo signal. Theaudio block 200" inFig. 4(c) comprises a firstprimary audio package 206 and a secondprimary audio package 208 for right and left ear, respectively. Theaudio block 200" illustrated inFig. 4(c) further comprises a firstsecondary audio package 210 and a secondsecondary audio package 212. The firstsecondary audio package 210 may be a copy of the firstprimary audio package 206, and the secondsecondary audio package 212 may be a copy of the secondprimary audio package 208.Fig. 4(d) illustrates anaudio block 200‴ of an exemplary stereo signal. Theaudio block 200‴ illustrated inFig. 4d comprises a firsttertiary audio package 214 and a secondtertiary audio package 216. The firsttertiary audio package 214 may be a copy of the first secondaryright audio package 210 and/or the firstprimary audio package 206. The secondtertiary audio package 216 may be a copy of the secondsecondary audio package 212 and/or the secondprimary audio package 208. A "copy of" means that at least the audio data of the audio packages are identical. -
Fig. 5 is a flow diagram of anexemplary method 300 according to the invention. Themethod 300 comprises transmitting 302 a first audio block, transmitting 304 a first primary pilot package and transmitting 308 a second audio block. Optionally, themethod 300 comprises transmitting 306 a first secondary pilot package after transmitting 304 the first primary pilot package and before transmitting 308 the second audio block in the second audio frame. - Transmitting 302 the first audio block comprises transmitting at least a first primary audio package comprising transmitter unit address of the transmitter unit from which it was transmitted.
- Transmitting 304 the first primary pilot package comprises transmitting transmitter unit address of the transmitter unit from which it was transmitted, a first primary time offset, and a channel identifier of the first primary audio package of the second audio block in a second audio frame.
-
Optional transmittal 306 of a first secondary pilot package comprises transmitting a first secondary pilot package comprising transmitter unit address of the transmitter unit from which it was transmitted, a first secondary time offset, and a channel identifier of the first primary audio package of the second audio block in a second audio frame. -
Fig. 6 illustrates an exemplary audio package comprising transmitter unit address, optional audio stream identifier, and audio stream data. Transmitter unit address may be indicative of the transmitter unit from which the audio package was transmitted. - Audio stream identifier may comprise data indicative of the audio stream, e.g. audio track identification, audio group identification etc. Audio stream data comprises a finite part of the audible information forming the audio stream.
-
Fig. 7 illustrates an exemplary primary and/or secondary pilot package comprising transmitter unit address, channel identifier, time offset, optional audio stream identifier, and optional network identifier. Transmitter unit address may be indicative of the transmitter unit from which the pilot package was transmitted. Channel identifier may be indicative of the channel where the next audio block of the audio stream is transmitted, i.e. the channel identifier may be a frequency or a number indicating a frequency. Time offset may be indicative of when the next audio block is transmitted. - Audio stream identifier may comprise data indicative of the audio stream, e.g. audio track identification, audio group identification etc. Network identifier may be indicative of a group of transmitter units, e.g. a network identifier may comprise a subnet address. The information comprised within a pilot package may enable the hearing device to receive the following audio block from the transmitter unit transmitting the audio stream in question by configuring the hearing device in accordance with the information.
-
- 2
- audio system
- 4
- transmitter control unit
- 6
- transmitter unit
- 8
- audio system control unit
- 10
- audio system user interface
- 50, 50'
- user of a hearing device
- 100
- electromagnetic signal
- 101
- first audio block (A1)
- 102
- first primary pilot package (P1,1)
- 103
- first secondary pilot package (P1,2)
- 104
- first audio frame
- 106
- first primary time offset (Δt1,1)
- 108
- first secondary time offset (Δt1,2)
- 111
- second audio block (A2)
- 112
- second primary pilot package (P2,1)
- 113
- second secondary pilot package (P2,2)
- 114
- second audio frame
- 116
- second primary time offset (Δt2,1)
- 118
- second secondary time offset (Δt2,2)
- 121
- third audio block (A3)
- 122
- third primary pilot package (P3,1)
- 123
- third secondary pilot package (P3,2)
- 124
- third audio frame
- 126
- third primary time offset (Δt3,1)
- 128
- third secondary time offset (Δt3,2)
- 200, 200′, 200", 200‴
- audio block
- 202
- primary audio package
- 204
- secondary audio package
- 206
- first primary audio package
- 208
- second primary audio package
- 210
- first secondary audio package
- 212
- second secondary audio package
- 214
- first tertiary audio package
- 216
- second tertiary audio package
- 300
- method for transmitting
- 302
- transmitting first audio block
- 304
- transmitting first primary pilot package
- 306
- transmitting first secondary pilot package
- 308
- transmitting second audio block
Claims (14)
- Method for transmitting wireless audio streams to one or more hearing devices in an audio system comprising a first transmitter unit and a second transmitter unit, the method comprising- transmitting a first audio block of an audio stream in a first audio frame with the first transmitter unit,characterized in that the method comprises- transmitting the first audio block of the audio stream in the first audio frame with the second transmitter unit,- transmitting a first primary pilot package with the first transmitter unit, the first primary pilot package comprising the transmitter unit address of the first transmitter unit, a first primary time offset, and a channel identifier of a first primary audio package of a second audio block of the audio stream in a second audio frame; and- transmitting a first primary audio package of the second audio block at a start time depending on the first primary time offset and the channel identifier;and in that the first audio block comprises a first primary audio package comprising a transmitter unit address of the transmitter unit transmitting the first primary audio package.
- Method according to claim 1, the method comprising transmitting a first secondary pilot package, the first secondary pilot package comprising the transmitter unit address of the first transmitter unit, a first secondary time offset, and the channel identifier of the first primary audio package of the second audio block, the first secondary time offset being indicative of a time offset between the first secondary pilot package and the first primary audio package of the second audio block.
- Method according to claim 2, comprising selecting the first secondary time offset based on a predetermined offset scheme, a random offset scheme, or a pseudo-random offset scheme.
- Method according to any of claims 2-3, wherein the time difference between the first primary pilot package and the first secondary pilot package is larger than a first time threshold.
- Method according to any of the preceding claims, wherein transmitting the first audio block comprises transmitting a second primary audio package comprising the transmitter unit address of the first transmitter unit.
- Method according to any of the preceding claims, wherein the first primary pilot package comprises an audio stream identifier.
- An electromagnetic signal for transmitting wireless audio streams to one or more hearing devices, the electromagnetic signal comprising a plurality of audio blocks of an audio stream including a first audio block of the audio stream in a first audio frame and a second audio block of the audio stream in a second audio frame following the first audio frame, characterized in that the first audio block and the second audio block each comprising a first primary audio package comprising a transmitter unit address, the electromagnetic signal comprising a first primary pilot package in the first audio frame, the first primary pilot package and the first primary audio package of the second audio block being separated by a first primary time offset, wherein the first primary pilot package comprises the transmitter unit address, the first primary time offset and a channel identifier of the first primary audio package of the second audio block.
- Electromagnetic signal according to claim 7, comprising a first secondary pilot package in the first audio frame, the first secondary pilot package and the first primary audio package of the second audio block being separated by a first secondary time offset, wherein the first secondary pilot package comprises the transmitter unit address, the first secondary time offset and the channel identifier of the first primary audio package of the second audio block.
- Electromagnetic signal according to claim 8, wherein the time difference between the first primary pilot package and the first secondary pilot package is larger than a first time threshold.
- Electromagnetic signal according to any of claims 7-9, wherein the first audio block comprises a second primary audio package comprising the transmitter unit address.
- Electromagnetic signal according to any of claims 7-10, wherein the first primary pilot package comprises an audio stream identifier.
- Audio system for transmitting wireless audio streams to one or more hearing devices, the audio system comprising one or more transmitter units including a first transmitter unit and a second transmitter unit, the one or more transmitter units being configured for transmitting audio blocks,characterized in that each audio block of an audio stream includes a first primary audio package comprising a transmitter unit address of the respective transmitter, wherein the first transmitter unit is configured to- transmit a first audio block of the audio stream in a first audio frame, the first audio block comprising a first primary audio package comprising the transmitter unit address of the first transmitter unit;wherein the second transmitter unit is configured to transmit the first audio block of the audio stream in the first audio frame, the first audio block comprising the first primary audio package comprising the transmitter unit address of the second transmitter unit;wherein the first transmitter unit is further configured to- transmit a first primary pilot package, the first primary pilot package comprising the transmitter unit address of the first transmitter unit, a first primary time offset, and a channel identifier of a first primary audio package of a second audio block of the audio stream in a second audio frame; and- transmit the first primary audio package of the second audio block at a start time depending on the first primary time offset and the channel identifier of the first primary audio package of the second audio block.
- Audio system according to claim 12, wherein the second transmitter unit is configured to- transmit a first primary pilot package, the first primary pilot package comprising the transmitter unit address of the second transmitter unit, a first primary time offset, and the channel identifier of a first primary audio package of a second audio block in a second audio frame; and- transmit the first primary audio package of the second audio block at a start time depending on the first primary time offset and the channel identifier of the first primary audio package of the second audio block from the second transmitter.
- Transmitter unit for transmitting wireless audio streams, wherein the transmitter unit is configured for transmitting an electromagnetic signal according to any of the claims 7-11.
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
DK19168691.4T DK3528514T3 (en) | 2013-05-15 | 2013-05-15 | Method and device for wireless transmission of audio streams |
EP19168691.4A EP3528514B1 (en) | 2013-05-15 | 2013-05-15 | Method and apparatus for wireless transmission of audio streams |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP13167809.6A EP2804399B1 (en) | 2013-05-15 | 2013-05-15 | Method and apparatus for transmitting wireless audio streams |
EP19168691.4A EP3528514B1 (en) | 2013-05-15 | 2013-05-15 | Method and apparatus for wireless transmission of audio streams |
Related Parent Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP13167809.6A Division EP2804399B1 (en) | 2013-05-15 | 2013-05-15 | Method and apparatus for transmitting wireless audio streams |
EP13167809.6A Division-Into EP2804399B1 (en) | 2013-05-15 | 2013-05-15 | Method and apparatus for transmitting wireless audio streams |
Publications (2)
Publication Number | Publication Date |
---|---|
EP3528514A1 EP3528514A1 (en) | 2019-08-21 |
EP3528514B1 true EP3528514B1 (en) | 2021-11-03 |
Family
ID=48482912
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP13167809.6A Active EP2804399B1 (en) | 2013-05-15 | 2013-05-15 | Method and apparatus for transmitting wireless audio streams |
EP19168691.4A Active EP3528514B1 (en) | 2013-05-15 | 2013-05-15 | Method and apparatus for wireless transmission of audio streams |
Family Applications Before (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP13167809.6A Active EP2804399B1 (en) | 2013-05-15 | 2013-05-15 | Method and apparatus for transmitting wireless audio streams |
Country Status (2)
Country | Link |
---|---|
EP (2) | EP2804399B1 (en) |
DK (2) | DK2804399T3 (en) |
Family Cites Families (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2004110099A2 (en) * | 2003-06-06 | 2004-12-16 | Gn Resound A/S | A hearing aid wireless network |
GB2463277B (en) * | 2008-09-05 | 2010-09-08 | Sony Comp Entertainment Europe | Wireless communication system |
JP5925209B2 (en) * | 2010-10-14 | 2016-05-25 | ジーエヌ リザウンド エー/エスGn Resound A/S | Hearing apparatus and method for compensating for frequency difference between transmitter and receiver |
WO2013106024A1 (en) * | 2011-04-05 | 2013-07-18 | Planetmac, Llc | Wireless audio dissemination system |
US8918569B2 (en) * | 2011-08-10 | 2014-12-23 | Intel Corporation | Streaming audio visual content simultaneously to different topologies on a wireless adapter |
-
2013
- 2013-05-15 DK DK13167809.6T patent/DK2804399T3/en active
- 2013-05-15 EP EP13167809.6A patent/EP2804399B1/en active Active
- 2013-05-15 DK DK19168691.4T patent/DK3528514T3/en active
- 2013-05-15 EP EP19168691.4A patent/EP3528514B1/en active Active
Non-Patent Citations (1)
Title |
---|
IAN POOLE: "GSM Handover | GSM Handoff | Radio-Electronics.Com", 1 December 2009 (2009-12-01), XP055460652, Retrieved from the Internet <URL:http://www.radio-electronics.com/info/cellulartelecomms/gsm_technical/handover-handoff.php> [retrieved on 20180319] * |
Also Published As
Publication number | Publication date |
---|---|
EP3528514A1 (en) | 2019-08-21 |
EP2804399B1 (en) | 2019-05-15 |
EP2804399A1 (en) | 2014-11-19 |
DK3528514T3 (en) | 2022-01-24 |
DK2804399T3 (en) | 2019-06-03 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP3031218B1 (en) | Hearing assistance system and method | |
US9826320B2 (en) | Hearing device and a method for receiving wireless audio streaming | |
EP3149963B1 (en) | Hearing assistance system and method | |
CN104754468A (en) | Hearing device with position data, audio system and related methods | |
CN110830973B (en) | Method for transmitting audio information by using wireless earphone | |
CN102224699B (en) | System and method to implement synchronous channel timing in a wireless communications network | |
US9232296B2 (en) | Method and apparatus for transmitting wireless audio streams | |
EP3528514B1 (en) | Method and apparatus for wireless transmission of audio streams | |
JP4881454B2 (en) | Electronics | |
US9287998B2 (en) | Broadcast device for broadcasting payload data, network device for receiving broadcasted payload data and method for initiating broadcasting payload data | |
US8666413B2 (en) | Base station and handover control method | |
EP3624356B1 (en) | Wireless headset and signal transmission method for the same | |
EP2804400B1 (en) | Hearing device and a method for receiving wireless audio streaming | |
EP2773135B1 (en) | Audio system for audio streaming and associated method | |
US11381951B2 (en) | Wireless Bluetooth (BT) audio output system and control method thereof | |
CN108632797B (en) | Fast Bluetooth connection method and Bluetooth system for reducing interference | |
CN115996217A (en) | Wireless communication method for transmitting and/or receiving audio information and storage medium | |
CN115967929A (en) | Communication method, bluetooth headset and Bluetooth communication system | |
CN114390404A (en) | Synchronous playing recovery method, wireless earphone, earphone and storage medium | |
EP2890157A1 (en) | Hearing device with position data, audio system and related methods | |
JP2006238122A (en) | Radio communication system |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE APPLICATION HAS BEEN PUBLISHED |
|
AC | Divisional application: reference to earlier application |
Ref document number: 2804399 Country of ref document: EP Kind code of ref document: P |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
17P | Request for examination filed |
Effective date: 20200219 |
|
RBV | Designated contracting states (corrected) |
Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
17Q | First examination report despatched |
Effective date: 20200526 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: GRANT OF PATENT IS INTENDED |
|
INTG | Intention to grant announced |
Effective date: 20210614 |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE PATENT HAS BEEN GRANTED |
|
AC | Divisional application: reference to earlier application |
Ref document number: 2804399 Country of ref document: EP Kind code of ref document: P |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: REF Ref document number: 1445080 Country of ref document: AT Kind code of ref document: T Effective date: 20211115 Ref country code: CH Ref legal event code: EP |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 602013079947 Country of ref document: DE |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: DK Ref legal event code: T3 Effective date: 20220117 |
|
REG | Reference to a national code |
Ref country code: LT Ref legal event code: MG9D |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: MP Effective date: 20211103 |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: MK05 Ref document number: 1445080 Country of ref document: AT Kind code of ref document: T Effective date: 20211103 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: RS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20211103 Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20211103 Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20211103 Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220203 Ref country code: AT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20211103 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220303 Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20211103 Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220303 Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20211103 Ref country code: NO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220203 Ref country code: NL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20211103 Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20211103 Ref country code: HR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20211103 Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220204 Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20211103 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SM Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20211103 Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20211103 Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20211103 Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20211103 Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20211103 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 602013079947 Country of ref document: DE |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
26N | No opposition filed |
Effective date: 20220804 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: AL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20211103 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20211103 |
|
REG | Reference to a national code |
Ref country code: BE Ref legal event code: MM Effective date: 20220531 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MC Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20211103 Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20220515 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20220515 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20211103 Ref country code: BE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20220531 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: FR Payment date: 20230516 Year of fee payment: 11 Ref country code: DK Payment date: 20230515 Year of fee payment: 11 Ref country code: DE Payment date: 20230524 Year of fee payment: 11 Ref country code: CH Payment date: 20230602 Year of fee payment: 11 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: GB Payment date: 20230523 Year of fee payment: 11 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: HU Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO Effective date: 20130515 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20211103 Ref country code: CY Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20211103 |