WO2011027004A2 - Method for operating a hearing device and a hearing device - Google Patents

Method for operating a hearing device and a hearing device Download PDF

Info

Publication number
WO2011027004A2
WO2011027004A2 PCT/EP2010/070191 EP2010070191W WO2011027004A2 WO 2011027004 A2 WO2011027004 A2 WO 2011027004A2 EP 2010070191 W EP2010070191 W EP 2010070191W WO 2011027004 A2 WO2011027004 A2 WO 2011027004A2
Authority
WO
WIPO (PCT)
Prior art keywords
hearing device
signal
signals
audio
identification information
Prior art date
Application number
PCT/EP2010/070191
Other languages
French (fr)
Other versions
WO2011027004A3 (en
Inventor
Hilmar Meier
Original Assignee
Phonak Ag
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Phonak Ag filed Critical Phonak Ag
Priority to PCT/EP2010/070191 priority Critical patent/WO2011027004A2/en
Priority to EP10795374.7A priority patent/EP2656637B1/en
Priority to US13/994,326 priority patent/US9363612B2/en
Priority to CN201080070785.XA priority patent/CN103262578B/en
Publication of WO2011027004A2 publication Critical patent/WO2011027004A2/en
Publication of WO2011027004A3 publication Critical patent/WO2011027004A3/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R25/00Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
    • H04R25/43Electronic input selection or mixing based on input signal analysis, e.g. mixing or selection between microphone and telecoil or between microphones with different directivity characteristics
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R25/00Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
    • H04R25/55Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception using an external connection, either wireless or wired
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R1/00Details of transducers, loudspeakers or microphones
    • H04R1/10Earpieces; Attachments therefor ; Earphones; Monophonic headphones
    • H04R1/1091Details not provided for in groups H04R1/1008 - H04R1/1083
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2225/00Details of deaf aids covered by H04R25/00, not provided for in any of its subgroups
    • H04R2225/41Detection or adaptation of hearing aid parameters or programs to listening situation, e.g. pub, forest
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2420/00Details of connection covered by H04R, not provided for in its groups
    • H04R2420/01Input selection or mixing for amplifiers or loudspeakers

Definitions

  • the present invention is related to a method for operating a hearing device as well as to a corresponding hearing device according to the pre-characterising part of claim 11.
  • hearing device refers to hearing aids (alternatively called hearing instruments or hearing prostheses) used to compensate hearing impairments of hard of hearing persons as well as audio and communication devices used to provide sound signals to persons with normal hearing capability.
  • hearing devices can be adapted to be worn at the ear, behind the ear or in the ear canal, and can also be
  • anchorable to or implantable into a user's head
  • hearing devices can comprise multiple separate units, for example two ear-level units of which one is worn at the left ear and the other is worn at the right ear, where for instance communication between these two ear-level units and/or other devices such as a mobile phone or a portable audio player takes place via a remote auxiliary unit such as a hub which acts as a communication relay.
  • the term hearing device thus also encompasses a binaural hearing system including associated accessories such as a communication interface unit, e.g. Phonak' s iCom, Oticon' s ConnectLine or Siemens' Tek/miniTek, and a remote control unit.
  • hearing program refers to a
  • adaptation i.e. the switching between different hearing programs, is performed by manually activating a switch at the hearing device or on a remote control, or automatically by the hearing device itself based on a suitable algorithm.
  • a programmable signal processing device capable of
  • a method for automatically recognising a momentary acoustic surround situation and for adjusting a hearing device according to the determined acoustic surround situation is known from WO 01/22790 A2.
  • the known teaching is related to a very efficient algorithm with the aid of which the acoustic surround situation can be determined with a high reliability.
  • a method for detecting and automatically selecting an input signal in a hearing aid in which at least two analog input signals are available is described in EP 1 443 803 A2.
  • EP 1 653 773 A2 discloses a technique with which the best suited hearing program is selected after a certain input source has been detected and selected from a plurality of input sources.
  • the present invention provides a method for operating a hearing device capable of receiving a plurality of input signals, the method comprising the steps of:
  • source identification information embedded in one or more of the input signals, wherein the source identification information identifies a signal source from which a particular input signal originates, and/or extracting audio type information embedded in one or more of the input signals, wherein the audio type information provides an indication of the type of audio content present in a particular input signal;
  • step of selecting is at least partly dependent on the extracted source identification information and/or the extracted audio type information
  • step of processing is at least partly dependent on the extracted source identification information and/or the extracted audio type information.
  • the connectivity of hearing devices to external units providing audio signals has only recently been dramatically improved with the availability of appropriate wireless communication technologies.
  • the present invention takes this into account in view of the increasing proliferation of personal audio and communication devices, such as MP3 players, gaming devices, mobile phones, navigation units, ebook readers, personal digital assistants, remote
  • a hearing device must be able to optimally cope with a plurality of different audio signals
  • the present invention proposes to utilise source identification information and/or audio type information embedded in the signals being sent to a hearing device.
  • source identification information can for instance include the following:
  • MAC media access control
  • IMSI international mobile subscriber identity
  • MSIN mobile subscriber identity
  • IP Internet protocol
  • audio type information can for instance include the following:
  • audio metadata e.g. ID3 or APE tag
  • audio/video metadata e.g. MPEG-7 description
  • RDS radio data system
  • the hearing device is able to optimally adjust its processing of the incoming signal (s) and/or its mode of operation.
  • the hearing device is not only able to distinguish between different types of communication links, such as for
  • T-coil FM or Bluetooth
  • the hearing device can be optimally adjusted according to the signal originating from each companion microphone, e.g. specifically to a woman's or a man's voice.
  • a signal from a companion microphone e.g. specifically to a woman's or a man's voice.
  • the personal audio player may contain different audio contents, e.g. music (including various genres such as classic or pop) or speech (such as audiobooks), at different times.
  • the hearing device can then distinguish between the two based on the audio type information it extracts from the signal.
  • Such a differentiation is not possible based on knowledge of the type of communication link alone, even when further information pertinent to a communication protocol being used to transmit a certain signal, such as the active Bluetooth profile (e.g. headset profile HSP or advanced audio distribution profile A2DP) , is also taken into account as proposed in WO 2008/071230 Al .
  • the active Bluetooth profile e.g. headset profile HSP or advanced audio distribution profile A2DP
  • identification information and/or with one or more of the audio types identifiable by the audio type information. This allows to apply a hearing program that is most
  • the associating of a hearing program with a signal source and/or with an audio type is performed prior to use of the hearing device by the user of the hearing device as part of a hearing device fitting process.
  • the person performing the fitting of the hearing device such as for instance an audiologist, chooses the most appropriate hearing program for a certain signal source and/or audio type based on knowledge of what kind of audio signal this signal source provides and what kind of sounds are contained in this type of audio signal, such that the signal can be optimally processed by the hearing device according to the needs and desires of its user.
  • the associating of a hearing program with a signal source and/or with an audio type is modified dependent on user interaction with the hearing device during use of the hearing device.
  • the user of the hearing device is able to modify the behaviour of the hearing device relative to the behaviour programmed into the hearing device during the fitting process. This may be desirable if it turns out during use of the hearing device that another hearing program is more suitable for dealing with a signal from a certain signal source or for handling a certain audio type. If this is the case, the user will normally adjust the hearing device manually (i.e. through user interaction with the hearing device) and switch to a more suitable hearing program. The user can then for instance indicate to the hearing device that such a change is to be made permanently when certain source
  • the hearing device can learn the user's preference over the course of time from the user's interaction with the hearing device in certain situations and then automatically apply a different hearing program than before when certain source identification information and/or audio type information is detected.
  • the audio type information and/or the audio type information cannot be extracted or cannot be associated with a specific signal source and/or audio type the sounds present in a signal are determined with the aid of a classifier.
  • the step of analysing and classifying takes into account the sound identification information and/or the audio type information extracted from the respective selected signal.
  • the sound classification process can be made more accurate and more reliable, and furthermore can be performed more rapidly and more efficiently. This approach is for instance useful in situations where the source identification information and/or the audio type
  • the hearing device originating from different sources, e.g. the signal from the hearing device microphone picking up the surrounding sounds together with the sound from a remote companion microphone providing the voice signal of a communication partner located at a distance from the hearing device user.
  • the hearing device is programmed to treat these two signals differently, e.g. amplify the signal from the companion microphone beyond that of the surrounding sounds, in order to enhance the voice of the remote communication partner, whilst still enabling to hear what is going on in the user' s proximity, thus ensuring his awareness of the surrounding environment
  • the step of selecting is at least partly dependent on a selection priority list, wherein the
  • processing priority list comprises assignments of priorities to the signal sources identifiable by the source identification information and/or the audio types identifiable by the audio type information and/or combinations of both.
  • signals with low priority will for instance not be processed or are
  • processing priority list is performed prior to use of the hearing device by the user of the hearing device as part of a hearing device fitting process.
  • the preferences of the user can thus be taken into account before the user starts to employ the hearing device.
  • the user does not want the hearing device to deselect the signal from an audio player when a telephone is received, he can indicate this to the device by manually selecting the signal from the audio player each time it is automatically deselected by the hearing device when a telephone call is received.
  • the hearing device can also learn this behaviour by analysing the user's previous manual interventions, i.e. his
  • a hearing device comprising:
  • - input receiving means for receiving a plurality of
  • the source identification information identifies a signal source from which a particular input signal originates, and/or for extracting audio type information embedded in one or more of the input
  • the audio type information provides an indication of the type of audio content present in a particular input signal
  • extracting means and selecting means are operationally connected to one another for transferring extracted source identification information and/or audio type information
  • extracting means and the processing means are operationally connected to one another for transferring extracted source identification information and/or audio type information.
  • An embodiment of the hearing device according to the present invention is further characterised in that the processing means provides a plurality of hearing programs, wherein at least one hearing program is selectable
  • a further embodiment of the hearing device according to the present invention is characterised by further comprising classifying means for analysing and classifying one or more of the selected signals into sound classes, wherein the extracting means and the classifying means are
  • a further embodiment of the hearing device according to the present invention is characterised in that the processing means is configured to modify each selected signal
  • processing means further comprises weighting means for forming a weighted sum of the modified signals, wherein the weighting is at least partly dependent on at least one of the source identification information, the audio type information and the sound class.
  • a further embodiment of the hearing device according to the present invention is characterised in that the selecting means is configured to select the selected signals at least partly dependent on a selection priority list, wherein the selection priority list comprises assignments of priorities to the signal sources identifiable by the source
  • processing means is configured to process the selected signals at least partly dependent on a processing priority list, wherein the processing priority list comprises assignments of priorities to the signal sources
  • Fig. 1 shows a block diagram of a hearing device
  • the present invention in a schematic representation along with a number of external signal sources
  • Fig. 2 shows a block diagram of a hearing device
  • the hearing device depicted in Fig. 1 comprises input receiving means 1 capable of receiving a plurality of input signals ii, is.
  • These input signals ii is are either audio, i.e. sound input signals ii, i 2 originating from the local surroundings of the hearing device, or they are carrier input signals 13, i , 15 conveying audio signals from various remote signal sources Si, S N to the hearing device, whereby the audio signals are modulated onto the carrier input signals 13, i 4 , i 5 .
  • a broad range of equipment can act as signal sources Si, ... , S N such as for instance portable multi-media players (e.g. MP3 players, CD players, DVD players) , mobile telephones, personal digital assistants, personal computers, home entertainment systems, gaming units, navigation devices, companion/conference microphones, etc.
  • portable multi-media players e.g. MP3 players, CD players, DVD players
  • the sound input signals ii, i 2 are picked up by a front and a back microphone, respectively, of the hearing device, which are part of the blocks labelled Micl and Mic2, respectively.
  • the two microphones convert the sound signals into electrical signals which are subsequently digitised by means of analogue-to-digital converters (which are also part of the blocks Micl & Mic2) for the digital processing that follows.
  • Different transmission schemes can be employed to convey the audio signals from the remote signal sources Si, ... , S N to the hearing device. For instance radio-frequency (RF) transmission according to the Bluetooth (BT) or Zigbee standard or based on frequency modulation (FM) as well as inductive transmission are commonly utilized.
  • RF radio-frequency
  • BT Bluetooth
  • FM frequency modulation
  • the inductive carrier input signal i 3 from an inductive loop system Si is picked up by a T-coil (also referred to as telephone coil) contained in the block labelled T-C.
  • T-coil also referred to as telephone coil
  • This block further contains an inductive receiver as well as an analogue-to-digital converter to retrieve and
  • Inductive loop systems are often employed to broadcast the signal from a speaker' s microphone to
  • BANs body-area networks
  • the FM carrier input signal i 4 for instance from a remote companion microphone S 2 is demodulated in the block
  • This block contains an FM receiver as well as an analogue-to-digital converter to retrieve and digitise the audio signal conveyed by the carrier input signal i .
  • the Bluetooth carrier input signal 15 from the Bluetooth device S N is demodulated in the block labelled BT .
  • This block contains a Bluetooth receiver as well as an audio codec which provides the audio signal conveyed by the carrier input signal i 4 in digitised form.
  • Bluetooth devices to transmit various kinds of signals for different applications has become widespread. For instance Bluetooth transmission in conjunction with mobile
  • an appropriate output generating means 4 such as a miniature loudspeaker (also referred to as receiver) or another kind of electromechanical transducer, e.g. cochlear or middle ear implant.
  • the input signals ii, ... , 15 which are to be processed by the processing means 3 of the hearing device are selected in the selecting means 2 of the hearing device.
  • Signal selection in the selecting means 2 can be based on different inputs and various criteria. According to the present invention selecting of the input signal (s) ii, ..., i 5 to be processed is based on information regarding the signal source Si, ... , S N from which an input signal i 3 , ... , is originates and/or from information regarding the audio type being conveyed by an input signal i 3 , ⁇ .., 15. Such information is provided as part of the input signal i 3 , 15. In the case of analogue signal transmission such as used for example with a T-coil or FM system, this information is for instance sent as a separate data signal or as a distinct indicator signal "along side" or "on top of" the carrier signal bearing the audio signal itself.
  • the information is embedded in the data stream containing the audio signal.
  • the source identification information identifying the signal source Si, ... , S N from which a particular input signal ii, i 5 originates, and/or the audio type information indicating the type of audio content present in a
  • the source identification information can either identify a single specific source for instance based on its individual and unique MAC (media access control) address, IMSI (international mobile subscriber identity) number, MSIN (mobile subscriber identity) number, IP (Internet protocol) address, telephone number, name (device or person to which it is associated) , serial number or geographical position (e.g. coordinates or location address), or it can identify groups of identical or similar sources based on common source identification information such as sub- addresses, -domains, -names, etc.
  • the audio type can be used to identify a single specific source for instance based on its individual and unique MAC (media access control) address, IMSI (international mobile subscriber identity) number, MSIN (mobile subscriber identity) number, IP (Internet protocol) address, telephone number, name (device or person to which it is associated) , serial number or geographical position (e.g. coordinates or location address), or it can identify groups of identical or similar sources based on common source identification information such as sub- addresses, -domains, -names
  • audio metadata e.g. ID3 or APE tags
  • RDS radio data system
  • the user also has the possibility to manually select an input signal ii, ... , 15 he wished to hear via a switch located on the hearing device itself (labelled SW) or via a separate accessory such as a remote control
  • the remote control can for instance also be used to instruct the hearing device which one of a plurality of FM devices or Bluetooth devices is to be linked to the FM or BT block of the input receiving means 1.
  • the hearing device then configures the FM or BT block accordingly, e.g. tunes to a specific FM carrier frequency or connects to a specific Bluetooth device using a specific Bluetooth profile (e.g. performs Bluetooth pairing) .
  • the hearing device is able to select one or more input signals ii, ... , i 5 automatically based on evaluating the input signals ii, ... , i 5 and/or based on user preferences stored in the hearing device. For instance the hearing device detects the presence and determines the signal quality of the input signals ii, ... , i 5 and subsequently selects only the input signals ii, ... , i 5 having a signal quality above a certain threshold.
  • the assessment of signal quality can either be performed by the selecting means 2 itself or by the processing means 3. In the latter case the feedback signal labelled ⁇ a' from the processing unit 3 to the selecting unit 2 is used to indicate to the selecting unit 2 which input signal (s) ii, . . . , 15 to select .
  • the selection can be influenced by the block within the input means 1 which receives an input signal ii, i 5 .
  • the input signal i 3 is always
  • the selecting means 2 may also comprise a selection
  • This selection priority list 9 assigns priorities to the individual input signals ⁇ , ... , i 5 depending on the signal source Si, S N from which they originate and/or the audio type of the audio signal being carried by them. So for instance the input signal 15
  • the assignment of priorities in the selection priority list 9 is performed during fitting of the hearing device to the needs and requirements of the user. Moreover, the
  • selection priority list 9 can be modified by the user during use of the hearing device, in that the hearing device adapts itself to the preferences of the user based on the manual inputs of the user, i.e. the user
  • the hearing device thus learns the
  • preferences of the user by analysing the user interactions and changes its behaviour accordingly, for instance by changing the priorities assigned in the selection priority list 9. As soon as the change is in-line with the user's preference the user will consequently no longer need to correct the automatic behaviour of the hearing device through manual intervention.
  • the selected signals ui , ... , u M are subsequently processed by the processing means 3. For this processing the
  • Each hearing program 6 comprises specific signal processing routines as well as related parameter settings which optimally, i.e. according to the user's requirements and preferences, adapt the operation of the hearing device to a given listening situation such as for instance a certain sound environment or a certain audio type.
  • a given listening situation such as for instance a certain sound environment or a certain audio type.
  • the hearing device applies the corresponding hearing program 6 to the selected input signal ui , ... , u M .
  • the hearing device must be capable of determining the present listening situation associated with a specific selected signal ui , ... , u M .
  • a hearing program 6 is for instance associated with at least one of the signal sources Si , . . . , S N identifiable by the source
  • a hearing program 6 is for instance associated with at least one of the audio types identifiable by the audio type information.
  • a hearing program 6 may for instance also be associated with both a signal source Si , . . . , S N as well as an audio type. This is useful in cases where different audio types originate from the same signal source Si , . . . , S N at different times.
  • the associating of hearing programs 6 to signal sources Si . . . , S N and audio types is performed during the fitting of the hearing device to the needs and preferences of the user. This is typically done be a hearing health care professional such as an audiologist. Moreover, these assignments may be modified later during use of the hearin device in response to the user's manual interventions, i.e the user interactions with the hearing device. The user i able to change the selected hearing program via a switch located on the hearing device or on a remote control (referred to as SW & RC, respectively) . Systematic manual changes by the user are registered by the hearing device and over time the hearing device learns from these
  • the hearing device subsequently modifies this association so that it is adapted to the user's preference, and the user no longer has to change the hearing program selected by the hearing device.
  • the automatic selection of an appropriate hearing program may be further supported by a classifying means 7, which analyses and classifies one or more of the selected signals Ui, u M into sound classes.
  • a hearing program is then associated with each sound class, for the processing of which it is specifically optimised.
  • the classification process may thereby be supported by providing source identification information and/or audio type information to the classifying means 7 from the extracting means 5.
  • the classification process may be supported additionally by providing information regarding the block within the input receiving means 1 from which a specific selected signal Ui, u M originates from, i.e. if it was picked up by one of the microphones Micl, Mic2, by the T-coil, or received via an FM or Bluetooth link.
  • each selected signal ui, ... , u M is for instance processed according to an certain hearing program 6, thus yielding modified signals.
  • these modified signals are combined to form a single signal which is then applied to a digital-to-analogue converter and to an output generating means 4 such as a receiver or other type transducer as indicated above, which outputs the signal labelled ⁇ ⁇ ' .
  • the combining of the modified signals is performed by an appropriate weighting means 8, which weights each of the modified signals with a corresponding weighting coefficient and then adds together the resulting weighted modified signals.
  • the weighting coefficients may thereby be partly dependent on the extracted source
  • identification information and/or the extracted audio type information This makes it possible to emphasise those modified signals originating from specific signal sources Si , S N and/or those comprising certain audio types.
  • the processing of the selected signals Ui , ... , u M may be dependent on a processing priority list 10. This
  • processing priority list 10 assigns a processing priority to the signal sources Si , ... , S N identifiable by the source identification information and/or to the audio types identifiable by the audio type information and/or
  • S N its processing may take precedence over another signal which has been assigned a lower priority.
  • assignments may be modified, i.e. updated later on during use of the hearing device based on the user' s interactions with the hearing device, from which the hearing device automatically learns new, more preferable priority
  • the hearing device depicted in Fig. 2 includes a separate, remote auxiliary unit 11, such as a hub which acts as a communication relay.
  • the remote auxiliary unit 11 can for instance be attached to a necklace or a waistbelt at a distance to the other part(s) of the hearing device worn at the ear(s).
  • the hearing device comprises more than one input receiving means 1, 1' each capable of receiving one or more input signals ii, ... , 15, i' .
  • the input receiving means 1' at the remote auxiliary unit 11 thereby receives the input signals i 3 , ... , i 5 sent wirelessly from such sources as an inductive loop system Si, a remote companion microphone S2, or a mobile telephone S N .
  • a signal source such as an portable audio (MP3) player can however also be connected via a wired connection to an input of the remote auxiliary unit 11.
  • MP3 portable audio
  • auxiliary unit 11 then pre-selects one (or possibly more than one) of theses input signals i 3 , ... , i 5 via the preselecting means 2' and then sends the selected signal (s) i' to the ear-level part of the hearing device with the help of a short-range communication means 12 such as a body-area network (BAN) transmitter.
  • a short-range communication means 12 such as a body-area network (BAN) transmitter.
  • the pre-selection of the input signal (s) i' to be passed on to the ear-level part of the hearing device can be determined by a manual selection performed by the user of the hearing device and fed to the pre-selecting means 2 ' via the input labelled ⁇ ⁇ ' from a switch (SW) or a button on a remote control unit (RC) .
  • SW switch
  • RC remote control unit
  • the pre-selection can also be performed automatically by the pre-selecting means 2' itself based on a selection priority list as previously mentioned or based on signal strength or quality.
  • the subsequent operations performed on the input signals i lf i 2 and i' i.e. the steps of
  • processing these selected signals is carried out in the same way as described above in conjunction with the hearing device according to Fig. 1.
  • a specific example is given of a way in which audio type information can be derived at a television set in order to be provided to the hearing device along with the audio signal.
  • the audio type information is derived from an electronic program guide which is commonly provided with the distribution of digital
  • Such an electronic program guide includes exact information as to what television program is being transmitted at a certain time over a certain channel. From this information the primary audio content of the audio signal associated with a specific television program can be determined. This audio type information, e.g. if the current television program is a pop concert, a talk show, a newscast or an action film with loud sound effects, is then send together with the audio signal to the user of a hearing device, for instance via a Bluetooth link from the television set a hub and then via inductive short-range transmission from the hub to the ear-level part(s) of the hearing device.
  • This audio type information e.g. if the current television program is a pop concert, a talk show, a newscast or an action film with loud sound effects, is then send together with the audio signal to the user of a hearing device, for instance via a Bluetooth link from the television set a hub and then via inductive short-range transmission from the hub to the ear-level part(s) of the hearing device.

Abstract

The present invention proposes a method for operating a hearing device capable of receiving a plurality of input signals (il,..., 15). The method comprises the steps of extracting source identification information embedded in one or more of the input signals (il,..., 15), wherein the source identification information identifies a signal source (Si,..., SN) from which a particular input signal (ii,..., is) originates, and/or extracting audio type information embedded in one or more of the input signals (ii,..., is), wherein the audio type information provides an indication of the type of audio content present in a particular input signal (ii,..., is), selecting from the plurality of input signals (ii,..., is) one or more selected signals to be processed (ui,..., uM), processing the selected signals (ui,..., uM), and generating an output signal (o) of the hearing device by said processing of the selected signals (ui,..., uM). Thereby, the step of selecting is at least partly dependent on the extracted source identification information and/or the extracted audio type information, and/or wherein the step of processing is at least partly dependent on the extracted source identification information and/or the extracted audio type information. A corresponding hearing device is also disclosed.

Description

METHOD FOR OPERATING A HEARING DEVICE AND A HEARING DEVICE
TECHNICAL FIELD
The present invention is related to a method for operating a hearing device as well as to a corresponding hearing device according to the pre-characterising part of claim 11. In the context of the present invention the term
"hearing device" refers to hearing aids (alternatively called hearing instruments or hearing prostheses) used to compensate hearing impairments of hard of hearing persons as well as audio and communication devices used to provide sound signals to persons with normal hearing capability. Such hearing devices can be adapted to be worn at the ear, behind the ear or in the ear canal, and can also be
anchorable to or implantable into a user's head.
Furthermore, such hearing devices can comprise multiple separate units, for example two ear-level units of which one is worn at the left ear and the other is worn at the right ear, where for instance communication between these two ear-level units and/or other devices such as a mobile phone or a portable audio player takes place via a remote auxiliary unit such as a hub which acts as a communication relay. The term hearing device thus also encompasses a binaural hearing system including associated accessories such as a communication interface unit, e.g. Phonak' s iCom, Oticon' s ConnectLine or Siemens' Tek/miniTek, and a remote control unit.
BACKGROUND OF THE INVENTION
Modern hearing devices can be adapted to various acoustic surround situations as well as to a variety of signal sources with the help of different hearing programs. In this context the term "hearing program" refers to a
specific set of parameters associated with the signal processing performed by the hearing device. The
adaptation, i.e. the switching between different hearing programs, is performed by manually activating a switch at the hearing device or on a remote control, or automatically by the hearing device itself based on a suitable algorithm.
A programmable signal processing device capable of
selecting a number of different signal processes to suit different sound situations automatically or by the user himself is disclosed in EP 0 064 042 Al .
A method for automatically recognising a momentary acoustic surround situation and for adjusting a hearing device according to the determined acoustic surround situation is known from WO 01/22790 A2. The known teaching is related to a very efficient algorithm with the aid of which the acoustic surround situation can be determined with a high reliability. A method for detecting and automatically selecting an input signal in a hearing aid in which at least two analog input signals are available is described in EP 1 443 803 A2.
EP 1 653 773 A2 discloses a technique with which the best suited hearing program is selected after a certain input source has been detected and selected from a plurality of input sources.
In US 2002/0044669 Al a hearing aid is proposed that automatically chooses a hearing program based on detecting whether it is located in the vicinity of an external transmitter .
A method for operating a hearing device capable of
receiving a variety of input signals is described in WO 2008/071230 Al, wherein the parameters for controlling the processing of the hearing device are derived from
information pertinent to the communication protocol used to transmit the input signal being processed.
SUMMARY OF THE INVENTION
It is an object of the present invention to further improve a method for operating a hearing device. At least this object is achieved by the method according to claim 1. Preferred embodiments as well as a hearing device are given in the further claims.
The present invention provides a method for operating a hearing device capable of receiving a plurality of input signals, the method comprising the steps of:
- extracting source identification information embedded in one or more of the input signals, wherein the source identification information identifies a signal source from which a particular input signal originates, and/or extracting audio type information embedded in one or more of the input signals, wherein the audio type information provides an indication of the type of audio content present in a particular input signal;
- selecting from the plurality of input signals one or
more selected signals to be processed;
- processing the selected signals; and
- generating an output signal of the hearing device by
said processing of the selected signals;
wherein the step of selecting is at least partly dependent on the extracted source identification information and/or the extracted audio type information, and/or wherein the step of processing is at least partly dependent on the extracted source identification information and/or the extracted audio type information. The connectivity of hearing devices to external units providing audio signals has only recently been dramatically improved with the availability of appropriate wireless communication technologies. The present invention takes this into account in view of the increasing proliferation of personal audio and communication devices, such as MP3 players, gaming devices, mobile phones, navigation units, ebook readers, personal digital assistants, remote
companion microphones, etc., which can be linked to a hearing device. As a result of this increased
connectivity, a hearing device must be able to optimally cope with a plurality of different audio signals
originating from various signal sources. In order to do so, the present invention proposes to utilise source identification information and/or audio type information embedded in the signals being sent to a hearing device. Such source identification information can for instance include the following:
- media access control (MAC) address;
- international mobile subscriber identity (IMSI) number;
- mobile subscriber identity (MSIN) number;
- Internet protocol (IP) address;
- telephone number;
- person's or device's name;
- serial number; - geographical position, e.g. coordinates or location address ;
and such audio type information can for instance include the following:
- audio metadata, e.g. ID3 or APE tag;
- audio/video metadata, e.g. MPEG-7 description;
- radio data system (RDS) data.
Based on this kind of information the hearing device is able to optimally adjust its processing of the incoming signal (s) and/or its mode of operation. Thereby, the hearing device is not only able to distinguish between different types of communication links, such as for
instance T-coil, FM or Bluetooth, used to send signals to the hearing device, but also detect which source is sending a signal, e.g. via a Bluetooth link, and what type of audio content is contained in that signal. So if a hearing impaired person is using a hearing device together with a plurality of companion microphones each assigned to a specific communication partner, the hearing device can be optimally adjusted according to the signal originating from each companion microphone, e.g. specifically to a woman's or a man's voice. Correspondingly, a signal from a
personal audio player may contain different audio contents, e.g. music (including various genres such as classic or pop) or speech (such as audiobooks), at different times. The hearing device can then distinguish between the two based on the audio type information it extracts from the signal. Such a differentiation is not possible based on knowledge of the type of communication link alone, even when further information pertinent to a communication protocol being used to transmit a certain signal, such as the active Bluetooth profile (e.g. headset profile HSP or advanced audio distribution profile A2DP) , is also taken into account as proposed in WO 2008/071230 Al .
In an embodiment of the method according to the present invention a hearing program is associated with one or more of the signal sources identifiable by the source
identification information and/or with one or more of the audio types identifiable by the audio type information. This allows to apply a hearing program that is most
suitable for handling the signal originating from a certain source and/or the type of audio content contained in a signal once the source identification information and/or the audio type information has been extracted from the signal without the necessity of any further signal
analysis .
In a further embodiment of the method according to the present invention the associating of a hearing program with a signal source and/or with an audio type is performed prior to use of the hearing device by the user of the hearing device as part of a hearing device fitting process. Thereby, the person performing the fitting of the hearing device, such as for instance an audiologist, chooses the most appropriate hearing program for a certain signal source and/or audio type based on knowledge of what kind of audio signal this signal source provides and what kind of sounds are contained in this type of audio signal, such that the signal can be optimally processed by the hearing device according to the needs and desires of its user.
In a further embodiment of the method according to the present invention the associating of a hearing program with a signal source and/or with an audio type is modified dependent on user interaction with the hearing device during use of the hearing device. Thereby, the user of the hearing device is able to modify the behaviour of the hearing device relative to the behaviour programmed into the hearing device during the fitting process. This may be desirable if it turns out during use of the hearing device that another hearing program is more suitable for dealing with a signal from a certain signal source or for handling a certain audio type. If this is the case, the user will normally adjust the hearing device manually (i.e. through user interaction with the hearing device) and switch to a more suitable hearing program. The user can then for instance indicate to the hearing device that such a change is to be made permanently when certain source
identification information and/or audio type information is detected. Alternatively, the hearing device can learn the user's preference over the course of time from the user's interaction with the hearing device in certain situations and then automatically apply a different hearing program than before when certain source identification information and/or audio type information is detected.
In a further embodiment of the method according to the invention the step of processing is at least partly
dependent on a further step of analysing and classifying one or more of the selected signals into sound classes, wherein a hearing program is associated with each sound class. For signals where the source identification
information and/or the audio type information cannot be extracted or cannot be associated with a specific signal source and/or audio type the sounds present in a signal are determined with the aid of a classifier.
In a further embodiment of the method according to the present invention the step of analysing and classifying takes into account the sound identification information and/or the audio type information extracted from the respective selected signal. By taking this information into account the sound classification process can be made more accurate and more reliable, and furthermore can be performed more rapidly and more efficiently. This approach is for instance useful in situations where the source identification information and/or the audio type
information are rather crude and sound classification is necessary to determine the best hearing program to employ. Moreover, in situations where interference is added to the signal, yielding a signal which deviates from the signal indicated by the source identification information and/or the audio type information alone, benefits from additionally employing sound classification to determine the best hearing program to use.
In a further embodiment of the method according to the present invention the step of processing comprises
modifying each of the selected signals according to the hearing program associated with the signal source
identified by the source identification information
embedded in the respective selected signal and/or the audio type identified by the audio type information embedded in the respective selected signal, thus yielding one or more modified signals, and forming a weighted sum of the one or more modified signals, wherein the weighting is at least partly dependent on at least one of the extracted source identification information, the extracted audio type information and the sound class. With this it is possible to optimally combine different audio signal types
originating from different sources, e.g. the signal from the hearing device microphone picking up the surrounding sounds together with the sound from a remote companion microphone providing the voice signal of a communication partner located at a distance from the hearing device user. Depending on the preferences of the user the hearing device is programmed to treat these two signals differently, e.g. amplify the signal from the companion microphone beyond that of the surrounding sounds, in order to enhance the voice of the remote communication partner, whilst still enabling to hear what is going on in the user' s proximity, thus ensuring his awareness of the surrounding environment
In a further embodiment of the method according to the present invention the step of selecting is at least partly dependent on a selection priority list, wherein the
selection priority list comprises assignments of priorities to the signal sources identifiable by the source
identification information and/or the audio types
identifiable by the audio type information and/or
combinations of both, and/or that the processing of the selected one or more signals is at least partly dependent on a processing priority list, wherein the processing priority list comprises assignments of priorities to the signal sources identifiable by the source identification information and/or the audio types identifiable by the audio type information and/or combinations of both.
Depending on the preferences of the user, which are
manifested in the two priority lists, signals from certain sources or certain audio types can be handled
preferentially over others. For instance when a telephone call is received it is immediately selected whilst the signal from an audio player which is currently being listen to by the user of the hearing device is deselected.
Moreover, it is possible to allocate the available signal processing resources as well as the processing horsepower of the hearing device in dependence of the relative
importance of the signals present given by their individual priority. For example, if the hearing programs chosen to handle the selected signals require more processing
resources or power than available or can be provided by the processing means of the hearing device, signals with low priority will for instance not be processed or are
processed with a less complex, suboptimal hearing program.
In a further embodiment of the method according to the present invention the assigning of priorities to the signal sources or the audio types or combinations of both as provided by the selection priority list and/or the
processing priority list is performed prior to use of the hearing device by the user of the hearing device as part of a hearing device fitting process. The preferences of the user can thus be taken into account before the user starts to employ the hearing device.
In a further embodiment of the method according to the present invention the assigning of priorities to the signal sources or the audio types or combinations of both as provided by the selection priority list and/or the
processing priority list is modified based on user
interaction with the hearing device during use of the hearing device. This allows modifying the assigned
priorities present in the hearing device based on how the user interacts with the hearing device in certain
situations. If for instance the user does not want the hearing device to deselect the signal from an audio player when a telephone is received, he can indicate this to the device by manually selecting the signal from the audio player each time it is automatically deselected by the hearing device when a telephone call is received. The hearing device can also learn this behaviour by analysing the user's previous manual interventions, i.e. his
interaction with the hearing device, in certain situations and then automatically adopting this desired behaviour in such situations in the future.
Furthermore, a hearing device is provided comprising:
- input receiving means for receiving a plurality of
inputs signals;
- selecting means for selecting from the plurality of
input signals one or more selected signals to be
processed;
- processing means for processing the selected signals; and
- output generating means for generating an output signal of the hearing device by said processing of the selected signals;
characterised by
- extracting means for extracting source identification information embedded in one or more of the input
signals, wherein the source identification information identifies a signal source from which a particular input signal originates, and/or for extracting audio type information embedded in one or more of the input
signals, wherein the audio type information provides an indication of the type of audio content present in a particular input signal;
wherein the extracting means and selecting means are operationally connected to one another for transferring extracted source identification information and/or audio type information, and/or wherein the extracting means and the processing means are operationally connected to one another for transferring extracted source identification information and/or audio type information.
An embodiment of the hearing device according to the present invention is further characterised in that the processing means provides a plurality of hearing programs, wherein at least one hearing program is selectable
dependent on the extracted source identification
information and/or the extracted audio type information.
A further embodiment of the hearing device according to the present invention is characterised by further comprising classifying means for analysing and classifying one or more of the selected signals into sound classes, wherein the extracting means and the classifying means are
operationally connected to one another for transferring extracted source identification information and/or
extracted audio type information.
A further embodiment of the hearing device according to the present invention is characterised in that the processing means is configured to modify each selected signal
according to the hearing program assigned to the respective selected signal, thus yielding one or more modified
signals, and in that the processing means further comprises weighting means for forming a weighted sum of the modified signals, wherein the weighting is at least partly dependent on at least one of the source identification information, the audio type information and the sound class.
A further embodiment of the hearing device according to the present invention is characterised in that the selecting means is configured to select the selected signals at least partly dependent on a selection priority list, wherein the selection priority list comprises assignments of priorities to the signal sources identifiable by the source
identification information and/or the audio types
identifiable by the audio type information, and/or in that the processing means is configured to process the selected signals at least partly dependent on a processing priority list, wherein the processing priority list comprises assignments of priorities to the signal sources
identifiable by the source identification information and/or the audio types identifiable by the audio type information and/or combinations of both.
It should be expressly pointed out that the invention is not limited to instances where both source identification information and audio type information are available, but is equally applicable in cases where only one of these two kinds of information is available or is being extracted. Moreover, any combination of the above-mentioned
embodiments, or combinations of combinations, is subject of a further combination. Only those combinations are
excluded that would result in a contradiction.
BRIEF DESCRIPTION OF THE DRAWINGS
For the purpose of facilitating the understanding of the present invention, exemplary embodiments thereof are illustrated in the accompanying drawings which are to be considered in connection with the following description. Thus, the present invention may be more readily
appreciated.
Fig. 1 shows a block diagram of a hearing device
according to an embodiment the present invention in a schematic representation along with a number of external signal sources; and
Fig. 2 shows a block diagram of a hearing device
comprising a remote auxiliary unit according to a further embodiment the present invention in a schematic representation along with a number of external signal sources. DETAILED DESCRIPTION OF THE INVENTION
The hearing device depicted in Fig. 1 comprises input receiving means 1 capable of receiving a plurality of input signals ii, is. These input signals ii, is are either audio, i.e. sound input signals ii, i2 originating from the local surroundings of the hearing device, or they are carrier input signals 13, i , 15 conveying audio signals from various remote signal sources Si, SN to the hearing device, whereby the audio signals are modulated onto the carrier input signals 13, i4, i5. A broad range of equipment can act as signal sources Si, ... , SN such as for instance portable multi-media players (e.g. MP3 players, CD players, DVD players) , mobile telephones, personal digital assistants, personal computers, home entertainment systems, gaming units, navigation devices, companion/conference microphones, etc.
The sound input signals ii, i2 are picked up by a front and a back microphone, respectively, of the hearing device, which are part of the blocks labelled Micl and Mic2, respectively. The two microphones convert the sound signals into electrical signals which are subsequently digitised by means of analogue-to-digital converters (which are also part of the blocks Micl & Mic2) for the digital processing that follows. Different transmission schemes can be employed to convey the audio signals from the remote signal sources Si, ... , SN to the hearing device. For instance radio-frequency (RF) transmission according to the Bluetooth (BT) or Zigbee standard or based on frequency modulation (FM) as well as inductive transmission are commonly utilized.
The inductive carrier input signal i3 from an inductive loop system Si is picked up by a T-coil (also referred to as telephone coil) contained in the block labelled T-C. This block further contains an inductive receiver as well as an analogue-to-digital converter to retrieve and
digitise the audio signal conveyed by the carrier input signal i3. Inductive loop systems are often employed to broadcast the signal from a speaker' s microphone to
multiple listeners, e.g. in churches, class rooms or conference centres. Inductive transmission is also
increasingly being used for short-range links, e.g. ear-to- ear communication or body-area networks (BANs), in binaural hearing systems.
The FM carrier input signal i4 for instance from a remote companion microphone S2 is demodulated in the block
labelled FM. This block contains an FM receiver as well as an analogue-to-digital converter to retrieve and digitise the audio signal conveyed by the carrier input signal i . The Bluetooth carrier input signal 15 from the Bluetooth device SN is demodulated in the block labelled BT . This block contains a Bluetooth receiver as well as an audio codec which provides the audio signal conveyed by the carrier input signal i4 in digitised form. The use of
Bluetooth devices to transmit various kinds of signals for different applications has become widespread. For instance Bluetooth transmission in conjunction with mobile
telephones, portable multi-media players, personal
computers, home entertainment systems (e.g. television and hi-fi stereo equipment), etc. is commonplace nowadays. It is therefore important to provide modern hearing devices with appropriate means to interconnect with such equipment, thus allowing the user of a corresponding hearing device to receive signals from a multitude of available Bluetooth devices .
From the plurality of input signals ilr 15 typically only a subset is processed by the hearing device and subsequently provided to the user via an appropriate output generating means 4, such as a miniature loudspeaker (also referred to as receiver) or another kind of electromechanical transducer, e.g. cochlear or middle ear implant. The input signals ii, ... , 15 which are to be processed by the processing means 3 of the hearing device are selected in the selecting means 2 of the hearing device.
Signal selection in the selecting means 2 can be based on different inputs and various criteria. According to the present invention selecting of the input signal (s) ii, ..., i5 to be processed is based on information regarding the signal source Si, ... , SN from which an input signal i3, ... , is originates and/or from information regarding the audio type being conveyed by an input signal i3, · .., 15. Such information is provided as part of the input signal i3, 15. In the case of analogue signal transmission such as used for example with a T-coil or FM system, this information is for instance sent as a separate data signal or as a distinct indicator signal "along side" or "on top of" the carrier signal bearing the audio signal itself. In the case of digital data transmission, such as used for a Bluetooth link, the information is embedded in the data stream containing the audio signal. In both cases the source identification information identifying the signal source Si, ... , SN from which a particular input signal ii, i5 originates, and/or the audio type information indicating the type of audio content present in a
particular input signal ii, ... , 15 is extracted from the input signals ii, 15 by an extracting means 5, which provides the extracted information to the selecting means 2. The source identification information can either identify a single specific source for instance based on its individual and unique MAC (media access control) address, IMSI (international mobile subscriber identity) number, MSIN (mobile subscriber identity) number, IP (Internet protocol) address, telephone number, name (device or person to which it is associated) , serial number or geographical position (e.g. coordinates or location address), or it can identify groups of identical or similar sources based on common source identification information such as sub- addresses, -domains, -names, etc. The audio type
information can for instance be extracted from audio metadata (e.g. ID3 or APE tags) or from data from an RDS (radio data system) sent along with the audio signal as part of the input signal ii, 15.
Moreover, the user also has the possibility to manually select an input signal ii, ... , 15 he wished to hear via a switch located on the hearing device itself (labelled SW) or via a separate accessory such as a remote control
(labelled RC) , the output of which is provided to the selecting means 2 via the input labelled ^m' . The remote control can for instance also be used to instruct the hearing device which one of a plurality of FM devices or Bluetooth devices is to be linked to the FM or BT block of the input receiving means 1. The hearing device then configures the FM or BT block accordingly, e.g. tunes to a specific FM carrier frequency or connects to a specific Bluetooth device using a specific Bluetooth profile (e.g. performs Bluetooth pairing) .
Furthermore, the hearing device is able to select one or more input signals ii, ... , i5 automatically based on evaluating the input signals ii, ... , i5 and/or based on user preferences stored in the hearing device. For instance the hearing device detects the presence and determines the signal quality of the input signals ii, ... , i5 and subsequently selects only the input signals ii, ... , i5 having a signal quality above a certain threshold. The assessment of signal quality can either be performed by the selecting means 2 itself or by the processing means 3. In the latter case the feedback signal labelled ^a' from the processing unit 3 to the selecting unit 2 is used to indicate to the selecting unit 2 which input signal (s) ii, . . . , 15 to select .
Additionally, the selection can be influenced by the block within the input means 1 which receives an input signal ii, i5. For example the input signal i3 is always
selected as soon as the presence of a T-coil signal has been detected.
The selecting means 2 may also comprise a selection
priority list 9. This selection priority list 9 assigns priorities to the individual input signals ίχ, ... , i5 depending on the signal source Si, SN from which they originate and/or the audio type of the audio signal being carried by them. So for instance the input signal 15
originating from a mobile phone always takes precedence over the input signal i3 originating from an inductive loop system of a conference room. In another example an alarm (= specific audio type) relayed to the hearing device via an FM link as part of the input signal i4 takes precedence over music (= another specific audio type) received over the Bluetooth link from a personal audio player. The assignment of priorities in the selection priority list 9 is performed during fitting of the hearing device to the needs and requirements of the user. Moreover, the
selection priority list 9 can be modified by the user during use of the hearing device, in that the hearing device adapts itself to the preferences of the user based on the manual inputs of the user, i.e. the user
interaction. The hearing device thus learns the
preferences of the user by analysing the user interactions and changes its behaviour accordingly, for instance by changing the priorities assigned in the selection priority list 9. As soon as the change is in-line with the user's preference the user will consequently no longer need to correct the automatic behaviour of the hearing device through manual intervention.
The selected signals ui , ... , uM are subsequently processed by the processing means 3. For this processing the
processing means 3 provides a plurality of hearing programs 6. Each hearing program 6 comprises specific signal processing routines as well as related parameter settings which optimally, i.e. according to the user's requirements and preferences, adapt the operation of the hearing device to a given listening situation such as for instance a certain sound environment or a certain audio type. Thus, whenever a certain listening situation is encountered the hearing device applies the corresponding hearing program 6 to the selected input signal ui , ... , uM. In order to achieve this the hearing device must be capable of determining the present listening situation associated with a specific selected signal ui , ... , uM. This is made possible by the present invention by selecting a certain hearing program 6 dependent on the source identification information and/or the audio type information associated with a particular selected signal ui , ... , uM. This information is provided to the processing means 3 from the extracting means 5. Accordingly, a hearing program 6 is for instance associated with at least one of the signal sources Si , . . . , SN identifiable by the source
identification information. Alternatively, a hearing program 6 is for instance associated with at least one of the audio types identifiable by the audio type information. Moreover, a hearing program 6 may for instance also be associated with both a signal source Si , . . . , SN as well as an audio type. This is useful in cases where different audio types originate from the same signal source Si , . . . , SN at different times.
The associating of hearing programs 6 to signal sources Si . . . , SN and audio types is performed during the fitting of the hearing device to the needs and preferences of the user. This is typically done be a hearing health care professional such as an audiologist. Moreover, these assignments may be modified later during use of the hearin device in response to the user's manual interventions, i.e the user interactions with the hearing device. The user i able to change the selected hearing program via a switch located on the hearing device or on a remote control (referred to as SW & RC, respectively) . Systematic manual changes by the user are registered by the hearing device and over time the hearing device learns from these
interactions that the user' s preference does not match with the present association of hearing program with signal source Si, ..., SN and/or audio type. Accordingly, the hearing device subsequently modifies this association so that it is adapted to the user's preference, and the user no longer has to change the hearing program selected by the hearing device.
The automatic selection of an appropriate hearing program may be further supported by a classifying means 7, which analyses and classifies one or more of the selected signals Ui, uM into sound classes. A hearing program is then associated with each sound class, for the processing of which it is specifically optimised. The classification process may thereby be supported by providing source identification information and/or audio type information to the classifying means 7 from the extracting means 5. The classification process may be supported additionally by providing information regarding the block within the input receiving means 1 from which a specific selected signal Ui, uM originates from, i.e. if it was picked up by one of the microphones Micl, Mic2, by the T-coil, or received via an FM or Bluetooth link.
When multiple selected signals ui, ... , uM are processed simultaneously, each selected signal ui, ... , uM is for instance processed according to an certain hearing program 6, thus yielding modified signals. Subsequently, these modified signals are combined to form a single signal which is then applied to a digital-to-analogue converter and to an output generating means 4 such as a receiver or other type transducer as indicated above, which outputs the signal labelled Λο' . The combining of the modified signals is performed by an appropriate weighting means 8, which weights each of the modified signals with a corresponding weighting coefficient and then adds together the resulting weighted modified signals. The weighting coefficients may thereby be partly dependent on the extracted source
identification information and/or the extracted audio type information. This makes it possible to emphasise those modified signals originating from specific signal sources Si , SN and/or those comprising certain audio types.
This is desirable for instance in a situation where the hearing device user is primarily making a phone call via the Bluetooth link and simultaneously still wants to listen to another speaker via the FM link in the background, or when primarily listening to a speaker via the FM link whilst concurrently still wanting to hear in the background music from a home entertainment system via the Bluetooth link.
The processing of the selected signals Ui , ... , uM may be dependent on a processing priority list 10. This
processing priority list 10 assigns a processing priority to the signal sources Si , ... , SN identifiable by the source identification information and/or to the audio types identifiable by the audio type information and/or
combinations of both. Depending on the priority of a signal originating from a certain signal source Si, ... , SN or of a certain audio type or of a signal of a certain audio type originating from a certain signal source Si, ... , SN its processing may take precedence over another signal which has been assigned a lower priority.
Especially if processing power is limited, for instance due to power constraints when the hearing device battery is almost depleted, it is advantageous to allocate the
available resources to the most important signals or those most preferred by the user. As was already elaborated upon above on conjunction with the selection priority list, the assigning of priorities initially takes place as part of a hearing device fitting process, but these initial
assignments may be modified, i.e. updated later on during use of the hearing device based on the user' s interactions with the hearing device, from which the hearing device automatically learns new, more preferable priority
assignments .
The hearing device depicted in Fig. 2 includes a separate, remote auxiliary unit 11, such as a hub which acts as a communication relay. The remote auxiliary unit 11 can for instance be attached to a necklace or a waistbelt at a distance to the other part(s) of the hearing device worn at the ear(s). With such a configuration the hearing device comprises more than one input receiving means 1, 1' each capable of receiving one or more input signals ii, ... , 15, i' . The input receiving means 1' at the remote auxiliary unit 11 thereby receives the input signals i3, ... , i5 sent wirelessly from such sources as an inductive loop system Si, a remote companion microphone S2, or a mobile telephone SN. A signal source such as an portable audio (MP3) player can however also be connected via a wired connection to an input of the remote auxiliary unit 11. The remote
auxiliary unit 11 then pre-selects one (or possibly more than one) of theses input signals i3, ... , i5 via the preselecting means 2' and then sends the selected signal (s) i' to the ear-level part of the hearing device with the help of a short-range communication means 12 such as a body-area network (BAN) transmitter. The pre-selection of the input signal (s) i' to be passed on to the ear-level part of the hearing device can be determined by a manual selection performed by the user of the hearing device and fed to the pre-selecting means 2 ' via the input labelled λπι' from a switch (SW) or a button on a remote control unit (RC) .
Alternatively, the pre-selection can also be performed automatically by the pre-selecting means 2' itself based on a selection priority list as previously mentioned or based on signal strength or quality. At the ear-level part of the hearing device the subsequent operations performed on the input signals ilf i2 and i' , i.e. the steps of
extracting source identification and/or audio type
information, selecting signals to be processed and
processing these selected signals is carried out in the same way as described above in conjunction with the hearing device according to Fig. 1. Finally, a specific example is given of a way in which audio type information can be derived at a television set in order to be provided to the hearing device along with the audio signal. In this case the audio type information is derived from an electronic program guide which is commonly provided with the distribution of digital
television signals. Such an electronic program guide includes exact information as to what television program is being transmitted at a certain time over a certain channel. From this information the primary audio content of the audio signal associated with a specific television program can be determined. This audio type information, e.g. if the current television program is a pop concert, a talk show, a newscast or an action film with loud sound effects, is then send together with the audio signal to the user of a hearing device, for instance via a Bluetooth link from the television set a hub and then via inductive short-range transmission from the hub to the ear-level part(s) of the hearing device.

Claims

1. A method for operating a hearing device capable of receiving a plurality of input signals (ilf is, i' ) , the method comprising the steps of:
- extracting source identification information embedded in one or more of the input signals (ii, 15, i' ) , wherein the source identification information identifies a signal source (Si, ... , SN) from which a particular input signal (ii, ..., 15, i' ) originates, and/or
extracting audio type information embedded in one or more of the input signals (ii, 15, i' ) , wherein the audio type information provides an indication of the type of audio content present in a particular input signal (ii, i5, i' ) ;
- selecting from the plurality of input signals (ii,
i5, i' ) one or more selected signals to be processed (ui, • · · r UM) ;
- processing the selected signals (ui, ... , uM) ; and - generating an output signal (o) of the hearing device by said processing of the selected signals (ui, ... , uM) ; wherein the step of selecting is at least partly dependent on the extracted source identification information and/or the extracted audio type information, and/or wherein the step of processing is at least partly dependent on the extracted source identification information and/or the extracted audio type information.
2. The method according to claim 1, wherein a hearing program (6) is associated with one or more of the signal sources ( S i , SN ) identifiable by the source
identification information and/or with one or more of the audio types identifiable by the audio type information.
3. The method according to claim 2, wherein the
associating of a hearing program (6) with a signal source ( S i , SN ) and/or with an audio type is performed prior to use of the hearing device by the user of the hearing device as part of a hearing device fitting process.
4. The method according to claim 2 or 3, wherein the associating of a hearing program (6) with a signal source ( S i , SN ) and/or with an audio type is modified
dependent on user interaction with the hearing device during use of the hearing device.
5. The method according to one of the claims 1 to 4, wherein the step of processing is at least partly dependent on a further step of analysing and classifying one or more of the selected signals ( ui , uM) into sound classes, wherein a hearing program (6) is associated with each sound
6. The method according to claim 5, wherein the step of analysing and classifying takes into account the sound identification information and/or the audio type
information extracted from the respective selected signal ( ui , ... , uM) .
7 The method according to one of the claims 2 to 6, wherein the step of processing comprises modifying each of the selected signals ( ui , ... , uM) according to the hearing program (6) associated with the signal source ( Si , SN ) identified by the source identification information
embedded in the respective selected signal ( ui , ... , uM) and/or the audio type identified by the audio type
information embedded in the respective selected signal ( ui , ·.., uM) , thus yielding one or more modified signals, and forming a weighted sum of the one or more modified signals, wherein the weighting is at least partly dependent on at least one of the extracted source identification
information, the extracted audio type information and the sound class.
8. The method according to one of the claims 1 to 7, wherein the step of selecting is at least partly dependent on a selection priority list (9), wherein the selection priority list (9) comprises assignments of priorities to the signal sources ( Si , SN ) identifiable by the source identification information and/or the audio types
identifiable by the audio type information and/or
combinations of both, and/or that the processing of the selected one or more signals is at least partly dependent on a processing priority list (10) , wherein the processing priority list (10) comprises assignments of priorities to the signal sources (Si, SN) identifiable by the source identification information and/or the audio types
identifiable by the audio type information and/or
combinations of both.
9. The method according to claim 8, wherein the assigning of priorities to the signal sources (Si, SN) or the audio types or combinations of both as provided by the selection priority list (9) and/or the processing priority list (10) is performed prior to use of the hearing device by the user of the hearing device as part of a hearing device fitting process .
10. The method according to claim 8 or 9, wherein the assigning of priorities to the signal sources (Si, ... , SN) or the audio types or combinations of both as provided by the selection priority list (9) and/or the processing priority list (10) is modified based on user interaction with the hearing device during use of the hearing device.
11. A hearing device comprising:
- input receiving means (1) for receiving a plurality of inputs signals (ii, 15, i' ) ; - selecting means (2) for selecting from the plurality of input signals (ii, is, i' ) one or more selected signals (ui, ..., uM) to be processed;
- processing means (3) for processing the selected signals (ui, ... , uM) ; and
- output generating means (4) for generating an output
signal (o) of the hearing device by said processing of the selected signals (ui, ... , uM) ;
characterised by
- extracting means (5) for extracting source
identification information embedded in one or more of the input signals (ii, 15, i' ) , wherein the source identification information identifies a signal source (Si, SN) from which a particular input signal (ii, i5, i' ) originates, and/or for extracting audio type information embedded in one or more of the input signals (ii, 15, i' ) , wherein the audio type
information provides an indication of the type of audio content present in a particular input signal;
wherein the extracting means (5) and selecting means (2) are operationally connected to one another for transferring extracted source identification information and/or audio type information, and/or wherein the extracting means (5) and the processing means (3) are operationally connected to one another for transferring extracted source
identification information and/or audio type information.
12. The hearing device according to claim 11,
characterised in that the processing means (3) provides a plurality of hearing programs (6), wherein at least one hearing program (6) is selectable dependent on the
extracted source identification information and/or the extracted audio type information.
13. The hearing device according the claim 11 or 12, characterised by further comprising classifying means (7) for analysing and classifying one or more of the selected signals (ui, uM) into sound classes, wherein the extracting means (5) and the classifying means (7) are operationally connected to one another for transferring extracted source identification information and/or
extracted audio type information.
14. The hearing device according to claim 12 or 13, characterised in that the processing means (3) is
configured to modify each selected signal (ui, ... , uM) according to the hearing program assigned to the respective selected signal (ui, ... , uM) , thus yielding one or more modified signals, and in that the processing means (3) further comprises weighting means (8) for forming a
weighted sum of the modified signals, wherein the weighting is at least partly dependent on at least one of the source identification information, the audio type information and the sound class.
15. The hearing device according to one of the claims 11 to 14, characterised in that the selecting means (2) is configured to select the selected signals (ui, ... , uM) at least partly dependent on a selection priority list (9), wherein the selection priority list (9) comprises
assignments of priorities to the signal sources (Si, ... , SN) identifiable by the source identification information and/or the audio types identifiable by the audio type information, and/or in that the processing means (3) is configured to process the selected signals (ui, ... , uM) at least partly dependent on a processing priority list (10) , wherein the processing priority list (10) comprises
assignments of priorities to the signal sources (Si,
SN) identifiable by the source identification information and/or the audio types identifiable by the audio type information and/or combinations of both.
PCT/EP2010/070191 2010-12-20 2010-12-20 Method for operating a hearing device and a hearing device WO2011027004A2 (en)

Priority Applications (4)

Application Number Priority Date Filing Date Title
PCT/EP2010/070191 WO2011027004A2 (en) 2010-12-20 2010-12-20 Method for operating a hearing device and a hearing device
EP10795374.7A EP2656637B1 (en) 2010-12-20 2010-12-20 Method for operating a hearing device and a hearing device
US13/994,326 US9363612B2 (en) 2010-12-20 2010-12-20 Method for operating a hearing device and a hearing device
CN201080070785.XA CN103262578B (en) 2010-12-20 2010-12-20 The method and hearing device of operation hearing device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/EP2010/070191 WO2011027004A2 (en) 2010-12-20 2010-12-20 Method for operating a hearing device and a hearing device

Publications (2)

Publication Number Publication Date
WO2011027004A2 true WO2011027004A2 (en) 2011-03-10
WO2011027004A3 WO2011027004A3 (en) 2011-11-03

Family

ID=43649706

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/EP2010/070191 WO2011027004A2 (en) 2010-12-20 2010-12-20 Method for operating a hearing device and a hearing device

Country Status (4)

Country Link
US (1) US9363612B2 (en)
EP (1) EP2656637B1 (en)
CN (1) CN103262578B (en)
WO (1) WO2011027004A2 (en)

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104022788A (en) * 2013-02-28 2014-09-03 Gn瑞声达A/S Audio system for audio streaming transmission and associated method
EP2773135A1 (en) * 2013-02-28 2014-09-03 GN Resound A/S Audio system for audio streaming and associated method
CN104168531A (en) * 2013-05-15 2014-11-26 Gn瑞声达A/S Hearing instrument with an authentication protocol
EP2835986A1 (en) 2013-08-09 2015-02-11 Oticon A/s Hearing device with input transducer and wireless receiver
WO2014184395A3 (en) * 2014-09-15 2015-07-16 Phonak Ag Hearing assistance system and method using bluetooth profiles
US9538284B2 (en) 2013-02-28 2017-01-03 Gn Resound A/S Audio system for audio streaming and associated method
WO2017152993A1 (en) * 2016-03-11 2017-09-14 Widex A/S Method and hearing assistive device for handling streamed audio, and an audio signal for use with the method and the hearing assistive device
WO2017152992A1 (en) * 2016-03-11 2017-09-14 Widex A/S Method and hearing assisting device for handling streamed audio

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9148734B2 (en) * 2013-06-05 2015-09-29 Cochlear Limited Feedback path evaluation implemented with limited signal processing
US10735876B2 (en) * 2015-03-13 2020-08-04 Sonova Ag Method for determining useful hearing device features
US9924277B2 (en) * 2015-05-27 2018-03-20 Starkey Laboratories, Inc. Hearing assistance device with dynamic computational resource allocation
EP3133759A1 (en) * 2015-08-18 2017-02-22 GN Resound A/S A method of exchanging data packages of different sizes between first and second portable communication devices
US10003896B2 (en) 2015-08-18 2018-06-19 Gn Hearing A/S Method of exchanging data packages of different sizes between first and second portable communication devices
JP6589458B2 (en) * 2015-08-19 2019-10-16 ヤマハ株式会社 Audio equipment
US10846045B2 (en) * 2018-02-23 2020-11-24 Bose Corporation Content based dynamic audio settings
CN110650422A (en) * 2018-06-26 2020-01-03 深圳市智汇声科技有限公司 Hearing assistance method and system, and host and slave thereof
CN116888978A (en) * 2021-10-14 2023-10-13 恩尼奥·潘内拉 Audio transmission device for sports ground

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0064042A1 (en) 1981-04-16 1982-11-03 Stephan Mangold Programmable signal processing device
WO2001022790A2 (en) 2001-01-05 2001-04-05 Phonak Ag Method for operating a hearing-aid and a hearing aid
US20020044669A1 (en) 2000-09-29 2002-04-18 Wolfram Meyer Method of operating a hearing aid and hearing-aid arrangement or hearing aid
EP1443803A2 (en) 2004-03-16 2004-08-04 Phonak Ag Hearing aid and method for the detection and automatic selection of an input signal
EP1653773A2 (en) 2005-08-23 2006-05-03 Phonak Ag Method for operating a hearing aid and hearing aid
WO2008071230A1 (en) 2006-12-13 2008-06-19 Phonak Ag Method for operating a hearing device and a hearing device

Family Cites Families (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4920570A (en) * 1987-12-18 1990-04-24 West Henry L Modular assistive listening system
EP1216444A4 (en) * 1999-09-28 2006-04-12 Sound Id Internet based hearing assessment methods
EP1442628A2 (en) * 2001-11-09 2004-08-04 Phonak Ag Method for operating a hearing device and hearing device
DE10201068A1 (en) * 2002-01-14 2003-07-31 Siemens Audiologische Technik Selection of communication connections for hearing aids
US20040175008A1 (en) * 2003-03-07 2004-09-09 Hans-Ueli Roeck Method for producing control signals, method of controlling signal and a hearing device
EP1460769B1 (en) 2003-03-18 2007-04-04 Phonak Communications Ag Mobile Transceiver and Electronic Module for Controlling the Transceiver
WO2007096792A1 (en) * 2006-02-22 2007-08-30 Koninklijke Philips Electronics N.V. Device for and a method of processing audio data
DE102007043081A1 (en) * 2007-09-10 2009-03-26 Siemens Audiologische Technik Gmbh Method and arrangements for detecting the type of a sound signal source with a hearing aid
DK2191662T3 (en) * 2007-09-26 2011-09-05 Phonak Ag Hearing system with a user preference control and method for using a hearing system
US8155340B2 (en) * 2008-07-24 2012-04-10 Qualcomm Incorporated Method and apparatus for rendering ambient signals
DE102008053458A1 (en) * 2008-10-28 2010-04-29 Siemens Medical Instruments Pte. Ltd. Hearing device with special situation recognition unit and method for operating a hearing device
US8224395B2 (en) * 2009-04-24 2012-07-17 Sony Mobile Communications Ab Auditory spacing of sound sources based on geographic locations of the sound sources or user placement
KR20120027100A (en) * 2009-06-08 2012-03-21 파나소닉 주식회사 Hearing aid, repeater, hearing aid system, method for hearing aid, program, and integrated circuit

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0064042A1 (en) 1981-04-16 1982-11-03 Stephan Mangold Programmable signal processing device
US20020044669A1 (en) 2000-09-29 2002-04-18 Wolfram Meyer Method of operating a hearing aid and hearing-aid arrangement or hearing aid
WO2001022790A2 (en) 2001-01-05 2001-04-05 Phonak Ag Method for operating a hearing-aid and a hearing aid
EP1443803A2 (en) 2004-03-16 2004-08-04 Phonak Ag Hearing aid and method for the detection and automatic selection of an input signal
EP1653773A2 (en) 2005-08-23 2006-05-03 Phonak Ag Method for operating a hearing aid and hearing aid
WO2008071230A1 (en) 2006-12-13 2008-06-19 Phonak Ag Method for operating a hearing device and a hearing device

Cited By (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2773135A1 (en) * 2013-02-28 2014-09-03 GN Resound A/S Audio system for audio streaming and associated method
CN104022788A (en) * 2013-02-28 2014-09-03 Gn瑞声达A/S Audio system for audio streaming transmission and associated method
US9497541B2 (en) 2013-02-28 2016-11-15 Gn Resound A/S Audio system for audio streaming and associated method
US9538284B2 (en) 2013-02-28 2017-01-03 Gn Resound A/S Audio system for audio streaming and associated method
CN104168531B (en) * 2013-05-15 2019-06-14 Gn瑞声达A/S Hearing instrument with indentification protocol
CN104168531A (en) * 2013-05-15 2014-11-26 Gn瑞声达A/S Hearing instrument with an authentication protocol
US10652673B2 (en) 2013-05-15 2020-05-12 Gn Hearing A/S Hearing instrument with an authentication protocol
EP2835986A1 (en) 2013-08-09 2015-02-11 Oticon A/s Hearing device with input transducer and wireless receiver
US9980059B2 (en) 2014-09-15 2018-05-22 Sonova Ag Hearing assistance system and method
WO2014184395A3 (en) * 2014-09-15 2015-07-16 Phonak Ag Hearing assistance system and method using bluetooth profiles
WO2017152992A1 (en) * 2016-03-11 2017-09-14 Widex A/S Method and hearing assisting device for handling streamed audio
WO2017152993A1 (en) * 2016-03-11 2017-09-14 Widex A/S Method and hearing assistive device for handling streamed audio, and an audio signal for use with the method and the hearing assistive device
US10524064B2 (en) 2016-03-11 2019-12-31 Widex A/S Method and hearing assistive device for handling streamed audio
US11082779B2 (en) 2016-03-11 2021-08-03 Widex A/S Method and hearing assistive device for handling streamed audio, and an audio signal for use with the method and the hearing assistive device

Also Published As

Publication number Publication date
CN103262578A (en) 2013-08-21
CN103262578B (en) 2017-03-29
EP2656637A2 (en) 2013-10-30
EP2656637B1 (en) 2021-07-07
WO2011027004A3 (en) 2011-11-03
US9363612B2 (en) 2016-06-07
US20130272553A1 (en) 2013-10-17

Similar Documents

Publication Publication Date Title
US9363612B2 (en) Method for operating a hearing device and a hearing device
EP2352312B1 (en) A method for dynamic suppression of surrounding acoustic noise when listening to electrical inputs
US9854369B2 (en) Wireless system for hearing communication devices providing wireless stereo reception modes
EP1460769B1 (en) Mobile Transceiver and Electronic Module for Controlling the Transceiver
US20090076825A1 (en) Method of enhancing sound for hearing impaired individuals
US20090074216A1 (en) Assistive listening system with programmable hearing aid and wireless handheld programmable digital signal processing device
US20090074214A1 (en) Assistive listening system with plug in enhancement platform and communication port to download user preferred processing algorithms
US20090074206A1 (en) Method of enhancing sound for hearing impaired individuals
US20090076804A1 (en) Assistive listening system with memory buffer for instant replay and speech to text conversion
US20090076816A1 (en) Assistive listening system with display and selective visual indicators for sound sources
EP2103177B1 (en) Method for operating a hearing device and a hearing device
US20160286323A1 (en) Wireless stereo hearing assistance system
WO2014053023A1 (en) Automated program selection for listening devices
US20070183609A1 (en) Hearing aid system without mechanical and acoustic feedback
EP2865197B1 (en) A method for operating a hearing system as well as a hearing device
EP3269152B1 (en) Method for determining useful hearing device features based on logged sound classification data
EP3665912B1 (en) Communication device having a wireless interface
US20090074203A1 (en) Method of enhancing sound for hearing impaired individuals
EP4203517A2 (en) Accessory device for a hearing device
CN112956214A (en) Method, system and hearing device for enhancing an ambient audio signal of the hearing device
EP4203514A2 (en) Communication device, terminal hearing device and method to operate a hearing aid system
US20240015457A1 (en) Hearing device, fitting device, fitting system, and related method
EP4203516A1 (en) Hearing device with multi-source audio reception
US20230209281A1 (en) Communication device, hearing aid system and computer readable medium

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 10795374

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 2010795374

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 13994326

Country of ref document: US

NENP Non-entry into the national phase

Ref country code: DE