WO2010043223A1 - Method of rendering binaural stereo in a hearing aid system and a hearing aid system - Google Patents

Method of rendering binaural stereo in a hearing aid system and a hearing aid system Download PDF

Info

Publication number
WO2010043223A1
WO2010043223A1 PCT/DK2008/000363 DK2008000363W WO2010043223A1 WO 2010043223 A1 WO2010043223 A1 WO 2010043223A1 DK 2008000363 W DK2008000363 W DK 2008000363W WO 2010043223 A1 WO2010043223 A1 WO 2010043223A1
Authority
WO
WIPO (PCT)
Prior art keywords
hearing aid
signal
aid system
rendering device
rendering
Prior art date
Application number
PCT/DK2008/000363
Other languages
French (fr)
Inventor
Preben Kidmose
Mike Lind Rank
Morten Holm Jensen
Original Assignee
Widex A/S
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Widex A/S filed Critical Widex A/S
Priority to KR1020117008911A priority Critical patent/KR20110069112A/en
Priority to AU2008362920A priority patent/AU2008362920B2/en
Priority to JP2011531354A priority patent/JP5325988B2/en
Priority to CA2740522A priority patent/CA2740522A1/en
Priority to CN2008801315463A priority patent/CN102187690A/en
Priority to EP08874938A priority patent/EP2351384A1/en
Priority to PCT/DK2008/000363 priority patent/WO2010043223A1/en
Publication of WO2010043223A1 publication Critical patent/WO2010043223A1/en
Priority to US13/083,080 priority patent/US20110188662A1/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R25/00Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
    • H04R25/55Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception using an external connection, either wireless or wired
    • H04R25/552Binaural
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R25/00Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R3/00Circuits for transducers, loudspeakers or microphones
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R25/00Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
    • H04R25/55Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception using an external connection, either wireless or wired
    • H04R25/554Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception using an external connection, either wireless or wired using a wireless connection, e.g. between microphone and amplifier or using Tcoils
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R25/00Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
    • H04R25/55Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception using an external connection, either wireless or wired
    • H04R25/558Remote control, e.g. of amplification, frequency
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04SSTEREOPHONIC SYSTEMS 
    • H04S1/00Two-channel systems
    • H04S1/002Non-adaptive circuits, e.g. manually adjustable or static, for enhancing the sound image or the spatial distribution
    • H04S1/005For headphones
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04SSTEREOPHONIC SYSTEMS 
    • H04S2400/00Details of stereophonic systems covered by H04S but not provided for in its groups
    • H04S2400/01Multi-channel, i.e. more than two input channels, sound reproduction with two speakers wherein the multi-channel information is substantially preserved
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04SSTEREOPHONIC SYSTEMS 
    • H04S2420/00Techniques used stereophonic systems covered by H04S but not provided for in its groups
    • H04S2420/01Enhancing the perception of the sound image or of the spatial distribution using head related transfer functions [HRTF's] or equivalents thereof, e.g. interaural time difference [ITD] or interaural level difference [ILD]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04SSTEREOPHONIC SYSTEMS 
    • H04S3/00Systems employing more than two channels, e.g. quadraphonic
    • H04S3/002Non-adaptive circuits, e.g. manually adjustable or static, for enhancing the sound image or the spatial distribution
    • H04S3/004For headphones

Definitions

  • the present invention relates to hearing aids.
  • the invention more specifically, relates to a hearing aid system for rendering a multi-channel digitally encoded audio signal into a binaural stereo signal.
  • US-A 1-20080008341 discloses a hearing assistance system that presents sound to both ears of a user wearing wireless hearing assistance devices which is derived from a single monaural signal. Among other things, it allows for better control of the received sound and obtains benefits of binaural hearing for listening to the monaural signal.
  • the sound presented to one ear is phase shifted relative to the sound presented to the other ear.
  • the phase shift arises from a constant time delay or the phase shift arises from a constant phase shift at all frequencies.
  • the phase shift arises from a phase shift that is varying as a function of frequency.
  • the sound presented to one ear is set to a different level relative to the sound presented to the other ear.
  • the sound presented to one ear is controllable in relative phase and in relative level with respect to the sound presented to the other ear.
  • WO-A 1-2006133158 discloses a hearing aid system adapted for wireless communications between one or more wireless audio devices and other electronics for providing e.g. streaming audio and other enhanced hearing functions. Mono and stereo communication modes are supported in various embodiments.
  • an interface device has a first port, which is adapted to receive information from a communication device. The information is subsequently processed or formatted if required, and transmitted wirelessly to one or more audio devices.
  • streaming audio packets are received from the communication device and in some embodiments the streaming audio is in stereo.
  • the interface device can transmit stereo information that is received by the proper wireless audio device to preserve the stereo nature of the information.
  • the communication device includes a computer connected to a content source over a network, such as the Internet, hi one application, it includes a storage device, such as an iPodTM or other streaming audio device. In one application it includes a connection to a wireless audio source, hi one application it includes a wireless connection to a Bluetooth MP3 player. One application includes a wired stereo or mono connection.
  • WO-Al -200674655 discloses a hearing aid system, which enables signals of arbitrary origin to be transmitted from a portable module to one or more hearing aids. This feature may, for instance, be used for transferring digital audio signals to the hearing aid from the portable module.
  • the transmission of data may be from an external source, such as a personal computer or similar appliance, wirelessly to the hearing aid via the portable module.
  • US-A1-20060018497 discloses a communication system where exactly matched, but generally slightly different acoustic signals can be created and directed to the user's left and right ear. This means that it is possible for the left and the right ear of a user to be fed acoustic signals which are slightly phase -shifted and adapted in their amplitude, so that the user gets the impression that an acoustic signal generated or stored in a hearing aid or communication system is coming from a specific direction of the space. The user thus gets the impression that the acoustic signal originates from an acoustic signal source with a certain position in the space.
  • US-B 1-5438623 discloses a method for imposing spatial cues to a plurality of audio input signals using synthetic head related transfer functions (HRTFs).
  • HRTFs head related transfer functions
  • US-B 1-6307941 discloses a system and method for providing improved virtual sound images.
  • One or more spatial cues of an audio signal may be modulated within a desired range to increase the clarity and perceived localization of the virtual sound image.
  • US-A1-20050117762 discloses a more computational efficient implementation of HRTF filters with no detectable deterioration of output quality.
  • This invention uses a cascade of resonators and anti-resonators similar to those used in speech synthesizers to model the vocal tract transfer function for implementing HRTF filters.
  • an algorithm that creates a wider sound image by processing only two channels of audio is disclosed.
  • virtual surround systems which employ algorithms that try to localize sounds in virtual space using head-related transfer functions (HRTFs) are disclosed.
  • HRTFs head-related transfer functions
  • Hearing aid systems have been developed for listening to traditional stereo signals. However, when listening to such a signal through a set of hearing aids, the sound will not be subjected to shading effects and the stereo image will be perceived as being narrow and "inside the head”.
  • a digital surround sound signal cannot be played back directly through a set of hearing aids. It is an object of the current invention to overcome this drawback by providing a hearing aid system capable of delivering binaural stereo signals. Hereby it becomes possible for the hearing aid user to perceive the surround sound signal through a set of hearing aids.
  • the invention in a first aspect, provides a hearing aid system according to claim 1.
  • This provides a hearing aid system comprising a left and a right hearing aid and a rendering device, wherein the rendering device is adapted for receiving and decoding a digitally encoded audio signal defining at least two audio input streams and for rendering two output signals defining a binaural stereo signal and for transmitting the two output signals as a left and a right rendered signal to the first and the second hearing aid, each of said first and second hearing aid having means for decoding and playing a respective rendered signal.
  • the rendering device is adapted for receiving and decoding a digitally encoded audio signal defining at least two audio input streams and for rendering two output signals defining a binaural stereo signal and for transmitting the two output signals as a left and a right rendered signal to the first and the second hearing aid, each of said first and second hearing aid having means for decoding and playing a respective rendered signal.
  • This advanced listening feature is achieved without compromising size or electrical power requirements in the hearing aid units themselves, because the rendering device carries out the signal processing required by the binaural stereo rendering. Additionally the decoding in the hearing aid units has been simplified to so called mono-decoding for additional savings with respect to size and electrical power requirements in the hearing aid units themselves. Furthermore, making the rendering processing in the rendering device avoids distortions because the binaural rendering is only carried out once, as opposed to being carried out in both hearing aids independently of each other and based on an input signal that may have been distorted during the transmission from audio device to hearing aid. Finally the necessary bandwidth required for the signal transmitted to the hearing aids is reduced in cases where the number of channels in the received multi-channel digitally encoded audio signal exceeds the two channels that are required for transmitting a binaural stereo signal.
  • the invention in a second aspect, provides a method for replaying at least two audio streams in a pair of hearing aids according to claim 13.
  • This provides a method for replaying at least two audio streams in a pair of hearing aids comprising receiving the at least two audio streams in a rendering device, processing the at least two audio streams in the rendering device to produce two output signals defining a binaural stereo signal, transmitting the two output signals from the rendering device as a left and a right rendered signal to a left and a right hearing aid, and playing a respective rendered signal in each of said left and right hearing aid.
  • Fig. 1 illustrates a highly schematic and simplified block diagram of a hearing aid system according to an embodiment of the present invention
  • Fig. 2 illustrates a highly schematic and simplified block diagram of a hearing aid system according to another preferred embodiment of the present invention
  • Fig. 3 illustrates a highly schematic and simplified block diagram of a hearing aid system according to another preferred embodiment of the present invention
  • Fig. 4 illustrates a highly schematic implementation of a hearing aid system according to another preferred embodiment of the present invention
  • Fig. 5 illustrates schematically a typical listening situation for replay of a traditional audio stereo signal through a pair of loudspeakers
  • Fig. 6 illustrates a highly simplified block diagram of a part of a hearing aid system for rendering a traditional stereo signal into a binaural stereo signal according to an embodiment of the present invention.
  • a hearing aid should be understood as a small, battery- powered, microelectronic device designed to be worn behind or in the human ear by a hearing-impaired user.
  • the hearing aid Prior to use, the hearing aid is adjusted by a hearing aid fitter according to a prescription in order to alleviate a hearing loss by amplifying frequencies in those parts of the audible frequency range where the user has difficulties in perceiving sounds.
  • the prescription is based on a hearing test, which results in an audiogram, signifying the performance of the hearing-impaired user's unaided hearing.
  • a hearing aid comprises one or more microphones, a battery, a microelectronic circuit comprising a signal processor, and an acoustic output transducer.
  • the signal processor is preferably a digital signal processor.
  • the hearing aid is enclosed in a casing suitable for fitting behind or in a human ear.
  • the microphone in the hearing aid converts sounds from the surroundings into an analog, electrical signal.
  • the digital signal processor in the hearing aid converts the analog electrical signal from the microphone into a digital form by virtue of an analog-to-digital converter, and subsequent signal processing is carried out in the digital domain.
  • a hearing aid may come in different styles, such as Behind-the-Ear (BTE), In-the-Ear (ITE) or Completely-in-Canal (CIC) types.
  • BTE Behind-the-Ear
  • ITE In-the-Ear
  • CIC Completely-in-Canal
  • a hearing aid system comprises a pair of hearing aids, in order to allow replay of binaural stereo.
  • the hearing aid system may comprise one or more associated devices, e.g. devices adapted for wireless audio streaming to the hearing aids.
  • the associated devices may also be denoted rendering devices.
  • the general term audio device includes all sorts of devices, capable of delivering a digital audio output such as e.g. televisions, DVD recorders, computers, mp3 players and mobile phones.
  • a digital audio output such as e.g. televisions, DVD recorders, computers, mp3 players and mobile phones.
  • the typical output from these devices will be a multi-channel digitally encoded audio signal.
  • An audio signal in the general meaning of the term comprises all the sounds that may be received by a hearing aid system using e.g. a microphone.
  • a digitally encoded audio signal is a digital signal representing sounds that have been recorded and coded in a digital format. Therefore a hearing aid system can only receive a digitally encoded audio signal using a digital input means such as e.g. Bluetooth receivers, FM receivers or digital plugs and cables.
  • a digital input means such as e.g. Bluetooth receivers, FM receivers or digital plugs and cables.
  • binaural rendering it is a significant advantage to consider only digitally encoded audio signals because the digital formats comprises information on the placement of the intended loudspeakers relative to the listener. This information is e.g. specified in the various commercial surround sound formats. For traditional audio stereo signals of digital origin it is reasonable to assume an intended loudspeaker placement at +/- 30 degrees relative to the listener.
  • rendering is used to refer to a digital transformation, where an audio signal in one digital format is transformed into another digital format suitable for being replayed to a user. I.e. a multi-channel digitally encoded audio signal comprising more than two channels may be rendered for replay by only two channels.
  • binaural rendering refers to the process where any multichannel digitally encoded audio signal is rendered for replay of binaural stereo by two hearing aids.
  • a specific type of binaural rendering transforms a traditional digitally encoded audio stereo signal into a binaural stereo signal. Binaural stereo is explained in - more detail below.
  • the term "mono rendering” refers to the process where any multi-channel digitally encoded audio signal is rendered for replay of only one of the two channels required to generate binaural stereo. Therefore replay of binaural stereo by two hearing aid units using the mono rendering process, requires the process to be adapted to the hearing aid unit, in such a way that the hearing aid units provide the appropriate binaural stereo channel. I.e. the left hearing aid unit provides the left binaural stereo channel and the right hearing aid unit provides the right binaural stereo channel. It follows directly that the mono rendering process requires only half the processing power of the binaural rendering process.
  • A"multi-channel signal” is a signal that includes two or more channels intended for simultaneous replay, e.g. by respective speakers.
  • Stereo and surround sound recordings include multi-channel signals. Examples of multi-channel formats are Channel Surround 2.0, 2.1, 3.0, 4.0, 5.1, 6.1, 7.1, 10.2 and 22.2.
  • binaural stereo is provided by simulating or improving a multi-channel digitally encoded audio signal using two hearing aid units.
  • the method of providing binaural stereo consists of processing a multi-channel digitally encoded audio signal with psychoacoustic sound localization methods to simulate a multi-dimensional sound field for a user wearing two hearing aids. Binaural stereo and the various methods for providing it is further described below with reference to Fig. 5 and Fig. 6.
  • transmission means and “receiving means” should be understood as means for connecting audio devices to the hearing aid system and means for interconnecting the various parts of the hearing aid system.
  • Such means may be telecoils, FM transmitters and receivers, Bluetooth transmitters and receivers, other wireless digital transmitter and receiver types, optical plugs and cables, digital coax plugs and cables as well as any other type of wired or wireless transmitting and receiving means.
  • transmitting and receiving means may be incorporated in both the audio devices and the units of the hearing aid system.
  • the transmitting and receiving means in the various units need not be the same and a single unit may comprise more than one type.
  • the transmission types need not be the same, since the choice depends on the system requirements for the specific transmission path.
  • the transmission format used for signal transmission to the hearing aids themselves should be optimized for requiring a minimum of electrical power for the signal decoding in the hearing aids.
  • audio decoder refers to means for decoding an audio encoded signal.
  • the “audio decoder” typically detects the transmission format of the received digital audio signal and decodes the signal appropriately.
  • audio encoder processes the audio encoding of the given audio signal.
  • “Mono-decoding" of a digital stereo signal is a process where one of the two input stereo channels is decoded and the other of the two input stereo channels is discarded.
  • the right channel of the stereo signal is discarded and in the right hearing aid unit the left channel of the stereo signal is discarded.
  • the required processing power for the "mono-decoding" is only half or less that of the traditional audio decoding of a multi-channel signal.
  • FIG. 6 shows a block diagram of a part of a hearing aid system for rendering a digitally encoded stereo audio signal into a digital binaural stereo signal according to an embodiment of the present invention.
  • Fig. 6 illustrates a digital filter configuration 600 adapted for processing a first digital input signal 601-1 representing a left traditional stereo channel, and a second digital input signal 601-1 representing a right traditional stereo channel in order to output a first digital output signal 602-1 representing a left binaural stereo channel, and a second digital output signal 602-r representing a right binaural stereo channel.
  • the left binaural stereo channel 602-1 is the sum of the first digital input signal 601-1 filtered by a first digital filter 603 and the second digital input signal 601-r filtered by a second digital filter 604.
  • the right binaural stereo channel 602-r is the sum of the first digital input signal 601-1 filtered by a third digital filter 605 and the second digital input signal 601-r filtered by a fourth digital filter 606.
  • the first digital filter 603 represents the transfer function for sound transmitted from a left loudspeaker to the left ear of a listener inclusive HRTF and room impulse response.
  • the second digital filter 604 represents the transfer function for sound transmitted from a left loudspeaker to the right ear of a listener inclusive HRTF and room impulse response.
  • the third digital filter 605 represents the transfer function for sound transmitted from a right loudspeaker to the right ear of a listener inclusive HRTF and room impulse response.
  • the fourth digital filter 606 represents the transfer function for sound transmitted from a right loudspeaker to the left ear of a listener inclusive HRTF and room impulse response.
  • FIG. 5 shows schematically a typical listening situation for replay of a traditional audio stereo signal of digital origin through a set of loudspeakers.
  • Fig. 5 illustrates a stereo set 500, comprising a stereo processor unit 501 and left and right loudspeakers 502-1, 502 -r.
  • the stereo set and the listener are positioned in a room 508.
  • the direct sound 504 reaches the right ear 509-r first. Then, the reflective sounds from the walls and the ceiling (506-1, ..506-n) arrive. Further, the sound waves having been subjected to repeated multiple reflections on the surrounding walls (507-1, ..,507- n) reach as reverberation. If for example, a very short sound with a flat frequency response is emitted from the loudspeaker, the listener receives a time series of the reflected sound. This is called the "impulse response". The impulse response contains information about the acoustical properties of a room.
  • the knowledge of the typical impulse response of various locations such as a living room, church or concert hall may be used in processing for simulating a virtual acoustic reality.
  • This kind of processing can be implemented in a hearing aid system, according to the present invention, adapted to offer the user the choice between a variety of virtual locations, that the user may prefer for listening.
  • HRTFs Head Related Transfer Functions
  • HRTFs are response functions that characterize how a given single-channel audio signal from a given location is perceived by a listener. This means that the HRTF can be used to determine the relation between the signal 504 from the right loudspeaker 502 -r and to the right ear 509-r and the signal 505 from the right loudspeaker and to the left ear 509-1. Therefore the HRTFs contain information that is necessary to render binaural stereo in a set of hearing aids.
  • the HRTF can be captured in an anechoic chamber, using a model of a human head, with microphones placed in the ear canals.
  • the binaural stereo signal is provided based on more than two digital input signals.
  • digital surround sound signals having more than two channels can be rendered for binaural stereo.
  • the binaural stereo effect may also be provided using a number of alternative transformation techniques, as will be known in the art.
  • FIG. 1 shows a highly schematic and simplified block diagram of a part of a hearing aid system according to an embodiment of the present invention.
  • Fig. 1 illustrates a pair of hearing aids 100, comprising a left and a right hearing aid 105-L and 105 -R, each adapted for receiving a multi-channel digitally encoded audio signal 101, and further comprising means 102-L, 102-R for receiving said multi-channel signal, means 103-L, 103-R for audio decoding said received multichannel signal, means 104-L, 104-R for mono rendering in order to provide a binaural stereo signal using the corresponding left and right ear hearing aids.
  • the hearing aid microphones 107-L and 107-R are not used for providing the binaural stereo signal.
  • the binaural stereo signal outputs from the mono rendering means are used as input to digital signal processors 106-L and 106-R in each of the hearing aid units.
  • the hearing aids have microphones 107-L and 107-R, which pick up ambient sound and feed it into signal processors, 106-L and 106-R.
  • the digital signal processor mixes the inputs and carry out the hearing loss compensation.
  • the processors may comprise controls for selecting among the inputs, or for adjusting the balance among them.
  • the receiving means is a Bluetooth receiver
  • the audio device (which is not shown in Fig. 1) is a Bluetooth enabled personal computer. Therefore the personal computer is capable of providing the hearing aid units with MP3 coded audio stereo signals.
  • the audio decoder in the hearing aid unit is capable of decoding the MP3 coding and the rendering transforms the traditional stereo signal into a binaural stereo signal with a wider stereo image.
  • the receiving means is a telecoil and the audio device (which is not shown in Fig. 1) is a telecoil system that has been adapted for pulse-width coding in order to allow a stereo signal to be transmitted.
  • the audio decoder in the hearing aid unit decodes the pulse-width coded signal and the rendering transforms the traditional stereo signal into a binaural stereo signal with a wider stereo image.
  • the binaural stereo signal is provided based on a digital surround sound signal having more than two channels.
  • a user may enjoy virtual surround sound through a pair of hearing aids.
  • FIG. 2 shows a highly schematic and simplified block diagram of a hearing aid system according to another embodiment of the invention.
  • Fig. 2 illustrates the hearing aid system 200, generally comprising an associated device 202, left and right hearing aid units 203-L, 203-R.
  • the associated device comprises receiving means 204 for receiving a multi-channel digitally encoded audio signal 201 from an audio device (not shown in Fig. 2), an audio decoder 205 for decoding said received multi-channel signal, an audio encoder 206 for adapting said received signal for transmission to the hearing aids and transmission means 207 for transmitting the encoded signal.
  • the hearing aids 203-L, 203-R further comprise receiving means 208- L, 208-R for receiving said transmitted signal, decoding means 209-L and 209-R for decoding said received signal, rendering means 210-L, 210-R for mono rendering in order to provide a binaural stereo signal using the corresponding left and right ear hearing aids.
  • the hearing aids further comprise microphones and signal processors (not shown in Fig. 2) configured as discussed above with reference to Fig. 1.
  • the associated device is a hearing aid remote control adapted for allowing cable connection to a streaming audio device, such as an MP3 player.
  • the hearing aid systems 200 and 300 may further comprise additional associated devices.
  • An example of such a hearing aid system is described with reference to Fig. 4.
  • FIG. 3 shows a highly schematic and simplified block diagram of a hearing aid system according to a preferred embodiment of the present invention.
  • Fig. 3 illustrates the hearing aid system 300, generally comprising an associated device 302 and left and right hearing aids 303 -L, 303 -R.
  • the associated device further comprises receiving means 304 for receiving a multi-channel digitally encoded audio signal 301, an audio decoder 305 for decoding the received multi- channel signal, means 306 for rendering the decoded signal into a binaural stereo signal, means 307 for encoding the binaural stereo signal for transmission towards the two hearing aids and means 308 for transmitting the encoded signal towards the two hearing aids 303-L, 303-R.
  • the hearing aids further comprise means 309-1, 309-R for receiving a transmitted signal, means 310-L and 310-R for mono decoding the received signal in the corresponding left and right hearing aid units and microphones and signal processors (not shown in Fig. 3) configured as discussed above with reference to Fig. 1.
  • the resulting binaural stereo signal is less sensitive to possible distortions of the signal transmitted from the associated device towards the respective hearing aids.
  • Fig. 4 shows a DVD player 401, that supports DVDs with multi-channel digitally encoded audio.
  • the DVD player is connected to a television set 402, a surround sound amplifier 403 and a first associated device 302 dedicated for binaural rendering, encoding and subsequently wirelessly transmitting the binaural stereo signal to a second associated device 404, which is adapted for relaying wirelessly the audio signal further on to the respective hearing aids 303-L and 303-R.
  • the second associated device ensures that the wireless signal transmission consumes a minimum of electrical power in the hearing aids.
  • the hearing aid user can enjoy the full benefit of the audio surround sound that today is a part of many DVD movies.
  • the complex and therefore power consuming binaural rendering process is carried out by the first associated device, that may be connected to a wall plug as opposed to the second associated device and the hearing aids that will normally be battery powered.
  • the television set, DVD player, the surround sound amplifier and first associated device are connected with digital coax cables.
  • the first associated device functions as base station for the second associated device and wherein the second associated device functions as a hearing aid remote control.

Abstract

A hearing aid system comprising means (304) for receiving a multi-channel digitally encoded audio signal (301) and means (306) for rendering said received multi-channel signal into a binaural stereo signal. The invention further provides a method for replaying audio streams in hearing aids.

Description

METHOD OF RENDERING BINAURAL STEREO IN A HEARING AID SYSTEM AND A HEARING AID SYSTEM
FIELD OF THE INVENTION
The present invention relates to hearing aids. The invention, more specifically, relates to a hearing aid system for rendering a multi-channel digitally encoded audio signal into a binaural stereo signal.
BACKGROUND OF THE INVENTION
US-A 1-20080008341 discloses a hearing assistance system that presents sound to both ears of a user wearing wireless hearing assistance devices which is derived from a single monaural signal. Among other things, it allows for better control of the received sound and obtains benefits of binaural hearing for listening to the monaural signal. In various embodiments, the sound presented to one ear is phase shifted relative to the sound presented to the other ear. In some embodiments, the phase shift arises from a constant time delay or the phase shift arises from a constant phase shift at all frequencies. In other embodiments, the phase shift arises from a phase shift that is varying as a function of frequency. In still other embodiments, the sound presented to one ear is set to a different level relative to the sound presented to the other ear. In further embodiments, the sound presented to one ear is controllable in relative phase and in relative level with respect to the sound presented to the other ear.
WO-A 1-2006133158 discloses a hearing aid system adapted for wireless communications between one or more wireless audio devices and other electronics for providing e.g. streaming audio and other enhanced hearing functions. Mono and stereo communication modes are supported in various embodiments. In one embodiment an interface device has a first port, which is adapted to receive information from a communication device. The information is subsequently processed or formatted if required, and transmitted wirelessly to one or more audio devices. In one application, streaming audio packets are received from the communication device and in some embodiments the streaming audio is in stereo. The interface device can transmit stereo information that is received by the proper wireless audio device to preserve the stereo nature of the information. In one application the communication device includes a computer connected to a content source over a network, such as the Internet, hi one application, it includes a storage device, such as an iPodTM or other streaming audio device. In one application it includes a connection to a wireless audio source, hi one application it includes a wireless connection to a Bluetooth MP3 player. One application includes a wired stereo or mono connection.
WO-Al -200674655 discloses a hearing aid system, which enables signals of arbitrary origin to be transmitted from a portable module to one or more hearing aids. This feature may, for instance, be used for transferring digital audio signals to the hearing aid from the portable module. The transmission of data may be from an external source, such as a personal computer or similar appliance, wirelessly to the hearing aid via the portable module.
US-A1-20060018497 discloses a communication system where exactly matched, but generally slightly different acoustic signals can be created and directed to the user's left and right ear. This means that it is possible for the left and the right ear of a user to be fed acoustic signals which are slightly phase -shifted and adapted in their amplitude, so that the user gets the impression that an acoustic signal generated or stored in a hearing aid or communication system is coming from a specific direction of the space. The user thus gets the impression that the acoustic signal originates from an acoustic signal source with a certain position in the space.
US-B 1-5438623 discloses a method for imposing spatial cues to a plurality of audio input signals using synthetic head related transfer functions (HRTFs). Hereby the plurality of audio input signals will be perceived by the user as emerging from a corresponding plurality of predetermined directions.
US-B 1-6307941 discloses a system and method for providing improved virtual sound images. One or more spatial cues of an audio signal may be modulated within a desired range to increase the clarity and perceived localization of the virtual sound image. Hereby a system that is less sensitive to head movements of the user is achieved. US-A1-20050117762 discloses a more computational efficient implementation of HRTF filters with no detectable deterioration of output quality. This invention uses a cascade of resonators and anti-resonators similar to those used in speech synthesizers to model the vocal tract transfer function for implementing HRTF filters. Further an algorithm that creates a wider sound image by processing only two channels of audio is disclosed. Finally virtual surround systems, which employ algorithms that try to localize sounds in virtual space using head-related transfer functions (HRTFs) are disclosed.
For replay of sound there are a number of formats in use. In mono replay there is one channel of sound, and the sound can be replayed by a single loudspeaker. For traditional stereo replay, two channels are provided, and the listener will normally replay them using two loudspeakers. The loudspeakers will preferably be arranged in the listening theatre vis-a-vis the listener in a triangle in equal distances to the listener and with a wide spacing symmetrical about the listeners preferred direction of view in order to offer the maximum of spatial experience. Stereo recordings of music and other sound bits will normally be optimized for this kind of listening. Other sound formats used today are surround sound systems with five, six or even more channels arranged in a spatial pattern around the user. A listener with unimpaired hearing will hear sound from any of the speakers with both ears, shading effects of the head and the external ear colouring the sound, whereby the listener can distinguish among the sources.
Hearing aid systems have been developed for listening to traditional stereo signals. However, when listening to such a signal through a set of hearing aids, the sound will not be subjected to shading effects and the stereo image will be perceived as being narrow and "inside the head".
It is an object of the current invention to overcome this shortcoming and make a hearing aid system capable of delivering binaural stereo signals. Hereby it becomes possible for the hearing aid user to perceive the stereo image as being wider and more natural.
It is also well known to experience listening fatigue when listening to traditional stereo signals in headphones. It is a further object of the current invention to overcome this drawback when listening to traditional stereo signals streamed to a pair of hearing aids and make a hearing aid system capable of rendering binaural stereo signals that may relieve the hearing aid user from listening fatigue. This can be done by introducing frequency dependent cross talk between the traditional stereo signals. The relief from listening fatigue may be provided by a number of alternative techniques, as will be known in the art.
Today, many home entertainment appliances are capable of providing the necessary output to drive a traditional surround sound system. As an example many DVD movies comprise surround sound. Many hearing aid users prefer to have their hearing aids linked directly to e.g. the television or DVD player and in this way bypass both the television speaker and hearing aid microphone. Hereby e.g. ambient noise and reverberations will not interfere with the television or DVD signal and it therefore becomes possible to improve both the signal to noise ratio and speech intelligibility of the audio signal.
However, a digital surround sound signal cannot be played back directly through a set of hearing aids. It is an object of the current invention to overcome this drawback by providing a hearing aid system capable of delivering binaural stereo signals. Hereby it becomes possible for the hearing aid user to perceive the surround sound signal through a set of hearing aids.
SUMMARY OF THE INVENTION
The invention, in a first aspect, provides a hearing aid system according to claim 1.
This provides a hearing aid system comprising a left and a right hearing aid and a rendering device, wherein the rendering device is adapted for receiving and decoding a digitally encoded audio signal defining at least two audio input streams and for rendering two output signals defining a binaural stereo signal and for transmitting the two output signals as a left and a right rendered signal to the first and the second hearing aid, each of said first and second hearing aid having means for decoding and playing a respective rendered signal. Hereby an advanced listening feature is achieved, which would otherwise be denied many hearing aid users because most hearing aid types does not interact conveniently with head phones, which are generally the preferred tool for enjoying binaural stereo.
This advanced listening feature is achieved without compromising size or electrical power requirements in the hearing aid units themselves, because the rendering device carries out the signal processing required by the binaural stereo rendering. Additionally the decoding in the hearing aid units has been simplified to so called mono-decoding for additional savings with respect to size and electrical power requirements in the hearing aid units themselves. Furthermore, making the rendering processing in the rendering device avoids distortions because the binaural rendering is only carried out once, as opposed to being carried out in both hearing aids independently of each other and based on an input signal that may have been distorted during the transmission from audio device to hearing aid. Finally the necessary bandwidth required for the signal transmitted to the hearing aids is reduced in cases where the number of channels in the received multi-channel digitally encoded audio signal exceeds the two channels that are required for transmitting a binaural stereo signal.
The invention, in a second aspect, provides a method for replaying at least two audio streams in a pair of hearing aids according to claim 13.
This provides a method for replaying at least two audio streams in a pair of hearing aids comprising receiving the at least two audio streams in a rendering device, processing the at least two audio streams in the rendering device to produce two output signals defining a binaural stereo signal, transmitting the two output signals from the rendering device as a left and a right rendered signal to a left and a right hearing aid, and playing a respective rendered signal in each of said left and right hearing aid.
Further advantageous features appear from the other dependent claims.
Still other objects of the present invention will become apparent to those skilled in the art from the following description wherein embodiments of the invention will be explained in greater detail.
BRIEF DESCRIPTION OF THE DRAWINGS By way of example, there is shown and described a preferred embodiment of this invention. As will be realized, the invention is capable of other different embodiments, and its several details are capable of modification in various, obvious aspects all without departing from the invention. Accordingly, the drawings and descriptions will be regarded as illustrative in nature and not as restrictive. In the drawings:
Fig. 1 illustrates a highly schematic and simplified block diagram of a hearing aid system according to an embodiment of the present invention;
Fig. 2 illustrates a highly schematic and simplified block diagram of a hearing aid system according to another preferred embodiment of the present invention;
Fig. 3 illustrates a highly schematic and simplified block diagram of a hearing aid system according to another preferred embodiment of the present invention;
Fig. 4 illustrates a highly schematic implementation of a hearing aid system according to another preferred embodiment of the present invention;
Fig. 5 illustrates schematically a typical listening situation for replay of a traditional audio stereo signal through a pair of loudspeakers; and
Fig. 6 illustrates a highly simplified block diagram of a part of a hearing aid system for rendering a traditional stereo signal into a binaural stereo signal according to an embodiment of the present invention.
DETAILED DESCRIPTION
In order to more fully detail the present invention some terms used in the definition of the invention are explained in the following.
In the present disclosure, a hearing aid should be understood as a small, battery- powered, microelectronic device designed to be worn behind or in the human ear by a hearing-impaired user. Prior to use, the hearing aid is adjusted by a hearing aid fitter according to a prescription in order to alleviate a hearing loss by amplifying frequencies in those parts of the audible frequency range where the user has difficulties in perceiving sounds. The prescription is based on a hearing test, which results in an audiogram, signifying the performance of the hearing-impaired user's unaided hearing. A hearing aid comprises one or more microphones, a battery, a microelectronic circuit comprising a signal processor, and an acoustic output transducer. The signal processor is preferably a digital signal processor. The hearing aid is enclosed in a casing suitable for fitting behind or in a human ear. The microphone in the hearing aid converts sounds from the surroundings into an analog, electrical signal. The digital signal processor in the hearing aid converts the analog electrical signal from the microphone into a digital form by virtue of an analog-to-digital converter, and subsequent signal processing is carried out in the digital domain. A hearing aid may come in different styles, such as Behind-the-Ear (BTE), In-the-Ear (ITE) or Completely-in-Canal (CIC) types.
In the present disclosure "a hearing aid system" comprises a pair of hearing aids, in order to allow replay of binaural stereo. In addition to the hearing aids themselves the hearing aid system may comprise one or more associated devices, e.g. devices adapted for wireless audio streaming to the hearing aids. In the following the associated devices may also be denoted rendering devices.
The general term audio device, as opposed to associated device or rendering device, includes all sorts of devices, capable of delivering a digital audio output such as e.g. televisions, DVD recorders, computers, mp3 players and mobile phones. The typical output from these devices will be a multi-channel digitally encoded audio signal.
An audio signal, in the general meaning of the term comprises all the sounds that may be received by a hearing aid system using e.g. a microphone. As opposed to this a digitally encoded audio signal is a digital signal representing sounds that have been recorded and coded in a digital format. Therefore a hearing aid system can only receive a digitally encoded audio signal using a digital input means such as e.g. Bluetooth receivers, FM receivers or digital plugs and cables. With respect to binaural rendering it is a significant advantage to consider only digitally encoded audio signals because the digital formats comprises information on the placement of the intended loudspeakers relative to the listener. This information is e.g. specified in the various commercial surround sound formats. For traditional audio stereo signals of digital origin it is reasonable to assume an intended loudspeaker placement at +/- 30 degrees relative to the listener.
The general term "rendering"is used to refer to a digital transformation, where an audio signal in one digital format is transformed into another digital format suitable for being replayed to a user. I.e. a multi-channel digitally encoded audio signal comprising more than two channels may be rendered for replay by only two channels.
In the present disclosure "binaural rendering" refers to the process where any multichannel digitally encoded audio signal is rendered for replay of binaural stereo by two hearing aids. A specific type of binaural rendering transforms a traditional digitally encoded audio stereo signal into a binaural stereo signal. Binaural stereo is explained in - more detail below.
In the present disclosure the term "mono rendering" refers to the process where any multi-channel digitally encoded audio signal is rendered for replay of only one of the two channels required to generate binaural stereo. Therefore replay of binaural stereo by two hearing aid units using the mono rendering process, requires the process to be adapted to the hearing aid unit, in such a way that the hearing aid units provide the appropriate binaural stereo channel. I.e. the left hearing aid unit provides the left binaural stereo channel and the right hearing aid unit provides the right binaural stereo channel. It follows directly that the mono rendering process requires only half the processing power of the binaural rendering process.
A"multi-channel signal" is a signal that includes two or more channels intended for simultaneous replay, e.g. by respective speakers. Stereo and surround sound recordings include multi-channel signals. Examples of multi-channel formats are Channel Surround 2.0, 2.1, 3.0, 4.0, 5.1, 6.1, 7.1, 10.2 and 22.2.
In the present disclosure "binaural stereo" is provided by simulating or improving a multi-channel digitally encoded audio signal using two hearing aid units. Typically the method of providing binaural stereo consists of processing a multi-channel digitally encoded audio signal with psychoacoustic sound localization methods to simulate a multi-dimensional sound field for a user wearing two hearing aids. Binaural stereo and the various methods for providing it is further described below with reference to Fig. 5 and Fig. 6.
In this application "transmission means" and "receiving means" should be understood as means for connecting audio devices to the hearing aid system and means for interconnecting the various parts of the hearing aid system. Such means may be telecoils, FM transmitters and receivers, Bluetooth transmitters and receivers, other wireless digital transmitter and receiver types, optical plugs and cables, digital coax plugs and cables as well as any other type of wired or wireless transmitting and receiving means. Thus, in the present application such transmitting and receiving means may be incorporated in both the audio devices and the units of the hearing aid system. The transmitting and receiving means in the various units need not be the same and a single unit may comprise more than one type. Especially in hearing aid systems with several associated devices the transmission types need not be the same, since the choice depends on the system requirements for the specific transmission path. As an example the transmission format used for signal transmission to the hearing aids themselves should be optimized for requiring a minimum of electrical power for the signal decoding in the hearing aids.
It is well known to use an audio codec algorithm in order to represent an audio signal with a minimum number of bits while retaining the quality. This can effectively reduce the bandwidth required for transmission of an audio file. Examples of audio codecs are MP3, WMA, AAC and AC-3 (digital dolby). In the present application the term "audio decoder" refers to means for decoding an audio encoded signal. The "audio decoder" typically detects the transmission format of the received digital audio signal and decodes the signal appropriately. Correspondingly the "audio encoder" processes the audio encoding of the given audio signal.
"Mono-decoding" of a digital stereo signal (which may be either a binaural or traditional stereo signal) is a process where one of the two input stereo channels is decoded and the other of the two input stereo channels is discarded. Thus in the left hearing aid unit the right channel of the stereo signal is discarded and in the right hearing aid unit the left channel of the stereo signal is discarded. Hereby the required processing power for the "mono-decoding" is only half or less that of the traditional audio decoding of a multi-channel signal.
Reference is first made to Fig. 6, which shows a block diagram of a part of a hearing aid system for rendering a digitally encoded stereo audio signal into a digital binaural stereo signal according to an embodiment of the present invention. Fig. 6 illustrates a digital filter configuration 600 adapted for processing a first digital input signal 601-1 representing a left traditional stereo channel, and a second digital input signal 601-1 representing a right traditional stereo channel in order to output a first digital output signal 602-1 representing a left binaural stereo channel, and a second digital output signal 602-r representing a right binaural stereo channel. The left binaural stereo channel 602-1 is the sum of the first digital input signal 601-1 filtered by a first digital filter 603 and the second digital input signal 601-r filtered by a second digital filter 604. The right binaural stereo channel 602-r is the sum of the first digital input signal 601-1 filtered by a third digital filter 605 and the second digital input signal 601-r filtered by a fourth digital filter 606.
The first digital filter 603 represents the transfer function for sound transmitted from a left loudspeaker to the left ear of a listener inclusive HRTF and room impulse response.
The second digital filter 604 represents the transfer function for sound transmitted from a left loudspeaker to the right ear of a listener inclusive HRTF and room impulse response.
The third digital filter 605 represents the transfer function for sound transmitted from a right loudspeaker to the right ear of a listener inclusive HRTF and room impulse response.
The fourth digital filter 606 represents the transfer function for sound transmitted from a right loudspeaker to the left ear of a listener inclusive HRTF and room impulse response.
Reference is now made to Fig. 5, which shows schematically a typical listening situation for replay of a traditional audio stereo signal of digital origin through a set of loudspeakers. Fig. 5 illustrates a stereo set 500, comprising a stereo processor unit 501 and left and right loudspeakers 502-1, 502 -r. A listener 503, with a right ear 509-r and a left ear 509-1, receives the sound emitted from both loudspeakers. The stereo set and the listener are positioned in a room 508.
For reasons of simplicity only sound emitted from the right loudspeaker and to the right ear is considered in the following. When sound is emitted from the right loudspeaker 502 -r, the direct sound 504 reaches the right ear 509-r first. Then, the reflective sounds from the walls and the ceiling (506-1, ..506-n) arrive. Further, the sound waves having been subjected to repeated multiple reflections on the surrounding walls (507-1, ..,507- n) reach as reverberation. If for example, a very short sound with a flat frequency response is emitted from the loudspeaker, the listener receives a time series of the reflected sound. This is called the "impulse response". The impulse response contains information about the acoustical properties of a room.
The knowledge of the typical impulse response of various locations such as a living room, church or concert hall may be used in processing for simulating a virtual acoustic reality. This kind of processing can be implemented in a hearing aid system, according to the present invention, adapted to offer the user the choice between a variety of virtual locations, that the user may prefer for listening.
In the listening situation shown in Fig. 5 the sound received at each ear of the listener is a linear combination of the sound emitted from the left and the right loudspeaker. Head Related Transfer Functions (HRTFs) are response functions that characterize how a given single-channel audio signal from a given location is perceived by a listener. This means that the HRTF can be used to determine the relation between the signal 504 from the right loudspeaker 502 -r and to the right ear 509-r and the signal 505 from the right loudspeaker and to the left ear 509-1. Therefore the HRTFs contain information that is necessary to render binaural stereo in a set of hearing aids.
The HRTF can be captured in an anechoic chamber, using a model of a human head, with microphones placed in the ear canals. In an embodiment of the present invention the binaural stereo signal is provided based on more than two digital input signals. Hereby digital surround sound signals having more than two channels can be rendered for binaural stereo.
The binaural stereo effect may also be provided using a number of alternative transformation techniques, as will be known in the art.
Reference is now made to Fig. 1 , which shows a highly schematic and simplified block diagram of a part of a hearing aid system according to an embodiment of the present invention. Fig. 1 illustrates a pair of hearing aids 100, comprising a left and a right hearing aid 105-L and 105 -R, each adapted for receiving a multi-channel digitally encoded audio signal 101, and further comprising means 102-L, 102-R for receiving said multi-channel signal, means 103-L, 103-R for audio decoding said received multichannel signal, means 104-L, 104-R for mono rendering in order to provide a binaural stereo signal using the corresponding left and right ear hearing aids. It is noted that the hearing aid microphones 107-L and 107-R are not used for providing the binaural stereo signal. The binaural stereo signal outputs from the mono rendering means are used as input to digital signal processors 106-L and 106-R in each of the hearing aid units. The hearing aids have microphones 107-L and 107-R, which pick up ambient sound and feed it into signal processors, 106-L and 106-R. The digital signal processor mixes the inputs and carry out the hearing loss compensation. The processors may comprise controls for selecting among the inputs, or for adjusting the balance among them.
Hereby an advanced listening feature is achieved, which would otherwise be denied many hearing aid users because most hearing aid types does not interact conveniently with head phones, which are generally the preferred tool for enjoying binaural stereo.
In one embodiment the receiving means is a Bluetooth receiver, and the audio device (which is not shown in Fig. 1) is a Bluetooth enabled personal computer. Therefore the personal computer is capable of providing the hearing aid units with MP3 coded audio stereo signals. The audio decoder in the hearing aid unit is capable of decoding the MP3 coding and the rendering transforms the traditional stereo signal into a binaural stereo signal with a wider stereo image. In another embodiment the receiving means is a telecoil and the audio device (which is not shown in Fig. 1) is a telecoil system that has been adapted for pulse-width coding in order to allow a stereo signal to be transmitted. The audio decoder in the hearing aid unit decodes the pulse-width coded signal and the rendering transforms the traditional stereo signal into a binaural stereo signal with a wider stereo image.
Alternatively, the binaural stereo signal is provided based on a digital surround sound signal having more than two channels. Hereby a user may enjoy virtual surround sound through a pair of hearing aids.
Reference is now made to Fig. 2, which shows a highly schematic and simplified block diagram of a hearing aid system according to another embodiment of the invention. Fig. 2 illustrates the hearing aid system 200, generally comprising an associated device 202, left and right hearing aid units 203-L, 203-R. The associated device comprises receiving means 204 for receiving a multi-channel digitally encoded audio signal 201 from an audio device (not shown in Fig. 2), an audio decoder 205 for decoding said received multi-channel signal, an audio encoder 206 for adapting said received signal for transmission to the hearing aids and transmission means 207 for transmitting the encoded signal. The hearing aids 203-L, 203-R further comprise receiving means 208- L, 208-R for receiving said transmitted signal, decoding means 209-L and 209-R for decoding said received signal, rendering means 210-L, 210-R for mono rendering in order to provide a binaural stereo signal using the corresponding left and right ear hearing aids. The hearing aids further comprise microphones and signal processors (not shown in Fig. 2) configured as discussed above with reference to Fig. 1.
hi an embodiment the associated device is a hearing aid remote control adapted for allowing cable connection to a streaming audio device, such as an MP3 player.
The hearing aid systems 200 and 300 (refer to Fig. 3) may further comprise additional associated devices. An example of such a hearing aid system is described with reference to Fig. 4.
Reference is now made to Fig. 3, which shows a highly schematic and simplified block diagram of a hearing aid system according to a preferred embodiment of the present invention. Fig. 3 illustrates the hearing aid system 300, generally comprising an associated device 302 and left and right hearing aids 303 -L, 303 -R. The associated device further comprises receiving means 304 for receiving a multi-channel digitally encoded audio signal 301, an audio decoder 305 for decoding the received multi- channel signal, means 306 for rendering the decoded signal into a binaural stereo signal, means 307 for encoding the binaural stereo signal for transmission towards the two hearing aids and means 308 for transmitting the encoded signal towards the two hearing aids 303-L, 303-R. The hearing aids further comprise means 309-1, 309-R for receiving a transmitted signal, means 310-L and 310-R for mono decoding the received signal in the corresponding left and right hearing aid units and microphones and signal processors (not shown in Fig. 3) configured as discussed above with reference to Fig. 1.
Hereby an advanced listening feature is achieved without compromising size or electrical power requirements in the hearing aids themselves, because the associated device carries out the signal processing required by the binaural stereo rendering. Additionally the decoding in the hearing aid units has been simplified to so called mono-decoding for additional savings with respect to size and electrical power requirements in the hearing aid units themselves.
Furthermore, the resulting binaural stereo signal is less sensitive to possible distortions of the signal transmitted from the associated device towards the respective hearing aids.
Reference is now made to Fig. 4, which shows an illustration of a specific embodiment of the present invention. Fig. 4 shows a DVD player 401, that supports DVDs with multi-channel digitally encoded audio. The DVD player is connected to a television set 402, a surround sound amplifier 403 and a first associated device 302 dedicated for binaural rendering, encoding and subsequently wirelessly transmitting the binaural stereo signal to a second associated device 404, which is adapted for relaying wirelessly the audio signal further on to the respective hearing aids 303-L and 303-R. The second associated device ensures that the wireless signal transmission consumes a minimum of electrical power in the hearing aids. Hereby the hearing aid user can enjoy the full benefit of the audio surround sound that today is a part of many DVD movies. Furthermore it should be appreciated that the complex and therefore power consuming binaural rendering process is carried out by the first associated device, that may be connected to a wall plug as opposed to the second associated device and the hearing aids that will normally be battery powered.
hi an embodiment the television set, DVD player, the surround sound amplifier and first associated device are connected with digital coax cables.
In another embodiment the first associated device functions as base station for the second associated device and wherein the second associated device functions as a hearing aid remote control.
Other modifications and variations of the structures and methods will be evident to those skilled in the art.

Claims

1. A hearing aid system comprising a left and a right hearing aid and a rendering device, wherein the rendering device is adapted for receiving and decoding a digitally encoded audio signal defining at least two audio input streams and for rendering two output signals defining a binaural stereo signal and for transmitting the two output signals as a left and a right rendered signal to the first and the second hearing aid, each of said first and second hearing aid having means for decoding and playing a respective rendered signal.
2. The hearing aid system according to claim 1 , wherein the rendering device comprises a digital filter configuration wherein each of the two output signals is provided as a linear sum of digitally filtered versions of all the audio input signals.
3. The hearing aid system according to claim 1 or 2, wherein the rendering device comprises a receiver for receiving the digitally encoded audio signal.
4. The hearing aid system according to claim 1 , wherein the rendering device is adapted for rendering the two output signals by subjecting the at least two audio input streams to frequency dependent cross talk.
5. The hearing aid system according to anyone of the preceding claims, wherein the rendering device is adapted for processing a multi-channel audio input stream.
6. The hearing aid system according to anyone of the preceding claims, wherein the rendering device comprises a user input means and a remote control output.
7. The hearing aid system according to anyone of the preceding claims, wherein the rendering device is adapted for rendering the two output signals by subjecting the at least two audio input streams to a head related transfer function.
8. The hearing aid system according to claim 7, wherein the rendering device has means for selecting cues for the head related transfer function for simulating a specific listening environment such as one selected from the group living room, church and concert hall.
9. The hearing aid system according to claim 8, wherein the cues for the rendering device have been derived by measuring the acoustic impulse response of a selected acoustic environment.
10. The hearing aid system according to anyone of the preceding claims, wherein the rendering device is a portable, battery-powered device.
11. The hearing aid system according to anyone of the claims 1 to 9, wherein the rendering device is powered from a wall socket.
12. The hearing aid system according to claim 11, wherein the rendering device additionally functions as base station for a hearing aid remote control.
13. A method for replaying at least two audio streams in a pair of hearing aids, comprising receiving the at least two audio streams in a rendering device, processing the at least two audio streams in the rendering device to produce two output signals defining a binaural stereo signal, transmitting the two output signals from the rendering device as a left and a right rendered signal to a left and a right hearing aid, and playing a respective rendered signal in each of said left and right hearing aid.
PCT/DK2008/000363 2008-10-14 2008-10-14 Method of rendering binaural stereo in a hearing aid system and a hearing aid system WO2010043223A1 (en)

Priority Applications (8)

Application Number Priority Date Filing Date Title
KR1020117008911A KR20110069112A (en) 2008-10-14 2008-10-14 Method of rendering binaural stereo in a hearing aid system and a hearing aid system
AU2008362920A AU2008362920B2 (en) 2008-10-14 2008-10-14 Method of rendering binaural stereo in a hearing aid system and a hearing aid system
JP2011531354A JP5325988B2 (en) 2008-10-14 2008-10-14 Method for rendering binaural stereo in a hearing aid system and hearing aid system
CA2740522A CA2740522A1 (en) 2008-10-14 2008-10-14 Method of rendering binaural stereo in a hearing aid system and a hearing aid system
CN2008801315463A CN102187690A (en) 2008-10-14 2008-10-14 Method of rendering binaural stereo in a hearing aid system and a hearing aid system
EP08874938A EP2351384A1 (en) 2008-10-14 2008-10-14 Method of rendering binaural stereo in a hearing aid system and a hearing aid system
PCT/DK2008/000363 WO2010043223A1 (en) 2008-10-14 2008-10-14 Method of rendering binaural stereo in a hearing aid system and a hearing aid system
US13/083,080 US20110188662A1 (en) 2008-10-14 2011-04-08 Method of rendering binaural stereo in a hearing aid system and a hearing aid system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/DK2008/000363 WO2010043223A1 (en) 2008-10-14 2008-10-14 Method of rendering binaural stereo in a hearing aid system and a hearing aid system

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US13/083,080 Continuation-In-Part US20110188662A1 (en) 2008-10-14 2011-04-08 Method of rendering binaural stereo in a hearing aid system and a hearing aid system

Publications (1)

Publication Number Publication Date
WO2010043223A1 true WO2010043223A1 (en) 2010-04-22

Family

ID=40547970

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/DK2008/000363 WO2010043223A1 (en) 2008-10-14 2008-10-14 Method of rendering binaural stereo in a hearing aid system and a hearing aid system

Country Status (8)

Country Link
US (1) US20110188662A1 (en)
EP (1) EP2351384A1 (en)
JP (1) JP5325988B2 (en)
KR (1) KR20110069112A (en)
CN (1) CN102187690A (en)
AU (1) AU2008362920B2 (en)
CA (1) CA2740522A1 (en)
WO (1) WO2010043223A1 (en)

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2012092973A1 (en) 2011-01-07 2012-07-12 Widex A/S A hearing aid system with a dual mode wireless radio
WO2012127828A1 (en) * 2011-03-18 2012-09-27 パナソニック株式会社 Hearing aid apparatus and sound control method
JP2015019360A (en) * 2013-07-04 2015-01-29 ジーエヌ リザウンド エー/エスGn Resound A/S Determination of individual hrtfs
EP2806661B1 (en) * 2013-05-23 2017-09-06 GN Resound A/S A hearing aid with spatial signal enhancement
EP3280159A1 (en) 2016-08-03 2018-02-07 Oticon A/s Binaural hearing aid device
US10425747B2 (en) 2013-05-23 2019-09-24 Gn Hearing A/S Hearing aid with spatial signal enhancement
EP3595334A3 (en) * 2018-06-20 2020-04-01 Sivantos Pte. Ltd. Method for audio reproduction in a hearing aid

Families Citing this family (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP6421120B2 (en) * 2012-10-05 2018-11-07 シラス ロジック インターナショナル セミコンダクター リミテッド Binaural hearing system and method
US9191755B2 (en) 2012-12-14 2015-11-17 Starkey Laboratories, Inc. Spatial enhancement mode for hearing aids
CN103096230A (en) * 2013-01-15 2013-05-08 杭州爱听科技有限公司 All-digital type hearing-aid and changing channel matching and compensating method thereof
US9497541B2 (en) 2013-02-28 2016-11-15 Gn Resound A/S Audio system for audio streaming and associated method
US9538284B2 (en) * 2013-02-28 2017-01-03 Gn Resound A/S Audio system for audio streaming and associated method
US9124983B2 (en) 2013-06-26 2015-09-01 Starkey Laboratories, Inc. Method and apparatus for localization of streaming sources in hearing assistance system
US9936310B2 (en) * 2013-12-10 2018-04-03 Sonova Ag Wireless stereo hearing assistance system
US9877116B2 (en) * 2013-12-30 2018-01-23 Gn Hearing A/S Hearing device with position data, audio system and related methods
RU2747713C2 (en) * 2014-01-03 2021-05-13 Долби Лабораторис Лайсэнзин Корпорейшн Generating a binaural audio signal in response to a multichannel audio signal using at least one feedback delay circuit
CN104768121A (en) 2014-01-03 2015-07-08 杜比实验室特许公司 Generating binaural audio in response to multi-channel audio using at least one feedback delay network
MX357405B (en) * 2014-03-24 2018-07-09 Samsung Electronics Co Ltd Method and apparatus for rendering acoustic signal, and computer-readable recording medium.
US9848275B2 (en) 2014-04-02 2017-12-19 Wilus Institute Of Standards And Technology Inc. Audio signal processing method and device
EP3054706A3 (en) * 2015-02-09 2016-12-07 Oticon A/s A binaural hearing system and a hearing device comprising a beamformer unit
KR102640940B1 (en) * 2016-01-27 2024-02-26 돌비 레버러토리즈 라이쎈싱 코오포레이션 Acoustic environment simulation
CN108778410B (en) * 2016-03-11 2022-05-27 梅约医学教育与研究基金会 Cochlear stimulation system with surround sound and noise cancellation
EP3457716A1 (en) 2017-09-15 2019-03-20 Oticon A/s Providing and transmitting audio signal
US10547926B1 (en) * 2018-07-27 2020-01-28 Mimi Hearing Technologies GmbH Systems and methods for processing an audio signal for replay on stereo and multi-channel audio devices
CN115190389A (en) 2018-12-24 2022-10-14 华为技术有限公司 Audio data transmission method and equipment applied to TWS earphone single-ear and double-ear switching
JP7463796B2 (en) 2020-03-25 2024-04-09 ヤマハ株式会社 DEVICE SYSTEM, SOUND QUALITY CONTROL METHOD AND SOUND QUALITY CONTROL PROGRAM
WO2023047647A1 (en) * 2021-09-21 2023-03-30 ソニーグループ株式会社 Information processing device, information processing method, and program

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0932324A2 (en) * 1998-01-22 1999-07-28 Sony Corporation Sound reproducing device, earphone device and signal processing device therefor
EP1531650A2 (en) * 2003-11-12 2005-05-18 Gennum Corporation Hearing instrument having a wireless base unit
WO2007031896A1 (en) * 2005-09-13 2007-03-22 Koninklijke Philips Electronics N.V. Audio coding
EP1879426A2 (en) * 2006-07-10 2008-01-16 Starkey Laboratories, Inc. Method and apparatus for a binaural hearing assistance system using monaural audio signals

Family Cites Families (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2953011B2 (en) * 1990-09-28 1999-09-27 松下電器産業株式会社 Headphone sound field listening device
DK1057367T3 (en) * 1998-02-18 2008-05-13 Widex As Binaural digital hearing aid system
FI113147B (en) * 2000-09-29 2004-02-27 Nokia Corp Method and signal processing apparatus for transforming stereo signals for headphone listening
JP2002135898A (en) * 2000-10-19 2002-05-10 Matsushita Electric Ind Co Ltd Sound image localization control headphone
JP2004023486A (en) * 2002-06-17 2004-01-22 Arnis Sound Technologies Co Ltd Method for localizing sound image at outside of head in listening to reproduced sound with headphone, and apparatus therefor
JP2004201195A (en) * 2002-12-20 2004-07-15 Pioneer Electronic Corp Headphone device
US7680289B2 (en) * 2003-11-04 2010-03-16 Texas Instruments Incorporated Binaural sound localization using a formant-type cascade of resonators and anti-resonators
DE102004035046A1 (en) * 2004-07-20 2005-07-21 Siemens Audiologische Technik Gmbh Hearing aid or communication system with virtual signal sources providing the user with signals from the space around him
GB0419346D0 (en) * 2004-09-01 2004-09-29 Smyth Stephen M F Method and apparatus for improved headphone virtualisation
EP1867207B1 (en) * 2005-01-17 2008-08-06 Widex A/S Apparatus and method for operating a hearing aid
US20060227976A1 (en) * 2005-04-07 2006-10-12 Gennum Corporation Binaural hearing instrument systems and methods
JP3128564U (en) * 2006-10-18 2007-01-18 亨 甲本 hearing aid

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0932324A2 (en) * 1998-01-22 1999-07-28 Sony Corporation Sound reproducing device, earphone device and signal processing device therefor
EP1531650A2 (en) * 2003-11-12 2005-05-18 Gennum Corporation Hearing instrument having a wireless base unit
WO2007031896A1 (en) * 2005-09-13 2007-03-22 Koninklijke Philips Electronics N.V. Audio coding
EP1879426A2 (en) * 2006-07-10 2008-01-16 Starkey Laboratories, Inc. Method and apparatus for a binaural hearing assistance system using monaural audio signals

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2012092973A1 (en) 2011-01-07 2012-07-12 Widex A/S A hearing aid system with a dual mode wireless radio
US9344816B2 (en) 2011-01-07 2016-05-17 Widex A/S Hearing aid system and a hearing aid
WO2012127828A1 (en) * 2011-03-18 2012-09-27 パナソニック株式会社 Hearing aid apparatus and sound control method
JP2012195907A (en) * 2011-03-18 2012-10-11 Panasonic Corp Hearing aid device
EP2806661B1 (en) * 2013-05-23 2017-09-06 GN Resound A/S A hearing aid with spatial signal enhancement
US10425747B2 (en) 2013-05-23 2019-09-24 Gn Hearing A/S Hearing aid with spatial signal enhancement
US10869142B2 (en) 2013-05-23 2020-12-15 Gn Hearing A/S Hearing aid with spatial signal enhancement
JP2015019360A (en) * 2013-07-04 2015-01-29 ジーエヌ リザウンド エー/エスGn Resound A/S Determination of individual hrtfs
US9426589B2 (en) 2013-07-04 2016-08-23 Gn Resound A/S Determination of individual HRTFs
EP3280159A1 (en) 2016-08-03 2018-02-07 Oticon A/s Binaural hearing aid device
EP3595334A3 (en) * 2018-06-20 2020-04-01 Sivantos Pte. Ltd. Method for audio reproduction in a hearing aid

Also Published As

Publication number Publication date
CA2740522A1 (en) 2010-04-22
AU2008362920A1 (en) 2010-04-22
JP2012505617A (en) 2012-03-01
EP2351384A1 (en) 2011-08-03
US20110188662A1 (en) 2011-08-04
AU2008362920B2 (en) 2013-09-19
CN102187690A (en) 2011-09-14
JP5325988B2 (en) 2013-10-23
KR20110069112A (en) 2011-06-22

Similar Documents

Publication Publication Date Title
AU2008362920B2 (en) Method of rendering binaural stereo in a hearing aid system and a hearing aid system
US10869142B2 (en) Hearing aid with spatial signal enhancement
US9930456B2 (en) Method and apparatus for localization of streaming sources in hearing assistance system
EP3468228B1 (en) Binaural hearing system with localization of sound sources
JP6193844B2 (en) Hearing device with selectable perceptual spatial sound source positioning
WO2005125270A1 (en) In-ear monitoring system and method
JP2002209300A (en) Sound image localization device, conference unit using the same, portable telephone set, sound reproducer, sound recorder, information terminal equipment, game machine and system for communication and broadcasting
EP2806661B1 (en) A hearing aid with spatial signal enhancement
US6990210B2 (en) System for headphone-like rear channel speaker and the method of the same
US20190246230A1 (en) Virtual localization of sound
US7050596B2 (en) System and headphone-like rear channel speaker and the method of the same
US6983054B2 (en) Means for compensating rear sound effect
KR102613035B1 (en) Earphone with sound correction function and recording method using it
JP2003199200A (en) System for headphone-like rear channel speaker and method of the same
DK201370280A1 (en) A hearing aid with spatial signal enhancement

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 200880131546.3

Country of ref document: CN

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 08874938

Country of ref document: EP

Kind code of ref document: A1

DPE1 Request for preliminary examination filed after expiration of 19th month from priority date (pct application filed from 20040101)
WWE Wipo information: entry into national phase

Ref document number: 2011531354

Country of ref document: JP

Ref document number: 2740522

Country of ref document: CA

ENP Entry into the national phase

Ref document number: 20117008911

Country of ref document: KR

Kind code of ref document: A

ENP Entry into the national phase

Ref document number: 2008362920

Country of ref document: AU

Date of ref document: 20081014

Kind code of ref document: A

WWE Wipo information: entry into national phase

Ref document number: 2008874938

Country of ref document: EP