EP2271136A1 - Appareil de correction auditive avec une source sonore virtuelle - Google Patents

Appareil de correction auditive avec une source sonore virtuelle Download PDF

Info

Publication number
EP2271136A1
EP2271136A1 EP10178809A EP10178809A EP2271136A1 EP 2271136 A1 EP2271136 A1 EP 2271136A1 EP 10178809 A EP10178809 A EP 10178809A EP 10178809 A EP10178809 A EP 10178809A EP 2271136 A1 EP2271136 A1 EP 2271136A1
Authority
EP
European Patent Office
Prior art keywords
signals
audio signals
hearing
user
information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP10178809A
Other languages
German (de)
English (en)
Inventor
Raoul Glatt
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sonova Holding AG
Original Assignee
Phonak AG
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Phonak AG filed Critical Phonak AG
Publication of EP2271136A1 publication Critical patent/EP2271136A1/fr
Withdrawn legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R25/00—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
    • H04R25/40—Arrangements for obtaining a desired directivity characteristic

Definitions

  • the invention relates to a hearing system, which comprises at least one hearing device, and which is capable of generating sounds or signals to be perceived by a user of the hearing system.
  • the hearing device can be a hearing aid, worn in or near the ear or implanted, a headphone, an earphone, a hearing protection device, a communication device or the like.
  • binaural hearing systems which provide for "virtual sound sources" in the sense that system-generated sounds can be perceived by a user of the system as if they were generated in certain locations near the user.
  • the system-generated sounds are processed with HRTF (head-related transfer functions) for each ear, so that the user's left and right ears will typically perceive, at slightly different times, slightly different signals, such that the origin of the system-generated sound appears to be in a specific fixed location near the user.
  • HRTF head-related transfer functions
  • the two hearing devices are linked with each other in order to be able to provide a synchronization of the hearing device necessary to achieve a required timing precision for signals played to the user's left and right ears.
  • a hearing aid which is capable of generating sounds (device signals) as a function of a hearing aid value, e.g., a battery status.
  • Said device signals can be adjusted in level or type, based on a level of an input signal and a signal shape of the input signal or on a classification of the input signal.
  • said input signal may be adjusted with respect to the device signal. For example, the level of the device signal is increased when the user is in a loud environment (high input signal) and/or the gain for the input signal is decreased (up to muting) when a device signal is to be output.
  • a goal of the invention is to create a hearing system and a method of operating a hearing system, that allow for a clear perception of system-generated signals by a user of the system.
  • One object of the invention is to provide for a hearing system and a method of operating a hearing system, which provide for a good distinguishability between different system-generated signals.
  • Another object of the invention is to provide for a hearing system and a method of operating a hearing system, which allow for a clear perception of system-generated signals without a linked pair of hearing devices.
  • Another object of the invention is to provide for a hearing system without a linked pair of hearing devices and a method of operating such a hearing system, which provide for a good distinguishability between different system-generated signals.
  • the hearing system comprises
  • Said providing of said system-generated audio signals with said spatial information can also be called or considered a providing of said system-generated audio signals with spaciousness
  • Said system-generated audio signals can be provided with said spatial information in order to achieve the effect, that said spatialized system-generated audio signals, when perceived by the user as output signals, are perceived by the user as signals originating from a virtual location, wherein said virtual location is chosen in dependence of said localization information.
  • the spatialization of the system-generated signals gives the user the impression that the signals perceived by him, when said spatialized system-generated audio signals are converted in said output converter into output signals, originate from a virtual location. And that virtual location is chosen in dependence of said localization information.
  • a virtual location is defined by an apparent distance from the user and/or an apparent azimuthal angle and/or an apparent polar angle, where the signals are apparently coming from. It may comprise apparent room information (information of size and/or shape and/or surfaces and the like of a room inside of which the system-generated sounds are apparently originating in). An apparent distance may result from various effects, among which are damping (reduction of high-frequency components) and reflections.
  • Said hearing system may comprise one hearing device or two hearing devices, which may be linked (wirelessly or wirebound) or not-linked.
  • Hearing devices are usually worn in or near a user's ear, or may be implanted.
  • Hearing systems may furthermore comprise remote controls and other accessories.
  • said incoming signals are incoming sound (acoustical sound). They may also be of other nature, e.g., electromagnetic waves, e.g., when the hearing system receives frequency modulated radio waves from a speech inside a filled auditorium with the user being inside or outside the auditorium with his hearing system.
  • Said input unit may comprise one or more input converters, which are typically mechanical-to-electrical converters (e.g., microphones), but converters receiving electromagnetic waves and converting these into audio signals are also possible (e.g., in case of a telephone coil or of a remote frequency modulation receiver or infrared receiver).
  • input converters typically mechanical-to-electrical converters (e.g., microphones), but converters receiving electromagnetic waves and converting these into audio signals are also possible (e.g., in case of a telephone coil or of a remote frequency modulation receiver or infrared receiver).
  • Audio signals are usually electrical signals, analogue and/or digital, which describe or represent sound (natural sound or artificially generated sound).
  • Said output signals are often acoustic signals (sound, sound waves), but may be other signals as well, e.g., in the case of implanted hearing devices.
  • Said output transducers can therefore be electro-to-mechanical converters (loudspeakers) or others, e.g., electrical-to-electrical converters.
  • each hearing device comprises one output transducer.
  • each hearing device comprises one, possibly two or even more, input transducers.
  • At least one or each hearing device comprises a sound generator, which may be realized in form of software.
  • Said audio analysis unit is typically a software-implemented signal processing algorithm. From the received input signals, information on where in space the input audio signals or a part or different parts of the input signals come from (localization information) is extracted.
  • localization information in terms of information on a room (size, shape, surfaces) in which acoustic waves travelled from which the input audio signals are obtained, can be obtained.
  • reverberation and echo portions (signals, components) in the input audio signals provide for the necessary information.
  • localization information in terms of distance information is obtainable, at least a maximum distance as obtained from said room information.
  • localization information may be obtained from a time delay (time-of-reception difference) and/or the loudness difference (level difference) between the two audio streams.
  • time-of-reception difference time-of-reception difference
  • level difference loudness difference
  • audio analysis units are also known as localizers and used in conjunction with beam formers.
  • Classifiers which are also known in the art, may also be used, since they may allow to distinguish between different sound sources if more than one principal sound sources exist.
  • said localization information can be decided, where to arrange said virtual location. If, e.g., only one principal sound source is detected, which comprises a lot of reverberation or is located far away, the virtual location could be arranged close to the user. If the one principal sound source is located to the very right of the user, the virtual location could be arranged to the very left of the user. If, on the other hand, e.g., a principal sound source is located in front of the user, and a major noise source is located far away on the right behind the user, the virtual sound source could be arranged on the left behind the user. In a generally loud environment, the virtual location could be arranged within the user's head.
  • Said virtual localization processor may be implemented in form of software and generates the reverberation and/or echo signals, and the interaural time differences, the interaural level differences and the different spectral coloration of output signals to be perceived by each of the user's two ears, which are required (and possible) to let the virtual sound source appear in the desired location (with the desired spaciousness). Individually measured and/or averaged or estimated HRTF may be used.
  • Said system-generated audio signals may be provided with at least one of interaural time differences, interaural level differences, and different spectral coloration of output signals to be perceived by each of the user's two ears as spatial information.
  • the kind and/or the amount of said spatial information is chosen in dependence of at least one of a gain model describing hearing preferences of said user and an analysis of said input audio signals.
  • Said analysis of said input audio signals can comprise classifications as they are known in the art.
  • Said gain model takes the user's individual preferences (in case of hearing aids: mostly individual hearing deficiencies) into account.
  • the invention can be used in conjunction with acknowledge signals (or other sound messages) as the system-generated audio signals to be perceived by the hearing system user.
  • acknowledge signals or other sound messages
  • said system-generated audio signals may be speech signals.
  • Acknowledge sounds also called feedback sounds, are played to the user upon a change in the hearing device's function, e.g., when the user changes the loudness (volume) or another setting or program of one or both hearing devices, or when some other user's manipulation shall be acknowledged, or when the hearing device by itself takes an action, e.g., by making a change, e.g., if, in the case of a hearing aid, the hearing aid chooses, in dependence of the acoustical environment, a different hearing program (frequency-volume settings and the like), or when the hearing device user shall be informed that a hearing device's energy source (battery) is low.
  • Acknowledge sounds can be considered signals that indicate a change in an operational condition of the hearing system.
  • the hearing system comprises
  • a change from a hearing program e.g., number 3 to a hearing program with the next higher number (number 4) could be indicated by a virtual move of the appropriate acknowledge signal (e.g., a speech signal saying "program four") from left to right.
  • the appropriate acknowledge signal e.g., a speech signal saying "program four”
  • this second aspect of the invention is rather valuable, in particular when averaged HRTF are used, since averaged HRTF do not exactly represent the effects that take place at a particular user's head.
  • the determination of individualized HRTF is, on the other hand, rather cumbersome and impractical in a typical fitting environment.
  • the according method of operating a hearing system comprising at least one hearing device may be considered a method for indicating an operational condition of a hearing system. It comprises the steps of:
  • the hearing system comprises
  • Said first, second and third aspects of the invention may be pairwise combined or combined altogether, which can lead to particularly advantageous embodiments.
  • combining the third aspect with the second aspect results in an improved distinguishability between different output signals.
  • different output signals may differ in terms of frequency and spectral content, and in time structure and so on.
  • the purpose for which signal-generated sounds are generated can be indicated.
  • the invention can well be used, when speech signals or more complex sounds are to be generated and presented to the user.
  • the complexity of a sound may manifest in its (large) spectral content, its structure in time or rhythmic or percussive structure.
  • Speech sounds may be used for guiding the user, informing the user and acknowledging events in the hearing system.
  • simple "whistle sounds" typically sine-waves
  • Such more complex sounds can be better localized and more effectively be provided with spatial information. Accordingly, the virtual-sound-source effect is more realistic and therefore of greater use to the user in case of more complex sounds.
  • the simple "whistle sounds" often used as acknowledge sounds are hardly susceptible to a realistic spatialization.
  • Fig. 1 shows a schematic diagram of a hearing system 1, which comprises at least one hearing device 10.
  • the hearing device 10 comprises an input unit 11 for receiving incoming signals 5.
  • the incoming signals are incoming acoustic waves 5, and the input unit 11 comprises one microphone.
  • the input unit 11 obtains input audio signals 20 from said incoming signals 5, which are fed to a signal processor 12, preferably a digital signal processor DSP, by means of which the input audio signals 20 can be adapted to the needs and preferences of a user of the hearing system 1.
  • Said input audio signals 20 are also fed to an audio analysis unit 14, which is used to obtain localization information 40 from said input audio signals 20.
  • Said localization information 40 may comprise data about the distance between the origin of said incoming acoustic waves 5 and the hearing system 1 (or, more precisely, the microphone), and it may comprise data about the direction from which said incoming acoustic waves 5 originate.
  • Said directional information requires the existence of at least two microphones. This may be accomplished by providing said input unit 11 of the hearing device 10 with two microphones, or by providing two hearing devices 10 (typically equally or similarly designed as the hearing device 10 shown in Fig. 1 ) in the hearing system 1 with at least one microphone each.
  • the hearing system comprises a sound generator 15, which generates system-generated audio signals 30, typically acknowledge sounds indicating a change in the internal (operational) status of the hearing system 1.
  • system-generated audio signals 30 are fed to a virtual location processor 16, which provides the system-generated audio signals 30 with spatial information, e.g., by applying appropriate (HRTF) filtering and adding reverberation signals, thus generating spatialized system-generated audio signals 31, so as to create the illusion (to the user) that the system-generated signals originate from a certain place or direction (virtual sound source effect).
  • HRTF HRTF
  • the place (virtual location), from where the system-generated signals are apparently perceived by the user, is chosen in dependence of the localization information 40.
  • audio signals are fed to an output transducer 19, which converts said audio signals into output signals 6 to be perceived by the user, which, in the case shown in Fig. 1 , are acoustical sound 6.
  • Said DSP 12, audio analysis unit 14, virtual location processor 16 and sound generator 15 may fully or in part be integrated within the same processor and/or within the same software.
  • Fig. 1 so far emphasizes a first aspect of the invention, namely the choice of the virtual location in dependence of incoming signals, or, more precisely, of the origin (in space) of sound, which is represented by said input audio signals 20.
  • Fig. 1 may also be interpreted in terms of a third aspect of the invention, which is about creating virtual sound sources when the hearing system 1 comprises only one output transducer 19 or when it comprises two or more output transducers, which are not synchronized to each other (as far as the simultaneousness of the outputting of signals to the user - within the 0.01 ms to 0.1 ms range - is concerned).
  • the audio analysis unit 14 is optional; the virtual location does not necessarily depend on some localization information.
  • FIG. 1 audio signals are represented by solid arrows.
  • FIG. 2 is a schematic illustration of a first and a second aspect of the invention. Said first aspect is already described above.
  • two hearing devices 10, each worn in or near one ear if the user 90 comprise input transducers and a localization processor, so that a (predominant) noise source 60 (which also is an incoming signal 5) can be localized.
  • the virtual location of a system-generated sound 50 is chosen such that it appears to originate from a location approximately opposite to the noise source 60 (with respect to the user's head).
  • Said second aspect of the invention is, that a certain system-generated sound does not only occur at a fixed location, but describes a path (or moves), wherein that path indicates a specific operational condition of the hearing system 1, e.g., that an energy supply of the hearing system is unstable.
  • a corresponding path 51 or virtual movement 51 is indicated in Fig. 2 .
  • Fig. 3 shows a schematic illustration of said first aspect of the invention.
  • the user 90 is in a noisy environment, in which noise 60 is impinging on the user 90 practically from any direction.
  • This is detected by an audio analysis unit 14, which may be in one or both of the two hearing devices 10 of the hearing system 1.
  • the virtual location may be chosen, as indicated in
  • the spatial information with which the system-generated sounds 30 are provided with is no reverberation, no echo, no interaural time difference, no interaural level difference and, typically, also no filtering.
  • Fig. 4 shows a schematic illustration of said second and said third aspect of the invention.
  • the hearing system 1 comprises only one hearing device 1 (or, at least, only one output transducer). And nevertheless, a system-generated signal is perceived as coming from a virtual location 50.
  • said virtual location 50 moves (while being perceived), along a (virtual) path 51 (second aspect).
  • a hearing system 1 may comprise a control unit and/or a data acquisition unit, by means of which system parameters (related to an operational condition of the hearing system) can be obtained. Appropriate system-generated sounds (and locations and maybe virtual movement paths) may thereupon be chosen.
  • a Hearing system (1) comprising
  • system-generated audio signals (30) are provided with said spatial information in order to achieve the effect that said spatialized system-generated audio signals (31), when perceived by the user (90) as output signals (6), are perceived by the user (90) as signals originating from a virtual location (50), wherein said virtual location (50) is chosen in dependence of said localization information (40).
  • said input unit (11) comprises at least one input transducer
  • said localization information (40) comprises room information and/or distance information.
  • said input unit (11) comprises at least two input transducers
  • said localization information (40) comprises at least one of room information, distance information and directional information.
  • said localization information (40) comprises directional information, which is obtained from analyzing at least one of
  • said spatial information comprises at least one of
  • the system (1) comprising at least two hearing devices (10), one hearing device (10) for each of the user's (90) two ears, each of the two hearing devices (10) comprising an output transducer (19), wherein said spatial information comprises at least one of
  • system-generated audio signals (30) comprise acknowledge signals and/or speech signals.
  • system-generated audio signals (30) are provided with said spatial information in order to achieve the effect that said spatialized system-generated audio signals (31), when perceived by the user (90) as output signals (6), are perceived by the user (90) as signals originating from a virtual location (50), wherein said virtual location (50) is chosen in dependence of said localization information (40).
  • the method according to one of the previous method embodiments furthermore comprising the step of obtaining room information and/or distance information from said input audio signals (20).
  • the method according to one of the previous method embodiments comprising the step of obtaining room information and/or distance information from reverberation and/or echo signals comprised in said input audio signals (20).
  • the method according to the previous method embodiment comprising the step of obtaining directional information from said at least two streams of input audio signals (20) by analyzing at least one of level differences, spectral differences, and time-of-reception differences between said at least two streams of input audio signals (20).
  • said hearing system (1) comprises at least two hearing devices (10), one hearing device (10) for each of the user's (90) two ears, comprising the step of providing said system-generated audio signals (30) with at least one of
  • a hearing system (1) comprising
  • a hearing system (1) comprising
  • a method of operating a hearing system (1) comprising the steps of:
EP10178809A 2005-12-07 2005-12-07 Appareil de correction auditive avec une source sonore virtuelle Withdrawn EP2271136A1 (fr)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
EP05026707A EP1796427A1 (fr) 2005-12-07 2005-12-07 Appareil de correction auditive avec une source sonore virtuelle

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
EP05026707.9 Division 2005-12-07

Publications (1)

Publication Number Publication Date
EP2271136A1 true EP2271136A1 (fr) 2011-01-05

Family

ID=36698788

Family Applications (3)

Application Number Title Priority Date Filing Date
EP05026707A Withdrawn EP1796427A1 (fr) 2005-12-07 2005-12-07 Appareil de correction auditive avec une source sonore virtuelle
EP10178809A Withdrawn EP2271136A1 (fr) 2005-12-07 2005-12-07 Appareil de correction auditive avec une source sonore virtuelle
EP10178795A Withdrawn EP2273800A1 (fr) 2005-12-07 2005-12-07 Appareil de correction auditive avec une source sonore virtuelle

Family Applications Before (1)

Application Number Title Priority Date Filing Date
EP05026707A Withdrawn EP1796427A1 (fr) 2005-12-07 2005-12-07 Appareil de correction auditive avec une source sonore virtuelle

Family Applications After (1)

Application Number Title Priority Date Filing Date
EP10178795A Withdrawn EP2273800A1 (fr) 2005-12-07 2005-12-07 Appareil de correction auditive avec une source sonore virtuelle

Country Status (1)

Country Link
EP (3) EP1796427A1 (fr)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9031242B2 (en) 2007-11-06 2015-05-12 Starkey Laboratories, Inc. Simulated surround sound hearing aid fitting system
US9185500B2 (en) 2008-06-02 2015-11-10 Starkey Laboratories, Inc. Compression of spaced sources for hearing assistance devices
US9485589B2 (en) 2008-06-02 2016-11-01 Starkey Laboratories, Inc. Enhanced dynamics processing of streaming audio by source separation and remixing
US8705751B2 (en) 2008-06-02 2014-04-22 Starkey Laboratories, Inc. Compression and mixing for hearing assistance devices
CN113556660B (zh) * 2021-08-01 2022-07-19 武汉左点科技有限公司 一种基于虚拟环绕立体声技术的助听方法及装置

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2005004534A1 (fr) * 2003-07-04 2005-01-13 Vast Audio Pty Ltd Production audio a realite augmentee
US20050152567A1 (en) 2004-01-09 2005-07-14 Siemens Audiologische Technik Gmbh Hearing aid
DE102004035046A1 (de) 2004-07-20 2005-07-21 Siemens Audiologische Technik Gmbh Hörhilfe-oder Kommunikationssystem mit virtuellen Signalquellen

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2005004534A1 (fr) * 2003-07-04 2005-01-13 Vast Audio Pty Ltd Production audio a realite augmentee
US20050152567A1 (en) 2004-01-09 2005-07-14 Siemens Audiologische Technik Gmbh Hearing aid
DE102004035046A1 (de) 2004-07-20 2005-07-21 Siemens Audiologische Technik Gmbh Hörhilfe-oder Kommunikationssystem mit virtuellen Signalquellen

Also Published As

Publication number Publication date
EP1796427A1 (fr) 2007-06-13
EP2273800A1 (fr) 2011-01-12

Similar Documents

Publication Publication Date Title
US10431239B2 (en) Hearing system
US9930456B2 (en) Method and apparatus for localization of streaming sources in hearing assistance system
US9571918B2 (en) Audio signal output device and method of processing an audio signal
US7936890B2 (en) System and method for generating auditory spatial cues
JP5894634B2 (ja) 個人ごとのｈｒｔｆの決定
EP2099236B1 (fr) Système d'adaptation d'une aide auditive par simulation d'effet spatial
EP3468228B1 (fr) Système auditif binauriculaire comportant une localisation des sources sonores
JP6193844B2 (ja) 選択可能な知覚空間的な音源の位置決めを備える聴覚装置
JP2009508442A (ja) オーディオ処理のためのシステムおよび方法
EP2351384A1 (fr) Procédé de rendu stéréo binaural dans un système de prothèse auditive et système de prothèse auditive
AU2007201362B2 (en) System and method for generating auditory spatial cues
CN112544089A (zh) 提供具有空间背景的音频的麦克风设备
EP2271136A1 (fr) Appareil de correction auditive avec une source sonore virtuelle
EP2822301B1 (fr) Détermination de HRTF individuels
US20070127750A1 (en) Hearing device with virtual sound source
JP2022528579A (ja) 時間的非相関化ビームフォーマを備えるバイラテラル補聴器システム
EP1275269B1 (fr) Procédé de traitement d'un signal audio pour haut-parleur disposé a proximite d'une oreille et appareil de communication destiné à mettre en oeuvre ledit procédé
Kates et al. Improving auditory externalization for hearing-aid remote microphones

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

AC Divisional application: reference to earlier application

Ref document number: 1796427

Country of ref document: EP

Kind code of ref document: P

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): CH DE DK LI

17P Request for examination filed

Effective date: 20110628

17Q First examination report despatched

Effective date: 20131105

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN

18D Application deemed to be withdrawn

Effective date: 20140318