EP1619928A1 - Hearing aid or communication system with virtual sources - Google Patents

Hearing aid or communication system with virtual sources Download PDF

Info

Publication number
EP1619928A1
EP1619928A1 EP05106213A EP05106213A EP1619928A1 EP 1619928 A1 EP1619928 A1 EP 1619928A1 EP 05106213 A EP05106213 A EP 05106213A EP 05106213 A EP05106213 A EP 05106213A EP 1619928 A1 EP1619928 A1 EP 1619928A1
Authority
EP
European Patent Office
Prior art keywords
hearing aid
user
communication system
signal source
virtual
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP05106213A
Other languages
German (de)
French (fr)
Other versions
EP1619928B1 (en
Inventor
Ulrich Kornagel
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sivantos GmbH
Original Assignee
Siemens Audioligische Technik GmbH
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Family has litigation
First worldwide family litigation filed litigation Critical https://patents.darts-ip.com/?family=34684136&utm_source=google_patent&utm_medium=platform_link&utm_campaign=public_patent_search&patent=EP1619928(A1) "Global patent litigation dataset” by Darts-ip is licensed under a Creative Commons Attribution 4.0 International License.
Application filed by Siemens Audioligische Technik GmbH filed Critical Siemens Audioligische Technik GmbH
Publication of EP1619928A1 publication Critical patent/EP1619928A1/en
Application granted granted Critical
Publication of EP1619928B1 publication Critical patent/EP1619928B1/en
Revoked legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R25/00—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
    • H04R25/55—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception using an external connection, either wireless or wired
    • H04R25/552—Binaural
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S1/00—Two-channel systems
    • H04S1/002—Non-adaptive circuits, e.g. manually adjustable or static, for enhancing the sound image or the spatial distribution
    • H04S1/005—For headphones
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S2400/00—Details of stereophonic systems covered by H04S but not provided for in its groups
    • H04S2400/11—Positioning of individual sound objects, e.g. moving airplane, within a sound field
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S2420/00—Techniques used stereophonic systems covered by H04S but not provided for in its groups
    • H04S2420/01—Enhancing the perception of the sound image or of the spatial distribution using head related transfer functions [HRTF's] or equivalents thereof, e.g. interaural time difference [ITD] or interaural level difference [ILD]

Definitions

  • the invention relates to a hearing aid or communication system for the binaural supply of a user, wherein acoustic signals for the user's information about settings or system states of the hearing aid or communication system can be generated.
  • Hearing aid systems with two head-worn hearing aids for the binaural care of a user are known from the prior art. Furthermore, communication systems are known in which a user can be supplied with different acoustic signals for the left and the right ear via at least two loudspeakers.
  • a sound output device for a motor vehicle is known.
  • An output portion consisting of a pair of loudspeakers arranged adjacent to each other is installed inside a seat back or seat back of a designated seat.
  • the sound output surfaces of the respective speakers point to a designated person sitting on the designated seat. It is thus easy to ensure a necessary distance for achieving a clear acoustic image localization in accordance with the size of the speakers cooperatively forming the output portion.
  • EP 0 557 847 B1 discloses a head-worn hearing aid comprising an electrical signal path between a microphone and a receiver, wherein the signal path can be adapted to different listening situations / sound environments using means for electronically setting pre-programmable transmission parameters and a switching means of the hearing aid , wherein the switching means additionally controls a signal output device, the at least one signal which is characteristic of the respective transmission parameters set for a specific listening situation / sound environment, whereby the hearing device user can perceive this signal and can be informed about the selected setting without removing the hearing device from the head.
  • HRIR Head Related Impulse Response
  • HRTF Head Related Transfer Function
  • the HRTF is a function of four variables: the three spatial coordinates (relative to the head) and the frequency.
  • measurements on an artificial head e.g. KEMAR (Knowles Electronics Mannequin for Acoustical Research).
  • HRTFs Head-Related Transfer Functions
  • the object of the present invention is to make it easier for the user of a hearing aid or communication system to differentiate or assign acoustic signals to inform the user about settings or system states of the hearing aid or communication system.
  • This object is achieved in a hearing aid or communication system for binaural care of a user, wherein acoustic signals for the user information on settings or system states of the hearing aid or communication system can be generated, achieved in that the signal output by the hearing aid or communication system is such that for the user, signals from different virtual signal sources can be generated from the space surrounding the user.
  • a hearing aid system according to the invention comprises two head-worn hearing aids for the binaural care of a user.
  • the hearing aid devices are coupled to one another in such a way that an exactly matched delivery of an acoustic signal to the left and the right ear can take place.
  • a communication system according to the invention exactly matched, but usually slightly different acoustic signals can be generated and supplied to the left and the right ear of a user.
  • the acoustic information relates to current settings of the hearing aid or communication system, such as the set volume or the currently set hearing program and certain system states, such as the current state of charge of the voltage sources used.
  • a sound could be placed spatially virtually in such a way that its spatial height symbolizes the level of the state of charge. Since this is a continuous size, a virtual acoustic scale should also be displayed. This can be done by first going through the possible range of values, i. E. So, walking from the bottom left to the top right, and in direct connection to it comes virtually from the direction that reflects the current state of charge.
  • the principle of virtual spatial representation of information can also be used for other, as yet unspecified features for hearing aid or communication systems. It can thus be used as a universal additional degree of freedom for information transfer. For example, a user in conjunction with a compass can be notified of the sky direction "North" by generating an on-demand virtual sound coming from this direction.
  • the spatial arrangement of the virtual signal source in the room is preferably carried out taking into account the so-called HRTF (head-related transfer functions) of the two ears.
  • HRTF head-related transfer functions
  • the fact is exploited that in known impulse responses of the left or right ear with respect to a sound signal emanating from a spatial point, a fictitious sound source lying at this point in space can be simulated.
  • the relevant acoustic signal is folded with the left or right HRIR (head-related impulse response). It is important here that the possibly asymmetric behavior of the hearing aid or communication devices of the hearing aid or communication systems worn on the left or right ear does not destroy the spatial impression.
  • both hearing aid or communication devices provide the acoustic signal in exact synchronism, so that the signal changes produced by the respective HRIR can also be exactly effective.
  • asynchronously operating hearing aid or communication devices may occur due to the time lag between the acoustic signal for the left and the right ear an unwanted spatial offset in the perception of the acoustic signal.
  • Prerequisite for synchronous signal delivery is a coupling and synchronization of the two hearing aid or communication devices, in which, if necessary, differences in the clock frequency of both devices must be compensated.
  • the HRTF or HRIR are preferably determined on the KEMAR, a standardized artificial head. Such measurements are usually sufficient. However, better results are achieved by individual measurements of the HRTF or HRIR at the respective user of the hearing aid or communication system.
  • FIG. 1 shows a user 2 who carries behind the right ear a hearing aid 1A and behind the left ear a hearing aid 1B.
  • the two hearing aids 1A and 1B are coupled to each other by means of a wire connection or wirelessly, so that signals generated or stored in the hearing aids 1A and 1B can be supplied to the left and the right ear in a coordinated manner.
  • a slight phase shift and a slight change in the amplitudes of the signals applied to the two ears can give the user 2 the impression that the signal originates from a signal source occupying a specific position in the room.
  • no such signal source is actually present in the room, it is a virtual signal source.
  • the virtual signal source with respect to the straight-ahead viewing direction of the user 2 can be moved in space.
  • the change in the position of the virtual signal source in space is used to add additional information to the acoustic signal coming from the virtual signal source. This additional information can be perceived by the user 2 consciously or unconsciously.
  • the hearing programs designated by the program numbers 1 to 4 are adjustable. When switching between different hearing programs or by a specific query of the currently set hearing program is the user 2 informed about the currently set hearing program. This information can take place, for example, in the form of a voice signal.
  • the hearing aid 1 is assigned the virtual signal source 3 in the lower left position with respect to the straight-ahead viewing direction of the user 2. Accordingly, the virtual signal source is at the announcement of the hearing program 2 in the position 4 front left.
  • all signal sources are on a cone surrounding the user 2, which is rotationally symmetrical with respect to the body longitudinal axis of the user 2 in the room.
  • the virtual signal sources can easily be placed in the room so that a confusion with natural sound sources is usually excluded.
  • the position of the virtual signal sources is limited to the space enclosed by the cone 7.
  • FIG. 2 shows a further embodiment of the invention.
  • the user 2 is supplied by two hearing aid devices 1A and 1B, which are coupled with respect to the delivery of signals generated or stored in the hearing aid system 1A, 1B.
  • the current hearing program in the exemplary embodiment according to FIG. 2, not the current hearing program but the current state of charge of the voltage sources serving for supplying energy to the two hearing aid devices 1A and 1B is displayed.
  • a sound for indicating an empty voltage source from the left side appears to be approximately at eye level.
  • a full voltage source is by one from the right displayed above the head beep.
  • the frequency and / or the volume and / or the duration of the signal tone used can increase with increasing charge of the voltage source.
  • the hearing aid system 1A, 1B can be operated in such a way that the user 2 is presented with the possible values of charging states initially in the form of an acoustic scale. This can take place, for example, in that the signal tone runs continuously within a short time with respect to the position of the virtual signal source and the signal frequency and volume for all possible charging states and then the signal representing the current state of charge is generated again, so that the user 2 better the current state of charge in relation to the possible value range.
  • FIG. 2 illustrates possible positions 8 to 11 of the virtual signal source when displaying the state of charge of the voltage source. In order to display the current value, after the virtual scale has been displayed, the current value, to which, for example, position 10 is assigned, is generated again.
  • the phase shift and change in the volume of an acoustic signal supplied to the left and right ears are essential features to provide the user 2 with a direction from which the signal is received.
  • other influencing factors In order to cover three-dimensionally almost the entire space surrounding the user 2, however, other influencing factors must be considered. These factors relate in particular to the anatomical conditions of the head and the ears, are changed by the incoming from a certain direction sound signals before they reach the eardrum of each ear.
  • Related signal changes can be described by the so-called head-related transfer functions (HRTF).
  • HRTF head related impulse responses
  • HRIR head related impulse responses
  • the user 2 is in a measurement environment and is by means of a speaker 12, which represents the sound source, sonicated by a specific signal.
  • the acoustic signal thus supplied to the user 2 is measured in the auditory canals thereof by means of measuring sensors (not shown) installed there. From the comparison of the emitted signal with the signals measured in the auditory canals, the HRIR and HRTF can be determined for the left and the right ear. If the determined HRTF or HRIR are then applied to a signal generated synthetically in the two hearing aid devices 1A and 1B according to FIGS. 1 or 2, then the user 2 receives the impression that the signal originates from a signal source which is in position of the loudspeaker 12 according to FIG.

Abstract

The hearing aid or communication system for both ears of the user generates acoustic signals for the user's information via settings or from the status of the system. Signals are output from the system such that signals from different virtual signal sources from the area around the user can be sensed by the user.

Description

Die Erfindung betrifft ein Hörhilfe- oder Kommunikationssystem zur binauralen Versorgung eines Benutzers, wobei akustische Signale zur Information des Benutzers über Einstellungen oder Systemzustände des Hörhilfe- oder Kommunikationssystems erzeugbar sind.The invention relates to a hearing aid or communication system for the binaural supply of a user, wherein acoustic signals for the user's information about settings or system states of the hearing aid or communication system can be generated.

Aus dem Stand der Technik sind Hörhilfesysteme mit zwei am Kopf tragbaren Hörhilfegeräten zur binauralen Versorgung eines Benutzers bekannt. Ferner sind Kommunikationssysteme bekannt, bei denen einem Benutzer über wenigstens zwei Lautsprecher unterschiedliche akustische Signale für das linke und das rechte Ohr zuführbar sind.Hearing aid systems with two head-worn hearing aids for the binaural care of a user are known from the prior art. Furthermore, communication systems are known in which a user can be supplied with different acoustic signals for the left and the right ear via at least two loudspeakers.

Aus der DE 103 03 441 A1 ist ein Schallausgabegerät für ein Kraftfahrzeug bekannt. Ein Ausgabeabschnitt, der aus einem Paar von Lautsprechern besteht, die benachbart zueinander angeordnet sind, ist innerhalb einer Sitzlehne oder eines Sitzrückens eines designierten Sitzes installiert. Die Schallausgabeflächen der jeweiligen Lautsprecher weisen zu einer designierten Person hin, die auf dem designierten Sitz sitzt. Es ist somit einfach, einen erforderlichen Abstand zum Erzielen einer klaren akustischen Bildlokalisierung in Einklang mit der Größe der Lautsprecher, die im Zusammenwirken den Ausgabeabschnitt bilden, sicherzustellen.From DE 103 03 441 A1 a sound output device for a motor vehicle is known. An output portion consisting of a pair of loudspeakers arranged adjacent to each other is installed inside a seat back or seat back of a designated seat. The sound output surfaces of the respective speakers point to a designated person sitting on the designated seat. It is thus easy to ensure a necessary distance for achieving a clear acoustic image localization in accordance with the size of the speakers cooperatively forming the output portion.

Aus der EP 0 557 847 B1 ist ein am Kopf tragbares Hörgerät bekannt, umfassend einen elektrischen Signalweg zwischen einem Mikrofon und einem Hörer, wobei der Signalweg unter Verwendung von Mitteln zur elektronischen Einstellung vorprogrammierbarer Übertragungsparameter und eines Schaltmittels des Hörgerätes an verschiedene Hörsituationen / Schallumgebungen anpassbar ist, wobei das Schaltmittel zusätzlich eine Signalabgabeeinrichtung steuert, die wenigstens ein Signal abgibt, das für den jeweils zu einer bestimmten Hörsituationen/Schallumgebung eingestellten Übertragungsparameter charakteristisch ist, wobei der Hörgerätebenutzer dieses Signal wahrnehmen kann und ohne Abnahme des Hörgerätes vom Kopf über die gewählte Einstellung informierbar ist.EP 0 557 847 B1 discloses a head-worn hearing aid comprising an electrical signal path between a microphone and a receiver, wherein the signal path can be adapted to different listening situations / sound environments using means for electronically setting pre-programmable transmission parameters and a switching means of the hearing aid , wherein the switching means additionally controls a signal output device, the at least one signal which is characteristic of the respective transmission parameters set for a specific listening situation / sound environment, whereby the hearing device user can perceive this signal and can be informed about the selected setting without removing the hearing device from the head.

Um den Schalldruck zu ermitteln, den eine beliebige Signalquelle vor dem Trommelfell einer Person produziert, ist es ausreichend, die Impulsantwort zwischen der Quelle und dem Trommelfell zu kennen. Diese wird HRIR (Head Related Impulse Response) genannt. Ihre Fourier-Transformierte nennt man HRTF (Head Related Transfer Function). Die HRTF umfasst alle physikalischen Kenngrößen zur Lokalisation einer Signalquelle. Sind die HRTFs für das linke und das rechte Ohr bekannt, lassen sich auch binaurale Signale von einer akustischen Quelle synthetisieren.To determine the sound pressure produced by any signal source in front of a person's eardrum, it is sufficient to know the impulse response between the source and the eardrum. This is called HRIR (Head Related Impulse Response). Their Fourier transform is called HRTF (Head Related Transfer Function). The HRTF includes all physical parameters for the localization of a signal source. If the left and right ear HRTFs are known, binaural signals can also be synthesized from an acoustic source.

In nachhallfreier Umgebung ist die HRTF eine Funktion von vier Variablen: den drei Raum-Koordinaten (bezogen auf den Kopf) und der Frequenz. Zur Bestimmung der HRTFs werden zumeist Messungen an einem Kunstkopf, z.B. dem KEMAR (Knowles Electronics Mannequin for Acoustical Research), durchgeführt. Ein Überblick über die Bestimmung von HRTFs ist z.B. aus Yang, Wonyoung, "Overview of the Head-Related Transfer Functions (HRTFs)", ACS 498B Audio Engineering, The Pennsylvania State University, July 2001, bekannt.In a non-reverberant environment, the HRTF is a function of four variables: the three spatial coordinates (relative to the head) and the frequency. For the determination of the HRTFs, measurements on an artificial head, e.g. KEMAR (Knowles Electronics Mannequin for Acoustical Research). An overview of the determination of HRTFs is e.g. from Yang, Wonyoung, "Overview of the Head-Related Transfer Functions (HRTFs)", ACS 498B Audio Engineering, The Pennsylvania State University, July 2001.

Aus dem Bereich der Kunstkopftechnik ist bekannt, dass sich die richtungsabhängigen Übertragungsfunktionen des Kopfes und des Außenohres durch Mehrmikrofonanordnungen im Freifeld mit geeigneten nachgeschalteten Filtern relativ genau nachbilden lassen (z.B. Podlaszewski, Mellert: "Lokalisationsversuche für virtuelle Realität mit einer 6-Mikrofonanordnung", DAGA 2001). Die Filter werden dabei mit speziellen Optimierungsverfahren so entworfen, dass die Summe der gefilterten Mikrofonsignale (typischerweise 3 pro Seite) für beliebige Raumrichtungen mit einer gewissen Fehlertoleranz dem Schallsignal entspricht, das in der gleichen Situation bei einem Kunstkopf im Ohrkanal gemessen würde.From the field of artificial head technology is known that the directional transfer functions of the head and the outer ear can be replicated relatively accurately by multi-microphone arrangements in the open field with appropriate downstream filters (eg Podlaszewski, Mellert: "Localization experiments for virtual reality with a 6-microphone array", DAGA 2001 ). The filters are designed with special optimization methods so that the sum of the filtered microphone signals (typically 3 per side) for any spatial directions with a certain error tolerance the sound signal which would be measured in the same situation with an artificial head in the ear canal.

Aufgabe der vorliegenden Erfindung ist es, für den Benutzer eines Hörhilfe- oder Kommunikationssystems akustische Signale zur Information des Benutzers über Einstellungen oder Systemzustände des Hörhilfe- oder Kommunikationssystems besser unterscheidbar oder zuordenbar zu machen. Diese Aufgabe wird bei einem Hörhilfe- oder Kommunikationssystem zur binauralen Versorgung eines Benutzers, wobei akustische Signale zur Information des Benutzers über Einstellungen oder Systemzustände des Hörhilfe- oder Kommunikationssystems erzeugbar sind, dadurch gelöst, dass die Signalabgabe durch das Hörhilfe- oder Kommunikationssystem derart erfolgt, dass für den Benutzer Signale von unterschiedlichen virtuellen Signalquellen aus dem den Benutzer umgebenden Raum erzeugbar sind.The object of the present invention is to make it easier for the user of a hearing aid or communication system to differentiate or assign acoustic signals to inform the user about settings or system states of the hearing aid or communication system. This object is achieved in a hearing aid or communication system for binaural care of a user, wherein acoustic signals for the user information on settings or system states of the hearing aid or communication system can be generated, achieved in that the signal output by the hearing aid or communication system is such that for the user, signals from different virtual signal sources can be generated from the space surrounding the user.

Die Erfindung kann gleichermaßen bei Hörhilfe- oder Kommunikationssystemen angewandt werden. Dabei umfasst ein Hörhilfesystem gemäß der Erfindung zwei am Kopf tragbare Hörhilfegeräte zur binauralen Versorgung eines Benutzers. Die Hörhilfegeräte sind derart miteinander gekoppelt, dass eine exakt aufeinander abgestimmte Abgabe eines akustischen Signals in das linke und das rechte Ohr erfolgen kann. Ebenso können bei einem Kommunikationssystem gemäß der Erfindung exakt aufeinander abgestimmte, in der Regel jedoch leicht unterschiedliche akustische Signale erzeugt und dem linken bzw. dem rechten Ohr eines Benutzers zugeführt werden. Dadurch ist es möglich, dass dem linken und dem rechten Ohr eines Benutzers geringfügig phasenverschobene und in ihrer Amplitude angepasste akustische Signale zugeführt werden, so dass für den Benutzer der Eindruck entsteht, ein im Hörhilfe- oder Kommunikationssystem erzeugtes oder abgespeichertes akustisches Signal kommt aus einer bestimmten Richtung des Raumes. Für den Benutzer entsteht somit der Eindruck, dass das akustische Signal von einer akustischen Signalquelle mit einer bestimmten Position im Raum stammt. Da sich in der entsprechenden Position in Wirklichkeit in der Regel keine entsprechende Signalquelle im Raum befindet, handelt es sich dabei also um eine virtuelle Signalquelle. Die Platzierung dieser virtuellen Signalquelle im Raum wird gemäß der Erfindung dazu verwendet, die in dem akustischen Signal enthaltene Information für den Benutzer leichter zugänglich zu machen. Darüber hinaus kann dem Benutzer durch die Platzierung der virtuellen Signalquelle im Raum auch eine zusätzliche Information übermittelt werden. Die akustische Information betrifft aktuelle Einstellungen des Hörhilfe- oder Kommunikationssystems, wie die eingestellte Lautstärke oder das derzeit eingestellte Hörprogramm sowie bestimmte Systemzustände, wie beispielsweise der aktuelle Ladezustand der verwendeten Spannungsquellen.The invention can equally be applied to hearing aid or communication systems. In this case, a hearing aid system according to the invention comprises two head-worn hearing aids for the binaural care of a user. The hearing aid devices are coupled to one another in such a way that an exactly matched delivery of an acoustic signal to the left and the right ear can take place. Likewise, in a communication system according to the invention exactly matched, but usually slightly different acoustic signals can be generated and supplied to the left and the right ear of a user. This makes it possible that the left and right ear of a user slightly out of phase and adjusted in amplitude acoustic signals are supplied, so that the user the impression arises, generated in hearing aid or communication system or stored acoustic signal comes from a specific Direction of the room. The user therefore has the impression that the acoustic signal originates from an acoustic signal source with a specific position in the room. As in the corresponding position in reality usually no corresponding signal source in the room, it is thus a virtual signal source. The placement of this virtual signal source in space is used according to the invention to make the information contained in the acoustic signal more accessible to the user. In addition, the user can be transmitted by the placement of the virtual signal source in the room also additional information. The acoustic information relates to current settings of the hearing aid or communication system, such as the set volume or the currently set hearing program and certain system states, such as the current state of charge of the voltage sources used.

Vorzugsweise wird der den Benutzer umgebende Raum bezüglich der Geradeaus-Blickrichtung des Benutzers in unterschiedliche Sektoren eingeteilt, in denen dann die virtuellen Signalquellen platziert werden. Die verwendeten Sektoren sollten so ausgewählt werden, dass die eingespielten akustischen Signale auch als künstlich erzeugt, d.h. als nicht real vorhanden erkannt werden. Als Sektor könnte hierzu beispielsweise ein rotationssymmetrisch um die Körperlängsachse eines Benutzers festgelegter Kegelabschnitt oberhalb oder unterhalb eines bestimmten Elevationswinkels dienen. Ebenso könnten die Sektoren dicht am oder über dem Kopf festgelegt werden. Die Anordnung der Signalquelle wird vorzugsweise so vorgenommen, dass dem Benutzer intuitiv klar wird, welche Information hierdurch übermittelt werden soll. Sind beispielsweise bei dem Hörhilfe- oder Kommunikationssystem mehrere Programme mit unterschiedlichen Übertragungsfunktionen einstellbar, so kann die zugehörige Programmnummer anhand eines einzelnen Tons erkannt werden, der aus einem dieser Programmnummer zugeordneten Raumpunkt zu stammen scheint. Beispielsweise ist folgende Zuordnung sinnvoll:

  • Programmnummer 1 = Ton links
  • Programmnummer 2 = Ton links vorne
  • Programmnummer 3 = Ton rechts vorne
  • Programmnummer 4 = Ton rechts.
Preferably, the space surrounding the user is divided into different sectors with respect to the straight-ahead viewing direction of the user, in which case the virtual signal sources are then placed. The sectors used should be selected in such a way that the recorded acoustic signals are also recognized as artificially created, ie not real. As a sector for this purpose, for example, could serve a rotationally symmetrical about the body longitudinal axis of a user defined cone section above or below a certain elevation angle. Likewise, the sectors could be set close to or above the head. The arrangement of the signal source is preferably made so that the user becomes intuitively clear which information is to be transmitted thereby. If, for example, several programs with different transmission functions can be set in the hearing aid or communication system, the associated program number can be recognized on the basis of a single tone that appears to come from a room point assigned to this program number. For example, the following assignment makes sense:
  • Program number 1 = sound left
  • Program number 2 = sound left front
  • Program number 3 = sound right front
  • Program number 4 = sound on the right.

Zu dem Beispiel der akustischen Anzeige des Batterieladezustandes könnte ein Ton räumlich virtuell derart platziert werden, dass seine räumliche Höhe die Höhe des Ladezustandes symbolisiert. Da es sich hierbei um eine kontinuierliche Größe handelt, sollte zusätzlich eine virtuelle akustische Skala mit eingeblendet werden. Dies kann dadurch erfolgen, dass der Ton zunächst den möglichen Wertebereich durchläuft, d.h. also, von links unten nach rechts oben wandert, und in direktem Anschluss daran virtuell aus der Richtung kommt, die den aktuellen Ladezustand widerspiegelt.For the example of the acoustic display of the battery state of charge, a sound could be placed spatially virtually in such a way that its spatial height symbolizes the level of the state of charge. Since this is a continuous size, a virtual acoustic scale should also be displayed. This can be done by first going through the possible range of values, i. E. So, walking from the bottom left to the top right, and in direct connection to it comes virtually from the direction that reflects the current state of charge.

Das Prinzip der virtuellen räumlichen Darstellung von Informationen kann auch für weitere, noch nicht spezifizierte Leistungsmerkmale für Hörhilfe- oder Kommunikationssysteme verwendet werden. Es kann somit als universeller zusätzlicher Freiheitsgrad zur Informationsvermittlung eingesetzt werden. Beispielsweise kann einem Benutzer in Verbindung mit einem Kompass die Himmelrichtung "Norden" mitgeteilt werden, indem auf Abruf ein virtuell aus dieser Richtung stammendes akustisches Signal erzeugt wird.The principle of virtual spatial representation of information can also be used for other, as yet unspecified features for hearing aid or communication systems. It can thus be used as a universal additional degree of freedom for information transfer. For example, a user in conjunction with a compass can be notified of the sky direction "North" by generating an on-demand virtual sound coming from this direction.

Die räumliche Anordnung der virtuellen Signalquelle im Raum erfolgt vorzugsweise unter Berücksichtigung der so genannten HRTF (head related transfer functions) der beiden Ohren. Dabei wird der Umstand zunutze gemacht, dass bei bekannten Impulsantworten des linken bzw. rechten Ohres bezüglich eines von einem Raumpunkt ausgehenden Schallsignals eine fiktiv an diesem Raumpunkt liegende Schallquelle simuliert werden kann. Um die entsprechenden Signale einer virtuellen Signalquelle für das linke bzw. das rechte Ohr zu erhalten, wird das betreffende akustische Signal mit der linken bzw. rechten HRIR (head related impulse response) gefaltet. Wichtig ist hierbei, dass das eventuell asymmetrische Verhalten der am linken bzw. am rechten Ohr getragenen Hörhilfe- oder Kommunikationsgeräte der betreffenden Hörhilfe- oder Kommunikationssysteme den räumlichen Eindruck nicht zerstören. Eine derartige Asymmetrie kann beispielsweise bei Hörhilfegeräten durch unterschiedliche Einstellungen zur Anpassung an einen unterschiedlichen Hörverlust der beiden Ohren auftreten. Eventuell müssen dann entsprechende Entzerrungsmaßnahmen durchgeführt werden, um die Asymmetrie zu korrigieren. Es ist wichtig, dass beide Hörhilfe- oder Kommunikationsgeräte das akustische Signal exakt synchron anbieten, so dass die durch die jeweilige HRIR erzeugten Signalveränderungen ebenfalls exakt wirksam werden können. Bei asynchron arbeitenden Hörhilfe- oder Kommunikationsgeräten kann durch den zeitlichen Versatz zwischen dem akustischen Signal für das linke und das rechte Ohr ein ungewollter räumlicher Versatz bei der Wahrnehmung des akustischen Signals auftreten. Voraussetzung einer synchronen Signalabgabe ist eine Kopplung und Synchronisation der beiden Hörhilfe- oder Kommunikationsgeräte, bei der gegebenenfalls auch Unterschiede in der Taktfrequenz beider Geräte ausgeglichen werden müssen.The spatial arrangement of the virtual signal source in the room is preferably carried out taking into account the so-called HRTF (head-related transfer functions) of the two ears. In this case, the fact is exploited that in known impulse responses of the left or right ear with respect to a sound signal emanating from a spatial point, a fictitious sound source lying at this point in space can be simulated. In order to obtain the corresponding signals of a virtual signal source for the left and the right ear, the relevant acoustic signal is folded with the left or right HRIR (head-related impulse response). It is important here that the possibly asymmetric behavior of the hearing aid or communication devices of the hearing aid or communication systems worn on the left or right ear does not destroy the spatial impression. Such asymmetry, for example, in hearing aids by different settings to adapt to a different hearing loss of the two ears occur. It may then be necessary to perform appropriate equalization measures to correct the asymmetry. It is important that both hearing aid or communication devices provide the acoustic signal in exact synchronism, so that the signal changes produced by the respective HRIR can also be exactly effective. In asynchronously operating hearing aid or communication devices may occur due to the time lag between the acoustic signal for the left and the right ear an unwanted spatial offset in the perception of the acoustic signal. Prerequisite for synchronous signal delivery is a coupling and synchronization of the two hearing aid or communication devices, in which, if necessary, differences in the clock frequency of both devices must be compensated.

Die HRTF bzw. HRIR werden vorzugsweise am KEMAR, einem standardisierten Kunstkopf, ermittelt. Derartige Messungen sind in der Regel ausreichend. Bessere Resultate werden jedoch durch individuelle Messungen der HRTF bzw. HRIR an dem jeweiligen Benutzer des Hörhilfe- oder Kommunikationssystems erreicht.The HRTF or HRIR are preferably determined on the KEMAR, a standardized artificial head. Such measurements are usually sufficient. However, better results are achieved by individual measurements of the HRTF or HRIR at the respective user of the hearing aid or communication system.

Bei einer vereinfachten Version der Erfindung wird lediglich der Laufzeit-/ und/oder Pegelunterschied an den Ohren bei den aus unterschiedlichen Richtungen einfallenden Signalen zur Simulation der Signalquelle gemäß der Erfindung verwendet. Diese Einstellung beruht auf der Erkenntnis, dass beispielsweise in der Realität von rechts anfallender Schall von dem rechten Ohr früher und lauter wahrgenommen wird als von dem linken Ohr. Dieser Effekt wird gemäß der Erfindung zur Platzierung der virtuellen Signalquelle verwendet. Auch hierbei muss eine hinreichende Synchronisation beider Hörhilfe- oder Kommunikationsgeräte gewährleistet sein.In a simplified version of the invention, only the runtime and / or level difference at the ears in the signals incident from different directions is used to simulate the signal source according to the invention. This attitude is based on the knowledge that, for example, in the real world right sound is perceived earlier and louder by the right ear than by the left ear. This effect is used according to the invention for placement of the virtual signal source. Again, a sufficient synchronization of both hearing aid or communication devices must be guaranteed.

Die Erfindung wird nachfolgend anhand von Ausführungsbeispielen näher erläutert. Es zeigen:

Figur 1
einen mit einem Hörhilfesystem versorgten Benutzer, der virtuelle Signalquellen aus unterschiedlichen Richtungen wahrnimmt,
Figur 2
einen Benutzer eines Hörhilfesystems mit oberhalb des Kopfes wahrnehmbaren virtuellen Signalquellen und
Figur 3
eine Messanordnung zur Bestimmung der HRIR.
The invention will be explained in more detail with reference to embodiments. Show it:
FIG. 1
a user supplied with a hearing aid system who perceives virtual signal sources from different directions,
FIG. 2
a user of a hearing aid system with above-the-head perceptible virtual signal sources and
FIG. 3
a measuring arrangement for determining the HRIR.

Figur 1 zeigt einen Benutzer 2, der hinter dem rechten Ohr ein Hörhilfegerät 1A und hinter dem linken Ohr ein Hörhilfegerät 1B trägt. Die beiden Hörhilfegeräte 1A und 1B sind mittels einer Drahtverbindung oder drahtlos miteinander gekoppelt, so dass in den Hörhilfegeräten 1A und 1B generierte oder gespeicherte Signale in aufeinander abgestimmter Weise dem linken sowie dem rechten Ohr zugeführt werden können. Dadurch kann durch eine geringfügige Phasenverschiebung und eine geringfügige Veränderung der Amplituden bei den den beiden Ohren zugeführten Signalen bei dem Benutzer 2 der Eindruck vermittelt werden, dass das Signal von einer Signalquelle stammt, die eine bestimmte Position im Raum einnimmt. Da tatsächlich jedoch keine derartige Signalquelle im Raum vorhanden ist, handelt es sich dabei um eine virtuelle Signalquelle. Durch eine aufeinander abgestimmte Veränderung der den beiden Ohren des Benutzers zugeführten Signale kann die virtuelle Signalquelle bezüglich der Geradeaus-Blickrichtung des Benutzers 2 im Raum bewegt werden. Die Veränderung der Position der virtuellen Signalquelle im Raum wird dazu verwendet, um dem von der virtuellen Signalquelle kommenden akustischen Signal eine zusätzliche Information hinzuzufügen. Diese zusätzliche Information kann von dem Benutzer 2 bewusst oder unbewusst wahrgenommen werden. Im Ausführungsbeispiel sind bei dem Hörhilfesystem 1A, 1B die mit den Programmnummern 1 bis 4 bezeichneten Hörprogramme einstellbar. Beim Umschalten zwischen unterschiedlichen Hörprogrammen oder durch eine gezielte Abfrage des aktuell eingestellten Hörprogramms wird der Benutzer 2 über das aktuell eingestellte Hörprogramm informiert. Diese Information kann beispielsweise in Form eines Sprachsignals erfolgen. Zur besseren Unterscheidung der unterschiedlichen, von dem aktuellen Hörprogramm abhängigen Sprachausgaben erfolgt die Sprachausgabe von einer virtuellen Signalquelle, die in Abhängigkeit des aktiven Hörprogramms unterschiedliche Lagen im Raum einnimmt. So ist im Ausführungsbeispiel dem Hörprogramm 1 die virtuelle Signalquelle 3 in der Position links unten bezüglich der Geradeaus-Blickrichtung des Benutzers 2 zugeordnet. Entsprechend befindet sich die virtuelle Signalquelle bei der Ansage des Hörprogramms 2 in der Position 4 links vorne. Dem Hörprogramm 3 ist die Position 5 rechts vorne und dem Hörprogramm 4 die Position 6 rechts zugeordnet. Im Ausführungsbeispiel sind alle Signalquellen auf einem den Benutzer 2 umgebenden Kegel, der rotationssymmetrisch bezüglich der Körperlängsachse des Benutzers 2 im Raum liegt. Durch Festlegung eines Elevationswinkels ϕ lassen sich Sektoren im Raum bestimmen, innerhalb derer sich die virtuellen Signalquellen befinden. Dadurch können die virtuellen Signalquellen leicht derart im Raum platziert werden, dass eine Verwechslung mit natürlichen Schallquellen in der Regel ausgeschlossen wird. Im Ausführungsbeispiel gemäß Figur 1 ist die Position der virtuellen Signalquellen auf den von dem Kegel 7 eingeschlossenen Raum begrenzt.FIG. 1 shows a user 2 who carries behind the right ear a hearing aid 1A and behind the left ear a hearing aid 1B. The two hearing aids 1A and 1B are coupled to each other by means of a wire connection or wirelessly, so that signals generated or stored in the hearing aids 1A and 1B can be supplied to the left and the right ear in a coordinated manner. As a result, a slight phase shift and a slight change in the amplitudes of the signals applied to the two ears can give the user 2 the impression that the signal originates from a signal source occupying a specific position in the room. However, since no such signal source is actually present in the room, it is a virtual signal source. By a coordinated change in the two ears of the user supplied signals, the virtual signal source with respect to the straight-ahead viewing direction of the user 2 can be moved in space. The change in the position of the virtual signal source in space is used to add additional information to the acoustic signal coming from the virtual signal source. This additional information can be perceived by the user 2 consciously or unconsciously. In the exemplary embodiment, in the hearing aid system 1A, 1B, the hearing programs designated by the program numbers 1 to 4 are adjustable. When switching between different hearing programs or by a specific query of the currently set hearing program is the user 2 informed about the currently set hearing program. This information can take place, for example, in the form of a voice signal. For better differentiation of the different, depending on the current hearing program voice output, the voice output of a virtual signal source, which occupies different positions in space as a function of the active hearing program. Thus, in the exemplary embodiment, the hearing aid 1 is assigned the virtual signal source 3 in the lower left position with respect to the straight-ahead viewing direction of the user 2. Accordingly, the virtual signal source is at the announcement of the hearing program 2 in the position 4 front left. The hearing program 3, the position 5 right front and the hearing program 4, the position 6 assigned to the right. In the exemplary embodiment, all signal sources are on a cone surrounding the user 2, which is rotationally symmetrical with respect to the body longitudinal axis of the user 2 in the room. By defining an elevation angle φ, it is possible to determine sectors in the space within which the virtual signal sources are located. As a result, the virtual signal sources can easily be placed in the room so that a confusion with natural sound sources is usually excluded. In the exemplary embodiment according to FIG. 1, the position of the virtual signal sources is limited to the space enclosed by the cone 7.

Figur 2 zeigt ein weiteres Ausführungsbeispiel der Erfindung. Auch in diesem Ausführungsbeispiel ist der Benutzer 2 durch zwei Hörhilfegeräte 1A und 1B versorgt, die bezüglich der Abgabe von in dem Hörhilfesystem 1A, 1B generierter oder gespeicherter Signale gekoppelt sind. Im Unterschied zu Figur 1 wird bei dem Ausführungsbeispiel gemäß Figur 2 nicht das aktuelle Hörprogramm, sondern der aktuelle Ladezustand der zur Energieversorgung der beiden Hörhilfegeräte 1A und 1B dienenden Spannungsquellen angezeigt. Dabei scheint für den Benutzer 2 ein Ton zur Anzeige einer entleerten Spannungsquelle von der linken Seite in etwa aus Augenhöhe zu stammen. Eine volle Spannungsquelle hingegen wird durch einen von rechts oberhalb des Kopfes stammenden Signalton angezeigt. Zur weiteren Verdeutlichung des Ladezustandes können mit zunehmender Ladung der Spannungsquelle auch die Frequenz und/oder die Lautstärke und/oder die Dauer des verwendeten Signaltons zunehmen. Weiterhin kann das Hörhilfesystem 1A, 1B derart betrieben werden, dass dem Benutzer 2 die möglichen Werte von Ladezuständen zunächst in Form einer akustischen Skala präsentiert werden. Dies kann z.B. dadurch erfolgen, dass der Signalton innerhalb kurzer Zeit hinsichtlich der Position der virtuellen Signalquelle sowie der Signalfrequenz und Lautstärke für alle möglichen Ladezustände kontinuierlich durchläuft und anschließend das den aktuellen Ladezustand repräsentierende Signal nochmals erzeugt wird, so dass der Benutzer 2 den aktuellen Ladezustand besser in Relation zu dem möglichen Wertebereich setzen kann. Figur 2 veranschaulicht hierzu möglichen Positionen 8 bis 11 der virtuellen Signalquelle bei der Anzeige des Ladezustandes der Spannungsquelle. Zur Anzeige des aktuellen Wertes wird nach der Anzeige der virtuellen Skale der aktuelle Wert, dem beispielsweise die Position 10 zugeordnet ist, nochmals erzeugt.FIG. 2 shows a further embodiment of the invention. In this exemplary embodiment too, the user 2 is supplied by two hearing aid devices 1A and 1B, which are coupled with respect to the delivery of signals generated or stored in the hearing aid system 1A, 1B. In contrast to FIG. 1, in the exemplary embodiment according to FIG. 2, not the current hearing program but the current state of charge of the voltage sources serving for supplying energy to the two hearing aid devices 1A and 1B is displayed. In this case, for the user 2, a sound for indicating an empty voltage source from the left side appears to be approximately at eye level. A full voltage source, however, is by one from the right displayed above the head beep. To further clarify the state of charge, the frequency and / or the volume and / or the duration of the signal tone used can increase with increasing charge of the voltage source. Furthermore, the hearing aid system 1A, 1B can be operated in such a way that the user 2 is presented with the possible values of charging states initially in the form of an acoustic scale. This can take place, for example, in that the signal tone runs continuously within a short time with respect to the position of the virtual signal source and the signal frequency and volume for all possible charging states and then the signal representing the current state of charge is generated again, so that the user 2 better the current state of charge in relation to the possible value range. FIG. 2 illustrates possible positions 8 to 11 of the virtual signal source when displaying the state of charge of the voltage source. In order to display the current value, after the virtual scale has been displayed, the current value, to which, for example, position 10 is assigned, is generated again.

Die Phasenverschiebung und Veränderung der Lautstärke eines akustischen Signals, das dem linken und dem rechten Ohr zugeführt wird, sind wesentliche Merkmale, um dem Benutzer 2 eine Richtung zu vermitteln, aus der das Signal eingeht. Um dreidimensional nahezu den gesamten Raum abdecken zu können, der den Benutzer 2 umgibt, müssen jedoch weitere Einflussfaktoren berücksichtigt werden. Diese Faktoren betreffen insbesondere die anatomischen Gegebenheiten des Kopfes sowie der Ohren, durch die aus einer bestimmten Richtung einfallende Schallsignale verändert werden, bevor sie das Trommelfell des jeweiligen Ohres erreichen. Diesbezügliche Signalveränderungen können durch die so genannten head related transfer functions (HRTF) beschrieben werden. Zur Bestimmung dieser Übertragungsfunktionen werden die head related impulse responses (HRIR) gemessen. Eine entsprechende Messanordnung ist in Figur 3 wiedergegeben. Dabei befindet sich der Benutzer 2 in einer Messumgebung und wird mittels eines Lautsprechers 12, der die Schallquelle darstellt, durch ein bestimmtes Signal beschallt. Das dadurch dem Benutzer 2 zugeführte akustische Signal wird in dessen Gehörgängen mittels dort angebrachter Messaufnehmer (nicht dargestellt) gemessen. Aus dem Vergleich des abgegebenen Signals mit den in den Gehörgängen gemessenen Signalen lassen sich die HRIR bzw. HRTF für das linke und das rechte Ohr bestimmen. Werden nun auf ein synthetisch in den beiden Hörhilfegeräten 1A und 1B gemäß den Figuren 1 oder 2 erzeugtes Signal die ermittelten HRTF bzw. HRIR angewandt, so entsteht für den Benutzer 2 der Eindruck, das Signal würde von einer Signalquelle stammen, die sich in der Position des Lautsprechers 12 gemäß Figur 3 befindet.The phase shift and change in the volume of an acoustic signal supplied to the left and right ears are essential features to provide the user 2 with a direction from which the signal is received. In order to cover three-dimensionally almost the entire space surrounding the user 2, however, other influencing factors must be considered. These factors relate in particular to the anatomical conditions of the head and the ears, are changed by the incoming from a certain direction sound signals before they reach the eardrum of each ear. Related signal changes can be described by the so-called head-related transfer functions (HRTF). To determine these transfer functions, head related impulse responses (HRIR) are measured. A corresponding measuring arrangement is shown in FIG. In this case, the user 2 is in a measurement environment and is by means of a speaker 12, which represents the sound source, sonicated by a specific signal. The acoustic signal thus supplied to the user 2 is measured in the auditory canals thereof by means of measuring sensors (not shown) installed there. From the comparison of the emitted signal with the signals measured in the auditory canals, the HRIR and HRTF can be determined for the left and the right ear. If the determined HRTF or HRIR are then applied to a signal generated synthetically in the two hearing aid devices 1A and 1B according to FIGS. 1 or 2, then the user 2 receives the impression that the signal originates from a signal source which is in position of the loudspeaker 12 according to FIG.

Claims (9)

Hörhilfe- oder Kommunikationssystem (1A, 1B) zur binauralen Versorgung eines Benutzers (2), wobei akustische Signale zur Information des Benutzers (2) über Einstellungen oder Systemzustände des Hörhilfe- oder Kommunikationssystems (1A, 1B) erzeugbar sind, dadurch gekennzeichnet, dass die Signalabgabe durch das Hörhilfe- oder Kommunikationssystem (1A, 1B) derart erfolgt, dass für den Benutzer (2) Signale von unterschiedlichen virtuellen Signalquellen (3, 4, 5, 6; 8, 9, 10, 11) aus dem den Benutzer (2) umgebenden Raum (7) wahrnehmbar sind.Hearing aid or communication system (1A, 1B) for the binaural supply of a user (2), wherein acoustic signals for information of the user (2) on settings or system states of the hearing aid or communication system (1A, 1B) can be generated, characterized in that the Signaling by the hearing aid or communication system (1A, 1B) takes place in such a way that for the user (2) signals from different virtual signal sources (3, 4, 5, 6; 8, 9, 10, 11) from which the user (2 ) surrounding space (7) are perceptible. Hörhilfe- oder Kommunikationssystem (1A, 1B) nach Anspruch 1, wobei wenigstens ein Sektor (7) im Raum definierbar ist, in dem für den Benutzer (2) die virtuelle Signalquelle (3 bis 6; 8 bis 11) liegt.A hearing aid or communication system (1A, 1B) according to claim 1, wherein at least one sector (7) is definable in space in which the user (2) has the virtual signal source (3 to 6, 8 to 11). Hörhilfe- oder Kommunikationssystem (1A, 1B), nach Anspruch 2, wobei als Sektor ein um die Körperlängsachse des Benutzers (2) rotationssymmetrischer Kegel (7) ausgebildet ist.Hearing aid or communication system (1A, 1B), according to claim 2, wherein a sector about the body longitudinal axis of the user (2) rotationally symmetric cone (7) is formed. Hörhilfe- oder Kommunikationssystem (1A, 1B) nach Anspruch 2 oder 3, wobei der Sektor (7) durch einen bestimmten Elevationswinkel (ϕ) bestimmt oder abgegrenzt ist.A hearing aid or communication system (1A, 1B) according to claim 2 or 3, wherein the sector (7) is defined or demarcated by a particular elevation angle (φ). Hörhilfe- oder Kommunikationssystem (1A, 1B) nach einem der Ansprüche 1 bis 4, wobei das akustische Signal über einen bestimmten Zeitraum abgebbar ist, derart, dass sich während der Signalabgabe für den Benutzer (2) die Lage der virtuellen Signalquelle (8 bis 11) im Raum verändert.A hearing aid or communication system (1A, 1B) according to any one of claims 1 to 4, wherein the acoustic signal over a certain period is deliverable, such that during the signal delivery for the user (2) the position of the virtual signal source (8 to 11 ) changed in the room. Hörhilfe- oder Kommunikationssystem (1A, 1B) nach einem der Ansprüche 1 bis 5, wobei die Lage der virtuellen Signalquelle (8 bis 11) im Raum abhängig ist von dem Wert der dargestellten Einstellung bzw. dem Wert des dargestellten Systemzustandes.A hearing aid or communication system (1A, 1B) according to any one of claims 1 to 5, wherein the position of the virtual signal source (8 to 11) in space is dependent on the value of the setting shown or the value of the illustrated system state. Hörhilfe- oder Kommunikationssystem (1A, 1B) nach einem der Ansprüche 1 bis 6, wobei eine für den Benutzer (2) virtuelle Skala erzeugbar ist.A hearing aid or communication system (1A, 1B) according to any one of claims 1 to 6, wherein a virtual scale for the user (2) can be generated. Hörhilfe- oder Kommunikationssystem (1A, 1B) nach einem der Ansprüche 1 bis 7, wobei eine Verknüpfung der Position der virtuellen Signalquelle (8 bis 11) im Raum mit weiteren Eigenschaften des abgegebenen akustischen Signals, wie Lautstärke oder Frequenz oder Dauer, erfolgt.A hearing aid or communication system (1A, 1B) according to any one of claims 1 to 7, wherein a link of the position of the virtual signal source (8 to 11) takes place in space with other characteristics of the emitted acoustic signal, such as volume or frequency or duration. Hörhilfe- oder Kommunikationssystem (1A, 1B) nach einem der Ansprüche 1 bis 8, wobei die unterschiedliche Positionierung der virtuellen Signalquelle (3 bis 4; 8 bis 11) im Raum unter Berücksichtigung so genannter head related transfer functions erfolgt.A hearing aid or communication system (1A, 1B) according to any one of claims 1 to 8, wherein the different positioning of the virtual signal source (3 to 4, 8 to 11) takes place in space taking into account so-called head-related transfer functions.
EP05106213A 2004-07-20 2005-07-07 Hearing aid or communication system with virtual sources Revoked EP1619928B1 (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
DE102004035046A DE102004035046A1 (en) 2004-07-20 2004-07-20 Hearing aid or communication system with virtual signal sources providing the user with signals from the space around him

Publications (2)

Publication Number Publication Date
EP1619928A1 true EP1619928A1 (en) 2006-01-25
EP1619928B1 EP1619928B1 (en) 2008-02-27

Family

ID=34684136

Family Applications (1)

Application Number Title Priority Date Filing Date
EP05106213A Revoked EP1619928B1 (en) 2004-07-20 2005-07-07 Hearing aid or communication system with virtual sources

Country Status (5)

Country Link
US (1) US7561707B2 (en)
EP (1) EP1619928B1 (en)
AT (1) ATE387830T1 (en)
DE (2) DE102004035046A1 (en)
DK (1) DK1619928T3 (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102012205637A1 (en) 2012-04-05 2013-02-07 Siemens Medical Instruments Pte. Ltd. Method for operating audio device e.g. earphone, involves assigning detected position or movement of body of user to initial or final virtual position and associated virtual position is selected corresponding to setting item
EP2648423A2 (en) 2012-04-05 2013-10-09 Siemens Medical Instruments Pte. Ltd. Adjustment of a hearing aid device
US9420386B2 (en) 2012-04-05 2016-08-16 Sivantos Pte. Ltd. Method for adjusting a hearing device apparatus and hearing device apparatus

Families Citing this family (32)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7369671B2 (en) 2002-09-16 2008-05-06 Starkey, Laboratories, Inc. Switching structures for hearing aid
US9774961B2 (en) 2005-06-05 2017-09-26 Starkey Laboratories, Inc. Hearing assistance device ear-to-ear communication using an intermediate device
US8041066B2 (en) 2007-01-03 2011-10-18 Starkey Laboratories, Inc. Wireless system for hearing communication devices providing wireless stereo reception modes
CN101263735A (en) * 2005-09-15 2008-09-10 皇家飞利浦电子股份有限公司 An audio data processing device for and a method of synchronized audio data processing
EP2273800A1 (en) 2005-12-07 2011-01-12 Phonak Ag Hearing device with virtual sound source
US8712063B2 (en) 2005-12-19 2014-04-29 Phonak Ag Synchronization of sound generated in binaural hearing system
DK1651005T3 (en) 2005-12-19 2017-07-10 Sonova Ag Synchronization of sound generated in binaural hearing aid system
DK1841281T3 (en) 2006-03-28 2015-10-26 Oticon As System and method for generating auditory spatial information
US20070230714A1 (en) * 2006-04-03 2007-10-04 Armstrong Stephen W Time-delay hearing instrument system and method
US8208642B2 (en) 2006-07-10 2012-06-26 Starkey Laboratories, Inc. Method and apparatus for a binaural hearing assistance system using monaural audio signals
WO2008008730A2 (en) 2006-07-08 2008-01-17 Personics Holdings Inc. Personal audio assistant device and method
US7764798B1 (en) * 2006-07-21 2010-07-27 Cingular Wireless Ii, Llc Radio frequency interference reduction in connection with mobile phones
KR100862663B1 (en) * 2007-01-25 2008-10-10 삼성전자주식회사 Method and apparatus to localize in space position for inputting signal.
DE102007051308B4 (en) * 2007-10-26 2013-05-16 Siemens Medical Instruments Pte. Ltd. A method of processing a multi-channel audio signal for a binaural hearing aid system and corresponding hearing aid system
US8666501B2 (en) 2008-07-02 2014-03-04 Microtransponder, Inc. Methods, systems, and devices for treating tinnitus with VNS pairing
US11471330B2 (en) 2008-07-02 2022-10-18 The Board Of Regents, The University Of Texas System Methods, systems, and devices for treating tinnitus with VNS pairing
WO2010043223A1 (en) * 2008-10-14 2010-04-22 Widex A/S Method of rendering binaural stereo in a hearing aid system and a hearing aid system
FR2938396A1 (en) * 2008-11-07 2010-05-14 Thales Sa METHOD AND SYSTEM FOR SPATIALIZING SOUND BY DYNAMIC SOURCE MOTION
US9420385B2 (en) 2009-12-21 2016-08-16 Starkey Laboratories, Inc. Low power intermittent messaging for hearing assistance devices
US9532146B2 (en) * 2009-12-22 2016-12-27 Starkey Laboratories, Inc. Method and apparatus for testing binaural hearing aid function
US8737653B2 (en) 2009-12-30 2014-05-27 Starkey Laboratories, Inc. Noise reduction system for hearing assistance devices
EP2547122A1 (en) * 2010-03-08 2013-01-16 Panasonic Corporation Hearing aid
US9167368B2 (en) * 2011-12-23 2015-10-20 Blackberry Limited Event notification on a mobile device using binaural sounds
US9191755B2 (en) 2012-12-14 2015-11-17 Starkey Laboratories, Inc. Spatial enhancement mode for hearing aids
EP2887695B1 (en) * 2013-12-19 2018-02-14 GN Hearing A/S A hearing device with selectable perceived spatial positioning of sound sources
US9307331B2 (en) 2013-12-19 2016-04-05 Gn Resound A/S Hearing device with selectable perceived spatial positioning of sound sources
US10003379B2 (en) 2014-05-06 2018-06-19 Starkey Laboratories, Inc. Wireless communication with probing bandwidth
TWI609589B (en) * 2015-05-14 2017-12-21 陳光超 Hearing auxiliary device and hearing auxiliary processing method
US10142755B2 (en) * 2016-02-18 2018-11-27 Google Llc Signal processing methods and systems for rendering audio on virtual loudspeaker arrays
US10154354B2 (en) 2017-02-10 2018-12-11 Cochlear Limited Advanced artificial sound hearing training
DE102017207581A1 (en) * 2017-05-05 2018-11-08 Sivantos Pte. Ltd. Hearing system and hearing device
CN107734428B (en) * 2017-11-03 2019-10-01 中广热点云科技有限公司 A kind of 3D audio-frequence player device

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0557847A1 (en) * 1992-02-27 1993-09-01 Siemens Audiologische Technik GmbH Head-mounted hearing aid
US5438623A (en) * 1993-10-04 1995-08-01 The United States Of America As Represented By The Administrator Of National Aeronautics And Space Administration Multi-channel spatialization system for audio signals
US6307941B1 (en) * 1997-07-15 2001-10-23 Desper Products, Inc. System and method for localization of virtual sound
WO2003015471A2 (en) * 2001-08-10 2003-02-20 A & G Soluzioni Digitali S.R.L. Device and method for simulation of the presence of one or more sound sources in virtual positions in three-dimensional acoustic space
US20030059070A1 (en) * 2001-09-26 2003-03-27 Ballas James A. Method and apparatus for producing spatialized audio signals

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6320969B1 (en) * 1989-09-29 2001-11-20 Etymotic Research, Inc. Hearing aid with audible alarm
JP4509450B2 (en) * 1999-12-24 2010-07-21 コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ Headphone with integrated microphone
GB2373154B (en) 2001-01-29 2005-04-20 Hewlett Packard Co Audio user interface with mutable synthesised sound sources
JP4019952B2 (en) * 2002-01-31 2007-12-12 株式会社デンソー Sound output device
JP4694763B2 (en) * 2002-12-20 2011-06-08 パイオニア株式会社 Headphone device
ES2375183T3 (en) * 2002-12-30 2012-02-27 Koninklijke Philips Electronics N.V. AUDIO PLAYBACK, FEEDING SYSTEM AND METHOD.
DE60307576T2 (en) 2003-11-20 2007-10-04 Phonak Ag A method for adjusting a hearing aid to a current acoustic environment situation and a hearing aid system

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0557847A1 (en) * 1992-02-27 1993-09-01 Siemens Audiologische Technik GmbH Head-mounted hearing aid
US5438623A (en) * 1993-10-04 1995-08-01 The United States Of America As Represented By The Administrator Of National Aeronautics And Space Administration Multi-channel spatialization system for audio signals
US6307941B1 (en) * 1997-07-15 2001-10-23 Desper Products, Inc. System and method for localization of virtual sound
WO2003015471A2 (en) * 2001-08-10 2003-02-20 A & G Soluzioni Digitali S.R.L. Device and method for simulation of the presence of one or more sound sources in virtual positions in three-dimensional acoustic space
US20030059070A1 (en) * 2001-09-26 2003-03-27 Ballas James A. Method and apparatus for producing spatialized audio signals

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102012205637A1 (en) 2012-04-05 2013-02-07 Siemens Medical Instruments Pte. Ltd. Method for operating audio device e.g. earphone, involves assigning detected position or movement of body of user to initial or final virtual position and associated virtual position is selected corresponding to setting item
EP2648423A2 (en) 2012-04-05 2013-10-09 Siemens Medical Instruments Pte. Ltd. Adjustment of a hearing aid device
DE102012205634A1 (en) 2012-04-05 2013-10-10 Siemens Medical Instruments Pte. Ltd. Adjusting a hearing device device
EP2648423A3 (en) * 2012-04-05 2014-03-05 Siemens Medical Instruments Pte. Ltd. Adjustment of a hearing aid device
DE102012205634B4 (en) * 2012-04-05 2014-07-10 Siemens Medical Instruments Pte. Ltd. Adjusting a hearing device device
US9420386B2 (en) 2012-04-05 2016-08-16 Sivantos Pte. Ltd. Method for adjusting a hearing device apparatus and hearing device apparatus

Also Published As

Publication number Publication date
US20060018497A1 (en) 2006-01-26
DE502005002956D1 (en) 2008-04-10
US7561707B2 (en) 2009-07-14
ATE387830T1 (en) 2008-03-15
EP1619928B1 (en) 2008-02-27
DK1619928T3 (en) 2008-06-30
DE102004035046A1 (en) 2005-07-21

Similar Documents

Publication Publication Date Title
EP1619928B1 (en) Hearing aid or communication system with virtual sources
DE10249416B4 (en) Method for adjusting and operating a hearing aid device and hearing aid device
Toole In‐Head Localization of Acoustic Images
DE69734934T2 (en) METHOD AND DEVICE FOR PROJECTING SOUND SOURCES ON LOUDSPEAKERS
AT394650B (en) ELECTROACOUSTIC ARRANGEMENT FOR PLAYING STEREOPHONER BINAURAL AUDIO SIGNALS VIA HEADPHONES
DE102011006471B4 (en) Hearing aid device and hearing aid system with a directional microphone system and method for adjusting a directional microphone in a hearing aid
DE102012204877B3 (en) Hearing device for a binaural supply and method for providing a binaural supply
EP2519033B1 (en) Method for operating a hearing aid with reduced comb filter perceptio and hearing aid with reduced comb filter perception
DE102014210215A1 (en) Identification and use of hearing room optimized transfer functions
EP3669554A1 (en) Loudspeaker assembly and headphones for spatially localizing a sound event
DE102005001395B4 (en) Method and apparatus for transforming the early sound field
CH694606A5 (en) Method of fitting a hearing aid and hearing aid.
EP1471770B1 (en) Method for generating an approximated partial transfer function
DE102007051308B4 (en) A method of processing a multi-channel audio signal for a binaural hearing aid system and corresponding hearing aid system
EP0484354B1 (en) Stereo headphone for the "in front" location of auditory events generated by stereo headphones
WO2021122540A1 (en) Method and system for transmitting and reproducing acoustic information
DE102013111295A1 (en) Device for comparison test of hearing aids
DE102022107266A1 (en) Audio system and method for determining audio filter based on device position
EP0025509B1 (en) Process for stereophonic transmission and means for carrying out the method
DE102021211278B3 (en) Procedure for determining an HRTF and hearing aid
EP3695620B1 (en) Improved sound transducer
DE102009058414A1 (en) Hearing aid for treatment of hearing-impaired patients, has signal processing device receiving sensor signals from acoustic sensors as input signals and processing sensor signals depending on spatial arrangement of acoustic sensors
DE102018210053A1 (en) Process for audio playback in a hearing aid
EP2503799B1 (en) Method and system for calculating synthetic head related transfer functions by means of virtual local sound field synthesis
DE102006018490A1 (en) Acoustical signals binaural reproduction method for e.g. headphone, involves determining momentary rotational position of binaural reproduction system by rotational measuring device and outputting acoustical signals over reproduction system

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC NL PL PT RO SE SI SK TR

AX Request for extension of the european patent

Extension state: AL BA HR MK YU

AKX Designation fees paid
17P Request for examination filed

Effective date: 20060921

RBV Designated contracting states (corrected)

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC NL PL PT RO SE SI SK TR

17Q First examination report despatched

Effective date: 20061018

17Q First examination report despatched

Effective date: 20061018

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC NL PL PT RO SE SI SK TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

Free format text: NOT ENGLISH

GBT Gb: translation of ep patent filed (gb section 77(6)(a)/1977)

Effective date: 20080227

REG Reference to a national code

Ref country code: CH

Ref legal event code: NV

Representative=s name: SIEMENS SCHWEIZ AG

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

Free format text: LANGUAGE OF EP DOCUMENT: GERMAN

REF Corresponds to:

Ref document number: 502005002956

Country of ref document: DE

Date of ref document: 20080410

Kind code of ref document: P

REG Reference to a national code

Ref country code: DK

Ref legal event code: T3

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20080607

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20080627

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20080227

NLV1 Nl: lapsed or annulled due to failure to fulfill the requirements of art. 29p and 29m of the patents act
ET Fr: translation filed
PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20080227

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20080227

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20080227

REG Reference to a national code

Ref country code: IE

Ref legal event code: FD4D

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20080227

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20080527

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20080721

Ref country code: IE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20080227

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20080227

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20080227

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20080919

Year of fee payment: 4

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20080227

PLBI Opposition filed

Free format text: ORIGINAL CODE: 0009260

PLAX Notice of opposition and request to file observation + time limit sent

Free format text: ORIGINAL CODE: EPIDOSNOBS2

26 Opposition filed

Opponent name: OTICON A/S/PHONAK AG/WIDEX A/S/GN RESOUND A/S

Effective date: 20081127

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20080227

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20080731

REG Reference to a national code

Ref country code: CH

Ref legal event code: PCAR

Free format text: SIEMENS SCHWEIZ AG;INTELLECTUAL PROPERTY FREILAGERSTRASSE 40;8047 ZUERICH (CH)

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20080527

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20080227

PLAF Information modified related to communication of a notice of opposition and request to file observations + time limit

Free format text: ORIGINAL CODE: EPIDOSCOBS2

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20080227

RDAF Communication despatched that patent is revoked

Free format text: ORIGINAL CODE: EPIDOSNREV1

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20080707

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DK

Payment date: 20090709

Year of fee payment: 5

Ref country code: FR

Payment date: 20090717

Year of fee payment: 5

RDAG Patent revoked

Free format text: ORIGINAL CODE: 0009271

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: PATENT REVOKED

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20090713

Year of fee payment: 5

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

27W Patent revoked

Effective date: 20090817

GBPR Gb: patent revoked under art. 102 of the ep convention designating the uk as contracting state

Effective date: 20090817

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CH

Free format text: LAPSE BECAUSE OF THE APPLICANT RENOUNCES

Effective date: 20080227

Ref country code: LI

Free format text: LAPSE BECAUSE OF THE APPLICANT RENOUNCES

Effective date: 20080227

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20080828

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20080707

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20080731

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20080227

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20080528

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: IT

Payment date: 20080731

Year of fee payment: 4