WO2017211426A1 - Procédé et système de présentation d'un ou plusieurs messages système à un utilisateur - Google Patents

Procédé et système de présentation d'un ou plusieurs messages système à un utilisateur Download PDF

Info

Publication number
WO2017211426A1
WO2017211426A1 PCT/EP2016/063260 EP2016063260W WO2017211426A1 WO 2017211426 A1 WO2017211426 A1 WO 2017211426A1 EP 2016063260 W EP2016063260 W EP 2016063260W WO 2017211426 A1 WO2017211426 A1 WO 2017211426A1
Authority
WO
WIPO (PCT)
Prior art keywords
msg1
user
hearing
msg4
system message
Prior art date
Application number
PCT/EP2016/063260
Other languages
English (en)
Inventor
Manuela Feilner
Harald Krueger
Michael ECKARDT
Pascal MAGNENAT
Original Assignee
Sonova Ag
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sonova Ag filed Critical Sonova Ag
Priority to PCT/EP2016/063260 priority Critical patent/WO2017211426A1/fr
Publication of WO2017211426A1 publication Critical patent/WO2017211426A1/fr

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R25/00—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R1/00—Details of transducers, loudspeakers or microphones
    • H04R1/10—Earpieces; Attachments therefor ; Earphones; Monophonic headphones
    • H04R1/1041—Mechanical or electronic switches, or control elements
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2225/00—Details of deaf aids covered by H04R25/00, not provided for in any of its subgroups
    • H04R2225/55—Communication between hearing aids and external devices via a network for data exchange
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2225/00—Details of deaf aids covered by H04R25/00, not provided for in any of its subgroups
    • H04R2225/61—Aspects relating to mechanical or electronic switches or control elements, e.g. functioning
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2460/00—Details of hearing devices, i.e. of ear- or headphones covered by H04R1/10 or H04R5/033 but not provided for in any of their subgroups, or of hearing aids covered by H04R25/00 but not provided for in any of its subgroups
    • H04R2460/07—Use of position data from wide-area or local-area positioning systems in hearing devices, e.g. program or information selection

Definitions

  • the present invention is related to a method of presenting at least one system message to a user of a hearing system as well as to a system for performing such a method.
  • Hearing devices are typically used to improve the hearing capability or communication capability of a user.
  • a hearing device may pick up the surrounding sound with a microphone of the hearing device, process the microphone signal thereby taking into account the hearing preferences of the user of the hearing device and providing the processed sound signal into an ear canal of the user via a miniature loudspeaker, commonly referred to as a receiver.
  • a hearing device may also receive sound from an alternative input such as an induction coil or a wireless interface.
  • Hearing device users can be notified of numerous events daily, e.g. program changes, battery state of the hearing device, smartphone notifications, messages issued by home appliances, public announcements, etc. These notifications, in the following also called system messages, may be unclear, misleading, disturbing or inappropriate depending on the user context.
  • Hearing devices comprise hearing aids, e.g. behind-the-ear (BTE) hearing aids, in-the-ear (ITE) hearing aids, cochlear implants, etc., worn by hearing impaired peoples.
  • BTE behind-the-ear
  • ITE in-the-ear
  • cochlear implants etc.
  • Hearing systems may contain a configurator to adapt the notification levels manually based on user preferences. However, switching-off "unwanted" system messages also disables system messages that could still be beneficial or rather important, e.g. a hearing device battery state warning, etc. It is therefore an object of the present invention to provide a method which solves the problems stated above. It is a further object of the invention to propose a hearing system for performing such a method.
  • the present invention is directed to a method of presenting at least one system message to a user of a hearing system, wherein the hearing system comprises at least one hearing device.
  • the method comprises the steps of: retrieving the system message; storing the retrieved system message;
  • the inventive method allows to present at least one system message based on a (current) situation of the hearing device user as well as a priority associated with the system message (e.g. important, less important, unimportant system messages) .
  • a priority associated with the system message e.g. important, less important, unimportant system messages
  • the at least one system message is output i.e. presented (e.g. played) to the user.
  • the hearing system continuously analyzes the user's situation by checking on situation parameters.
  • respective system messages that do not need to be immediately addressed by the user are delayed and issued to the user at a later point in time.
  • These system messages can be presented either automatically or at the user's request.
  • the present invention avoids to distract attention or rather disturb the hearing system user when being in a conversation.
  • System messages having low priority are stored in a memory of the hearing system and presented to the user when the hearing system detects that the situation for the user is appropriate, e.g. the hearing system detects a "quiet" situation.
  • the hearing system allows to personalize the settings for system message priorities.
  • the hearing system also allows to configure which signal priority will be played for which sound environment.
  • the system also allows to summarize multiple stored system messages by playing a notification only once instead of multiple times. For example, if 10 messages, e.g. SMS, e-mail, instant messaging, etc., are received while the user shouldn't be disturbed with
  • the step of playing the at least one system message comprises applying text-to- speech to read out a text based on the system message.
  • Either the whole system message may be converted to speech or some kind of summary (e.g. the first sentence, metadata such as the sender and/or the sending-time, etc.) may be compiled.
  • Playing the at least one system message may adapt different forms as well, for example replaying the complete system message, a solely notification about each existing system message, a general notification to consult a phone screen, for example a smartphone screen, to get an overview about pending system messages, etc.
  • the hearing system further comprises an accessory device connectable to the hearing device, and the step of playing the at least one system message comprises notifying the user of existing system messages, and/or the scheduling of said system messages through the accessory device.
  • the accessory device can be connected to the hearing device by means of a wireless connection, e.g. Bluetooth.
  • the accessory device can be a smartphone.
  • the system messages may include spoken text, melodies, music or simple beep tones, etc. Further, the system messages may be based on incoming text messages such as SMS or e-mail. Furthermore, the system messages may also be based on incoming audio, such as the content of a telephone call or voice mail. The system messages may also correspond to events such as a doorbell ringing or a fire alarm. Further, the system messages may also be reminders of appointments within an electronic calendar. Also certain streaming audio, such as music, may be regarded as a kind of system message. The system message or audio may be played directly in its entirety. Alternatively, the
  • presentation of the entire system message may require some kind of confirmation by the user.
  • analysing the situation comprises determining at least one environment sound class.
  • the hearing system continuously analyzes the user' s situation by checking on situation parameters. When the hearing system identifies that the user requires not to be disturbed, notifications that do not need to be immediately addressed by the user are delayed and presented to the user later (either
  • the environment sound class can comprise e.g. calm, noise, speech, speech in noise, t-coil, etc.
  • the environment sound class is retrieved from a sound class classifier comprised by the hearing device or based on a manually adjusted hearing program.
  • analysing the situation comprises determining a user body and health information.
  • information can comprise user related information such as blood pressure, pulse, pulse rate, etc.
  • Said user related information can be obtained by adeguate sensors, e.g. pulse meter, hemoglobin measurement meter, etc., for different wearing options, e.g. wrist band, smartwatch, etc.
  • the user body and health information is retrieved from at least one monitor operatively coupled to the hearing device and/or the accessory device, wherein the monitor comprises at least one of: a pulse rate monitor, a temperature monitor, a skin resistance monitor, an electroencephalogram EEG monitor, an electrocardiogram ECG monitor, and an accelerometer .
  • the respective monitor detects user body information such as situations: lying, sitting, walking, running, etc. A lower pulse rate of the user detected from the pulse rate monitor allows to more freguently present a system message to the user .
  • analysing the situation comprises determining a location information .
  • the location information is retrieved based on at least one of: global positioning system GPS, beacon devices, wireless local area network WLAN, at least one cellular cell, and a combination of a current time and at least one calendar entry.
  • the location can be determined by means of a GPS device
  • the location can be determined based on WLANs within range or based on a GSM cellular
  • the location can be determined based on the current time and calendar entries. Further examples comprise determining whether the user is driving a car, is at home or work, etc.
  • analysing the situation comprises determining situation parameters comprising a user activity and/or an electronic agenda.
  • the situation parameters can be based on a
  • plurality of user activities comprising sleeping, swimming, playing tennis, listening, eating, etc. Said user
  • activities can be determined by means of at least one sensor data comprising pulse rate, movement, location, setting an alarm clock, calendar entries, still pictures or video of a surveillance camera, etc.
  • the proposed method further comprises repeating the step of determining the priority and repeating the step of scheduling of unheard system
  • the step of playing the system message comprises attenuating or muting an acoustical signal from a microphone comprised in the hearing device.
  • the microphone of the hearing device is attenuated or muted. This allows the user to better distinguish the system message from the surrounding sound resulting in a better understanding of the system message.
  • system message comprises at least one of: a text message, an SMS, an email, a telephone call, a voicemail, a door bell ringing, a fire alarm, a reminder notification, a public
  • the system message can further comprise a public announcement, e.g. at a train station, in a theatre, in a public building, etc.
  • the system message can further comprise a message issued by a home appliance.
  • the system message can comprise an audio hearing aid user guide.
  • the system message can comprise at least one of a battery low
  • the step of storing the retrieved system message comprises writing the system message into a memory comprised in the hearing system.
  • the present invention is directed to a hearing system adapted to perform a method according to one of claims 1 to 15.
  • Fig. 1 is an illustrative view depicting scheduling of
  • system messages in a method of presenting system messages to a user of a hearing system.
  • Fig. 1 depicts in an illustrative view scheduling of system messages MSG1-MSG4 in a method of presenting said system messages SG1-MSG4 to a user of a hearing system depending on time or rather situation.
  • the system messages MSG1-MSG4 can comprise an incoming notification, a sound source, an alternative input, or simply a message.
  • the system messages MSG1-MSG4 are retrieved.
  • the retrieved system messages MSG1-MSG4 are stored in a memory M of the hearing system.
  • respective situations Sl- S3 of the hearing device user are analysed.
  • situation SI relates to "in a car”
  • S2 relates to "speech in loud noise”
  • S3 relates to "quiet”.
  • a priority associated with a respective one of said system messages MSG1- SG4 is determined.
  • the system messages are associated with (or rather mapped by) an identifier
  • the decision logic DL comprises prioritization rules configured to schedule said system messages MSG1- SG4. Each of the system messages MSG1-MSG4 is scheduled based on said prioritization rules. Further, during the time t or rather depending on the respective situation, the at least one system message MSG1-MSG4 is presented to the user based on said scheduling in a
  • the figure further depicts (environmental) situations comprising situations: “car” (SI), “speech in loud noise” (S2) and “quiet” (S3) .
  • SI system in which situations: "car”
  • SI speech in loud noise
  • S3 "quiet”
  • the number in brackets [n] i.e. [0], [1] and [4]
  • the system message MSG4 which is determined to have priority [#0] is played instantaneously, even in the situation "speech in loud noise".
  • the system message MSG3 which is determined to have priority [#4] is stored during the time t until the situation will be quiet.
  • the system message MSG2 which is determined to have priority [#1] is determined to have a priority less important than that of system message MSG4 but more important than that of system messages MSGl and MSG3. Therefore, the decision logic DL schedules said system message MSG2 such to be played while the user is in the car (situation "car" SI).
  • the retrieved system messages MSG1-MSG4 can be disturbing for the user.
  • the incoming system messages SG1-MSG4 will not necessarily be presented immediately to the hearing system user but can be stored or rather stacked in the memory M of the hearing system.
  • Said stored system messages MSG1-MSG4 can be presented later in a more convenient situation based on the determined prioritization depending of the users situation. Whether a situation is convenient (suitable) or not can be detected depending on an acoustical analysis of the hearing system, e.g. if the hearing system detects situations
  • the hearing system determines which input source the user is listening to, e.g. acoustic input, T-coil, etc. In a further example, the hearing system determines which acoustic sources are present, e.g. speaker recognition - if a specific speaker is present, the system messages can be presented or can be specifically not presented. Furthermore, in an example, the hearing system determines current physical activity of the user, e.g. whether the hearing system user is sitting, walking, running, etc. At least one sensor for monitoring the physical activity of the user can comprise a motion sensor in the hearing system. As mentioned above, the hearing system can comprise at least one hearing device and an accessory device such as a remote control, smartphone, bracelet, etc. Due to the wide distribution and the capability of multi-purpose
  • smartphones are preferred as accessory device.
  • the respective one or more of said sensors can be located in the hearing device and/or the accessory device (e.g. the smartphone) .
  • the accessory device e.g. the smartphone
  • many functionalities, features, such as the various sensors mentioned in the description, etc. can be implemented in the accessory device, e.g. the smartphone, which is
  • the hearing system comprises at least one sensor adapted to determine the head position of the user, e.g. whether the head of the user is moving or not, whether the head elevation is low or high, etc.
  • a possible sensor is a movement sensor located e.g. in the hearing device itself.
  • the hearing system can be configured to determine the location of the user.
  • the hearing system detects via its at least one sensor if e.g. the user is at home, in his car, in a public transportation system, etc.
  • One or more possible sensors might be selected from GPS, WLAN, specific localization beacons, etc.
  • the hearing system determines body, mental and health condition of the user, e.g. pulse, pulse rate, body temperature, blood pressure, oxygen in blood, insulin level, etc.
  • the hearing system can be configured to determine the location of the user.
  • the hearing system detects via its at least one sensor if e.g. the user is at home, in his car, in a public transportation system, etc.
  • One or more possible sensors might be selected from GPS, WLAN, specific localization beacons, etc.
  • the hearing system determines body, mental and health condition of the user, e.g. pulse, pulse rate, body temperature, blood pressure, oxygen in blood, insulin level, etc.
  • the hearing system can be
  • the hearing system determines mental occupation of the user (e.g. by means of EEG
  • Some of a plurality of respective sensors comprise a heart rate sensor, a temperature sensor in the hearing device and/or the accessory device, etc.
  • the hearing system can determine calendar entries, week-day, day time, etc.
  • user' s situation can be analysed by means of a camera, which might be a camera on a TV set. While not shown in the figure, the suitability of situations may also be determined based on a user preference learning
  • the hearing system can automatically estimate if the user wants to be
  • the system may temporarily overwrite the default/configured priority setting to ensure that a system message will not be delayed infinitely. For example, too many pending SMS exist and it could be useful to play them back, or an SMS is older than e.g. 2 hours and should be presented to the user.
  • One way of implementation is by gradually increasing the priority of waiting messages over time. For each listening
  • the user may configure which signal priority is allowed to be presented or rather played back.
  • configuration of at least one feature mentioned above may be done during a fitting process, by means of a mobile phone application or any other apparatus that can alter the configuration.
  • the following can be configured:
  • the priority of each possible type of notification e.g. a fire alarm has a high priority
  • the suitability of each environment, situation and/or condition for replay e.g. a calm situation is very suitable
  • the following table 1 presents possible message type/ priority/presentation configurations .
  • Notification 2 None Notify, of presence present on of a T-Coil request signal
  • the above rules may also be prioritized, for example the rule "pulse>120 -> unsuitable” may overwrite the rule "calm & home suitable”.
  • a mixed mode sound flow
  • the suitability of the dominant class may be used or a suitability may be calculated by
  • An automatic input management rule can be overruled manually.
  • the user can stop the presentation of system messages or the notification of the system messages or the user can actively trigger the presentation of stored system messages.
  • the system cannot only distinguish between not convenient (not suitable) and convenient
  • a gesture can allow to present the
  • the present invention prevents unwanted frequent
  • the present invention allows smoothly operation of the complete hearing system, which is a major driver of successful adoption by the user.

Landscapes

  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Neurosurgery (AREA)
  • Otolaryngology (AREA)
  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Acoustics & Sound (AREA)
  • Signal Processing (AREA)
  • Telephone Function (AREA)

Abstract

L'invention concerne un procédé de présentation d'un ou plusieurs messages système (MSG1-MSG4) à un utilisateur d'un système auditif, le système auditif comprenant un ou plusieurs dispositifs auditifs. Le procédé consiste : à récupérer le message système (MSG1-MSG4) ; à mémoriser le message système récupéré (MSG1-MSG4) ; à analyser une situation (S1-S3) de l'utilisateur du dispositif auditif ; à déterminer une priorité associée au message système (MSG1-MSG4) ; à entrer le résultat de ladite analyse et de ladite détermination dans une logique de décision (DL) ; à programmer chacun des messages système (MSG1-MSG4) conformément à des règles de priorisation comprises par ladite logique de décision (DL) ; et à lire lesdits messages système (MSG1-MSG4) à l'utilisateur en fonction de ladite programmation.
PCT/EP2016/063260 2016-06-10 2016-06-10 Procédé et système de présentation d'un ou plusieurs messages système à un utilisateur WO2017211426A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/EP2016/063260 WO2017211426A1 (fr) 2016-06-10 2016-06-10 Procédé et système de présentation d'un ou plusieurs messages système à un utilisateur

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/EP2016/063260 WO2017211426A1 (fr) 2016-06-10 2016-06-10 Procédé et système de présentation d'un ou plusieurs messages système à un utilisateur

Publications (1)

Publication Number Publication Date
WO2017211426A1 true WO2017211426A1 (fr) 2017-12-14

Family

ID=56203324

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/EP2016/063260 WO2017211426A1 (fr) 2016-06-10 2016-06-10 Procédé et système de présentation d'un ou plusieurs messages système à un utilisateur

Country Status (1)

Country Link
WO (1) WO2017211426A1 (fr)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10681459B1 (en) 2019-01-28 2020-06-09 Sonova Ag Hearing devices with activity scheduling for an artifact-free user experience
US11363391B2 (en) 2020-03-24 2022-06-14 Sonova Ag Systems and methods for biomarker analysis on a hearing device
US11457320B2 (en) 2020-03-25 2022-09-27 Sonova Ag Selectively collecting and storing sensor data of a hearing system
US11477583B2 (en) 2020-03-26 2022-10-18 Sonova Ag Stress and hearing device performance

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1460769A1 (fr) * 2003-03-18 2004-09-22 Phonak Communications Ag Emetteur-récepteur mobile et module électronique pour la commande du émetteur-récepteur
US20090238386A1 (en) * 2007-12-25 2009-09-24 Personics Holding, Inc Method and system for event reminder using an earpiece
US20140369536A1 (en) * 2013-06-14 2014-12-18 Gn Resound A/S Hearing instrument with off-line speech messages

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1460769A1 (fr) * 2003-03-18 2004-09-22 Phonak Communications Ag Emetteur-récepteur mobile et module électronique pour la commande du émetteur-récepteur
US20090238386A1 (en) * 2007-12-25 2009-09-24 Personics Holding, Inc Method and system for event reminder using an earpiece
US20140369536A1 (en) * 2013-06-14 2014-12-18 Gn Resound A/S Hearing instrument with off-line speech messages

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10681459B1 (en) 2019-01-28 2020-06-09 Sonova Ag Hearing devices with activity scheduling for an artifact-free user experience
US11363391B2 (en) 2020-03-24 2022-06-14 Sonova Ag Systems and methods for biomarker analysis on a hearing device
US11457320B2 (en) 2020-03-25 2022-09-27 Sonova Ag Selectively collecting and storing sensor data of a hearing system
US11477583B2 (en) 2020-03-26 2022-10-18 Sonova Ag Stress and hearing device performance

Similar Documents

Publication Publication Date Title
US11501772B2 (en) Context aware hearing optimization engine
CN101076949B (zh) 具有自动报警模式选择的手持通信设备
KR102240898B1 (ko) 사용자 제어가능 청각 환경 맞춤화 시스템 및 방법
Sawhney et al. Nomadic radio: speech and audio interaction for contextual messaging in nomadic environments
US8473081B2 (en) Method and system for event reminder using an earpiece
CN101795323B (zh) 一种电子闹铃运行方法、电子闹铃及一种移动通信终端
WO2017211426A1 (fr) Procédé et système de présentation d'un ou plusieurs messages système à un utilisateur
US20130163765A1 (en) Event notification on a mobile device using binaural sounds
CA2646432A1 (fr) Notification intelligente de message d'arrivee
US20140256298A1 (en) Systems and methods for providing notifications regarding status of handheld communication device
KR102252818B1 (ko) 사용자 수면 상태에 기초한 스마트폰 구성
CN111492672B (zh) 听力设备及其操作方法
CN109804358B (zh) 再现终端和再现方法
EP3214856A1 (fr) Appareil auditif conçu pour fonctionner dans un système de communication
US11893997B2 (en) Audio signal processing for automatic transcription using ear-wearable device
US20230205484A1 (en) Methods and systems for generating customized audio experiences
US20120086578A1 (en) Systems and methods for providing notifications regarding status of handheld communication device
US20140369536A1 (en) Hearing instrument with off-line speech messages
JP2016091221A (ja) 情報処理装置、情報処理方法及びコンピュータプログラム
US10873816B2 (en) Providing feedback of an own voice loudness of a user of a hearing device
EP2608131A9 (fr) Notification d'événements sur un dispositif mobile au moyen de sons binauraux
US11057525B1 (en) Communication system for covert and hands-free communication
Sawhney Contextual awareness, messaging and communication in nomadic audio environments
EP4290885A1 (fr) Sensibilisation situationnelle basée sur le contexte pour instruments auditifs
EP2814264B1 (fr) Instrument auditif pour messages vocaux hors ligne

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16731822

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 16731822

Country of ref document: EP

Kind code of ref document: A1