NL1044390B1

NL1044390B1 - Audio wearables and operating methods thereof

Info

Publication number: NL1044390B1
Application number: NL1044390A
Authority: NL
Inventors: Rembrandt Donkersloot Msc; Dr Ir Tjerk Oosterkamp Prof
Original assignee: Dr Ir Tjerk Oosterkamp Prof; Rembrandt Donkersloot Msc
Priority date: 2022-08-01
Filing date: 2022-08-01
Publication date: 2024-02-06

Abstract

Method for operating audio wearable such as wireless headphones, the method comprising the steps of recording environmental sound, processing said environmental sound for speech recognition, identifying a start of a conversation in the proceseed environmental sound, and in response to said identification, changing an operational modus of the audio wearable such that a transfer of information associated with said start of the conversation is being enhanced.

Description

AUDIO WEARABLES AND OPERATING METHODS THEREOF

Field of the invention

The present invention pertains to the field of audio wearables, in particular headphones and more in particular wireless and noise cancelling headphones.

Art background

Many headphones incorporate active noise cancellation techniques to suppress environmental noise heard by the user. These types of headphones, for example, are often used in public transportation to suppress noise, or in noisy workplaces where people work in an open office space such as cubicles.

Active noise cancelling headphones typically operate by detecting a background noise signal and generating an anti-noise signal which destructively interferes with the background noise signal,

A common problem related to the use of noise cancellation is that a user often misses the beginning of a conversation. The full transfer of communication information is consequently affected as said user could miss important pieces of information. Their behaviour may also be perceived as anti-social, as they could not realise that a conversation was being initiated. It could also be the case that the initial conversation is not fully understood, leading to miscommunication. In some scenarios a repeat of information may have to be requested to remedy the situation, possibly leading to rude, humiliating, and awkward encounters with loss of face.

One goal of the present invention is to overcome the above-mentioned problems. This and other objects have been attained according to the present invention.

Summary of the invention

The invention is defined by the appended claims.

Brief description of the drawings

The present invention is described with respect to exemplary embodiments thereof and reference is accordingly made to the drawings in which:

Figure 1: shows an exemplary pair of headphones;

Figure 2: shows a flow diagram with steps of a method for making headphones less anti-social. 1

Detailed description

The following description is not to be considered as limiting the scope of the embodiments described herein in any way, but rather as merely describing the implementation of the various embodiments described herein.

With reference to Figure 1 a pair of headphones 1 is shown, Headphones 1 are wireless and noise cancelling headphones although it is understood that the present invention is also applicable to headphones that do not incorporate a noise cancelling function and/or are wired, Each of the headphones 1 at least comprise a speaker 2. Headphones 1 can further optionally comprise a battery 3 in case of wireless {2.g. Bluetooth} headphones, and optionally processing means 4, Furthermore,

Figure 1 shows that headphones 1 comprise one or more microphones 5. The one or more microphones 5 are at least used for recording noise in case of noise cancelling headphones. The same or further microphone of the headphones 1 is used to record environmental sound such as a nearby conversation, for example from a person that tries to initiate a conversation with the user of said headphones 1.

The headphones 1 now benefit from the following function as set out in the flow diagram of Figure 2.

That is, Figure 2 demonstrates a method for making headphones less anti-social. In step 200, one or more microphones 5 of the headphones 1 record environmental sound. In step 201 the environmental sound is processed for speech recognition, and in particular for the recognition of the start of a conversation. in the subsequent step 202, an operational mode of the headphones 1 is being changed, such that a transfer of information associated with the start of the conversation is being enhanced.

For example, the operational modus is being changed from playing audio such as music to pausing said audio, or to continue playing audio at a lower volume. Alternatively, or in addition, the noise cancelling mode of the headphones 1 may be disabled and/or a modus of the headphones 1 can be enabled that enhance environmental sound. 25. To further illustrate the method according to Figure 2, imagine a user Michelle who is listening to music using headphones 1. A nearby colleague starts a conversation: “Hey Michelle... | want those reports by Friday latest”. The microphones of headphones 1 recorded said environmental sound and through speech processing the start of a conversation was detected ("Hey Michelle...”}. In response thereto, headphones 1 stopped playing music. As a result, Michelle became aware that their colleague needed their attention, and they could grasp the received instruction with improved clarity as their music stopped playing. 2 it should be clear to the skilled person that ‘conversation starters’ can be preconfigured by the user to improve correct recognition of conversation starters directed to said user.

Moreover, it should be clear to the skilled person that enabling hardware for headphones 1 include at least speakers 2 and microphones 5, It is further understood that said noise cancelling functionalities, speech recognition and other processing functionalities are being processed by the processing means 4 of the headphones 1 and/or processing means of its carrier such as a smartphone or computer. it should be further clear to the skilled person that the headphones 1 comprise all architecture as knewn in the art that enable communication of alt received and processed signals (e.g. environmental sound and its corresponding processed data). ina further embodiment, the initiation of a nearby conversation is being recognized and the user of headphones 1 is warned, for example by providing the user with a specific and possibly user configurable audible warning signal. in a further embodiment, as a subsequent change of operational modus {step 202}, the last X seconds are played back through speakers 2 of headphones 1 {with X a real number), for example the last 1 second, 5 seconds, 10 seconds, or even 30 seconds, such that the beginning of the conversation can be repeated. This would eliminate the need to ask a person who started a conversation to repeat said start of the conversation. The user could trigger such functionality through user interaction such as tapping, clicking, or touching one of the headphones 1 or after providing some other kind of input command. in a further embodiment, the conversation is repeated at an increased speed, for example 1,5 or 2 ïmes. Repeating speed can be a user adjustable configuration. Alternatively or in addition thereto, only a portion of the recorded sound is repeated that comprises speech. it is to be understood that, to ensure privacy of other persons, conversations are only temporarily stored in the memory of the headphones {if present) or coupled carrier such as a smartphone or computer.

The present invention has been described regarding specific embodiments. However, it will be obvious to persons skilled in the art that various variants and modifications can be made without departing from the scope of the invention as described herein. For example, it is to be understood that the invention as disclosed herein is applicable to any kind of audio wearables such as headphones, wireless {e.g Bluetooth) or wired, including over-ear, on-ear and in-ear. 3

Clauses

Certain aspects of the invention are discussed in the following clauses: 1. Method for operating audio wearable such as wireless headphones, the method comprising the steps of: a. recording, with a microphone of the audio wearable, environmental sound; b. communicating the environmental sound to processing means, wherein the processing means is being comprised by the audio wearable and/or a connected audio carrier such as a smartphone; c. using the processing means to carry out the steps of: i. processing the environmental sound for speech recognition; ii. identifying a start of a conversation in the processed environmental sound; fi. In response to said identification, changing an operational modus of the audio wearable such that a transfer of information associated with said start of the conversation is being enhanced. 2. Method of clause 1, wherein the operational modus is being changed from playing audio such a5 music to pausing said audio, or to continue playing audio at a lower volame, the audio being played through speakers of said audio wearable. 3. Method of clause 1 or 2, wherein said changing of operational modus is accompanied with an audible warning signal. 4. Method of clause 2 or 3, wherein the operational modus is further being changed to repeat the last 10 seconds or shorter of the recorded environmental sound through speakers of the audio wearable, preferably the last 5 seconds or shorter, 5. Method according to clause 4, wherein only a portion of the environmental sound is repeated that comprises speech. 6. Method according to clause 4 or 5, wherein the environmental sound is repeated at an increased speed. 4

7. Method according to any of the preceding clauses, wherein the audio wearable is activated in 3 noise cancelling mode, at least prior to the step of changing the operational modus of the audio wearable.

8. Audio wearable such as headphones, comprising at least one microphone, speakers and preferably processing means, wherein the audio wearable implements the method according to any of the preceding clauses.

9. Audio wearable of clause 8, being wireless audio wearable such as Bluetooth headphones,

10. Audio wearable of clause 8 or 9, comprising noise cancelling headphones. 5

Claims

Conclusions

1. Method for operating portable audio such as wireless audio earbuds, wherein the method includes the steps of!

a. recording ambient noise with a portable audio microphone;

b. communicating the ambient sound to processing means, wherein the processing means are part of the portable audio and/or an audio carrier connected to the portable audio, such as a smartphone;

c. where processing tools are used to perform the steps of: processing the ambient sound for speech recognition;

i. identifying the start of a conversation in the processed ambient noise:

iii. in response to said identification, changing an operational mode of the portable audio such that a transmission of information associated with said call initiation is enhanced.

The method of claim 1, wherein the operational mode is changed from playing audio such as music to pausing the audio, or continuing to play audio at a lower volume, with the audio being played through speakers of the portable audio.

3, Method according to claim 1 or 2, wherein the said change in operational speed is accompanied by an audible warning signal.

A method according to claim 2 or 3, wherein the operational mode is further changed to repeat the last 10 seconds or less of the recorded ambient sound through speakers of the portable audio, preferably the last 5 seconds or less.

5. Method according to claim 4, wherein only part of the ambient sound that comprises speech is repeated.

5. Method according to claim 4 or 5, wherein the ambient sound is repeated at an increased speed, 6

A method according to any one of the preceding claims, wherein the portable audio is activated in a noise-canceling mode at least prior to the step of changing the operational mode of the portable audio.

8. Portable audio such as audio earphones, comprising at least one microphone, speakers and preferably processing means, whereby the portable audio. the method . implements according to one of the preceding claims,

9. Portable audio according to claim 8, being wireless portable audio such as Bluetooth audio earphones.

10. Portable audio according to claim 8 or 9, consisting of audio earplugs with noise suppression. 7