DE102021204665A1 - SYSTEM AND METHOD FOR DETERMINING THE TYPE OF AN AUDIO OUTPUT DEVICE - Google Patents

Abstract

Method performed by a processor of an audio source device. The method controls an audio output device of the audio source device in order to output a sound with an audio output signal. The method receives a microphone signal from a microphone of the audio source device, wherein the microphone signal detects the output sound. The method determines whether the audio output device is headphones or a speaker based on the microphone signal and configures a sound dosimetry process based on the determination.

Description

CROSS REFERENCE TO RELATED APPLICATION

This application claims the benefit and priority of the preliminary, filed on May 14, 2020 U.S. Patent Application No. 63 / 025,026 which is hereby incorporated by reference in its entirety.

AREA

One aspect of the disclosure relates to configuring an audio source device based on a determination of whether an audio output device is a headphone or a speaker. Other considerations are also described.

STATE OF THE ART

Headphones are an audio device that includes a pair of speakers, each of which is placed on top of a user's ear when the headphones are worn on or around the user's head. Similar to headphones, earphones (or in-ear headphones) are two separate audio devices, each having a speaker that is inserted into the user's ear. Both headphones and earphones are typically wired to a separate playback device, such as an MP3 player, which operates each of the devices' speakers with an audio signal to produce sound (e.g., music). Headphones and earphones provide a convenient method by which the user can individually listen to audio content without having to broadcast the audio content to other people who are nearby.

SHORT REPRESENTATION

One aspect of the disclosure is a method performed by an audio source device, such as a multimedia device including a microphone. The audio source device transmits an audio output signal, which may include audio content such as music desired by the user, to an audio output device for driving a speaker to output a sound. For example, the source device can transmit the signal via a wired or wireless connection with the output device. The source device receives a microphone signal from the microphone of the source device, the microphone signal picking up the sound output via the loudspeaker of the output device. The source device determines whether the output device is headphones (e.g., headset) or a speaker, and based on that determination, configures an acoustic dosimetry process.

In one aspect, the determination may be based on how much of the output sound is included in the microphone signal. For example, the source device may process the microphone signal by performing an acoustic echo cancellation process on the microphone signal using the audio output signal as a reference input to generate a linear echo estimate that corresponds to the portion of the output signal contained in the microphone signal. The source device determines a correlation level between the audio output signal and the linear echo estimate. In some aspects, if the correlation level is above a threshold, the output device is determined to be a speaker, and if the correlation level is below the threshold, the output device is determined to be a headset.

The above summary is not intended to be an exhaustive list of all aspects of the disclosure. The disclosure is intended to encompass all practicable systems and methods from all suitable combinations of the various aspects summarized above, as well as those disclosed in the detailed description below and expressly mentioned in the claims. Such combinations may have certain advantages not specifically noted in the summary above.

Figure list

• 1A zeigt das Audiosystem, das die Quellenvorrichtung und eine Audioausgabevorrichtung einschließt.
• 1B zeigt ein Audiosystem, das die Quellenvorrichtung und einen Lautsprecher einschließt.
• 2 zeigt ein Blockdiagramm eines Audiosystems, das die Quellenvorrichtung basierend auf einem Typ einer Audioausgabevorrichtung konfiguriert.
• 3 ist ein Flussdiagramm eines Gesichtspunkts eines Verfahrens zum Konfigurieren einer Audioquellenvorrichtung basierend auf einem Typ einer Audioausgabevorrichtung.

The aspects are illustrated in an exemplary and non-restrictive manner in the representations of the accompanying drawings, in which like reference characters indicate like elements. It should be noted that references to "a" aspect of this disclosure do not necessarily refer to the same aspect, and they mean at least one aspect. Additionally, in the interests of brevity and reducing the total number of figures, a given figure may be used to illustrate the features from more than one point of view, and all of the elements in the figure may not be required for a given point of view.

• 1A Figure 10 shows the audio system including the source device and an audio output device.
• 1B Figure 11 shows an audio system including the source device and a speaker.
• 2 FIG. 13 shows a block diagram of an audio system that the source device is based on configured to a type of audio output device.
• 3 Figure 4 is a flow diagram of one aspect of a method of configuring an audio source device based on a type of audio output device.

DETAILED DESCRIPTION

Several aspects of the disclosure will now be explained with reference to the accompanying drawings. In cases where the shapes, relative positions, and other aspects of the parts described in a given aspect are not clearly defined, the scope of the disclosure herein is not limited to only the parts shown, which are provided for the purpose of illustration only. Additionally, while numerous details are set forth, it should be understood that some aspects can be practiced without those details. In other instances, well known circuits, structures, and techniques have not been shown in detail in order not to obscure the understanding of this description. Furthermore, unless the meaning is clearly to the contrary, all ranges set forth herein are considered to be inclusive of the endpoints of each range.

Sound dosimetry measures audio exposure over a period of time (e.g., an hour, day, week, month, etc.) to provide a cumulative value for audio exposure (e.g., a sound pressure level (SPL)) . For example, a listener can be supplied with audio content (for example music) desired by the user via an audio output device, such as headphones, which are worn by a listener. Sound dosimetry can also refer to the measurement of a listener's exposure to ambient noise. To measure ambient noise, an electronic device (e.g. an SPL meter) captures the noise (e.g. using a microphone) that is in close proximity to a listener and outputs an SPL reading (e.g. using a microphone) E.g. by displaying the reading on a display screen of the SPL meter).

It has been shown that prolonged exposure to loud noises can cause hearing loss (e.g., noise-induced hearing loss (NIHL)). NIHL is attributed to damage to the microscopic hair cells in the inner ear caused by high levels of noise. For example, prolonged exposure to noise at or above 85 dB can cause temporary or permanent hearing loss in one or both ears. Therefore, some organizations (e.g. the National Institute for Occupational Safety and Health (NIOSH) have recommended that workers' exposure to noise should be kept below 85 dBA for eight hours to minimize NIHL in the workplace.

Electronic headphones have become increasingly popular with users because they reproduce media such as music, podcasts, and movie soundtracks with high fidelity while not interfering with others in the vicinity. The World Health Organization (WHO) recently established safety standards for hearing protection, according to which the maximum sound output from headphones is limited to 85 dBA. To meet this standard, a sound dosimetry process (e.g. performed within the headphones or other electronic device coupled to the headphones) can monitor an in-ear SPL on the headphones and notify (or warn a user) ) if the noise level exceeds this threshold. In particular, the sonic dosimetry process measures or estimates the in-ear SPL, e.g. B. at or near an eardrum reference point during sound reproduction. In one aspect, the in-ear SPL is measured as follows. The signal from an internal microphone of the headphones, which picks up all noise in the ear canal, can be processed into an equivalent SPL using, for example, laboratory calibration results, the correction factors, e.g. Equalization applied to the microphone signal. These correction factors can take into account an occlusion effect in which the headphones at least partially close the ear canal of the user. The in-ear SPL can be determined during playback via the headphones worn by the user. After the estimation, the in-ear SPL is converted to a sound sample that has units defined by the hearing protection standards described herein. These sound samples can then be used by the dosimetry process to track audio exposure from the headphones. However, this conversion of the in-ear SPL into sound samples may be superfluous if the sound is in the environment, e.g. B. is played over a loudspeaker. Therefore, it may be necessary to determine the type of audio output device through which a listener will hear the sound in order to properly configure a dosimetry process (e.g., to convert in-ear SPL values if the output device is headphones).

To overcome these shortcomings, the present disclosure describes an audio system that is capable of configuring a dosimetry process based on determining whether the listener is hearing the sound through headphones or a speaker. In particular, the audio system an audio output device that transmits an audio output signal to an audio output device to drive a speaker and output sound. A microphone signal is obtained from a microphone in the source device which picks up the output sound. The audio system determines whether the audio output device is headphones or a speaker based on the microphone signal. A sound dosimetry process is configured based on the determination. For example, if the audio output device is determined to be headphones, the process is configured to take sound level measurements associated with use of the headphones. In contrast, after determining that the audio output device is a loudspeaker, the process is configured such that the sound level measurement is associated with the ambient noise. Thus, the audio system is able to provide accurate sound level measurements and notifications based on the type of audio output device that is outputting the sound.

1A illustrates an audio system 1 , which is an audio source device 2 and an audio output device 3 that is worn by a user (or wearer). In one aspect, the audio system may include other devices such as a remote electronic server (not shown) that may be communicatively coupled to either the headset or the audio source device and configured to perform one or more acts as described herein. As illustrated, the output device is a headset, which is an electronic device adapted to be worn on a user's head and which is arranged to direct the sound into the wearer's ears. In particular, the headphone, as illustrated in this figure, is a pair of earphones (in-ear headphones or earplugs), only the right earphone being shown, which is positioned on the right ear of the user. In one aspect, the headphones can include two earphones (left and right) or can include one earphone. According to some aspects, the earphones can be a sealing headphone that has a flexible ear tip that serves to acoustically seal off the entrance of the user's ear canal from the environment by blocking or occluding the ear canal. In another aspect, the headphone can be an over-the-ear headset (or headphones) that at least partially covers a corresponding ear of the user. In some aspects, the output device is an earphone. In another aspect, the output device may be any electronic device that includes at least one speaker and is arranged to be worn by the user and to output sound.

The audio source device 2 is a multimedia device, especially a smartphone. In one aspect, the audio source device may be any electronic device that can perform audio signal processing and / or network operations. Such a device can be, for example, a tablet computer, a laptop, a desktop computer, an intelligent loudspeaker and so on. In one aspect, the source device can be a portable device such as a smartphone as illustrated in this figure. In another aspect, the source device may be a head-worn device such as smart glasses or a wearable device such as a smart watch.

As shown is the audio source device 2 with the audio output device 3 via a cable connection 4th communicatively coupled. In particular, the cable connection can consist of one or more wires which are permanently coupled to (or integrated with) the audio output device and are detachably connected to the source device. In one aspect, the cable connection can be detachably coupled to each of the devices. In another aspect, the cable connection may be an analog cable connection via a connector, such as a 3.5 mm media jack that plugs into a jack of the audio source device. Once connected, the audio source device can be configured to drive the speakers of the output device with one or more audio output signals so that the output device reproduces the sound. In this case, the audio output signals can be analog audio signals that are sent to the output device (via the cable connection 4th ) can be output. According to another aspect, the cable connection can be a digital connection via a connector, such as a USB (Universal Serial Bus) connector, in which one or more audio signals are digitally transmitted to the audio output device for playback.

1B Fig. 10 shows the audio system that the audio source device 2 and an audio output device 5 includes. As illustrated, the audio output device is a speaker 5 which is arranged in such a way that it emits the sound into the (surrounding) environment. In one aspect, the audio output device can be any electronic device that which is arranged in such a way that it emits the sound to the environment. For example, the output device 5 Be part of a standalone loudspeaker, smart loudspeaker, home theater system, or infotainment system integrated into a vehicle. For example, it can be in the case of the output device 5 be at least one loudspeaker that is part of an audio system, such as a home theater system or an infotainment system, as described herein. In one aspect, the output device can 5 Include one speaker or more than one speaker. Similar to in 1A are the audio source device and the audio output device 5 than via a wired connection 4th shown communicatively coupled which, as described herein, may be an analog or digital connection.

In one aspect, the audio source device can 2 with either the audio output device 3 or 5 via a wireless connection instead of (or in addition to) the wired connection 4th be communicatively coupled. In particular, in 1A the audio source device 2 with the audio output device 3 paired over a wireless connection to form the audio system configured to output sound. For example, the source device may be configured to wirelessly connect to the output device via a wireless communication link (e.g., via a BLUETOOTH protocol or any other wireless communication protocol). During the established wireless communication link, the source device can exchange data packets (e.g., Internet Protocol (IP) packets) with the output device (e.g., by transmitting and receiving). More about establishing a wireless communication link and exchanging data is described herein.

In one aspect, an audio source device (such as device 2 ) be able to identify an audio output device with which it is paired (e.g., communicatively coupled). For example, once both devices are paired, the output device may transmit device data to the audio source device that includes identification information, such as the type of electronic device. In some cases, however, the audio output device may be unable to convey the information or may not include the capabilities (or electrical components such as memory, one or more processors, etc.) to convey such information. For example, the loudspeaker 5 no information transmitted because the analog cable connection 4th can only be arranged for passing through (e.g. for the loudspeaker for receiving and / or transmitting) analog audio signals. As another example, the output device may include the capabilities (e.g., communication) to convey such information, but may not be able to convey it for various reasons (e.g., such information may be inaccessible to the device) . To overcome these shortcomings, the present disclosure provides an audio system that is capable of determining the type of audio output device that is part of the audio system (e.g., whether the device is headphones or a speaker ). How this determination is made is further described herein.

2 Figure 3 shows a block diagram of an audio system 1 that the audio source device 2 configured based on whether an audio output device 15th is a headphone or speaker. The audio source device includes one or more microphones 11th , an input source 12th , a controller 10 and a network interface 21 a. In one aspect, the audio source device may include more or fewer elements (or components) as described herein. For example, the audio source device can include at least one screen that is configured to display image data and that can include one or more speakers.

The microphone 11th can be any type of microphone (e.g. a microphone with a micro-electromechanical system (MEMS)) that is designed to absorb acoustic energy caused by a sound threshold that propagates in an acoustic environment, to convert it into a microphone input signal. The microphone 11th may be an “external” (or reference) microphone configured to capture sound from the acoustic environment, as opposed to an “internal” (or error) microphone configured to capture sound (and / or pressure changes) in the ear (or ear canal) of a user.

The input source 12th may include a programmed processor executing a media player application program; and may include a decoder that receives an audio output signal as digital audio input to the controller 10 issues. In one aspect, the programmed processor can be part of the audio source device 2 so that the media player application program is executed within the device. In another aspect, the application program may be executed on another electronic device that is paired with the audio source device. In this case, the electronic device executing the program can transmit the audio output signal (e.g., wirelessly) to the audio source device. According to In some aspects, the decoder may be able to decode an encoded audio signal that has been encoded using any suitable audio codec, such as Advanced Audio Coding (AAC), MPEG Audio Layer II, MPEG Audio Layer III, or Free Lossless Audio Codec (FLAC ). Alternatively, the input audio source can be 12th Include a codec that converts an analog or optical audio signal, such as from a line input, into digital form for control. Alternatively, there can be more than one input audio channel, such as a two-channel input, namely a left and a right channel of a stereophonic recording of a piece of music, or there can be more than two input audio channels, such as the entire soundtrack in 5.1 surround format of a movie or of a movie. In one aspect, the input source may 12th provide a digital input or an analog input.

The control 10 A special processor such as an application-specific integrated circuit (ASIC), a general-purpose microprocessor, a field-programmable gate array (FPGA), a digital signal controller or a set of hardware logic structures (e.g. filters , arithmetic-logical units and dedicated state machines). The controller is configured to perform sonic dosimetry processes, echo cancellation processes, and network operations. For example is the controller 10 configured to output an audio signal from the input source 12th to determine whether an audio output device to which the audio source device is communicatively coupled (or paired) is a headphone or a speaker, and to configure the dosimetry process based on that determination. More about the operations performed by the controller is described herein. In one aspect, those from the controller 10 operations performed are implemented in software (e.g. as instructions stored in the memory of the audio source device 2 are stored and from the controller 10 and / or can be implemented by hardware logic structures as described herein.

The audio output device 15th closes at least one loudspeaker 16 a. For example, as described herein, the audio output device may be headphones (e.g., headphones 3 , in 1A) or a loudspeaker (e.g. loudspeaker 5 , in 1B) be. In one aspect, the audio output device can 15th include more or less elements. For example, the device 15th include one or more processors that can be configured to perform audio signal processing operations, it can include one or more microphones (internal or external), and it can include a network interface. As another example, the output device can include only one speaker. In one aspect, one or more of the speakers can 16 be an electrodynamic driver that can be specially designed to output sound in certain frequency bands, such as a woofer, tweeter or mid-range speaker. In one aspect, the speaker can 16 be an electrodynamic "full-range" driver (or "full-band" driver) that reproduces the largest possible audible frequency range.

As described herein, the audio source device 2 with the audio output device 15th be paired to exchange data. For example, the audio source device 2 be a wireless electronic device configured to have a (wireless) communication link 13th (or wireless connection) via the network interface 21 with another electronic device (such as the output device 15th ) over a wireless computer network (e.g. a Wireless Personal Area Network (WPAN)) using e.g. B. the BLUETOOTH protocol or a WLAN to exchange data. In one aspect, is the network interface 21 configured to use the wireless communication link 13th with a wireless access point in order to exchange data with a remote electronic server (e.g. via the Internet). In another aspect, and as described herein, the communication link may 13th be a cable connection (e.g. via a cable that couples the two devices together). While both source devices are paired, the audio source device is configured to output the audio signal over an established communication link 13th to the audio output device 15th transferred to. The audio output device 15th controls the speaker or speakers 16 with the output signal to play the sound. Thus, the audio output device can stream and output audio signals from the source device, which may include content such as music desired by the user.

As illustrated, the controller can 10 have one or more functional blocks that have a linear echo canceller (or canceller) 17, a decision logic 19th and a sonic dosimetry 20th can include. The linear echo canceller 17th is configured to reduce (or suppress) linear echo components by estimating the echo from the audio output signal that the source device sends to the output device for playback 15th transmits. In particular, the canceller performs an acoustic echo cancellation process on a microphone signal Using the audio output signal as the reference input to generate the linear echo estimate, which is an estimate of how much des (from the speaker 16 output) audio output signal in that from the microphone 11th generated microphone signal is included. The suppressor defines a linear filter 18th (e.g. a finite impulse response (FIR) filter) and applies the filter to the audio output signal to produce the estimate of the linear echo. In one aspect, the filter is linear 18th a standard filter stored in the memory of the (control of the) source device 2 is stored. According to another aspect, the filter is made by measuring an impulse response on the microphone 11th certainly. For example, the audio source device can be the speaker 16 control the output device to output a sound. In response to the sound, the microphone generates a microphone signal from which the impulse response is measured, which is a transmission path between the loudspeaker 16 and the microphone 11th represents.

The oppressor 17th receives a microphone signal from the microphone 11th is produced. In one aspect, the microphone signal is generated in response to the reproduction of the audio output signal by the speaker 16 the audio output device 15th generated. Thus, the microphone signal can be tones (e.g. echo) of the tones output by the loudspeaker 16 included, along with other tones. The oppressor 17th subtracts the from the filter 18th generated linear echo estimate from the microphone signal to generate an error signal to remove the echo (in whole or in part). The oppressor 17th uses the error signal to set the filter 18th to update, whereby the difference between the microphone signal and the error signal can be reduced.

The decision logic 18th is configured to be used by the suppressor 17th generated linear echo estimate and the audio output signal from the input source 12th and configured to determine whether the audio output device 15th is a headphone or speaker. In particular, the decision logic determines the correlation level between the linear echo estimate and the audio output signal. For example, the decision logic determines whether there is sufficient correlation between the echo estimate and the microphone signal. According to one aspect, there is sufficient correlation when a correlation level between the estimate and the signal is above a threshold value. When the microphone signal is above a threshold, which means that the microphone signal contains at least part of the audio output signal coming from the speaker 16 is output, the decision logic determines that the output device 15th is a speaker. The correlation level above a threshold is due to the sound being emitted into the surrounding area. However, if the correlation level is below the threshold, the decision logic determines that the output device is headphones, as this may mean that the output device is not outputting any sound to the environment. In one aspect, the threshold values can be different. For example, the determination of whether the output device is a loudspeaker may be based on the correlation level being above a first threshold, while the determination of whether the output device is a headphone may be based on the correlation level being below a second threshold that is below the first threshold.

The sound dosimetry 20th is configured to receive a signal from the decision logic 19th to get the type of audio output device 15th that is paired with the audio source device, and is configured to perform a sound dosimetry process based on the signal. In particular, upon receiving an indication that the audio output device is headphones, the sound dosimetry process is configured to perform sound level measurements associated with use of the headphones and is configured to issue notifications associated with the measurements. For example, the dosimetry process can estimate the in-ear sound pressure level, SPL, as follows. The sound dosimetry 20th can calculate a measurement of the strength of the audio output signal being played back, for example as root mean square (RMS). It should be noted that the output sound is the result of an audio rendering process that performs a conventional chain of audio processing operations on an input playback signal (which includes media such as music or a movie soundtrack). These can include adjustments of the dynamic range, equalization and gain adjustment for the volume step. The process then converts the RMS value of such output audio to an in-ear SPL by applying (and multiplying by) output sensitivity data (for the headphones in question) to the RMS value. In one aspect, the output sensitivity data can be associated data, which can include the acoustic output sensitivity of the headphones and parameters of the volume curve. These data can be stored in the audio source device 2 get saved. According to another aspect, this data can be transmitted from the audio output device. In another aspect, this data can be generic or standard data (e.g. not for a specific audio output device). For example dB full scale RMS values are converted into in-ear SPL dB values.

In one aspect, the in-ear SPL can be determined by processing a microphone signal obtained from an internal microphone of the audio output device, as described herein. According to another aspect, the in-ear SPL can be determined by processing at least one of the internal and external microphones of the audio output device.

The measured or estimated in-ear SPL is then converted into units of a hearing protection standard for audio exposure (a standard or a generally defined metric for the acceptable audio exposure for the health of the hearing). For example, the in-ear SPL can be multiplied by a transfer function (determined in a laboratory setting) that converts the in-ear SPL into an equivalent free-field or diffuse-field measurement of the sound as it would be picked up by an imaginary reference microphone that is located in some distance from the user as defined in the hearing protection standard. The result is referred to here as the calculated sound sample, for example in units of SPL dBA (A-weighted decibels).

In one aspect, the sound sample can be calculated repeatedly over time, for example every second or some other suitable interval during playback. The sound samples can then be used by an application program (which is also used by the control 10 the audio source device 2 is performed) for visualization on a graphical user interface of the audio source device (not shown). Thus, for example, a health application program can be authorized to access the locally stored health database in order to retrieve the sound samples and calculate various statistical measures of the collected sound samples, such as Leq dBA (average) over certain time intervals. The health app can then “show” the user his / her sound exposure, which can be traced back to the playback through the headphones. The health app can also visualize to the user which sections of the sound samples were generated by which apps (e.g. a music app, a video game app and a movie player), and which models of against-the-ear audio devices have which sound samples have generated. It is expected that the user will be able to use several different models of headsets for listening, such as wired in-ear earbuds, wireless in-ear earbuds and on-the-ear headphones, at different volume levels or with different media. This useful information can be monitored and reported to the user through the health app. There are other ways of reporting useful information to the user about such collected sound samples (sound dosimetry). For example, the data may be from another electronic device that is paired with the source device. As another example, the audio source device may provide a haptic or audio warning indicating audio exposure.

However, if the sonic dosimetry 20th of the decision logic 19th receives an indication that the audio output device 15th is a speaker, the sound dosimetry process is configured to make sound level measurements associated with ambient noise and is configured to issue notifications associated with the measurements. For example, the process of taking the sound level measurements receives the microphone signal that is coming from the microphone 11th the source device 2 and uses the signal to estimate the SPL of the environment. Additionally or alternatively, acoustic dosimetry may receive a microphone signal from one or more electronic devices (e.g., a portable device) associated with the source device 2 is paired. Based on the estimated SPL, the sound dosimetry 20th Issue alerts or notifications associated with the ambient noise level, such as a current SPL, as described herein.

3 Figure 12 is a flow diagram of one aspect of a method of configuring an audio source device based on whether an audio output device is headphones or a speaker. In one aspect, the process becomes 40 from (e.g. the controller 10 the) audio source device 2 and / or from the audio output device 15th carried out. Thus, with reference to FIG 2 described. The process 40 starts with that control 10 controls an audio output device of the audio source device in order to output a sound with an audio signal (at block 41 ). In particular, the controller 10 the audio source device of the network interface 21 signal that the audio output signal is to be reproduced on the output device 15th should be transferred. After the signaling, the audio output signal (via the communication link 13th ) to the audio output device 15th transmitted that uses the signal to the speaker 16 and output the tone contained in the signal. According to another aspect, when the audio output device 15th includes multiple speakers (e.g., in the case of a headphone having left and right speakers), the source device 2 output multiple audio output signals (e.g. left and right audio channels).

The control 10 receives a microphone signal from a microphone 11th the audio source device 2 , whereby the microphone signal detects the sound emitted (at block 42 ). In particular, the microphone 11th detect the output sound and in response generate a microphone signal that includes the output sound and / or ambient noise in the environment. The control 10 determines, based on the microphone signal, whether the audio output device is a headphone or a loudspeaker (at block 43 ). In particular, the (linear echo canceller 18th the) control 10 process the microphone signal by performing an acoustic echo cancellation process on the microphone signal using the audio output signal as a reference input to produce a linear echo estimate. The decision logic 19th determines whether the audio output device is a headphone or a speaker based on a correlation level between the audio output signal driving the audio output device and the linear echo estimate. The control 10 configures the sound dosimetry process based on the determination (at block 44 ). For example, the controller can 10 determine the in-ear SPL when the audio output device is headphones to monitor sound samples as described herein.

In some aspects, variations can be made to the methods described herein. For example, the specific acts of at least some of the methods need not be performed in the exact order that is shown and described. The specific operations need not be performed in an ongoing series of operations, and various specific operations may be performed according to different viewpoints. Once the sound dosimetry process is configured, the audio source device collects and stores, for example, one or more sound samples to generate cumulative data over time (e.g., a day, etc.). In one aspect, the source device may issue notifications (or alarms) from the accumulated data that display an indication of audio exposure to the user of the source device.

As described herein, one aspect of the present technology is the collection and use of data available from specific and legitimate sources to improve the health and safety of a user's hearing. The present disclosure contemplates that this collected data may, in some instances, include personally identifiable information that uniquely identifies a particular individual or can be used to identify a particular individual. This personal data can be demographic data, location-based data, online identifiers, telephone numbers, e-mail addresses, home addresses, data or records about the health or fitness level of a user (e.g. vital parameter measurements, medication information, training information, SPL measurements) , date of birth or other personal information.

The present disclosure recognizes that the use of such personal data in the present technology can be used for the benefit of the users. For example, the health and fitness data can be used to measure a user's audio exposure and provide a cumulative audio exposure indication according to user preferences. Accordingly, the use of such personal data enables users to conduct better listening habits.

This disclosure assumes that those entities responsible for the collection, analysis, disclosure, transfer, storage, or other use of such personal information will comply with generally established data protection guidelines and / or data protection practices. In particular, such entities are expected to establish and consistently apply privacy practices that are generally recognized as meeting or exceeding industry or government requirements for the privacy of users. This information regarding the use of personal data should be visible and easily accessible to users and should be updated with changes to the collection and / or use of data. Personal data from users should only be collected for lawful purposes. Further, such collection / sharing should only be done after obtaining user consent or any other basis established by applicable law. In addition, such entities should consider taking all necessary steps to protect and secure access to such personal data and ensure that others who have access to the personal data adhere to their data protection rules and procedures. Such entities may also submit to a third party evaluation to confirm that they are complying with commonly accepted data protection rules and practices. In addition, the policies and practices should be adapted to the particular types of personal data that is collected and / or accessed and to the applicable laws and standards, including court-specific considerations that can be used to enforce a higher standard. For example, in the United States, the collection or access to certain health information may be governed by federal and / or state laws, such as the Health Insurance Portability and Accountability Act (HIPAA); while health data in other countries may be subject to different regulations and guidelines and should be treated accordingly.

Despite the foregoing, the present disclosure also contemplates embodiments in which users selectively block the use of or access to personal data. That is to say, the present disclosure assumes that hardware and / or software elements can be provided in order to prevent or block access to such personal data. For example, as in the case of advertising delivery services, the present technology may be configured to enable users to choose, during registration for services or at any time thereafter, whether to “opt in” or decline to participate in the collection of personal data ("Opt out"). In addition to the "agree" and "reject" options, this disclosure contemplates the provision of notifications of access to or use of personal data. For example, when a user is downloading an app, they can be notified that their personal data is being accessed and then be reminded again shortly before the app accesses the personal data.

Furthermore, it is the intention of the present disclosure that personal data are managed and treated in such a way that the risk of unintentional or unauthorized access or use is minimized. Risk can be minimized by limiting the collection of data and deleting data as soon as it is no longer needed. In addition, and when needed, including in certain health-related applications, data de-identification can be used to protect a user's privacy. De-identification can be facilitated by removing identifiers, checking the amount or specificity of the stored data (e.g. collecting location data at city level instead of address level), and the way in which data is stored (e.g. aggregation of data across users), is controlled and / or by other methods such as differential data protection.

Although the present disclosure broadly covers the use of personal data to implement one or more of the different disclosed embodiments, the present disclosure also contemplates that the different embodiments can be implemented without the need for access to such personal data. That is, the various embodiments of the present technology will not become inoperable due to the absence of all or part of such personal data. For example, content can be selected and delivered to users based on aggregated non-personal data or a purely minimal amount of personal information, such as content handled only on the user's device or other non-personal information available to the content delivery services.

As previously explained, one aspect of the disclosure may be a non-transitory machine-readable medium (such as microelectronic memory, for example) having stored thereon instructions that program one or more data processing components (herein generically referred to as a processor) to perform the network operations, signal processing operations To perform audio signal processing operations and sound dosimetry operations. In other respects, some of these operations could be performed by specific hardware components that contain hardwired logic. These operations could alternatively be performed by any combination of programmed data processing components and hard-wired circuit components.

While certain aspects have been described and shown in the accompanying drawings, it should be understood that such aspects are illustrative and not restrictive of the broad disclosure, and that the disclosure is not limited to the specific constructions and arrangements shown and described as various other modifications may occur to those skilled in the art. The description is therefore to be regarded in an illustrative rather than a restrictive sense.

For example, in some aspects, this disclosure may include the language "at least one of [element A] and [element B]". This language can refer to one or more of the elements. For example, “at least one of A and B” can refer to “A”, “B”, or “A and B”. Specifically, “at least one of A and B” can refer to “at least one of A and at least one of B” or “at least one of either A or B”. In some aspects, for example, this disclosure may Include the language "[Element A], [Element B], and / or [Element C]". That language may refer to any of the Elements or any combination thereof. For example, “A, B and / or C” can mean “A”, “B”, “C”, “A and B”, “A and C”, “B and C” or “A, B and C” " relate.

QUOTES INCLUDED IN THE DESCRIPTION

This list of the documents listed by the applicant was generated automatically and is included solely for the better information of the reader. The list is not part of the German patent or utility model application. The DPMA assumes no liability for any errors or omissions.

Patent literature cited

• US 63025026 [0001]

Claims (21)

A method performed by a processor of an audio source device, the method comprising: Driving an audio output device of the audio source device to output a sound with an audio signal; Receiving a microphone signal from a microphone of the audio source device, the microphone signal detecting the output sound; Determining whether the audio output device is a headphone or a speaker based on the microphone signal; and Configure a sound dosimetry process based on the determination. Procedure according to Claim 1 wherein the determining comprises performing, using the audio output signal as a reference input, an acoustic echo cancellation process on the microphone signal to generate a linear echo estimate; and determining a correlation level between the audio output signal and the linear echo estimate. Procedure according to Claim 2 wherein if the correlation level is above a threshold, the audio output device is determined to be the speaker, and if the correlation level is below a threshold, the audio output device is determined to be the headphone. Procedure according to Claim 1 wherein the audio source device is communicatively coupled to the audio output device via a cable connection. Procedure according to Claim 1 , wherein the loudspeaker is part of an intelligent loudspeaker. Procedure according to Claim 1 wherein after determining that the audio output device is the headphones, the sound dosimetry process is configured to make sound level measurements associated with use of the headphones. Procedure according to Claim 1 wherein after determining that the audio output device is the speaker, the sound dosimetry process is configured to make sound level measurements associated with ambient noise. An audio source device comprising: a microphone; a processor; and a memory in which instructions are stored which, when executed by the processor, cause the audio source device to drive an audio output device to output a sound with an audio output signal; Receiving a microphone signal from the microphone, the microphone signal detecting the output sound; Determining whether the audio output device is a headphone or a speaker based on the microphone signal; and Configure a sound dosimetry process based on the determination. Audio source device according to Claim 8 wherein the instructions for determining whether the audio output device is a headphone or a speaker comprises instructions for performing, using the audio output signal as a reference input, an acoustic echo cancellation process on the microphone signal to generate a linear echo estimate; and determining a correlation level between the audio output signal and the linear echo estimate. Audio source device according to Claim 9 wherein if the correlation level is above a threshold, the audio output device is determined to be the speaker, and if the correlation level is below a threshold, the audio output device is determined to be the headphone. Audio source device according to Claim 8 wherein the audio source device is communicatively coupled to the audio output device via a cable connection. Audio source device according to Claim 8 , wherein the loudspeaker is part of an intelligent loudspeaker. Audio source device according to Claim 8 wherein after determining that the audio output device is the headphones, the sound dosimetry process is configured to make sound level measurements associated with use of the headphones. Audio source device according to Claim 8 wherein after determining that the audio output device is the headphones, the sound dosimetry process is configured to make sound level measurements associated with ambient noise. An article of manufacture comprising a machine readable medium having stored therein Instructions which, when executed by a processor of an audio source device, control an audio output device of the audio source device to output a sound with an audio signal; receive a microphone signal from a microphone of the audio source device, the microphone signal detecting the output sound; determine whether the audio output device is a headphone or a speaker based on the microphone signal; and configure a sound dosimetry process based on the determining. Articles of manufacture according to Claim 15 wherein the instructions for determining whether the audio output device is a headphone or a speaker comprises instructions for performing, using the audio output signal as a reference input, an acoustic echo cancellation process on the microphone signal to generate a linear echo estimate; and determining a correlation level between the audio output signal and the linear echo estimate. Articles of manufacture according to Claim 16 wherein if the correlation level is above a threshold, the audio output device is determined to be the speaker, and if the correlation level is below a threshold, the audio output device is determined to be the headphone. Articles of manufacture according to Claim 15 wherein the audio source device is communicatively coupled to the audio output device via a cable connection. Articles of manufacture according to Claim 15 , wherein the loudspeaker is part of an intelligent loudspeaker. Articles of manufacture according to Claim 15 wherein after determining that the audio output device is the headphones, the sound dosimetry process is configured to make sound level measurements associated with use of the headphones. Articles of manufacture according to Claim 15 wherein after determining that the audio output device is the headphones, the sound dosimetry process is configured to make sound level measurements associated with ambient noise.

Images