EP4565130A1 - Statistical audiogram processing - Google Patents
Statistical audiogram processingInfo
- Publication number
- EP4565130A1 EP4565130A1 EP23758758.9A EP23758758A EP4565130A1 EP 4565130 A1 EP4565130 A1 EP 4565130A1 EP 23758758 A EP23758758 A EP 23758758A EP 4565130 A1 EP4565130 A1 EP 4565130A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- data
- hearing
- sample
- user
- hearing threshold
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/12—Audiometering
- A61B5/121—Audiometering evaluating hearing capacity
- A61B5/123—Audiometering evaluating hearing capacity subjective methods
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/12—Audiometering
- A61B5/121—Audiometering evaluating hearing capacity
- A61B5/125—Audiometering evaluating hearing capacity objective methods
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/68—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient
- A61B5/6801—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient specially adapted to be attached to or worn on the body surface
- A61B5/6813—Specially adapted to be attached to a specific body part
- A61B5/6814—Head
- A61B5/6815—Ear
Definitions
- Hearing loss is a common problem caused by exposure to noise, disease, and aging. People with hearing loss may find it hard to have conversations. They may also have trouble understanding dialog in media content, enjoying music to its full extent, or efficiently interacting with systems that include user interfaces or feedback mechanisms that rely on audio (e.g., voice assistants, voice commands or controls, etc.).
- audio e.g., voice assistants, voice commands or controls, etc.
- Several types of hearing loss exist ranging from mild loss, in which a person has a reduced sensitivity to high-pitched sounds to severe hearing loss in which a person can hardly hear anything unless acoustic pressure levels are very high.
- Hearing loss comes on gradually as a person gets older. Since age-related hearing loss, also called presbycusis, is gradual, someone with presbycusis may not realize that he or she has lost some of the ability to hear low-level sounds. Hearing loss is traditionally assessed by an audiologist using professional equipment that is carefully calibrated. The assessment is performed in a sound-proof environment. The audiologist will, among other tests, determine a so-called audiogram, which describes the amount of hearing loss in decibels as a function of frequency. This process comprises measurement of an audibility threshold expressed in sound pressure levels (dB SPL) using a test signal such as a sine wave or band-limited noise signal.
- dB SPL sound pressure levels
- the audiogram, or hearing loss specified as a function of frequency is subsequently determined by computing the difference between the measured threshold of audibility and the threshold of a healthy ear.
- Accurate calibration data is required for this process to allow conversion of digital signal levels existing in a sound generator or test app (e.g., levels specified relative to a digital full-scale signal, or dB re FS) to acoustic sound pressure levels reproduced by the headphones used during an assessment.
- Fig.1 depicts an example of an audiogram estimation process by audiogram estimation system 100.
- a sound generator 110 produces a signal of a specific frequency that is reproduced on headphones to a listener (user) 10.
- the listener 10 indicates whether the signal is audible or not (in the form of a subjective response 120) to determine a threshold sound level 130 in the digital domain, expressed as dB re FS (Full Scale).
- This threshold 130 is subsequently corrected for the frequency response of the headphones and playback equipment (using calibration data 140) to compute a corresponding threshold 150 in dB SPL.
- the normal hearing level 160 at the specific frequency is subtracted to compute the hearing loss (at the specific frequency) that goes into the audiogram 170.
- the resulting audiogram may be applied in a hearing loss compensation system, such as a hearing aid or an application that applies hearing loss compensation for playback of media content (e.g., a media playback device such as a mobile phone, television, set-top-box, computer, etc.) based on audiogram data.
- a hearing loss compensation system such as a hearing aid or an application that applies hearing loss compensation for playback of media content (e.g., a media playback device such as a mobile phone, television, set-top-box, computer, etc.) based on audiogram data.
- An example of such system 200 is schematically illustrated in Fig.2.
- the system 200 receives audio content 20 corresponding to an input audio signal 210 as input, and computes, at signal level calculation block (or module) 220, signal levels of the audio input 210 in the digital domain. This process is typically performed in two or more sub bands (not shown in the figure). Subsequently, and for each sub band, hearing loss compensation gains 250 are calculated, at hearing loss compensation calculation block (or module) 230, based on the user's audiogram data 270 and the sub band digital signal levels.
- device level e.g., device playback level or volume setting
- frequency response calibration data e.g., data characterizing acoustic output relative to device level
- device calibration data 270 is essential to ensure that the digital signal levels can be converted to associated acoustic sound pressure levels prior to calculating hearing loss compensation gains 250.
- the hearing loss compensation gains 250 are applied to the (sub bands of the) audio signal 210, creating a reproduction audio signal 280 that is sent to headphones, earbuds, or a hearing aid transducer of the listener (user) 10.
- the process of acquisition of an audiogram, and setting up a hearing aid is done by an audiologist.
- Measurement of hearing loss is done in a supervised manner in laboratory conditions, providing accurate estimates of hearing loss. More recently, however, mobile device applications have been introduced that attempt to measure and compensate for hearing loss. In order to obtain accurate measurements, these apps typically require a consumer (user) to wear a limited set of headphones (e.g., headphones with known calibration data; known frequency response) in a quiet environment while running a hearing test. Similar to an assessment performed by an audiologist, the process used in mobile apps is repetitive (e.g., requiring user input in response to many discrete stimulus signals for each ear), cumbersome (e.g., difficult to follow procedure requiring substantial concentration that is prone to error) and inefficient (e.g., consumes time and associated computing related resources).
- a limited set of headphones e.g., headphones with known calibration data; known frequency response
- the process used in mobile apps is repetitive (e.g., requiring user input in response to many discrete stimulus signals for each ear), cumbersome (e.g., difficult to follow procedure requiring
- the process of assessing the hearing loss is often referred to as 'onboarding' or 'enrolment'.
- Measuring hearing loss in a consumer domain setting comes with significant challenges, for example: • Lack of supervision. In contrast to the process carried out by an audiologist, the onboarding process on a mobile device is typically unsupervised, increasing the risk of mistakes and a reduction in accuracy of the test results. • Environmental noise. Consumers may not have access to an environment that is sufficiently quiet to measure an audiogram accurately, reducing the accuracy of the measured audiogram. • Unknown playback level. Given the large number of mobile devices, the exact conversion from digital signal levels within the app to sound pressure levels produced by headphones may be subject to significant variance, introducing further inaccuracies in the estimated audiogram. • Unknown headphones frequency response.
- the present disclosure provides a method of estimating an audiogram for a user of a media playback device and a method of estimating calibration data for a media playback device, as well as corresponding apparatus, programs, and computer-readable storage media, having the features of the respective independent claims.
- a method of estimating an audiogram for a user of a media playback device may include obtaining user hearing threshold data for the user.
- the user hearing threshold data may be indicative of hearing thresholds for one or more frequencies and for one or two ears.
- the hearing thresholds in the user hearing threshold data may relate to hearing threshold measurements.
- the hearing measurements may be taken at the media playback device.
- the method may further include obtaining sample hearing threshold data.
- the sample hearing threshold data may be indicative of hearing thresholds of a sample set (e.g., population) of individuals.
- the sample hearing threshold data (statistical hearing threshold data, population hearing threshold data) may be indicative of pre-stored hearing thresholds of the sample set of individuals.
- the method may further include obtaining at least one of sample calibration data and sample noise data.
- the sample calibration data may be indicative of frequency responses of a sample set (e.g., population) of media playback devices.
- the sample noise data may be indicative of a variability of playback levels and/or a variability of user responses in a process of measuring hearing thresholds.
- the method may yet further include determining an estimate of the audiogram for the user based on the user hearing threshold data, the sample hearing threshold data, and the at least one of the sample calibration data and the sample noise data.
- the method may further include outputting the determined estimate of the audiogram and/or a set of compensation gains associated with the determined estimate of the audiogram, for example to an application capable of audio playback on the media playback device, or for transmission to another device (e.g., server or cloud-based service).
- the proposed method can correlate measurements at different frequencies and/or for different ears with each other, thereby improving accuracy of the audiogram estimation. This in particular can address deficiencies of audiogram estimation that could result from unknown device data, lack of supervision, and a less than ideal test environment.
- determining the estimate of the audiogram may be further based on normal hearing data indicative of expected hearing thresholds in the absence of hearing loss.
- determining the estimate of the audiogram may involve applying a relative weight to the user hearing threshold data and the sample hearing threshold data based on the at least one of the sample calibration data and the sample noise data.
- determining the estimate of the audiogram may be based on a Bayesian maximum a-posteriori (MAP) estimation technique.
- MAP estimation techniques provide a reliable tool for using prior knowledge (e.g., on population audiograms and population calibration data, as well as expected noise) to improve the estimation of the user’s audiogram.
- the user hearing threshold data may be indicative of hearing thresholds for a plurality of frequencies for left and right ears.
- the hearing thresholds of the user hearing threshold data may be expressed in digital signal levels of the playback device.
- obtaining the user hearing threshold data may include outputting, by the media playback device, a plurality of audio signals (audio test signals) at different frequencies (and at different sound pressure levels, e.g., gradually increasing or decreasing sound pressure levels).
- the plurality of audio signals may have different frequencies, and for each frequency, there may be one such signal for each ear.
- Said obtaining may further include receiving user input in response to the output audio signals.
- Said obtaining may yet further include generating the user hearing threshold data based on the received user input. Accordingly, the method can obtain the user’s subjective response to the audio test signals to determine the user’s hearing thresholds based on these subjective responses.
- the sample hearing threshold data may be indicative of information on audiograms for the sample set of individuals. Additionally or alternatively, the sample hearing threshold data may be indicative of a mean and a covariance of audiograms for the sample set of individuals. Additionally or alternatively, the sample hearing threshold data may be indicative of a mean and a covariance of hearing thresholds for respective frequencies and ears, for the sample set of individuals. For example, the sample hearing threshold data may be indicative of the mean and covariance of hearing threshold vectors for the sample set of individuals. Each entry of the sample hearing threshold vector may relate to a given frequency and ear. Accordingly, the sample hearing threshold vector may have dimension ⁇ 2 ⁇ ⁇ 1, where ⁇ (or ⁇ as defined below) is the number of frequencies.
- the sample calibration data may be indicative of a mean and a covariance of frequency responses for the sample set of media playback devices.
- the sample calibration data may be indicative of the mean and covariance of frequency response vectors for the sample set of media playback devices.
- Each entry of a frequency response vector may relate to a given frequency and ear.
- the frequency response vector may have dimension ⁇ 2 ⁇ ⁇ ⁇ ⁇ 1, where ⁇ ⁇ is the number of frequencies.
- the mean may be represented by a vector of dimension ⁇ 2 ⁇ ⁇ ⁇ ⁇ 1, with each entry representing the mean of the frequency responses for a respective frequency-ear pair.
- the covariance accordingly may be represented by a matrix of dimension ⁇ 2 ⁇ ⁇ ⁇ ⁇ ⁇ 2 ⁇ ⁇ ⁇ , for example.
- the method may further include receiving audio data for playback at the media playback device.
- the method may further include determining a set of compensation gains based on the determined estimate of the audiogram.
- the method may further include generating hearing optimized audio data by applying the determined set of compensation gains to the audio data.
- the method may yet further include rendering the hearing optimized audio data for playback.
- determining the set of compensation gains may be further based on the received audio data.
- the first sample hearing threshold data may be indicative of hearing thresholds for a first sample set of individuals and associated with a given device type.
- the method may further include obtaining second sample hearing threshold data.
- the second sample hearing threshold data may be indicative of hearing thresholds for a second sample set of individuals different from the first sample set of individuals.
- the second sample hearing data may not be associated with given single device type.
- the second sample hearing data may include a plurality of subsets of sample hearing data, each associated with a respective device type.
- the method may yet further include determining an estimate of the calibration data based on the first sample hearing threshold data, the second sample hearing threshold data, and normal hearing data indicative of expected hearing thresholds in the absence of hearing loss.
- the method may further include obtaining user hearing threshold data of a user of the media playback device.
- the method may yet further include determining an estimate of an audiogram for the user based on the user hearing threshold data, the estimate of the calibration data, and the normal hearing data.
- the user hearing threshold data, the first sample hearing threshold data, and the second sample hearing threshold data may each be indicative of hearing thresholds for one or more frequencies and for one or two ears.
- the user hearing threshold data may be indicative of hearing thresholds for a plurality of frequencies for left and right ears. Analogous statements may apply to the first and second sample hearing threshold data. In some embodiments, the hearing thresholds of the user hearing threshold data may be expressed in digital signal levels of the playback device. In some embodiments, the second sample hearing threshold data may be indicative of information on audiograms for the second sample set of individuals. Additionally or alternatively, the second sample hearing threshold data may be indicative of a mean of audiograms for the second sample set of individuals. Additionally or alternatively, the second sample hearing threshold data may be indicative of a mean of hearing thresholds for respective frequencies and ears, for the second sample set of individuals.
- the second sample set of individuals may be selected based on at least one user attribute of the user.
- determining the estimate of the audiogram may be performed at the media playback device or at a server device in communication with the media playback device.
- the method may further include obtaining updated user hearing threshold data of the user for a second media playback device different from the media playback device, the updated user hearing threshold data indicating an updated hearing threshold for a given frequency.
- the method may further include determining an offset between a user hearing threshold at the given frequency as indicated by the user hearing threshold data and the updated hearing threshold.
- the method may yet further include determining an estimate of second calibration data for the second media playback device based on the estimate of the calibration data and the determined offset.
- the method may further include obtaining updated user hearing threshold data of the user for a second media playback device different from the media playback device, the updated user hearing threshold data indicating updated hearing thresholds for a plurality of given frequencies.
- the method may further include determining an estimate of an offset between the calibration data and second calibration data for the second media playback device, based on user hearing thresholds at the plurality of given frequencies as indicated by the user hearing threshold data, the updated hearing thresholds, the second sample hearing threshold data, and sample noise data.
- the sample noise data may be indicative of a variability of user responses in a process of measuring hearing thresholds.
- the method may yet further include determining an estimate of the second calibration data based on the estimate of the calibration data and the determined estimate of the offset.
- determining the estimate of the second calibration data may be based on a Bayesian maximum a-posteriori, MAP, estimation technique.
- the apparatus may include at least one processor and memory coupled to the processor.
- the processor may be adapted to carry out the method according to aspects and embodiments of the present disclosure.
- the memory may store instructions that when executed by the at least one processor cause the computing apparatus to carry out the method according to aspects and embodiments of the present disclosure.
- aspects of the present disclosure may be implemented via a computer program. When instructions of the computer program are executed by a processor (or computing apparatus), the processor may carry out aspects and embodiments of the present disclosure.
- a computer- readable storage medium may store the program.
- Such computer-readable storage media may include memory devices such as those described herein, including but not limited to random access memory (RAM) devices, read-only memory (ROM) devices, etc.. Accordingly, some innovative aspects of the subject matter described in this disclosure can be implemented via one or more computer-readable storage media having software stored thereon. It should be noted that the methods and systems including its preferred embodiments as outlined in the present disclosure may be used stand-alone or in combination with the other methods and systems disclosed in this document. Furthermore, all aspects of the methods and systems outlined in the present disclosure may be arbitrarily combined. In particular, the features of the claims may be combined with one another in an arbitrary manner. It will be appreciated that apparatus features and method steps may be interchanged in many ways.
- Fig.1 schematically illustrates an example of an audiogram estimation system
- Fig.2 schematically illustrates an example of a hearing loss compensation system
- Fig.3 schematically illustrates an example of an audiogram estimation system according to embodiments of the disclosure
- Fig.4 is a diagram showing examples of an average population headphones frequency response and an average population audiogram
- Fig.5 is a flowchart showing an example of a method of estimating an audiogram for a user of a media playback device according to embodiments of the disclosure
- Fig.6 is a flowchart showing an example of a method of estimating calibration data for a media playback device according to embodiments of the disclosure
- Fig.7 schematically illustrates an example of a system for determining audiograms using a cloud-based database infrastructure according to embodiments of the disclosure
- Fig.8 is a flowchart showing another example of a
- these techniques and systems combine threshold measurements and one or more additional sources of probabilistic information to reduce the error in the estimated audiogram.
- These one or more additional sources of information may include for example: • Threshold values measured at other frequencies than the frequency of which a threshold was measured for. It has been found that both headphone calibration data as well as audiogram data are not independent across frequency. This means that, for example, a threshold measurement for a frequency of 500 Hz also provides some probabilistic information or likelihood about the threshold values at other frequencies.
- Threshold values measured at one ear provide probabilistic information for hearing loss for a different ear (e.g., a right ear).
- Threshold values measured at one ear provide probabilistic information for hearing loss for a different ear (e.g., a right ear).
- Demographic data Combining threshold data with statistical population information that have similar demographic attributes (e.g., gender, age, and/or geolocation), an improved estimate of the audiogram can be obtained.
- Threshold values measured during another measurement session A user may repeat one or more measurements at a different time, or in a different environment.
- the accuracy of the resulting audiogram or estimated hearing loss can be improved.
- Threshold values measured with a different device e.g., a different mobile phone and/or different headphones or earbuds.
- the probabilistic combination of measurements across multiple devices will reduce the bias due to specific, and often unknown device calibration characteristics, improving the audiogram estimate.
- Headphone frequency response population information is not available.
- the statistical properties of the frequency responses of a population of headphones or earbuds can provide information on how their frequency responses, on average, vary and correlate with frequency. This can help to improve the accuracy of audiogram estimation.
- Population audiogram information The availability of audiogram data for a population of consumers can provide information on how audiograms correlate across frequency and across ears. This allows for a more accurate estimation of audiogram data.
- Fig.3 schematically illustrates an example of an audiogram estimation system 300 for hearing loss estimation.
- the system 300 may be suitable for estimating an audiogram for a user of a media playback device, for example in a consumer setting.
- a sound generator 310 produces a signal 315 of a specific frequency that is reproduced on headphones to a listener (user) 10.
- the listener 10 indicates whether the signal is audible or not (in the form of a subjective response 320) to determine a threshold sound level 330, for example in the digital domain, for example expressed as dB re FS (Full Scale). This is done for one or more frequencies (e.g., for a plurality of frequencies) and for one or more ears (e.g., for left and right ears). It is understood that a plurality of threshold sound levels are determined. Preferably, threshold sound levels are determined for a plurality of frequencies and for left and right ears. The obtained sound levels may be represented by or included in user hearing threshold data. An indication of hearing loss 360 of the listener 10 is determined by statistical optimization block (or module) 350, based on the user hearing threshold data.
- a threshold sound level 330 for example in the digital domain, for example expressed as dB re FS (Full Scale). This is done for one or more frequencies (e.g., for a plurality of frequencies) and for one or more ears (e.g.
- the indication of hearing loss 360 may be stored or compiled in the form of an audiogram 370 for the listener 10.
- the statistical optimization block 350 (probabilistically) combines the user hearing threshold data with statistical information 340 (e.g., sample hearing threshold data and at least one of sample calibration data and sample noise data, as described in more detail below) to improve the accuracy of the estimated audiogram 370.
- the statistical information 340 may be stored locally (e.g., on a mobile device, on a playback device, etc.) or remotely (e.g., in a distributed system, a cloud service, etc.).
- the optimization process may be performed locally or run as a cloud-based service.
- the threshold data generated by the user may contribute to the statistical information that is being collected (e.g., locally or remotely) to improve the process of estimating audiograms.
- dB re FS digital signal levels
- the mobile device and headphones (which may be jointly referred to as a playback device) used during the measurement are unknown, but that statistical information describing populations of headphones and mobile devices that consumers typically use is accessible. More specifically, it is assumed that the headphones frequency response population information (e.g., in the form of sample calibration data, as detailed below) can be characterized by a mean frequency response vector ⁇ ⁇ representing (e.g., consisting of) the mean across frequency responses h for K frequencies across two ear cups, and a frequency response covariance matrix ⁇ ⁇ using the expected value (expectation value) operator ⁇ . ⁇ .
- the headphones response population information may be given by ⁇ ,",$% ⁇ ⁇ é ⁇ h",$% ⁇ é ù ù ê ⁇ (2) (3) a population of users (e.g., in the form of sample hearing threshold data, as detailed below).
- this mean vector and covariance matrix is adjusted for at least one user attribute, e.g., adjusted for the age and/or gender of the user.
- the audiogram mean and covariance matrix are denoted by ⁇ ⁇ and ⁇ ⁇ , respectively.
- the values for ⁇ (average population headphones frequency response) and ⁇ (average population audiogram) as functions of frequency for the age band 40-60 years are visualized in the diagram of Fig.4.
- graph 410 represents values of ⁇ ⁇ and graph 420 represents values of ⁇ ⁇ .
- the playback level may vary from one mobile device (or playback device) to another and can be described by a zero-mean random variable with variance ⁇ ⁇ ⁇ .
- variability of responses if a measurement would be repeated, due to subjective rating variability can be modelled by a zero-mean random variable with variance ⁇ ⁇ ⁇ .
- These variables may be represented by or included in, for example, sample noise data, as detailed below.
- the absolute threshold in quiet for normal hearing (e.g., no hearing loss) in dB SPL is denoted by ⁇ ⁇ .
- the term 'calibration data' may be used to describe the transfer from digital signal levels to acoustic sound pressure levels, which includes both the sensitivity and frequency response of the headphones, as well as the effect of the mobile device producing electrical signals.
- a combination of a mobile device (e.g., mobile phone) and headphones may be referred to as a playback device.
- the audiogram for the listener can now be estimated from the noisy measurement data (e.g., user hearing threshold data) that was acquired with unknown device calibration data (including frequency response data).
- Fig.5 illustrates an example of a method 500 of estimating an audiogram for a user of a media playback device in line with the above considerations.
- Method 500 comprises steps S510 through S540 that may be performed at the media playback device or at a server device in communication with the media playback device.
- user hearing threshold data for the user is obtained (e.g., determined, measured). This may be done as described above with reference to Fig.1 and Fig.3.
- the user hearing threshold data may be indicative of hearing thresholds for one or more frequencies and for one or two ears.
- the user hearing threshold data is indicative of hearing thresholds for a plurality of frequencies for left and right ears.
- the user hearing threshold data may be indicative of a user hearing threshold vector (i.e., a vector of user hearing thresholds, such as vector ⁇ defined above, for example).
- the plurality of audio signals may have different frequencies, and for each frequency, there may be one such signal for each ear. Moreover, for each frequency and ear, audio signals at different level may be output to determine the threshold of the sound pressure level beyond which the audio signal is audible to the user.
- Step B Receive user input in response to the output audio signals. This user input may relate to the user’s subjective responses as to whether the user can hear respective audio output audio signals.
- Step C Generate the user hearing threshold data based on the received user input.
- sample hearing threshold data is obtained.
- the sample hearing threshold data may be statistical data indicative of hearing thresholds of a sample set of individuals. As such, the sample hearing threshold data may be indicative of or relate to pre-stored hearing thresholds of the sample set of individuals.
- the sample hearing threshold data may be indicative of information on audiograms for the sample set of individuals.
- the sample hearing threshold data may be indicative of a mean (e.g., ⁇ ⁇ as defined above) and a variance (e.g., covariance) of audiograms (e.g., ⁇ ⁇ as defined above) for the sample set of individuals.
- This mean and variance may relate to hearing thresholds for respective frequencies and ears, for set of individuals.
- the sample hearing threshold data may be indicative of the mean and variance (e.g., covariance) of hearing threshold vectors (i.e., vectors of hearing thresholds) for the sample set of individuals. Each entry of the sample hearing threshold vector may relate to a given frequency and ear.
- the sample set of individuals may be selected (e.g., compiled) based on at least one user attribute of the user. For example, the sample set of individuals may be selected based on at least one of an age, sex, or place of residence of the user.
- the user attribute may be derived from user input, for example, from other user-provided data, or from user-related data obtained from external sources.
- at least one of sample calibration data and sample noise data is obtained.
- the sample calibration data may be statistical data indicative of frequency responses of a sample set of media playback devices.
- the sample set of media playback devices may be selected (e.g., compiled) based on a device attribute, device ID, etc., of the media playback device, in some embodiments.
- the sample set of media playback devices may be selected in accordance with a headphone type of the headphones used by the user (e.g., open, closed, earbuds, cable-based, wireless).
- the sample set of media playback devices may be selected in accordance with a device type or ID or device brand, for example. In general, any known properties or attributes of the media playback device may be used to select the sample set of media playback devices.
- the sample calibration data may be indicative of a mean and a variance (e.g., covariance) of frequency responses for the sample set of media playback devices.
- the sample calibration data may be indicative of the mean and variance (e.g., covariance) of frequency response vectors (i.e., vectors of frequency responses) for the sample set of media playback devices.
- Each entry of a frequency response vector may relate to a given frequency and ear.
- the mean (e.g., ⁇ ⁇ defined above) may be represented by a vector of dimension ⁇ 2 ⁇ ⁇ ⁇ ⁇ 1, with each entry representing the mean of the frequency response for a respective frequency-ear pair.
- the covariance (e.g., ⁇ defined above) accordingly may be represented by a matrix of dimension ⁇ 2 ⁇ ⁇ ⁇ 2 ⁇ .
- the sample noise data may be statistical data indicative of a variability of playback levels (e.g., represented by ⁇ ⁇ ⁇ defined above) and/or a variability of user responses in a process of repeatedly measuring hearing thresholds (e.g., ⁇ ⁇ ⁇ defined above).
- the sample set of media playback devices may include a plurality of different media playback devices that the user might use for estimation of his audiogram in a consumer setting. It is understood that the different media playback devices may relate to different combinations of media players, mobile phones, PDAs, handhelds, etc. and headphones, earbuds, etc..
- an estimate of the audiogram for the user is determined (e.g., calculated) based on the user hearing threshold data, the sample hearing threshold data, and the at least one of the sample calibration data and the sample noise data. It is understood that determining the estimate of the audiogram may be further based on normal hearing data (e.g., ⁇ ⁇ in equation (4)) indicative of expected hearing thresholds in the absence of hearing loss.
- the expected hearing thresholds may be subtracted from the measured thresholds of the user hearing threshold data, to determine an estimate of the user’s hearing loss. Further, as indicated above, determining the estimate of the audiogram at step S540 may involve applying a relative weight to the user hearing threshold data and the sample hearing threshold data based on the at least one of the sample calibration data and the sample noise data.
- the relative weight may be determined such that for better measurement conditions (e.g., small uncertainty in device calibration (e.g., ⁇ ⁇ in equation (5)) and/or little impact from noise (e.g., ⁇ ⁇ ⁇ and/or ⁇ ⁇ ⁇ in equation (4)) the estimation of the audiogram is closer to an audiogram directly calculated from the measured user hearing thresholds (possibly corrected for by the frequency response and other calibration data (e.g., ⁇ ⁇ in equation(4))), and for worse measurement conditions is closer to the population average audiogram (e.g., ⁇ ⁇ in equation (4)).
- better measurement conditions e.g., small uncertainty in device calibration (e.g., ⁇ ⁇ in equation (5)) and/or little impact from noise (e.g., ⁇ ⁇ ⁇ and/or ⁇ ⁇ ⁇ in equation (4))
- the estimation of the audiogram is closer to an audiogram directly calculated from the measured user hearing thresholds (possibly corrected for by the frequency response and other calibration data (e.g
- the method 500 may further include a step of outputting the determined estimate of the audiogram and/or a set of compensation gains associated with the determined estimate of the audiogram, for example to an application capable of audio playback on the media playback device, or for transmission to another device.
- the Bayesian MAP estimator will work irrespectively of which frequencies are associated with index k, as long as all mean and covariance matrices are appropriately determined for the frequencies associated with measurement index k (i.e., as long as a consistent assignment of vector elements to frequency-ear pairs is used).
- Example Embodiment: Use of Estimated Audiograms for Hearing Optimization This embodiment can be readily combined with the embodiment(s) and implementations described above.
- the estimated audiogram of the user may be used for enhancing audio playback for the user, by compensating for individual hearing loss. This may be done in the same manner as described above in connection with Fig.2.
- a method for enhancing audio playback that may be performed in conjunction with method 500 described above or as a standalone method may comprise the following steps A through D.
- Step A Receive audio data for playback at the user’s media playback device.
- Step B Determine (e.g., calculate) a set of compensation gains based on the determined estimate of the audiogram. Determining the set of compensation gains may be further based on the received audio data. For example, the compensation gains may be applied in a multi- band compression framework in which the gains depend on the audiogram and the audio signal level in each frequency band.
- Step C Generate hearing optimized audio data by applying the determined set of compensation gains to the audio data (or an audio signal derived therefrom).
- Step D Render the hearing optimized audio data for playback to the user.
- Example Embodiment Use of Population Statistics Device calibration data estimation This embodiment can be readily combined with the embodiment(s) and implementations described above.
- the device calibration data ⁇ ⁇ ,9 can be estimated by evaluating and calculating the mean across all measurements ⁇ 9 performed by many users with the same device D, combined with the population average audiogram ⁇ ⁇ and normal hearing thresholds ⁇ ⁇ .
- This device calibration data ⁇ ⁇ ,9 can then be used when estimating the user’s (or any user’s) audiogram using a media playback device which is of type device ⁇ .
- Fig.6 illustrates an example of a method 600 of estimating calibration data for a media playback device in line with the above considerations.
- the calibration data may be indicative of a frequency response of the media playback device.
- Method 600 comprises steps S610 through S630 that may be performed at the media playback device or at a server device in communication with the media playback device.
- first sample hearing threshold data is obtained (e.g., retrieved from a database).
- the first sample hearing threshold data may be indicative of hearing thresholds for a first sample set of individuals and associated with a given device type.
- the first sample hearing threshold data may for example correspond to the (large) number (e.g., set) of thresholds ⁇ 9 across users for a given device D as defined above, or to the expectation value ⁇ ⁇ 9 ⁇ thereof.
- second sample hearing threshold data is obtained (e.g., retrieved from a database).
- the second sample hearing threshold data may be indicative of hearing thresholds for a second sample set of individuals different from the first sample set of individuals.
- the second sample hearing data may not be associated with given single device type.
- the second sample hearing data may include a plurality of subsets of sample hearing data, each associated with a respective device type.
- the second sample hearing threshold data may be indicative of information on audiograms for the second sample set of individuals.
- the second sample hearing threshold data may be indicative of a mean of the audiograms for the second sample set of individuals, or in other words, indicative of a mean of hearing thresholds for respective frequencies and ears, for the second sample set of individuals.
- the second sample hearing threshold data may for example correspond to the population average audiogram ⁇ ⁇ as defined above.
- the second sample set of individuals may be based on at least one user attribute of the user. This may be done for example in analogy to the selection described above in the context of step S520 of method 500.
- an estimate of the calibration data (e.g., ⁇ ⁇ ,9 ) is determined based on the first sample hearing threshold data (e.g., ⁇ 9 ⁇ ), the second sample hearing threshold data (e.g., ⁇ ), and normal hearing data indicative of expected hearing thresholds in the absence of hearing loss (e.g., ⁇ ⁇ ).
- the user hearing threshold data, the first sample hearing threshold data, and the second sample hearing threshold data may each be indicative of hearing thresholds for one or more frequencies and for one or two ears.
- user hearing threshold data is indicative of hearing thresholds for a plurality of frequencies for left and right ears.
- the method may further comprise (not shown in the figure), a step of obtaining user hearing threshold data (e.g., ⁇ 9 ) of a user of the media playback device (e.g., expressed in digital signal levels of the playback device), and a step of determining an estimate of an audiogram (e.g., ⁇ ) for the user based on the user hearing threshold data, the estimate of the calibration data, and the normal hearing data.
- user hearing threshold data e.g., ⁇ 9
- an audiogram e.g., ⁇
- the former of these steps may proceed in analogy to step S510 of method 500 described above and the latter of these steps may proceed in analogy to step S540 of method 500.
- the step of determining the estimate of the audiogram (e.g., ⁇ ) for the user may use equation (10) defined above, or equations (13) and (14) defined below. Further, as above, determining the estimate of the audiogram may be performed at the media playback device or at a server device in communication with the media playback device. Cloud-based Service and Iterative Improvements of Hearing Loss Compensation The above embodiments may be implemented in a cloud-based manner.
- a schematic overview of an example system 700 for determining audiograms using a cloud- based database infrastructure is shown in Fig.7.
- a user 710 determines digital threshold values 730, for example using a mobile app 710 (e.g., running on a playback device). This may be done in the same manner as described above in the context of Fig.3, based on the user’s subjective responses 720 to audio signals 715 generated by the playback device.
- the mobile app 710 sends the threshold values 730 and the corresponding device and/or user information 780 (e.g., device ID(s), user ID, age, and/or gender, etc.) to a central, cloud- based server 790 which collects data from multiple users.
- the cloud-based service can then estimate the device characteristics 740 for device D as well as the audiogram 770 for the user as outlined above.
- this architecture/method can be combined with the method described in the embodiment of method 500 (Example Embodiment: Combining Measurements Across Frequency and/or Across Ears).
- Clustering of device data The process of estimating device calibration data can be further improved by using two or more devices D to compute ⁇ ⁇ ,9 as long as there is confidence that the two or more devices have similar characteristics.
- Clustering can be applied for devices that have similar characteristics, for example using k-means or multivariate Gaussian mixture models, or other clustering techniques based on similarity of measurement data acquired for that device.
- headphones type earbuds, over-ear or on-ear headphones
- Example Embodiment User Switching to Different Headphones
- This example embodiment considers the use case of a user having gone through enrolment and measurement of an audiogram on headphones D1 (or, in general, device configuration D1) resulting in threshold data ⁇ 9 ⁇ and is now using the same process on different headphones D2 (or, in configuration D2).
- the calibration data associated with the devices have not changed, but the calibration data associated with the headphones may have changed.
- new calibration data needs to be acquired.
- One way is to use the method as described in the preceding example embodiment (Example Embodiment: Use of Population Statistics), where a cloud-based system is able to provide calibration data for the new headphone D2.
- the user can go through a reduced test with a limited number of frequencies for which new thresholds will be assessed, from which new calibration data will be derived.
- Fig.8 illustrates an example of a method 800 of estimating calibration data for a media playback device in line with the above considerations.
- the calibration data may be indicative of a frequency response of the media playback device (including a specific headphone).
- Method 800 comprises steps S810 through S830 that may be performed at the media playback device or at a server device in communication with the media playback device. Steps S810 through S830 of method 800 may be performed subsequent to the steps of method 600, or as a standalone method.
- updated user hearing threshold data of the user is obtained for a second media playback device (e.g., media playback device with headphones D2) different from the media playback device (e.g., media playback device with headphones D1).
- a second media playback device e.g., media playback device with headphones D2
- the media playback device e.g., media playback device with headphones D1
- the updated user hearing threshold data may indicate an updated hearing threshold for a given frequency (e.g., ⁇ 9 ⁇ ,”,$).
- an offset e.g., scalar offset d
- a user hearing threshold e.g., ⁇ 9 ⁇ ,",$
- the updated hearing threshold e.g., ⁇ 9 ⁇ ,",$
- an estimate is determined of second calibration data for the second media playback device based on the estimate of the calibration data (e.g., ⁇ ⁇ ,9 ) and the determined offset (e.g., scalar offset d), for example by adding the determined offset to the estimate of the calibration data.
- the updated user hearing threshold data at step S810 may indicate updated hearing thresholds for a plurality of given frequencies.
- the estimate of the offset between the calibration data and second calibration data for the second media playback device may be determined based on user hearing thresholds at the plurality of given frequencies as indicated by the user hearing threshold data, the updated hearing thresholds, the second sample hearing threshold data, and sample noise data.
- the sample noise data may be indicative of a variability of user responses in a process of measuring hearing thresholds.
- an estimate of the second calibration data may again be determined based on the estimate of the calibration data and the determined estimate of the offset. Determining the estimate of the second calibration data may be based on a Bayesian MAP estimation technique, as described above.
- Calibration Inference for Hearing Optimisation Problem Part of a hearing optimization solution is an onboarding step in which hearing levels (HL) at different frequencies (in some embodiments, 11 or 17 data points, for example) are measured to produce an audiogram.
- HL hearing levels
- Conventional audiogram tests require calibrated equipment in order reproduce test tones at specific levels, thus in order to reproduce a test with a device such as a mobile phone, response characteristics of both earphone and mobile phone must be known (i.e., device specific calibration data needs to be known).
- “calibration” may refer to (1) the sound pressure level (SPL) a mobile phone and earphone (e.g., jointly referred to as playback device) produces for a given signal level (e.g., as specified at the OS/application level) and (2) the frequency response of the mobile phone and earphone. It is not feasible to measure every mobile phone and earphone on the market, so a solution must be calibration free. Notably, an audiogram does not include any aspect of device calibration, but only measured hearing levels for a user. Test results that include device calibration will be referred to as “audiogram + calibration” in the present disclosure.
- Fig.9 is a diagram showing an example of a comparison of an audiogram for a known device (graph 910) and audiogram + calibration for a new device (graph 920) as functions of frequency.
- the following solutions S1 through S4 may relate to the example embodiments and their implementations described above, as the skilled person will appreciate. S1.
- a reduced test can be performed. By testing at a single frequency that was tested on a known device, a calibration offset can be generated between the known and the new devices. This allows us to use the previous “audiogram + calibration” for the new device.
- Information identifying a device such as Bluetooth device IDs, can be used when available to identify the device for which the updated test applies.
- Fig.10 is a diagram showing an example of a comparison of an audiogram for a known device (graph 1010) and audiogram + calibration for a new device with SPL recalibration (graph 1020) as functions of frequency. S2.
- Solution for separating SPL calibration and audiogram The method in S1 does not allow to separate the “audiogram + calibration” results into earphone + mobile calibration and the audiogram (i.e., it is not possible to derive separate device pair compensation data and audiogram data from S1).
- a Bayesian Inference model can be built to enable gradual estimation of model output using update rules as more information becomes available. As more and more users switch between devices and perform update tests, the Bayesian Inference model incorporates the information to update SPL calibration for a given device. This information can be disseminated to users who have not or not yet performed updated tests.
- S3. Solution for SPL calibration and frequency response The method in S2 allows separation of SPL calibration and audiogram + device frequency response.
- Fig.11 is a diagram showing an example of a comparison of an audiogram for a known device (graph 1110), audiogram + calibration for a new device with SPL and response recalibration (graph 1120), and the device response (graph 1130) as functions of frequency. S4.
- Fig.12 is a diagram showing an example of a comparison of an audiogram for a known device (graph 1210), audiogram + calibration for a new device with SPL and response recalibration (graph 1220), the device response (graph 1230), and a variant of the device response (graph 1230) as functions of frequency.
- Initial Onboarding A full audiogram test is performed (e.g., all frequencies are tested for left and right ears (L & R)). The measured hearing levels are then split up into SPL calibration and for each frequency an audiogram value (hearing level) and a device response value. Each value is assigned a probability (e.g., gaussian or other) distribution. If the device is known, the known response and SPL can be used. Associated probability distributions may be narrow in this case. If the device is not known, the device response may be flat and a default SPL value can be used. Associated probability distributions are wider, making updates more likely to change the split between audiogram and calibration. Using Bayesian Inference to Update Audiogram and Calibration Onboarding establishes an audiogram and device calibration and associated confidences.
- a probability e.g., gaussian or other
- the device characteristics may or may not be known. If they are known, there is high confidence in the device calibration, and low confidence (broad probability distributions) if they are not. Bayesian Inference can be used to update probability distributions for the audiogram and calibration points for both the old and new device. As more points are tested, this allows the model to become more certain about what portion of the test value should be assigned to the old/new device calibrations and what should be assigned to the audiogram. It is important to note that probability distributions for device calibration can be updated based on data from many users, allowing much quicker updating of device characteristics.
- Device Clustering As more and more users perform update tests, the model will be able to see trends in the data for the same device model identifier. Clustering within device identifiers allows the model to infer device variations caused by differences in manufacturing or other causes. As a user performs more test updates, the model can become more certain about which cluster their device belongs to, allowing more accurate updating of device characteristics. Advantages In addition to any advantages described above, techniques according to the present disclosure can have the following advantages: • Calibration (e.g., measurement of every device SPL output and frequency response) is no longer required. The proposed technique can operate on any ear device, known or unknown. This simplifies both user onboarding and development of a hearing optimisation solution. • The proposed techniques can readily build a library of device responses and calibrations.
- apparatus 1300 comprises a processor 1310 and a memory 1320 coupled to the processor 1310.
- the memory 1320 may store instructions for the processor 1310.
- the processor 1310 may also receive, among others, suitable input data 1330 (e.g., statistical information, hearing thresholds, subjective responses from a user, etc.), depending on use cases and/or implementations.
- the processor 1310 may be adapted to carry out the methods/techniques described throughout the present disclosure (e.g., method 500 of Fig.5, method 600 of Fig.6, method 800 of Fig.8) and to generate corresponding output data 1340 (e.g., an estimate of an audiogram for the user, hearing loss compensated reproduction audio signals, etc.), depending on use cases and/or implementations. It is understood that the present disclosure further relates to corresponding computer programs and computer-readable storage media storing such computer programs. Interpretation Aspects of the systems described herein may be implemented in an appropriate computer- based processing network environment (e.g., standalone playback device, server or cloud environment) for processing digital data.
- corresponding output data 1340 e.g., an estimate of an audiogram for the user, hearing loss compensated reproduction audio signals, etc.
- Portions of the system may include one or more networks that comprise any desired number of individual machines, including one or more routers (not shown) that serve to buffer and route the data transmitted among the computers.
- a network may be built on various different network protocols, and may be the Internet, a Wide Area Network (WAN), a Local Area Network (LAN), or any combination thereof.
- WAN Wide Area Network
- LAN Local Area Network
- One or more of the components, blocks, processes or other functional components may be implemented through a computer program that controls execution of a processor-based computing device of the system.
- the various functions disclosed herein may be described using any number of combinations of hardware, firmware, and/or as data and/or instructions embodied in various machine-readable or computer-readable media, in terms of their behavioral, register transfer, logic component, and/or other characteristics.
- Computer-readable media in which such formatted data and/or instructions may be embodied include, but are not limited to, physical (non-transitory), non-volatile storage media in various forms, such as optical, magnetic or semiconductor storage media.
- embodiments may include hardware, software, and electronic components or modules that, for purposes of discussion, may be illustrated and described as if the majority of the components were implemented solely in hardware.
- the electronic-based aspects may be implemented in software (e.g., stored on non-transitory computer-readable medium) executable by one or more electronic processors, such as a microprocessor and/or application specific integrated circuits (“ASICs”).
- ASICs application specific integrated circuits
- the systems, blocks, or modules described in the context of Fig.1, Fig.2, Fig.13, Fig.7, or Fig.13 above can include one or more electronic processors, one or more computer-readable medium modules, one or more input/output interfaces, and various connections (e.g., a system bus) connecting the various components.
- various connections e.g., a system bus
- a method for estimating a hearing threshold for a first user of a media playback device comprising: obtaining user hearing threshold data corresponding to a first user (In some embodiments, a set of hearing threshold measurements for one or two ears of a user corresponding to one or more frequencies (e.g., thresholds expressed in digital signal levels)); obtaining population hardware data corresponding to a plurality of media playback devices (In some embodiments, hardware data includes data characterizing a population of listening devices (e.g., headphones, hearing aids, speakers, etc.) and media playback systems (e.g., mobile phones, televisions, etc.), data identifying a distribution of listening device and/or media playback device models, types, brands, etc.); obtaining population hearing threshold data corresponding to a plurality of second users (In some embodiments, hearing threshold data includes data characterizing the hearing thresholds of a population of people (e.g., a population corresponding to a set of demographic characteristics)); and determining an estimated audiogram for the first user based on: the user
- EEE2 The method of EEE1, wherein the user hearing threshold data includes hearing threshold measurements expressed in digital signal levels (e.g., dB re FS) for two ears (e.g., left and right) for a plurality of frequencies (e.g., 2 frequencies, 11 frequencies, 17 frequencies, etc.).
- obtaining user hearing threshold data includes: at a media playback device: outputting a plurality of audio signals (e.g., outputting audio tones or signals corresponding a plurality of frequencies though headphones connected to the media playback device); and receiving user input corresponding to respective audio signals of the plurality of audio signals (e.g., user input indicating perception of a particular audio signal); and wherein, the user hearing threshold data is based on the data corresponding to the received user input.
- EEE4 The method of any of EEE1-EEE3, wherein the user hearing threshold data is obtained from at least one of: memory of the media playback device storing application data; and a server in communication with the media playback device via one or more networks.
- EEE1-EEE4 wherein the population hardware data includes statistical information describing frequency response and associated covariance of a population of listening devices and media playback devices (e.g., devices typically in use by consumers).
- EEE6 The method of any of EEE1-EEE5, wherein the population hardware data includes a mean frequency response vector corresponding to a mean of frequency responses for a plurality of frequencies.
- EEE7 The method of any of EEE1-EEE6, wherein the population hearing threshold data includes statistical information describing audiograms of a population people (e.g., audiograms corresponding to a demographically related population of people or media playback device users).
- EEE8 The method of any of EEE1-EEE4, wherein the population hardware data includes statistical information describing frequency response and associated covariance of a population of listening devices and media playback devices (e.g., devices typically in use by consumers).
- EEE6 The method of any of EEE1-EEE5, wherein the population hardware data includes a mean frequency response vector corresponding to
- the population hearing threshold data includes a mean audiogram data (e.g., a mean vector) and corresponding covariance data (e.g., a covariance vector).
- EEE9 The method of EEE8, wherein the population hearing threshold data is adjusted based on at least one of: age (e.g., an age or age range, an age threshold, a hearing age, etc.) and a gender of the first user.
- age e.g., an age or age range, an age threshold, a hearing age, etc.
- obtaining population hearing threshold data includes: receiving user input corresponding to self-identified demographic data (e.g., user input indicating an age or age range, a gender, a location, an occupation, etc.); and wherein, the population hearing threshold data is based on data corresponding to the received user input.
- self-identified demographic data e.g., user input indicating an age or age range, a gender, a location, an occupation, etc.
- the population hearing threshold data is based on data corresponding to the received user input.
- determining an estimated audiogram is performed according to a Bayesian maximum a-posteriori (MAP) estimation technique.
- MAP Bayesian maximum a-posteriori
- EEE1-EEE14 further comprising: receiving audio for playback at the media playback device; determining a set of gains based on the estimated audiogram; generating hearing optimized audio by applying the set of gains to the audio for playback; and causing playback of the hearing optimized audio by the media playback device.
- EEE16 The method of any of EEE1-EEE15, further comprising: providing data representing the estimated audiogram or compensation gains associated with the estimated audiogram to an application on the media playback device (e.g., a media player app, a communication app, a game, etc.).
- EEE1-EEE16 further comprising: transmitting data representing the estimated audiogram or compensation gains associated with the estimated audiogram to another device (e.g., a server or device different from the media playback device).
- another device e.g., a server or device different from the media playback device.
- EEE18 The method of any of EEE1-EEE17, further comprising: generating a set of personalized compensation gains based on the estimated audiogram and data representing a personalizer head related transfer function; and generating personalized hearing compensated audio by applying the set of personalized compensation gains to received audio for playback.
- EEE19
- a method for estimating device calibration for a first media playback device comprising: obtaining device hearing threshold data associated with a first plurality of users and a device type; obtaining population hearing threshold data corresponding to a second plurality of users (In some embodiments, population hearing threshold data includes data characterizing the hearing thresholds of a population of people (e.g., a population corresponding to a set of demographic characteristics, a population representative of the demographics of a device userbase or geographic area, etc.)); and determining estimated device calibration data based the device hearing threshold data, the population hearing threshold data, and audiogram data representing normal hearing (e.g., data based on an audiogram indicating no hearing loss). EEE20.
- the method of EEE1 further comprising: obtaining user hearing threshold data corresponding to a first user (in some embodiments, a set of hearing threshold measurements for one or two ears of a user corresponding to one or more frequencies (e.g., thresholds expressed in digital signal levels)); and determining an estimated audiogram for the first user based on: the user hearing threshold data; the estimated device calibration data, and audiogram data representing normal hearing (e.g., data based on an audiogram indicating no hearing loss).
- EEE21 The method of any of EEE19-EEE20, wherein the device hearing threshold data includes a plurality of hearing threshold vectors associated with a device type and representing digital levels for a plurality of frequencies.
- EEE19-EEE21 wherein the device type defined in part by at least one of: a device model (e.g., a phone model such as iPhone 13); a Bluetooth identification value; a device brand; a device form factor (e.g., mobile phone, hearing aid, VR/AR headset, etc.); and an application (e.g., a gaming system).
- a device model e.g., a phone model such as iPhone 13
- a Bluetooth identification value e.g., a device brand
- a device form factor e.g., mobile phone, hearing aid, VR/AR headset, etc.
- an application e.g., a gaming system.
- EEE23 The method of any of EEE19-EEE22, wherein the population hearing threshold data includes statistical information describing audiograms of a population of media playback devices users (e.g., audiograms corresponding to a demographically related population of users).
- EEE24 The method of any of EEE19-EEE21, wherein the device
- EEE19-EEE23 wherein the population hearing threshold data includes a mean audiogram data (e.g., a mean vector) and a corresponding covariance (e.g., a covariance vector).
- EEE25 The method of EEE24, wherein the population hearing threshold data is adjusted based on at least one of age (e.g., an age or age range, a hearing age, etc.) and a gender of the first user.
- EEE26 The method of any of EEE19-EEE25, wherein determining an estimated device calibration data is performed by a media playback device.
- EEE27 The method of any of EEE19-EEE25, wherein determining an estimated device calibration data is performed by a media playback device.
- EEE19-EEE26 wherein determining an estimated device calibration data is performed by server device in communication with a media playback device (e.g., a remote server, (e.g., a remote server, a companion device, etc.).
- a media playback device e.g., a remote server, (e.g., a remote server, a companion device, etc.).
- EEE28 The method of any of EEE19-EEE27, wherein device type and data corresponding to the population hearing threshold data are received from a plurality of second media playback devices.
- EEE29 The method of any of EEE19-EEE26, wherein determining an estimated device calibration data is performed by server device in communication with a media playback device (e.g., a remote server, (e.g., a remote server, a companion device, etc.).
- EEE19-EEE28 further comprising: receiving demographic data (e.g., age, gender, user ID, geographic area, etc.) from a plurality of second media playback devices in response to user input; and wherein, determining estimated device calibration data is further based on a subset of the received demographic data.
- demographic data e.g., age, gender, user ID, geographic area, etc.
- EEE19-EEE29 further comprising: generating updated estimated device calibration data for a second media playback device by: obtaining updated user threshold data corresponding to a single frequency (e.g., threshold generated with a different device (e.g., headphone) than was used to determine the estimated device calibration data); and determining an offset between values of the estimated device calibration data corresponding to the single frequency and the updated user threshold data corresponding to the single frequency; and determining the updated estimated device calibration data by applying the offset to data corresponding to each frequency represented in the estimated device calibration data.
- EEE31 The method of EEE30, further comprising: using a Bayesian MAP estimator to optimize the offset using additional measurements based on frequencies other than the single frequency.
- a computing apparatus comprising: at least one processor; and memory storing instructions, which when executed by the at least one processor, cause the computing apparatus to perform the method of any of EEE1-EEE31.
- EEE33. A non-transitory computer-readable storage medium storing instructions which, when executed by a computing apparatus, cause the computing apparatus to perform the method of any of EEE1-EEE31.
- EEE34. A computer program including instructions which, when executed by a computing apparatus, cause the computing apparatus to perform the method of any of EEE1-EEE31.
Landscapes
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Animal Behavior & Ethology (AREA)
- Medical Informatics (AREA)
- Veterinary Medicine (AREA)
- Biophysics (AREA)
- Pathology (AREA)
- Biomedical Technology (AREA)
- Heart & Thoracic Surgery (AREA)
- Public Health (AREA)
- Molecular Biology (AREA)
- Surgery (AREA)
- Otolaryngology (AREA)
- General Health & Medical Sciences (AREA)
- Multimedia (AREA)
- Acoustics & Sound (AREA)
- Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
Abstract
Description
Claims
Applications Claiming Priority (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US202263394017P | 2022-08-01 | 2022-08-01 | |
| US202363438669P | 2023-01-12 | 2023-01-12 | |
| PCT/US2023/028941 WO2024030337A1 (en) | 2022-08-01 | 2023-07-28 | Statistical audiogram processing |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| EP4565130A1 true EP4565130A1 (en) | 2025-06-11 |
Family
ID=87797676
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| EP23758758.9A Pending EP4565130A1 (en) | 2022-08-01 | 2023-07-28 | Statistical audiogram processing |
Country Status (4)
| Country | Link |
|---|---|
| EP (1) | EP4565130A1 (en) |
| JP (1) | JP2025528067A (en) |
| CN (1) | CN119968154A (en) |
| WO (1) | WO2024030337A1 (en) |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP3657261B2 (en) * | 2003-10-15 | 2005-06-08 | 株式会社ビジョンメガネ | Hearing test system and hearing aid selection system using the same |
| US8447042B2 (en) * | 2010-02-16 | 2013-05-21 | Nicholas Hall Gurin | System and method for audiometric assessment and user-specific audio enhancement |
| WO2014124449A1 (en) * | 2013-02-11 | 2014-08-14 | Symphonic Audio Technologies Corp. | Methods for testing hearing |
| US20190320268A1 (en) * | 2018-04-11 | 2019-10-17 | Listening Applications Ltd | Systems, devices and methods for executing a digital audiogram |
-
2023
- 2023-07-28 EP EP23758758.9A patent/EP4565130A1/en active Pending
- 2023-07-28 JP JP2025505720A patent/JP2025528067A/en active Pending
- 2023-07-28 CN CN202380068706.9A patent/CN119968154A/en active Pending
- 2023-07-28 WO PCT/US2023/028941 patent/WO2024030337A1/en not_active Ceased
Also Published As
| Publication number | Publication date |
|---|---|
| WO2024030337A1 (en) | 2024-02-08 |
| CN119968154A (en) | 2025-05-09 |
| JP2025528067A (en) | 2025-08-26 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11812223B2 (en) | Electronic device using a compound metric for sound enhancement | |
| US9613028B2 (en) | Remotely updating a hearing and profile | |
| CN113574597B (en) | Apparatus and method for source separation using estimation and control of sound quality | |
| US9679555B2 (en) | Systems and methods for measuring speech signal quality | |
| US10631105B2 (en) | Hearing aid system and a method of operating a hearing aid system | |
| KR20210020751A (en) | Systems and methods for providing personalized audio replay on a plurality of consumer devices | |
| CN102576535B (en) | Method and system for determining perceived quality of an audio system | |
| Peeters et al. | Subjective and objective evaluation of noise management algorithms | |
| CN112565981B (en) | Howling suppression method, device, hearing aid and storage medium | |
| US11895467B2 (en) | Apparatus and method for estimation of eardrum sound pressure based on secondary path measurement | |
| Koutrouvelis et al. | A convex approximation of the relaxed binaural beamforming optimization problem | |
| EP4565130A1 (en) | Statistical audiogram processing | |
| HK40124131A (en) | Statistical audiogram processing | |
| CN115211145B (en) | Method for fitting hearing aid gain and hearing aid fitting system | |
| JP6628715B2 (en) | Hearing aid | |
| US20260032395A1 (en) | Systems and Methods for Facilitating Fitting of a Hearing Device With Active Noise Cancellation | |
| d’Olne et al. | Latency-agnostic speech enhancement for wireless acoustic sensor networks using polynomial eigenvalue decomposition | |
| US20230223001A1 (en) | Signal processing apparatus, signal processing method, signal processing program, signal processing model production method, and sound output device | |
| WO2026013307A1 (en) | Method of operating a hearing aid system and a hearing aid system | |
| WO2026009400A1 (en) | Acoustic quality evaluation device, acoustic quality evaluation method, and program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: UNKNOWN |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE |
|
| PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
| 17P | Request for examination filed |
Effective date: 20250115 |
|
| AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC ME MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
| P01 | Opt-out of the competence of the unified patent court (upc) registered |
Free format text: CASE NUMBER: APP_30098/2025 Effective date: 20250624 |
|
| DAV | Request for validation of the european patent (deleted) | ||
| DAX | Request for extension of the european patent (deleted) |