TWM645890U - Earphone device and hearing apparatus - Google Patents

Abstract

Provided is an earphone device, including a wireless transmitting and receiving module, which receives a first electrical signal from an electronic device through a wireless transmission network; a first compensation module, which is connected to the wireless transmitting and receiving module, and disposed in an S(z) filter of an active noise cancellation chip to compensate gain, wherein the first compensation module is used to realize a frequency response curve so as to calculate a frequency response of the first electrical signal in each frequency band, and to generate first filter parameters of a target frequency response curve through a first compensation gain conversion model, and the first filter parameters compensate the gain of the first electrical signal in each of the frequencies; and a first transducer, which is connected to the first compensation module and/or the wireless transmitting and receiving module, convers the gain-compensated first electrical signal into sound when a compensation function is turned on, so as to transmit the sound, and when the compensation function is turned off, the first electrical signal is directly converted into sound so as to transmit the sound. In addition, a hearing apparatus is also provided, and the hearing apparatus can be connected to the earphone device.

Description

Headphone devices and hearing equipment

This invention relates to an audio compensation technology, in particular to a headphone device and hearing equipment that automatically compensates for gain in each frequency band and has real ear measurement (REM) analysis.

From the early days when it was almost unimaginable to enjoy music anytime and anywhere, now you can see people wearing headphones everywhere to answer wireless calls or listen to music on the street. The way of listening to music has changed significantly from the past.

With the advancement of semiconductor and wireless communication technology and the development of entertainment media, music has gradually become an inseparable part of everyone's life. Music playback devices are getting lighter and lighter, which also drives the final sound-emitting components to undergo drastic changes. Speakers for listening to music at a fixed point have evolved into headphones that everyone now owns. There are various ways to listen to music, but the most convenient way to listen to music is headphones.

As headphones continue to evolve, a variety of different internal driver units have also been developed. Although there are no major changes in the basic principles, the actual sound-producing structures are very different, and each type has its own developments. background, but also has its own advantages and disadvantages.

Past research has pointed out that the different gain of frequency response used in audio processing chips will directly affect the user's experience of listening to music. Currently, the gain adjustment of the frequency response of TWS earphones uses the DSP unit to perform gain compensation processing for each frequency band. The fineness of the frequency adjustment will be affected by the sampling frequency of the DSP unit (that is, the higher the sampling rate, the more detailed the frequency will be. adjustment ability). However, when the sampling rate increases, the power consumption of the DSP chip will directly increase, causing the user's usage time to be significantly reduced with the same battery power.

Furthermore, any acoustic measurement performed on a person's actual ear may be referred to as real ear analysis or real ear measurement. In a broad sense, real ear testing refers to acoustic measurements performed on a person's real ear. In a narrow sense, it is defined as a probe insertion measurement performed in the real ear near the tympanic membrane (the tip of the probe tube is about 5mm away from the tympanic membrane). In the field of hearing aids, it refers specifically to acoustic measurements made around the interventional gain of the real ear near the tympanic membrane. Although real-ear measurement is for people with hearing loss who wear hearing aids, the shape and structure of each person's ears are different. Real-ear measurement is also applicable to today's headphone devices to confirm how much sound can really be heard in the ear canal and how much sound can be heard in the ear canal. audio quality within.

In addition, the measured real-ear response is often inconsistent with the results expected by the fitting software. The main reason is that the acoustic characteristics of the user's outer and inner ears (such as resonance, volume, impedance, etc.) may be different from those used in the software prediction. The "average ear" data is different. When real-ear measurements are taken, the user's unique ear canal characteristics will be reflected, resulting in errors. Furthermore, users' earphone devices have different acoustic parameters, such as air hole size or eardrum depth. Therefore, real-ear measurements require additional gain adjustment to match the specified or expected target gain. Additionally, insertion gain measurements are a common method for verifying the performance characteristics of headphone devices. However, as mentioned above, the insertion gain has many limitations when debugging headphone devices, resulting in errors.

In other words, when exploring the active noise cancellation (ANC) architecture to adjust the compensation gain, it is traditionally necessary to adjust multiple filters (for example, filter type, fc, fc1, Q) or filter coefficients (for example, , b ₀ , b ₁ , b ₂ ...a ₀ , a ₁ ...) to obtain the frequency response to achieve gain compensation. However, if frequency response is obtained by adjusting multiple filters, it is necessary to manually determine and adjust the filter type, fc, fc1, Q and other parameters. Multiple filters will affect each other's gain compensation, resulting in poor efficiency. problem. If the frequency response is obtained by adjusting filter coefficients (for example, 8 sets of filters), there will be extremely high dimensions that need to be adjusted, making it impossible to quickly and accurately set the filter coefficients.

In addition, the feedforward filter (FF) and feedback filter (FB) used in current active noise reduction chips deal with the elimination of environmental noise, but no streaming audio filter is used in this active noise reduction chip ( For example: S(z) filter) and transparent audio filter (such as: APT filter) to perform frequency response gain compensation action on the audio.

The above are some of the main problems encountered in the current technical field. Therefore, based on the above reasons, how to provide a real-ear test method that does not require a real-ear analyzer, a probe transducer (i.e., a probe microphone), and does not need to be limited to a professional listening space (such as a listening room). Measurement and analysis, without the assistance of professionals (such as professional tuners), can effectively solve the above problems of headphone devices and headphone device compensation methods, which can effectively reduce the power consumption and delay of DSP chips, and provide better performance in the current real environment. Accurate, real-time, automated and customized user's headphone devices (such as commercially available headphones, ANC headphones, TWS headphones, hearing aids, hearing aids or headphones with hearing aid functions, glasses and other hearing devices or equipment), and how to mass Reducing the dimensions that need to be adjusted to quickly and accurately set filter coefficients has become an urgent issue in the industry.

In order to solve the above-mentioned conventional technical problems or provide related functions, the present invention provides a headphone device, which includes: a wireless transmission and reception module that receives a first electrical signal from an electronic device through a wireless transmission network; The compensation module is connected to the wireless transmission and reception module and is provided with a filter (for example, S(z) filter) for stream audio compensation gain in the active noise reduction chip, wherein the first compensation module Used to implement a frequency response curve, to calculate the frequency response of the first electrical signal in each frequency band, and to generate the first filter parameters of the target frequency response curve through the first compensation gain conversion model, so that the first filter The parameter gain compensates the first electrical signal in each frequency; and the first transducer is connected to the first compensation module and/or the wireless transmission and reception module to set the gain when the compensation function is turned on. The compensated first electrical signal is converted into sound to transmit the sound, and when the compensation function is turned off, the first electrical signal is directly converted into sound to transmit the sound.

The invention also provides a hearing device.

In one embodiment, the present invention includes: a second compensation module, which is connected to the wireless transmission and reception module and is provided with a filter (for example, APT filter) of the transparent audio compensation gain in the active noise reduction chip. device), wherein the second compensation module is used to implement speech gain compensation to calculate the gain of the second electrical signal in each frequency band, and generate the second filter parameters through the second compensation gain conversion model, so that the The second filter parameter gain compensates the second electrical signal in each frequency.

In one embodiment of this invention, the target frequency response curve is a Harman frequency response curve, an Etymotic frequency response curve, an HRTF frequency response curve, or other target frequency response curves that can achieve the same or similar target frequency response curve. This invention does not take this as an example. limit.

In an embodiment of the present invention, the first filter parameter is a filter parameter of gain compensation in each frequency of active noise reduction, and the first filter parameter of gain compensation in each frequency of active noise reduction is Audio gain compensation filter unit parameters.

In an embodiment of the present invention, the present invention includes: a storage module, wherein the first compensation module stores the first filter parameters to the storage module.

In an embodiment of the invention, the invention includes: a second transducer connected to the first compensation module, wherein the second transducer receives the first test signal from the electronic device to convert the The first test signal is converted into a third electrical signal; the third transducer is connected to the wireless transmission and receiving module to synchronously convert the transmitted sound into a fourth electrical signal for transmission through the wireless The network transmits the fourth electrical signal to the electronic device.

In an embodiment of the invention, the electronic device receives the fourth electrical signal from the third transducer through a wireless transmission network, and the third compensation module calculates the frequency response of the fourth electrical signal in each frequency band. , to compare the error between the frequency response and the target frequency response curve. If the error does not meet the error target, the electronic device quantifies the error to generate third filter parameters through the third compensation gain conversion model, and The third filter parameter gain compensates the fourth electrical signal in each frequency, so as to transmit the third filter parameter to the first compensation module through the wireless transmission network for gain compensation.

In an embodiment of the invention, the invention includes: a probe tube or a long earplug, one end of which is connected to the third transducer, and the other end of which is as short as the ear canal opening and as long as near the eardrum (such as 1mm or closer) ), the closer the other end is to the eardrum, the more accurate the high-frequency audio quality obtained.

In another embodiment of the present invention, one end of the probe tube or the long earplug is connected to the third transducer, and the other end is connected to the first bend of the external auditory canal or to a point approximately several mm (such as 5mm) away from the tympanic membrane. , making the high-frequency audio quality obtained more accurate compared to existing technologies.

In an embodiment of the invention, if the error still does not meet the error target, the third compensation module further quantifies the error to generate another set of filter parameters through the third compensation gain conversion model. , causing the gain of the other set of filter parameters to compensate the fourth electrical signal in each frequency.

In an embodiment of the present invention, the electronic device includes: a wireless communication module, wherein the wireless communication module transmits the test signal of the electronic device to the wireless transmitting and receiving module through the wireless transmission network to perform Gain compensation at each frequency.

In another embodiment of the present invention, the electronic device includes: a speaker module, wherein the speaker module transmits the test signal of the electronic device to the first transducer through air to perform gain at each frequency. compensation.

In one embodiment of this invention, the compensation module automatically searches for the complex filter through noise reduction technology combined with optimization methods and loss functions based on the real-time customized headphone device obtained by the user in the current real environment. The optimal filter parameter value generated by the complex group parameters is used as the original filter parameter, but this creation is not limited to this.

In an embodiment of the present invention, the electronic device stores the original filter parameters or the second filter parameters to a device with sound source processing capabilities, wherein the device has a fourth compensation module for gain compensation.

In one embodiment of the invention, the headphone device is installed in a headphone device with active noise reduction, and the hearing device is applied to the headphone device. The headphone device does not need to be professionally Performed with the assistance of personnel; in another embodiment, the hearing device is applied to a headphone device with active noise reduction.

In an embodiment of the present invention, the headphone device and the hearing equipment are processed automatically, real-time and/or synchronously through the compensation module of the headphone device in combination with the compensation gain conversion model and wireless communication technology.

In one embodiment of this invention, the compensation gain conversion model is used to greatly reduce the dimensions that need to be adjusted, so as to quickly and accurately set the filter coefficients.

Accordingly, this invention provides a method that does not require a real-ear analyzer, a probe transducer (i.e., a probe microphone), does not need to be limited to a professional listening space for real-ear measurement analysis, and does not require the use of professional personnel. Assist to effectively solve the above problems, and effectively reduce the power consumption and delay of the DSP chip, and use the user's personal headphone device through wireless communication technology to perform gain compensation and real-ear measurements at each frequency in the current real environment. , and provide accurate, real-time, automated and customized headphone devices for users, and greatly reduce the dimensions that need to be adjusted to quickly and accurately set filter coefficients.

1: Headphone device

10: Electronic devices

102:Third compensation module

11: Wireless transmission and reception module

110:Equipment or device

12: The first compensation module

120: Detection tube

122:Long earplugs

13:First transducer

14: Second compensation module

15:Storage module

16:Second transducer

17:Third transducer

21:Window frame

22: Discrete Fourier Transform (DFT)

31: Target frequency response curve

32: Compensated gain conversion model

33: Headphone device

34: Calculate the error between the target frequency response curve and the user’s frequency response

35: Determine whether it meets the error target

41: Hearing equipment

S11-S17: Steps

S21-S27: Steps

Figure 1 is a block diagram of the headphone device of this invention.

Figures 2, 2-1, and 2-2 are schematic diagrams of embodiments of the headphone device combined with a smart device of the present invention.

FIG. 3 is a schematic diagram showing model training of the compensation gain conversion model according to an embodiment of the present invention.

Figure 4 shows a log-power spectrum (LPS) acquisition method according to an embodiment of the present invention.

FIG. 5 is a block diagram showing model training of the compensation gain conversion model according to an embodiment of the present invention.

後的步驟流程圖。 Figure 6 shows the application terminal of this creation receiving electrical signals.

The following steps flow chart.

Figures 7A and 7B are step flow charts of the headphone device compensation method of this invention.

The following describes the implementation of the present invention through specific embodiments. Those familiar with this art can easily understand other advantages and effects of the present invention from the content disclosed in this specification.

It should be noted that the structures, proportions, sizes, etc. shown in the drawings attached to this manual are only used to coordinate with the content disclosed in the manual for the understanding and reading of people familiar with this technology, and are not used to limit the implementation of this creation. Therefore, it has no technical substantive significance. Any structural modifications, changes in proportions, or adjustments in size shall still fall within the scope of this invention without affecting the effect that this creation can produce and the purpose that it can achieve. The technical content revealed in the creation must be within the scope that can be covered.

Figure 1 is a block diagram of the headphone device of this invention. According to the embodiment of this invention, as shown in Figure 1 , the headphone device 1 of this invention includes a wireless transmission and reception module 11, a first compensation module 12, a first transducer (ie, speaker) 13, and a second compensation module. 14. Storage module 15, second transducer (Ref.Mic) 16 and third transducer (Err.Mic) 17, in which the wireless transmission interface The receiving module 11 receives a signal S from an electronic device (such as a smart device or a mobile device) through a wireless transmission network (not shown in the figure) to convert the signal S into an electrical signal; the first compensation module Group 12 is connected to the wireless transmission and reception module 11 and is provided with a stream audio compensation gain filter (for example, S(z) filter) in an active noise reduction chip (not shown in the figure), where, The first compensation module 12 is used to implement a frequency response curve to calculate the frequency response of the electrical signal in each frequency band, and generate the first filter parameters of the target frequency response curve through the first compensation gain conversion model, so that the first The filter parameter gain compensates the electrical signals in each frequency, and the first transducer 13 is connected to the first compensation module 12 and/or the wireless transmission and reception module 11, so that when the compensation function is turned on, the gain-compensated The first electrical signal is converted into sound and the sound is transmitted to the ear canal. When the compensation function is turned off, the first electrical signal is directly converted into sound and the sound is transmitted to the ear canal.

Furthermore, as shown in FIG. 1 , the second compensation module 14 is connected to the wireless transmission and reception module 11 and is provided with a filter (for example, an APT filter) that transmits the audio compensation gain in the active noise reduction chip ( (not shown in the figure), in which the second compensation module 14 is used to implement speech gain compensation to calculate the gain of another electrical signal in each frequency band, and generate a second filter through the second compensation gain conversion model The filter parameters allow the second filter parameter gain to compensate another electrical signal in each frequency.

In one embodiment, the first compensation module 12 and the second compensation module 14 implement the above content when the compensation function is turned on, and when the compensation function is turned off, the electrical signal is directly converted into sound to transmit the sound. .

In an embodiment of the invention, the above-mentioned target frequency response curve can be a Harman frequency response curve, an Etymotic frequency response curve, a head-related transfer function The head-related transfer function (HRTF) frequency response curve or other frequency response curves that can achieve the same or similar target frequency response curve are not limited to this.

In an embodiment of the present invention, the above-mentioned first filter parameters are filter parameters for gain compensation in each frequency of active noise reduction, and the filter parameters of gain compensation in each frequency of active noise reduction are gain compensation in each frequency of audio. Filter unit (e.g. S(z) filter or APT filter) parameters.

As shown in Figure 1, the headphone device 1 of the present invention further includes a storage module 15. The first compensation module 12 uses an algorithm (or compensation gain conversion model) or its firmware to store the set of filter parameters into the storage module. 15.

According to another embodiment of the invention, as shown in Figures 1 and 2, the invention uses a wireless transmission and reception module 11, a first compensation module 12, a first transducer (speaker) 13, a second transducer (Ref.Mic.) 16, the third transducer (Err.Mic.) 17 and the electronic device 10 perform real ear measurements. Specifically, the wireless transmission and reception module 11 receives the first test signal from the electronic device 10 through the wireless transmission network to convert the first test signal into a first electrical signal; the third transducer (Err.Mic. ) 17 is connected to the wireless transmission and reception module 11 to synchronously convert the sound transmitted in the ear canal into a second electrical signal, so as to transmit the second electrical signal to the electronic device 10 through the wireless transmission network, wherein the electronic device 10 Receive the second electrical signal from the third transducer (Err.Mic.) 17 through the wireless transmission network, and the third compensation module 102 calculates the frequency response of the second electrical signal in each frequency band to compare The error between the frequency response and the target frequency response curve. If the error does not meet the error target, the electronic device 10 quantifies the error to generate a third filter parameter through a third compensation gain conversion model, and the third filter The amplifier parameter gain compensates each frequency in the second The electrical signal is used to transmit the third filter parameters to the first compensation module through the wireless transmission network for gain compensation.

According to another embodiment of the invention, as shown in Figures 1 and 2, the second transducer (Ref. Mic.) 16 of the earphone device 1 of the invention can also receive signals from the electronic device 10 (such as a smart phone) through the air. The test signal S of the speaker module of the device or mobile device) 10. Similar to the above embodiment, if the second transducer (Ref.Mic.) 16 receives the test signal S from the speaker module of the electronic device 10 through the air, the first compensation module 12 performs gain compensation on the test signal S. ; The first transducer (speaker) 13 is connected to the first compensation module 12 and converts the gain-compensated test signal into sound to transmit the sound to the ear canal; the third transducer (Err. Mic) 17 simultaneously converts the sound transmitted in the ear canal into an electrical signal, and transmits the electrical signal to the electronic device 10 through the wireless transmission and reception module 11 and the wireless transmission network, wherein the electronic device 10 uses an application program (app), its firmware or cloud technology calculates the frequency response of the electrical signal in each frequency band to compare the error of the frequency response with the target frequency response curve through the third compensation module 102. If the error does not meet the error target, Then the electronic device 10 uses the application program, its firmware or cloud technology to quantify the error to generate a set of filter parameters through the compensation gain conversion model, and then sends the error through the wireless transmission network and the wireless transmission and reception module 11 Set the filter parameters to the first compensation module 12, the third compensation module 102 or other equipment or devices with audio source processing capabilities (or compensation modules) to perform gain compensation in each frequency.

Further, the electronic device can store the original filter parameters or the above-mentioned filter parameters to a device or device with sound source processing capabilities, wherein the device or device has a fourth compensation module for gain compensation. In one embodiment, the device or device with audio source processing capabilities may Select the original filter parameters or the above filter parameters to perform gain compensation through the compensation module to personalize the listening experience.

In addition, in an embodiment of the present invention, if the error still does not meet the error target, the first compensation module uses an algorithm or its firmware to further quantify the error to generate another error through the compensation gain conversion model. After setting the corrected filter parameters, the gain of the other corrected filter parameter is compensated for the electrical signal in each frequency, wherein the compensation gain conversion model can be set in a headphone device, a smart device, a cloud or a server , this creation is not limited to this.

In an embodiment of the present invention, the first compensation module 12 and the second compensation module 14 are disposed in an active noise reduction chip, and the third compensation module 102 is disposed in the electronic device 10 (for example, a smart device or mobile device), implemented by an application program, its firmware or cloud technology, wherein the first compensation module 12 is synchronized with the third compensation module 102.

In another embodiment of the present invention, the set of filter parameters are gain-compensated filter parameters for active noise reduction, wherein the gain-compensated filter parameters for active noise reduction are audio gain compensation filter units (for example, S( z) or APT filter) parameters.

In an embodiment of the present invention, the headphone device of the present invention is installed in a headphone device with active noise reduction.

In addition, the above-mentioned modules can be hardware or firmware; if they are hardware, they can respectively implement various circuits for gain compensation, wireless transmission and reception, and storage in each frequency or hardware units with similar technologies; if they are firmware, , they can be various firmware units that perform gain compensation, wireless transmission and reception, and storage in each frequency. In one embodiment, the compensation module can be a gain compensation circuit or a gain compensation hardware/firmware unit, and the wireless transmission and reception module can be a wireless transmission and reception circuit or a wireless The transmitting and receiving hardware/firmware unit, and the storage module can be a storage circuit or a storage hardware/firmware unit, in which the headphone device of the present invention includes but is not limited to ANC.

The headset device of this invention does not require the use of additional probe transducers (i.e., probe microphones), so as to provide accurate, real-time, automated and customized information through algorithms and wireless communication technology in the current real environment. Headphone device.

In another embodiment of the invention, as shown in Figures 2-1 and 2-2, the earphone device of the invention can also use a probe tube 120 or a long earplug 122, one end of which is connected to the transducer (Err.Mic. ), the other end of which is the shortest to the ear canal and the longest to the vicinity of the tympanic membrane (such as 1mm or closer). The closer the other end is to the tympanic membrane, the more accurate the quality of the high-frequency audio obtained, so as to pass through it in the current real environment. Wireless communication technology provides accurate, real-time, automated and customized headset devices.

In another embodiment of this invention, one end of the probe tube or long earplug is connected to the transducer (Err.Mic), and the other end is connected to the first bend of the external auditory canal or to a point approximately several mm (such as 5mm) away from the tympanic membrane. The high-frequency audio quality obtained is more accurate compared to existing technologies.

It should be noted that Figures 2-1 and 2-2 are schematic illustrations and are not limited thereto.

的頻率響應特性，補償增益轉換模型會自動地透過模型訓練產生複數組(或n組)ANC濾波器參數，可以提供ANC耳機進行各頻率中增益補償。 In an embodiment of the present invention, FIG. 3 shows a schematic diagram of model training of the compensation gain conversion model. Based on electrical signals

Based on the frequency response characteristics, the compensation gain conversion model will automatically generate complex sets (or n sets) of ANC filter parameters through model training, which can provide ANC headphones with gain compensation at each frequency.

之頻率響應的計算以及透過補償增益轉換模型架構進行增益補償參數計算詳細說明。 The following are respectively for electrical signals

The calculation of frequency response and the calculation of gain compensation parameters through the compensation gain conversion model structure are explained in detail.

之頻率響應的計算 electrical signal

Calculation of frequency response

先傳送到APP端進行聲學特徵提取，且透過對數功率頻譜(log-power spectrum,LPS)方法來計算在一段時間下電性訊號

中的頻率響應。當特徵進行擷取時，通過計算各重疊窗框(window frame)21的離散傅立葉轉換(discrete Fourier transform,DFT)22，對輸入訊號進行短時傅立葉轉換(short-time Fourier transform,STFT)，亦即透過公式(1)將音樂訊號從時域轉為頻域，公式(1)如下所示：

Figure 4 shows the power spectrum (log-power spectrum, LPS) acquisition method. In the embodiment of this invention, the transducer (Err.Mic) converts the received electrical signal into

First, it is sent to the APP for acoustic feature extraction, and the log-power spectrum (LPS) method is used to calculate the electrical signal over a period of time.

frequency response in . When features are extracted, a short-time Fourier transform (STFT) is performed on the input signal by calculating the discrete Fourier transform (DFT) 22 of each overlapping window frame (window frame) 21, and That is, the music signal is converted from the time domain to the frequency domain through formula (1). Formula (1) is as follows:

k =0,1,..., L -1

)在時域中第l個樣本，Y ^f (k)代表輸入訊號的頻譜，k是頻率索引(frequency index)，h(l)表示漢明窗函數。 Among them, Y ^t ( l ) represents the input signal (ie, electrical signal

) is the l- th sample in the time domain, Y ^f ( k ) represents the spectrum of the input signal, k is the frequency index, and h ( l ) represents the Hamming window function.

Compensation gain parameters through compensation gain conversion model architecture

Figure 5 shows a block diagram of model training of the compensated gain conversion model. As shown in Figure 5, the target frequency response curve 31 is provided to the compensation gain conversion model 32, and then, through the compensation gain conversion model 32 (for example, artificial intelligence algorithm, deep learning method, machine learning method, mathematical statistics method, etc.) Convert the compensation into the filter parameter gain G' _N required by the circuit, and transmit it to the ANC headphone device 33. The above process can be model trained through the compensation gain conversion model architecture, and through the target loss function (cost function) Implementation, as shown in formula (2):

Among them, N indicates that the model will generate a complex set of filter parameters (obtaining N sets), M indicates the number of samples of the training model, and i indicates the gain data in the training.

When the compensation gain conversion model is used for model training, the error is back-propagated to update the model parameters and adjust the parameter weights to find the best compensation, as shown in formula (3):

綠製後的頻率響應與目標頻率響應曲線進行計算34，以獲得兩者之間的誤差

，其中，計算誤差的方法包含以下方法：minimum mean-square error、客觀性評估指標(例如，HASQI,HASPI,STOI,NCM,PESQ,...等)，本創作不以此為限。之後，透過判別來確定當前的誤差是否在可以接受之範圍內35。若誤差

是在可以接受的範圍內時，則表示選配完成；反之，將此誤差

再次傳送至補償增益轉換模型來重新產生另一組修正後補償增益

。經過上述流程，可以重複以上流程使誤差

持續收斂至符合設定之需求，從而完成自動化的流程。 Afterwards, the electrical signal in the ear canal is transmitted through the transducer of the ANC device.

Calculate 34 the frequency response after greening and the target frequency response curve to obtain the error between the two

, among which, the error calculation methods include the following methods: minimum mean-square error, objective evaluation indicators (for example, HASQI, HASPI, STOI, NCM, PESQ,...etc.), this creation is not limited to this. Afterwards, judgment is used to determine whether the current error is within an acceptable range35. If error

When it is within the acceptable range, it means that the matching is completed; otherwise, the error

Send to the compensation gain conversion model again to regenerate another set of corrected compensation gains

. After the above process, you can repeat the above process to make the error

Continuously converge to meet the set requirements to complete the automated process.

後的步驟流程圖。如圖6所示，在步驟S11，電子裝置傳送電性訊號

。 Figure 6 shows the ANC headphone end of this creation receiving electrical signals.

The following steps flow chart. As shown in Figure 6, in step S11, the electronic device transmits an electrical signal

.

(例如，約10秒鐘的音樂)。 Then, in step S12, the ANC earphone terminal receives the electrical signal

(eg, about 10 seconds of music).

的頻率響應。 Then, in step S13, n sound frames are taken, Fourier transform is performed on each sound frame, and the energy under the n sound frames is accumulated to obtain an electrical signal.

frequency response.

In step S14, the frequency response of the electrical signal in each frequency band is calculated.

In step S15, the ANC filter parameters of the target frequency response curve are generated through the compensation gain conversion model.

In step S16, the ANC filter parameter gain compensates the electrical signal in each frequency.

Finally, in step S17, the ANC filter parameters are written into the chip of the ANC earphone (ie, stored in the storage module of the ANC earphone).

It is worth mentioning that the headphone device of this invention adopts active noise cancellation (ANC) technology, but in different embodiments, the same or similar noise reduction technology can be applied, and this invention is not limited to this. . In this embodiment, the filter parameters (for example, FF, FB, SZ, APT, etc.) can be set through the information of "mechanical acoustic characteristics" and "hearing compensation prescription", that is, through the mean squared error (mean-square error, MSE) method is used to set the filter parameters in ANC technology, so that the ANC technology can perform gain compensation at different frequencies for the sound source transmitted by the transducer. In an embodiment of the present invention, the above-mentioned filters may be feedforward (FF) filters, feedback (FB) filters, and audio gain compensation filter units (such as S(z) filters, APT filters), where , the feedforward (FF) filter can receive the electrical signal of the transducer (Ref.Mic) to eliminate external noise; the feedback (FB) filter can receive the electrical signal of the transducer (Err.Mic) (i.e. , the transducer (Err.Mic) converts the noise in the ear canal into an electrical signal) to eliminate the In-channel noise; and the audio gain compensation filter unit (such as S(z) filter and APT filter) receives the appropriate target curve to appropriately adjust the electrical signal in each frequency band.

Since this invention is suitable for various smart devices, the headphone device can perform gain compensation at each frequency in the current environment (for example, residential buildings, outdoors, in cars, parks, etc.) without the assistance of professionals. It is worth mentioning that in addition to performing gain compensation at each frequency, the headphone device of this invention does not need to be limited to real-ear measurement and analysis in the listening room with real-ear measurement instruments. The headphone device of this invention can be used in non- The current real-world environment in the listening room provides automated, real-time, customized user earphone devices or hearing equipment.

In one embodiment of this invention, the earphone device of this invention can be an earphone (including but not limited to moving coil, moving iron, piezoelectric, pneumatic, electrostatic, wired transmission, wireless transmission earphones), a hearing aid, Anti-noise headphones, monitoring headphones, smart glasses, wearable devices or a combination thereof. In another embodiment, as shown in FIG. 1 , the headphone device 1 of the present invention can also be selectively disposed and connected to the hearing device 41 and has the above compensation technology.

In addition, the headphone device of this invention combines wireless communication technologies (such as Bluetooth, Wi-Fi, near-field communication (NFC), ultrasonic technology) through algorithms (such as compensated gain conversion model technology). Broadband (UWB), IEEE 802.15.4 and other wireless communication technologies) can directly synchronize the user's real-time customized gain compensation with the noise reduction module and/or compensation provided in the same or a single chip The module operates to provide users with an instant and comfortable music listening experience. In addition, according to the above-mentioned embodiments of the present invention, since users use their own hearing equipment or headphone devices (for example, various smart devices or devices with ANC headsets or TWS headsets), they can operate in various current real environments or real application environments (i.e., Quiet or noisy environment) performs gain compensation at each frequency, so users can choose to turn on or off the noise reduction module according to their own needs when performing the headphone device compensation method of this invention.

It is worth noting that the headphone device of this invention does not need to be limited to performing gain compensation at each frequency in the listening room and does not require the assistance of professionals. This invention also does not require the use of additional probe transducers, only through its own Devices (such as headphones, hearing aids, hearing aids, etc.) and by combining smart devices with compensated gain conversion model technology and wireless communication technology, the user's headphone device or hearing equipment can be automatically, real-time, and customized.

7A and 7B are step flow charts of the headphone device compensation method of the present invention, together with the description of the above embodiment, in which the method flow at least includes the following steps S21 to S27.

In step S21, the first electrical signal from an electronic device is received through the wireless transmission network through the wireless transmission and reception module.

In step S22, when the compensation function is turned on, a filter for stream audio compensation gain in the active noise reduction chip is set by the first compensation module connected to the wireless transmission and reception module, wherein the third compensation module A compensation module is used to implement a frequency response curve to calculate the frequency response of the first electrical signal in each frequency band, and generate the first filter parameters of the target frequency response curve through the first compensation gain conversion model, so that the The first filter parameter gain compensates the first electrical signal in each frequency.

In step S24, the gain-compensated first electrical signal is converted into sound by the first transducer connected to the first compensation module, so as to transmit the sound into the ear canal.

In step S25, when the compensation function is turned on, a filter that transmits the audio compensation gain in the active noise reduction chip is set by the second compensation module connected to the wireless transmission and reception module, wherein the The second compensation module is used to implement speech gain compensation to calculate the second The gain of the electrical signal in each frequency band is used to generate a second filter parameter through the second compensation gain conversion model, so that the gain of the second filter parameter compensates the second electrical signal in each frequency.

In step S27, the first test signal from the electronic device is received by the second transducer connected to the first compensation module, so as to convert the first test signal into a third electrical signal; by The third transducer connected to the wireless transmission and reception module is used to simultaneously convert the sound transmitted in the ear canal into a fourth electrical signal, and transmit the fourth electrical signal to the electronic signal through the wireless transmission network. Device, wherein the electronic device receives the fourth electrical signal from the third transducer through a wireless transmission network, and the third compensation module calculates the frequency response of the fourth electrical signal in each frequency band to compare the The error between the frequency response and the target frequency response curve. If the error does not meet the error target, the electronic device quantifies the error to generate a third filter parameter through a third compensation gain conversion model, and the third filter The fourth electrical signal in each frequency is gain compensated by the filter parameter, so as to transmit the third filter parameter to the first compensation module through the wireless transmission network for gain compensation.

In addition, in step S23, when the compensation function is turned off, the first electrical signal is converted into sound by the first transducer connected to the wireless transmission and reception module to transmit the sound.

Furthermore, in step S26, when the compensation function is turned off, the second electrical signal is converted into sound by the first transducer connected to the wireless transmission and reception module to transmit the sound.

In another embodiment, in addition to storing the set of filter parameters to the storage module, the electronic device can also use an algorithm (compensation gain conversion model), its firmware or cloud technology to The original filter parameters or the set of filter parameters are stored in equipment or devices with sound source processing capabilities, where the equipment or devices have a fourth compensation module for gain compensation.

In addition, in addition to the transducer (Ref.Mic.) being able to receive the first test signal from an electronic device (for example, a smart device or a mobile device) through the wireless transmission network and the wireless transmission and reception module, the electronic device The speaker module can also transmit the second test signal of the electronic device to the transducer (Ref.Mic.) through the air to perform gain compensation as mentioned above. In addition, the first test signal can be transmitted via wireless communication, and the second test signal can be transmitted in the air.

In the above method flow, the first compensation module and the second compensation module can be disposed in the active noise reduction chip, and the third compensation module can be disposed in the electronic device (for example, a smart device or a mobile device) , implemented by an application, its firmware or cloud technology, wherein the first compensation module is synchronized with the third compensation module.

In an embodiment of the present invention, the set of filter parameters are filter parameters for gain compensation of active noise reduction or gain compensation parameters of a digital signal processing circuit, wherein the filter parameters of gain compensation for active noise reduction are audio gain compensation. Filter unit (e.g. S(z) filter or APT filter) parameters.

In addition, the above method and flow are applied to headphone devices and can also be applied to headphone devices with active noise reduction.

In addition, it is worth noting that in audio processing chips, ANC technology has gradually been used in TWS headsets. It mainly generates reverse wave signals through hardware circuits and corresponding system parameters, thereby achieving active anti-noise. Function. Since ANC technology can have extremely low delay time (<20μS), in addition to the advantages of hardware circuit implementation, its use of extremely high sampling rate processing is also used to solve the delay time challenge. Therefore, in the ANC technical architecture, this creation can appropriately give the correct The filter parameters and their circuit characteristics can also be converted into gain adjustments applied to the frequency response. In other words, the headphone device and its compensation method of the present invention can effectively allow the ANC technology to perform gain adjustment of the frequency response, thereby achieving the advantages of high sampling rate and low power consumption of the ANC technology, and effectively improving the audio frequency after processing by the audio processing chip. audio quality and reduced power consumption.

To sum up, the earphone device and its compensation method of this invention combine digital network technology and wireless transmission technology through active noise reduction (ANC) technology, which not only enables the earphones to emit reverse waves with the same energy as the current noise (or Forward wave) to eliminate environmental noise in the ear canal, and can directly perform gain compensation in each frequency. When performing real ear measurements (REM), the compensation module can also be used to directly customize the earphones for the user in real time. The device performs gain compensation in each frequency (thus appropriately adjusting the signal gain of each frequency band (such as forward signal and/or reverse signal)), and has the function of automating, real-time and customizing the user's headphone device or hearing equipment. This allows the user's headphone device or hearing device to listen to clearer sounds or better-sounding music.

In addition, the headphone device and its compensation method of this invention consider the gain characteristics of the user's frequency response through compensation gain conversion model technology to provide test music, and then perform real-ear measurements, and achieve automated, real-time and customized user The function of the headphone device or hearing equipment enables the user to listen to clearer sounds or better-listening music.

In addition, in the embodiment of the present invention, the compensation gain conversion model can also automatically correct the compensation parameters of the headphone device (for example, SII (speech intelligibility index), HASQI, HASPI and other compensation parameters), wherein the compensation gain conversion model can be set in In headset devices, smart devices, clouds or servers, this creation is not limited to this.

It is worth mentioning that the headphone device and hearing equipment of this invention do not require dynamic range compression function (DRCF).

Finally, in an embodiment of the present invention, a computer program product utilizes the algorithm (compensation gain conversion model) of the device or its firmware technology to execute the above content, and can automatically store various filter parameters to the audio source. Equipment or devices with processing capabilities (110 as shown in Figure 2, such as smart devices, mobile devices, speakers or speakers), wherein the equipment or device has a compensation module to perform gain compensation at each frequency. Therefore, the computer program product can choose to synchronize the filter parameters to the headphone device or synchronize the filter parameters to the device or device with music processing capabilities for music processing and playback.

The above embodiments are only illustrative to illustrate the principle and effect of this invention, and are not intended to limit this invention. Anyone familiar with this art can modify and change the above implementation form without violating the spirit and scope of the invention. Therefore, the scope of rights protection for this creation should be as listed in the scope of the patent application.

1: Headphone device

11: Wireless transmission and reception module

12: The first compensation module

13:First transducer

14: Second compensation module

15:Storage module

16:Second transducer

17:Third transducer

Claims (13)

An earphone device includes: a wireless transmission and reception module that receives a first electrical signal from an electronic device through a wireless transmission network; a first compensation module that is connected to the wireless transmission and reception module and is disposed on A filter for compensation gain of streaming audio in an active noise reduction chip, wherein the first compensation module is used to implement a frequency response curve to calculate the frequency response of the first electrical signal in each frequency band, and through the third A compensation gain conversion model generates first filter parameters of a target frequency response curve such that the first filter parameters gain compensate the first electrical signal in each frequency; and a first transducer is connected to the first A compensation module and/or the wireless transmission and reception module is used to convert the gain-compensated first electrical signal into sound when the compensation function is turned on, so as to transmit the sound, and when the compensation function is turned off, the first electrical signal is converted into sound. The first electrical signal is directly converted into sound to transmit the sound. The headphone device according to claim 1 further includes: a second compensation module, which is connected to the wireless transmission and reception module and is provided with a filter for transparent audio compensation gain in the active noise reduction chip, wherein, The second compensation module is used to implement speech gain compensation to calculate the gain of the second electrical signal in each frequency band, and generate second filter parameters through the second compensation gain conversion model, so that the second filter parameters The gain compensates the second electrical signal in each frequency. The headphone device of claim 1, wherein the target frequency response curve is a Harman frequency response curve, an Etymotic frequency response curve, or an HRTF frequency response curve. The headphone device according to claim 1, wherein the first filter parameter is a filter parameter of gain compensation in each frequency of active noise reduction, and the first filter parameter of gain compensation in each frequency of active noise reduction The filter parameters are the audio gain compensation filter unit parameters. The headphone device of claim 1 further includes: a storage module, wherein the first compensation module stores the first filter parameter in the storage module. The headphone device according to claim 1 further includes: a second transducer connected to the first compensation module, wherein the second transducer receives the first test signal from the electronic device to The first test signal is converted into a third electrical signal; the third transducer is connected to the wireless transmission and receiving module to synchronously convert the transmitted sound into a fourth electrical signal for transmission through the wireless The network transmits the fourth electrical signal to the electronic device. The headphone device of claim 6, wherein the electronic device receives the fourth electrical signal from the third transducer through a wireless transmission network, and the third compensation module calculates the frequency of the fourth electrical signal in each frequency band. The frequency response is to compare the error of the frequency response with the target frequency response curve. If the error does not meet the error target, the electronic device quantifies the error to generate a third filter through the third compensation gain conversion model. parameters, and the third filter parameter gain compensates the fourth electrical signal in each frequency, so as to transmit the third filter parameter to the first compensation module through the wireless transmission network for gain compensation. The earphone device as described in claim 7 further includes: a probe tube or a long earplug, one end of the probe tube or the long earplug is connected to the third transducer, and the other end of the probe tube or the long earplug is Tie one end to the first bend of the external auditory canal or 5mm away from the tympanic membrane. The headphone device of claim 7, wherein if the error still does not meet the error target, the third compensation module quantizes the error again to increase the error through the third compensation. After the gain conversion model generates another set of filter parameters, the gain of the other set of filter parameters is compensated for the fourth electrical signal in each frequency. The headphone device according to claim 7, wherein the electronic device includes: a wireless communication module, wherein the wireless communication module transmits the test signal of the electronic device to the wireless transmission and reception module through the wireless transmission network. group to perform gain compensation at each frequency. The headphone device according to claim 7, wherein the electronic device includes: a speaker module, wherein the speaker module transmits the test signal of the electronic device to the first transducer through air to perform each of the Mid-frequency gain compensation. The headphone device according to claim 2, wherein the electronic device stores the original filter parameters or the second filter parameters to a device with sound source processing capabilities, wherein the device has a fourth compensation module for gain compensation. A hearing device having the earphone device according to any one of claims 1 to 12, wherein the earphone device is provided and connected to the hearing device.

Images