WO2024039049A1 - Dispositif électronique et procédé de commande associé - Google Patents

Dispositif électronique et procédé de commande associé Download PDF

Info

Publication number
WO2024039049A1
WO2024039049A1 PCT/KR2023/008941 KR2023008941W WO2024039049A1 WO 2024039049 A1 WO2024039049 A1 WO 2024039049A1 KR 2023008941 W KR2023008941 W KR 2023008941W WO 2024039049 A1 WO2024039049 A1 WO 2024039049A1
Authority
WO
WIPO (PCT)
Prior art keywords
microphone
speaker
signal
electronic device
inner microphone
Prior art date
Application number
PCT/KR2023/008941
Other languages
English (en)
Korean (ko)
Inventor
박수연
민경보
성호상
이원준
최승도
Original Assignee
삼성전자주식회사
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 삼성전자주식회사 filed Critical 삼성전자주식회사
Publication of WO2024039049A1 publication Critical patent/WO2024039049A1/fr

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R1/00—Details of transducers, loudspeakers or microphones
    • H04R1/10—Earpieces; Attachments therefor ; Earphones; Monophonic headphones
    • H04R1/1083—Reduction of ambient noise
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
    • G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
    • G10L21/0208—Noise filtering
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R1/00—Details of transducers, loudspeakers or microphones
    • H04R1/10—Earpieces; Attachments therefor ; Earphones; Monophonic headphones
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R1/00—Details of transducers, loudspeakers or microphones
    • H04R1/10—Earpieces; Attachments therefor ; Earphones; Monophonic headphones
    • H04R1/1058—Manufacture or assembly
    • H04R1/1075—Mountings of transducers in earphones or headphones
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R3/00—Circuits for transducers, loudspeakers or microphones
    • H04R3/02—Circuits for transducers, loudspeakers or microphones for preventing acoustic reaction, i.e. acoustic oscillatory feedback
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R3/00—Circuits for transducers, loudspeakers or microphones
    • H04R3/04—Circuits for transducers, loudspeakers or microphones for correcting frequency response
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2410/00—Microphones
    • H04R2410/01—Noise reduction using microphones having different directional characteristics
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2460/00—Details of hearing devices, i.e. of ear- or headphones covered by H04R1/10 or H04R5/033 but not provided for in any of their subgroups, or of hearing aids covered by H04R25/00 but not provided for in any of its subgroups
    • H04R2460/01—Hearing devices using active noise cancellation

Definitions

  • the present disclosure relates to an electronic device and a control method thereof, and specifically, to an electronic device capable of outputting sound that blocks external noise by adaptively changing the ANC filter value according to the sound output environment and a control method thereof. .
  • An audio output device is an electronic device that converts electrical signals into sound waves and outputs them.
  • earphones or headphones are portable. As earphones or headphones can be used not only in quiet environments but also in noisy environments, recent earphones and headphones support a noise canceling function.
  • ANC Active Noise Cancellation
  • An electronic device includes a speaker, an inner microphone disposed in a direction in which the speaker emits sound, an outer microphone disposed in a direction opposite to the inner microphone, and input through the outer microphone and the inner microphone.
  • a noise signal is identified using the identified audio signal, a filter including a plurality of orthogonal basis filters is used to generate a cancellation acoustic signal having an opposite wavelength of the confirmed noise signal, and the generated cancellation acoustic signal is output.
  • a processor that controls the speaker.
  • the processor may check the weight value to be applied to each of the plurality of orthogonal basis filters based on the audio signal received through the inner microphone and the audio signal received through the outer microphone.
  • the processor may generate the offset sound signal using the plurality of orthogonal basis filters and the weight value.
  • the processor may determine a first transmission characteristic between the inner microphone and the outer microphone and a second transmission characteristic between the speaker and the inner microphone based on the audio signals received from each of the inner microphone and the outer microphone. there is. Additionally, the processor may calculate a plurality of weight values to be applied to the plurality of orthogonal basis filters based on the confirmed first and second transfer characteristics.
  • each of the plurality of orthogonal basis filters may be a noise removal filter with different transfer characteristics.
  • the plurality of orthogonal basis filters may include a plurality of IIR filters having mutual orthogonality, two FIR filters connected to each of the plurality of IIR filters, and a plurality of weight modules connected to each of the FIR filters.
  • the plurality of orthogonal basis filters may be 8 or 16.
  • the processor may control the speaker to output both the content sound signal corresponding to the sound source content and the calculated offset sound signal.
  • the processor determines a second transmission characteristic between the speaker and the inner microphone based on the audio signal received from each of the inner microphone and the outer microphone, and determines the second transmission characteristic between the speaker and the inner microphone, and determines the content based on the confirmed second transmission characteristic.
  • the sound signal can be corrected, and the speaker can be controlled so that the corrected sound signal and the offset sound signal are output together.
  • the processor may perform correction only for a preset low frequency band among the content audio signals.
  • a method of controlling an electronic device includes receiving an audio signal through an inner microphone disposed in a direction in which a speaker emits sound and an outer microphone disposed in a direction opposite to the inner microphone. , confirming a weight value to be applied to each of a plurality of orthogonal basis filters based on the received audio signal, generating an offset acoustic signal having an opposite wavelength of the noise signal using the plurality of orthogonal basis filters and the confirmed weight value. It includes generating and outputting the generated offset sound signal through a speaker.
  • the checking step includes determining a first transmission characteristic between the inner microphone and the outer microphone and a second transmission characteristic between the speaker and the inner microphone based on the audio signals received from each of the inner microphone and the outer microphone. , and a plurality of weight values to be applied to the plurality of orthogonal basis filters can be confirmed based on the confirmed first and second transfer characteristics.
  • each of the plurality of orthogonal basis filters may be a noise removal filter with different transfer characteristics.
  • the content sound signal corresponding to the sound source content and the calculated offset sound signal may be output together.
  • this control method confirms a second transmission characteristic between the speaker and the inner microphone based on the audio signal received from each of the inner microphone and the outer microphone, and determines the second transmission characteristic between the speaker and the inner microphone, and determines the content based on the confirmed second transmission characteristic. It may further include correcting the sound signal, and the outputting step may output both the corrected sound signal and the offset sound signal.
  • the correction step may perform correction only for a preset low frequency band among the content sound signals.
  • the control method includes an inner microphone disposed in a direction in which a speaker emits sound, and an inner microphone disposed in a direction opposite to the inner microphone.
  • an audio signal is input through each of the outer microphones disposed in the direction of It includes generating a canceling acoustic signal having an opposite wavelength to the noise signal using .
  • FIG. 1 is a diagram illustrating an example of use of an electronic device according to an embodiment of the present disclosure
  • FIG. 2 is a diagram illustrating a noise removal operation according to an embodiment of the present disclosure
  • FIG. 3 is a diagram illustrating an example of a combination of noise removal filters according to an embodiment of the present disclosure
  • FIG. 4 is a diagram illustrating an example of implementation of a noise control filter according to an embodiment of the present disclosure
  • FIG. 5 is a diagram illustrating an example of a noise control operation according to an embodiment of the present disclosure
  • FIG. 6 is a diagram illustrating an example of a noise control operation according to an embodiment of the present disclosure
  • FIG. 7 is a diagram illustrating second transmission characteristics estimated according to an embodiment of the present disclosure.
  • FIG. 8 is a block diagram illustrating the configuration of an electronic device according to an embodiment of the present disclosure.
  • FIG. 9 is a block diagram illustrating the configuration of an electronic device according to an embodiment of the present disclosure.
  • FIG. 10 is a flowchart illustrating a method of controlling an electronic device according to an embodiment of the present disclosure.
  • the term “signal” includes not only electrical signals but also signals in the form of sound waves, and in the case of electrical signals, they may be digital signals as well as analog signals.
  • the expression audio signal (or noise signal) refers to a sound wave (or radio wave) signal if the signal is outside the electronic device, and an electrical signal if it is inside the electronic device, depending on the location.
  • signal processing in electronic devices may be not only digital signal processing, but also analog signal processing or a signal processing method using a mixture of analog and digital methods.
  • the term “filter” refers to removing a specific component (for example, a specific frequency region or a specific pattern), and the filter may be a digital filter or an analog filter.
  • a “module” or “unit” for a component used in this specification performs at least one function or operation. And, the “module” or “unit” may perform a function or operation by hardware, software, or a combination of hardware and software. Additionally, a plurality of “modules” or a plurality of “units” excluding a “module” or “unit” that must be performed on specific hardware or performed on at least one processor may be integrated into at least one module. Singular expressions include plural expressions unless the context clearly dictates otherwise.
  • each step should be understood as non-limiting unless the preceding step must be performed logically and temporally prior to the subsequent step. In other words, except for the above exceptional cases, even if the process described as a subsequent step is performed before the process described as a preceding step, the nature of disclosure is not affected, and the scope of rights must also be defined regardless of the order of the steps.
  • the term “A or B” is defined not only to selectively indicate either A or B, but also to include both A and B.
  • the term "included” in this specification has the meaning of including additional components in addition to the elements listed as included.
  • each embodiment may be implemented or operated independently, but each embodiment may be implemented or operated in combination.
  • FIG. 1 is a diagram illustrating an example of using an electronic device according to an embodiment of the present disclosure.
  • the electronic device 100 is an electronic device that converts electrical signals into sound waves and outputs them. These electronic devices 100 may be earphones or headphones. Hereinafter, for ease of explanation, it is assumed that the electronic device 100 is an earphone that is inserted into the user's ear and operates. However, when implemented, the electronic device 100 may be a headphone, and content stored externally or internally. It may be a device that only performs the function of removing noise without the function of reproducing sound, a sound device that the user uses without wearing it, or a combination of an earphone and a smartphone.
  • the speaker of the electronic device 100 When a user wears the electronic device 100 on his or her ears, the speaker of the electronic device 100 is directed toward the user's eardrums, and sound output from the electronic device 100 is transmitted toward the user's eardrums. Accordingly, the user can hear the sound.
  • the electronic device 100 when the electronic device 100 is worn on the ear, the electronic device 100 shields the ears, thereby supporting a certain degree of noise prevention function (or passive noise canceling).
  • loud or specific external noise 10 may be transmitted to the user's eardrums, and such noise interferes with viewing content.
  • the electronic device 100 can determine the form of noise 20 transmitted to the user's eardrum, and generate and output a canceling sound signal 50 corresponding to the identified form of noise.
  • This canceling sound signal has an opposite wavelength to the noise signal, and the two signals are destroyed by the interference of the waves.
  • This operation is referred to as the active noise canceling function, and as explained earlier, the type of external noise that will be transmitted to the user's eardrums must be well estimated to properly remove the noise.
  • the fixed filter method uses a fixed filter value (or filter) and has the advantage of being able to operate with low resources because it generates an offset acoustic signal with only the fixed filter value.
  • a fixed filter value or filter
  • noise removal performance may vary depending on the external auditory canal shape and/or wearing condition.
  • the adaptive filter method calculates the filter value through calculation and generates an offset sound signal using the calculated filter value, so noise removal performance can be maintained even when the wearing condition changes.
  • the existing adaptive filter method required a lot of resources to calculate the above-mentioned filter and the parameters that make up the filter. Therefore, it was difficult to apply the adaptive filter method to earphones with low resources.
  • the present disclosure describes a method of calculating a filter value with lower resources than before while maintaining performance regardless of the user's wearing method.
  • FIG. 2 is a diagram explaining a noise removal operation according to an embodiment of the present disclosure. Specifically, FIG. 2 is a diagram illustrating a method of controlling noise using a feedforward method.
  • the feedforward ANC model 200 includes a first response characteristic 210, a second response characteristic 230, and a filter 220.
  • the first response characteristic 210 represents the sound transmission characteristic between the inner microphone (d(n)) and the outer microphone (x(n)).
  • This first response characteristic 210 may be expressed as a sound transmission characteristic between the outside of the ear and the inside of the ear (the eardrum or the space where the eardrum is located).
  • This first response characteristic 210 has a low dependence on the sound direction, but has a high dependence on the wearing style. For example, when the electronic device 100 is worn loosely (wearing it loosely or using a large tip, etc.), more noise may enter through the gap between the tip and the ear than when it is worn tightly. In this way, the first response characteristic 210 may vary depending on the wearing condition, etc. In particular, the difference in the first response characteristic 210 occurs more in the high-bandwidth region of sound.
  • the second response characteristic 230 represents the sound transmission characteristic between the speaker and the inner microphone d(n).
  • This second response characteristic 230 may also be expressed as a sound transmission characteristic between the speaker and the inside of the ear.
  • This second response characteristic 230 also has a high dependence on the wearing style. For example, the tighter the user wears the electronic device, the better the sound from the speaker is transmitted inside the ear, and the more loosely the user wears the electronic device, the worse the transmission of sound from the speaker becomes. Its characteristics may vary depending on the In particular, the difference in the second response characteristic 230 occurs more in the low-band region of sound.
  • the filter 220 must have transmission characteristics to remove noise signals transmitted inside the ear. In other words, in order for the offset sound signal output from the speaker to have an opposite wavelength to the noise signal transmitted inside the ear, it must have transmission characteristics as shown in Equation 1 below.
  • the first response characteristic 210 and the second response characteristic may change depending on the external shape, wearing condition, etc.
  • the value of the filter 220 is fixed despite changes in the first response characteristic 210 and the second response characteristic 210, the shape or size of the generated offset acoustic signal does not correspond to the noise signal, so noise cancellation performance is bound to deteriorate.
  • an adaptive filter method that can accurately estimate the wearing state and generate an offset acoustic signal with a corresponding filter value must be used.
  • the existing adaptive filter method had many difficulties in implementation. Specifically, since a canceling sound signal must be generated and output before external noise reaches the user's eardrums, fast sampling of approximately 384 kHz is required for noise cancellation.
  • this disclosure proposes and explains a method for adaptively changing filter values even with low resources. The specific method will be described below with reference to FIG. 3.
  • FIG. 3 is a diagram illustrating an example of a combination of noise removal filters according to an embodiment of the present disclosure.
  • ANC technology is implemented from the response characteristics between the outer microphone and the inner microphone, and the response characteristics of the speaker and inner microphone states. These characteristics may change depending on the shape of the individual's ear canal and wearing conditions (e.g., size of ear tip or wearing strength, etc.).
  • the filter response varies depending on the wearing status of many users, the shape of each filter has very similar characteristics. Given that the similarity of the filter response shapes was confirmed, orthogonal bases that could represent all of the corresponding shapes were calculated.
  • each filter value detected in various users and environments was converted into a matrix form, and a Hankel matrix for the corresponding matrix was calculated to calculate a representative orthoganl basis.
  • the calculated orthogonal basis is shown in Figure 3.
  • 16 orthogonal bases are created, but in implementation, other orthogonal bases other than 16 can be used.
  • the orthogonal basis shown in FIG. 3 has an accuracy of 95% that can implement the actual filter values identically. If higher filter accuracy is required, the number of orthogonal bases can be increased, and the filter accuracy can be increased by 95%. If it can be lowered, the number of orthogonal bases can be reduced.
  • this orthogonal basis can express the ANC filter only with the above-described orthogonal basis and the weight values to be applied to the orthogonal basis, unlike before, only a very small number (for example, 8 to 16 weight values) needs to be calculated. , calculations can be performed even with low resources.
  • FIG. 4 is a diagram illustrating an example of implementation of a noise control filter according to an embodiment of the present disclosure.
  • the filter 500 includes a plurality of IIR filters 510, a plurality of FIR filters 520, and a plurality of weight units 530.
  • IIR filters 510 a plurality of IIR filters 510
  • FIR filters 520 a plurality of FIR filters 520
  • weight units 530 a plurality of weight units 530.
  • one biquad IIR filter To apply one orthogonal basis, one biquad IIR filter, two tap FIR filters, and two weight units are required. As described above, when using 16 basis, 16 biquad IIR filters, 32 tap FIR filters, and 32 weight units are required. In the above, the value of the Biquaed IIR filter was explained in terms of one orthogonal basis, but the tap FIR filter can also be expressed as one orthogonal basis. To express these 16 orthogonal basis, 8 biquad IIR filters, 16 tap FIR filters, and 16 weight units are used.
  • the above-described biquad IIR filter and tap FIR filter have fixed filter values when the orthogonal basis is determined, and the weight value of the weight portion may vary depending on changes such as wearing environment.
  • the filter 500 may generate an acoustic signal having an opposite wavelength to the noise signal based on the calculated weight value and the signal received from the outer microphone received from the external microphone.
  • the signals received from the external outer are sequentially input to each IIR filter, but since the IIR filters (or orthogonal basis in the present disclosure) are mutually orthogonal, any one may be processed first, and in parallel It is okay to be treated as an enemy.
  • FIG. 5 is a diagram illustrating an example of a noise control operation according to an embodiment of the present disclosure.
  • the feedforward ANC model 500 includes a first response characteristic 510, a second response characteristic 530, a filter 520, and a weight calculation unit (RLS, recursive least squares).
  • RLS weight calculation unit
  • first response characteristic 510 and the second response characteristic 530 are the same as the first response characteristic 210 and the second response characteristic 230 of FIG. 2, duplicate descriptions will be omitted.
  • the weight calculation unit 540 determines the weight value to be applied to each of the plurality of orthogonal basis filters based on the audio signal (d(n)) received through the inner microphone and the audio signal received through the outer microphone (x(n)). You can.
  • the weight calculation unit 540 may calculate a first response characteristic based on the two received audio signals, and use the calculated response characteristic to calculate a value to be applied to each of the plurality of weights.
  • the weight calculation unit 510 checks the value of the first response characteristic corresponding to each of the plurality of base bands, calculates a weight corresponding to the confirmed value, or calculates a weight value to be used using a pre-stored lookup table. can confirm.
  • the weight calculation unit 510 may check the specific component value of the response characteristic for each of the plurality of weights and calculate the weight value corresponding to the component value, or calculate the weight value using a pre-stored lookup table.
  • the weight value can be confirmed by checking not the value of one component, but the value of several components or the average value of several component values.
  • the filter 520 may include a plurality of orthogonal basis filters as described in FIG. 4, and may generate a cancellation acoustic signal by passing the audio signal received through the outer microphone through the plurality of orthogonal basis filters.
  • the signal that has passed through the IIR filter and the FIR filter is finally output with a weight applied to the corresponding signal, and the above-mentioned weight is optimized to a value corresponding to the first transfer characteristic and the second transfer characteristic as described above. Appropriate offset acoustic signals corresponding to the user's wearing characteristics can be generated.
  • the noise canceling operation using the feedforward method has been described above, it can also be applied to the feedback method when implemented, and can also be applied to the hybrid method in which feedforward and feedback are applied together.
  • the hybrid method in which feedforward and feedback are applied together.
  • FIG. 6 is a diagram illustrating an example of a noise control operation according to an embodiment of the present disclosure.
  • the hybrid ANC model 600 includes a first response characteristic 610, a second response characteristic 630, a filter 620, a weight calculation unit (RLS, recursive least squares) 640, and a correction module ( 650, 660).
  • the configurations of the first response characteristic 610, the second response characteristic 630, the filter 620, and the weight calculation unit 640 are the same as those in FIG. 5, so duplicate descriptions will be omitted.
  • the feedback FNC technology removes noise measured from the inner microphone, the low band of the sound source can be eliminated by feedback ANC. Therefore, in order to prevent low-band sound sources from being damaged, it is necessary to minimize loss of the sound source by implementing response characteristics between the speaker and the inner microphone.
  • This loss correction can be performed in two ways. First, in the filtering process, the filter value is modified to prevent the above-described damage in the low band. The other is to predict that the low band will be lost in the filtering and correct the sound source accordingly. The latter method is described below, but the former method can also be used when implementing. That is, the weight calculation unit 640 may calculate a weight value that takes the above-described loss into consideration when calculating the weight value.
  • the correction modules 650 and 660 estimate the second response characteristic and correct the content sound signal based on the estimated second response characteristic. These correction modules 650 and 660 may be composed of an estimation module 660 and a correction module 650.
  • Estimation module 660 may estimate the second response characteristic. Specifically, as in Equation 1, the filter may be calculated in proportion to the first response characteristic and the second response characteristic. If the filter estimates well the first response characteristic and the second response characteristic, conversely, it is also possible to calculate the second response characteristic using the first response characteristic and the characteristics of the filter.
  • the estimation module 660 can calculate the second response characteristic using the characteristic applied to the filter 620 and the first response characteristic.
  • the second response characteristic generated according to the present disclosure will be described later with reference to FIG. 7.
  • the correction module 650 may correct the content sound signal for the sound source using the estimated second response characteristic. At this time, the correction module 650 can perform correction only for the low-band region of the sound source.
  • FIG. 7 is a diagram illustrating second transmission characteristics estimated according to an embodiment of the present disclosure.
  • the second transmission characteristic is actually measured and the second transmission characteristic is estimated by the electronic device 100 according to the present disclosure described in FIG. 6 .
  • the estimated second transfer characteristics are very similar to the actual transfer characteristics.
  • Figure 8 is a block diagram illustrating the configuration of an electronic device according to an embodiment of the present disclosure.
  • the electronic device 100 may include an inner microphone 110, an outer microphone 120, a speaker 130, and a processor 140.
  • This electronic device 100 may be an earphone or headphone, but is not limited thereto.
  • the inner microphone 110 is disposed in the direction in which the speaker emits sound. Specifically, the inner microphone 110 is a microphone placed in the direction of the user's eardrum when the user wears the electronic device 100, and can collect sounds in the corresponding area and generate an audio signal.
  • the outer microphone 120 is disposed in a direction opposite to the inner microphone.
  • the outer microphone 110 is a microphone placed in the opposite direction of the user when the user wears the electronic device 100, and can generate audio signals around the user.
  • the inner microphone 110 and the outer microphone 120 are electronic devices that convert sound signals into electrical signals. These microphones can be implemented as dynamic microphones, condenser microphones, etc. Below, the use of two microphones is shown and explained, but when implemented, three or more microphones may be used.
  • the speaker 130 can output signal-processed sound. Specifically, the speaker 130 may output an offset sound signal transmitted from the processor, or may output an offset sound signal mixed with the content sound signal.
  • the processor 140 can control each component of the electronic device 100.
  • the processor 140 may control the outer microphone 120 and the inner microphone 110 to receive an external sound signal, and may control the speaker 130 to output a processed sound signal.
  • the processor 140 may control the electronic device 100 to perform only a general speaker function. That is, the speaker 130 can be controlled so that an audio signal corresponding to the audio content is output.
  • the processor 140 may control the inner microphone 110 and the outer microphone 120 to receive an audio signal.
  • the processor 140 confirms the weight value to be applied to each of the plurality of orthogonal basis filters based on the received audio signal (S1020). Specifically, the processor 140 confirms the first transmission characteristic between the inner microphone and the outer microphone and the second transmission characteristic between the speaker and the inner microphone based on the audio signals received from each of the inner microphone and the outer microphone, and confirms the confirmed A plurality of weight values to be applied to a plurality of orthogonal basis filters can be confirmed based on the first transfer characteristic and the second transfer characteristic.
  • the method for checking the filter and weight values used in the present disclosure has been previously described, so redundant description will be omitted.
  • the processor 140 generates an offset acoustic signal having an opposite wavelength to the noise signal using a plurality of orthogonal basis filters and the confirmed weight values (S1030).
  • the processor 140 outputs the generated offset sound signal through the speaker (S1040). At this time, the processor 140 may output both a content sound signal corresponding to the sound source content and a calculated offset sound signal.
  • the processor 140 checks the second transmission characteristic between the speaker and the inner microphone based on the audio signal received from each of the inner microphone and the outer microphone, and confirms the second transmission characteristic between the speaker and the inner microphone.
  • 2 Content sound signals can also be corrected based on transmission characteristics. Whether and the degree of correction for such sound source content may be applied differently depending on the user's settings.
  • the electronic device can adaptively change the noise canceling filter value by only checking the weight values to be applied to a plurality of orthogonal basis filters with different transmission characteristics, and can adapt to different external auditory canal shapes and various wearing conditions for each user. It can operate without deterioration in noise cancellation performance.
  • the filter value can be modified only by calculating 16 weight values, which enables faster calculation (or calculation with lower resources) compared to the existing method of calculating more than 16,000 filter parameters, requiring a quick response. It can also be applied to small audio devices with relatively low resources.
  • FIG. 9 is a block diagram illustrating the configuration of an electronic device according to an embodiment of the present disclosure.
  • the electronic device 100 may include an inner microphone 110, an outer microphone 120, a speaker 130, a processor 140, a communication device 150, and a memory 150. Since the configurations of the inner microphone 110, outer microphone 120, and speaker 130 are the same as those described in FIG. 8, detailed descriptions are omitted.
  • the communication device 150 communicates with an external device.
  • external devices may include AI speakers, smartphones, tablet PCs, laptop computers, wearable devices, Set-Top Box (STB), Optical Disc Drive (ODD), video players, game consoles, servers, clouds, etc. there is.
  • the communication device 150 can transmit and receive control signals, sound signals, etc. to and from external devices.
  • the communication device 150 may include a module capable of performing communication through 3G, LTE, 5G, Wi-Fi, Bluetooth, DMB, ATSC, DVB, LAN, etc.
  • the communication device 150 can receive music content from an external device.
  • the music content may be content encoded using a specific compression method, or may be decoded content.
  • the communication device 150 may also receive and play the streaming data or the content itself. It can also be received as a decompressed digital signal.
  • the communication device 150 is wired, that is, when the electronic device 100 is a wired earphone, it is also possible to receive an analog signal corresponding to music content.
  • the memory 160 stores data and algorithms that perform the functions of the electronic device 100, and may store programs and commands that run in the electronic device 100.
  • This memory 160 may be implemented in the form of ROM, RAM, SSD, memory card, etc. Additionally, although the processor 140 and the memory 160 are shown and described as being separate, the memory 160 may be mounted on the processor 140 when implemented.
  • the memory 160 may store calculation formulas or lookup tables necessary for calculating weight values.
  • the calculation formula or lookup table may be for calculating the second transfer characteristic or filter value, and it is also possible to store several pieces of information rather than a single lookup table or calculation formula. That is, the noise canceling function according to the present disclosure can support various modes. For example, a mode that removes all noise, a mode that does not remove noise of a specific frequency (e.g., other users' voices), a mode that removes only noise of a specific pattern (e.g., a car engine sound, an airplane engine sound, etc.), and the calculation formula or lookup table for each mode can be stored.
  • the processor 130 may control the communication device 150 to establish a wireless connection with another external device.
  • the processor 140 may control the speaker 130 to output sound corresponding to the sound source content received through the communication device 150.
  • the processor 140 may perform the noise canceling function (and canceling mode) based on the input information.
  • the electronic device 100 may further include other configurations in addition to the configuration described above.
  • it may further include a sensor for detecting whether the user is wearing it, a display for displaying the operating state of the electronic device 100, and a user interface device for receiving a user's control command.
  • the electronic device 100 is assumed to be a device such as an earphone or a headphone.
  • the electronic device 100 is a device such as an earphone and a smartphone. It could be a combination. That is, a microphone and speaker are attached to the earphones, the signal is transmitted to the smartphone by wired or wireless method, the smartphone performs the noise canceling function as described above, and the resulting sound signal is output to the speaker. It can also be implemented as:
  • FIG. 10 is a flowchart illustrating a method of controlling an electronic device according to an embodiment of the present disclosure.
  • an audio signal is received through an inner microphone disposed in the direction in which the speaker emits sound and an outer microphone disposed in a direction opposite to the inner microphone (S1010).
  • the weight value to be applied to each of the plurality of orthogonal basis filters is confirmed based on the received audio signal (S1020). Specifically, based on the audio signals received from each of the inner microphone and the outer microphone, first transmission characteristics between the inner microphone and the outer microphone and second transmission characteristics between the speaker and the inner microphone are confirmed, and the confirmed first transmission characteristics and Based on the second transfer characteristic, a plurality of weight values to be applied to the plurality of orthogonal basis filters can be confirmed.
  • a canceling acoustic signal having an opposite wavelength to the noise signal is generated using a plurality of orthogonal basis filters and the confirmed weight values (S1030).
  • the generated offset sound signal is output through the speaker (S1040). At this time, the content sound signal corresponding to the sound source content and the calculated offset sound signal can be output together.
  • the second transmission characteristic between the speaker and the inner microphone is confirmed based on the audio signal received from each of the inner microphone and the outer microphone, and based on the confirmed second transmission characteristic
  • the content sound signal can be corrected. Whether and the degree of correction for such sound source content may be applied differently depending on the user's settings.
  • the control method according to the present disclosure can adaptively change the noise canceling filter value by only checking the weight values to be applied to a plurality of orthogonal basis filters with different transmission characteristics, and can adapt to different external auditory canal shapes and various wearing conditions for each user. It can operate without deterioration in noise cancellation performance.
  • the filter value can be modified only by calculating 16 weight values, which enables faster calculation (or calculation with lower resources) compared to the existing method of calculating more than 16,000 filter parameters, requiring a quick response. It can also be applied to small audio devices with relatively low resources.
  • a control method of an electronic device may be provided as a computer program product.
  • a computer program product may include the S/W program itself or a non-transitory computer readable medium in which the S/W program is stored.
  • a non-transitory readable medium refers to a medium that stores data semi-permanently and can be read by a device, rather than a medium that stores data for a short period of time, such as registers, caches, and memories.
  • the various applications or programs described above may be stored and provided on non-transitory readable media such as CD, DVD, hard disk, Blu-ray disk, USB, memory card, ROM, etc.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Signal Processing (AREA)
  • Health & Medical Sciences (AREA)
  • Otolaryngology (AREA)
  • General Health & Medical Sciences (AREA)
  • Computational Linguistics (AREA)
  • Quality & Reliability (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Human Computer Interaction (AREA)
  • Multimedia (AREA)
  • Manufacturing & Machinery (AREA)
  • Soundproofing, Sound Blocking, And Sound Damping (AREA)
  • Circuit For Audible Band Transducer (AREA)

Abstract

Un dispositif électronique est divulgué. Le présent dispositif électronique comprend : un haut-parleur ; un microphone interne disposé dans la direction dans laquelle le haut-parleur émet du son ; un microphone externe disposé dans la direction opposée à celle du microphone interne ; et un processeur, qui identifie un signal de bruit à l'aide de signaux audio entrés à travers le microphone externe et le microphone interne, génère un signal acoustique de décalage ayant la longueur d'onde opposée du signal de bruit identifié à l'aide d'un filtre comprenant une pluralité de filtres de base orthogonaux, et commande le haut-parleur de sorte que le signal acoustique de décalage généré soit émis, le processeur identifiant, sur la base du signal audio reçu par l'intermédiaire du microphone interne et du signal audio reçu par l'intermédiaire du microphone externe, une valeur de pondération à appliquer à chaque filtre de bases orthogonal de la pluralité de filtres de base orthogonaux, et génère un signal acoustique de décalage à l'aide de la pluralité de filtres de base orthogonaux et de la valeur de pondération.
PCT/KR2023/008941 2022-08-17 2023-06-27 Dispositif électronique et procédé de commande associé WO2024039049A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR10-2022-0102872 2022-08-17
KR1020220102872A KR20240024638A (ko) 2022-08-17 2022-08-17 전자 장치 및 그 제어 방법

Publications (1)

Publication Number Publication Date
WO2024039049A1 true WO2024039049A1 (fr) 2024-02-22

Family

ID=89942040

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2023/008941 WO2024039049A1 (fr) 2022-08-17 2023-06-27 Dispositif électronique et procédé de commande associé

Country Status (2)

Country Link
KR (1) KR20240024638A (fr)
WO (1) WO2024039049A1 (fr)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020080980A1 (en) * 1997-06-26 2002-06-27 Naoshi Matsuo Microphone array apparatus
JP2007517242A (ja) * 2003-11-26 2007-06-28 ザ リージェンツ オブ ザ ユニバーシティ オブ カリフォルニア フィードフォワードおよびフィードバック制御器を含むアクティブ雑音制御方法および装置
KR20150005924A (ko) * 2013-05-22 2015-01-15 고어텍 인크 강한 노이즈 환경 하에서의 헤드셋 통신 방법 및 헤드셋
KR101678305B1 (ko) * 2015-07-03 2016-11-21 한양대학교 산학협력단 텔레프레즌스를 위한 하이브리드형 3d 마이크로폰 어레이 시스템 및 동작 방법
KR102087827B1 (ko) * 2019-03-25 2020-03-10 윤정순 동시 통역/번역 기능을 겸비한 멀티 헤드셋 장치

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020080980A1 (en) * 1997-06-26 2002-06-27 Naoshi Matsuo Microphone array apparatus
JP2007517242A (ja) * 2003-11-26 2007-06-28 ザ リージェンツ オブ ザ ユニバーシティ オブ カリフォルニア フィードフォワードおよびフィードバック制御器を含むアクティブ雑音制御方法および装置
KR20150005924A (ko) * 2013-05-22 2015-01-15 고어텍 인크 강한 노이즈 환경 하에서의 헤드셋 통신 방법 및 헤드셋
KR101678305B1 (ko) * 2015-07-03 2016-11-21 한양대학교 산학협력단 텔레프레즌스를 위한 하이브리드형 3d 마이크로폰 어레이 시스템 및 동작 방법
KR102087827B1 (ko) * 2019-03-25 2020-03-10 윤정순 동시 통역/번역 기능을 겸비한 멀티 헤드셋 장치

Also Published As

Publication number Publication date
KR20240024638A (ko) 2024-02-26

Similar Documents

Publication Publication Date Title
WO2013020380A1 (fr) Procédé et dispositif d'amélioration de parole de casque d'écoute de communication, et casque d'écoute de communication à réduction de bruit
WO2018101639A1 (fr) Procédé de détection de mauvais positionnement d'écouteur, et dispositif électronique et support d'enregistrement associés
EP3682649A1 (fr) Procédé et système de contrôle non linéaire du mouvement d'un pilote de haut-parleur
WO2020166944A1 (fr) Dispositif de sortie de sons comprenant une pluralité de microphones et procédé de traitement de signaux sonores à l'aide d'une pluralité de microphones
WO2020155088A1 (fr) Procédé de réduction de bruit pour écouteur, écouteur bluetooth intelligent et support de stockage lisible par ordinateur
WO2016154868A1 (fr) Système de vol, appareil volant, appareil sonore et procédé de traitement de son
WO2018147573A1 (fr) Écouteur à élimination de bruit utilisant des caractéristiques de réception de son en provenance d'un microphone intra-auriculaire et d'un microphone sur l'oreille et procédé d'élimination de bruit
EP4029008B1 (fr) Synchronisation d'une atténuation d'instabilité dans des dispositifs audio
WO2020032333A1 (fr) Commande non linéaire de systèmes de haut-parleur avec amplificateur de source de courant
WO2020076013A1 (fr) Annulation active du bruit (anc) sur la base d'une plateforme mobile
EP3583783A1 (fr) Procédé et appareil d'optimisation de puissance sonore basse fréquence dans une pièce
US11250833B1 (en) Method and system for detecting and mitigating audio howl in headsets
WO2023098401A1 (fr) Écouteur comportant une fonction de réduction active du bruit et procédé de réduction active du bruit
WO2024039049A1 (fr) Dispositif électronique et procédé de commande associé
JP2009232205A (ja) 信号処理装置、信号処理方法
CN112235683B (zh) 一种受送话器和环境声音降噪方法
EP3991452A1 (fr) Égalisation personnalisée de casque d'écoute
WO2018164440A1 (fr) Procédé de blocage du bruit dans un oreiller à suppression du bruit et oreiller à suppression du bruit
KR20140006394A (ko) 이어폰 및 헤드폰의 주변 환경 소음저감 처리 장치
WO2020040541A1 (fr) Dispositif électronique, procédé de commande associé et support d'enregistrement
WO2022025452A1 (fr) Dispositif électronique et procédé de fonctionnement de dispositif électronique
US11853642B2 (en) Method and system for adaptive volume control
CN115396774A (zh) 主动降噪方法和主动降噪耳机
WO2021162337A1 (fr) Procédé d'amélioration de la qualité du son et dispositif portable à l'oreille
WO2023063627A1 (fr) Dispositif électronique de commande de son ambiant sur la base d'une scène audio, et son procédé de fonctionnement

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 23855020

Country of ref document: EP

Kind code of ref document: A1