TWI540915B - Audio signal output device, method of processing an audio signal, and headset - Google Patents

Description

Audio signal output device, method for processing an audio signal, and headset

The various embodiments of the present invention relate generally to the field of audio signal processing, and more particularly to an instant adaptive head-related transfer function (HRTF) system.

Advances in digital signal processing (DSP) have led to a proliferation of hardware (HW) and software (SW) development/solutions for a variety of sound systems, from traditional 2.1 sound systems up to including heads A virtual 7.1 sound system with a headphone/headset. In particular, a large number of variations have occurred in headset/headset groups by utilizing these new DSP technologies to a large extent. Users of headsets, headsets and ear buds are seeing virtualization versions 5.1 and 7.1 available. These extended versions require greater sound/sound processing power to achieve the desired sound (sound) results that closely match the actual 5.1 and 7.1 sounds and achieve optimized sound effects for gaming purposes.

Figure 1 shows a top plan view of a user 100 wearing a headset (or headset) 102. The head-related transfer function (HRTF) at the right earphone 104 and the left earphone 106 of the headset 102 is represented by H _RR 108 and H _LL 110, respectively, and H _RR 108 and H _LL 110 are used to represent the right ear. And the left ear will perceive the direct transmission or sound effect pulse. Ideally, in a contained environment, there should be no crosstalk between the right earphone 104 and the left earphone 106, ie HRTF (H _RL 112) from the right earphone to the left earphone and from the left earphone to The HRTF (H _LR 114) of the right earphone is zero. The right earphone 104 and the left earphone 106 are independent of each other. However, it should be understood that in practice, the audio signal may have inherent crosstalk that may affect the sound perceived by the user.

Although progress has been made in the implementation of the HRTF, these advancements are based on the "fixed model" of the implementation. This means that these implementations are not adaptive and do not take into account the physical aspects of environmental noise or the ears of a human listener (or user). The listener's outer ear configuration or structure (or auricle) may exacerbate the problem by applying an "amplification and/or attenuation factor" associated with the human auditory sensitivity to the incoming sound effect feature (or signal). Figure 2 shows a schematic diagram of the listener's ear 200. The auricle 202 of the listener's ear 200 acts as a receiver for transmitting the incoming sound effect signal 204 into the eardrum 208 via an auditory canal 206. Since the acoustic energy propagates according to the inverse square law, a larger receiver (such as a large auricle 202) picks up more energy, which in turn amplifies human hearing sensitivity by about 2 or 3 Factor.

Due to the fixed nature of current HRTF implementations, regardless of the environment (eg, environmental noise), the variability of the size and shape of a given listener/inner ear canal, a headset (eg, related to the external/inner ear canal) The variable position of the sound driver in the headset 102) shown in Fig. 1 cannot be adjusted for the variables that are known to exist and adjusted for these variables.

Therefore, it is desirable to provide a method and apparatus for integrating in a sound device such as a headset, a headset, and a headset, and an instant adaptive sound adjustment system that significantly improves the perceived sound quality, thereby attempting to Solve at least the above problems.

In a first aspect, the present invention relates to a method for processing an audio signal, the method comprising: outputting a first portion of a first sound signal; and picking the first portion of the first sound signal as a second sound effect Transmitting a second portion of the first sound effect signal and the second sound effect signal; modifying the second portion of the first sound effect signal according to the comparison result; and outputting the modified first sound signal of the first sound effect signal Two parts.

According to a second aspect, the present invention relates to an audio signal output device, the audio signal output device includes: a speaker for outputting a first portion of a first sound signal; and a microphone for picking up the first sound effect Signal The first part is a second sound effect signal; a comparator is configured to compare the second part of the first sound effect signal with the second sound effect signal; and a circuit for modifying the first sound effect signal according to the result of the comparison The second portion; wherein the speaker is further configured to output the modified second portion of the first sound effect signal.

In a third aspect, the present invention relates to a headset set comprising: a pair of earphones; one or more speakers located in each of the earphones; and a microphone located at least in the pair of earphones One of the speakers; wherein the speaker is substantially centrally located within the earphone; and wherein the microphone is positioned adjacent to the speaker.

100‧‧‧Users

102‧‧‧Headphones

104‧‧‧right headphones

106‧‧‧Left headphones

108‧‧‧HRTF/H _RR at the right earphone

110‧‧‧ HRTF/H _LL at the left earphone

112‧‧‧HRTF/H _RL from right earphone to left earphone

114‧‧‧HRT/H _LR from left earphone to right earphone

200‧‧‧ Ears

202‧‧‧Aurora

204‧‧‧Audio signal

206‧‧‧ Listening

208‧‧‧ tympanic membrane

300‧‧‧Input signal

302‧‧‧Required transfer function D

304‧‧‧Adaptive Filter A

306‧‧‧ required signal

308‧‧‧Measured signals

310‧‧‧ Comparator

312‧‧‧ Error signal

314‧‧‧Real transfer function R

316‧‧‧ drive signal

400‧‧‧ Original sound stream (or signal)

402‧‧‧System

404‧‧‧DSP function

406‧‧‧Modified sound stream (or signal)

408‧‧‧ left earphone

410‧‧‧right headphones

412‧‧‧ wearing group

414‧‧‧ direction symbol

416‧‧‧ arrow

418‧‧‧ arrow

420‧‧‧Microphone MIC "L"

422‧‧‧Microphone MIC "R"

424‧‧‧MIC (L/R) sound signal

426‧‧‧ comparator

428‧‧‧Comparative results

430‧‧‧ phase shifter

432‧‧‧ phase shifter

500‧‧‧ method

502~510‧‧‧Steps

600‧‧‧Audio signal output device

602‧‧‧Speaker

604‧‧‧Microphone

606‧‧‧ comparator

608‧‧‧ Circuit

700‧‧‧ head group

702‧‧‧ headphone

704‧‧‧Speaker

706‧‧‧ microphone

800‧‧‧Instance headphones

802‧‧‧ speaker

804‧‧‧Speaker/Driver

806‧‧‧Speaker/Driver

808‧‧‧Speaker

810‧‧‧Speaker/Driver

820‧‧‧ (sound) driver

822‧‧‧ (sound) driver

824‧‧‧ (sound) driver

826‧‧‧ (sound) driver

828‧‧‧ (sound) driver

830‧‧‧The preferred (or ideal) position of the MEMS microphone

832‧‧‧ center axis

840‧‧‧Area

842‧‧‧Area

844‧‧‧Area

900‧‧‧Modified sound signal

902‧‧‧Modified sound signal

904‧‧‧ Original sound signal

906‧‧‧ original sound signal

In the drawings, like reference characters generally refer to the The drawings are not necessarily to scale, For the sake of clarity, the dimensions of various features/components can be arbitrarily expanded or reduced. In the following description, various embodiments of the present invention will be described with reference to the following drawings in which: FIG. 1 shows a top view of a user wearing a headset (or a headset) and the headset HRTF of the receiver (or headset); Figure 2 shows a schematic diagram of a listener's ear; Figure 3 shows a block diagram of an exemplary instant adaptive reverse filtering process in accordance with various embodiments; An exemplary overview of a combination (or a modified combination) of one of the existing DSP HW techniques and a unique SW/algorithm of an embodiment that achieves a particular implementation; FIG. 5 shows a process one in accordance with various embodiments A flowchart of a method for sound signal; FIG. 6 is a schematic block diagram of an audio signal output device according to various embodiments; and FIG. 7 is a schematic block diagram of a headset according to various embodiments; FIG. 8A A side cross-sectional view showing an exemplary headset of one of the headsets in accordance with various embodiments; FIG. 8B shows an exemplary headset of one of the headsets in accordance with various embodiments. A side cross-sectional view showing the position of various drivers; FIG. 8C is a side cross-sectional view showing an exemplary earphone of a headset according to various embodiments, showing one of the MEMS microphones being preferred (or ideal) Position; FIG. 8D is a side cross-sectional view showing an exemplary earphone of one of the headsets in accordance with various embodiments, illustrating possible regions in which a MEMS microphone can be positioned and effects thereof; and FIG. 9 in accordance with various embodiments The modified sound signal based on a value correction factor and the corresponding original sound signal are displayed in the frequency range of (A) left ear and (B) right ear in the range of 100 Hz to 20 kHz.

The detailed description of the embodiments of the invention may be These embodiments are described in sufficient detail to enable those skilled in the art to practice the invention. Other embodiments may be utilized and structural and logical changes may be made without departing from the scope of the invention. The various embodiments are not necessarily mutually exclusive, as some embodiments may be combined with one or more other embodiments to form new embodiments.

The specific embodiments are illustrated by way of example and not limitation,

The unique modification or implementation of the head related transfer function (HRTF) continues to evolve. Various embodiments provide a combination (or a combination of improvements) of existing DSP HW technology and a unique SW/algorithm that can achieve a particular implementation. The manner in which the various HW and SW components are arranged in the earphone and integrated on the SW level allows the original audio stream to be changed (i.e., modified) by applying complex instant signal processing to the sound effects of the listener's ear. To make the listening experience clearer (or purer). This ensures that the perceived sound is matched as closely as possible to the original/original sound stream that you want to hear.

Various embodiments include a unique combination or blending of sound DSP technology with one of the microphone components located in the earphone, such that the earphone picks up the right/left sound signal by bounces the sound out of the external auditory canal and then performs the original/original sound effect left sound The track is compared to one of the right channels. Instant adaptive DSP technology calls and changes the original original sound stream at the DSP level and ensures that the perceived sound characteristics at the outer ear match the original/original sound flow as closely as possible.

Various embodiments provide frequency correction to the original original sound stream based on one of the unique HW drivers in the headset of the headset. The frequency correction can be correlated or associated with other algorithmic functions, such as amplitude correction (ie, amplification correction or attenuation correction) and phase shift correction (or delay correction). Figure 3 shows a block diagram of an exemplary instant adaptive reverse filtering process. In Fig. 3, an input signal 300 is fed into a desired transfer function D 302 and an adaptive filter A 304. The output from the desired transfer function D 302 is a desired signal 306, and a comparator 310 compares the desired signal 306 with a measured signal 308 to provide an error signal 312. The measured signal 308 is derived from the output of a real transfer function R 314, which accepts a drive signal 316 as its input. Drive signal 316 is then derived from the output of adaptive filter A 304, which has filter parameters modified according to error signal 312. The adaptive filter as shown in Fig. 3 is an example of a specific basic algorithm for adaptively processing one of the audio signals in real time.

In other words, for example, wave synthesis can be performed by comparing a baseline line audio wave with a reflected sound wave from one of the microphones provided in each earphone. A microphone can be placed at various locations in each headset. However, when placed at certain locations or strategic locations, the microphone can receive, for example, a maximum level of reflected sound waves, thereby enhancing pickup of the desired audio signal for processing.

The wave synthesis can be applied immediately and is, for example, the process shown in FIG. 3: digitally sampling the original sound wave or the incoming sound wave in the process and then combining it with one of the reflected sound waves from each earphone Digital samples were compared. A third or sound wave is generated after applying a correction factor (ie, amplification, attenuation, phase shifting, delay, echo, and/or noise cancellation). The wave synthesis applies the correction factor instantaneously and produces a unique third sound wave that is reconstructed by applying a correction factor to approximate the initial or original sound wave as closely as possible.

Figure 4 shows the existing DSP HW technology and unique SW/algorithm An exemplary overview of a combination (or a modified combination) that achieves a particular implementation.

In FIG. 4, an original sound stream (or signal) 400 is input to a system 402 that includes a DSP function 404. System 402 can be, but is not limited to, an external sound PUCK/MICX amplifier. The original sound stream 400 can be modified by the DSP function 404 into a modified sound effect stream (or signal) 406, and the system 402 outputs the modified sound effect stream (or signal) 406. The DSP function 404 can also be used to perform a certain amount of processing (such as echo and/or noise cancellation) for amplitude changes, attenuation, and/or other signal anomalies. The modified sound effect stream 406 is then fed into the left earphone 408 and the right earphone 410 of a wearing set 412. A user (not shown in FIG. 4) positions his/her head between the left earphone 408 and the right earphone 410, as indicated by a direction symbol 414. The earphones 408, 410 can be positioned against the respective ears of the user (not shown in Figure 4), as indicated by arrows 416, 418, respectively.

One of the microphones 420 (MIC "L") of the left earphone 408 and one of the microphones 422 (MIC "R") of the right earphone 410 respectively pick up a MIC (L/R) sound effect signal 424, MIC (L/R) sound effect signal. 424 is fed back to a comparator 426. The comparator 426 also receives the original sound effect stream 400 and compares the original sound effect stream 400 with the MIC (L/R) sound effect signal 424. Comparator 426 outputs comparison result 428, which is fed back into system 402. System 402 receives result 428 and modifies original sound effect stream 400 based on result 428.

In order for the comparator 426 to perform a comparison of the MIC (L/R) sound effect signal 424 with respect to the corresponding original sound effect stream 400, a delay is introduced by the phase shifter 430 to the original sound effect stream 400 before the original sound effect stream 400 enters the comparator 426. Thereby a form of timing synchronization is provided between the two signals for comparison.

In order for system 402 to perform a modification to original sound effect stream 400 based on the corresponding comparison result 428, another delay is introduced by another phase shifter 432 to comparison result 428 before comparison result 428 enters system 402, thereby A form of timing synchronization is provided between the signals for modification.

For the example shown in Figure 4, all audio signals can be digital signals.

In other instances, some audio signals may be analog or digital in some processing steps. For example, the original sound stream can be an analog sound stream or a digital sound stream. If the original sound stream is an analog sound stream, the system converts the original sound stream into a digital signal, and the DSP function can be applied.

In a first aspect, a method 500 of processing an audio signal is provided, as shown in FIG. In 502, a first portion of one of the first sound effects signals is output. For example, the first portion of the first sound effect signal can refer to the modified sound effect stream 406 shown in FIG. 4, and the first sound effect signal can refer to the original sound effect stream 400 shown in FIG. The first part of the first sound signal refers to an audio signal within a period of time (eg, denoted as X). The term "sound effect signal" may be interchangeably referred to as "sound effect stream", which may refer to any sound effect signal from any sound source source (eg, an audio track).

In 504, the first portion of the first sound effect signal is picked up as a second sound effect signal. For example, the second sound effect signal may refer to the MIC (L/R) sound effect signal 424 shown in FIG. The term "pickup" as used herein may be taken in a generic sense.

In 506, comparing the second part of the first sound effect signal with the second sound effect signal. For example, the second portion of the first sound effect signal can refer to a sound effect based on the original sound effect stream 400 shown in FIG. 4 and fed to the input of one of the comparators 426 via the system 402 having the DSP function 404. Signal. In another example (not shown), the second portion of the first sound signal may be based on one of the original sound effects and fed to the comparator without passing through the DSP-enabled system. One of the inputs.

In 508, the second portion of the first sound effect signal is modified according to the comparison result. For example, the comparison result refers to the comparison result 428 shown in FIG.

As used herein, the term "modification" means, but is not limited to, changing, adjusting, amplifying, or attenuating. For example, the second portion can be modified by amplifying the amplitude of the second portion of the first sound effect signal according to the comparison result, and the comparison result can be an amplification correction factor. In another non-limiting example, The second portion is modified by changing the frequency of the second portion of the first sound effect signal as a result, and the comparison result may be a frequency correction factor. It will be appreciated that modifications may be in any combination of variations or variations depending on the result of the comparison. This modification can be referred to as an adaptive modification due to the feedback mechanism. The purpose of this modification is to match one of the sound signals perceived at the outer ear of a user to the original/original sound effect as closely as possible.

In 510, the modified second portion of the first sound effect signal is output.

For example, the modified second portion of the first sound effect signal can refer to the modified sound effect stream 406 shown in FIG. 4 within another time period (eg, denoted as Y). In one example, time periods X and Y can be tied to adjacent time periods. In another example, at least some portions of time periods X and Y may overlap.

In various embodiments, the output step in 502, 510, the picking step in 504, the comparing step in 506, and the modifying step in 508 are repeated at a predetermined time interval that allows the sound effect to be processed substantially instantaneously Signal. For example, after the modified second portion of the first sound effect signal is output in 510, the step provided by the method 500 may be repeated to modify the second portion of the first sound effect signal. The first part of the first sound effect signal in 502. In this case, the first portion of the first sound effect signal refers to an audio signal within the other time period (eg, represented as Y).

Method 500 can be repeated at regular intervals or continuously to provide substantially instantaneous sound signal processing. It should be appreciated and understood that the term "substantial" may include "accurately" and "similar", and "similar" may be understood to be "accurate" to a certain extent. For purposes of illustration only and not as a limiting example, the term "substantial" may be quantified to one or more of +/- 5% of the change relative to the actual or actual. For example, the phrase "A (at least) substantially identical to B" can include embodiments in which A is exactly the same as B or a variation in which A can be +/- 5% (eg, a value) of B Within the scope and vice versa.

In various embodiments, the step of outputting the first portion of the first sound effect signal at 502 can include outputting the first portion of the first sound effect signal via a speaker of a headset.

In the context of various embodiments, the term "headset" may refer to a device having one or more earphones, which typically have a headband to place the one or more earpieces Keep on the ears of a user. In some instances, the term "headset" interchangeably refers to a headset, an ear piece, an earpiece, or a receiver.

In one example, a headset includes an earpiece in the form of an earphone (e.g., earphones 408, 410 shown in FIG. 4). Each earphone can include a cushion that surrounds the outer circumference of the earphone. When a user places the headset on the ear, the cushion covers the ear to provide a closed environment around the ear so that an audio signal is directed into the ear canal.

As used herein, the term "speaker" generally refers to any general form of sound effect transmitter and is interchangeably referred to as a loudspeaker. The speaker can include an audio driver. The speaker can be mounted in the headset of the headset.

In various embodiments, the step of picking the first portion of the first sound effect signal as the second sound effect signal in 504 may include: receiving the first portion of the first sound effect signal by a microphone. The microphone can be strategically positioned within the headset, the microphone receiving the highest level of audio signal and/or the microphone receiving a similar sound signal received by the ear canal of one of the wearers.

As used herein, the term "microphone" generally refers to any general form of sound effect receiver. For example, the microphone can be a microelectromechanical system (MEMS) microphone. A MEMS microphone is typically a microphone chip or a microphone. To form a MEMS microphone, a pressure sensitive diaphragm is directly etched into a wafer by MEMS technology, and the pressure sensitive diaphragm is usually accompanied by a phase integrated preamplifier. Most MEMS microphones are variations of capacitive microphone designs. MEMS microphones often have an analog-to-digital converter (ADC) circuit built into the same CMOS chip, which makes the chip a digital microphone and therefore easier to integrate with digital products. MEMS microphones are typically compact and small in size and can receive audio signals over a wide range of transmission angles. MEMS microphones are also in A flat response in a large frequency range.

In various embodiments, the microphone can be located in one of the headsets of the headset, and when a wearer wears the headset, the microphone can be positioned substantially adjacent to the wearer's ear canal entrance. .

The term "wearer" as used herein is used interchangeably as "user." The term "substance" can be as defined above. In this context, the term "nearby" refers to a close proximity that causes the microphone and the ear canal to receive at least similar sound effects. The term "ear canal" refers to the ear canal.

In various embodiments, the second sound effect signal may include one of the headphone group's left channel sound effect signal and one right channel sound effect signal. For example, the left channel sound signal and the right channel sound signal may refer to the MIC (L/R) sound effect signal 424 shown in FIG.

In an embodiment, the second sound signal may further include a noise signal.

The phrase "noise signal" as used herein generally refers to any undesired signal that may include unwanted audio signals and/or electrical noise caused by various electronic components such as microphones or electrical conductors. Signal. Electrical noise signals may include, for example, crosstalk, thermal noise, shot noise. Undesirable sound effects can include, for example, sounds from the environment.

In various embodiments, the first portion of the first sound effect signal can include one of the first portions of the first sound effect signal. In the context of various embodiments, the term "reflection" refers to an echo.

In one embodiment, the reflecting of the first portion of the first sound effect signal can include the first portion of the first sound effect signal being reflected from one of at least a portion of an auricle of one of the wearers of the wearing set. The reflected signal can be adjusted by processing the echo and noise cancellation correction factors.

As used herein, the term "auricle" refers to an ear structure that forms a unique ear shape of a person.

For example, when a wearer (or user) wears a headset, the audio signal is output from the speaker of the headset and propagates to the ear. The part of the sound signal The minute can enter the ear canal, and the rest of the sound signal can reach the auricle of the ear. The other portions of the sound signal or portions thereof may bounce or reflect from the surface of the auricle and may be picked up by the microphone.

In another example, a portion of the sound signal can enter the ear canal, and other portions of the sound signal can reach the surface of the earphone that together with the ear form a surface of at least substantially enclosed area. The other portions of the sound signal or portions thereof may bounce or reflect from the surface of the earphone and be picked up by the microphone.

In various embodiments, the step of comparing the second portion of the first sound effect signal with the second sound effect signal in 506 can include performing at least one of: comparing the second portion of the first sound effect signal a value and a magnitude of the second sound signal to obtain a value correction factor, comparing a frequency of the second portion of the first sound signal with a frequency of the second sound signal to obtain a frequency correction factor Or comparing a phase of one of the second portions of the first sound effect signal with one of the second sound effect signals to obtain a phase correction factor.

For example, the amplitude correction factor, the frequency correction factor, and/or the phase correction factor may be the comparison result 428 shown in FIG.

The term "comparison" may mean, but is not limited to, obtaining a difference between two or more signals. For example, the term "comparison" may also include a weighting or a multiplication factor applied to the difference.

In various embodiments, the step of modifying the second portion of the first sound effect signal in 508 can include modifying the first one according to at least one of the amplitude correction factor, the frequency correction factor, or the phase correction factor. The second part of the sound signal. For example, the magnitude correction factor, or the frequency correction factor, or the phase correction factor, or a combination of the amplitude correction factor and the frequency correction factor, or the amplitude correction factor and the phase correction factor may be Combining, or combining the phase correction factor with the frequency correction factor, or the amplitude correction factor and the combination of the frequency correction factor and the phase correction factor to modify the second portion of the first sound effect signal.

In various embodiments, the step of modifying the second portion of the first sound effect signal in 508 may include: increasing or decreasing the second portion of the first sound effect signal One of the amplitudes, a frequency or a phase of at least one of the parts.

In various embodiments, the step of modifying the second portion of the first sound effect signal in 508 can include modifying the second portion of the first sound effect signal according to a Head Related Transfer Function (HRTF).

In the context of various embodiments, a head-related transfer function (HRTF) is a response that characterizes how an ear receives a sound from a point in space. One of the binaural pairs of HRTFs can be used to synthesize a binaural sound that appears to be from a particular point in space. In general, the HRTF is a transfer function used to describe how sound from one of a particular point reaches the ear or auricle.

In various embodiments, the second portion of the first sound effect signal is modified in accordance with a dynamic HRTF. In other words, the dynamic HRTF changes based on a number of factors (eg, one of the ear positions changes and/or one of the received sound effects signals changes). This is in contrast to existing HRTFs that are static and unchanged. For example, existing stereo systems can perform their corresponding signal processing using a static HRTF.

In various embodiments, the method 500 can further include: adding a delay to the second portion of the first sound effect signal before comparing the second portion of the first sound effect signal with the second sound effect signal in 506.

This delay can be performed by a phase shifter such as phase shifter 430 shown in FIG. The purpose of adding a delay is to provide a timing synchronization form between the two signals for comparison so that the second sound signal can be compared with the corresponding portion of the first sound signal.

In various embodiments, method 500 can further include adding another delay to the comparison result prior to modifying the second portion of the first sound effect signal in 508.

This other delay can be performed by a phase shifter such as phase shifter 432 shown in FIG. The purpose of adding the further delay is to provide a timing synchronization form between the signals for modification, and the second portion of the first sound signal can be modified according to the corresponding comparison result.

In various embodiments, the second portion of the first sound effect signal can be It is an analog signal or a digital signal. If the second portion of the first sound effect signal is an analog signal, the method 500 may further include: converting the analogous second portion of the first sound effect signal into a digital signal. The digital signal can be in any format, for example, represented by a parallel bit or a string of bits, and can have any resolution, such as, but not limited to, an 8-bit representation, a 16-bit representation, a 32-bit representation, 64. A bit representation, or other representation that is higher than a 64-bit representation.

In a second aspect, an audio signal output device 600 is provided, as shown in FIG. The sound signal output device 600 includes: a speaker 602 for outputting a first portion of a first sound effect signal; a microphone 604 for picking up the first portion of the first sound effect signal as a second sound effect signal; a comparator 606, configured to compare the second portion of the first sound effect signal with the second sound effect signal; and a circuit 608, configured to modify the second portion of the first sound effect signal according to the comparison result; wherein the speaker 602 is further used And outputting the modified second part of the first sound effect signal.

For example, the speaker 602 can be the corresponding speaker as seen in the left earphone 408 and the right earphone 410 shown in FIG. Microphone 604 can be as defined above and can be a microphone MIC "L" 420 or microphone MIC "R" 422 as shown in FIG. Comparator 606 can refer to comparator 426 shown in FIG. Comparator 606 can be a summing circuit and can be a digital comparator (i.e., a comparator for comparing digital signals). Circuitry 608 can refer to system 402 having DSP functionality 404 as shown in FIG.

In other examples, circuit 608 can be integrated into an earphone (eg, left earphone 408 and/or right earphone 410 shown in FIG. 4).

In the context of various embodiments, a "circuit" can be understood to be any type of logical execution entity, which can be a dedicated circuit or a software for executing a memory, firmware, or any combination thereof. processor. Thus, a "circuit" can be a hard-wired logic circuit or a programmable logic circuit, such as a programmable processor (eg, a microprocessor (eg, a complex instruction set computer (eg, a complex instruction set computer ( Complex Instruction Set Computer; CISC) processor or a Reduced Instruction Set Computer (RISC) Processor)). A "circuit" can also be a processor for executing software (eg, any type of computer program, such as a computer program using a virtual machine code (eg, Java or a digital signal processing algorithm). Any other type of implementation of the corresponding function can also be understood as a "circuit" in accordance with an alternative aspect of the invention.

In various embodiments, speaker 602, microphone 604, comparator 606, and circuitry 608 can be used to repeatedly operate at predetermined time intervals that allow for substantially instantaneous sound signal processing.

The term "substance" is defined as above. The term "instant" refers to a time frame in which a time frame can be accepted by a user and perceived as being similar or equivalent to the actual clock time. "Instant" may also refer to a deterministic time in response to a real-world event or transaction in which there is no strict time-related requirement. For example, in this context, "instant" may refer to an operation or event that occurs a few microseconds, milliseconds, seconds, or even minutes.

In an example, the predetermined time interval can be, but is not limited to, about 1 microsecond to about 100 microseconds, or about 10 microseconds to about 50 microseconds, about 1 millisecond to about 100 milliseconds, or about 10 milliseconds to about 50 milliseconds, ranging from about 1 second to about 10 seconds.

The term "repetitively" refers to repeated execution.

The terms "microphone", "first part of the first sound signal", "second sound signal", "second part of the first sound signal", "comparison", "modification", "comparison result" and "first sound effect" The second part of the modified signal may be as defined above.

In various embodiments, the comparator 606 can be configured to perform at least one of comparing the amplitude of the second portion of the first sound effect signal with the amplitude of the second sound effect signal to obtain a magnitude correction. Comparing a frequency of the second portion of the first sound effect signal with a frequency of the second sound effect signal to obtain a frequency correction factor, or comparing a phase of the second portion of the first sound effect signal with the first One phase of the two-effect signal obtains a phase correction factor.

The phrase "amplitude correction factor", "frequency correction factor" and "phase correction factor" may be as defined above.

In various embodiments, circuit 608 can be configured to modify the second portion of the first sound effect signal based on at least one of the amplitude correction factor, the frequency correction factor, or the phase correction factor. For example, circuit 608 can be used to increase or decrease at least one of a magnitude, a frequency, or a phase of the second portion of the first sound effect signal. The circuit 608 can also be configured to modify the second portion of the first sound signal according to a Head Related Transfer Function (HRTF).

The phrase "HRTF" can be as defined above.

In various embodiments, the audio signal output device 600 can further include: a phase shifter for adding a delay to the second portion of the first sound effect signal.

In other embodiments, the audio signal output device 600 may further include: another phase shifter for adding another delay to the comparison result.

The phase shifter and the other phase shifter can refer to the phase shifter 430 and the phase shifter 432 shown in FIG. 4, respectively. A phase shifter (or delay block) can be used if a phase or delay is measured as the signal passes through various components or devices during processing.

In various embodiments, the audio signal output device 600 can further include: an analog-to-digital converter for converting the analog second portion of the first audio signal into a digital signal.

In a third aspect, a headset set 700 is provided, as shown in FIG. The headset 700 includes: a pair of earphones 702; a speaker 704 located in each of the earphones 702; and a microphone 706 located in at least one of the pair of earphones 702; wherein the speaker 704 is substantially centrally located within the earphone 702 And wherein the microphone 706 is positioned adjacent to the speaker 704.

The term "adjacent" means adjacent, next to each other or next to each other.

For example, the pair of earphones 702 can refer to the left earphone 408 and the right earphone 410 shown in FIG. 4, and the speaker 704 can be the corresponding speaker seen in the left earphone 408 and the right earphone 410 shown in FIG. 4, and the microphone The 706 can be the microphone MIC "L" 420 and/or the microphone MIC "R" 422 shown in FIG.

In various embodiments, the microphone 706 can be positioned below the speaker 704, and when a wearer wears the headset, the microphone 706 faces the wearer. One of the lower part of the auditory canal.

The phrase "external tube" as used herein is interchangeably referred to as an ear canal or an ear canal.

In an embodiment, the microphone 706 can be located in an area having a radius of about 1 centimeter to 2 centimeters relative to the substantially centrally located speaker 704. In other examples, the microphone 706 can be located at about 0.5 centimeters, about 1 centimeter, about 1.2 centimeters, about 1.5 centimeters, about 1.8 centimeters, about 2 centimeters, about 2.2 centimeters, or about 2.5 centimeters relative to the substantially centrally located speaker 704. .

In some embodiments, the headset 700 can have a plurality of speakers in each of the headsets. For example, headset set 700 can have 2 or 3 or 4 or 5 speakers in each of the headsets.

The term "microphone" can be as defined above.

Various embodiments provide an adaptive method and apparatus for instantly adjusting (original) an original sound stream (eg, the original sound stream 400 shown in FIG. 4), thereby allowing the (original) original sound stream to be changed for sound effects. The position of the driver relative to the outer ear and its unique shape allows the listener (wearer) to feel that the sound content is intact and maintain the desired sound characteristics.

For example, the instant adaptation portion of the method as shown in FIG. 3 can be based on a unique combination of a specific HW driver frequency correction for the headset group and a SW wave synthesis algorithm, the combination being compared to one of the initial sound signals. Instantly adjust other key sound factors (eg, phase, delay, signal amplitude, (attenuation/amplification) factor). In some examples, both corrections and algorithms can be performed in a DSP-enabled system (e.g., system 402 shown in FIG. 4).

It is possible to strategically and optimally place a digital MEMS or MEMS microphone by placing an ear canal access to the tympanic membrane as shown in Fig. 2 to allow a microphone to pick up a critical acoustic pulse from the outer ear or the auricle. An adaptive method and apparatus for processing audio signals.

Figure 8A shows a side cross-sectional view of an exemplary headset 800 of a headset. In this example, five speakers 802, 804, 806, 808, and 810 are shown located within headset 800, with speaker 808 being centrally located in headset 800 in. The remaining speakers 802, 804, 806, and 810 are positioned around the center speaker 808. For example, speaker 802 is positioned at the upper left corner of speaker 808; driver 804 is positioned at the lower left corner of speaker 808; driver 806 is positioned at the upper right corner of speaker 808; and driver 810 is positioned at the lower right corner of speaker 808.

Figure 8B shows an example earphone 800 shown in Figure 8A, showing the location of the various drivers.

In Figure 8B, five (sound effect) drivers 820, 822, 824, 826, 828 are located at respective speakers 802, 804, 806, 808, 810. When a wearer wears a headset and has the headset 800 on the ear such that the headset 800 has an upright orientation as shown in FIG. 8B, the wearer faces the left side and the headset 800 is the wearer's left earphone. . The driver 820 can be a front drive having a diameter of about 30 mm; the drive 822 can be a center drive having a diameter of about 30 mm; and the drive 824 can be a rear surround drive having a diameter of about 20 mm; the drive 826 can be a subwoofer driver having a diameter of about 40 mm; and drive 828 can be a surround drive having a diameter of about 20 mm.

Figure 8C shows an example earphone 800 shown in Figure 8A showing a preferred (or ideal) position 830 of the MEMS microphone. In FIG. 8C, the MEMS microphone is positioned along the central axis 832 and adjacent the bottom of the earphone 800 (ie, below the center driver 822 and the surround driver 828).

Figure 8D shows an example earphone 800 shown in Figure 8A, which illustrates three possible regions 840, 842, 844 in which a MEMS microphone can be positioned and its effects.

For example, it is not desirable to have the MEMS microphone in region 840 because the location of region 840 is furthest from the ear canal of the wearer. Having the MEMS microphone in region 842 enables the adaptive audio signal processing to operate and is better than in region 840. Positioning the MEMS microphone in region 844 is (most) ideal because the location of region 844 is closest to the ear canal of the wearer.

The method according to various embodiments as described above may be more adaptive to a sound effect listening environment, especially under a micro-water squat (for example, at the entrance of the ear when an audio signal (or sound) enters the outer ear), at such a micro level Medium, used in sound effects There is an inherent difference in the signal or sound directed to the surface of the tympanic membrane, which is provided by the user's outer ear or auricle and the shape of the inner ear canal. The method may also take into account environmental noise levels and various noise cancellation methods that vary depending on the listening environment. In contrast, existing HRTF functions are static in nature and cannot account for such eventual/environmental factors or correct for such event/environment factors.

By applying the method, a comparison is made between the modified one of the sound effects and the corresponding original sound signal. Figure 9 shows the modified sound signal 900, 902 and the corresponding original sound signal 904 based on a value correction factor for the (A) left ear and (B) right ear in the frequency range of 100 Hz to 20 kHz. 906. It should be noted that there is an inherent difference of about 4 decibels to about 8 decibels between the right ear and the left ear.

As shown in FIG. 9, the modified sound effect signals 900, 902 are attenuated from the original sound effects signals 904, 906 according to the amplitude correction factor. When a user wears a headset that outputs a modified sound effect signal 900, 902, the original sound effect signals 904, 906 are perceived. In summary, Figure 9 shows an example of an original sound effect wave obtained after applying a wave synthesis or correction factor.

In the context of various embodiments, the term "about" as applied to a numerical value includes the precise value and one of +/- 5% of the value.

Although the present invention has been particularly shown and described with reference to the specific embodiments of the present invention, it is understood that the invention may be made without departing from the spirit and scope of the invention as defined by the appended claims. Various changes in form and detail. Therefore, the scope of the invention is to be construed as being limited by the scope of the claims

800‧‧‧Instance headphones

822‧‧‧ (sound) driver

828‧‧‧ (sound) driver

830‧‧‧The preferred (or ideal) position of the MEMS microphone

832‧‧‧ center axis

Claims (32)

A method for processing an audio signal, comprising: outputting a first portion of a first sound signal; picking the first portion of the first sound signal as a second sound signal; and according to the first sound signal and a desired transfer function Generating a second portion of the first sound effect signal; comparing the second portion of the first sound effect signal with the second sound effect signal; modifying the second portion of the first sound effect signal according to a comparison result; and outputting The second part of the modified first sound signal. The method of claim 1, wherein the outputting step, the picking step, the comparing step, and the modifying step are repeated at a predetermined time interval, the predetermined time interval allowing the sound effect signal to be processed substantially instantaneously. The method of claim 1, wherein the step of outputting the first portion of the first sound effect signal comprises: outputting the first portion of the first sound effect signal via a speaker of a wearing set. The method of claim 3, wherein the step of picking the first portion of the first sound effect signal as the second sound effect signal comprises: receiving the first portion of the first sound effect signal by a microphone. The method of claim 4, wherein the microphone is located in an ear cup of the headset, and when the wearer wears the headset, the microphone is positioned to be substantially located in the wearer. Near the ear canal entrance. The method of claim 4, wherein the microphone is a microelectromechanical system (MEMS) microphone. The method of claim 3, wherein the second audio signal comprises a left channel audio signal and a right channel audio signal of the headset. The method of claim 1, wherein the second sound signal further comprises a noise signal. The method of claim 3, wherein the first portion of the first sound effect signal comprises a reflection of one of the first portions of the first sound effect signal. The method of claim 9, wherein the first part of the first sound signal The reflection includes the first portion of the first sound effect signal being reflected from one of at least a portion of an auricle of one of the wearers of the headset. The method of claim 1, wherein the step of comparing the second portion of the first sound effect signal with the second sound effect signal comprises performing at least one of: comparing the second portion of the first sound effect signal a value and a magnitude of the second sound signal to obtain a value correction factor, comparing a frequency of the second portion of the first sound signal with a frequency of the second sound signal to obtain a frequency correction factor Or comparing a phase of one of the second portions of the first sound effect signal with one of the second sound effect signals to obtain a phase correction factor. The method of claim 11, wherein the modifying the second portion of the first sound effect signal comprises: modifying the first one according to at least one of the amplitude correction factor, the frequency correction factor, or the phase correction factor The second part of the sound signal. The method of claim 1, wherein the step of modifying the second portion of the first sound effect signal comprises: increasing or decreasing a magnitude, a frequency or a phase of the second portion of the first sound effect signal At least one of them. The method of claim 1, wherein the modifying the second portion of the first sound effect signal comprises modifying the second portion of the first sound effect signal according to a Head Related Transfer Function (HRTF). The method of claim 1, further comprising: adding a delay to the second portion of the first sound effect signal before comparing the second portion of the first sound effect signal with the second sound effect signal. The method of claim 1, further comprising: adding another delay to the result of the comparing before modifying the second portion of the first sound effect signal. The method of claim 1, wherein the second portion of the first sound signal is an analog signal. The method of claim 17, further comprising: converting the analogous second portion of the first sound effect signal into a digital signal. An audio signal output device comprising: a speaker for outputting a first portion of a first sound effect signal; a microphone for picking up the first portion of the first sound effect signal as a second sound effect signal; and a desired transfer function circuit for An audio signal and a required transfer function to generate a second portion of the first sound signal; a comparator for comparing the second portion of the first sound signal with the second sound signal; and a circuit The second portion of the first sound effect signal is modified according to the result of the comparison; wherein the speaker is further configured to output the modified second portion of the first sound effect signal. The audio signal output device of claim 19, wherein the speaker, the microphone, the comparator, and the circuit are operative to repeatedly operate at a predetermined time interval, the predetermined time interval permitting substantially instantaneous sound signal processing. The audio signal output device of claim 19, wherein the microphone is a microelectromechanical system (MEMS) microphone. The sound effect signal output device of claim 19, wherein the comparator is configured to perform at least one of: comparing one of the amplitudes of the second portion of the first sound effect signal with the amplitude of the second sound effect signal Obtaining a value correction factor, comparing a frequency of the second portion of the first sound effect signal with a frequency of the second sound effect signal to obtain a frequency correction factor, or comparing the second portion of the first sound effect signal One phase is phased with one of the second sound signals to obtain a phase correction factor. The audio signal output device of claim 22, wherein the circuit is configured to modify the second portion of the first sound effect signal according to at least one of the amplitude correction factor, the frequency correction factor, or the phase correction factor. The audio signal output device of claim 19, wherein the circuit is configured to increase or decrease at least one of a magnitude, a frequency or a phase of the second portion of the first sound effect signal. The audio signal output device of claim 19, wherein the circuit is configured to A Head Related Transfer Function (HRTF) modifies the second portion of the first sound signal. The audio signal output device of claim 19, further comprising: a phase shifter for adding a delay to the second portion of the first sound effect signal. The audio signal output device of claim 19, further comprising: a phase shifter for adding another delay to the result of the comparison. The audio signal output device of claim 19, further comprising: an analog-to-digital converter for converting the second portion of the first sound signal into a digital signal. A headset set comprising: a pair of earphones; a plurality of speakers located in each of the earphones; and a microphone located in at least one of the pair of earphones; wherein at least one speaker of the speaker is substantially centrally located within the earphone And wherein the microphone is positioned adjacent to the speaker. The headset of claim 29, wherein the microphone is positioned below the speaker, the microphone facing the wearer's auditory canal when the wearer wears the headset One of the lower parts of the substance. The headwear set of claim 30, wherein the microphone is located in an area having a radius of from about 1 cm to about 2 cm relative to the substantially centrally located speaker. The headwear set of claim 29, wherein the microphone is a microelectromechanical system (MEMS) microphone.