KR20240020130A - Electronic device and method for control audio signal based on sensor - Google Patents

Abstract

According to one embodiment, an audio device may include at least one processor, at least one speaker, at least one microphone, a filter circuit, and at least one sensor. The at least one processor may output a first audio signal through the at least one speaker. The at least one processor may receive a noise signal through the at least one microphone. The at least one processor may generate a tuning signal based on the noise signal. The at least one processor may output a second audio signal, which is a combination of the generated tuning signal and the first audio signal, through the at least one speaker. The at least one processor may detect an external input through the at least one sensor. The at least one processor may change the gain of the filter circuit in response to the external input. The at least one processor may generate an output signal by passing the second audio signal received through the at least one microphone through the filter circuit whose gain is changed. The at least one processor may be configured to output the output signal through the at least one speaker.

Description

Apparatus and method for controlling audio signals based on sensors {ELECTRONIC DEVICE AND METHOD FOR CONTROL AUDIO SIGNAL BASED ON SENSOR}

The descriptions below relate to an apparatus and method for controlling an audio signal based on a sensor.

To output the sound signal, an audio device (e.g., earbuds) may be used. While outputting the sound signal, in order to remove ambient noise, the audio device may use noise canceling (e.g., noise cancellation) through a microphone and speaker. : ANC (active noise canceling) function can be performed. In addition, in order to more accurately acquire surrounding sounds, the audio device uses a microphone to listen to surrounding sounds, such as an ambient sound tolerance function or PSAP (personal sound amplification products). It can perform its function.

According to one embodiment, an audio device may include at least one processor, at least one speaker, at least one microphone, a filter circuit, and at least one sensor. The at least one processor may output a first audio signal through the at least one speaker. The at least one processor may receive a noise signal through the at least one microphone. The at least one processor may generate a tuning signal based on the noise signal. The at least one processor may output a second audio signal, which is a combination of the generated tuning signal and the first audio signal, through the at least one speaker. The at least one processor may detect an external input through the at least one sensor. The at least one processor may change the gain of the filter circuit in response to the external input. The at least one processor may generate an output signal by passing the second audio signal received through the at least one microphone through the filter circuit whose gain is changed. The at least one processor may be configured to output the output signal through the at least one speaker.

According to one embodiment, an audio device may include at least one processor, at least one speaker, at least one microphone, a filter circuit, and at least one sensor. The at least one processor may receive an external signal through the at least one microphone. The at least one processor may generate a tuning signal based on the external signal. The at least one processor may output the generated tuning signal through the at least one speaker. The at least one processor may detect an external input through the at least one sensor. The at least one processor may change the gain of the filter circuit in response to the external input. The at least one processor may generate an output signal by passing the audio signal received through the at least one microphone through the filter circuit whose gain is changed. The at least one processor may be configured to output the output signal through the at least one speaker.

According to one embodiment, a method performed by an audio device may include outputting a first audio signal through at least one speaker. The method may include receiving a noise signal through at least one microphone. The method may include generating a tuning signal based on a noise signal. The method may include outputting a second audio signal, which is a combination of the generated tuning signal and the first audio signal, through the at least one speaker. The method may include detecting an external input through at least one sensor. The method may include changing the gain of the filter circuit in response to the external input. The method may include generating an output signal by passing the second audio signal received through the at least one microphone through the filter circuit whose gain is changed. The method may include outputting the output signal through the at least one speaker.

1 shows an example of a state in which an audio device is close to a user's body, according to one embodiment.
Figure 2 shows an example of an audio device connected to a power supply, according to one embodiment.
Figure 3 is a block diagram showing components of an audio device, according to one embodiment.
4 shows an example of wearing an audio device, according to one embodiment.
5 shows an example of movement of an audio device, according to one embodiment.
Figure 6a shows an example of signal inflow characteristics through a secondary path depending on the amount of blockage of the speaker port.
Figure 6b shows an example of signal inflow characteristics depending on the external auditory canal volume.
Figure 7 shows the functional configuration of an audio device, according to one embodiment.
8A shows an example of the functional configuration of an audio device including a filter circuit combination, according to one embodiment.
8B shows an example of a functional configuration of an audio device including partial filter circuits, according to one embodiment.
8C shows an example of the functional configuration of an audio device including a filter circuit combination, according to one embodiment.
9 shows an example of a functional configuration of an audio device for controlling characteristics of a filter, without a microphone, according to one embodiment.
FIG. 10 is a flowchart illustrating the operation of an audio device for controlling an audio signal while active noise cancellation (ANC) is performed, according to an embodiment.
FIG. 11 is a flowchart illustrating the operation of an audio device for controlling an audio signal while a peripheral sound tolerance function or a personal sound amplification products (PSAP) function for listening to surrounding sounds is performed, according to an embodiment.

Terms used in the present disclosure are merely used to describe specific embodiments and may not be intended to limit the scope of other embodiments. Singular expressions may include plural expressions, unless the context clearly indicates otherwise. Terms used herein, including technical or scientific terms, may have the same meaning as generally understood by a person of ordinary skill in the technical field described in this disclosure. Among the terms used in this disclosure, terms defined in general dictionaries may be interpreted to have the same or similar meaning as the meaning they have in the context of related technology, and unless clearly defined in this disclosure, have an ideal or excessively formal meaning. It is not interpreted as In some cases, even terms defined in the present disclosure cannot be interpreted to exclude embodiments of the present disclosure.

In various embodiments of the present disclosure described below, a hardware approach method is explained as an example. However, since various embodiments of the present disclosure include technology using both hardware and software, the various embodiments of the present disclosure do not exclude software-based approaches.

Terms used in the following description to refer to a feedback microphone (e.g., feedback microphone, error microphone, the first microphone), and terms to refer to a reference microphone (e.g., : Reference microphone, feedforward microphone, the second microphone), terms referring to audio equipment (audio device, audio output equipment, wireless earphones (true wireless) stereo earphone)), etc. are given as examples for convenience of explanation. Accordingly, the present disclosure is not limited to the terms described below, and other terms having equivalent technical meaning may be used. In addition, terms such as '... part', '... base', '... water', and '... body' used hereinafter mean at least one shape structure or a unit that processes a function. It can mean.

In addition, in the present disclosure, the expressions greater than or less than may be used to determine whether a specific condition is satisfied or fulfilled, but this is only a description for expressing an example, and the description of more or less may be used. It's not exclusion. Conditions written as ‘more than’ can be replaced with ‘more than’, conditions written as ‘less than’ can be replaced with ‘less than’, and conditions written as ‘more than and less than’ can be replaced with ‘greater than and less than’. In addition, hereinafter, 'A' to 'B' means at least one of the elements from A to (including A) and B (including B).

Before describing the embodiments of the present disclosure, terms necessary to describe the operations of the audio device according to the embodiments are defined. An audio device may refer to an electronic device that includes a speaker for outputting audio signals. An audio signal may refer to a sound wave output from an audio device. The first microphone is a feedback microphone and may refer to a microphone placed on the side of the housing containing the protrusion. The second microphone is a feedforward microphone and may refer to a microphone placed on the side of the housing containing the sensor. The signal inflow characteristic may refer to a measure of how much the audio signal from the speaker flows into the microphone.

Hereinafter, various embodiments disclosed in this document will be described with reference to the attached drawings. For convenience of explanation, the sizes of components shown in the drawings may be exaggerated or reduced, and the present invention is not necessarily limited to what is shown.

1 shows an example of a state in which an audio device is close to a user's body, according to an embodiment.

Referring to FIG. 1, when the audio device 100 is not in use, the audio device 100 can be accommodated and stored in the power supply device 200, and when the audio device 100 is in use, the audio device 100 can be stored in the power supply device 200. ) can be worn and brought into close proximity to a part of the user's body (e.g., ears). According to one embodiment, the audio device 100 may be configured as a pair so that it can be worn on both ears of the user and brought into close proximity. For example, the audio device 100 may include a right audio device 100a that is worn on the user's right ear and can be approached, and a left audio device 100b that can be worn on the user's left ear and can be approached. . According to one embodiment, the audio device 100 may output an audio signal when worn and in close proximity to a part of the user's body. According to one embodiment, at least one of the right audio device 100a and the left audio device 100b may output an audio signal using wireless data transmission and reception with an electronic device. For example, the wireless data transmission and reception path is a path for a Bluetooth communication scheme, a route for a BLE communication scheme (bluetooth low energy communication scheme), and a route for a UWA communication scheme (ultra-wide band communication scheme). It may include at least one of a path, a path for a Wi-Fi (wireless fidelity) direct communication technique, and a path for a mobile communication technique (e.g., long term evolution (LTE) sidelink, etc.) . According to one embodiment, only one of the pair of audio devices 100a and 100b may create the communication path with the electronic device. For example, the electronic device may be connected to the right audio device 100a among the pair of audio devices 100a and 100b. The right audio device 100a may output an audio signal based on the audio data of the electronic device received through the communication path. When the electronic device is connected to the right-side audio device 100a, the electronic device or the right-side audio device 100a provides information about the communication path to the left side so that the left-side audio device 100b can output the audio signal. It can be provided to the audio device 100b. The left audio device 100b can receive or sniff data transmitted to the right audio device 100a based on the information about the communication path and output the audio signal. For example, the left audio device 100b can receive data transmitted to the right audio device 100a by monitoring information about the communication path. According to one embodiment, the right audio device 100a connected to the electronic device may be referred to as a master device, and the left audio device 100b not connected to the electronic device may be referred to as a slave device. It can be referred to as . According to one embodiment, the master device and the slave device among the pair of audio devices 100a and 100b may be changed. According to one embodiment, at least one of the pair of audio devices 100a and 100b may transmit data to an electronic device. For example, the data may include information for controlling the audio signal output through the audio device 100 (e.g., information for playing a sound source, information for pausing the sound source). , information for stopping the sound source, information for controlling the volume of the sound source (e.g., volume up, volume down), and information for selecting the sound source, etc. You can.

Figure 2 shows an example of an audio device connected to a power supply, according to one embodiment.

Referring to FIG. 2, the power supply device 200 may have a structure that can be opened and closed. According to one embodiment, in response to the operation of opening the power supply device 200, the power supply device 200 may perform a triggering operation for Bluetooth pairing with the audio device 100. there is. According to one embodiment, the audio device 100 is generally small in size and may include a rechargeable battery to provide mobility. Accordingly, the audio device 100 may be stored connected to a separate power supply device 200 to prevent loss while the audio device 100 is not in use. According to one embodiment, the audio device 100 may be connected to the power supply device 200 and be able to charge the battery while being stored. According to one embodiment, although not shown in FIG. 2, the audio device 100 may include a sensing member corresponding to the sensor of the power supply device 200. For example, the power supply device 200 may include a Hall sensor (or hall IC) and the audio device 100 may include a magnet. According to one embodiment, when the audio device 100 is accommodated in the power supply device 200, the Hall sensor of the power supply device 200 can recognize a magnet installed in the audio device 100 and the power supply device ( A signal related to the combination of 200) and the audio device 100 may be output. According to one embodiment, although not shown in FIG. 2, the audio device 100 may include at least one conductive pin pad on the outside. According to one embodiment, although not shown in FIG. 2, the power supply device 200 may include at least one externally conductive pin (eg, a conductive terminal). The conductive pin pad included in the audio device 100 and the conductive pin included in the power supply 200 may be arranged to physically contact each other while the audio device 100 is connected to the power supply 200. . According to one embodiment, when the audio device 100 is connected to the power supply device 200, the conductive pin of the audio device 100 and the conductive pin of the power supply device 200 may be in contact and electrically connected. According to one embodiment, by identifying a conductive pin contact, the audio device 100 or the power supply 200 can determine whether the audio device 100 is connected to the power supply 200.

According to one embodiment, although not shown in FIG. 2, the audio device 100 senses the amount of light reflected from the power supply device 200 through a proximity sensor, so that the audio device 100 detects the amount of light reflected from the power supply device 200. ) can be determined whether or not it is connected. According to one embodiment, the accuracy of sensing an object close to the audio device 100 may be improved by processing the reflective structure of the power supply device 200 in a color with high reflectivity. According to one embodiment, when the power supply device 200 is configured in various colors, the power supply device 200 adjusts the transmittance of the filter to match the color of the power supply device 200 and the color of the power supply device 200. The colors of the reflective structures may be visually identical or similar. According to one embodiment, by performing proximity sensing by adjusting the power of the proximity sensor of the audio device 100, the audio device 100 can distinguish the sensing result values for the power supply device 200 and the user.

Figure 3 is a block diagram showing components of an audio device, according to one embodiment. The configuration illustrated in FIG. 3 may be understood as a configuration of an audio device (e.g., audio device 100a for right or audio device 100b for left), as mentioned in FIG. 1.

Referring to FIG. 3, the audio device 300 (e.g., the audio device 100 of FIG. 1, the left audio device 100a, and the right audio device 100b) includes a speaker 301 and a filter circuit 303. , may include a processor 305, a sensor 307, a first microphone 309, and a second microphone 311. According to one embodiment, the audio device 300 may include a number of electronic components disposed in an internal space. For example, the audio device 300 may include a speaker 301, a filter circuit 303, a processor 305, a sensor 307, a first microphone 309, and a second microphone 311. . However, it is not limited to this, and electronic components other than the above may be included. According to one embodiment, the audio device 300 may be an electronic device for outputting audio signals. For example, the audio device 300 may be a wired earphone. For example, the audio device 300 may be true wireless stereo (TWS) earphones.

According to one embodiment, the audio device 300 may include a speaker 301. The speaker 301 can output an audio signal. The speaker 301 can receive electrical signals. The speaker 301 may include an element for acquiring an electrical signal. The speaker 301 can convert electrical signals into sound wave signals. The speaker 301 may include an element for converting an electrical signal into a sound wave signal. The speaker 301 can output an audio signal including the converted sound wave signal. The speaker 301 may include an element for outputting the audio signal.

According to one embodiment, the filter circuit 303 may be an element that adjusts the intensity of the output signal according to the frequency of the input signal. The ratio between the intensity of the input signal and the intensity of the output signal may be determined based on the gain of the filter circuit 303. Therefore, the strength of the output signal can be determined based on the gain of the filter circuit 303. Since the gain of the filter circuit may vary depending on the frequency of the input signal, the strength of the output signal may vary depending on the frequency. According to embodiments, at least one processor 305 may change the gain of the filter circuit 303 by changing characteristics of a plurality of partial filter circuits of the filter circuit 303. The filter circuit 303 may include a plurality of partial circuits. According to one embodiment, the at least one processor may activate at least one of a plurality of partial filter circuits and deactivate at least one other one to change the gain of the filter circuit 303 according to frequency. there is. According to one embodiment, the at least one processor may change the weight of each of the plurality of partial filter circuits in order to change the gain of the filter circuit 303 according to frequency. Hereinafter, FIGS. 8A, 8B, and 8C illustrate a method of changing the gain of the filter circuit based on changing the characteristics of a plurality of partial filter circuits.

According to one embodiment, the audio device 300 may include a processor 305. The processor 305 may be implemented with one or more integrated circuit (IC) chips and may perform various data processing. For example, the processor 305 may be implemented as a system on chip (SoC). The processor 305 includes a central processing unit (CPU), graphics processing unit (GPU), neural processing unit (NPU), image signal processor (ISP), display controller, memory controller, storage controller, application processor (AP), and CP. (communication processor), and/or may include sub-components including a sensor interface. The above sub-components are merely examples. For example, the processor 305 may further include other sub-components. For example, some sub-components may be omitted from processor 305.

According to embodiments, the processor 305 may detect the wearing state through the sensor 307, which will be described later. The processor 305 may control components according to the wearing state of the audio device 300. The processor 305 may output an audio signal through the speaker 301. According to one embodiment, the processor 305 may receive audio data from an external device (eg, a server, smartphone, PC, PDA, or access point). The processor 305 may be designed to store received audio data in memory (not shown). For example, the processor 305 may receive non-volatile audio data (or downloaded audio data) from an external device. The processor 305 may store the received non-volatile audio data in non-volatile memory. Additionally, for example, the processor 305 may receive volatile audio data (or streaming audio data) from an external device. The processor 305 may store the received volatile audio data in volatile memory. The processor 305 may reproduce audio data (eg, non-volatile audio data or volatile audio data) stored in memory and output it through the speaker 301. The processor 305 can decode audio data to obtain an audio signal (play audio data) and output the acquired audio signal through the speaker 301.

According to one embodiment, the audio device 300 may include a sensor 307. Sensor 307 may receive physical data related to the audio device 300. For example, the sensor 307 may receive data related to the wearing state of the audio device 300. For example, the sensor 307 can identify whether a touch input is input to the audio device 300. For example, the sensor 307 may identify the pressure of a touch input applied to the audio device 300. The sensor 330 may convert measured or sensed information into an electrical signal. The sensor 307 may provide various information to the processor 305 depending on the type of sensor. According to one embodiment, sensor 307 may include a touch detection sensor. The sensor 307 can detect a user's touch input. The sensor 307 may provide the detection result of the touch input to the processor 305. According to one embodiment, the sensor 307 may include a grip detection sensor. The sensor 307 can detect the user's grip. The sensor 307 may provide the detection result of the grip to the processor 305. According to one embodiment, sensor 307 may include a pressure sensor. The sensor 307 can detect pressure caused by a user or an external object. The sensor 307 may provide the pressure detection result to the processor 305.

Information provided by sensor 307 may be used by the processor 305 to perform various operations. The processor 305 can identify whether the audio device 300 is connected to the power supply device 200 from the information obtained from the sensor 307. According to one embodiment, the processor 305 may identify whether the audio device 300 is worn and in close proximity to a part of the user's body from information obtained from the sensor 307. According to one embodiment, the processor 305 may identify whether the wearing state of the audio device 300 has changed from information obtained from the sensor 307.

According to one embodiment, the audio device 300 may include a first microphone 309 and a second microphone 311. The audio device 300 may include a first microphone 309. For example, the first microphone 309 may be placed in one area of the protrusion of the audio device 300. The first microphone 309 is disposed adjacent to the speaker when the audio device 300 is worn by the user, and may be referred to as a feedback microphone. Additionally, the first microphone 309 may also be referred to as an error microphone. The audio device 300 may include a second microphone 311. Additionally, for example, the second microphone 311 may be placed in an area of the housing that includes a sensor (eg, sensor 307) of the audio device 300. The second microphone 311 is disposed toward the outside when the audio device 300 is worn by the user, and may be referred to as a feedforward microphone. Additionally, the second microphone 311 may also be referred to as a reference microphone.

The first microphone 309 may receive a noise signal to adjust the audio signal. The second microphone 311 may receive an external signal to adjust the audio signal. For example, the first microphone 309 may be used in active noise cancellation (ANC) technology to remove external noise. For example, the second microphone 311 may be used for an active noise cancellation (ANC) function to remove external noise. To cancel out the noise signal received from the first microphone 309 or the second microphone 311, the at least one processor (eg, processor 305) may generate a tuning signal. The tuning signal may be generated based on second phase information for canceling out the first phase information of the noise signal. For example, the second microphone 311 may be used for an ambient sound tolerance function or a personal sound amplification products (PSAP) function for listening to surrounding sounds. To amplify the external signal received from the second microphone, the at least one processor 305 may generate a tuning signal. The tuning signal may be generated based on second phase information for amplifying the first phase information of the external signal. Depending on the degree to which the external signal received from the second microphone is amplified, the ambient noise tolerance function and the PSAP function can be distinguished. The ambient sound tolerance function may include a surrounding sound listening function, an ambient function, or a transparency function. When the ambient sound tolerance function is activated, the at least one processor 305 may amplify the external signal received from the second microphone to the strength of the signal received by the user when the earbuds are not worn. When the PSAP function operates, the at least one processor 305 may amplify the external signal received from the second microphone to the strength of the signal received by the user when the earbuds are not worn.

4 shows an example of wearing an audio device, according to one embodiment.

Referring to FIG. 4, the audio device 401 (eg, audio device 100, audio device 300) may be an electronic device for outputting an audio signal. The protrusion 403 may be a protruding structure to output an audio signal through a speaker (eg, speaker 301 in FIG. 3). The touch detection sensor 405 can detect a user's touch input. The external auditory canal 407 may be a passage through which audio signals propagate when the audio device 401 is worn. The speaker port 409 may be a ventilation hole for improving the performance of the speaker 301 by adjusting air pressure. Audio signals can also be transmitted through the speaker port 409. The first microphone 411 (e.g., the first microphone 309 in FIG. 3) may be a feedback microphone. The first microphone 411 may also be referred to as an error microphone. The second microphone 413 (e.g., the second microphone 311 in FIG. 3) may be a feedforward microphone. The second microphone 413 may also be referred to as a reference microphone. The charging terminal 415 may be a conductive pad corresponding to a conductive pin (eg, a conductive terminal) of a power supply device (eg, the power supply device 200 of FIG. 2).

A processor (eg, processor 305) may identify a user's touch input through the touch detection sensor 405. The processor 305 may control the operation of the audio device 401 based on the touch input. For example, when a touch input is input to the touch detection sensor 405 once, the processor 305 may pause the audio signal being played. For example, when a touch input is input to the touch detection sensor 405 twice, the processor 305 can replay the paused audio signal.

The speaker port 409 may be a ventilation hole for improving the performance of the speaker 301 by adjusting air pressure. According to one embodiment, because the performance of the speaker 301 varies depending on the degree to which the speaker port 409 is blocked, howling may occur when an active noise cancellation (ANC) function is used to remove external noise. According to one embodiment, since audio signals can be transmitted through the speaker port 409, howling may occur when using the ambient sound tolerance function or personal sound amplification products (PSAP) function to listen to surrounding sounds. . This is because the audio signal output from the speaker port 409 may flow back into the second microphone 413, causing resonance. The causes of howling in each function are described below in FIG. 5.

The first microphone 411 may be a feedback microphone disposed on the surface of the housing where the protrusion is coupled. According to one embodiment, the first microphone 411 may be used in active noise cancellation (ANC) technology to remove external noise. To cancel out the noise signal received from the first microphone 411, the processor 305 may generate a tuning signal. The tuning signal may be generated based on second phase information for canceling out the first phase information of the noise signal. For example, the first phase information may be the phase of a noise signal. The second phase information may be the phase of the tuning signal. The phase of the tuning signal may be opposite to the phase of the noise signal.

The second microphone 413 may be a reference microphone disposed on the surface of the housing to which the touch detection sensor 405 is coupled. According to one embodiment, the second microphone 413 may be used in active noise cancellation (ANC) technology to remove external noise. To cancel out the noise signal received from the second microphone 413, the processor 305 may generate a tuning signal. The tuning signal may be generated based on second phase information for canceling out the first phase information of the noise signal. For example, the first phase information may be the phase of a noise signal. The second phase information may be the phase of the tuning signal. The phase of the tuning signal may be opposite to the phase of the noise signal. According to one embodiment, the second microphone 413 may be used for an ambient sound tolerance function or personal sound amplification products (PSAP) technology for listening to surrounding sounds. In order to amplify the external signal received from the second microphone 413, the processor 305 may generate a tuning signal. The tuning signal may be generated based on second phase information for amplifying the first phase information of the external signal. For example, the first phase information may be the phase of an external signal. The second phase information may be the phase of the tuning signal. The phase of the tuning signal may be the same as the phase of the external signal.

The charging terminal 415 may be a conductive pad corresponding to a conductive pin (eg, a conductive terminal) of a power supply device (eg, the power supply device 200 of FIG. 2). The audio device 401 may include at least one conductive pin pad on the outside. The power supply device 200 may externally include at least one conductive pin (eg, a conductive terminal). The conductive pin pad included in the audio device 401 and the conductive pin included in the power supply 200 may be arranged to physically contact each other while the audio device 401 is connected to the power supply 200. . When the audio device 401 is connected to the power supply device 200, the conductive pad of the audio device 401 and the conductive pin of the power supply device 200 may be contacted and electrically connected. By identifying the conductive pin contact, audio device 401 or power supply 200 can determine whether audio device 401 is connected to power supply 200.

5 shows an example of movement of an audio device, according to one embodiment. As an audio device (eg, audio device 100, audio device 300, or audio device 401) moves, an audio signal output from a speaker (eg, speaker 301) may be input into a microphone. For example, when a signal output for the ANC function, background noise tolerance function, or PSAP function is re-input through the microphone, the delayed signal may cause unintended constructive interference. Constructive interference can cause howling.

Referring to FIG. 5, the audio device 501 (eg, audio device 300, audio device 401) may be an electronic device for outputting an audio signal. The speaker port 503 (e.g., the speaker port 409 in FIG. 4) may be a ventilation hole for improving the performance of the speaker 301 through air pressure adjustment. The audio signal of the audio device 501 may be radiated through the speaker port 503. The protrusion 505 (eg, the protrusion 403 in FIG. 4) may be a protruding structure for wearing by the user and for transmitting audio signals.

The audio device 501 may include a first microphone 507 (eg, the first microphone 309 in FIG. 3 and the first microphone 411 in FIG. 4). The first microphone 507 may be placed on one side of the housing, including the protrusion 505 of the audio device 501. The first microphone 507 may be referred to as a feedback microphone or an error microphone. The first microphone 507 can be used for active noise cancellation (ANC) to remove external noise. The audio device 501 may include a second microphone 509 (eg, the second microphone 311 in FIG. 3 and the second microphone 413 in FIG. 4). The second microphone 509 may be placed on one side of the housing containing the sensor of the audio device 501. The second microphone 509 may be referred to as a feedforward microphone or a reference microphone. The second microphone 509 may be used for an ANC function, an ambient sound tolerance function, or a personal sound amplification products (PSAP) function.

According to embodiments, howling may be generated by the first microphone 507. At least one processor (e.g., processor 305) may receive an audio signal output from a speaker within the protrusion 505 or an audio signal output from the speaker port 503 through the first microphone 507. . The processor 305 can reduce the howling effect using a filter circuit. Howling can occur as the audio signal from the speaker flows into the microphone. The signal inflow characteristics may indicate how much of the audio signal from the speaker flows into the microphone. If the signal incoming characteristics change, the settings of the filter circuit to reduce the effect of howling are changed. Changed filter circuit settings may cause howling again.

For example, an audio signal may be output from a speaker within the protrusion 505. The audio signal may be input to the first microphone 507. In order to reduce howling caused by the input of the audio signal, the processor 305 may determine the characteristics of an optimized filter circuit according to the signal inflow characteristics. Through the filter circuit, the processor 305 can reduce the strength of signals at frequencies where howling is likely to occur. The characteristic of the filter circuit may be gain depending on frequency. In a normal wearing state, howling may not occur even if the audio signal output from the speaker within the protrusion 505 is input to the first microphone 507. However, if the wearing condition changes, howling may occur. For example, when the audio device 501 detects a user's touch input, the amount of blockage of the speaker port may vary. Due to changes in the amount of blockage of the speaker port, the air pressure within the audio device 501 may vary. Changes in atmospheric pressure can change the signal intake characteristics of the micro. Additionally, for example, when a user's touch input is detected by the audio device 501, a change in the volume of the external auditory canal may occur. Due to changes in the volume of the external auditory canal, signal inflow characteristics may vary. Additionally, for example, when the audio device 501 senses pressure from a user's grip or an external object, the amount of blockage of the speaker port may vary. Due to changes in the amount of blockage of the speaker port, signal inflow characteristics may vary. Additionally, for example, when the audio device 501 senses pressure from a user's grip or an external object, a change in the volume of the external auditory canal may occur. Due to changes in the volume of the external auditory canal, signal inflow characteristics may vary. As signal inflow characteristics change, it is difficult to set the filter circuit before the wearing state is changed to reduce howling of the audio device 501 whose wearing state is changed. Therefore, if the wearing condition changes, howling may occur again due to the amount of blockage of the speaker port or a change in the volume of the external auditory canal.

For example, an audio signal may radiate from speaker port 503. The audio signal may flow into the first microphone 507. In order to reduce howling caused by the input of the audio signal, the processor 305 may determine the characteristics of an optimized filter circuit according to the signal inflow characteristics. Through the filter circuit, the processor 305 can reduce the strength of signals at frequencies where howling is likely to occur. The characteristic of the filter circuit may be gain depending on frequency. Therefore, under normal wearing conditions, howling may not occur even if the audio signal output from the speaker port 503 is input to the first microphone 507. However, if the wearing condition changes, howling may occur. For example, when the audio device 501 detects a user's touch input, the amount of blockage of the speaker port may vary. Due to changes in the amount of blockage of the speaker port, signal inflow characteristics may vary. Additionally, for example, when the audio device 501 senses pressure from a user's grip or an external object, the amount of blockage of the speaker port may vary. Due to changes in the amount of blockage of the speaker port, signal inflow characteristics may vary. As signal inflow characteristics change, it is difficult to set the filter circuit before the wearing state is changed to reduce howling of the audio device 501 whose wearing state is changed. Therefore, if the wearing condition changes, howling may occur again due to the amount of blockage of the speaker port or a change in the volume of the external auditory canal. Hereinafter, the relationship between the amount of speaker port blockage and signal inflow characteristics will be described in FIG. 6A. Hereinafter, the relationship between the external auditory canal volume and signal inflow characteristics will be described in FIG. 6B.

According to embodiments, howling may be generated by the second microphone 509. Like the first microphone 507, when an audio signal output from the speaker within the protrusion 505 or an audio signal output from the speaker port 503 is input to the second microphone 509, howling may occur. Howling can occur as the audio signal from the speaker flows into the microphone. The signal inflow characteristics may indicate how much of the audio signal from the speaker flows into the microphone. If the signal incoming characteristics change, the settings of the filter circuit to reduce the effect of howling are changed. Changed filter circuit settings may cause howling again.

According to one embodiment, due to the structure of the audio device 501, it is difficult for an audio signal output from the speaker within the protrusion 505 to be input to the second microphone 509. Therefore, howling may not occur in normal wearing conditions. However, when the wearing state of the audio device 501 is adjusted or the audio device 501 is touched for touch input, the degree of occlusion of the speaker is changed, so signal inflow characteristics may vary. When the wearing state of the audio device 501 is adjusted, signal inflow characteristics may change. That is, the audio signal output from the speaker within the protrusion 505 is input to the second microphone 509, and howling may occur.

According to one embodiment, due to the structure of the audio device 501, it is difficult for the audio signal output from the speaker port 503 to be input to the second microphone 509. Therefore, howling may not occur in normal wearing conditions. However, if the wearing condition changes, howling may occur. For example, when a user's touch input is detected by the audio device 501, the amount of coverage of the speaker port may vary.

When the wearing state of the audio device 501 is adjusted or the audio device 501 is touched for touch input, the degree of occlusion of the speaker port 503 is changed, so signal inflow characteristics may vary. When the wearing state of the audio device 501 is adjusted, signal inflow characteristics may change. That is, the audio signal output from the speaker port 503 is input to the second microphone 509, and howling may occur.

Figure 6a shows an example of signal inflow characteristics through a secondary path depending on the amount of speaker port blockage.

Referring to FIG. 6A, the graph 600 shows the signal inflow characteristics through the secondary path according to the amount of blockage of the speaker port (e.g., speaker port 409 in FIG. 4, speaker port 503 in FIG. 5). can indicate. The horizontal axis of the graph 600 represents frequency (unit: Hz (hertz)), and the vertical axis of the graph 600 represents gain (unit: dB (decibel)). Due to changes in the amount of blockage of the speaker port, the air pressure within the audio device 501 may vary. Changes in atmospheric pressure can change the signal intake characteristics of the micro. For example, the signal inflow characteristics through the secondary path can be obtained based on the ratio of the received signal strength to the transmitted signal strength.

The signal inflow characteristics through the primary path may be the result of comparing the signal received through the first microphone and the signal received through the second microphone. The signal inflow characteristics through the secondary path can be obtained by inputting the audio signal from the speaker to the first microphone. Hereinafter, signal inflow characteristics refer to signal inflow characteristics through a secondary path.

Data 601 is the signal inflow characteristics according to the frequency measured when the amount of speaker port blockage is about 100%. Data 602 is the signal inflow characteristics according to the frequency measured when the speaker port is blocked by about 90%. Data 603 is the signal inflow characteristics according to the frequency measured when the amount of speaker port blockage is about 70%. Data 604 is the signal inflow characteristic according to the frequency measured when the speaker port blockage amount is the default value (e.g., 10%).

It can be confirmed that as the amount of blockage of the speaker port increases, the signal inflow characteristics of the frequency section 605 increase. Since the higher the frequency, the shorter the wavelength, the greater the impact of the time delay of the incoming signal. Therefore, it may be difficult to remove external noise using the active noise cancellation (ANC) function. In particular, at frequencies above 1000 Hz (hertz), it is difficult to remove external noise using the ANC function, and howling is prone to occur. As the amount of speaker port blockage increases, the audio device (eg, audio device 501) can reduce howling by filtering the audio signal in the frequency section 605 through a filter circuit. For example, as the amount of speaker port blockage increases, the audio device 501 reduces the gain for a specific frequency range (e.g., about 1000 to 3000 Hz) of the input signal through a filter circuit in the frequency section 605. You can do it.

When the wearing state of the audio device 501 is adjusted or the audio device 501 is touched for touch input, the amount of speaker port blockage may change. Therefore, in order to prevent howling, the audio device 501 can be identified by a change in the amount of speaker port blockage when a touch input is identified by a wearing detection sensor (e.g., the touch detection sensor 405 in FIG. 4). there is. Accordingly, the audio device 501 can reduce the gain of the filter circuit in the frequency section 605.

Figure 6b shows an example of signal inflow characteristics depending on the external auditory canal volume.

Referring to FIG. 6B, a graph 650 may represent signal inflow characteristics according to the volume of the external auditory canal (e.g., the external auditory canal 407 of FIG. 4). The horizontal axis of the graph 650 represents frequency (unit: Hz (hertz)), and the vertical axis of the graph 650 represents signal inflow characteristics (unit: dB (decibel)). As the ear canal volume varies, the resonant frequency for the audio device 501 may vary. For example, as the volume of the external auditory canal increases, the resonance frequency may also increase. Changes in resonant frequency may change signal incoming characteristics. For example, the signal inflow characteristics may be obtained based on the ratio of received signal strength to transmitted signal strength.

Data 651 is a signal inflow characteristic according to frequency measured when the external auditory canal volume is the largest. Data (651), Data (652), Data (653), Data (654), Data (655), Data (656), Data (657), Data (658), Data (659) have large external auditory canal volumes. This is the signal inflow characteristic according to the measured frequency. Data 659 is a signal inflow characteristic according to frequency measured when the external auditory canal volume is the smallest. It can be seen that as the volume of the external auditory canal decreases, the signal inflow characteristics of the frequency section 665 increase. Higher frequencies have shorter wavelengths and are more affected by time delay, making it difficult to remove external noise using the ANC function. In particular, at frequencies above 1000Hz, it is difficult to remove external noise using the ANC function, and howling is prone to occur. Therefore, as the volume of the external auditory canal decreases, the audio device 501 can reduce howling by filtering the audio signal in the frequency section 665 through a filter circuit. For example, as the volume of the external auditory canal decreases, the audio device 501 reduces the gain for a specific frequency range (e.g., about 1000 to 3000 Hz) of the input signal through a filter circuit in the frequency section 665. You can do it.

When the wearing state of the audio device 501 is adjusted or the audio device 501 is touched for touch input, the volume of the external auditory canal may change. In particular, when a touch input occurs, the audio device 501 is pushed into the external auditory canal. The volume of the external auditory canal may be reduced. Therefore, in order to prevent howling, the audio device 501 may identify that the volume of the external auditory canal has changed when a touch input is identified by a wearing detection sensor (e.g., the touch detection sensor 405 in FIG. 4). . Therefore, the audio device 501 may reduce the gain of the filter circuit in the frequency section 665 when the touch input is identified.

As described above, howling may occur because signal inflow characteristics are changed by operations such as receiving a touch input or adjusting the wearing state. In order to reduce the impact due to howling even if the signal inflow characteristics are changed, the audio device 501 according to embodiments may change the settings of the filter circuit to reduce the signal gain within the frequency range that causes howling. Hereinafter, a method of changing the settings of the filter circuit in FIGS. 7, 8A, and 8B will be described.

Figure 7 shows the functional configuration of an audio device, according to one embodiment.

Referring to FIG. 7 , an audio device (eg, audio device 501) may include a first microphone 701, a second microphone 703, and a speaker 711. The first microphone 701 may receive noise for ANC from the audio device 501. Additionally, the first microphone 701 is located adjacent to the speaker 711 of the audio device 501 and can receive the output of the speaker 711. The first microphone 701 may be referred to as a feedback microphone or an error microphone. The second microphone 703 may receive noise for ANC, or receive ambient sound for the ambient sound tolerance function or PSAP. Additionally, the second microphone 703 is located adjacent to the sensor of the audio device 501 and can receive signals from outside the audio device 501. The second microphone 703 may be referred to as a feedforward microphone or a reference microphone. Speaker 711 can transmit an audio signal.

The audio device 501 may include a codec 705 (codec). The codec 705 refers to components (e.g., encoder, decoder) for converting a digital signal into a voice signal or converting a voice signal into a digital signal. The codec 705 may change the filter settings of the codec 705 based on a control signal from the processor 707.

Audio device 501 may include a processor 707. The processor 707 may transmit a control signal for changing filter settings to the codec 705 based on the detection result from the sensor 709. Audio device 501 may include a sensor 709. According to one embodiment, the sensor 709 may be a sensor for detecting touch input. The processor 707 may identify a change in the wearing state of the audio device based on the touch input. Additionally, according to one embodiment, the sensor 709 may be a sensor for detecting the user's grip. The processor 707 may identify a change in the wearing state of the audio device based on the grip. Additionally, according to one embodiment, the sensor 709 may be a sensor for measuring external pressure. The processor 707 may identify a change in the wearing state of the audio device based on the external pressure.

Howling may occur when an audio signal output from the speaker 711 is input to the first microphone 701 or the second microphone 703 and output again through the speaker 711. Therefore, the processor 707 can adjust the signal transmitted to the speaker 711 based on changes in wearing status to prevent howling. The processor 707 can adjust the signal transmitted to the speaker 711 through the codec 705. The codec 705 adjusts the signal transmitted to the speaker 711 by changing the gain of the filter circuit included in the codec 705.

As mentioned in FIGS. 6A and 6B, when the wearing state is changed based on the touch input, the intensity of the audio signal in the frequency section vulnerable to howling may increase. Therefore, howling can be prevented by lowering the gain of the signal received through the microphone in the frequency range vulnerable to howling. Hereinafter, in FIGS. 8A, 8B, and 8C, a method of changing the settings of the filter circuit to lower the gain of the signal within the frequency range is described.

8A shows an example of the functional configuration of an audio device including a filter circuit combination, according to one embodiment.

Referring to FIG. 8A , an audio device (eg, audio device 501) may include a first microphone 701, a second microphone 703, and a speaker 711. For the first microphone 701, the second microphone 703, and the speaker 711, the description of FIG. 7 may be referred to.

The audio device 501 may filter the audio signal according to frequency. For example, the codec of the audio device 501 (eg, codec 705 in FIG. 7) may include a first filter circuit unit 801 and a second filter circuit unit 803.

The audio device 501 may include a first filter circuit 801. The first filter circuit unit 801 may include a first amplifier 801a and a first filter circuit 801b. The first amplifier 801a can control the gain of the input signal. For example, the first amplifier 801a may lower the gain of the signal. The first filter circuit 801b may filter signals in a specific frequency range from the signal. For example, the first filter circuit 801b may perform filtering to lower the intensity of a signal in a specified range where howling is expected. The first filter circuit unit 801 may filter the audio signal received through the second microphone 703 according to frequency while the ANC function, ambient noise tolerance function, or PSAP function is performed. As the signal is filtered at certain frequencies, howling can be reduced.

Audio device 501 may include second filter circuitry 803. The second filter circuit unit 803 may include a second amplifier 803a and a second filter circuit 803b. The second amplifier 803a can control the gain of the input signal. For example, the second amplifier 803a may lower the gain of the signal. The second filter circuit 803b may filter signals in a specific frequency range from the signal. For example, the second filter circuit 803b may perform filtering to lower the intensity of a signal in a specified range where howling is expected. The second filter circuit unit 803 may filter the audio signal received through the first microphone 701 according to frequency while the active noise cancellation (ANC) function is performed. As the signal is filtered at certain frequencies, howling can be reduced.

According to embodiments, the processor 707 may receive a detection result through the sensor 709. According to one embodiment, the sensor 709 may detect a user's touch input through a touch sensor. According to one embodiment, the sensor 709 may detect a grip through a grip detection sensor. According to one embodiment, the sensor 709 may detect the pressure of an external object or a user through a pressure sensor.

The processor 707 may identify a change in the wearing state of the audio device 501 based on the detection result. As the wearing state of the audio device 501 changes, signal inflow characteristics may vary. Due to changing signal inflow characteristics, the audio signal output from the speaker 711 may be input to the first microphone 701 or the second microphone 703. As the input audio signal is output again through the speaker 711, howling may occur. Therefore, the processor 707 can adjust the characteristics of the audio signal output again through the speaker 711 based on changes in wearing status to prevent howling.

According to one embodiment, the processor 707 may change the overall gain of the first filter circuit unit 801. The processor 707 can change the overall gain of the first filter circuit unit 801 regardless of frequency. For example, the processor 707 may overall lower the gain of the first filter circuit unit 801. According to one embodiment, the processor 707 may change the gain of the first filter circuit unit 801 according to frequency. For example, the processor 707 may lower the gain of the first filter circuit unit 801 in a specific frequency range.

According to one embodiment, the processor 707 may change the overall gain of the second filter circuit unit 803. The processor 707 can change the overall gain of the second filter circuit unit 803 regardless of frequency. For example, the processor 707 may overall lower the gain of the second filter circuit unit 803. According to one embodiment, the processor 707 may change the gain of the second filter circuit unit 803 according to frequency. For example, the processor 707 may lower the gain of the second filter circuit unit 803 in a specific frequency range.

8B shows an example of a functional configuration of an audio device including partial filter circuits, according to one embodiment. Unlike FIG. 8A, the gain of the signal can be controlled by selecting partial filter circuits of the filter circuit unit, instead of changing the gain of the entire filter circuit.

Referring to FIG. 8B, an audio device (eg, audio device 501) may include a first microphone 701, a second microphone 703, and a speaker 711. For the first microphone 701, the second microphone 703, and the speaker 711, the description of FIG. 7 may be referred to.

The audio device 501 may filter the audio signal according to frequency. For example, the codec of the audio device 501 (e.g., codec 705 in FIG. 7) may include a first filter circuit unit 851 and a second filter circuit unit 853.

The audio device 501 may include a first filter circuit 851. The first filter circuit unit 851 may include a first switch 851a and partial filter circuits. The partial filter circuits may include a first partial filter circuit 851b, a second partial filter circuit 851c, ..., and an n-th partial filter circuit 851d. The first switch 851a may connect one of the partial filter circuits. The first switch 851a may change the currently connected partial filter circuit to another partial filter circuit among the partial filter circuits based on a control command of the processor 707. For example, the first switch 851a may change the connected partial filter circuit from the second partial filter circuit 851c to the first partial filter circuit 851b based on a control command of the processor 707. The first filter circuit unit 851 may filter the audio signal received through the second microphone 703 according to frequency while the ANC function, ambient noise tolerance function, or PSAP function is performed. As the signal is filtered at certain frequencies, howling can be reduced.

Audio device 501 may include a second filter circuit 853. The second filter circuit unit 853 may include a second switch 853a and partial filter circuits. The partial filter circuits may include a first partial filter circuit 853b, a second partial filter circuit 853c, ..., and an n-th partial filter circuit 853d. The first switch 853a may connect one of the partial filter circuits. The first switch 853a may change the currently connected partial filter circuit to another partial filter circuit among the partial filter circuits based on a control command of the processor 707. For example, the first switch 853a may change the connected partial filter circuit from the second partial filter circuit 853c to the first partial filter circuit 853b based on a control command of the processor 707. The second filter circuit unit 853 may filter the audio signal received through the first microphone 701 according to frequency while the ANC function is performed. As the signal is filtered at certain frequencies, howling can be reduced.

According to one embodiment, the processor 707 may switch the partial filter circuit to be used among the partial filter circuits of the first filter circuit unit 851 from one partial filter circuit to another partial filter circuit. Due to external inputs (e.g., touch input, grip detection, pressure), the signal inflow characteristics may vary. The filtering frequency and filtering gain provided by each partial filter circuit may be independent. For example, the filtering characteristics of the first partial filter circuit 851b and the filtering characteristics of the second partial filter circuit 851c may be different. The first partial filter circuit 851b may lower the pass gain for signals in the first frequency range, while the second partial filter circuit 851c may lower the pass gain for signals in the second frequency range. The processor 707 may identify partial filter circuits to lower signal gain in the desired frequency range. The processor 707 may connect the identified partial filter circuit to the second microphone 703 through the first switch 851a. Although the first switch 851a is illustrated in FIG. 8B, selection of the partial filter circuit may be implemented in other ways. For example, the processor 707 may activate one of the partial filter circuits of the first filter circuit unit 851 and deactivate all remaining partial filter circuits of the first filter circuit unit 851.

According to one embodiment, the processor 707 may switch the partial filter circuit to be used among the partial filter circuits of the second filter circuit unit 853 from one partial filter circuit to another partial filter circuit. Due to external inputs (e.g., touch input, grip detection, pressure), the signal inflow characteristics may vary. The filtering frequency and filtering gain provided by each partial filter circuit may be independent. For example, the filtering characteristics of the first partial filter circuit 853b and the filtering characteristics of the second partial filter circuit 853c may be different. The first partial filter circuit 853b may lower the pass gain for signals in the first frequency range, while the second partial filter circuit 853c may lower the pass gain for signals in the second frequency range. The processor 707 may identify partial filter circuits to lower signal gain in the desired frequency range. The processor 707 may connect the identified partial filter circuit with the second microphone 703 through the first switch 853a. Although the first switch 853a is illustrated in FIG. 8B, selection of the partial filter circuit may be implemented in other ways. For example, the processor 707 may activate one of the partial filter circuits of the second filter circuit unit 853 and deactivate all remaining partial filter circuits of the second filter circuit unit 853.

8C shows an example of the functional configuration of an audio device including a filter circuit combination, according to one embodiment.

Referring to FIG. 8C, an audio device (eg, audio device 501) may include a first microphone 701, a second microphone 703, and a speaker 711. For the first microphone 701, the second microphone 703, and the speaker 711, the description of FIG. 7 may be referred to.

The audio device 501 may filter the audio signal according to frequency. For example, the codec of the audio device 501 (e.g., the codec 705 in FIG. 7) may include a first filter circuit combination unit 871 and a second filter circuit combination unit 873.

The audio device 501 may include a first filter circuit combination unit 871. The first filter circuit combination unit 871 may include a combination of a plurality of partial filter circuits. The partial filter circuits may include a first partial filter circuit, a second partial filter circuit, ..., and an n-th partial filter circuit. The first filter circuit combination unit 871 may be configured by changing the weight of each of a plurality of partial filter circuits based on a control command of the processor. For example, the first filter circuit combination unit 871 may be configured with the weight of the first partial filter circuit being 0.5, the weight of the second partial filter circuit being 0.3, and the weight of the third partial filter circuit being 0.2. . The first filter circuit combination unit 871 may filter the audio signal received through the second microphone 703 according to frequency while the ANC function, ambient noise tolerance function, or PSAP function is performed. Howling can be reduced as the signal is filtered at certain frequencies.

The audio device 501 may include a second filter circuit combination unit 873. The second filter circuit combination unit 873 may include a combination of a plurality of partial filter circuits. The partial filter circuits may include a first partial filter circuit, a second partial filter circuit, ..., and an n-th partial filter circuit. The second filter circuit combining unit 873 may be configured by changing the weight of each of the plurality of partial filter circuits based on a control command of the processor. For example, the second filter circuit combination unit 873 may be configured with the weight of the first partial filter circuit being 0.5, the weight of the second partial filter circuit being 0.3, and the weight of the third partial filter circuit being 0.2. . The second filter circuit combination unit 873 may filter the audio signal received through the first microphone 701 according to frequency while the ANC function, ambient noise tolerance function, or PSAP function is performed. Howling can be reduced as the signal is filtered at certain frequencies.

According to embodiments, the first filter circuit combination unit 871 and the second filter circuit combination unit 873 may be composed of a plurality of partial filter circuits. According to one embodiment, the first filter circuit combination unit 871 and the second filter circuit combination unit 873 may have at least one of a plurality of partial filter circuits activated and at least one of the other partial filter circuits deactivated. According to one embodiment, the first filter circuit combination unit 871 and the second filter circuit combination unit 873 may be configured to change the weight of each of the plurality of partial filter circuits. According to one embodiment, the first filter circuit combining unit 871 and the second filter circuit combining unit 873 may be configured to change the weight of each of the plurality of partial filter circuits. According to one embodiment, the first filter circuit combination unit 871 and the second filter circuit combination unit 873 may be a combination of a plurality of partial filter circuits. For example, in the at least one processor, as the intensity of the pressure of the touch input increases, the frequency range for lowering the gain of the first filter circuit combination unit 871 and the second filter circuit combination unit 873 may increase. there is.

9 shows an example of a functional configuration of an audio device for controlling characteristics of a filter, without a microphone, according to one embodiment.

Referring to FIG. 9, an audio device (eg, audio device 501) may include a sensor 903, a processor 901, a codec 907 including a filter circuit, and a speaker 711. The processor 901 may change the sound quality to improve the user experience even if the active noise cancellation (ANC), ambient noise tolerance, or personal sound amplification products (PSAP) function is not activated. The processor 901 may transmit a signal to the codec 907 to change sound quality. The sensor 903 can detect external input. For example, sensor 903 can detect touch input. For example, sensor 903 can detect touch pressure. Speaker 905 may transmit an audio signal. The codec 907 can change the gain of the filter. At least one processor (e.g., processor 305 in FIG. 3) may identify a change in wearing condition, such as a change in the amount of speaker port blockage or a change in the volume of the external auditory canal, based on external input identification received through a sensor. According to the change in the wearing state, the at least one processor 305 may change the gain according to the frequency of the filter through the codec 907. For example, the processor can increase the frequency range of a low-gain filter circuit because the greater the intensity of the touch pressure, the smaller the external auditory canal volume.

FIG. 10 is a flowchart illustrating the operation of an audio device for controlling an audio signal while active noise cancellation (ANC) is performed, according to an embodiment. ANC is a function to provide users with clear audio signals of sound quality by removing external noise. The operation of the audio device (eg, audio device 300, audio device 501) may be performed by at least one processor (eg, processor 305).

In operation 1001, at least one processor (eg, processor 305 in FIG. 3) may output a first audio signal through at least one speaker.

In operation 1003, the at least one processor 305 may receive a noise signal through at least one microphone. The at least one microphone may be a first microphone (eg, the first microphone 701 in FIG. 7). The at least one microphone may be a second microphone (eg, the second microphone 703 in FIG. 7). According to one embodiment, the first microphone 701 or the second microphone 703 may be used in active noise cancellation (ANC) technology to remove external noise.

In operation 1005, the at least one processor 305 may generate a tuning signal based on the noise signal. The tuning signal may be generated based on second phase information for canceling out the first phase information of the noise signal. Through cancellation, external noise can be eliminated. For example, the first phase information may be the phase of a noise signal. The second phase information may be the phase of the tuning signal. The phase of the tuning signal may be opposite to the phase of the noise signal.

In operation 1007, the at least one processor 305 may output a second audio signal in which the generated tuning signal and the first audio signal are combined through the at least one speaker. The at least one processor 305 may remove external noise through the tuning signal. The at least one processor 305 may transmit the second audio signal to transmit the first audio signal from which external noise has been removed.

In operation 1009, the processor 305 may detect external input through at least one sensor. The processor 305 may identify a change in the wearing state of the audio device 501 based on an external input. The at least one sensor may be a sensor for detecting touch. The at least one sensor may be a sensor for measuring pressure. The at least one sensor may be a sensor for detecting a grip. For example, the processor 305 may detect a touch input through a touch detection sensor. The processor 305 may identify a change in the wearing state of the audio device 501 based on the touch input. For example, the processor 305 may detect touch pressure through a pressure sensor. For example, the processor 305 may detect a grip through a grip sensor.

In operation 1009, the processor 305 may change the gain of a filter circuit in response to the external input. For example, the at least one processor 305 may lower the gain of the filter circuit based on the touch input. When a change in the wearing state is identified based on the touch input, the intensity of the audio signal in a frequency range vulnerable to howling may increase. Accordingly, the at least one processor 305 can prevent howling by lowering the gain of the filter circuit in the frequency range vulnerable to howling. Changes in wearing conditions that affect the strength of the audio signal may include changes in the amount of speaker port blockage and changes in the volume of the external auditory canal. The processor 305 can know this change in wearing status through whether external input is received through the sensor. The processor 305 may receive external input through the sensor. The processor 305 may identify a change in the wearing state of the audio device 501 based on the reception of the touch input. Howling may occur when an audio signal output from a speaker is input to the first microphone or the second microphone and is output again through the speaker. Therefore, the processor 305 can adjust the signal transmitted to the speaker based on changes in wearing status to prevent howling. For example, the processor 305 may lower the gain of the filter circuit in a specific frequency range based on external input identification. For example, the filter circuit may be switched from one of a plurality of partial filter circuits to another. For example, the processor 305 may activate one of a plurality of partial filter circuits and deactivate all remaining partial filter circuits. For example, the filter circuit combination unit may have activated at least one of the plurality of partial filter circuits and deactivated at least one other one. For example, the filter circuit combining unit may be configured to change the weight of each of the plurality of partial filter circuits. For example, the filter circuit combining unit may be configured to change the weight of each of the plurality of partial filter circuits.

In operation 1013, the at least one processor 305 may generate an output signal by passing the second audio signal received through the at least one microphone through the filter circuit.

In operation 1015, the at least one processor 305 may output an output signal through the at least one speaker. The processor 305 reduces the gain in the frequency range vulnerable to howling when the wearing state is changed, and reduces the output signal to prevent howling from occurring. Therefore, howling may not occur even if the amount of blockage in the speaker port changes or the volume of the external auditory canal changes.

FIG. 11 is a flowchart for explaining the operation of an audio device for controlling an audio signal while a peripheral sound tolerance function for listening to surrounding sounds or personal sound amplification products (PSAP) is performed, according to an embodiment.

In operation 1101, the at least one processor 305 may receive an external signal through at least one microphone. The microphone may be a second microphone (eg, the second microphone 703 in FIG. 7). According to one embodiment, the second microphone 413 may be used for an ambient sound tolerance function or personal sound amplification products (PSAP) technology for listening to surrounding sounds.

In operation 1103, the at least one processor 305 may generate a tuning signal based on the external signal. According to one embodiment, in order to amplify an external signal received from the second microphone 413, the at least one processor may generate a tuning signal. The tuning signal may be generated based on second phase information for amplifying the first phase information of the external signal. Through amplification, ambient sounds may be heard by the wearer. For example, the first phase information may be the phase of an external signal. The second phase information may be the phase of the tuning signal. The phase of the tuning signal may be the same as the phase of the external signal.

In operation 1105, the at least one processor 305 may output the generated tuning signal through the at least one speaker.

In operation 1107, the at least one processor 305 may detect an external input through at least one sensor. The processor 305 may identify a change in the wearing state of an audio device (eg, the audio device 501 in FIG. 5) based on the external input. The at least one sensor may be a sensor for detecting touch. The at least one sensor may be a sensor for measuring pressure. The at least one sensor may be a sensor for detecting a grip. For example, the processor 305 may detect a touch input through a touch detection sensor. The processor 305 may identify a change in the wearing state of the audio device 501 based on the touch input. For example, the processor 305 may detect touch pressure through a pressure sensor. For example, the processor 305 may detect a grip through a grip sensor.

At operation 1109, the at least one processor 305 may change the gain of a filter circuit in response to the external input. For example, the at least one processor 305 may lower the gain of the filter circuit based on the touch input. When a change in the wearing state is identified based on the touch input, the intensity of the audio signal in a frequency range vulnerable to howling may increase. Accordingly, the at least one processor 305 can prevent howling by lowering the gain of the filter circuit in the frequency range vulnerable to howling. Changes in wearing conditions that affect the strength of the audio signal may include changes in the amount of speaker port blockage and changes in the volume of the external auditory canal. The processor 305 can know this change in wearing status through whether external input is received through the sensor. The processor 305 may receive external input through the sensor. The processor 305 may identify a change in the wearing state of the audio device 501 based on the reception of the touch input. Howling may occur when an audio signal output from a speaker is input to the first microphone or the second microphone and is output again through the speaker. Therefore, the processor 305 can adjust the signal transmitted to the speaker based on changes in wearing status to prevent howling. For example, the processor 305 may lower the gain of the filter circuit in a specific frequency range based on external input identification. For example, the filter circuit may be switched from one of a plurality of partial filter circuits to another. For example, the processor 305 may activate one of a plurality of partial filter circuits and deactivate all remaining partial filter circuits. For example, the filter circuit combination unit may have activated at least one of the plurality of partial filter circuits and deactivated at least one other one. For example, the filter circuit combining unit may be configured to change the weight of each of the plurality of partial filter circuits. For example, the filter circuit combining unit may be configured to change the weight of each of the plurality of partial filter circuits.

In operation 1111, the at least one processor 305 may generate an output signal by passing the audio signal received through the at least one microphone through the filter circuit.

In operation 1113, the at least one processor 305 may output an output signal through the at least one speaker. The processor 305 reduces the gain in the frequency range vulnerable to howling when the wearing state is changed, and reduces the output signal to prevent howling from occurring. Therefore, howling may not occur even if the amount of blockage in the speaker port changes or the volume of the external auditory canal changes.

As described above, according to one embodiment, an audio device may include at least one processor, at least one speaker, at least one microphone, a filter circuit, and at least one sensor. The at least one processor may output a first audio signal through the at least one speaker. The at least one processor may receive a noise signal through the at least one microphone. The at least one processor may generate a tuning signal based on the noise signal. The at least one processor may output a second audio signal, which is a combination of the generated tuning signal and the first audio signal, through the at least one speaker. The at least one processor may detect an external input through the at least one sensor. The at least one processor may change the gain of the filter circuit in response to the external input. The at least one processor may generate an output signal by passing the second audio signal received through the at least one microphone through the filter circuit whose gain is changed. The at least one processor may be configured to output the output signal through the at least one speaker.

According to one embodiment, in order to change the gain of the filter circuit, the at least one processor may be configured to activate at least one of the plurality of partial filter circuits of the filter circuit and deactivate at least one other one. .

According to one embodiment, in order to change the gain of the filter circuit, the at least one processor may be configured to change the weight of each of a plurality of partial filter circuits of the filter circuit.

According to one embodiment, an audio device may include a housing coupled to the at least one sensor, and a sensor coupled to the housing. The at least one microphone may include a feedback microphone disposed on a surface of the housing where the protrusion is coupled.

According to one embodiment, an audio device may include a housing coupled to the at least one sensor, and a protrusion coupled to the housing. The at least one microphone may include a reference microphone disposed on a surface of the housing to which the sensor is coupled.

According to one embodiment, the at least one sensor may include a touch detection sensor. The external input detected through the touch detection sensor may include a touch input.

According to one embodiment, in order to generate the tuning signal, the at least one processor may obtain first phase information of the noise signal. The at least one processor may obtain second phase information to offset the first phase information. The at least one processor may generate the tuning signal based on the second phase information.

According to one embodiment, in order to change the gain of the filter circuit, the at least one processor may include a gain for a frequency within a designated range for howling cancellation based on the pressure of the external input ( It can be configured to reduce gain.

As described above, according to one embodiment, an audio device may include at least one processor, at least one speaker, at least one microphone, a filter circuit, and at least one sensor. The at least one processor may receive an external signal through the at least one microphone. The at least one processor may generate a tuning signal based on the external signal. The at least one processor may output the generated tuning signal through the at least one speaker. The at least one processor may detect an external input through the at least one sensor. The at least one processor may change the gain of the filter circuit in response to the external input. The at least one processor may generate an output signal by passing the audio signal received through the at least one microphone through the filter circuit whose gain is changed. The at least one processor may be configured to output the output signal through the at least one speaker.

According to one embodiment, in order to change the gain of the filter circuit, the at least one processor may activate at least one of a plurality of partial filter circuits of the filter circuit. The at least one processor may be configured to deactivate the other at least one processor.

According to one embodiment, in order to change the gain of the filter circuit, the at least one processor may be configured to change the weight of each of a plurality of partial filter circuits of the filter circuit.

According to one embodiment, an audio device may include a housing coupled to the at least one sensor, and a protrusion coupled to the housing. The at least one microphone may include a reference microphone disposed on a surface of the housing to which the sensor is coupled.

According to one embodiment, the at least one sensor may include a touch detection sensor. The external input detected through the touch detection sensor may include a touch input.

According to one embodiment, in order to generate the tuning signal, the at least one processor may obtain first phase information of the external signal. The at least one processor may obtain second phase information for amplifying the first phase information. The at least one processor may generate the tuning signal based on the second phase information.

According to one embodiment, in order to change the gain of the filter circuit, the at least one processor may include a gain for a frequency within a designated range for howling cancellation based on the pressure of the external input ( It can be configured to reduce gain.

As described above, according to one embodiment, a method performed by an audio device may include outputting a first audio signal through at least one speaker. The method may include receiving a noise signal through at least one microphone. The method may include generating a tuning signal based on a noise signal. The method may include outputting a second audio signal, which is a combination of the generated tuning signal and the first audio signal, through the at least one speaker. The method may include detecting an external input through at least one sensor. The method may include changing the gain of the filter circuit in response to the external input. The method may include generating an output signal by passing the second audio signal received through the at least one microphone through the filter circuit whose gain is changed. The method may include outputting the output signal through the at least one speaker.

According to one embodiment, the operation of changing the gain of the filter circuit may include activating at least one of a plurality of partial filter circuits of the filter circuit. The operation of changing the gain of the filter circuit may include the operation of deactivating at least one other filter circuit.

method.

According to one embodiment, the operation of changing the gain of the filter circuit may include the operation of changing the weight of each of a plurality of partial filter circuits of the filter circuit.

According to one embodiment, the at least one microphone may include a feedback microphone disposed on the sensor-coupled side of the housing.

According to one embodiment, the at least one microphone may include a reference microphone disposed on a surface of the housing where the protrusion is coupled.

Electronic devices according to various embodiments disclosed in this document may be of various types. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, electronic devices, or home appliances. Electronic devices according to embodiments of this document are not limited to the above-described devices.

The various embodiments of this document and the terms used herein are not intended to limit the technical features described in this document to specific embodiments, and should be understood to include various changes, equivalents, or replacements of the embodiments. In connection with the description of the drawings, similar reference numbers may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the above items, unless the relevant context clearly indicates otherwise. As used herein, “A or B”, “at least one of A and B”, “at least one of A or B”, “A, B or C”, “at least one of A, B and C”, and “A Each of phrases such as “at least one of , B, or C” may include any one of the items listed together in the corresponding phrase, or any possible combination thereof. Terms such as "first", "second", or "first" or "second" may be used simply to distinguish one component from another, and to refer to that component in other respects (e.g., importance or order) is not limited. One (e.g. first) component is said to be "coupled" or "connected" to another (e.g. second) component, with or without the terms "functionally" or "communicatively". Where mentioned, it means that any of the components can be connected to the other components directly (e.g. wired), wirelessly, or through a third component.

The term “module” used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and is interchangeable with terms such as logic, logic block, component, or circuit, for example. It can be used as A module may be an integrated part or a minimum unit of the parts or a part thereof that performs one or more functions. For example, according to one embodiment, the module may be implemented in the form of an application-specific integrated circuit (ASIC).

Various embodiments of the present document are software (e.g., a program) that includes one or more instructions stored in a storage medium (e.g., internal memory or external memory) that can be read by a machine (e.g., an electronic device). It can be implemented as: For example, a processor (eg, processor) of a device (eg, electronic device) may call at least one instruction among one or more instructions stored from a storage medium and execute it. This allows the device to be operated to perform at least one function according to the at least one instruction called. The one or more instructions may include code generated by a compiler or code that can be executed by an interpreter. A storage medium that can be read by a device may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' only means that the storage medium is a tangible device and does not contain signals (e.g. electromagnetic waves), and this term refers to cases where data is semi-permanently stored in the storage medium. There is no distinction between temporary storage cases.

According to one embodiment, methods according to various embodiments disclosed in this document may be provided and included in a computer program product. Computer program products are commodities and can be traded between sellers and buyers. The computer program product may be distributed in the form of a machine-readable storage medium (e.g. compact disc read only memory (CD-ROM)) or through an application store (e.g. Play Store™) or on two user devices (e.g. It can be distributed (e.g. downloaded or uploaded) directly between smart phones) or online. In the case of online distribution, at least a portion of the computer program product may be at least temporarily stored or temporarily created in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.

According to various embodiments, each component (e.g., module or program) of the above-described components may include a single or plural entity, and some of the plurality of entities may be separately placed in other components. there is. According to various embodiments, one or more of the components or operations described above may be omitted, or one or more other components or operations may be added. Alternatively or additionally, multiple components (eg, modules or programs) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each component of the plurality of components in the same or similar manner as those performed by the corresponding component of the plurality of components prior to the integration. . According to various embodiments, operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, or omitted. or one or more other operations may be added.

Claims (20)

at least one processor,
at least one speaker,
at least one microphone,
filter circuit, and
Contains at least one sensor,
The at least one processor,
Outputting a first audio signal through the at least one speaker,
Receiving a noise signal through the at least one microphone,
Generating a tuning signal based on the noise signal,
Outputting a second audio signal, which is a combination of the generated tuning signal and the first audio signal, through the at least one speaker,
Detect an external input through the at least one sensor,
In response to the external input, change the gain of the filter circuit,
Configured to generate an output signal by passing the second audio signal received through the at least one microphone through the filter circuit whose gain is changed, and output the output signal through the at least one speaker,
Audio device.
In claim 1,
To change the gain of the filter circuit, the at least one processor:
configured to activate at least one of the plurality of partial filter circuits of the filter circuit and deactivate at least one other one,
Audio device.
In claim 1,
To change the gain of the filter circuit, the at least one processor:
configured to change the weight of each of the plurality of partial filter circuits of the filter circuit,
Audio device.
In claim 1,
A housing coupled to the at least one sensor, and
Includes a protrusion coupled to the housing,
The at least one microphone includes a feedback microphone disposed on a surface of the housing to which the protrusion is coupled.
Audio device.
In claim 1,
A housing coupled to the at least one sensor, and
Includes a protrusion coupled to the housing,
The at least one microphone includes a reference microphone disposed on a surface of the housing to which the sensor is coupled.
Audio device.
In claim 1,
The at least one sensor includes a touch detection sensor,
The external input detected through the touch detection sensor includes a touch input,
Audio device.
In claim 1,
To generate the tuning signal,
The at least one processor,
Obtaining first phase information of the noise signal,
Obtaining second phase information to offset the first phase information,
Generating the tuning signal based on the second phase information,
Audio device.
In claim 1,
To change the gain of the filter circuit,
The at least one processor,
configured to reduce the gain for frequencies within a designated range for howling cancellation based on the pressure of the external input,
Audio device.
at least one processor,
at least one speaker,
at least one microphone,
filter circuit, and
Contains at least one sensor,
The at least one processor,
Receive an external signal through the at least one microphone,
Generating a tuning signal based on the external signal,
Outputting the generated tuning signal through the at least one speaker,
Detect an external input through the at least one sensor,
In response to the external input, change the gain of the filter circuit,
Configured to generate an output signal by passing the audio signal received through the at least one microphone through the filter circuit whose gain is changed, and output the output signal through the at least one speaker,
Audio device.
In claim 9,
To change the gain of the filter circuit,
The at least one processor,
configured to activate at least one of the plurality of partial filter circuits of the filter circuit and deactivate at least one other one,
Audio device.
In claim 9,
To change the gain of the filter circuit,
The at least one processor,
configured to change the weight of each of the plurality of partial filter circuits of the filter circuit,
Audio device.
In claim 9,
A housing coupled to the at least one sensor, and
Includes a protrusion coupled to the housing,
The at least one microphone includes a reference microphone disposed on a surface of the housing to which the sensor is coupled.
Audio device.
In claim 9,
The at least one sensor includes a touch detection sensor,
The external input detected through the touch detection sensor includes a touch input,
Audio device.
In claim 9,
To generate the tuning signal,
The at least one processor,
Obtaining first phase information of the external signal,
Obtaining second phase information for amplifying the first phase information,
Generating the tuning signal based on the second phase information,
Audio device.
In claim 9,
To change the gain of the filter circuit,
The at least one processor,
configured to reduce the gain for frequencies within a designated range for howling cancellation based on the pressure of the external input,
Audio device.
In a method performed by an audio device,
Outputting a first audio signal through at least one speaker;
Receiving a noise signal through at least one microphone;
An operation of generating a tuning signal based on a noise signal;
Outputting a second audio signal, which is a combination of the generated tuning signal and the first audio signal, through the at least one speaker;
An operation of detecting an external input through at least one sensor,
An operation of changing the gain of a filter circuit in response to the external input;
Generating an output signal by passing the second audio signal received through the at least one microphone through the filter circuit whose gain is changed;
Including the operation of outputting the output signal through the at least one speaker,
method.
In claim 16,
The operation of changing the gain of the filter circuit is,
activating at least one of a plurality of partial filter circuits of the filter circuit;
comprising an operation to disable at least one other,
method.
In claim 16,
The operation of changing the gain of the filter circuit is,
Including an operation of changing the weight of each of the plurality of partial filter circuits of the filter circuit,
method.
In claim 16,
The at least one microphone includes a feedback microphone disposed on the sensor-coupled side of the housing,
method.
In claim 16,
The at least one microphone includes a reference microphone disposed on a surface of the housing where the protrusion is coupled,
method.

Images