KR20210111603A - Apparatus and method for improving sound quality - Google Patents

Abstract

In accordance with an embodiment of the present invention, an electronic apparatus comprises: a communication circuit; an audio processing circuit; a speaker; and one or more processors operably connected to the communication circuit and the audio processing circuit. The one or more processors can acquire an audio signal through the communication circuit, analyze a first energy corresponding to a first frequency band and a second energy corresponding to a second frequency band, which is higher than the first frequency band, in the acquired audio signals, determine a calibration value applied to the audio signals based on the bandwidth set by the audio processing circuit based on the results of analysis of the first energy and the second energy, and output the audio signals with the calibration value applied through the speaker. On top of that, various embodiments identified through the specifications are possible.

Description

Method and device for improving sound quality

Embodiments disclosed in this document relate to a technique for improving sound quality deterioration that occurs when a bandwidth of an electronic device from which content is reproduced and a bandwidth of a content reproduction signal are different from each other.

For calls or multimedia, when an audio signal is reproduced, a signal having various bandwidths may be used according to a reproduced sound source or sound quality. When transmitting/receiving an audio signal between electronic devices, the bandwidth connected between the electronic devices is compared and forcibly set to the lower of the two bandwidths to transmit/receive an audio signal, or an audio signal to an electronic device having a bandwidth greater than the bandwidth of the audio signal can send and receive

When the bandwidth of the electronic device from which content is reproduced is different from the bandwidth of the content reproduction signal, the volume or sound quality of audio transmitted between the electronic devices may be deteriorated. For example, harmonics or clipping described in FIG. 1 or FIG. 2 may cause deterioration in volume or sound quality.

1 shows an example of harmonic generation.

Referring to FIG. 1 , when the bandwidth of the electronic device is greater than the bandwidth of the reproduction signal, at least one of noise or harmonic distortion 107 may be introduced into a band excluding the bandwidth of the reproduction signal among the bandwidths of the electronic device. can The electronic device may output an audio signal based on a bandwidth including at least one of the introduced noise and harmonic.

The electronic device may use signals having various bandwidths according to a reproduced sound source or sound quality. For example, the bandwidth may include 4 kHz, 8 kHz, 16 kHz, and 48 kHz. The bandwidth of 0 kHz to 4 kHz is NB (narrow band) 101, the bandwidth from 0 kHz to 8 kHz is WB (wide band) 103, and the bandwidth from 0 kHz to 16 kHz is SWB (super wide band) (105) can be referred to as .

For example, when an electronic device having a bandwidth of SWB acquires an audio signal having a bandwidth of NB 101 and outputs the audio signal with a bandwidth of SWB 105, saturation ( Harmonic distortion 107 may occur due to saturation or the like. The electronic device may output an audio signal including a harmonic component generated over a bandwidth of the NB 101 through a speaker.

2 shows an example of occurrence of clipping.

Referring to FIG. 2 , when the size of the audio signal transmitted to the electronic device exceeds the limit output level allowed by the electronic device, clipping may occur in the audio signal. At least one of distortion, harmonic, and noise may be generated in the audio signal by the clipping. The electronic device may output the distorted audio signal generated by the clipping through a speaker.

For example, the electronic device may obtain an audio signal corresponding to a relatively loud sound from an external device. The electronic device may output the audio signal A through a speaker within a frequency range of a maximum output of device 201 . When the obtained audio signal exceeds the threshold output size, clipping occurs in the obtained audio signal, and the bandwidth of the maximum output 201 of the electronic device matches the obtained audio signal bandwidth, the clipping The harmonic generated by ? may be masked by the audio signal or removed in a band exceeding the bandwidth of the maximum output 201 . On the other hand, when the bandwidth of the maximum output 201 of the electronic device is greater than the bandwidth of the obtained audio signal (eg, FIG. 1 ), the harmonic is masked by the audio signal or is caused by exceeding the bandwidth of the maximum output 201 . It may be output through the speaker without removal, resulting in deterioration of sound quality.

Various embodiments disclosed in this document may provide an apparatus and method for solving the above-described problems.

An electronic device according to an embodiment disclosed in this document includes a communication circuit; audio processing circuitry; speaker; and at least one processor operatively coupled with the communication circuitry and the audio processing circuitry, the at least one processor configured to: obtain an audio signal via the communication circuitry; analyzing a first energy corresponding to a first frequency band and a second energy corresponding to a second frequency band higher than the first frequency band among the obtained audio signals; determining a correction value applied to the audio signal based on an analysis result of the first energy and the second energy, and a bandwidth set in the audio processing circuit, and outputting the audio signal to which the correction value is applied through the speaker , may be an electronic device.

In addition, the method for controlling the improvement of operational sound quality according to an embodiment disclosed in this document may include: acquiring an audio signal through a communication circuit; analyzing a first energy corresponding to a first frequency band and a second energy corresponding to a second frequency band higher than the first frequency band among the obtained audio signals; determining a correction value applied to the audio signal based on a result of analyzing the first energy and the second energy and a bandwidth set in an audio processing circuit; and outputting the audio signal to which the correction value is applied through a speaker.

According to various embodiments disclosed in this document, improved sound quality can be provided to the user by compensating for sound quality deterioration that may occur when the bandwidth of the terminal where the content is reproduced and the bandwidth of the content reproduction signal are different. In addition, various effects directly or indirectly identified through this document may be provided.

1 shows a problem in the prior art due to harmonic generation.
Figure 2 shows the problem of the prior art due to the occurrence of clipping.
3 illustrates a relationship between the bandwidth of the electronic device 300 and the bandwidth of an audio signal according to an embodiment.
4 is a block diagram illustrating an electronic device 300 according to an embodiment.
5 illustrates a process of controlling the bandwidth of the electronic device 300 in response to the bandwidth of an audio signal according to an embodiment.
6 is a flowchart of determining a correction value applied to an audio signal based on energy analysis of the audio signal according to an exemplary embodiment.
7 is a flowchart illustrating whether a correction value is applied based on a comparison result of the bandwidth of an audio signal and the bandwidth of the electronic device 300 according to an embodiment.
8 is a flowchart of determining a reference frequency bandwidth of an audio signal through comparison of an absolute value and a threshold value, according to an exemplary embodiment.
9 illustrates a specific example of determining a reference frequency bandwidth of an audio signal through comparison of an absolute value and a threshold value, according to an embodiment.
10 is a block diagram of an electronic device 1001 in the network environment 1000 according to an embodiment.
In connection with the description of the drawings, the same or similar reference numerals may be used for the same or similar components.

Hereinafter, various embodiments will be described with reference to the accompanying drawings. However, this is not intended to limit the specific embodiments, and it should be understood that various modifications, equivalents, and/or alternatives of the embodiments are included.

3 illustrates a relationship between the bandwidth of the electronic device 300 and the bandwidth of an audio signal according to an embodiment.

3 illustrates, for example, in a situation in which a voice call is connected between the electronic device 300 and the external device 310 , a user of the electronic device 300 is connected to a peripheral device (eg, Bluetooth) connected to the electronic device 300 . It may refer to an exemplary scenario of making a call with a user of the external device 310 using a microphone and a speaker of the headset 320 .

According to an embodiment, the electronic device 300 may transmit or receive an audio signal with the external device 310 . The electronic device 300 may set the bandwidth of the electronic device 300 according to the call quality provided from the external device 310 . For example, the electronic device 300 may set the bandwidth of the electronic device 300 to NB, WB, or SWB corresponding to the bandwidth of the audio signal provided from the external device 310 . A band may mean a bandwidth. The bandwidth may mean a path.

According to an embodiment, the electronic device 300 may set the bandwidth of the electronic device 300 in response to the acquired bandwidth of the audio signal. For example, when a user and a counterpart make a WB call, the electronic device 300 changes the bandwidth of the electronic device 300 to 8 kHz (WB) in response to an 8 kHz (WB) audio signal obtained from the external device 310 . can be set to The electronic device 300 set to a bandwidth of 8 kHz (WB) may acquire an audio signal of 8 kHz (WB) from the external device 310 . The bandwidth of the electronic device 300 and the bandwidth of the obtained audio signal may match 351 at 8 kHz (WB), respectively. According to another embodiment, the bandwidth of the electronic device 300 and the bandwidth of the obtained audio signal may match 352 to 4 kHz (NB), respectively.

Audio signals between the electronic device 300 and the external device 310 may be exchanged with a bandwidth that matches each other, but the electronic device 300 transmits the audio signal obtained from the external device 310 to a peripheral device (eg, a BT headset ( 320))). According to an embodiment, a bandwidth for outputting an audio signal from a peripheral device (eg, the BT headset 320) may be always fixed. For example, the bandwidth for outputting an audio signal from the BT headset 320 may always be fixed (353, 354) to 8 kHz (WB). The BT headset 320 may output an audio signal of 4 kHz or 8 kHz obtained from the electronic device 300 through a fixed output bandwidth of 8 kHz (WB).

According to an embodiment, the electronic device 300 may output the audio signal obtained from the external device 310 through the AI speaker. The bandwidth for outputting an audio signal from the AI speaker may be fixed (353, 354) to always 8 kHz (WB).

According to an embodiment, the electronic device 300 obtains an audio signal of 4 kHz from the external device 310 and outputs the audio signal of 4 kHz through the BT headset 320 having a bandwidth of 8 kHz for outputting the audio signal. have. A bandwidth (eg, 4 kHz) of the acquired audio signal and a bandwidth (eg, 8 kHz) of an outputting device (eg, BT headset 320) may be different 353 .

4 is a block diagram illustrating an electronic device 300 according to an embodiment.

According to an embodiment, the components included in the electronic device 300 may not be limited to the components shown in the block diagram of FIG. 4 . Components shown in the block diagram of the electronic device 300 may be removed or new components may be added. For example, components of the electronic device 1001 illustrated in FIG. 10 may be applied to components of the electronic device 300 illustrated in FIG. 4 .

According to an embodiment, the electronic device 300 may include a processor 401 , a communication circuit 403 , a speaker 405 , and an audio processing circuit 407 .

According to an embodiment, the processor 401 may be electrically and/or operatively connected to the communication circuit 403 , the speaker 405 , and the audio processing circuit 407 . The processor 401 may execute software to control at least one other component connected to the processor 401 (eg, the communication circuit 403 , the speaker 405 , and/or the audio processing circuit 407 ). . The processor 401 may perform various data processing and/or operations.

According to an embodiment, the processor 401 may obtain an audio signal from the external device 310 through the communication circuit 403 . The processor 401 may set a bandwidth of the electronic device 300 to output an audio signal. The external device 310 may include a terminal, a BT headset, an AI speaker, and a BT speaker. The external device 310 may be an electronic device that supports calls, multimedia, and streaming.

According to an embodiment, the communication circuit 403 may transmit or receive an audio signal between the electronic device 300 and the external device 310 . The electronic device 300 transmits an audio signal by being directly connected (eg, BT (Bluetooth)) or indirectly connected (eg, server, access point (AP)) to the external device 310 through the communication circuit 403 . can transmit or receive. The communication circuit 403 may provide a communication function of cellular, VoLTE, YouTube streaming, or live chat between the electronic device 300 and the external device 310 .

According to an embodiment, the speaker 405 may output an audio signal obtained from the external device 310 . The speaker 405 may obtain an encoded audio signal through an encoder. The speaker 405 may decode and output the acquired audio signal through a decoder.

According to an embodiment, the audio processing circuit 407 may enhance an audio signal through speech enhancement. The audio processing circuit 407 may perform echo cancellation through an echo canceller. The echo cancellation may be referred to as removing noise or echo. The audio processing circuit 407 may process the acquired audio signal based on the bandwidth of the electronic device 300 . Processing the audio signal may be referred to as processing an audio signal obtained from the external device 310 according to a setting state of the electronic device 300 .

5 illustrates a method of controlling the bandwidth of the electronic device 300 in response to the bandwidth of an audio signal according to an embodiment.

Hereinafter, a process in which an audio signal obtained from the external device 310 is processed by the internal components of the electronic device 300 will be described.

According to an embodiment, operations of processing an audio signal obtained from the external device 310 by executing commands stored in the memory of the electronic device 300 may be implemented. The electronic device 300 may control the bandwidth of the electronic device 300 through a plurality of modules included in the electronic device 300 . Modules included in the electronic device 300 may be implemented as hardware or software. For example, a volume correction module (eg, an amplifier, a limiter) may be implemented in hardware, and the input signal band separation module may be implemented in software.

According to an embodiment, the electronic device 300 may obtain an audio signal from the external device 310 . The electronic device 300 may divide the obtained audio signal into a plurality of bands through the input signal band separation module 501 . For example, the input signal band separation module 501 may divide the bandwidth of the audio signal into 1 band, 2 bands, and 3 bands.

According to an embodiment, the first band may be referred to as a band of 0 kHz or more and 4 kHz or less, the second band may be referred to as a band of 4 kHz or more and 8 kHz or less, and the third band may be referred to as a band of 8 kHz or more and 16 kHz or less.

According to an embodiment, the electronic device 300 analyzes energy corresponding to each band through the 1-band energy analysis module 503 , the 2-band energy analysis module 505 , and the 3-band energy analysis module 507 . can The reproduction signal may mean an audio signal. For example, the electronic device 300 may analyze energy corresponding to one band (0 kHz or more and 4 kHz or less) through the 1-band energy analysis module 503 .

According to an embodiment, the electronic device 300 may compare the energy component difference between the first band and the second band and the third band through the reproduction signal band comparison and determination module 509 . For example, the reproduction signal band comparison and determination module 509 may calculate a difference between the energy level corresponding to the first band and the energy level corresponding to the second band or the third band.

According to an embodiment, the reproduction signal band comparison and determination module 509 may determine the reference frequency bandwidth of the audio signal by comparing the calculated energy difference with a preset threshold value. For example, the reproduction signal band comparison and determination module 509 may determine the reference frequency bandwidth of the audio signal as NB when the calculated energy difference is greater than a preset threshold value.

According to an embodiment, the volume correction module 511 may determine a volume correction value to be applied to the audio signal based on a comparison result of the reference frequency bandwidth of the audio signal and the bandwidth of the electronic device 300 . The type of volume correction may be at least one of a gain, a limiter, and a low path filter (LPF). The volume correction value may be variously referred to as a volume correction parameter, data, information, and the like.

According to an embodiment, the sign language and speech setting module 513 may set a sign language adaptive low path filter (ALPF) and a speech ALPF based on the determined volume correction value. Unlike the filter (LPF) that uses a fixed value, the ALPF adaptively uses the filter (LPF) for an empty band among the bandwidths of the electronic device 300 based on the reference frequency bandwidth of the acquired audio signal. can be referenced. The electronic device 300 may output the audio signal to which the ALPF is applied through the sign language and outgoing setting module 513 through the speaker 405 .

6 is a flowchart of determining a correction value applied to an audio signal based on energy analysis of the audio signal according to an exemplary embodiment.

In operation 601 , the electronic device 300 may obtain an audio signal having a bandwidth from the external device 310 through the communication circuit 403 . For example, the electronic device 300 may obtain an audio signal having a bandwidth of 4 kHz from the external device 310 through the communication circuit 403 . The bandwidth may include 4 kHz, 8 kHz, 16 kHz, and 48 kHz. The type of the bandwidth may not be limited.

According to an embodiment, the bandwidth of the electronic device 300 may be different from the reference frequency bandwidth of the audio signal. The reference frequency bandwidth of the audio signal may include a plurality of frequency bands. For example, the reference frequency bandwidth of the audio signal may include a first frequency band, a second frequency band, and a third frequency band.

According to an embodiment, the first frequency band may correspond to 0 kHz or more and 4 kHz or less, the second frequency band may correspond to 4 kHz or more and 8 kHz or less, and the third frequency band may correspond to 8 kHz or more and 16 kHz or less, respectively.

In operation 603, the frequency band may include energy corresponding to the frequency band. The energy of each frequency band may be different. For example, the energy of the first frequency band corresponding to 0 kHz or more and 4 kHz or less may be different from the energy of the second frequency band corresponding to 4 kHz or more and 8 kHz or less.

According to an embodiment, the electronic device 300 may analyze the first energy corresponding to the first frequency band and the second energy corresponding to the second frequency band. For example, the electronic device 300 may analyze the amount of energy corresponding to each frequency band. The level of energy corresponding to the frequency band may be proportional to the signal level of the frequency band.

According to an embodiment, the electronic device 300 may acquire the signal magnitude of the first frequency band and the signal magnitude of the second frequency band based on the analysis of the first energy and the second energy. A method of analyzing the first energy and the second energy may not be limited to the method described with reference to FIG. 5 .

According to an embodiment, the electronic device 300 may determine the reference frequency bandwidth of the audio signal based on a comparison of the signal magnitude of the first frequency band and the signal magnitude of the second frequency band. The reference frequency bandwidth of the audio signal may include one of NB, WB, and SWB. An operation in which the electronic device 300 determines (605) a correction value applied to an audio signal by analyzing (603) the first energy and the second energy will be described in detail with reference to FIGS. 7 and 8 .

In operation 605 , the electronic device 300 may determine a correction value applied to the audio signal based on the analysis of the first energy corresponding to the first frequency band and the second energy corresponding to the second frequency band. The correction value may include at least one of a gain, a filter LPF, and a limiter.

According to an embodiment, the electronic device 300 may control an operation time for applying the determined correction value to the audio signal. For example, the electronic device 300 may be configured to periodically apply a gain value, which is the determined correction value, to the audio signal from 7:00 PM to 9:00 PM every day. As another example, the electronic device 300 may be set to apply the determined correction value, which is the filter (LPF) value, to the audio signal aperiodically in response to a user input.

In operation 607, the electronic device 300 may output the audio signal to which the correction value is applied through the speaker. For example, the electronic device 300 may output an audio signal to which a gain and a filter LPF are applied through a speaker.

7 is a flowchart illustrating whether or not a correction value is applied based on a comparison result of the bandwidth of the audio signal and the bandwidth of the electronic device 300 according to an exemplary embodiment.

In operation 701 , the electronic device 300 may determine a reference frequency bandwidth of the obtained audio signal. The electronic device 300 may determine the reference frequency bandwidth of the obtained audio signal based on a comparison of the magnitudes of the first energy corresponding to the first frequency band and the second energy corresponding to the second frequency band.

For example, when the difference between the first energy level and the second energy level is greater than or smaller than the threshold value, the electronic device 300 may determine the reference frequency bandwidth of the obtained audio signal as NB or WB, respectively. A method of determining the reference frequency bandwidth of the obtained audio signal will be described in detail with reference to FIG. 8 .

In operation 703 , the electronic device 300 may determine whether the reference frequency bandwidth of the obtained audio signal is different from the bandwidth of the electronic device. For example, when the reference frequency bandwidth of the obtained audio signal is NB and the bandwidth of the electronic device 300 is WB, the electronic device 300 may determine that the reference frequency bandwidth is different from the bandwidth.

According to an embodiment, if the reference frequency bandwidth of the audio signal is different from the bandwidth of the electronic device, operation 605 may be performed, and if it is not determined whether it is different or different, operation 705 may be performed.

In operation 705 , when the reference frequency bandwidth of the audio signal and the bandwidth of the electronic device are the same, the electronic device 300 may output the obtained audio signal through the speaker 405 . For example, when the reference frequency bandwidth of the audio signal and the bandwidth of the electronic device are equal to NB, the electronic device 300 may output the obtained audio signal through the speaker 405 without correcting it.

8 is a flowchart of determining a reference frequency bandwidth of an audio signal through comparison of an absolute value and a threshold value, according to an exemplary embodiment.

In operation 801 , the electronic device 300 may analyze the magnitudes of the first energy and the second energy. The levels of the first energy and the second energy may correspond to a signal level of the first frequency band and a signal level of the second frequency band. For example, the electronic device 300 analyzes the signal level of the first frequency band corresponding to the level of the first energy and the signal level of the second frequency band corresponding to the level of the second energy as -20 dB and -30 dB, respectively. can do.

In operation 803 , the electronic device 300 may compare the absolute value of the difference between the magnitude of the first energy and the magnitude of the second energy with a preset threshold value. A specific example of operation 803 is described in detail with reference to FIG. 9 .

In operation 805 , the electronic device 300 may determine whether the absolute value is greater than or less than the preset threshold value based on the comparison of the absolute value with the preset threshold value.

According to an embodiment, if the absolute value is greater than the threshold value, operation 807 may be performed, and if the absolute value is less than the threshold value, operation 809 may be performed.

In operation 807, when the absolute value is greater than the preset threshold value, the electronic device 300 may determine the reference frequency bandwidth of the obtained audio signal as the first reference frequency bandwidth. For example, when the absolute value is greater than a preset threshold value, the electronic device 300 may determine the reference frequency bandwidth of the obtained audio signal as NB.

Thereafter, in operation 605 , the electronic device 300 may determine a correction value applied to the obtained audio signal based on determining that the reference frequency bandwidth of the obtained audio signal is NB.

In operation 809, when the absolute value is smaller than the preset threshold value, the electronic device 300 may determine the reference frequency bandwidth of the obtained audio signal as a second reference frequency bandwidth greater than the first reference frequency bandwidth. have. For example, when the absolute value is smaller than a preset threshold value, the electronic device 300 may determine the reference frequency bandwidth of the obtained audio signal as WB greater than NB.

Thereafter, in operation 605 , the electronic device 300 may determine a correction value applied to the obtained audio signal based on determining that the reference frequency bandwidth of the obtained audio signal is WB.

Hereinafter, a specific example of the operation 803 of FIG. 8 will be described with reference to FIG. 9 .

9 illustrates a specific example of determining a reference frequency bandwidth of an audio signal through comparison of an absolute value and a threshold value, according to an embodiment.

According to (a) of FIG. 9 , the reference frequency bandwidth of the obtained audio signal may correspond to WB. A first frequency band and a second frequency band among the reference frequency bandwidths of the obtained audio signal may correspond to band 1 and band 2, respectively. The electronic device 300 analyzes the first energy and the second energy corresponding to each of the first frequency band and the second frequency band of the obtained audio signal, and the signal magnitude (RMS value, root mean) of the first frequency band square value) and a signal magnitude of the second frequency band may be determined. For example, the electronic device 300 may determine the signal level of the first band and the signal level of the second band as -20 dB and -30 dB, respectively.

According to an embodiment, the electronic device 300 may determine a difference value between the signal level of the first frequency band and the signal level of the second frequency band. The electronic device 300 may determine an absolute value of the difference value. For example, the electronic device 300 may determine the absolute value of the difference between the signal level (-20 dB) of one band and the signal level (-30 dB) of the second band as 10 dB.

According to an embodiment, the electronic device 300 may compare the absolute value of the difference value with a preset threshold value. For example, the electronic device 300 may compare an absolute value (10 dB) of the difference value with a preset threshold value (20 dB).

According to an embodiment, the electronic device 300 may determine a reference frequency bandwidth of the obtained audio signal based on the comparison result. For example, when the absolute value (10 dB) of the difference value is smaller than a preset threshold value (20 dB), the electronic device 300 may determine the reference frequency bandwidth of the obtained audio signal as WB.

According to (b) of FIG. 9 , the reference frequency bandwidth of the obtained audio signal may correspond to NB. The electronic device 300 may determine the signal level of the first band and the signal level of the second band as -20dB and -50dB, respectively.

According to an embodiment, the electronic device 300 may determine the absolute value of the difference between the signal level (-20 dB) of the first band and the signal level (-50 dB) of the second band to be 30 dB.

According to an embodiment, the electronic device 300 may compare the absolute value (30 dB) of the difference value with a preset threshold value (20 dB). When the absolute value (30 dB) of the difference value is greater than a preset threshold value (20 dB), the electronic device 300 may determine the reference frequency bandwidth of the obtained audio signal as NB.

According to various embodiments, the number of bands of the audio signal may be set in various ways. For example, the band of the audio signal may include 1 band, 2 bands, 3 bands, and 4 bands.

According to various embodiments, the threshold value may be set in various ways. For example, the preset threshold value may be 25 dB.

10 is a block diagram of an electronic device 1001 in a network environment 1000 according to various embodiments of the present disclosure.

Referring to FIG. 10 , in a network environment 1000 , the electronic device 1001 communicates with the electronic device 1002 through a first network 1098 (eg, a short-range wireless communication network) or a second network 1099 . It may communicate with the electronic device 1004 or the server 1008 through (eg, a long-distance wireless communication network). According to an embodiment, the electronic device 1001 may communicate with the electronic device 1004 through the server 1008 . According to an embodiment, the electronic device 1001 includes a processor 1020 , a memory 1030 , an input device 1050 , a sound output device 1055 , a display device 1060 , an audio module 1070 , and a sensor module ( 1076 , interface 1077 , haptic module 1079 , camera module 1080 , power management module 1088 , battery 1089 , communication module 1090 , subscriber identification module 1096 , or antenna module 1097 ) ) may be included. In some embodiments, at least one of these components (eg, the display device 1060 or the camera module 1080) may be omitted or one or more other components may be added to the electronic device 1001 . In some embodiments, some of these components may be implemented as one integrated circuit. For example, the sensor module 1076 (eg, a fingerprint sensor, an iris sensor, or an illuminance sensor) may be implemented while being embedded in the display device 1060 (eg, a display).

The processor 1020, for example, executes software (eg, a program 1040) to execute at least one other component (eg, a hardware or software component) of the electronic device 1001 connected to the processor 1020. It can control and perform various data processing or operations. According to one embodiment, as at least part of data processing or computation, the processor 1020 converts commands or data received from other components (eg, the sensor module 1076 or the communication module 1090) to the volatile memory 1032 . may be loaded into the volatile memory 1032 , may process commands or data stored in the volatile memory 1032 , and may store the resulting data in the non-volatile memory 1034 . According to an embodiment, the processor 1020 includes a main processor 1021 (eg, a central processing unit or an application processor), and a coprocessor 1023 (eg, a graphics processing unit, an image signal processor) that can be operated independently or in conjunction with the main processor 1021 . , a sensor hub processor, or a communication processor). Additionally or alternatively, the auxiliary processor 1023 may be configured to use less power than the main processor 1021 or to specialize in a designated function. The auxiliary processor 1023 may be implemented separately from or as part of the main processor 1021 .

The coprocessor 1023 may, for example, act on behalf of the main processor 1021 while the main processor 1021 is in an inactive (eg, sleep) state, or when the main processor 1021 is active (eg, executing an application). ), together with the main processor 1021, at least one of the components of the electronic device 1001 (eg, the display device 1060, the sensor module 1076, or the communication module 1090) It is possible to control at least some of the related functions or states. According to one embodiment, coprocessor 1023 (eg, image signal processor or communication processor) may be implemented as part of another functionally related component (eg, camera module 1080 or communication module 1090). have.

The memory 1030 may store various data used by at least one component of the electronic device 1001 (eg, the processor 1020 or the sensor module 1076 ). The data may include, for example, input data or output data for software (eg, the program 1040 ) and instructions related thereto. The memory 1030 may include a volatile memory 1032 or a non-volatile memory 1034 .

The program 1040 may be stored as software in the memory 1030 , and may include, for example, an operating system 1042 , middleware 1044 , or an application 1046 .

The input device 1050 may receive a command or data to be used in a component (eg, the processor 1020 ) of the electronic device 1001 from the outside (eg, a user) of the electronic device 1001 . The input device 1050 may include, for example, a microphone, a mouse, a keyboard, or a digital pen (eg, a stylus pen).

The sound output device 1055 may output a sound signal to the outside of the electronic device 1001 . The sound output device 1055 may include, for example, a speaker or a receiver. The speaker can be used for general purposes such as multimedia playback or recording playback, and the receiver can be used to receive incoming calls. According to one embodiment, the receiver may be implemented separately from or as part of the speaker.

The display device 1060 may visually provide information to the outside (eg, a user) of the electronic device 1001 . The display device 1060 may include, for example, a display, a hologram device, or a projector and a control circuit for controlling the corresponding device. According to an embodiment, the display device 1060 may include a touch circuitry configured to sense a touch or a sensor circuit (eg, a pressure sensor) configured to measure the intensity of a force generated by the touch. have.

The audio module 1070 may convert a sound into an electric signal or, conversely, convert an electric signal into a sound. According to an embodiment, the audio module 1070 obtains a sound through the input device 1050 or an external electronic device (eg, a sound output device 1055 ) directly or wirelessly connected to the electronic device 1001 . The sound may be output through the electronic device 1002) (eg, a speaker or a headphone).

The sensor module 1076 detects an operating state (eg, power or temperature) of the electronic device 1001 or an external environmental state (eg, user state), and generates an electrical signal or data value corresponding to the sensed state. can do. According to one embodiment, the sensor module 1076 may include, for example, a gesture sensor, a gyro sensor, a barometric sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, It may include a temperature sensor, a humidity sensor, or an illuminance sensor.

The interface 1077 may support one or more specified protocols that may be used for the electronic device 1001 to directly or wirelessly connect with an external electronic device (eg, the electronic device 1002 ). According to an embodiment, the interface 1077 may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

The connection terminal 1078 may include a connector through which the electronic device 1001 can be physically connected to an external electronic device (eg, the electronic device 1002 ). According to an embodiment, the connection terminal 1078 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (eg, a headphone connector).

The haptic module 1079 may convert an electrical signal into a mechanical stimulus (eg, vibration or movement) or an electrical stimulus that the user can perceive through tactile or kinesthetic sense. According to an embodiment, the haptic module 1079 may include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

The camera module 1080 may capture still images and moving images. According to one embodiment, the camera module 1080 may include one or more lenses, image sensors, image signal processors, or flashes.

The power management module 1088 may manage power supplied to the electronic device 1001 . According to an embodiment, the power management module 1088 may be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

The battery 1089 may supply power to at least one component of the electronic device 1001 . According to one embodiment, battery 1089 may include, for example, a non-rechargeable primary cell, a rechargeable secondary cell, or a fuel cell.

The communication module 1090 is a direct (eg, wired) communication channel or a wireless communication channel between the electronic device 1001 and an external electronic device (eg, the electronic device 1002, the electronic device 1004, or the server 1008). It can support establishment and communication through the established communication channel. The communication module 1090 may include one or more communication processors that operate independently of the processor 1020 (eg, an application processor) and support direct (eg, wired) communication or wireless communication. According to one embodiment, the communication module 1090 is a wireless communication module 1092 (eg, a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 1094 (eg, : It may include a local area network (LAN) communication module, or a power line communication module). Among these communication modules, a corresponding communication module is a first network 1098 (eg, a short-range communication network such as Bluetooth, WiFi direct, or IrDA (infrared data association)) or a second network 1099 (eg, a cellular network, the Internet, or It may communicate with an external electronic device via a computer network (eg, a telecommunication network such as a LAN or WAN). These various types of communication modules may be integrated into one component (eg, a single chip) or may be implemented as a plurality of components (eg, multiple chips) separate from each other. The wireless communication module 1092 uses subscriber information (eg, International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module 1096 within a communication network, such as the first network 1098 or the second network 1099 . The electronic device 1001 may be identified and authenticated.

The antenna module 1097 may transmit or receive a signal or power to the outside (eg, an external electronic device). According to an embodiment, the antenna module may include one antenna including a conductor formed on a substrate (eg, a PCB) or a radiator formed of a conductive pattern. According to an embodiment, the antenna module 1097 may include a plurality of antennas. In this case, at least one antenna suitable for a communication scheme used in a communication network such as the first network 1098 or the second network 1099 is connected from the plurality of antennas by, for example, the communication module 1090 . can be chosen. A signal or power may be transmitted or received between the communication module 1090 and an external electronic device through the selected at least one antenna. According to some embodiments, other components (eg, RFIC) other than the radiator may be additionally formed as a part of the antenna module 1097 .

At least some of the components are connected to each other through a communication method between peripheral devices (eg, a bus, general purpose input and output (GPIO), serial peripheral interface (SPI), or mobile industry processor interface (MIPI)) and a signal ( eg commands or data) can be exchanged with each other.

According to an embodiment, the command or data may be transmitted or received between the electronic device 1001 and the external electronic device 1004 through the server 1008 connected to the second network 1099 . Each of the electronic devices 1002 and 1004 may be the same as or different from the electronic device 1001 . According to an embodiment, all or part of the operations executed in the electronic device 1001 may be executed in one or more of the external electronic devices 1002 , 1004 , or 1008 . For example, when the electronic device 1001 needs to perform a function or service automatically or in response to a request from a user or other device, the electronic device 1001 performs the function or service by itself instead of executing the function or service itself. Alternatively or additionally, one or more external electronic devices may be requested to perform at least a part of the function or the service. The one or more external electronic devices that have received the request may execute at least a part of the requested function or service, or an additional function or service related to the request, and transmit a result of the execution to the electronic device 1001 . The electronic device 1001 may process the result as it is or additionally and provide it as at least a part of a response to the request. For this purpose, for example, cloud computing, distributed computing, or client-server computing technology may be used.

The electronic device according to various embodiments disclosed in this document may have various types of devices. The electronic device may include, for example, a portable communication device (eg, a smart phone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a home appliance device. The electronic device according to the embodiment of the present document is not limited to the above-described devices.

It should be understood that the various embodiments of this document and the terms used therein are not intended to limit the technical features described in this document to specific embodiments, and include various modifications, equivalents, or substitutions of the embodiments. In connection with the description of the drawings, like reference numerals may be used for similar or related components. The singular form of the noun corresponding to the item may include one or more of the item, unless the relevant context clearly dictates otherwise. As used herein, “A or B”, “at least one of A and B”, “at least one of A or B,” “A, B or C,” “at least one of A, B and C,” and “A , B, or C" each may include any one of the items listed together in the corresponding one of the phrases, or all possible combinations thereof. Terms such as “first”, “second”, or “first” or “second” may simply be used to distinguish the component from other components in question, and may refer to components in other aspects (e.g., importance or order) is not limited. that one (eg first) component is “coupled” or “connected” to another (eg, second) component with or without the terms “functionally” or “communicatively” When referenced, it means that one component can be connected to the other component directly (eg by wire), wirelessly, or through a third component.

As used herein, the term “module” may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as, for example, logic, logic block, component, or circuit. A module may be an integrally formed part or a minimum unit or a part of the part that performs one or more functions. For example, according to an embodiment, the module may be implemented in the form of an application-specific integrated circuit (ASIC).

Various embodiments of the present document include one or more instructions stored in a storage medium (eg, internal memory 1036 or external memory 1038) readable by a machine (eg, electronic device 1001). may be implemented as software (eg, the program 1040) including For example, a processor (eg, processor 1020 ) of a device (eg, electronic device 1001 ) may call at least one command among one or more commands stored from a storage medium and execute it. This makes it possible for the device to be operated to perform at least one function according to the at least one command called. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The device-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' only means that the storage medium is a tangible device and does not include a signal (eg, electromagnetic wave), and this term is used in cases where data is semi-permanently stored in the storage medium and It does not distinguish between temporary storage cases.

According to one embodiment, the method according to various embodiments disclosed in this document may be provided in a computer program product (computer program product). Computer program products may be traded between sellers and buyers as commodities. The computer program product is distributed in the form of a device-readable storage medium (eg compact disc read only memory (CD-ROM)), or through an application store (eg Play Store™) or on two user devices (eg, It can be distributed (eg downloaded or uploaded) directly, online between smartphones (eg: smartphones). In the case of online distribution, at least a part of the computer program product may be temporarily stored or temporarily created in a machine-readable storage medium such as a memory of a server of a manufacturer, a server of an application store, or a relay server.

According to various embodiments, each component (eg, a module or a program) of the above-described components may include a singular or a plurality of entities. According to various embodiments, one or more components or operations among the above-described corresponding components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (eg, a module or a program) may be integrated into one component. In this case, the integrated component may perform one or more functions of each component of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. . According to various embodiments, operations performed by a module, program, or other component are executed sequentially, in parallel, repeatedly, or heuristically, or one or more of the operations are executed in a different order, or omitted. or one or more other operations may be added.

Claims (20)

In an electronic device,
communication circuit;
audio processing circuit;
speaker; and
at least one processor operatively coupled with the communication circuitry and the audio processing circuitry, the at least one processor comprising:
acquire an audio signal through the communication circuit;
analyzing a first energy corresponding to a first frequency band and a second energy corresponding to a second frequency band higher than the first frequency band among the obtained audio signals;
determining a correction value applied to the audio signal based on an analysis result of the first energy and the second energy, and a bandwidth set in the audio processing circuit;
and outputting an audio signal to which the correction value is applied through the speaker. The method according to claim 1,
The electronic device further comprising dividing the obtained audio signal into a plurality of frequency bands based on a setting condition of the electronic device. The method according to claim 1,
analyzing the magnitude of the first energy and the magnitude of the second energy,
determining a difference value between the magnitude of the first energy and the magnitude of the second energy based on the analysis;
comparing the absolute value of the difference value with a preset threshold value;
The electronic device further comprising determining a reference frequency bandwidth of the obtained audio signal based on the comparison result. 4. The method according to claim 3,
When the absolute value of the difference value is greater than a preset threshold value, the electronic device determines the reference frequency bandwidth of the obtained audio signal as a first reference frequency bandwidth. 4. The method according to claim 3,
When the absolute value of the difference value is smaller than a preset threshold, the electronic device determines the reference frequency bandwidth of the obtained audio signal as a second reference frequency bandwidth greater than a first reference frequency bandwidth. 4. The method according to claim 3,
determining whether a reference frequency bandwidth of the audio signal is different from a bandwidth set in the audio processing circuit;
The electronic device further comprising determining the correction value applied to the audio signal when the reference frequency bandwidth is different from a bandwidth set by the audio processing circuit. The method according to claim 1,
The correction value includes at least one of a gain, a filter (LPF), and a limiter applied to the audio signal. 8. The method of claim 7,
The electronic device further comprising controlling a set band for applying the filter. The method according to claim 1,
determining whether a first energy corresponding to the first frequency band among the obtained audio signals is sensed;
The electronic device further comprising: when the first energy is sensed, analyzing a second energy corresponding to the second frequency band. The method according to claim 1,
The electronic device further comprising controlling an operation time for applying the determined correction value to the audio signal. A method for controlling sound quality improvement, comprising:
obtaining an audio signal through the communication circuit;
analyzing a first energy corresponding to a first frequency band and a second energy corresponding to a second frequency band higher than the first frequency band among the obtained audio signals;
determining a correction value applied to the audio signal based on a result of analyzing the first energy and the second energy and a bandwidth set in an audio processing circuit; and
and outputting an audio signal to which the correction value is applied through a speaker. 12. The method of claim 11,
The method further comprising dividing the obtained audio signal into a plurality of frequency bands based on a setting condition of the electronic device. 12. The method of claim 11,
analyzing the magnitude of the first energy and the magnitude of the second energy;
determining a difference value between the magnitude of the first energy and the magnitude of the second energy based on the analysis;
comparing the absolute value of the difference value with a preset threshold value; and
The method further comprising determining a reference frequency bandwidth of the obtained audio signal based on the comparison result. 14. The method of claim 13,
and determining the reference frequency bandwidth of the obtained audio signal as a first reference frequency bandwidth when the absolute value of the difference value is greater than a preset threshold value. 14. The method of claim 13,
and determining the reference frequency bandwidth of the obtained audio signal as a second reference frequency bandwidth greater than a first reference frequency bandwidth when the absolute value of the difference value is smaller than a preset threshold value. 14. The method of claim 13,
determining whether a reference frequency bandwidth of the audio signal is different from a bandwidth set by the audio processing circuit; and
and determining the correction value applied to the audio signal when the reference frequency bandwidth is different from the bandwidth set by the audio processing circuit. 12. The method of claim 11,
The operation of applying the correction value to the audio signal includes applying at least one of a gain, a filter (LPF), and a limiter applied to the audio signal. 12. The method of claim 11,
determining whether a first energy corresponding to the first frequency band is detected from among the acquired audio signals; and
and analyzing a second energy corresponding to the second frequency band when the first energy is sensed. 12. The method of claim 11,
and controlling an operation time of applying the determined correction value to the audio signal. A non-transitory recording medium storing computer readable instructions, wherein the instructions are executed by at least one processor of an electronic device in which the instructions are stored:
obtaining an audio signal through the communication circuit;
analyzing a first energy corresponding to a first frequency band and a second energy corresponding to a second frequency band higher than the first frequency band among the obtained audio signals;
determining a correction value applied to the audio signal based on a result of analyzing the first energy and the second energy and a bandwidth set in an audio processing circuit; and
and outputting an audio signal to which the correction value has been applied through a speaker.

Images