WO2021107589A1 - Electronic device for performing wireless communication, and wireless communication method - Google Patents

Abstract

An electronic device according to an embodiment, disclosed in the present document, comprises: a communication circuit that transmits and receives a sound signal to and from an external device by a first communication method; a memory; and a processor, wherein the processor may: identify whether or not the external device applies a first noise reduction and echo cancellation (NREC) technology; when the external device applies the first NREC technology, transmit a first sound signal to the external device; receive, from the external device, a second sound signal corresponding to the first sound signal; identify the residual amount of echo or the residual amount of noise for the second sound signal; compare the residual amount of echo or the residual amount of noise with a preset reference value; and apply an additional NREC technology on the basis of the comparison.

Description

Electronic device and wireless communication method for performing wireless communication

Various embodiments disclosed in this document relate to an electronic device that transmits/receives a signal to/from an external device through wireless communication.

An electronic device such as a smartphone or a tablet PC may perform various functions through wireless communication. Recently, as wireless communication technology has been developed, a low-cost, low-power wireless device or short-distance communication technology using a wireless link has been developed. Bluetooth (Bluetooth) is a representative short-distance communication method and supports voice communication or data communication between electronic devices with low cost and low power.

The earphone (or earphone, headset) may be paired with a mobile electronic device such as a smartphone or tablet PC to transmit/receive data or signals by Bluetooth communication. For example, the earphone (or earphone, headset) may allow a user to make a hands-free call through Bluetooth communication, and may output a sound output when a music file or a video file stored in the mobile electronic device is executed.

When the earphone is used for a call, ambient noise may be introduced into the call signal through the microphone. In addition, various noise signals such as noise transmitted through the counterpart electronic device or noise generated from the earphone or the electronic device itself may be introduced into the call signal.

Earsets generally have a close distance between the microphone and the receiver, so the sound output from the receiver is often delivered to the microphone. The phenomenon in which the sound output from the receiver is transmitted to the microphone is called an echo phenomenon, and various technologies are being developed to reduce or eliminate the occurrence of echo.

When a conventional electronic device (eg, a smartphone, a tablet PC) is paired with a Bluetooth device (eg, an earphone) to transmit/receive an acoustic signal for a call, noise reduction and echo cancellation (NREC) (or echo cancellation noise reduction; ECNR) ) technology can be applied to reduce or eliminate noise or echo.

When the Bluetooth device itself applies the NREC technology, the electronic device may not apply the NREC technology. In this case, a residual echo may occur even after the application of the NREC technology in the Bluetooth device, and sound quality deterioration may occur, which may cause inconvenience to the user.

The electronic device includes a communication circuit, a memory, and a processor for transmitting and receiving a sound signal to and from an external device by a first communication method, wherein the processor checks whether a first noise reduction and echo cancellation (NREC) technology is applied in the external device and, when the first NREC technology is applied by the external device, a first acoustic signal is transmitted to the external device, a second acoustic signal corresponding to the first acoustic signal is received from the external device, and the second The residual echo amount or the residual noise amount for the acoustic signal may be checked, the residual echo amount or the residual noise amount may be compared with a preset reference value, and an additional NREC technique may be applied based on the comparison.

The electronic device according to various embodiments disclosed in this document may determine whether the NREC technology is applied in the Bluetooth-connected peripheral device, and determine whether to additionally apply the NREC technology by checking the residual amount of echo or the residual amount of noise. In this way, it is possible to provide the user with the sound quality of a conversation with reduced or eliminated echo or noise.

The electronic device according to various embodiments disclosed in this document may provide a test sound source, measure a residual echo amount, and apply NREC technology.

1 illustrates a first electronic device and a second electronic device according to various embodiments of the present disclosure;

2 is a block diagram of a first electronic device according to various embodiments of the present disclosure;

3 is a flowchart illustrating a wireless communication method according to various embodiments.

4 is a signal flow diagram illustrating a process of checking a residual echo value according to various embodiments of the present disclosure;

5 is a graph illustrating a process of canceling an echo from a second sound signal according to various embodiments of the present disclosure;

6 is an electronic device in a network environment, according to various embodiments.

In connection with the description of the drawings, the same or similar reference numerals may be used for the same or similar components.

Hereinafter, various embodiments of the present document will be described with reference to the accompanying drawings. However, it is not intended to limit the technology described in this document to specific embodiments, and it should be understood to include various modifications, equivalents, and/or alternatives of the embodiments of this document. . In connection with the description of the drawings, like reference numerals may be used for like components.

1 illustrates a first electronic device and a second electronic device according to various embodiments of the present disclosure; In FIG. 1 , the case where the first electronic device 101 is a smart phone and the second electronic device 102 is an earphone is exemplarily illustrated, but the present invention is not limited thereto.

Referring to FIG. 1 , the first electronic device 101 may include a main body 111 and a display 112 . Various components necessary for the operation of the first electronic device 101 such as a processor, a memory, a communication module, a printed circuit board, or a battery may be included in the main body 111 . The display 112 may display various content such as text or images.

According to various embodiments, the first electronic device (or terminal device) 101 may be paired with the second electronic device 102 using Bluetooth communication. The Bluetooth communication method uses an ISM (Industrial Scientific Medical) band of the 2.4 GHz band. The ISM band can be used freely without a separate license, and the Bluetooth communication method can prevent interference with other devices by placing a guard band of a 2MHz band below the ISM band and a 3.5MHz band above the ISM band.

According to an embodiment, the first electronic device 101 may broadcast an inquiry signal and receive a device address from the second electronic device 102 in response to the inquiry signal. The first electronic device 101 may request the second electronic device 102 to transmit the device name. When receiving the request for transmission of the device name, the second electronic device 102 may transmit the device name to the first electronic device 101 . The first electronic device 101 may receive a device name from the second electronic device 102 and be connected to the second electronic device 102 automatically or through a user input.

The second electronic device 102 may transmit/receive a sound signal to and from the first electronic device 101 through Bluetooth communication. The second electronic device 102 may include a receiver (or a sound output unit, a speaker) 121 that outputs a sound and a microphone 122 that receives a sound. The second electronic device 102 may receive the sound signal from the first electronic device 101 and output it through the receiver 121 . The second electronic device 102 may transmit the acoustic signal collected through the microphone 122 to the first electronic device 101 . In FIG. 1 , the case in which the second electronic device 102 is in the form of an ear set is illustrated as an example, but is not limited thereto. For example, the second electronic device 102 may be a headset or an earphone.

According to various embodiments, the second electronic device 102 may be small, and accordingly, the distance between the receiver 121 and the microphone 122 may be relatively close. In this case, an echo phenomenon in which the sound output to the receiver 121 is transmitted to the microphone 122 may occur.

According to an embodiment, the second electronic device 102, separately from the first electronic device 101 , a noise reduction and echo cancellation (NREC) (or echo cancellation and noise reduction (ECNR)) technology (or an NREC solution) , NREC algorithm) can be applied to reduce or eliminate noise or echo (hereinafter, the first NREC technique). In the case of the second electronic device 102 (eg, a Bluetooth device) supporting the first NREC technology, optimization cannot be performed only for a specific type of the first electronic device 101 (eg, a portable terminal). Performance may not be optimized. When the performance by the first NREC technology is insufficient, sound quality deterioration due to echo or the like may occur in the second electronic device 102 (eg, a Bluetooth device). The first electronic device 101 may reduce or prevent sound quality deterioration by performing a separate NREC.

According to another embodiment, the second electronic device 102 may not perform separate NREC. For example, the second electronic device 102 may not include a circuit for performing NREC.

According to various embodiments, the first electronic device 101 (or a processor inside the first electronic device 101 ) checks whether the first NREC technology is applied in the second electronic device 102 , or A separate NREC technique (hereinafter, an additional NREC technique) may be applied in various ways by analyzing the residual echo amount of the acoustic signal received by the device 102 (refer to FIGS. 2 to 5 ).

2 is a block diagram of a first electronic device according to various embodiments of the present disclosure;

Referring to FIG. 2 , the first electronic device 101 may include a wireless communication unit 210 , a Bluetooth module unit 220 , a memory 230 , a display 240 , an input unit 250 , and a processor 260 . have. 2 illustrates a partial configuration included in the first electronic device 101, but is not limited thereto.

The wireless communication unit 210 may perform a data transmission/reception function for wireless communication of the first electronic device 101 . The wireless communication unit 210 may include an RF transmitter that increases, converts, or amplifies the frequency of a transmitted signal, and an RF receiver that low-noise amplifies a received signal and down-converts the frequency. For example, the wireless communication unit 210 may perform long-distance communication such as 5G or LTE.

The wireless communication unit 210 may receive data through a wireless channel and provide it to the processor 260 , and transmit the data provided from the processor 260 to an external device (eg, the second electronic device 102 ) through a wireless channel. have.

The Bluetooth module unit (or Bluetooth communication circuit) 220 may wirelessly transmit/receive sound signals, control signals, or data to/from a device capable of Bluetooth communication (eg, the second electronic device 102 of FIG. 1 ). The Bluetooth module 220 may transmit a signal received from a device capable of Bluetooth communication to the processor 260 . The Bluetooth module unit 220 may transmit an acoustic signal provided from the processor 260 to a Bluetooth communication capable device (eg, the second electronic device 102 ).

According to various embodiments, the Bluetooth module unit 220 provides device identification information (eg, a device address (Bluetooth Device Address-BD_ADDR), a user friendly name), and device type information (device class) of peripheral devices). may be received and transmitted to the processor 260 .

When paired with the second electronic device 102 , the Bluetooth module unit 220 may perform wireless communication with a communication circuit of the second electronic device 102 . The Bluetooth module unit 220 may transmit, to the second electronic device 102 , a sound signal of the other party device (far-end) received by the first electronic device 101 from the wireless communication unit 210 .

According to an embodiment, the Bluetooth module unit 220 may transmit an acoustic signal (eg, a test sound source for echo measurement) provided by the processor 260 to the second electronic device 102 .

The Bluetooth module unit 220 may receive an acoustic signal input through the microphone 122 of the second electronic device 102 and transmit it to the processor 260 .

According to various embodiments, the Bluetooth module unit 220 may receive sound processing information (eg, AT command) regarding whether the second electronic device 102 performs the first NREC technology. The Bluetooth module 220 may transmit sound processing information to the processor 260 .

The memory 230 serves to store programs and data necessary for the operation of the first electronic device 101 , and may be divided into a program area and a data area. The memory 230 may store device information regarding a second electronic device (eg, an earphone) that has been paired.

For example, when the first electronic device 101 performs pairing with a specific earphone, the memory 230 may store a device address, a device name, and a link key of the earphone. A link key may be a key used for authentication and encryption to securely pair Bluetooth devices. For example, the link key is generated by a Bluetooth device address, a private user key, and a RAND value, which is an irregular number newly generated whenever a new connection between Bluetooth devices is established.

The display 240 may be formed of a liquid crystal display (LCD), and may visually provide various information to a user. For example, the display 240 may output a booting screen, a standby screen, a display screen, a call screen, or other application execution screen.

The processor 260 may broadcast an inquiry signal through the Bluetooth module 220 to search for Bluetooth devices located nearby. The display 240 may display a list of Bluetooth devices searched for by the inquiry signal. The display 240 may display device information of each Bluetooth device.

The input unit 250 may receive a user's input signal for controlling the first electronic device 101 and transmit it to the processor 260 . The input unit 250 may receive an input for selecting one of Bluetooth devices located nearby. According to an embodiment, the input unit 250 may be a touch panel integrally formed with the display 240 .

The processor 260 may perform various operations necessary for the operation of the first electronic device 101 . The processor 260 may control a signal flow between various components inside the first electronic device 101 .

According to various embodiments, the processor 260 checks whether the second electronic device 102 performs the first NREC technique, or a residual echo amount or residual noise of an acoustic signal received by the second electronic device 102 . By analyzing loudness, additional NREC technology can be applied in various ways. For example, the processor 260 may perform an additional NREC technique to remove noise and echo collected from the microphone 122 of the second electronic device 102 (eg, a Bluetooth device) during a call.

When the additional NREC technology is performed without reflecting the residual echo amount or the residual noise amount, NREC is applied twice in the second electronic device 102 and the first electronic device 101 redundantly, resulting in deterioration of sound quality may occur. The processor 260 may perform an additional NREC technique by detecting a residual echo amount or a residual noise amount. In this way, it is possible to prevent deterioration of the sound quality of the communication. The processor 260 may receive information on whether the first NREC technique is performed in the second electronic device 102 and determine whether to perform the additional NREC technique.

According to various embodiments, when performing the additional NREC technology, the processor 260 may determine the application level (or application level) of the additional NREC technology according to the residual echo amount or the residual noise amount. When the residual echo amount or residual noise amount is large, the application level of the additional NREC technology may be increased, and if the residual echo amount or the residual noise amount is small, the application level of the additional NREC technology may be decreased.

As for the performance of the first NREC technique performed by the second electronic device 102 , noise or echo cancellation performance may not be effective. When the amount of residual echo in the acoustic signal received from the second electronic device 102 is equal to or greater than (or exceeds) the reference value, the processor 260 controls the residual echo or residual noise included in the acoustic signal received from the second electronic device 102 . By performing additional NREC technology to additionally remove

According to various embodiments, the Bluetooth module unit 220 may include a voice section recognition unit (eg, a voice activity detection (VAD) circuit). The processor 260 may use a voice section recognition unit (eg, a VAD circuit) to classify a voice section and a noise section, and determine the amount of residual noise in the noise section.

3 is a flowchart illustrating a wireless communication method according to various embodiments.

Referring to FIG. 3 , in operation 310 , the processor 260 of the first electronic device 101 may be in a pairing state capable of Bluetooth communication with the second electronic device 102 . The processor 260 may be wirelessly connected to the communication circuit of the second electronic device 102 through the Bluetooth module unit 220 to transmit/receive data.

In operation 320 , the processor 260 may check whether the first NREC technology is applied in the second electronic device 102 . According to an embodiment, the processor 260 may receive a signal (or sound processing information) (eg, AT command) of a specified format from the second electronic device 102 to determine whether the first NREC technology is applied. .

According to various embodiments, when the first NREC technology is applied in the second electronic device 102 , the processor 260 may not perform a separate NREC technology (hereinafter, the second NREC technology).

According to various embodiments, in operation 330 , when the first NREC technology is not applied in the second electronic device 102 , the second NREC technology may be applied in the first electronic device 101 .

In operation 340 , the processor 260 may transmit a first acoustic signal for echo measurement of the second electronic device 102 to the second electronic device 102 .

According to an embodiment, the first sound signal may be a test sound source for measuring the amount of echo of the second electronic device 102 . For example, when the first electronic device 101 receives a call for a call connection from the outside and the user inputs an input to connect the call, the processor 260 outputs the test sound source “Call connected.” 2 may be transmitted to the electronic device 102 .

According to another embodiment, the first acoustic signal may be a sign language signal (eg, a counterpart's voice) received from a far-end device after a call is connected. After the call is connected, the processor 260 may analyze the residual echo amount or the residual noise amount in real time to determine whether to apply the additional NREC technology or a level at which the additional NREC technology is applied.

According to another embodiment, the first acoustic signal may be a signal according to a previously connected first call. When the second call is connected, the processor 260 may apply information on the residual echo amount or residual noise amount analyzed in the previous first call to the currently connected second call. Even when the received calls are different, the echo generation characteristics of the second electronic device 102 may be the same or similar.

In operation 350 , the processor 260 may receive a second sound signal corresponding to the first sound signal from the second electronic device 102 . A sound based on the first sound signal is output through the receiver 121 of the second electronic device 102 , and the output sound becomes an echo sound and is introduced into the microphone 122 of the second electronic device 102 to make the second An acoustic signal may be generated. The second electronic device 102 may transmit a second acoustic signal to the first electronic device 101 .

When the first NREC technology is applied, the second acoustic signal may be in a state in which noise or echo is partially removed to a specified level. Conversely, when the first NREC technology is not applied, the second acoustic signal may be in a state in which noise or echo is not removed.

In operation 360 , the processor 260 may check a residual echo amount or a residual noise amount of the second acoustic signal. For example, the processor 260 may check a root mean square (RMS) value of the echo or noise after the additional NREC technique is applied.

According to various embodiments, the processor 260 uses a voice section recognition unit (eg, a VAD circuit) included in the Bluetooth module unit 220 to classify a voice section and a noise section, and the amount of residual noise in the noise section can be decided

In operation 370 , the processor 260 may compare the residual echo amount or the residual noise amount with a preset reference value, and apply an additional NREC technique based on the comparison. For example, when the residual echo amount is equal to or greater than (or exceeds) a preset reference value, the processor 260 may apply the additional NREC technology.

According to various embodiments, the processor 260 may cancel an echo by comparing a signal received from a counterpart electronic device (far-end) with a root mean square (RMS) value for a non-echo portion.

4 is a signal flow diagram illustrating a process of checking a residual echo value according to various embodiments of the present disclosure;

Referring to FIG. 4 , in operation 410 , the processor 260 of the first electronic device 101 may transmit a first acoustic signal to the second electronic device 102 . For example, the first sound signal may be a test sound source for measuring the amount of echo or the amount of noise of the second electronic device 102 .

In operation 420 , a sound based on the first sound signal is output through the receiver 121 of the second electronic device 102 , and the output sound becomes an echo sound and is transmitted to the microphone 122 of the second electronic device 102 . The second acoustic signal may be generated. When the second electronic device 102 includes a circuit for performing the first NREC technology, the first NREC technology may be applied.

In operation 430 , the Bluetooth module unit 220 of the first electronic device 101 may receive a second sound signal from the second electronic device 102 . When the first NREC technology is applied, the second acoustic signal may be in a state in which noise or echo is partially removed to a specified level (a level set in the second electronic device 102 ). As for the performance of the first NREC technique performed by the second electronic device 102 , noise or echo cancellation performance may not be effective according to device characteristics.

In operation 440 , the processor 260 of the first electronic device 101 may analyze a residual echo amount or a residual noise amount of the received second acoustic signal. When the residual echo amount or the residual noise amount is equal to or greater than (or exceeds) a preset reference value, the processor 260 may perform an additional echo or noise removal operation by applying an additional NREC technology. The processor 260 may additionally remove a portion of the first sound signal from the second sound signal.

According to various embodiments, the processor 260 may apply the additional NREC technology by using a third sound signal collected through a microphone (not shown) provided in the first electronic device 101 . The processor 260 may compensate the near-end speech included in the third acoustic signal for the near-end speech portion of the second acoustic signal. Also, the processor 260 may additionally remove a stationary noise part included in the third sound signal from the second sound signal.

According to various embodiments, the processor 260 may display a user interface through which the user can selectively determine the level of applying the additional NREC technology. For example, the processor 260 may display a user interface that includes selectable options for any removal result or a navigation bar that determines the level of applying additional NREC techniques.

According to various embodiments, the processor 260 may adaptively apply an echo cancellation intensity, Rx volume, and the like, in order to efficiently perform echo cancellation. For example, when the echo residual amount is -70 dB or less based on the average root mean square (RMS), the additional NREC technology is not applied, and when the echo residual amount exceeds the average root mean square (RMS), the additional NREC technology may be applied.

According to various embodiments, the processor 260 determines the parameter optimal value information for applying the additional NREC technology in the first call through the currently received call, and when connected to the second call by receiving the additional call, the memory ( 230) may be loaded in advance to improve call quality.

According to various embodiments, the processor 260 may apply additional NREC technology by using an external server. When the performance of the first NREC technology is lower than the reference value in the call connection through the currently paired second electronic device 102 , the processor 260 transmits noise information along with the BT id information of the second electronic device 102 to the external server. can convey An external server may store the received information. When a user or another user of the first electronic device 101 performs BT pairing or call setup, the processor 260 may download stored information. The processor 260 may improve call quality by applying the improvement parameter from the beginning of the pairing step or the call setup step.

According to various embodiments, the processor 260 may apply additional NREC technology by using machine learning using an external server. When a call is connected through the paired second electronic device 102 , the processor 260 stores the BT id information and the noise information of the second electronic device 102 in the memory 230 of the first electronic device 101 or the cloud server. (Cloud server) can be saved. The cloud server can derive NREC parameters by analyzing continuously updated noise information based on a deep neural network (DNN). The derived NREC parameter may be stored in the memory 230 or the cloud server of the first electronic device 101 for each BT id. When the user proceeds with BT pairing or call setup, call quality can be improved by applying matched NREC parameter information for each BT id. Since NREC parameters are analyzed based on DNN, more information can be accumulated as the user uses more, so that more accurate NREC parameters can be derived.

According to various embodiments, out of the scope of Bluetooth communication, when the NREC performance of the first electronic device 101 is deteriorated in an abnormal state of the microphone of the first electronic device 101 itself, the echo residual amount is analyzed can further improve NREC performance.

5 is a graph illustrating a process of removing an echo from a second acoustic signal according to various embodiments of the present disclosure; 5 is illustrative and not limited thereto.

Referring to FIG. 5 , in the first graph 501 , the second sound signal may include a sign-in section 510 and a speech section 520 . In the sign language section 510 , a sound based on the first sound signal is output through the receiver 121 of the second electronic device 102 , and the output sound becomes an echo sound, and the microphone ( 122) to generate a second acoustic signal.

In the second graph 502 , the first NREC technology may be applied by the second electronic device 102 to the second acoustic signal introduced into the microphone 122 of the second electronic device 102 . In the sign language section 510 , the overall amount of echo may be reduced compared to that of the first graph 501 , but the second sound signal may include some residual echoes. The performance of the first NREC technique performed by the second electronic device 102 may be inferior to that of the additional NREC technique of the first electronic device 101 , and accordingly, some residual echo may be included in the second acoustic signal.

In the third graph 503 , the processor 260 of the first electronic device 101 may analyze a residual echo amount of the received second acoustic signal. When the residual echo amount is equal to or greater than a preset reference value, the processor 260 may perform an additional echo cancellation operation by applying an additional NREC technology. In the sign language section 510 , the amount of echo may be greatly reduced compared to that of the first graph 501 or the second graph 502 , and call quality may be improved.

6 is a block diagram of an electronic device 601 in a network environment 600 according to various embodiments of the present disclosure. Electronic devices according to various embodiments disclosed in this document may be devices of various types. Electronic devices include, for example, portable communication devices (eg, smartphones), computer devices (eg, personal digital assistants), tablet PCs (tablet PCs), laptop PCs (desktop PCs, workstations, or servers); It may include at least one of a portable multimedia device (eg, an e-book reader or an MP3 player), a portable medical device (eg, a heart rate, blood sugar, blood pressure, or body temperature monitor), a camera, or a wearable device. (e.g. watches, rings, bracelets, anklets, necklaces, eyeglasses, contact lenses, or head-mounted-devices (HMDs)); : skin pad or tattoo), or a bioimplantable circuit.In some embodiments, the electronic device is, for example, a television, a digital video disk (DVD) player, an audio device, an audio accessory device. (e.g. speaker, headphones, or headset), refrigerator, air conditioner, vacuum cleaner, oven, microwave oven, washing machine, air purifier, set-top box, home automation control panel, security control panel, game console, electronic dictionary, electronic key, camcorder , or at least one of an electronic picture frame.

In another embodiment, the electronic device may include a navigation device, a global navigation satellite system (GNSS), an event data recorder (EDR) (eg, a black box for a vehicle/vessel/airplane), and an automotive infotainment device. (e.g. head-up displays for vehicles), industrial or domestic robots, drones, automated teller machines (ATMs), point of sales (POS) devices, metering instruments (e.g. water, electricity, or gas metering instruments); Alternatively, it may include at least one of an IoT device (eg, a light bulb, a sprinkler device, a fire alarm, a thermostat, or a street lamp). The electronic device according to the embodiment of this document is not limited to the above-described devices, and, for example, as in the case of a smartphone equipped with a function of measuring personal biometric information (eg, heart rate or blood sugar), a plurality of electronic devices The functions of the devices may be provided in a complex manner. In this document, the term user may refer to a person who uses an electronic device or a device (eg, an artificial intelligence electronic device) using the electronic device.

In the network environment 600 , the electronic device 601 communicates with the electronic device 602 through a first network 698 (eg, a short-range wireless communication network), or a second network 699 (eg, a long-range wireless communication network). network) and communicate with the electronic device 604 or the server 608 . According to an embodiment, the electronic device 601 may communicate with the electronic device 604 through the server 608 . According to an embodiment, the electronic device 601 includes a processor 620 , a memory 630 , an input device 650 , a sound output device 655 , a display device 660 , an audio module 670 , and a sensor module ( 676 , interface 677 , haptic module 679 , camera module 680 , power management module 688 , battery 689 , communication module 690 , subscriber identification module 696 , or antenna module 697 . ) may be included. In some embodiments, at least one of these components (eg, the display device 660 or the camera module 680 ) may be omitted or one or more other components may be added to the electronic device 601 . In some embodiments, some of these components may be implemented as one integrated circuit. For example, the sensor module 676 (eg, a fingerprint sensor, an iris sensor, or an illuminance sensor) may be implemented while being embedded in the display device 660 (eg, a display).

The processor 620, for example, executes software (eg, a program 640) to execute at least one other component (eg, a hardware or software component) of the electronic device 601 connected to the processor 620 . It can control and perform various data processing or operations. According to one embodiment, as at least part of data processing or computation, the processor 620 converts commands or data received from other components (eg, the sensor module 676 or the communication module 690) to the volatile memory 632 . may load into the volatile memory 632 , process commands or data stored in the volatile memory 632 , and store the resulting data in the non-volatile memory 634 . According to an embodiment, the processor 620 includes a main processor 621 (eg, a central processing unit or an application processor), and an auxiliary processor 623 (eg, a graphics processing unit, an image signal processor) that can be operated independently or in conjunction with the main processor 621 (eg, a graphics processing unit or an image signal processor). , a sensor hub processor, or a communication processor). Additionally or alternatively, the auxiliary processor 623 may be configured to use less power than the main processor 621 or to be specialized for a designated function. The coprocessor 623 may be implemented separately from or as part of the main processor 621 .

The co-processor 623 may be, for example, on behalf of the main processor 621 while the main processor 621 is in an inactive (eg, sleep) state, or the main processor 621 is active (eg, executing an application). ), together with the main processor 621, at least one of the components of the electronic device 601 (eg, the display device 660, the sensor module 676, or the communication module 690) It is possible to control at least some of the related functions or states. According to one embodiment, the coprocessor 623 (eg, image signal processor or communication processor) may be implemented as part of another functionally related component (eg, camera module 680 or communication module 690). have.

The memory 630 may store various data used by at least one component (eg, the processor 620 or the sensor module 676 ) of the electronic device 601 . The data may include, for example, input data or output data for software (eg, the program 640 ) and instructions related thereto. The memory 630 may include a volatile memory 632 or a non-volatile memory 634 .

The program 640 may be stored as software in the memory 630 , and may include, for example, an operating system 642 , middleware 644 , or an application 646 .

The input device 650 may receive a command or data to be used in a component (eg, the processor 620 ) of the electronic device 601 from the outside (eg, a user) of the electronic device 601 . The input device 650 may include, for example, a microphone, a mouse, a keyboard, or a digital pen (eg, a stylus pen).

The sound output device 655 may output a sound signal to the outside of the electronic device 601 . The sound output device 655 may include, for example, a speaker or a receiver. The speaker can be used for general purposes such as multimedia playback or recording playback, and the receiver can be used to receive incoming calls. According to one embodiment, the receiver may be implemented separately from or as part of the speaker.

The display device 660 may visually provide information to the outside (eg, a user) of the electronic device 601 . The display device 660 may include, for example, a display, a hologram device, or a projector and a control circuit for controlling the corresponding device. According to an embodiment, the display device 660 may include a touch circuitry configured to sense a touch or a sensor circuit (eg, a pressure sensor) configured to measure the intensity of a force generated by the touch. have.

The audio module 670 may convert a sound into an electric signal or, conversely, convert an electric signal into a sound. According to an embodiment, the audio module 670 obtains a sound through the input device 650 or an external electronic device (eg, a sound output device 655 ) directly or wirelessly connected to the electronic device 601 . The electronic device 602) (eg, a speaker or headphones) may output sound.

The sensor module 676 detects an operating state (eg, power or temperature) of the electronic device 601 or an external environmental state (eg, a user state), and generates an electrical signal or data value corresponding to the sensed state. can do. According to an embodiment, the sensor module 676 may include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, It may include a temperature sensor, a humidity sensor, or an illuminance sensor.

The interface 677 may support one or more designated protocols that may be used for the electronic device 601 to directly or wirelessly connect with an external electronic device (eg, the electronic device 602 ). According to an embodiment, the interface 677 may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

The connection terminal 678 may include a connector through which the electronic device 601 can be physically connected to an external electronic device (eg, the electronic device 602 ). According to an embodiment, the connection terminal 678 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (eg, a headphone connector).

The haptic module 679 may convert an electrical signal into a mechanical stimulus (eg, vibration or movement) or an electrical stimulus that the user can perceive through tactile or kinesthetic sense. According to an embodiment, the haptic module 679 may include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

The camera module 680 may capture still images and moving images. According to one embodiment, the camera module 680 may include one or more lenses, image sensors, image signal processors, or flashes.

The power management module 688 may manage power supplied to the electronic device 601 . According to an embodiment, the power management module 688 may be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

The battery 689 may supply power to at least one component of the electronic device 601 . According to one embodiment, battery 689 may include, for example, a non-rechargeable primary cell, a rechargeable secondary cell, or a fuel cell.

The communication module 690 is a direct (eg, wired) communication channel or a wireless communication channel between the electronic device 601 and an external electronic device (eg, the electronic device 602 , the electronic device 604 , or the server 608 ). It can support establishment and communication through the established communication channel. The communication module 690 may include one or more communication processors that operate independently of the processor 620 (eg, an application processor) and support direct (eg, wired) communication or wireless communication. According to one embodiment, the communication module 690 is a wireless communication module 692 (eg, a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 694 (eg, : It may include a local area network (LAN) communication module, or a power line communication module). Among these communication modules, a corresponding communication module is a first network 698 (eg, a short-range communication network such as Bluetooth, WiFi direct, or infrared data association (IrDA)) or a second network 699 (eg, a cellular network, the Internet, or It may communicate with the external electronic device 604 through a computer network (eg, a telecommunication network such as a LAN or WAN). These various types of communication modules may be integrated into one component (eg, a single chip) or may be implemented as a plurality of components (eg, multiple chips) separate from each other. The wireless communication module 692 uses subscriber information (eg, International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module 696 within a communication network, such as the first network 698 or the second network 699 . The electronic device 601 may be identified and authenticated.

The antenna module 697 may transmit or receive a signal or power to the outside (eg, an external electronic device). According to an embodiment, the antenna module 697 may include one antenna including a conductor formed on a substrate (eg, a PCB) or a radiator formed of a conductive pattern. According to an embodiment, the antenna module 697 may include a plurality of antennas. In this case, at least one antenna suitable for a communication scheme used in a communication network such as the first network 698 or the second network 699 is connected from the plurality of antennas by, for example, the communication module 690 . can be selected. A signal or power may be transmitted or received between the communication module 690 and the external electronic device through the selected at least one antenna. According to some embodiments, other components (eg, RFIC) other than the radiator may be additionally formed as a part of the antenna module 697 .

At least some of the components are connected to each other through a communication method between peripheral devices (eg, a bus, general purpose input and output (GPIO), serial peripheral interface (SPI), or mobile industry processor interface (MIPI)) and a signal ( e.g. commands or data) can be exchanged with each other.

According to an embodiment, the command or data may be transmitted or received between the electronic device 601 and the external electronic device 604 through the server 608 connected to the second network 699 . Each of the external electronic devices 602 and 604 may be the same as or different from the electronic device 601 . According to an embodiment, all or part of the operations performed by the electronic device 601 may be executed by one or more of the external electronic devices 602 , 604 , or 608 . For example, when the electronic device 601 is to perform a function or service automatically or in response to a request from a user or other device, the electronic device 601 may perform the function or service itself instead of executing the function or service itself. Alternatively or additionally, one or more external electronic devices may be requested to perform at least a part of the function or the service. The one or more external electronic devices that have received the request may execute at least a part of the requested function or service, or an additional function or service related to the request, and transmit a result of the execution to the electronic device 601 . The electronic device 601 may process the result as it is or additionally and provide it as at least a part of a response to the request. For this purpose, for example, cloud computing, distributed computing, or client-server computing technology may be used.

According to various embodiments, an electronic device (eg, the first electronic device 101 of FIG. 1 or the electronic device 601 of FIG. 6 ) may communicate with an external device (eg, the second electronic device of FIG. 1 ) through a first communication method. 102 or a communication circuit (eg, the Bluetooth module unit 220 of FIG. 2 or the wireless communication module 692 of FIG. 6 ) for transmitting and receiving a sound signal to and from the external electronic device 602 of FIG. 6), a memory (eg: memory 230 of FIG. 2 or memory 630 of FIG. 6 ), a processor (eg, the processor 260 of FIG. 2 or the processor 620 of FIG. 6 ), and the processor (eg, the processor of FIG. 2 ). 260 or the processor 620 of FIG. 6 ) performs a first NREC technology (noise reduction and echo) in the external device (eg, the second electronic device 102 of FIG. 1 or the external electronic device 602 of FIG. 6 ). cancellation) is applied, and transmits a first acoustic signal to the external device (eg, the second electronic device 102 of FIG. 1 or the external electronic device 602 of FIG. 6 ), and the external device (eg, the second electronic device 602 of FIG. 6 ) : Receive a second acoustic signal corresponding to the first acoustic signal from the second electronic device 102 of FIG. 1 or the external electronic device 602 of FIG. 6 , and the external device (eg, the second electronic device of FIG. 1 ) When the first NREC technology is applied by the device 102 or the external electronic device 602 of FIG. 6 , the residual echo amount or the residual noise amount for the second sound signal is checked, and the residual echo amount or the The residual noise amount may be compared with a preset reference value, and an additional NREC technique may be applied based on the comparison.

According to various embodiments, the processor (eg, the processor 260 of FIG. 2 or the processor 620 of FIG. 6 ) is the external device (eg, the second electronic device 102 of FIG. 1 or the external electronic device of FIG. 6 ) If the device 602) does not apply the first NREC technique, the additional NREC technique may be applied regardless of the comparison.

According to various embodiments, the processor (eg, the processor 260 of FIG. 2 or the processor 620 of FIG. 6 ) is the external device (eg, the second electronic device 102 of FIG. 1 or the external electronic device of FIG. 6 ) When the device 602) applies the first NREC technique, the additional NREC technique may be applied based on the comparison.

According to various embodiments, the processor (eg, the processor 260 of FIG. 2 or the processor 620 of FIG. 6 ) may perform the comparison based on a root mean square (RMS) value of the second acoustic signal. have.

According to various embodiments, the first sound signal may be generated based on a test sound source generated by the electronic device (eg, the first electronic device 101 of FIG. 1 or the electronic device 601 of FIG. 6 ). .

According to various embodiments, the processor (eg, the processor 260 of FIG. 2 or the processor 620 of FIG. 6 ) transmits the first sound signal to the external device ( Example: It can transmit to the second electronic device 102 of FIG. 1 or the external electronic device 602 of FIG. 6 ).

According to various embodiments, the processor (eg, the processor 260 of FIG. 2 or the processor 620 of FIG. 6 ) receives a call for a call connection from the outside and, when the call is connected, receives a sign language sound received from the outside. The first acoustic signal may be transmitted to the external device (eg, the second electronic device 102 of FIG. 1 or the external electronic device 602 of FIG. 6 ).

According to various embodiments, the processor (eg, the processor 260 of FIG. 2 or the processor 620 of FIG. 6 ) may store the result according to the comparison in the memory (eg, the memory 230 of FIG. 2 or the processor 620 of FIG. 6 ). It may be stored in the memory 630). The processor (eg, the processor 260 of FIG. 2 or the processor 620 of FIG. 6 ) receives a call for a call connection from the outside and applies the additional NREC technology based on the stored result when the call is connected. can

According to various embodiments, the processor (eg, the processor 260 of FIG. 2 or the processor 620 of FIG. 6 ) may transmit a result according to the comparison to an external server. The processor (eg, the processor 260 of FIG. 2 or the processor 620 of FIG. 6 ) receives a call for a call connection from the outside and when the call is connected, the additional NREC based on the information received from the external server technology can be applied.

According to various embodiments, the first communication method may include Bluetooth communication or BLE communication.

According to various embodiments, the processor (eg, the processor 260 of FIG. 2 or the processor 620 of FIG. 6 ) may determine the application level of the additional NREC technology based on the comparison.

According to various embodiments, a wireless communication method performed by an electronic device (eg, the first electronic device 101 of FIG. 1 or the electronic device 601 of FIG. 6 ) is performed by an external device (eg, the second electronic device of FIG. 1 ). An operation of determining whether the first noise reduction and echo cancellation (NREC) technology is applied in 102 or the external electronic device 602 of FIG. 6 , the external device (eg, the second electronic device 102 of FIG. 1 ) or transmitting a first acoustic signal to the external electronic device 602 of FIG. 6 ), and the operation from the external device (eg, the second electronic device 102 of FIG. 1 or the external electronic device 602 of FIG. 6 ) An operation of receiving a second acoustic signal corresponding to the first acoustic signal, and performing the first NREC technology in the external device (eg, the second electronic device 102 of FIG. 1 or the external electronic device 602 of FIG. 6 ) When applied, the method may include checking the residual echo amount for the second acoustic signal, comparing the residual echo amount with a preset reference value, and applying an additional NREC technique based on the comparison. .

According to various embodiments, the operation of applying the additional NREC technology applies the first NREC technology in the external device (eg, the second electronic device 102 of FIG. 1 or the external electronic device 602 of FIG. 6 ). If not, it may include an operation of applying the additional NREC technology regardless of the comparison.

According to various embodiments, the operation of applying the additional NREC technology applies the first NREC technology in the external device (eg, the second electronic device 102 of FIG. 1 or the external electronic device 602 of FIG. 6 ). , it may include an operation of applying the additional NREC technology based on the comparison.

According to various embodiments, the comparing may include performing the comparison based on a root mean square (RMS) value of the second acoustic signal.

According to various embodiments, the first sound signal may be generated based on a test sound source generated by the electronic device (eg, the first electronic device 101 of FIG. 1 or the electronic device 601 of FIG. 6 ). .

According to various embodiments, the transmitting of the first sound signal may include transmitting the first sound signal to the external device (eg, the second electronic device 102 of FIG. 1 ) when a call for a call connection is received from the outside. Alternatively, it may include an operation of transmitting to the external electronic device 602 of FIG. 6 .

According to various embodiments, the operation of transmitting the first sound signal may include receiving a call for a call connection from the outside and, when a call is connected, convert a sign language sound received from the outside as the first sound signal to the external device (eg: transmitting to the second electronic device 102 of FIG. 1 or the external electronic device 602 of FIG. 6 ).

The electronic device according to various embodiments disclosed in this document may have various types of devices. The electronic device may include, for example, a portable communication device (eg, a smart phone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a home appliance device. The electronic device according to the embodiment of the present document is not limited to the above-described devices.

It should be understood that the various embodiments of this document and the terms used therein are not intended to limit the technical features described in this document to specific embodiments, and include various modifications, equivalents, or substitutions of the embodiments. In connection with the description of the drawings, like reference numerals may be used for similar or related components. The singular form of the noun corresponding to the item may include one or more of the item, unless the relevant context clearly dictates otherwise. As used herein, “A or B”, “at least one of A and B”, “at least one of A or B”, “A, B or C”, “at least one of A, B and C”, and “A , B, or C" each may include any one of the items listed together in the corresponding one of the phrases, or all possible combinations thereof. Terms such as “first”, “second”, or “first” or “second” may be used simply to distinguish the component from other such components, and refer to those components in other aspects (eg, importance or order) is not limited. that one (e.g. first) component is "coupled" or "connected" to another (e.g. second) component with or without the terms "functionally" or "communicatively" When referenced, it means that one component can be connected to the other component directly (eg by wire), wirelessly, or through a third component.

As used herein, the term “module” may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as, for example, logic, logic block, component, or circuit. A module may be an integrally formed part or a minimum unit or a part of the part that performs one or more functions. For example, according to an embodiment, the module may be implemented in the form of an application-specific integrated circuit (ASIC).

Various embodiments of the present document include one or more instructions stored in a storage medium (eg, internal memory 636 or external memory 638) readable by a machine (eg, electronic device 601). may be implemented as software (eg, the program 640) including For example, a processor (eg, processor 620 ) of a device (eg, electronic device 601 ) may call at least one command among one or more commands stored from a storage medium and execute it. This makes it possible for the device to be operated to perform at least one function according to the at least one command called. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The device-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' only means that the storage medium is a tangible device and does not contain a signal (eg, electromagnetic wave), and this term is used in cases where data is semi-permanently stored in the storage medium and It does not distinguish between temporary storage cases.

According to one embodiment, the method according to various embodiments disclosed in this document may be provided in a computer program product (computer program product). Computer program products may be traded between sellers and buyers as commodities. The computer program product is distributed in the form of a machine-readable storage medium (eg compact disc read only memory (CD-ROM)), or via an application store (eg Play Store ^TM ) or on two user devices ( It can be distributed (eg, downloaded or uploaded) directly between smartphones (eg: smartphones) and online. In the case of online distribution, at least a part of the computer program product may be temporarily stored or temporarily generated in a machine-readable storage medium such as a memory of a server of a manufacturer, a server of an application store, or a relay server.

According to various embodiments, each component (eg, a module or a program) of the above-described components may include a singular or a plurality of entities. According to various embodiments, one or more components or operations among the above-described corresponding components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (eg, a module or a program) may be integrated into one component. In this case, the integrated component may perform one or more functions of each component of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. . According to various embodiments, operations performed by a module, program, or other component are executed sequentially, in parallel, repeatedly, or heuristically, or one or more of the operations are executed in a different order, or omitted. or one or more other operations may be added.

Claims (15)

1. In an electronic device,

   a communication circuit for transmitting and receiving a sound signal to and from an external device by a first communication method;

   Memory; and

   processor; including;

   the processor

   Check whether the first noise reduction and echo cancellation (NREC) technology is applied in the external device,

   When the first NREC technology is applied in the external device, a first acoustic signal is transmitted to the external device,

   receiving a second sound signal corresponding to the first sound signal from the external device;

   Checking the residual echo amount or the residual noise amount for the second sound signal,

   comparing the residual echo amount or the residual noise amount with a preset reference value;

   An electronic device applying additional NREC technology based on the above comparison.
2. The method of claim 1, wherein the processor is

   When the external device does not apply the first NREC technology, the electronic device applies a second NREC technology before application of the additional NREC technology.
3. The method of claim 1, wherein the processor is

   An electronic device for receiving a signal regarding whether to apply the first NREC technology from the external device and determining whether to apply the first NREC technology.
4. The method of claim 1, wherein the processor is

   The electronic device performs the comparison based on a root mean square (RMS) value of the second acoustic signal.
5. The method of claim 1, wherein the first acoustic signal is

   An electronic device generated based on the test sound source generated by the electronic device.
6. The method of claim 1, wherein the processor is

   When receiving a call for a call connection from an external device, the electronic device transmits the first acoustic signal to the external device.
7. The method of claim 1, wherein the processor is

   An electronic device for receiving a call for a call connection from the outside and transmitting a sign language sound received from the outside as the first sound signal to the external device when the call is connected.
8. The method of claim 1, wherein the processor is

   An electronic device that stores a result according to the comparison in the memory.
9. The method of claim 8, wherein the processor

   An electronic device that receives a call for call connection from the outside and applies the additional NREC technology based on the stored result when the call is connected.
10. The method of claim 1, wherein the processor is

    An electronic device for transmitting a result according to the comparison to an external server.
11. 11. The method of claim 10, wherein the processor

    An electronic device that receives a call for call connection from the outside and applies the additional NREC technology based on the information received from the external server when the call is connected.
12. The method of claim 1, wherein the first communication method is

    An electronic device comprising Bluetooth communication or BLE communication.
13. The method of claim 1, wherein the processor is

    An electronic device that determines an application level of the additional NREC technology based on the comparison.
14. A wireless communication method performed in an electronic device, comprising:

    checking whether a first noise reduction and echo cancellation (NREC) technique is applied in an external device;

    transmitting a first sound signal to the external device when the first NREC technology is applied to the external device;

    receiving a second sound signal corresponding to the first sound signal from the external device;

    checking a residual echo amount for the second sound signal;

    comparing the residual echo amount with a preset reference value; and

    Method comprising; applying an additional NREC technology based on the comparison.
15. The method of claim 14, wherein the operation of determining whether the first NREC technology is applied comprises:

    and receiving a signal regarding whether to apply the first NREC technology from the external device and determining whether to apply the first NREC technology.

Images