KR20180062013A - Method for improving call quality and electronic device thereof - Google Patents

Abstract

The present invention relates to an operation method in an electronic device. The operation method of an electronic device for controlling a voice signal during a call includes the operations of: receiving the voice signal including a howling component from another electronic device; and outputting the voice signal filtered by a filter determined based on a frequency of the howling component. The filtered voice signal is outputted in a state in which a gain of a frequency band of the howling component is controlled. Accordingly, the present invention can improve call quality by removing howling.

Description

[0001] METHOD FOR IMPROVING CALL QUALITY AND ELECTRONIC DEVICE THEREOF [0002]

Various embodiments of the present invention are directed to a method and an electronic device for improving call quality.

Sounding equipment (e.g., speakers) for broadcasting, performances, and church installations can be appropriately positioned to eliminate howling since the output (e.g., volume) is large. Alternatively, when the acoustic equipment uses a highly sensitive directional microphone, since the sound is input only in a specific direction, the howling can be removed. Alternatively, frequency band tuning for howling cancellation may be performed. In this case, since the size of the sound equipment is large and the sound equipment is in a fixed position, the acoustic environment is constant and the howling frequency band does not change much.

In general mobile communication, when a sound output from a terminal to a speaker is micro-input to the same terminal, an echo may occur. When the echo is not removed, the sound output from the terminal is amplified by the signal processing in the terminal and causes howling. Therefore, most terminals support the echo canceller to block the occurrence of howling.

The echo cancellation method uses a signal received by an electronic device as a reference signal to remove echoes generated in a signal transmitted from the electronic device. However, since the output of the signal received by the counterpart electronic device (far end) is generated by circulation of the micro-input of the electronic device (near end), there is no reference signal and the echo cancellation method Can not be used. The method of removing the howling by applying a notch filter to the transmission of an electronic device has a poor effect of howling removal.

Various embodiments of the present invention provide a method and apparatus for controlling howling without using an echo cancellation scheme.

Various embodiments of the present invention provide a method and apparatus for controlling howling without using a notch filter.

Various embodiments of the present invention provide a method and apparatus for controlling howling generated by circulation of an audio signal output from another electronic device to an electronic device.

Various embodiments of the present invention provide a method and apparatus for controlling howling during a group call.

Various embodiments of the present invention provide a method and apparatus for determining a howling frequency band based on the power of a voice signal over a frequency band.

Various embodiments of the present invention provide a method and apparatus for controlling the gain of the howling frequency band.

Various embodiments of the present invention provide a method and apparatus for controlling the hydration loudness of a terminal.

According to an aspect of the present invention, there is provided a method of operating an electronic device for controlling a voice signal during a call, the method comprising: receiving a voice signal including a howling component from another electronic device; And outputting the speech signal filtered by a filter determined based on the frequency of the howling component. The filtered speech signal is output in a state in which the gain of the frequency band of the howling component is adjusted.

According to another embodiment of the present invention, an electronic device for controlling a voice signal during a call includes a controller receiving a voice signal including a howling component from another electronic device, a filter determined based on the frequency of the howling component, And an analog processor for outputting the voice signal filtered by the voice processor. The filtered speech signal is output in a state in which the gain of the frequency band of the howling component is adjusted.

According to the present invention, it is possible to improve the call quality by eliminating the howling occurring between the electronic devices located in the vicinity in the group call.

1 illustrates an example of a network environment including an electronic device according to various embodiments of the present invention.
Figure 2 shows an example of a block diagram of an electronic device according to various embodiments of the present invention.
Figure 3 shows an example of a block diagram of a program module according to various embodiments of the present invention.
Figure 4 illustrates an example of howling occurrence according to various embodiments of the present invention.
Figure 5 shows an example of the functional configuration of an electronic device according to various embodiments of the present invention.
Figure 6 shows an example of another functional configuration of an electronic device according to various embodiments of the present invention.
Figure 7 shows a flow diagram of an electronic device according to various embodiments of the present invention.
8 illustrates an example of time-frequency analysis of a speech signal according to various embodiments of the present invention.
Figure 9 shows a flow diagram of an electronic device for controlling howling in accordance with various embodiments of the present invention.
10 shows a flow diagram of an electronic device for determining a howling frequency band in accordance with various embodiments of the present invention.
11A and 11B show examples of a howling frequency band according to various embodiments of the present invention.
12 shows another flow diagram of an electronic device for determining a howling frequency band in accordance with various embodiments of the present invention.
Figure 13 shows a flow diagram of an electronic device for adjusting the gain of the howling frequency band according to various embodiments of the present invention.
14A and 14B show examples of gain control of the howling frequency band according to various embodiments of the present invention.
Figure 15 shows a flow diagram of an electronic device for controlling volume according to the howling frequency according to various embodiments of the present invention.
Figure 16 shows a flow diagram of an electronic device for recovering the gain and volume of the howling frequency band according to various embodiments of the present invention.
Figure 17 shows an example of howling improvement results in accordance with various embodiments of the present invention.

Hereinafter, various embodiments of the present document will be described with reference to the accompanying drawings. It is to be understood that the embodiments and terminologies used herein are not intended to limit the invention to the particular embodiments described, but to include various modifications, equivalents, and / or alternatives of the embodiments. In connection with the description of the drawings, like reference numerals may be used for similar components. The singular expressions may include plural expressions unless the context clearly dictates otherwise. In this document, the expressions "A or B" or "at least one of A and / or B" and the like may include all possible combinations of the items listed together. Expressions such as " first, "" second," " first, "or" second, " But is not limited to those components. When it is mentioned that some (e.g., first) component is "(functionally or communicatively) connected" or "connected" to another (second) component, May be connected directly to the component, or may be connected through another component (e.g., a third component).

In this document, the term " configured to (or configured) to "as used herein is intended to encompass all types of hardware, software, , "" Made to "," can do ", or" designed to ". In some situations, the expression "a device configured to" may mean that the device can "do " with other devices or components. For example, a processor configured (or configured) to perform the phrases "A, B, and C" may be implemented by executing one or more software programs stored in a memory device or a dedicated processor (e.g., an embedded processor) , And a general purpose processor (e.g., a CPU or an application processor) capable of performing the corresponding operations.

Electronic devices in accordance with various embodiments of the present document may be used in various applications such as, for example, smart phones, tablet PCs, mobile phones, videophones, electronic book readers, desktop PCs, laptop PCs, netbook computers, workstations, a portable multimedia player, an MP3 player, a medical device, a camera, or a wearable device. Wearable devices may be of the type of accessories (eg, watches, rings, bracelets, braces, necklaces, glasses, contact lenses or head-mounted-devices (HMD) (E.g., a skin pad or tattoo), or a bio-implantable circuit. In some embodiments, the electronic device may be, for example, a television, a digital video disk (Such as Samsung HomeSync ^TM , Apple TV ^TM , or Google TV ^TM ), which are used in home appliances such as home appliances, audio, refrigerators, air conditioners, vacuum cleaners, ovens, microwave ovens, washing machines, air cleaners, set top boxes, home automation control panels, , A game console (e.g., Xbox ^TM , PlayStation ^TM ), an electronic dictionary, an electronic key, a camcorder, or an electronic photo frame.

In an alternative embodiment, the electronic device may be any of a variety of medical devices (e.g., various portable medical measurement devices such as a blood glucose meter, a heart rate meter, a blood pressure meter, or a body temperature meter), magnetic resonance angiography (MRA) A navigation system, a global navigation satellite system (GNSS), an event data recorder (EDR), a flight data recorder (FDR), an automobile infotainment device, a marine electronic equipment (For example, marine navigation systems, gyro compasses, etc.), avionics, security devices, head units for vehicles, industrial or domestic robots, drones, ATMs at financial institutions, of at least one of the following types of devices: a light bulb, a fire detector, a fire alarm, a thermostat, a streetlight, a toaster, a fitness device, a hot water tank, a heater, a boiler, . According to some embodiments, the electronic device may be a piece of furniture, a building / structure or part of an automobile, an electronic board, an electronic signature receiving device, a projector, or various measuring devices (e.g., Gas, or radio wave measuring instruments, etc.). In various embodiments, the electronic device is flexible or may be a combination of two or more of the various devices described above. The electronic device according to the embodiment of the present document is not limited to the above-described devices. In this document, the term user may refer to a person using an electronic device or a device using an electronic device (e.g., an artificial intelligence electronic device).

1 illustrates an example of an electronic device 101 in a network environment 100 in accordance with various embodiments of the present disclosure.

Referring to Figure 1, in various embodiments, an electronic device 101 in a network environment 100 is described. The electronic device 101 may include a bus 110, a processor 120, a memory 130, an input / output interface 150, a display 160, and a communication interface 170. In some embodiments, the electronic device 101 may omit at least one of the components or additionally include other components. The bus 110 may include circuitry to connect the components 110-170 to one another and to communicate communications (e.g., control messages or data) between the components. Processor 120 may include one or more of a central processing unit, an application processor, or a communications processor (CP). The processor 120 may perform computations or data processing related to, for example, control and / or communication of at least one other component of the electronic device 101.

Memory 130 may include volatile and / or non-volatile memory. Memory 130 may store instructions or data related to at least one other component of electronic device 101, for example. According to one embodiment, the memory 130 may store software and / or programs 140. The program 140 may include, for example, a kernel 141, a middleware 143, an application programming interface (API) 145, and / or an application program . At least some of the kernel 141, middleware 143, or API 145 may be referred to as an operating system. The kernel 141 may include system resources used to execute an operation or function implemented in other programs (e.g., middleware 143, API 145, or application program 147) (E.g., bus 110, processor 120, or memory 130). The kernel 141 also provides an interface to control or manage system resources by accessing individual components of the electronic device 101 in the middleware 143, API 145, or application program 147 .

The middleware 143 can perform an intermediary role such that the API 145 or the application program 147 can communicate with the kernel 141 to exchange data. In addition, the middleware 143 may process one or more task requests received from the application program 147 according to the priority order. For example, middleware 143 may use system resources (e.g., bus 110, processor 120, or memory 130, etc.) of electronic device 101 in at least one of application programs 147 Prioritize, and process the one or more task requests. The API 145 is an interface for the application 147 to control the functions provided by the kernel 141 or the middleware 143. The API 145 is an interface for controlling the functions provided by the application 141. For example, An interface or a function (e.g., a command). Output interface 150 may be configured to communicate commands or data entered from a user or other external device to another component (s) of the electronic device 101, or to another component (s) of the electronic device 101 ) To the user or other external device.

The display 160 may include a display such as, for example, a liquid crystal display (LCD), a light emitting diode (LED) display, an organic light emitting diode (OLED) display, or a microelectromechanical system (MEMS) display, or an electronic paper display . Display 160 may display various content (e.g., text, images, video, icons, and / or symbols, etc.) to a user, for example. Display 160 may include a touch screen and may receive a touch, gesture, proximity, or hovering input using, for example, an electronic pen or a portion of the user's body. Communication interface 170 may establish communication between electronic device 101 and an external device (e.g., other electronic devices 102, 104 or server 106). For example, communication interface 170 may be connected to network 162 via wireless or wired communication to communicate with an external device (e.g., another electronic device 104 or server 106).

The wireless communication may include, for example, LTE, LTE-A (LTE Advance), code division multiple access (CDMA), wideband CDMA (WCDMA), universal mobile telecommunications system (UMTS), wireless broadband (WiBro) System for Mobile Communications), and the like. According to one embodiment, the wireless communication may be wireless communication, such as wireless fidelity (WiFi), Bluetooth, Bluetooth low power (BLE), Zigbee, NFC, Magnetic Secure Transmission, Frequency (RF), or body area network (BAN). According to one example, wireless communication may include GNSS. GNSS may be, for example, Global Positioning System (GPS), Global Navigation Satellite System (Glonass), Beidou Navigation Satellite System (Beidou) or Galileo, the European global satellite-based navigation system. Hereinafter, in this document, "GPS" can be used interchangeably with "GNSS ". The wired communication may include, for example, at least one of a universal serial bus (USB), a high definition multimedia interface (HDMI), a recommended standard 232 (RS-232), a power line communication or a plain old telephone service have. Network 162 may include at least one of a telecommunications network, e.g., a computer network (e.g., LAN or WAN), the Internet, or a telephone network.

Each of the other electronic devices 102 and 104 may be the same or a different kind of device as the electronic device 101. [ According to various embodiments, all or a portion of the operations performed on the electronic device 101 may be performed on another or a plurality of electronic devices (e.g., other electronic devices 102, 104, or a server 106) In accordance with the example, in the event that the electronic device 101 has to perform a function or service automatically or on demand, the electronic device 101 may, instead of or in addition to executing the function or service itself, (E. G., Other electronic devices 102,104, or server 106), and / or other devices (e. G., Other electronic devices 102,104, or server 106) May execute the requested function or additional function and forward the result to the electronic device 101. The electronic device 101 may process the received result as is or additionally to provide the requested function or service . This In order, for example, cloud computing, distributed computing, or client-server computing techniques can be used.

FIG. 2 illustrates an example of a block diagram of an electronic device 201 in accordance with various embodiments of the present disclosure.

Referring to FIG. 2, the electronic device 201 may include all or a portion of the electronic device 101 shown in FIG. 1, for example. The electronic device 201 may include one or more processors (e.g., AP) 210, a communications module 220, a subscriber identification module 224, a memory 230, a sensor module 240, an input device 250, An interface 270, an audio module 280, a camera module 291, a power management module 295, a battery 296, an indicator 297, and a motor 298. The processor 290, The processor 210 may be, for example, an operating system or an application program to control a plurality of hardware or software components coupled to the processor 210, and to perform various data processing and operations. ) May be implemented, for example, as a system on chip (SoC). According to one embodiment, the processor 210 may further include a graphics processing unit (GPU) and / or an image signal processor. The cellular module 210 may include at least some of the components shown in Figure 2 (e.g., the cellular module 221) The processor 210 other components: processing by loading the command or data received from at least one (e.g., non-volatile memory) in the volatile memory) and can store the result data into the nonvolatile memory.

May have the same or similar configuration as communication module 220 (e.g., communication interface 170). The communication module 220 may include, for example, a cellular module 221, a WiFi module 223, a Bluetooth module 225, a GNSS module 227, an NFC module 228 and an RF module 229 have. The cellular module 221 can provide voice calls, video calls, text services, or Internet services, for example, over a communication network. According to one embodiment, the cellular module 221 may utilize a subscriber identity module (e.g., a SIM card) 224 to perform the identification and authentication of the electronic device 201 within the communication network. According to one embodiment, the cellular module 221 may perform at least some of the functions that the processor 210 may provide. According to one embodiment, the cellular module 221 may comprise a communications processor (CP). At least some (e.g., two or more) of the cellular module 221, the WiFi module 223, the Bluetooth module 225, the GNSS module 227, or the NFC module 228, according to some embodiments, (IC) or an IC package. The RF module 229 can, for example, send and receive communication signals (e.g., RF signals). The RF module 229 may include, for example, a transceiver, a power amplifier module (PAM), a frequency filter, a low noise amplifier (LNA), or an antenna. According to another embodiment, at least one of the cellular module 221, the WiFi module 223, the Bluetooth module 225, the GNSS module 227, or the NFC module 228 transmits / receives an RF signal through a separate RF module . The subscriber identification module 224 may include, for example, a card or an embedded SIM containing a subscriber identity module, and may include unique identification information (e.g., ICCID) or subscriber information (e.g., IMSI (international mobile subscriber identity).

Memory 230 (e.g., memory 130) may include, for example, internal memory 232 or external memory 234. Volatile memory (e.g., a DRAM, an SRAM, or an SDRAM), a non-volatile memory (e.g., an OTPROM, a PROM, an EPROM, an EEPROM, a mask ROM, a flash ROM , A flash memory, a hard drive, or a solid state drive (SSD). The external memory 234 may be a flash drive, for example, a compact flash (CF) ), Micro-SD, Mini-SD, extreme digital (xD), multi-media card (MMC), or memory stick, etc. External memory 234 may communicate with electronic device 201, Or may be physically connected.

The sensor module 240 may, for example, measure a physical quantity or sense the operating state of the electronic device 201 to convert the measured or sensed information into an electrical signal. The sensor module 240 includes a gesture sensor 240A, a gyro sensor 240B, an air pressure sensor 240C, a magnetic sensor 240D, an acceleration sensor 240E, a grip sensor 240F, A green sensor 240G, a color sensor 240H (e.g., an RGB (red, green, blue) sensor), a living body sensor 240I, a temperature / humidity sensor 240J, And may include at least one of the sensor 240M or the ultrasonic sensor 240N. Additionally or alternatively, the sensor module 240 may be configured to perform various functions such as, for example, an e-nose sensor, an electromyography (EMG) sensor, an electroencephalograph (EEG) sensor, an electrocardiogram An infrared (IR) sensor, an iris sensor, and / or a fingerprint sensor. The sensor module 240 may further include a control circuit for controlling at least one or more sensors belonging to the sensor module 240. In some embodiments, the electronic device 201 further includes a processor configured to control the sensor module 240, either as part of the processor 210 or separately, so that while the processor 210 is in a sleep state, The sensor module 240 can be controlled.

The input device 250 may include, for example, a touch panel 252, a (digital) pen sensor 254, a key 256, or an ultrasonic input device 258. As the touch panel 252, for example, at least one of an electrostatic type, a pressure sensitive type, an infrared type, and an ultrasonic type can be used. Further, the touch panel 252 may further include a control circuit. The touch panel 252 may further include a tactile layer to provide a tactile response to the user. (Digital) pen sensor 254 may be part of, for example, a touch panel or may include a separate recognition sheet. Key 256 may include, for example, a physical button, an optical key, or a keypad. The ultrasonic input device 258 can sense the ultrasonic wave generated by the input tool through the microphone (e.g., the microphone 288) and confirm the data corresponding to the ultrasonic wave detected.

According to various embodiments, when the display is a liquid crystal-driven TFT display, the touch panel may include an in-cell type touch display used also as an electrode for driving the liquid crystal of the TFT.

According to various embodiments, the pen sensor 254 may include an electromagnetic resonance (EMR) sensor for detecting whether an electronic pen is removably provided in the electronic device 201. According to one embodiment, the processor can detect an input position by receiving a feedback signal with respect to a resonance frequency according to vibration of a coil included in the electronic pen, using an electromagnetic field generated from the EMR sensor. According to one embodiment, the processor may comprise a control circuit (driver IC) arranged in the EMR sensor.

Display 260 (e.g., display 160) may include panel 262, hologram device 264, projector 266, and / or control circuitry for controlling them. The panel 262 may be embodied, for example, flexibly, transparently, or wearably. The panel 262 may comprise a touch panel 252 and one or more modules. According to one embodiment, the panel 262 may include a pressure sensor (or force sensor) capable of measuring the intensity of the pressure on the user's touch. The pressure sensor may be integrated with the touch panel 252 or may be implemented by one or more sensors separate from the touch panel 252. The hologram device 264 can display a stereoscopic image in the air using interference of light. The projector 266 can display an image by projecting light onto a screen. The screen may be located, for example, inside or outside the electronic device 201. The interface 270 may include, for example, an HDMI 272, a USB 274, an optical interface 276, or a D-sub (D-subminiature) 278. The interface 270 may, for example, be included in the communication interface 170 shown in FIG. Additionally or alternatively, the interface 270 may include, for example, a mobile high-definition link (MHL) interface, an SD card / multi-media card (MMC) interface, or an infrared data association have.

The audio module 280 can, for example, convert sound and electrical signals in both directions. At least some of the components of the audio module 280 may be included, for example, in the input / output interface 145 shown in FIG. The audio module 280 may process sound information input or output through, for example, a speaker 282, a receiver 284, an earphone 286, a microphone 288, or the like. The microphone 288 may receive the analog voice signal received from another electronic device 104. The speaker 282 can output the voice signal received from the other electronic device 104 in analog form. The camera module 291 is, for example, a device capable of capturing still images and moving images, and according to one embodiment, one or more image sensors (e.g., a front sensor or a rear sensor), a lens, an image signal processor (ISP) , Or flash (e.g., an LED or xenon lamp, etc.). The power management module 295 can, for example, manage the power of the electronic device 201. [ According to one embodiment, the power management module 295 may include a power management integrated circuit (PMIC), a charging IC, or a battery or fuel gauge. The PMIC may have a wired and / or wireless charging scheme. The wireless charging scheme may include, for example, a magnetic resonance scheme, a magnetic induction scheme, or an electromagnetic wave scheme, and may further include an additional circuit for wireless charging, for example, a coil loop, a resonant circuit, have. The battery gauge can measure, for example, the remaining amount of the battery 296, the voltage during charging, the current, or the temperature. The battery 296 may include, for example, a rechargeable battery and / or a solar cell.

The indicator 297 may indicate a particular state of the electronic device 201 or a portion thereof (e.g., processor 210), e.g., a boot state, a message state, or a state of charge. The motor 298 can convert the electrical signal to mechanical vibration, and can generate vibration, haptic effects, and the like. Electronic device 201 is, for example, DMB Mobile TV-enabled devices capable of handling media data in accordance with standards such as (digital multimedia broadcasting), DVB (digital video broadcasting), or MediaFLO (mediaFlo ^TM) (for example, : GPU). Each of the components described in this document may be composed of one or more components, and the name of the component may be changed according to the type of the electronic device. In various embodiments, an electronic device (e. G., Electronic device 201) may have some components omitted, further include additional components, or some of the components may be combined into one entity, The functions of the preceding components can be performed in the same manner.

3 shows a block diagram of a program module according to various embodiments. According to one embodiment, program module 310 (e.g., program 140) includes an operating system that controls resources associated with an electronic device (e.g., electronic device 101) and / E.g., an application program 147). The operating system may include, for example, Android ^TM , iOS ^TM , Windows ^TM , Symbian ^TM , Tizen ^TM , or Bada ^TM .

3, program module 310 includes a kernel 320 (e.g., kernel 141), middleware 330 (e.g., middleware 143), API 360 (e.g., API 145) ), And / or an application 370 (e.g., an application program 147). At least a portion of the program module 310 may be preloaded on an electronic device, Servers 102, 104, server 106, etc.).

The kernel 320 may include, for example, a system resource manager 321 and / or a device driver 323. The system resource manager 321 can perform control, allocation, or recovery of system resources. According to one embodiment, the system resource manager 321 may include a process manager, a memory manager, or a file system manager. The device driver 323 may include, for example, a display driver, a camera driver, a Bluetooth driver, a shared memory driver, a USB driver, a keypad driver, a WiFi driver, an audio driver, or an inter-process communication . The middleware 330 may provide various functions through the API 360, for example, to provide functions that are commonly needed by the application 370 or allow the application 370 to use limited system resources within the electronic device. Application 370 as shown in FIG. According to one embodiment, the middleware 330 includes a runtime library 335, an application manager 341, a window manager 342, a multimedia manager 343, a resource manager 344, a power manager 345, a database manager The location manager 350, the graphic manager 351, or the security manager 352. In this case, the service manager 341 may be a service manager, a service manager, a service manager, a package manager 346, a package manager 347, a connectivity manager 348, a notification manager 349,

The runtime library 335 may include, for example, a library module that the compiler uses to add new functionality via a programming language while the application 370 is executing. The runtime library 335 may perform input / output management, memory management, or arithmetic function processing. The application manager 341 can manage the life cycle of the application 370, for example. The window manager 342 can manage GUI resources used in the screen. The multimedia manager 343 can recognize the format required for reproducing the media files and can perform encoding or decoding of the media file using a codec according to the format. The resource manager 344 can manage the source code of the application 370 or the space of the memory. The power manager 345 may, for example, manage the capacity or power of the battery and provide the power information necessary for operation of the electronic device. According to one embodiment, the power manager 345 may interoperate with a basic input / output system (BIOS). The database manager 346 may create, retrieve, or modify the database to be used in the application 370, for example. The package manager 347 can manage installation or update of an application distributed in the form of a package file.

The connectivity manager 348 may, for example, manage the wireless connection. The notification manager 349 may provide the user with an event such as, for example, an arrival message, an appointment, a proximity notification, and the like. The location manager 350 can manage the location information of the electronic device, for example. The graphic manager 351 may, for example, manage the graphical effects to be presented to the user or a user interface associated therewith. Security manager 352 may provide, for example, system security or user authentication. According to one embodiment, the middleware 330 may include a telephony manager for managing the voice or video call function of the electronic device, or a middleware module capable of forming a combination of the functions of the above-described components . According to one embodiment, the middleware 330 may provide a module specialized for each type of operating system. Middleware 330 may dynamically delete some existing components or add new ones. The API 360 may be provided in a different configuration depending on the operating system, for example, as a set of API programming functions. For example, for Android or iOS, you can provide a single API set for each platform, and for Tizen, you can provide two or more API sets for each platform.

The application 370 may include a home 371, a dialer 372, an SMS / MMS 373, an instant message 374, a browser 375, a camera 376, an alarm 377, Contact 378, voice dial 379, email 380, calendar 381, media player 382, album 383, watch 384, healthcare (e.g., measuring exercise or blood glucose) , Or environmental information (e.g., air pressure, humidity, or temperature information) application. According to one embodiment, the application 370 may include an information exchange application capable of supporting the exchange of information between the electronic device and the external electronic device. The information exchange application may include, for example, a notification relay application for communicating specific information to an external electronic device, or a device management application for managing an external electronic device. For example, the notification delivery application can transmit notification information generated in another application of the electronic device to the external electronic device, or receive notification information from the external electronic device and provide the notification information to the user. The device management application may, for example, control the turn-on / turn-off or brightness (or resolution) of an external electronic device in communication with the electronic device (e.g., the external electronic device itself Control), or install, delete, or update an application running on an external electronic device. According to one embodiment, the application 370 may include an application (e.g., a healthcare application of a mobile medical device) designated according to the attributes of the external electronic device. According to one embodiment, the application 370 may include an application received from an external electronic device. At least some of the program modules 310 may be implemented (e.g., executed) in software, firmware, hardware (e.g., processor 210), or a combination of at least two of the same, Program, routine, instruction set or process.

Figure 4 shows an example of howling occurrence according to various embodiments of the present invention.

Referring to FIG. 4, the electronic device 101 and other electronic devices 102, 104 may perform group calls. In this case, if the electronic device 101 and the other electronic device 104 are located at a distance of a certain distance or less, howling may occur. Howling refers to a method in which a voice 401 input to another electronic device 104 is converted into a digital signal 403 and transmitted to the electronic device 101 via the network and then transmitted to the electronic device 403 corresponding to the transmitted digital signal 403. [ The volume of the digital signal 403 may be amplified in the circulation in which the voice 405 output from the electronic device 101 is input to the other electronic device 104 again. Howling may refer to a phenomenon in which noise occurs due to resonance of a specific voice frequency. The howling contemplated in various embodiments may be performed by the circulation of the audio signal output by the other electronic device 104 to the electronic device 101 by the interference of the un-desired audio signal in a particular frequency band Can be a phenomenon that occurs.

Further, when the electronic device 101 and the other electronic devices 102 and 104 are connected in a device-to-device (D2D) manner, the electronic device 101 and the other electronic device 104 are connected to each other at a close distance , Howling may occur. For example, when the electronic device 101 and other electronic devices 102 and 104 are D2D connected to establish a disaster network, if the electronic device 101 and the other electronic device 104 are located in an enclosed indoor space , Howling may occur.

When the howling occurs as shown in FIG. 4, if the howling is not removed, the communication quality may deteriorate. Accordingly, the present disclosure describes various embodiments for eliminating howling for improving call quality.

5 shows an example of the functional configuration of an electronic device 101 according to various embodiments of the present invention.

5, the electronic device 101 may include a communication unit 510, a control unit 520, and an analogue processing unit 530. In various embodiments of the present invention, the electronic device 101 may be implemented with more configurations than the configurations shown in FIG. 5, or with configurations less than those shown in FIG. 5, have.

The communication unit 510 may receive a radio frequency (RF) signal. To this end, the communication unit 510 may include at least one antenna. The communication unit 510 may down-convert the received signal to generate an intermediate frequency (IF) or a baseband signal. The communication unit 510 may include a reception processing circuit that generates a processed baseband signal by filtering, decoding, and / or digitizing the baseband or IF signal. The receiving processing circuit may transmit the processed baseband signal to the speaker for voice data or to the control unit 520 for further processing. In addition, the communication unit 510 may include at least one transceiver. At least one transceiver may receive outgoing baseband data from the controller 520. The transmit processing circuit may encode, multiplex and digitize the baseband data for transmission to produce a processed baseband or intermediate frequency signal. The communication unit 520 may up-convert the processed baseband or intermediate frequency signal for transmission through a transmission processing circuit to an RF signal that can be transmitted through an antenna.

The control unit 520 may control the communication unit 510 and the analog processing unit 530 functionally combined with the control unit 520. For example, the control unit 520 may control the reception of a forward channel signal and the transmission of a reverse channel signal using the communication unit 510. In some embodiments, the control unit 520 may include at least one microprocessor or microcontroller. The control unit 520 can execute another process or a program existing in the electronic device 101. [ The control unit 520 may store or recall data to the electronic device 101 as required in the execution process. In some embodiments, the control unit 520 may be configured to execute an application in response to a received signal based on an operating system.

The analog processing unit 530 can receive a voice signal input from a user or a voice signal from another electronic device 104. [ In addition, the analog processor 530 may convert the received voice signal from an analog form to a digital form, and then adjust the level according to a set gain.

Referring to Fig. 5, the functional configuration of the electronic device 101 has been described. Hereinafter, a description of interlocking between the control unit 520 and the analog processing unit 530 is specifically shown in FIG. 6 shows an example of another functional configuration of an electronic device 101 according to various embodiments of the present invention.

6, the analog processing unit 530 includes a microphone 602, an analog to digital converter (ADC) 604, an amplifier 606, a digital to analog converter (DAC) 622, and a speaker 624 . The control unit 520 includes an echo cancellation unit 608, a speech enhancement unit 610, a voice encoding unit 612, an IP (internet protocol) layer unit 614, a voice decoding unit 616, A voice enhancement unit 618, and a hauling removal unit 620. The units included in the control unit 520 and the analog processing unit 530 may be in the form of hardware or software, and in the case of software, each unit may be performed by the function of the control unit 520 or the analog processing unit 530 .

The microphone 602 can include a circuit such as a piezoelectric element, and can generate an audio signal by using the vibration of the diaphragm due to a voice signal. The microphone 602 can receive a voice signal from another electronic device 104. [ The microphone 602 can deliver the received voice signal to the ADC 604. [ The microphone 602 can convert a voice signal received in the form of a sound wave into an electrical signal and transmit the electrical signal to the ADC 604. [

The ADC 604 may convert the electrical signal received from the microphone 602 from an analog form to a digital form. The ADC 604 may perform sampling, quantization, and binary encoding of the analog voice signal received from the microphone 602 to convert the analog voice signal into a digital voice signal. The ADC 604 can deliver the digital voice signal to the amplifier 606. [

The amplifier 606 may receive the digital voice signal from the ADC 604. [ The amplifier 606 can control the gain of the received digital voice signal. The amplifier 606 can increase the gain of the received digital voice signal. The gain may vary depending on the frequency band of the digital voice signal. The amplifier 606 can deliver the digital voice signal whose gain has been changed to the echo cancellation unit 610. [

The echo cancellation unit 608 may remove echoes from the digital speech signal received from the amplifier 606. The echo can be a noise generated by a voice output from the speaker 624 and input to the microphone 602 again. The echo cancellation unit 608 can remove the echo by using a voice outputted from the speaker 624 and input to the microphone 602 as a reference signal. The echo canceling unit 608 can deliver the echo canceled digital voice signal to the speaking voice enhancing unit 610. [

After the echo cancellation unit 608 receives the echo canceled digital voice signal from the echo canceling unit 608, it can remove noise from the digital voice signal. In some embodiments, the speaking voice enhancement unit 610 may adjust the volume and tone of the digital voice signal, and so on. The speech enhancement unit 610 can deliver the digital speech signal to which the noise has been removed to the speech encoding unit 612. [

The speech encoding unit 612 can receive the noise-canceled digital speech signal from the speech speech enhancement unit 610 and then encode the digital speech signal. The speech encoding unit 612 may compress the digital speech signal. The speech encoding unit 612 can deliver the compressed digital speech signal to the IP layer unit 614. [

IP layer unit 614 may process IP packets. For example, the IP layer unit 614 may receive the compressed digital voice signal from the voice encoding unit 612 and then packetize the digital voice signal and send the compressed digital voice < RTI ID = 0.0 > A packet containing a signal can be transmitted. Thereafter, the IP layer unit 614 receives the packet containing the digital signal from the other electronic device 104 over the network, restores the digital voice signal contained in the payload of the packet, ) Of the digital voice signal.

The speech decoding unit 616 may receive the digital signal from the IP layer unit 614 and then decode the digital speech signal. The speech decoding unit 616 may decompress the digital speech signal. The speech decoding unit 616 can deliver the decompressed digital speech signal to the hydrated speech enhancement unit 618. [

The hydrated speech enhancement unit 618 can remove the noise of the digital speech signal after receiving the decompressed digital speech signal from the speech decoding unit 616. [ In some embodiments, the hydrated voice enhancement unit 618 may adjust the volume and tone of the digital voice signal, and so on. The hydrated voice enhancement unit 618 can deliver the digital voice signal from which the noise has been removed to the howling removal unit 620.

The hauling removal unit 620 may remove the noises from the hydrated voice enhancement unit 618 and then remove the howling from the digital voice signal. The howling removal unit 620 may determine the howling frequency band based on the power for each frequency band of the digital voice signal, and adjust the gain and volume of the howling frequency band to remove howling. The howling removal unit 620 can deliver the DAC 622 the digital voice signal from which the howling is removed. In some embodiments, the hauling removal unit 620 may communicate the digital voice signal from which the howling is removed to the echo removal unit 610 so that the echo is further removed.

The DAC 622 may receive the digital voice signal from which the unhairing is removed from the howl removing unit 620, and then convert the digital voice signal into an analog voice signal. The DAC 622 can receive the digital binary code and convert it into an analog voice signal. For example, the DAC 622 may convert an n-bit digital voice signal into 2- ⁿ analog voltage reference signals. The DAC 622 can deliver an analog voice signal to the speaker 624.

The speaker 624 may receive an analog voice signal from the DAC 622 and then output it to the outside of the electronic device 101. [ In this case, since the audio signal output to the outside is a voice signal from which the howling is removed, it is possible to prevent the communication quality from deteriorating in the group communication.

In the embodiment described with reference to FIG. 6, the hauling removal unit 620 may be located on a path that processes the received packet, for example, on the hydration path. According to another embodiment, the hauling removal unit 620 may be disposed on the transmission path. Specifically, in some embodiments, the howling removal unit 620 may be located between the speech enhancement unit 610 and the speech encoding unit 612. In this case, the howl removing unit 620 can perform the operation of removing the howling from the voice signal input through the microphone 602. [

An electronic device 101 for controlling a voice signal during a call according to various embodiments of the present invention includes a controller for receiving a voice signal comprising a howling component from another electronic device 104, And an analog processor for outputting the voice signal filtered by the filter. The filtered speech signal may be output in a state in which the gain of the frequency band of the howling component is adjusted.

The howling component according to various embodiments of the present invention may occur because the voice signal output from the electronic device 101 is input to another electronic device 104 in communication with the electronic device 101. [

The electronic device 101 according to various embodiments of the present invention is capable of determining the howling frequency band for the speech signal and is capable of adjusting the gain for the howling frequency band, It is possible to adjust the volume for other frequency bands.

The electronic device 101 according to various embodiments of the present invention may determine a first sub-frequency band having a first maximum power among a plurality of sub-frequency bands constituting a first frequency band for the speech signal, Frequency band having a first maximum power and a second sub-frequency band having a second maximum power among a plurality of sub-frequency bands constituting a second frequency band for the voice signal, wherein the first maximum power and the second maximum power are capable of determining a first threshold A third frequency band may be determined based on the first sub-frequency band and the second sub-frequency band.

The controller according to various embodiments of the present invention may determine power for each of a plurality of sub-frequency bands constituting the third frequency band, and when the power is greater than a second threshold value, The third sub-frequency band may be determined as the Howling frequency band.

The control unit according to various embodiments of the present invention can determine a first sub-frequency band having a first maximum power among a plurality of sub-frequency bands constituting a first frequency band for the voice signal, Frequency band having a second maximum power among the plurality of sub-frequency bands constituting the second frequency band for the first sub-frequency band, the first maximum power and the second maximum power being larger than the first threshold , A third frequency band may be determined based on the first sub-frequency band and the second sub-frequency band.

The controller according to various embodiments of the present invention may determine power for each of a plurality of sub-frequency bands constituting the third frequency band, and when the power is greater than a second threshold value, The third sub-frequency band may be determined as the Howling frequency band.

The first frequency band and the second frequency band may be at least partially overlapped according to various embodiments of the present invention.

The size of each of the plurality of sub-frequency bands constituting the third frequency band according to various embodiments of the present invention may be different from the size of the plurality of sub-frequency bands forming the first frequency band and the second frequency band May be smaller than the respective sizes.

The controller according to various embodiments of the present invention may determine a first gain for the feedback frequency band and a second gain for the frequency band other than the howling frequency band and the first gain and the second gain Filtering may be performed on the frequency bands other than the howling frequency band and the howling frequency band.

The first gain according to various embodiments of the present invention may be determined according to each of a plurality of sub-frequency bands constituting the howling frequency band.

The controller according to various embodiments of the present invention can adjust the volume by a first value for the frequency band other than the howling frequency band and the howling frequency band and can detect the further generated howling, , The volume may be adjusted by a second value for the frequency band other than the howling frequency band and the howling frequency band.

Various embodiments of the present invention will now be described with reference to flowcharts, examples of signal spectra, examples of signal analysis, and the like. The electronic device described as an operating entity in the following description may be any of the electronic devices 101 of Figure 1, all or part of the electronic device 201 of Figure 2 (e.g., processor 120), the electronic device 101 of Figure 5 All or a portion (e.g., control 520).

Figure 7 shows a flow diagram of an electronic device 101 in accordance with various embodiments of the present invention. Fig. 7 illustrates a method of operation of the electronic device 101. Fig. 8 illustrates an example of time-frequency analysis of a speech signal according to various embodiments of the present invention.

Referring to FIG. 7, at operation 701, the electronic device 101 may receive a voice signal from another electronic device 104. The voice signal may be received via a direct link with other electronic device 104, or may be received over a network. The voice signal may be received in the form of a data packet, and the electronic device 101 may extract the voice signal from the data packet. The speech signal may include a howling component. The voice signal includes the voice of the other party of the other electronic device 104 and the voice output through the speaker of the electronic device 101 may further include a micro input signal of the other electronic device 104. [ The howling component may refer to a noise generated when a voice signal output from the electronic device 101 is input to another electronic device 104 in communication with the electronic device 101. [

At operation 703, the electronic device 101 may process the howling frequency band in the received voice signal. The electronic device 101 removes or reduces the howling component in the received speech signal. To this end, the electronic device 101 may convert the received voice signal into a signal in the frequency domain. The received voice may be converted into a time-frequency domain. Referring to FIG. 8, for example, howling may occur in the downlink frequency band interval 813 in the time interval 803. The electronic device 101 may determine a feedback frequency band among a plurality of frequency bands for the converted signal. The howling frequency band may be determined based on the power associated with each of the plurality of frequency bands. The electronic device 101 may adjust the gain corresponding to the determined howling frequency band. In addition, the electronic device 101 may adjust the volume to prevent additional hauling.

At operation 705, the electronic device 101 may output the processed voice signal with the howling frequency band processed. The processed voice signal may mean a voice whose gain corresponding to the howling frequency band is adjusted and additionally reduced in volume.

In some embodiments, the electronic device 101 may process the howling frequency band as it determines that a group call is being performed. The performance of the group call can be defined as a triggering condition of the procedure shown in FIG. For example, the electronic device 101 can determine that an application for the group call is being executed, and that a group call is performed when two or more participants are identified.

9 shows a flow diagram of an electronic device 101 for controlling howling in accordance with various embodiments of the present invention. 9 illustrates a method of operation of the electronic device 101. Fig.

Referring to Fig. 9, at operation 901, the electronic device 101 may determine the howling frequency band. The electronic device 101 may convert the voice signal received from the other electronic device 104 into the frequency domain and then determine the power for each of the plurality of frequency bands. The electronic device 101 may determine a specific frequency band based on the power for each of a plurality of frequency bands, and then determine power for each of a plurality of sub-frequency bands constituting the specific frequency band. The electronic device 101 may determine the howling frequency band based on the power for each of a plurality of sub-frequency bands.

At operation 903, the electronic device 101 may remove the howling frequency band. The electronic device 101 may determine a gain corresponding to a band corresponding to the howling frequency band and another gain corresponding to a band other than the howling frequency band, and then perform filtering according to the determined gains.

At operation 905, the electronic device 101 may adjust the volume. The electronic device 101 can adjust the volume corresponding to a band other than the howling frequency band and the filtering frequency band. The electronic device 101 can adjust the volume for the entire frequency band. In some embodiments, the electronic device 101 may adjust the volume for a band other than the howling frequency band for which filtering has been performed. In further embodiments, at step 905, the electronic device 101 decreases the volume to produce a feedback signal at the downlink frequency band < RTI ID = 0.0 > And the gain can be reduced more than the previously reduced gain for the band other than the howling frequency band.

In some embodiments, operation 905 may be omitted, since operation 905 may additionally be performed if there is also hauling after performing filtering on the howling frequency band in operation 903.

10 shows a flow diagram of an electronic device 101 for determining a howling frequency band in accordance with various embodiments of the present invention. Fig. 10 illustrates a method of operation of the electronic device 101. Fig.

Referring to Fig. 10, at operation 1001, the electronic device 101 may convert the received voice signal into a signal in the frequency domain. The electronic device 101 can convert the received speech signal into the frequency domain and analyze the speech signal in the frequency spectrum.

In operation 1003, the electronic device 101 may determine the power for each frequency band. For example, referring to Figure 11a and 11b, the electronic device 101 includes an operational section f _B s [i] n of empty (bin) that make up the 1101 and the operation interval _{f B [i + 1] (} 1103 ≪ / RTI > can be determined for each of the bins that constitute the < RTI ID = 0.0 > The computation interval may refer to a frequency band for determining whether or not howling occurs. Also, when there are a plurality of arithmetic sections, each arithmetic section may be defined to overlap. This may be to increase the accuracy of determining the howling frequency f _H (1109). This is because, when the howling frequency f _H 1109 is present at the boundary between the calculation interval f _B [i] 1101 and the calculation interval f _B [i + 2] 1103, the detection of the howling frequency f _H 1109 It can be because it can fail. In some embodiments, the end point of the computation period f _B [i] 1101 and the end point of the computation period f _B [i + 2] 1103 may not coincide. The computation period may be referred to as another term such as a 'detection interval', an 'inspection interval', a 'frequency band', and a 'frequency interval' depending on its technical meaning. The bin may refer to a basic unit constituting each operation section. A bean can mean a sub-frequency band that divides a frequency band. The bean may be referred to as another name such as 'subband', 'sub-frequency interval', and 'unit interval' depending on its technical meaning.

At operation 1005, the electronic device 101 determines whether the difference between the maximum power P [i] _max and the median (median) of power for each bin of the computation period f _B [i] 1101 is greater than the threshold You can decide. The electronic device 101 determines the first maximum power among the powers for each sub-frequency band constituting the first frequency band for the voice signal and determines whether the difference between the first maximum power and the median value is greater than the threshold value You can decide. In other embodiments, the electronic device 101 determines that the difference between the maximum power P [i] _max and the mean or minimum (minimum) of power for each bin of the computation period f _B [i] Lt; RTI ID = 0.0 > threshold. ≪ / RTI > In still other embodiments, the electronic device 101 may have a maximum power P [i] _max of the power for each bin of the operational range f _B [i] (1101) to determine whether or not larger than the threshold. If the difference between the maximum power P [i] _max and the median value is greater than the threshold value, the electronic device 101 may determine that howling exists. If the difference between the maximum power P [i] _max and the median is not greater than the threshold, the electronic device 101 proceeds to operation 1001. [

In another embodiment, if the difference between the maximum power P [i] _max and the median is greater than the threshold, the electronic device 101 proceeds to operation 1007. [ In operation 1007, the electronic device 101 determines whether the difference between the maximum power P [i + 1] _max of the power for each bin of the computation period f _B [i + 1] 1103 and the median is greater than a threshold value Can be determined. The electronic device 101 determines the second maximum power of the power for each sub-frequency band constituting the second frequency band for the voice signal, and determines whether the difference between the second maximum power and the median value is greater than the threshold value Can be determined. In other embodiments, the electronic device 101 determines that the difference between the maximum power P [i + 1] _max and the average or minimum value of power for each bin of the computation period f _B [i + 1] ≪ / RTI > In yet other embodiments, the electronic device 101 may determine whether the maximum power P [i + 1] _max of power for each bin of the computation period f _B [i + 1] 1103 is greater than a threshold have. If the difference between the maximum power P [i + 1] _max and the median is not greater than the threshold, the electronic device 101 proceeds to operation 1013. If the difference between the maximum power P [i + 1] _max and the median value is not greater than the threshold value, the electronic device 101 may determine that howling has occurred in the computation period f _B [i] 1101.

On the other hand, if the difference between the maximum power P [i + 1] _max and the median value is greater than the threshold, the electronic device 101 proceeds to operation 1009. In operation 1009, the electronic device 101 may determine the computation period f _B [Howling] 1107. Specifically, when f (P [i] _max ) and f (P [i + 1] _max ) coincide with each other, a bin having the maximum power in the i- The electronic device 101 may determine f _B [Howling] 1107 based on f (P [i] _max ) and f (P [i + 1] _max ). The electronic device 101 may determine the third frequency band based on the first sub-frequency band having the first maximum power and the second sub-frequency band having the second maximum power. The size of the operation interval f _B [Howling] 1107 may be the same as the size of other operation intervals (e.g., f _B [i] 1101. In some embodiments, f (P [i] If the _max) and f (P [i + 1] _max) does not match, one of the frequency range between the electronic device 101 is f (P [i] _max) and f (P [i + 1] _max) F _B [Howling] (1107) can be determined around the point (e.g.

In operation 1011, the electronic device 101 may determine the power for each bin of the computation period f _B [Howling] 1107. The electronic device 101 may determine a third power for each of a plurality of sub-frequency bands constituting the third frequency band. The size of each bin of the operation section f _B [Howling] 1107 may be smaller than the size of each bin of the operation section f _B [i] 1101. This may be to determine the howling frequency f _H (1109) more accurately by determining the power for a small-sized bin. In some embodiments, the size of each bin in the computation period f _B [Howling] 1107 may be equal to the size of each bin in the other computation periods. In other embodiments, the electronic device 101 uses a sampling rate (e. G., A sampling rate) used to determine the power for each of the bins that constitute the arithmetic section f _B [i] 1101 and the arithmetic section f _B [i + sampling rate), then the power for each bin of the calculation interval f _B [Howling] 1107 can be determined.

In operation 1013, the electronic device 101 may determine a howling frequency f _H (1109) and a howling frequency band 1111. Specifically, the electronic device 101 may determine a bin with a maximum power P [Howling] _max of power for each bin of f _B [Howling] 1107 as a howling frequency f _H (1109). Also, the electronic device 101 may determine the frequency band corresponding to the bin having the power greater than the threshold value among the powers of the bins of f _B [Howling] 1107 as the howling frequency band 1111. If the third power is greater than the threshold value, the electronic device 101 may determine the third sub-frequency band corresponding to the third power as the howling frequency band 1111. The threshold may be different from the threshold value that is compared with the power for bin in the operation interval f _B [i] 1101 and the operation interval f _B [i + 1] 1103 in operation 1005 and operation 1007. Then, the howling frequency band 1111 can be determined to occupy a constant bandwidth around the howling frequency f _H (1109). The constant bandwidth can be predefined.

12 shows another flow diagram of an electronic device 101 for determining a howling frequency band in accordance with various embodiments of the present invention. Fig. 12 illustrates a method of operation of the electronic device 101. Fig.

Referring to FIG. 12, at operation 1201, the electronic device 101 may determine the power associated with the computation period f _B [i] 1101 and the computation period f _B [i + 1] 1103. Specifically, the electronic device 101 determines the power for each bin of the computation period f _B [i] 1101 and determines the power for each bin of the computation period f _B [i + 1] 1103 have.

At operation 1203, the electronic device 101 may determine that the difference between the maximum power P [i] _max and the median value of power for each bin of the computation period f _B [i] 1101 is greater than a threshold value. In some embodiments, the electronic device 101 determines that the difference between the maximum power P [i] _{max of} power for each bin of the computation period f _B [i] 1101 and the average or minimum value is greater than the threshold . In other embodiments, electronic device 101 may determine that the maximum power P [i] _max of the power for each bin of the operational range f _B [i] (1101) is greater than the threshold.

In operation 1205, the electronic device 101 determines that the difference between the maximum power P [i + 1] _max and the median value of power for each bin of the computation period f _B [i + 1] 1103 is greater than the threshold value Can be determined. In some embodiments, the electronic device 101 determines that the difference between the maximum power P [i + 1] _max and the average or minimum value of power for each bin of the computation period f _B [i + 1] You can decide. In other embodiments, electronic device 101 may determine that the operation interval f _B [i + 1] The maximum power P [i + 1] _max of the power for each bin 1103 is greater than the threshold.

In operation 1207, the maximum power for the electronic device 101 includes an operational section f _B [i + 1] The maximum power P [i + 1] _max is calculated interval for the _{(1103) f B [i]} (1101) P [ i] _max . < / RTI > If the maximum power P [i + 1] _max for the calculation interval f _B [i + 1] 1103 is not greater than the maximum power P [i] _max for the calculation interval f _B [i] 1101, The electronic device 101 proceeds to operation 1217. [

On the other hand, the operation interval f _B [i + 1] The maximum power of the (1103) P [i + 1 ] if _max is greater than the maximum power P [i] _max for an operation period _{f B [i] (1101)} , E The device 101 proceeds to operation 1209. [ At operation 1209, the electronic device 101 may determine the power of the computation period f _B [i + 2] (1105). Specifically, the electronic device 101 can determine the power for each bin of the computation period f _B [i + 2] (1105). This operation range f _B [i + 1] is the maximum power P [i + 1] _max to 1103 is greater than the maximum power P [i] _max for an operation period _{f B [i] (1101)} , howling The frequency f _H 1109 is present in the annual interval f _B [i + 1] 1103 and the howling frequency band 1111 is divided into the calculation interval f _B [i] 1101 and the annual interval f _B [i + 2] 1105). ≪ / RTI >

In operation 1211, the electronic device 101 may determine the computation period f _B [Howling] 1107. Specifically, the electronic device 101 is f (P [i + 1] _max), and f (P [i + 2] max) if the match is, f (P [i + 1] _max), and f (P [ i + 2] _max ) based on the following equation: f _B [Howling] (1107). f (P [i + 1] max) is calculated interval f _B [i + 1] means a blank, and having a maximum power of bins (1103) f (P [i + 2] max) is calculated interval f _B [i + 2] (1105). The size of the operation interval f _B [Howling] 1107 may be larger than the size of other operation intervals. This may be because the howling frequency band 1111 exists over the annual interval f _B [i] 1101 and the annual interval f _B [i + 2] 1105. In some embodiments, f (P [i] _max), and f (P [i + 1] max) if they do not match, the electronic device 101 is f (P [i] _max), and f (P [ f [ _B ] (Howling) (1107) around one point (e.g., the middle point) of the inter-frequency range of [i + 1] _max ).

At operation 1213, the electronic device 101 may determine the power for each bin of f _B [Howling] 1107. The size of each bin of the operation section f _B [Howling] 1107 may be smaller than the size of each bin of the operation section f _B [i] 1101. This may be to determine the exact howling frequency f _H (1109), by determining the power for a small-sized bin. In some embodiments, the size of each bin in the computation period f _B [Howling] 1107 may be equal to the size of each bin in the computation period f _B [i] 1101.

At operation 1215, the electronic device 101 may determine a howling frequency f _H (1109) and a howling frequency band 1111. Specifically, the electronic device 101 may determine a bin with a maximum power P [Howling] _max of power for each bin of f _B [Howling] 1107 as a howling frequency f _H (1109). Also, the electronic device 101 can determine the frequency band corresponding to the bin having the power greater than the threshold value among the powers of the bins of f _B [Howling] 1107 as a howling frequency band. The threshold may be different from the threshold value that is compared with the power for the bin in the operation interval f _B [i] 1101 and the operation interval f _B [i + 1] 1103 in operation 1007 and operation 1009.

If the maximum power P [i + 1] _max for the computation period f _B [i + 1] 1103 is not greater than the maximum power P [i] _max for the computation period f _B [i] 1101, The electronic device 101 may determine the computation period f _B [Howling] 1107. Specifically, when f (P [i] _max ) and f (P [i + 1] _max ) coincide with each other, a bin having the maximum power in the i- The electronic device 101 may determine f _B [Howling] 1107 based on f (P [i] _max ) and f (P [i + 1] _max ). In some embodiments, f (P [i] _max), and f (P [i + 1] max) if they do not match, the electronic device 101 is f (P [i] _max), and f (P [ f [ _B ] (Howling) (1107) around one point (e.g., the middle point) of the inter-frequency range of [i + 1] _max ).

In operation 1219, the electronic device 101 may determine the power for each bin of the computation period f _B [Howling] 1107. The size of each bin of the operation section f _B [Howling] 1107 may be smaller than the size of each bin of the operation section f _B [i] 1101. This may be to determine the howling frequency f _H (1109) more accurately by determining the power for a small-sized bin. In some embodiments, the size of each bin in the computation period f _B [Howling] 1107 may be equal to the size of each bin in the other computation periods.

In operation 1221, the electronic device 101 may determine a howling frequency f _H (1109) and a howling frequency band 1111. Specifically, the electronic device 101 may determine a bin with a maximum power P [Howling] _max of power for each bin of f _B [Howling] 1107 as a howling frequency f _H (1109). Also, the electronic device 101 may determine the frequency band corresponding to the bin having the power greater than the threshold value among the powers of the bins of f _B [Howling] 1107 as the howling frequency band 1111.

10 to 12, operations for determining the howling frequency band have been described. The howling frequency band determined at operation 1215 of FIG. 12 may occupy a bandwidth wider than the howling frequency band determined at operation 1013 of FIG. The bandwidth of the howling frequency band can be adjusted according to the number of operation intervals in which the howling component exists. Accordingly, the electronic device 101 can determine the number of operation intervals that are judged to have the howling component, and determine the howling frequency band according to the size corresponding to the number of operation intervals to be checked.

Figure 13 shows a flow diagram of an electronic device 101 for adjusting the gain of the howling frequency band according to various embodiments of the present invention. Fig. 13 illustrates a method of operation of the electronic device 101. Fig.

Referring to FIG. 13, at operation 1301, the electronic device 101 may determine the gain for each frequency band. Specifically, the electronic device 101 can determine the gain for the howling frequency band and other gains for the band other than the howling frequency band. For example, the electronic device 101 may determine the gain for the howling frequency band to be 0.05 and another gain for the band other than the howling frequency band to be one.

In operation 1303, the electronic device 101 may perform filtering for each frequency band. The electronic device 101 may apply the determined gain to the howling frequency band and apply different gains to the band other than the howling frequency band. The electronic device 101 may perform filtering on frequency bands other than the howling frequency band and the howling frequency band, based on the determined gains. For example, referring to FIG. 14A, the band 1401 where the howling occurs is applied with a gain of 0, and the band 1403 other than the band where the howling occurs is applied with a gain of 1. For another example, referring to FIG. 14B, a band 1403 other than the band where the howling occurs may be applied with a gain of 1. However, the band 1401 in which the howling occurs is not applied to the entire band with a gain of 0, but a gain may be applied so that the gain is gradually reduced to a part of both ends of the band 1401 where the howling occurs. The gain for the howling frequency band can be determined according to each bin constituting the howling frequency band. In this case, there may be an advantage that distortions caused by a sudden change in the gain at the boundary between the band 1401 where the howling occurs and the band 1403 other than the band where the Howling occurs are suppressed.

15 shows a flow diagram of an electronic device 101 for controlling volume according to the howling frequency according to various embodiments of the present invention. Fig. 15 illustrates a method of operation of the electronic device 101. Fig.

Referring to FIG. 15, at operation 1501, the electronic device 101 may determine whether howling occurs. The electronic device 101 may analyze the frequency band of the voice signal to determine whether howling occurs. Specifically, after determining the power for each bin in the computation period, the electronic device 101 can determine that howling has occurred if the determined power is greater than the threshold. If no howling occurs, the electronic device 101 may periodically determine whether hauling occurs.

On the other hand, if hauling occurs, the electronic device 101 proceeds to operation 1503. At operation 1503, the electronic device 101 may determine whether the howling frequency first occurred or whether a single howling frequency is generated. The electronic device 101 can determine whether the current howling frequency is the first occurring howling frequency, whether the current was generated after the aftering frequency is removed, or whether the second generated frequency has been generated. In the case where howling is additionally generated in different frequency bands depending on various situations such as the position or direction of the electronic device 101, the electronic device 101 determines whether a single howling frequency is generated because there are two or more howling frequencies You can decide.

If the presently occurring howling frequency is the first encountered howling frequency or a single howling frequency is generated, the electronic device 101 proceeds to operation 1505. At operation 1505, the electronic device 101 may adjust the volume by a first value. The electronic device 101 can adjust the volume by a first value with respect to bands other than the band where the howling occurs and the band where the howling occurs. For example, the electronic device 101 can adjust the volume by -3 dB. This is because the howling occurs because the volume is large, so that the volume may be adjusted so as to prevent additional howling. The electronic device 101 may proceed to operation 1501 to determine whether additional hauling is occurring.

In an alternate embodiment, if the additional howling frequency is generated or a multi-falling frequency is generated before the previously occurring hashing frequency is removed and then recovered, the electronic device 101 proceeds to operation 1507. [ When a multi-stepping frequency is generated, it means that two or more howling frequencies are generated at the same time. At operation 1507, the electronic device 101 may adjust the volume by a second value. The electronic device 101 can adjust the volume by a second value for bands other than the band where the howling occurs and the band where the howling occurs. The second value may be a value greater than a volume (e.g., a first value) that is adjusted when a single howling frequency is generated. For example, the electronic device 101 can adjust the volume by -12 dB. This is to remove the howling of a single hauling frequency, and additionally to adjust how much the hauling occurs in other frequency bands, thereby eliminating the additional generated hauling. For example, if the distance between the electronic device 101 and the other electronic device 104 is very close to a certain distance or less, howling may further occur.

Figure 16 shows a flow diagram of an electronic device for recovering the gain and volume of the howling frequency band according to various embodiments of the present invention. 16 illustrates a method of operation of the electronic device 101. Fig.

Referring to Fig. 16, at operation 1601, the electronic device 101 may process the howling frequency band. The electronic device 101 may remove or reduce the howling component in the received speech signal. To this end, the electronic device 101 may determine the howling frequency band for the speech signal and may reduce the gain corresponding to the determined howling frequency band. Additionally, the electronic device 101 may reduce the volume so as to prevent additional hauling.

At operation 1603, the electronic device 101 may determine whether a hangover time has elapsed. The hangover time may be set to a predefined time (e.g., 1 second). According to another embodiment, the hangover time may be adaptively adjusted according to the state of the electronic device 101. [ For example, when there is no change in environment, such as when the electronic device 101 is moved over a certain distance or the direction of the electronic device 101 is changed over a certain angle, the electronic device 101 can extend the hangover time . If the hangover time has not elapsed, the electronic device 101 may periodically determine whether the hangover time has elapsed.

If the hangover time has elapsed, the electronic device 101 proceeds to operation 1603. At operation 1605, the electronic device 101 may recover gain and volume for the howling frequency band. The electronic device 101 may again increase the reduced volume and increase the reduced gain for the howling frequency band again. The electronic device 101 can return the audio signal to a state before processing the howling frequency band.

Figure 17 shows an example of howling improvement results in accordance with various embodiments of the present invention.

Referring to FIG. 17, the time-frequency analysis results 1701 and 1703 show a voice signal before the after-hearing removal in the time-frequency domain, and the time-frequency analysis results 1705 and 1707 show a voice signal after the after- Time-frequency domain. The waveform of the speech section 1711 before the un-hauling removal and the waveform of the speech section 1715 after the unblocking can be almost the same. The howling component can be removed in the howling section 1717 after the removal of the howling compared to the before-after-after-removal section 1713.

As the howling is removed, the hauling distance can be as shown in Table 1 below. Here, the hauling distance may mean the distance between the electronic device 101 where the howling occurs and the other electronic device 104 when the electronic device 101 and the other electronic device 104 face each other. Referring to Table 1 below, when the various embodiments of the present invention are applied, a howling distance of about 60% as compared with the conventional method can be improved. However, the improvement in the hauling distance by about 60% compared to the conventional example is merely an example, and in the case of applying the various embodiments of the present invention, the degree of improvement of the hauling distance is not limited to 60%.

Before application After applying Howling distance (cm) 80 30

If the loudspeaker volume is excessively large, or if howling occurs between electronic devices located close to each other during a group call, the howling can be eliminated by applying various embodiments of the present invention. By removing the howling, the call quality is improved and the user can talk to the other party without noise.

The method of operating an electronic device 101 for controlling a voice signal during a call according to various embodiments of the present invention includes receiving an audio signal including a howling component from another electronic device 104, And outputting the speech signal filtered by the filter determined based on the frequency. The filtered speech signal may be output in a state in which the gain of the frequency band of the howling component is adjusted.

The howling component according to various embodiments of the present invention may occur because the voice signal output from the electronic device 101 is input to another electronic device 104 in communication with the electronic device 101. [

The operation of outputting the filtered speech signal according to various embodiments of the present invention may include: determining the howling frequency band for the speech signal; adjusting the gain for the howling frequency band; And adjusting the volume of a frequency band other than the howling frequency band and the howling frequency band.

The operation of determining the howling frequency band for the speech signal according to various embodiments of the present invention may include determining a second frequency band for the speech signal, The method comprising: determining a first sub-frequency band; determining a second sub-frequency band having a second maximum power among a plurality of sub-frequency bands constituting a second frequency band for the voice signal; And determining a third frequency band based on the first sub-frequency band and the second sub-frequency band when the power and the second maximum power are greater than a first threshold.

The operation of determining the howling frequency band for the speech signal according to various embodiments of the present invention may include determining power for each of a plurality of sub-frequency bands constituting the third frequency band, And determining the third sub-frequency band corresponding to the power as the howling frequency band if the second sub-frequency band is greater than the second threshold.

The first frequency band and the second frequency band may be at least partially overlapped according to various embodiments of the present invention.

The size of each of the plurality of sub-frequency bands constituting the third frequency band according to various embodiments of the present invention may be different from the size of the plurality of sub-frequency bands forming the first frequency band and the second frequency band May be smaller than the respective sizes.

The operation of adjusting the gain for the howling frequency band according to various embodiments of the present invention may include determining a first gain for the howling frequency band and a second gain for the frequency band other than the howling frequency band And performing filtering on the frequency band other than the howling frequency band and the howling frequency band based on the first gain and the second gain.

The first gain according to various embodiments of the present invention may be determined according to each of a plurality of sub-frequency bands constituting the howling frequency band.

The operation of adjusting the volume of the frequency band other than the howling frequency band and the howling frequency band according to various embodiments of the present invention may include adjusting the volume of the frequency band other than the howling frequency band and the howling frequency band, And controlling the volume by a second value with respect to the frequency band other than the howling frequency band and the howling frequency band in accordance with the detection, . ≪ / RTI >

As used herein, the term "module " includes units comprised of hardware, software, or firmware and may be used interchangeably with terms such as, for example, logic, logic blocks, components, or circuits. A "module" may be an integrally constructed component or a minimum unit or part thereof that performs one or more functions. "Module" may be implemented either mechanically or electronically, for example, by application-specific integrated circuit (ASIC) chips, field-programmable gate arrays (FPGAs) And may include programmable logic devices. At least some of the devices (e.g., modules or functions thereof) or methods (e.g., operations) according to various embodiments may be stored in a computer readable storage medium (e.g., memory 130) . ≪ / RTI > When the instruction is executed by a processor (e.g., processor 120), the processor may perform a function corresponding to the instruction. The computer-readable recording medium may be a hard disk, a floppy disk, a magnetic medium such as a magnetic tape, an optical recording medium such as a CD-ROM, a DVD, a magnetic-optical medium such as a floppy disk, The instructions may include code that is generated by the compiler or code that may be executed by the interpreter. Modules or program modules according to various embodiments may include at least one or more of the components described above Operations that are performed by modules, program modules, or other components, in accordance with various embodiments, may be performed in a sequential, parallel, iterative, or heuristic manner, or at least in part Some operations may be executed in a different order, omitted, or other operations may be added.

It is to be understood that both the foregoing general description and the following detailed description of the present invention are exemplary and explanatory and are intended to provide further explanation of the invention as claimed. It is not intended to be limiting. Accordingly, the scope of various embodiments of the present invention should be construed as being included in the scope of various embodiments of the present invention without departing from the scope of the present invention, all changes or modifications derived from the technical idea of various embodiments of the present invention .

Claims (20)

A method of operating an electronic device for controlling a voice signal during a call,
Receiving an audio signal including a howling component from another electronic device,
And outputting the speech signal filtered by a filter determined based on the frequency of the howling component,
Wherein the filtered speech signal is output in a state in which the gain of the frequency band of the howling component is adjusted.
The method according to claim 1,
Wherein the howling component is generated by a voice signal output from the electronic device being input to the other electronic device in communication with the electronic device.
The method according to claim 1,
The operation of outputting the filtered voice signal includes:
Determining the howling frequency band for the speech signal;
Adjusting a gain for the howling frequency band,
And adjusting a volume of the frequency band other than the howling frequency band and the howling frequency band.
The method of claim 3,
Wherein the determining of the howling frequency band for the speech signal comprises:
Determining a first sub-frequency band having a first maximum power among a plurality of sub-frequency bands constituting a first frequency band for the voice signal;
Determining a second sub-frequency band having a second maximum power among a plurality of sub-frequency bands constituting a second frequency band for the voice signal;
Determining a third frequency band based on the first sub-frequency band and the second sub-frequency band when the first maximum power and the second maximum power are greater than a first threshold.
The method of claim 4,
Wherein the determining of the howling frequency band for the speech signal comprises:
Determining power for each of a plurality of sub-frequency bands constituting the third frequency band,
If the power is greater than a second threshold, determining a third sub-frequency band corresponding to the power as the Howling frequency band.
The method of claim 4,
Wherein the first frequency band and the second frequency band are at least partially overlapped.
The method of claim 5,
Wherein the size of each of the plurality of sub-frequency bands constituting the third frequency band is smaller than the size of each of the plurality of sub-frequency bands constituting the first frequency band and the second frequency band.
The method of claim 3,
The operation of adjusting the gain for the howling frequency band,
Determining a first gain for the howling frequency band and a second gain for the frequency band other than the howling frequency band,
And performing filtering on the frequency band other than the howling frequency band and the howling frequency band based on the first gain and the second gain.
The method of claim 8,
Wherein the first gain is determined according to each of a plurality of sub-frequency bands constituting the howling frequency band.
The method of claim 3,
The operation of adjusting the volume of the frequency band other than the howling frequency band and the howling frequency band,
Adjusting the volume by a first value for the frequency band other than the howling frequency band and the howling frequency band;
Detecting an additionally generated howling,
And adjusting the volume by a second value for the frequency band other than the howling frequency band and the howling frequency band according to the detection.
An electronic device for controlling a voice signal during a call,
A control unit for receiving a voice signal including a howling component from another electronic device;
And an analog processor for outputting the speech signal filtered by a filter determined based on the frequency of the howling component,
And the filtered speech signal is output in a state in which the gain of the frequency band of the howling component is adjusted.
The method of claim 11,
Wherein the howling component occurs because a voice signal output from the electronic device is input to the other electronic device in communication with the electronic device.
The method of claim 11,
Wherein,
Determining the howling frequency band for the speech signal,
Adjusting a gain for the howling frequency band,
And controls the volume of the frequency band other than the howling frequency band and the howling frequency band.
14. The method of claim 13,
Wherein,
Determining a first sub-frequency band having a first maximum power among a plurality of sub-frequency bands constituting a first frequency band for the voice signal,
Determining a second sub-frequency band having a second maximum power among a plurality of sub-frequency bands constituting a second frequency band for the voice signal,
And to determine a third frequency band based on the first sub-frequency band and the second sub-frequency band when the first maximum power and the second maximum power are greater than a first threshold value.
15. The method of claim 14,
Wherein,
Determining power for each of a plurality of sub-frequency bands constituting the third frequency band,
And determines the third sub-frequency band corresponding to the power as the howling frequency band if the power is greater than a second threshold value.
15. The method of claim 14,
Wherein the first frequency band and the second frequency band are at least partially overlapped.
16. The method of claim 15,
Wherein the size of each of the plurality of sub-frequency bands forming the third frequency band is smaller than the size of each of the plurality of sub-frequency bands forming the first frequency band and the second frequency band.
14. The method of claim 13,
Wherein,
Determining a first gain for the howling frequency band and a second gain for the frequency band other than the howling frequency band,
And performs filtering on the frequency band other than the howling frequency band and the howling frequency band based on the first gain and the second gain.
19. The method of claim 18,
Wherein the first gain is determined according to each of a plurality of sub-frequency bands constituting the howling frequency band.
14. The method of claim 13,
Wherein,
Adjusting the volume by a first value for the frequency band other than the howling frequency band and the howling frequency band,
Detects the further generated howling,
And adjusts the volume by a second value for the frequency band other than the howling frequency band and the howling frequency band according to the detection.

Images