KR20160026535A - Method for processing audio signal for improving call quality and apparatus for the same - Google Patents

Abstract

The present invention provides a plurality of audio tables and enable a user to selectively set the audio tables corresponding to each of audio receiving route and transmitting route equipped in an electronic device. Moreover, according to the present invention, a surrounding environment is analyzed during a call, so presence of noise is determined and volume or tone of an audio signal can be outputted or transmitted after being suitably adjusted thereby. Accordingly, an optimal call state can be provided in various call environments.

Description

TECHNICAL FIELD [0001] The present invention relates to an audio processing method and apparatus for improving call quality,

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a call using a portable communication apparatus, and more particularly, to an audio processing method and apparatus capable of providing an optimal call state even in a noisy environment.

A user can make a call in various ways during a voice call using the portable communication device. For example, the speaker of the portable communication apparatus can be directly pushed to the ear, the earphone or ear microphone can be used for the call, or the speaker phone mode can be used for the call. In other words, the portable communication apparatus includes a microphone, a plurality of speakers, a jack connector to which an earphone or ear microphone can be connected, and the like. Thereby, there are a plurality of audio signal paths connected to each speaker and a jack connector, and a plurality of audio signal paths connected to each microphone and jack connector.

Then, the user can select the volume level for the sign language audio by using the volume up / down key while the voice call is in progress, thereby adjusting the volume of the output audio. To this end, the portable communication apparatus has an audio table used for adjusting the volume of output audio. The audio table is a tabulation of the volume magnitude applied to the sign language audio signal step by step according to the volume level, and can be expressed as shown in Table 1 below.

Volume level Volume value max Vn max-1 Vn-1 ... ... max-n-1 V1 max-n 0

In Table 1, max denotes a maximum volume level, max-n denotes a minimum volume level, and 0 to Vn denotes a volume value applied to a sign language audio signal at each volume level.

Generally, the portable communication apparatus has one hydration audio table that can be configured as shown in Table 1 for each audio hydration path. The maximum loudness value of each of the sign language audio tables corresponding to the respective audio signal paths or the loudness change amount of each volume level may be different from each other. Therefore, the portable communication device adjusts the volume of the audio signal by using the sign language audio table corresponding to the audio signal path connected to the output device for outputting the audio signal when the volume up or down input of the user occurs.

On the other hand, the transmission volume level applied to the transmission audio is fixed to one value. However, the volume levels corresponding to the plural audio transmission paths may be different.

As described above, typical portable communication devices have a fixed sign language audio table corresponding to each audio sign language path, or have a fixed send sign level corresponding to the audio call path.

However, the user's call environment is not constant. For example, when a user is at home, a quiet call environment can be maintained, but when a user is located at a place such as a road or a shopping mall, a loud call environment is created.

However, since the portable communication apparatus adjusts only the volume of the audio signal within a limited range by using a fixed sign language audio table for each audio signal path, regardless of the surrounding environment, the user can not provide an optimal call state In addition, there is a problem in that an optimal call state can not be provided because a fixed transmission volume level is applied, although various environmental noises may be included in the voice communication audio.

To solve the above problems, various embodiments of the present invention provide a method and apparatus for changing the volume or tone of a sign language audio signal output during a call.

And various embodiments of the present invention provide a method and apparatus for enabling a user to selectively set various sign language audio tables for respective audio signatures.

Also, various embodiments of the present invention provide a method light device capable of changing the volume or tone of a transmitted audio signal.

In addition, various embodiments of the present invention provide a method light device in which a user can selectively change the volume or tone of various transmitted audio signals for each transmission path.

In addition, various embodiments of the present invention provide a method and apparatus for providing an optimal call service according to the surrounding environment.

According to an embodiment of the present invention, an electronic device includes at least one audio signal output device, an audio module for applying an audio table to at least one audio signal output to the at least one audio signal output device, And a processor for controlling the audio module to change an audio table applied to the at least one audio signal in response to a change request of the audio table and to expand the bandwidth of the at least one audio signal, Wherein the apparatus comprises a plurality of audio tables, wherein the plurality of audio tables include a base call audio table and at least one high-quality call audio table, wherein the volume value for each level of the high- It may be different from the have.

A method of processing an audio signal of an electronic device includes the steps of applying an audio table to at least one audio signal output to at least one audio signal output device, receiving a change request of the audio table, Changing an audio table to be applied to the at least one audio signal and extending a bandwidth of the at least one audio signal, the electronic device including a plurality of audio tables, The table may include a basic call audio table and at least one high-quality call audio table, and the level value of the high-quality call audio table may differ from the level value of each level of the basic call audio table.

Various embodiments of the present invention may change the volume or tone of a received audio signal output during a call and allow the user to selectively configure various audio-supported audio tables for each audio- The volume or tone of the audio signal can be changed, and the user can selectively change the volume or tone of various sending audio signals according to the transmission path. In addition, various embodiments of the present invention can provide an optimal call service according to the surrounding environment.

1 illustrates an electronic device in a network environment in accordance with various embodiments,
2 shows a configuration of an electronic device according to various embodiments,
3 illustrates a configuration of a program module according to various embodiments;
4 illustrates a configuration of an audio module according to various embodiments;
5 illustrates an audio signal processing process according to various embodiments;
6 illustrates a process of processing a sign language audio signal in a custom mode according to various embodiments,
FIG. 7 illustrates a process of processing a transmitted audio signal in the custom mode according to various embodiments; FIG.
8 is a diagram illustrating a frequency response of a sign language audio signal according to various embodiments,
9 is a diagram illustrating the frequency response of a transmitted audio signal according to various embodiments;
10 is a diagram showing an example of adjustment of a noise signal according to various embodiments;

Hereinafter, various embodiments of the present disclosure will be described with reference to the accompanying drawings. It should be understood, however, that this disclosure is not intended to limit the present disclosure to the particular embodiments, but includes various modifications, equivalents, and / or alternatives of the embodiments of the present disclosure. In connection with the description of the drawings, like reference numerals may be used for similar components.

In this document, the expressions "have," "may," "include," or "include" may be used to denote the presence of a feature (eg, a numerical value, a function, Quot ;, and does not exclude the presence of additional features.

In this document, "A or B," "at least one of A or / and B," or? Or " and / or " B "may include all possible combinations of the listed items, for example " A or B ". " At least one of A and B, At least one of B " can refer to both (1) at least one A, (2) at least one B, or (3) at least one A and at least one B. have.

The terms "first," "second," "first," or "second," etc. used in various embodiments may describe various components in any order and / or importance, Lt; / RTI > The representations may be used to distinguish one component from another. For example, the first user equipment and the second user equipment may represent different user equipment, regardless of order or importance. For example, without departing from the scope of the present disclosure, the first component may be referred to as a second component, and similarly, the second component may be named as the first component.

It is to be understood that a component (e.g., a first component) may be "operatively or communicatively coupled (coupled) / to" to another component (eg, a second component) Quot; connected state ", it is to be understood that any such element may be directly connected to the other element or may be connected via another element (e.g., a third element). On the other hand, when it is mentioned that a component (e.g., a first component) is "directly connected" or "directly connected" to another component (e.g., a second component) It can be understood that there is no other component (e.g., a third component) between other components.

As used in this document, the terms "having the capacity to", "having the ability to", and so on, depending on the configured (or configured) And can be used interchangeably with "designed to," "adapted to," "made to," or "capable of." The term " Quot; configured "may not necessarily imply only" specifically designed to "in hardware. Instead, in some circumstances, the expression" a device configured to " For example, a processor configured (or set up) to perform the phrases?, B, and C "may be a processor dedicated to performing the operation For example, an embedded processor), or one or more software stored on a memory device By executing the program, a general purpose processor (generic-purpose processor) capable of carrying out the operation: may mean (for example, CPU or the application processor).

The terminology used herein is for the purpose of describing particular embodiments only and is not intended to limit the scope of the other embodiments. The singular expressions may include plural expressions unless the context clearly dictates otherwise. All terms used herein, including technical or scientific terms, may have the same meaning as commonly understood by one of ordinary skill in the art of the present disclosure. Commonly used predefined terms may be interpreted to have the same or similar meaning as the contextual meanings of the related art and are not to be construed as ideal or overly formal in meaning unless expressly defined in this document . In some cases, the terms defined herein may not be construed to exclude embodiments of the present disclosure.

An electronic device according to various embodiments of the present disclosure may be any device that provides a call function, for example, a smartphone, a tablet personal computer, a mobile phone, a videophone, But are not limited to, e-book readers, desktop personal computers, laptop personal computers, netbook computers, workstations, servers, personal digital assistants (PDAs) player, an MP3 player, a mobile medical device, a camera or a wearable device such as smart glasses, head-mounted-device (HMD), electronic apparel, A necklace, an electronic app apparel, an electronic tattoo, a smart mirror, or a smart watch).

In some embodiments, the electronic device may be a smart home appliance. Smart home appliances include, for example, televisions, digital video disk players, audio, refrigerators, air conditioners, vacuum cleaners, ovens, microwaves, washing machines, air cleaners, set- (Such as a home automation control panel, a security control panel, a TV box such as Samsung HomeSync, Apple TV, or Google TV), a game console (such as Xbox, PlayStation) A camcorder, or an electronic photo frame.

In an alternative embodiment, the electronic device may be any of a variety of medical devices (e.g., various portable medical measurement devices such as a blood glucose meter, a heart rate meter, a blood pressure meter, or a body temperature meter), magnetic resonance angiography (MRA) A global positioning system receiver, an event data recorder (EDR), a flight data recorder (FDR), an automotive infotainment device, a navigation system, a navigation system, Electronic devices (eg marine navigation devices, gyro compass, etc.), avionics, security devices, head units for vehicles, industrial or home robots, ATMs (automatic teller's machines) point of sale, or internet of things (eg, light bulbs, various sensors, electrical or gas meters, sprinkler devices, fire alarms, thermostats, Of the emitter (toaster), exercise equipment, hot water tank, a heater, boiler, etc.) may include at least one.

According to some embodiments, the electronic device is a piece of furniture or a part of a building / structure, an electronic board, an electronic signature receiving device, a projector, Water, electricity, gas, or radio wave measuring instruments, etc.). In various embodiments, the electronic device may be a combination of one or more of the various devices described above. An electronic device according to some embodiments may be a flexible electronic device. Further, the electronic device according to the embodiment of the present disclosure is not limited to the above-described devices, and may include a new electronic device according to technological advancement.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS An electronic apparatus according to various embodiments will now be described with reference to the accompanying drawings. In this document, the term user may refer to a person using an electronic device or a device using an electronic device (e.g., an artificial intelligence electronic device).

Referring to Figure 1, in various embodiments, an electronic device 100 within a network environment is described. The electronic device 100 may include a bus 110, a processor 120, a memory 130, an input / output interface 150, a display 160, and a communication interface 170. In some embodiments, the electronic device 100 may omit at least one of the components or additionally include other components.

The bus 110 may include circuitry, for example, to connect the components 110-170 to each other and to communicate communications (e.g., control messages and / or data) between the components.

The processor 120 may include one or more of a central processing unit (CPU), an application processor (AP), or a communication processor (CP). The processor 120 may perform, for example, operations or data processing relating to control and / or communication of at least one other component of the electronic device 100. [

The memory 130 may include volatile and / or non-volatile memory. The memory 130 may store instructions or data related to at least one other component of the electronic device 100, for example. According to one embodiment, the memory 130 may store software and / or programs 140. The program 140 may include, for example, a kernel 141, a middleware 143, an application programming interface (API) 145, and / or an application program (or application) At least some of the kernel 141, middleware 143, or API 145 may be referred to as an operating system (OS).

The kernel 141 may include, for example, system resources (e.g., bus 110, processor 120, etc.) used to execute an operation or function implemented in other programs (e.g., middleware 143, API 145, Or memory 130, etc.). In addition, the kernel 141 may provide an interface for controlling or managing system resources by accessing individual components of the electronic device 100 in the middleware 143, the API 145, or the application program 147.

For example, the middleware 143 can act as an intermediary for communicating data with the API 141 or the application program 147 by communicating with the kernel 141. In addition, the middleware 143 may be associated with at least one of the application programs 147 in association with work requests received from the application program 147, such as system resources (e.g., bus 110, processor 120, (E.g., scheduling or load balancing) using a method such as assigning a priority that can be used (e.g., memory 130, etc.).

The API 145 is an interface for the application 147 to control the functions provided by the kernel 141 or the middleware 143, for example, for file control, window control, image processing, At least one interface or function (e.g., command).

The input / output interface 150 may serve as an interface through which commands or data input from, for example, a user or other external device can be transmitted to another component (s) of the electronic device 100. In addition, the input / output interface 150 may output commands or data received from other component (s) of the electronic device 100 to a user or other external device.

The display 160 can be, for example, a liquid crystal display (LCD), a light emitting diode (LED) display, an organic light emitting diode (OLED) display, or a microelectromechanical systems (MEMS) ) Display. The display 160 may display various content (e.g., text, images, video, icons, symbols, etc.) to the user, for example. The display 160 may include a touch screen and may receive touch, gesture, proximity, or hovering input using, for example, an electronic pen or a portion of the user's body.

The communication interface 170 may establish communication between, for example, the electronic device 100 and an external device (e.g., the first external electronic device 102, the second external electronic device 104, or the server 106). For example, the communication interface 170 may be connected to the network 162 via wireless or wired communication to communicate with the external device (e.g., the second external electronic device 104 or the server 106).

The wireless communication may use at least one of, for example, LTE, LTE-A, CDMA, WCDMA, UMTS, WiBro, or GSM as the cellular communication protocol. The wired communication may include at least one of a universal serial bus (USB), a high definition multimedia interface (HDMI), a recommended standard 232 (RS-232), a plain old telephone service (POTS) . The network 162 may include at least one of a telecommunications network, e.g., a computer network (e.g., LAN or WAN), the Internet, or a telephone network.

Each of the first and second external electronic devices 102, 104 may be the same or a different kind of device as the electronic device 100. According to one embodiment, the server 106 may include one or more groups of servers. According to various embodiments, all or a portion of the operations performed on the electronic device 100 may be performed on another electronic device or multiple electronic devices (e.g., electronic device 102, 104, or server 106). According to one embodiment, in the event that the electronic device 100 has to perform some function or service automatically or upon request, the electronic device 100 may, instead of or in addition to executing the function or service itself, (E.g., electronic device 102, 104, or server 106) at least some of the associated functionality. The other electronic device (e.g., electronic device 102, 104, or server 106) may execute the requested function or additional function and deliver the result to the electronic device 100. The electronic device 100 can directly or additionally process the received result to provide the requested function or service. For this purpose, for example, cloud computing, distributed computing, or client-server computing technology may be used.

2 is a diagram illustrating the configuration of an electronic device 200 according to various embodiments. The electronic device 200 may include, for example, all or part of the electronic device 100 shown in FIG. The electronic device 200 includes at least one application processor 210, a communication module 220, a subscriber identification module (SIM) card 224, a memory 230, a sensor module 240, an input device 250, a display 260, an interface 270, an audio module 280 A camera module 291, a power management module 295, a battery 296, an indicator 297, and a motor 298.

The AP 210 may control a plurality of hardware or software components connected to the AP 210 by, for example, operating an operating system or an application program, and may perform various data processing and operations. The AP 210 may be implemented as a system on chip (SoC), for example. According to one embodiment, the AP 210 may further include a graphics processing unit (GPU) and / or an image signal processor. The AP 210 may include at least some of the components shown in FIG. 2 (e.g., cellular module 221). The AP 210 may load and process commands or data received from at least one of the other components (e.g., non-volatile memory) into volatile memory and store the various data in non-volatile memory .

The communication module 220 may have the same or similar configuration as the communication interface 160 of FIG. The communication module 220 may include, for example, a cellular module 221, a WIFI module 223, a BT module 225, a GPS module 227, an NFC module 228, and a radio frequency (RF) module 229.

The cellular module 221 can provide a voice call, a video call, a text service, or an Internet service, for example, through a communication network. According to one embodiment, the cellular module 221 may utilize a subscriber identity module (e.g., SIM card 224) to perform the identification and authentication of the electronic device 200 within the communication network. According to one embodiment, the cellular module 221 may perform at least some of the functions that the AP 210 may provide. According to one embodiment, the cellular module 221 may include a communication processor (CP).

Each of the WIFI module 223, the BT module 225, the GPS module 227, and the NFC module 228 may include a processor for processing data transmitted and received through a corresponding module, for example. At least some (e.g., two or more) of the cellular module 221, the WIFI module 223, the BT module 225, the GPS module 227, or the NFC module 228 may be included in one integrated chip (IC) or IC package .

The RF module 229 can transmit and receive a communication signal (e.g., an RF signal), for example. The RF module 229 may include, for example, a transceiver, a power amplifier module (PAM), a frequency filter, a low noise amplifier (LNA), or an antenna. According to another embodiment, at least one of the cellular module 221, the WIFI module 223, the BT module 225, the GPS module 227, or the NFC module 228 can transmit and receive RF signals through separate RF modules.

The SIM card 224 may include, for example, a card containing a subscriber identity module and / or an embedded SIM and may include unique identification information (e.g., an integrated circuit card identifier (ICCID) (E.g., international mobile subscriber identity (IMSI)).

The memory 230 (e.g., memory 230) may include, for example, internal memory 232 or external memory 234. The built-in memory 232 may be a volatile memory such as a dynamic RAM (DRAM), a static random access memory (SRAM), or a synchronous dynamic RAM (SDRAM), a non-volatile memory such as an OTPROM such as one-time programmable ROM, programmable ROM, erasable and programmable ROM, electrically erasable and programmable ROM, mask ROM, flash ROM, flash memory such as NAND flash or NOR flash, A drive, or a solid state drive (SSD).

The external memory 234 may be a flash drive such as a compact flash (CF), a secure digital (SD), a micro secure digital (SD), a mini secure digital (SD), an extreme digital A memory stick, and the like. The external memory 234 may be functionally and / or physically connected to the electronic device 200 through various interfaces.

The sensor module 240 may, for example, measure a physical quantity or sense the operating state of the electronic device 200 and convert the measured or sensed information into an electrical signal. The sensor module 240 includes a gesture sensor 240A, a gyro sensor 240B, an air pressure sensor 240C, a magnetic sensor 240D, an acceleration sensor 240E, a grip sensor 240F, a proximity sensor 240G, a color sensor 240H blue sensor), a biological sensor 240I, a temperature / humidity sensor 240J, an illuminance sensor 240K, or an ultraviolet (UV) sensor 240M. Additionally or alternatively, the sensor module 240 may be, for example, an E-nose sensor, an EMG sensor, an EEG sensor, an electrocardiogram sensor, an IR sensor , An iris sensor, and / or a fingerprint sensor. The sensor module 240 may further include a control circuit for controlling at least one sensor included in the sensor module 240. In some embodiments, the electronic device 200 further includes a processor configured to control the sensor module 240, either as part of the AP 210 or separately, to control the sensor module 240 while the AP 210 is in a sleep state have.

The input device 250 may include, for example, a touch panel 252, a (digital) pen sensor 254, a key 256, or an ultrasonic input device 258. The touch panel 252 may employ, for example, at least one of an electrostatic type, a pressure sensitive type, an infrared type, and an ultrasonic type. The touch panel 252 may further include a control circuit. The touch panel 252 may further include a tactile layer to provide a tactile response to the user.

The (digital) pen sensor 254 may be, for example, part of a touch panel or may include a separate recognition sheet. The key 256 may include, for example, a physical button, an optical key, or a keypad. The ultrasonic input device 258 can sense data by sensing a sound wave with a microphone (e.g., a microphone 288) in the electronic device 200 through an input tool for generating an ultrasonic signal.

The display 260 (e.g., display 160) may include a panel 262, a hologram device 264, or a projector 266. The panel 262 may include the same or similar configuration as the display 160 of FIG. The panel 262 may be embodied, for example, flexible, transparent, or wearable. The panel 262 may be formed of one module with the touch panel 252. The hologram device 264 can display stereoscopic images in the air using interference of light. The projector 266 can display an image by projecting light onto a screen. The screen may be located, for example, inside or outside the electronic device 200. According to one embodiment, the display 260 may further include control circuitry for controlling the panel 262, the hologram device 264, or the projector 266.

The interface 270 may include, for example, a high-definition multimedia interface (HDMI) 272, a universal serial bus (USB) 274, an optical interface 276, or a D-sub . The interface 270 may, for example, be included in the communication interface 160 shown in FIG. Additionally or alternatively, the interface 270 may be implemented, for example, by a mobile high-definition link (MHL) interface, a secure digital (SD) card / multi-media card (MMC) interface, or an infrared data association .

The audio module 280 can convert, for example, a sound and an electrical signal in both directions. At least some of the components of the audio module 280 may be included, for example, in the input / output interface 150 shown in FIG. The audio module 280 may process audio information input or output through, for example, a speaker 282, an earphone 284, a receiver 86, a microphone 288, or the like.

The camera module 291 is, for example, a device capable of capturing a still image and a moving image. According to one embodiment, the camera module 291 includes at least one image sensor (e.g., a front sensor or a rear sensor), a lens, an image signal processor Or a flash (e.g., LED or xenon lamp).

The power management module 295 can manage the power of the electronic device 200, for example. According to one embodiment, the power management module 295 may include a power management integrated circuit (PMIC), a charger integrated circuit ("IC"), or a battery or fuel gauge. The PMIC may have a wired and / or wireless charging scheme. The wireless charging system may include, for example, a magnetic resonance system, a magnetic induction system, or an electromagnetic wave system, and may further include an additional circuit for wireless charging, for example, a coil loop, a resonant circuit, have. The battery gauge can measure, for example, the remaining amount of the battery 296, the voltage during charging, the current, or the temperature. The battery 296 may include, for example, a rechargeable battery and / or a solar battery.

The indicator 297 may indicate a specific state of the electronic device 200 or a part thereof (e.g., AP 210), for example, a boot state, a message state, or a charged state. The motor 298 can convert an electrical signal to mechanical vibration, and can generate vibration, haptic effects, and the like. Although not shown, the electronic device 200 may include a processing unit (e.g., GPU) for mobile TV support. The processing device for supporting the mobile TV can process media data conforming to standards such as digital multimedia broadcasting (DMB), digital video broadcasting (DVB), or media flow.

Each of the above-described components of the electronic device may be composed of one or more components, and the name of the component may be changed according to the type of the electronic device. In various embodiments, the electronic device may be configured to include at least one of the components described above, with some components omitted or further comprising additional other components. In addition, some of the components of the electronic device according to various embodiments may be combined into one entity, so that the functions of the components before being combined can be performed in the same manner.

FIG. 3 is a diagram illustrating a configuration of a program module 310 according to various embodiments. According to one embodiment, the program module 310 (e.g., program 140) includes an operating system (OS) that controls resources associated with an electronic device (e.g., electronic device 100) and / Application (e.g., application program 147). The operating system may be, for example, android, iOS, windows, symbian, tizen, or bada.

The program module 310 may include a kernel 320, a middleware 330, an application programming interface (API) 360, and / or an application 370. At least a portion of the program module 310 may be preloaded on an electronic device or downloaded from a server (e.g., server 106).

The kernel 320 (e.g., kernel 141 of FIG. 1) may include, for example, a system resource manager 321 or a device driver 323. The system resource manager 321 can perform control, assignment, or recovery of system resources. According to one embodiment, the system resource manager 321 may include a process management unit, a memory management unit, or a file system management unit. The device driver 323 may include, for example, a display driver, a camera driver, a Bluetooth driver, a shared memory driver, a USB driver, a keypad driver, a WIFI driver, an audio driver, or an inter-process communication (IPC) driver.

The middleware 330 can provide various functions commonly required by the application 370 or allow the application 370 to perform various functions through the API 360 so that the application 370 can efficiently use limited system resources in the electronic device. 370 < / RTI > According to one embodiment, the middleware 330 (e.g., middleware 143) includes a runtime library 335, an application manager 341, a window manager 342, a multimedia manager 343, a resource manager, 344, a power manager 345, a database manager 346, a package manager 347, a connectivity manager 348, a notification manager 349, a location manager 350, A graphic manager 351, or a security manager 352.

The runtime library 335 may include, for example, a library module used by the compiler to add new functionality via a programming language while the application 370 is running. The runtime library 335 may perform input / output management, memory management, or functions for arithmetic functions.

The application manager 341 can manage the life cycle of at least one of the applications 370, for example. The window manager 342 can manage GUI resources used on the screen. The multimedia manager 343 can identify the format required for various media files and can encode or decode the media file using a codec suitable for the format. The resource manager 344 may manage resources such as a source code, a memory, or a storage space of at least one of the applications 370.

The power manager 345 operates in conjunction with a basic input / output system (BIOS), for example, to manage a battery or a power source, and to provide power information and the like necessary for the operation of the electronic device. The database manager 346 may create, search, or modify a database to be used in at least one of the applications 370. The package manager 347 can manage installation or update of an application distributed in the form of a package file.

The connection manager 348 may manage wireless connections, such as, for example, WIFI or Bluetooth. The notification manager 349 may display or notify events such as arrival messages, appointments, proximity notifications, etc. in a manner that does not disturb the user. The location manager 350 may manage location information of the electronic device. The graphic manager 351 may manage a graphic effect to be provided to the user or a user interface related thereto. The security manager 352 may provide security functions necessary for system security or user authentication. According to one embodiment, when the electronic device (e.g., electronic device 100) includes a telephone function, the middleware 330 may further include a telephony manager for managing the voice or video call capability of the electronic device have.

The middleware 330 may include a middleware module that forms a combination of various functions of the above-described components. The middleware 330 may provide a module specialized for each type of operating system to provide a differentiated function. In addition, the middleware 330 may dynamically delete some existing components or add new components.

The API 360 (e.g., API 145) may be provided in a different configuration depending on the operating system, for example, as a set of API programming functions. For example, for Android or iOS, you can provide one API set per platform, and for tizen, you can provide more than two API sets per platform.

The application 370 (e.g., application program 147) includes a home 371, a dialer 372, an SMS / MMS 373, an instant message 374, a browser 375, a camera 376, an alarm 377, a contact 378, Such as e-mail 380, calendar 381, media player 382, album 383, or clock 384, health care (e.g., to measure exercise or blood glucose), or environmental information (e.g., pressure, humidity, Providing one or more applications that are capable of providing functions,

According to one embodiment, the application 370 is an application that supports information exchange between the electronic device (e.g., electronic device 100) and an external electronic device (e.g., electronic devices 102 and 104) Exchange applications). The information exchange application may include, for example, a notification relay application for communicating specific information to the external electronic device, or a device management application for managing the external electronic device .

For example, the notification delivery application may send notification information generated in another application (e.g., SMS / MMS application, email application, health care application, or environmental information application) of the electronic device to an external electronic device 102, and 104, respectively. Further, the notification delivery application can receive notification information from, for example, an external electronic device and provide the notification information to the user. The device management application may include at least one function (e.g., turn-on / turn-off) of an external electronic device (e.g., some components) of an external electronic device (E.g., install, delete, or change the brightness (or resolution) of the display), an application running on the external electronic device, or services (e.g., call service or message service) Or updated).

According to one embodiment, the application 370 is configured to provide an application (e. G., An electronic device, e. G., An electronic device) Health care applications). According to one embodiment, the application 370 may include an application received from an external electronic device (e.g., server 106 or electronic device 102, 104). According to one embodiment, the application 370 may include a preloaded application or a third party application downloadable from a server. The names of the components of the program module 310 according to the illustrated embodiment may vary depending on the type of the operating system.

According to various embodiments, at least some of the program modules 310 may be implemented in software, firmware, hardware, or a combination of at least two of them. At least some of the program modules 310 may be implemented (e.g., executed) by, for example, a processor (e.g., AP 210). At least some of the program modules 310 may include, for example, modules, programs, routines, sets of instructions, or processes for performing one or more functions.

As used herein, the term module may refer to a unit comprising, for example, one or a combination of two or more of hardware, software, or firmware. A module may be interchangeably used with terms such as, for example, unit, logic, logical block, component, or circuit. The module may be a minimum unit or a part of an integrally constructed component. A module may be a minimum unit or part thereof that performs one or more functions. The module may be implemented mechanically or electronically. For example, the module may be an application-specific integrated circuit (ASIC) chip, field-programmable gate arrays (FPGAs) or programmable-logic devices that perform known or future developments, . ≪ / RTI >

At least a portion of a device (e.g., modules or functions thereof) or a method (e.g., operations) according to various embodiments may include, for example, computer-readable storage media in the form of program modules, As shown in FIG. The instructions, when executed by a processor (e.g., processor 120), may cause the one or more processors to perform functions corresponding to the instructions. The computer readable storage medium may be, for example, the memory 130.

The computer readable recording medium may be a hard disk, a floppy disk, a magnetic media (e.g., a magnetic tape), an optical media (e.g., a compact disc read only memory (CD-ROM) but are not limited to, digital versatile discs, magneto-optical media such as floptical discs, hardware devices such as read only memory (ROM), random access memory (RAM) Etc.), etc. The program instructions may also include machine language code such as those produced by a compiler, as well as high-level language code that may be executed by a computer using an interpreter, etc. The above- May be configured to operate as one or more software modules to perform the operations of the various embodiments, and vice versa.

Modules or program modules according to various embodiments may include at least one or more of the elements described above, some of which may be omitted, or may further include additional other elements. Operations performed by modules, program modules, or other components in accordance with various embodiments may be performed in a sequential, parallel, iterative, or heuristic manner. Also, some operations may be performed in a different order, omitted, or other operations may be added.

And the embodiments disclosed in this document are presented for the purpose of explanation and understanding of the disclosed contents, and do not limit the scope of the present disclosure. Accordingly, the scope of the present disclosure should be construed as including all modifications based on the technical idea of the present disclosure or various other embodiments.

The embodiment according to the present disclosure is intended to provide an optimal call state in various call environments. Accordingly, various embodiments provide a plurality of sign language audio tables or sent audio tables having different loudness values or tone values or noise cancellation values or bandwidth extension information, The user can selectively set an audio table corresponding to the transmission path. In addition, various embodiments can analyze the surrounding environment during a call to determine whether or not there is noise, and to cause the volume or tone of the sign language audio signal to be appropriately adjusted and output in the presence of noise. Noise can be removed from the transmitted audio signal in the presence of noise, or the volume or tone of the transmitted audio signal can be appropriately adjusted.

2, the audio module 280 may include a communication module 220, or a camera module 291, or an input device 250, or a sensor module 240, or an interface (not shown) via various audio output devices, such as a speaker 282, an earphone 286, It is possible to output sound corresponding to various signals (e.g., a wireless signal, a broadcast signal, a digital audio file, a digital movie file, or a picture) Accordingly, there may be a plurality of hydration paths connecting the audio module 280 and the respective audio output devices.

The audio module 280 may also process sounds input through various audio input devices, e.g., a receiver 284, a microphone 288, an ear microphone, and the like. Accordingly, there can be a plurality of transmission paths connecting the audio module 280 and each audio input device.

The audio module 280 converts an analog audio signal input through a transmission path set in an active transmission path among a plurality of transmission paths into a digital audio signal, encodes the digital audio signal into a compressed audio signal, and outputs the compressed audio signal to the application processor 210.

The active transmission path is an audio transmission path connected to an audio input device designated by a device used for communication among a plurality of audio input devices such as a receiver 284, a microphone 288, and an ear microphone. For example, if the jack of the electronic device 200 is followed by a jack of the microphone, the active transmission path will be the transmission path connecting the audio module 280 and the jack connector. As another example, if the electronic device 200 and the ear microphone are connected via Bluetooth communication, the active transmission path will be a transmission path connecting the audio module 280 and the BT module 223. As another example, if no external device such as a microphone is connected to the electronic device 200, then the active transmission path will be the transmission path connecting the microphone 288 and the audio module 280.

The audio module 280 may decode a compressed audio signal input from the application processor 210, convert the digital audio signal into a digital audio signal, convert the digital audio signal into an analog audio signal, and output the converted audio signal through an audio output device such as a speaker 282. At this time, the audio module 280 allows the analog audio signal to be applied to the active signal path.

The active hydration path is an audio hydration path connected to an audio output apparatus that is set to output an audio signal among a plurality of audio output apparatuses. For example, if the jack connector has an earphone or ear jack jack inserted therein, then the active hand-over path will be the salvage path connecting the audio module 280 and the jack connector. As another example, if the speaker phone mode is set in the electronic device 200, even if the jack connector of the earphone is inserted into the jack connector, the active signal path will be a signal path connecting the audio module 280 and the speaker.

The audio module 280 may store a plurality of audio tables, according to an embodiment. The audio table may include a base call audio table and at least one high quality call audio table. In addition, the audio table can be divided into a sign language audio table and a speech audio table. Wherein the sign language audio table is an audio table that can be applied to the sign language path, at least one audio table among the plurality of sign language audio tables is a basic sign language audio table, and at least one audio table is a high quality sign language audio table. Wherein the at least one audio table is a basic transmitted audio table and the at least one audio table is a high quality audio table. Each audio table is a tabulation of at least one or a combination of at least one of a volume value, a tone value, a noise cancellation value, or bandwidth extension information for a received audio signal or a transmitted audio signal.

The audio module 280 may enable the user to selectively set an audio table corresponding to each mating path or each mating path. The audio module 280 analyzes the surrounding environment during the call to determine whether or not there is noise, and selects an appropriate audio table among a plurality of audio tables according to the noise to apply the audio table to the sign language path or the sound path to record The audio table can be applied.

4 is a diagram illustrating a configuration of an audio module 280 according to various embodiments. 2, the audio module 280 may include an audio table selection unit 410, a sign language audio adjustment unit 420, a signal analysis unit 430, an environment analysis unit 440, a transmission audio adjustment unit 450, a decoder 460, an encoder 470, and a codec 480 .

Each component of the audio module 280 may be implemented as a hardware module or a software module. And the audio module 280 may be a separate circuit or IC. Or some or all of audio module 280 may be included in a communication circuit or communication IC (e.g., communication module 220) or application processor 210.

For example, the audio table selection application unit 410 is included in the application processor 210, and the sign language audio adjustment unit 420, the signal analysis unit 430, the environment analysis unit 440, the transmission audio adjustment unit 450, the decoder 460, the encoder 470, As shown in FIG. The audio analyzing unit 430, the environment analyzing unit 440, the sign language audio adjusting unit 420, and the sending audio adjusting unit 450 are included in the application processor 210, and the decoder 460, the encoder 470, and the codec 480 are included in the audio module 280 Lt; / RTI > In this case, the audio module 280 may operate under the control of the application processor 210.

The codec 480 may convert the analog audio signal input from the audio input device 495 into a digital audio signal and output the converted digital audio signal to the transmission audio adjusting unit 450. Then, the decoder 460 converts the digital audio signal input through the sign language audio adjusting unit 420 into an analog audio signal, and outputs the analog audio signal to the audio output device 490. The audio input device 495 may be, for example, either a microphone 288 or an ear microphone. The audio output device 490 may be, for example, a speaker 282, a receiver 284, an earphone 286, or an ear microphone.

The encoder 470 encodes the digital audio signal input from the audio-audio adjusting unit 450 into a compressed signal and outputs the encoded signal to the application processor 210.

The decoder 460 may decode the compressed audio signal input from the application processor 210 into a digital audio signal and output the decoded audio signal to the sign language audio adjustment unit 420.

The audio table selection application unit 410 stores a plurality of audio tables according to an embodiment and selects an audio table to be applied to the corresponding sign language path and the speech path in accordance with the audio mode set for each sign language path and each speech path, And the selected audio table to be applied to the transmitted audio signal. According to another embodiment, the plurality of audio tables may be stored in the memory 230, and the audio table selection application 410 may be included in the application processor 210.

Audio mode can be divided into general mode and custom mode. The normal mode may be a mode in which the default call audio table is applied to each sign language and speech path as a default mode. The custom mode may be a mode in which a high-quality call audio table is applied to each sign language and a speech path, or an audio table selected according to a noise environment around the electronic device 200 is applied. The audio mode may be set differently for the sign language and the speech language.

The custom mode may include at least one of a user selection mode, a noise detection mode, and an environment analysis mode according to an embodiment. The user selection mode may be a mode in which a high-quality call audio table is applied instead of a basic call audio table, depending on the user's selection. The noise detection mode may be a mode in which the audio table is selected and applied according to the noise included in the audio signal that has been captured through the audio input device 495. The environment analysis mode may be a mode in which the environment of the electronic device 200 is analyzed and the audio table is selected and applied according to the result.

The audio table is a table of at least one or a combination of at least one of a volume value, a tone value, a noise cancellation value, or bandwidth extension information for a sign language audio signal or a transmission audio signal. The audio table applied to the sign language path in the audio table may be referred to as a sign language audio table, and the audio table applied to the send path may be referred to as a spoken audio table. The audio table may include a base call audio table and at least one high quality call audio table.

The volume value is the overall volume magnitude of the audio signal, which can be expressed in decibels.

The tone color value is a value representing the tone color of the audio signal and may be expressed by a volume change value corresponding to each of a plurality of frequency sections included in the entire frequency band corresponding to the audio signal. For example, a decrease value for lowering the volume value is set for the first frequency section of 400 Hz or less, and a change value is not set for the second frequency section of 400 Hz to 1 KHz so that the original volume value can be maintained , And an increase value for increasing the volume value may be set for the third frequency section of 1 kHz or more. By lowering the volume value of the low frequency band and increasing the volume value of the high frequency band in this way, the clarity of the audio signal can be enhanced.

The bandwidth extension information may be information requesting to expand and process the bandwidth of the sign language audio signal to WideBand. In general, NarrowBa of 300-3,400 KHz, for example, may be used as the audio bandwidth for voice processing in a call. If the audio bandwidth is changed to a wide band (for example, 50-8,000 Hz or 50-1,600 Hz) wider than NarrowBa, it is possible to provide a high-quality voice call service.

The bandwidth extension information may additionally include a bandwidth extension parameter. The bandwidth extension parameter may be a parameter used to extend the sign language audio signal. The bandwidth extension parameter may include at least one of, for example, s_bandwidth, s_gain, s_eqtilt, s_silencef, s_envd, and options.

s_bandwidth may be the frequency range over which the bandwidth to be extended is generated. s_gain may be a gain for the extended bandwidth. s_eqtilt may be the frequency slope (lower toward the high band) for the extended bandwidth. s_silencef may be a noise gate value. s_envd can be a spectral dynamic adjustment (spectral peak and valley adjustment) value of the extended bandwidth. Options can be LPF filter values.

The noise removal value may be a volume change value for each frequency band for removing the noise included in the transmitted audio signal.

According to the embodiment, the sign language audio table can be classified into a basic sign language audio table and a high quality sign language audio table. The basic hydration audio table is an audio table set by default corresponding to each of a plurality of hydration paths when the audio mode is the normal mode, and may include a volume value for each volume level. Examples thereof are shown in Table 2.

Volume level Volume value max V _n max-1 V _{n -1} ... ... max-n-1 V ₂ max-n V ₁

In Table 2, max indicates a maximum volume level, max-n indicates a minimum volume level, and V ₁ through V _n indicate volume values at respective volume levels.

The high-quality sign language audio table can be an audio table that can be set by the user selectively for each sign language path, or can be selected as needed in the noise detection mode or environment analysis mode. The high-quality sign language audio table may include at least one of a different loudness value, tone value, or bandwidth extension information from the basic sign language audio table. Examples of such a high-quality-sounding audio table are shown in Tables 3 to 7.

Volume level Volume value max V _n + a max-1 V _{n -1} + a ... ... max-n-1 V ₂ + a max-n V ₁ + a

Table 3 shows a constant volume change sign language audio table in which an additional loudness value a of a certain size is added to the level value of each level of the basic sign language audio table.

Volume level Volume value max V _n + a _n max-1 V _{n -1} + a _{n -1} ... ... max-n-1 V ₂ + a ₂ max-n V ₁ + a ₁

Table 4 is an individual volume change sign language audio table, in which an additional volume value having a different size for each level, that is, an additional volume value a ₁ to an additional volume value a _n-1, is added to the level value for each level of the basic hydrated audio table .

Volume level Volume value Tone value max V _n b max-1 V _{n -1} b ... ... ... max-n-1 V ₂ b max-n V ₁ b

Table 5 is a tone color changing sign language audio table, which shows the tone level value for each level of the basic hydration audio table and the tone value b added for each level. The tone color value b may include, for example, a decrement value for lowering the volume value for a frequency band of 400 Hz or less and an increment value for increasing the volume value for the third frequency band of 1 kHz or more.

Volume level Volume value Tone value max V _n b _n max-1 V _{n -1} b _{n -1} ... ... ... max-n-1 V ₂ b ₂ max-n V ₁ b ₁

Table 6 shows the individual tone color changing sign language audio tables, which represent the tone level values of the basic hydration audio table and the tone color values b ₁ to b _n added to each level.

Volume level Volume value Tone value max V _n + a b max-1 V _{n -1} + a b ... ... ... max-n-1 V ₁ + a b max-n 0 0

Table 7 shows that the tone color value b is added to the sign language audio table of Table 3, which is a fixed loudness / constant tone color changing loudness audio table.

Volume level Volume value Tone value max V _n + a _n b _n max-1 V _{n -1} + a _{n -1} b _{n -1} ... ... ... max-n-1 V ₁ + a ₁ b ₂ max-n 0 b ₁

Table 8 shows that the tone color values b ₁ to b _n are added to the sign language audio table of Table 4 according to the level.

Volume level Volume value Tone value Bandwidth extension information max V _n + a _n b _n c max-1 V _{n -1} + a _{n -1} b _{n -1} c ... ... ... c max-n-1 V ₁ + a ₁ b ₂ c max-n 0 b ₁ c

Table 9 shows that the bandwidth extension information c is added to the sign language audio table of Table 8 as the individual sound volume / individual tone color / bandwidth extended sign language audio table.

According to the embodiment, the transmission audio table can be classified into a basic transmission audio table and a high-quality transmission audio table. The basic transmission audio table is an audio table set as a default in correspondence with each of a plurality of transmission paths when the audio mode is the normal mode, and may include a basic loudness value. Examples thereof are shown in Table 10.

Volume level Volume value Fixed e

Table 10 above assumes that the speech audio is fixed at one volume level. In Table 10, e represents a basic volume value. According to another embodiment, the transmission audio may also have a plurality of volume levels, and a basic volume value per level may be specified.

The high-quality sounding audio table may be an audio table that can be set by the user for each of the hydration paths, or may be selected as needed in the noise detection mode or environment analysis mode. The high-quality sounding audio table may include at least one of a loudness value or a tone value or a noise-removed value different from the basic sentence audio table. Examples of such a high-quality sounding audio table are shown in Tables 11 to 16.

Volume level Volume value Fixed e + f

Table 11 shows that the additional sound volume value f is added to the basic sound volume value e as the sound volume changing sounding audio table.

Volume level Volume value Tone value Fixed e g

Table 12 shows the basic tone volume value e and tone color value g as the tone color changing tone audio table. The tone value g may include, for example, a decrement value for lowering the volume value for a frequency band of 400 Hz or lower, and an increment value for increasing the volume value for the third frequency band higher than 1 kHz.

Volume level Volume value Noise canceling value Fixed e h

Table 13 is a noise canceling audio table, which shows a basic loudness value e and a noise removal value h. The noise removal value h may be a volume change value for each frequency band for removing the noise included in the transmitted audio signal.

Volume level Volume value Noise canceling value Fixed e + f h

Table 14 shows the noise reduction / volume change transmission audio table, in which the additional loudness value f is added to the basic loudness value e and the noise removal value h.

Volume level Volume value Tone value Noise canceling value Fixed e g h

Table 15 shows the basic tone volume value e, the tone color value g, and the noise removal value h as the noise reduction / tone color changing tone audio table.

Volume level Volume value Tone value Noise canceling value Fixed e + f g h

Table 16 shows the basic volume value e, the tone color value g, and the noise removal value h as the noise reduction / volume and tone color changing tone audio table.

The audio table selection application unit 410 may provide a user interface for setting the audio mode by the user so that the user can set either the basic mode or the custom mode to the audio mode. When setting the custom mode, either one of the custom mode types can be set automatically, or the user can specify a specific mode type.

According to an embodiment, the electronic device 200 may support only one of the plurality of custom mode types described above, i.e., a user selected mode, a noise detection mode, and an environment analysis mode. In this case, the audio table selection application unit 410 can automatically set the supported custom mode type according to the user's custom mode setting request.

According to another embodiment, when the electronic device 200 supports a plurality of custom mode types, the audio table selection application 410 may display an audio mode setting interface in response to a user's audio mode change request. If the user selects the basic mode, either the basic mode or the custom mode, the basic call audio table can be set for each of the sign language and the speech language of the electronic device 200. [ When the user selects the custom mode, the audio table selection application 410 displays the custom mode type list, and the user can select and set a desired one of the custom mode types.

When there is a setting request for the user selection mode among the custom mode types, the audio table selection application unit 410 receives a list of the sign language path table, a plurality of sign language audio table lists corresponding to each sign language path, a sending path list, and a plurality It is possible to display a list of audio-visualized audio tables. The user can designate an audio table for each sign language and each speech path.

As another example, if there is a setting request for the user-selected mode among the custom mode types, a predetermined high-quality call audio table may be set for each of the sign language and the transmission channel.

As another example, whenever a request to change an audio table is input from a user during a call, one of a plurality of high-quality call audio tables is arbitrarily selected, and a high-quality call audio table selected in the active salivation path and the active call path may be applied. At this time, a plurality of high-quality voice call audio tables may be selected at random each time an audio table change button is input, or may be selected in a manner of being rotated in a predetermined order. When selected in the order of rotation, the base call audio table may be selected when selection is made for all high-quality call audio tables.

As another example, if an audio mode change request is input from the user during a call, the currently set audio mode may be changed. If the currently set mode is the basic mode, the mode is changed to the custom mode, and if the currently set mode is the custom mode, the mode can be changed to the basic mode.

The sign language audio adjusting unit 420 may adjust the volume, tone or bandwidth of the digital audio signal input from the decoder 460 under the control of the audio table selecting and applying unit 410, and output the codeword to the codec 480. Accordingly, the sign language audio adjusting unit 420 may include a volume adjusting unit 421, a tone color adjusting unit 422, and a bandwidth adjusting unit 423.

The audio table selection application unit 410 can set the volume value to the volume adjusting unit 421 by referring to the sign language audio table and the volume adjusting unit 421 can adjust the volume of the entire digital audio signal according to the set volume value.

The audio table selection application unit 410 can set a tone color value to the tone color adjustment unit 422 by referring to the sign language audio table, and the tone color adjustment unit 422 can adjust the volume of the digital audio signal according to the set tone color value.

In addition, if the audio extension table includes bandwidth extension information, the audio table selection application unit 410 may request the bandwidth adjustment unit 423 to expand the received audio signal to a wide band, and set the bandwidth adjustment unit 423 to the bandwidth adjustment unit 423 , The bandwidth adjuster 422 may apply a wide bandwidth to the bandwidth of the digital audio signal upon request.

The frequency response is shown in FIG. 8 when the volume, tone color, or bandwidth is changed for the sign language audio signal. 8 (a) shows a signal form of the basic speech signal and a frequency response 910, (b) shows a signal form and a frequency response 920 when the volume of the basic speech signal is changed, and Shows the frequency response 930 when the volume and tone of the basic voice signal are changed, and (d) shows the frequency response 940 when the bandwidth of the basic voice signal is changed.

According to the control of the audio table selecting and applying unit 410, the audio-audio adjusting unit 450 removes noise from the digital audio signal input from the codec 480, adjusts the volume or tone, and outputs the digital audio signal to the encoder 470. Accordingly, the transmission audio adjusting unit 450 may include a noise removing unit 451, a volume adjusting unit 452, and a tone color adjusting unit 453.

The audio table selection application unit 410 can set the noise removal value to the noise removal unit 451 by referring to the transmission audio table and the noise removal unit 451 can remove the noise from the digital audio signal according to the set noise removal value .

The audio table selection application unit 410 can set the volume value to the volume adjusting unit 452 by referring to the audio transmission audio table and the volume adjusting unit 452 can adjust the volume of the entire digital audio signal according to the set volume value.

The audio table selection application unit 410 can set the tone color value to the tone color adjustment unit 453 and adjust the volume of the digital audio signal according to the set tone color value by referring to the audio transmission audio table.

The frequency response is shown in Fig. 9 when the transmitted audio signal is adjusted as described above. 9 (a) shows the signal form of the basic speech signal and the frequency response 1010, (b) shows the signal form and the frequency response 1020 when the noise is removed from the basic speech signal, and ) Shows the signal form and the frequency response 1030 when the noise is removed from the basic speech signal and the volume is changed. (d) shows a signal form and a frequency response 1040 when the noise is removed from the basic speech signal and the tone color is changed.

The signal analyzer 430 analyzes the audio signal that has been captured through the audio input device 495 under the control of the audio table selection and application unit 410 to determine the degree of noise generation according to the surrounding environment of the electronic device 200. Accordingly, the signal analyzer 430 can analyze the digital audio signal output from the codec 480 to distinguish between voice and noise, and analyze the volume and frequency components of the noise in the presence of noise. Various techniques can be used to distinguish between voice and noise, for example, voice activity detection (VAD) technology can be used. The signal analysis unit 430 may output the noise detection information to the audio table selection application unit 410. The noise detection information includes information on whether noise is present and the detected noise. When noise is present, the noise detection information may include information on the frequency of the noise and the volume of the noise corresponding to the frequency band.

The environment analyzer 440 can determine the presence or absence of noise by acquiring the current position or the surrounding image of the electronic device 200 under the control of the audio table selection application unit 410. In other words, the environment analyzer 440 can obtain positional information of the electronic device 200 in cooperation with the GPS module 227, and determine the presence or absence of noise and the type of noise according to the position of the electronic device 200. For example, when the current position of the electronic device 200 is a specific road, it is determined that there is noise due to an automobile. Or if the current position of the electronic device 200 is a certain cafe, it can be determined that noise due to conversation of people exists.

In addition, the environment analyzing unit 440 may interrogate the camera module 291 to acquire an image of the surroundings, and analyze the presence of the image to determine whether or not there is noise. For example, if the face recognition is performed on the peripheral image and it is confirmed that a certain number or more of people are included, it can be determined that noise due to conversation of people exists. Alternatively, if cars are included in the surrounding image, it can be determined that there is noise due to the automobile.

The environment analyzer 440 can determine whether or not there is noise based on at least one of the position information and the surrounding image, and output the environment information including the result to the audio table selecting and applying unit 410.

If the noise detection mode is set, the audio table selection application unit 410 can activate the signal analysis unit 430 to obtain noise detection information. Then, an appropriate audio table may be selected in accordance with the noise detection information, and a loudness value or a tone color value included in the selected audio table may be set in the loudness adjusting unit 420.

For example, if the noise detection information includes a noise component, the audio table selection application unit 410 may select a basic hydrated audio table and a basic transmitted audio table, and set the corresponding volume value in the audio adjustment unit 420.

In another example, if the noise detection information includes the frequency band for the noise and the corresponding volume value, the audio table selection application unit 410 divides the noise frequency band corresponding to the noise into a plurality of frequency intervals, Each noise level can be compared with a reference value. As a result, if there is a noise volume larger than the reference value, the audio table selection application unit 410 can select an audio table in which the volume or tone of the received audio signal and the transmitted audio signal can be changed. Alternatively, the audio table selection application unit 410 may select an audio table capable of extending the bandwidth of the audio signal to a wide bandwidth. Or an audio table capable of removing noise from the transmitted audio signal can be selected.

For example, if the noise frequency band is divided into two frequency bands, the volume values of the two frequency bands are compared with the reference value, and if they are all below the reference value, the audio table selection application unit 410 applies the basic hydrated audio table, The user can select a table and set the corresponding volume value to the sign language audio adjusting unit 420 and the sending voice adjusting unit 480.

The reference value is a reference value for judging the degree of harm of the noise. In other words, even if noise exists in the surroundings, noise of a volume lower than the reference value does not cause inconvenience in conversation, so that no further adjustment is required based on the base call audio table.

However, if the noise volume of some of the entire frequency bands is equal to or higher than the reference value, it is determined that the harmful noise is present, and thus the volume value of the sign language audio signal can be changed to a value larger than the volume value set in the basic sign language audio table, Or a sign language audio table capable of expanding the bandwidth can be selected. The transmission audio table having a volume value larger than the volume value set in the basic transmission audio table or the transmission audio table capable of changing the tone or the transmission audio table in which the noise elimination value is set can be selected.

If the environment analysis mode is set, the audio table selection application unit 410 can activate the environment analysis unit 440 to acquire environment information. If the environment information indicates a noisy environment, the audio table selection applying unit 410 may be configured as a sign language audio table capable of changing the loudness value of the sign language audio signal to a width larger than the loudness value set in the basic sign language audio table, You can choose a sign language audio table that can extend the bandwidth.

FIG. 5 illustrates a process in which the audio table selection and application unit 410 provides a call service according to the audio mode set in the electronic device 200 according to the embodiment. 5 is a diagram illustrating an audio processing procedure when a call service is provided according to an exemplary embodiment of the present invention.

Referring to FIG. 5, when a call is started, the audio table selection and application unit 410 can confirm an active signal path and an active speech path in operation 601. The audio table selection application unit 410 can confirm whether the custom mode is set in correspondence with the hydration path and the transmission path confirmed in operation 603. [ If the custom mode is not set, that is, if the normal mode is set, the audio table selection application unit 410 proceeds to operation 605 to apply the basic call audio table to the corresponding sign language and transmission channel.

On the other hand, if the custom mode is set corresponding to the sign language and speech path identified in step 601, the audio table selection application unit 410 may proceed to step 607 and apply the corresponding audio table among the plurality of audio tables. The detailed procedure of step 607 will be described with reference to FIG. 6 and FIG. FIG. 6 is a diagram illustrating a process of processing a sign language audio signal in the custom mode according to various embodiments, and FIG. 7 is a diagram illustrating a process of processing a transmitted audio signal in the custom mode according to various embodiments.

Referring to FIG. 6, the audio table selection application unit 410 can confirm the custom mode type in operation 701. As a result, if the custom mode type is the noise detection mode, the operation 703 can be performed. In operation 703, the audio table selection application unit 410 detects noise from a signal input through a microphone, and proceeds to operation 705 to check whether noise is included. If it is determined that the noise is included, the audio table selection application unit 410 proceeds to operation 707 to compare the volume of the noise with the reference value. If the noise volume for the entire frequency band constituting the noise is below the reference value, the audio table selection application unit 410 proceeds to operation 711 to select the basic hydration audio table and set it in the hydration audio adjustment unit 420.

The audio table selection application unit 410 selects an audio table for changing at least one of the bandwidth, the volume, and the tone color in the operation 709 if the volume is even larger than the reference value even for some of the entire frequency bands constituting the noise, can do. For example, either a sign language audio table that can be changed to a larger width than the volume value set in the basic sign language audio table, a high-quality sign language audio table that can change the tone, or a high-quality sign language audio table that can expand the bandwidth can be selected have.

10 is a diagram showing various noise signals that can be detected according to an embodiment and examples of adjustment thereof. 10 shows a first noise 1110 that may occur in a car or a second noise 1120 that may occur in the street or a third noise 1130 that may occur in a crowded area such as a shopping mall, The frequency band constituting the noise is divided into three frequency bands represented by f1, f2 and f3, and an appropriate audio table is selected in accordance with the noise level of each frequency band.

If all of the frequency bands of the noise signals 1110, 1120, and 1130 are less than or equal to the reference value, the base call audio table can be selected. However, if only the noise volume of the frequency section f1 is larger than the reference value, the tone color changing sign language audio table capable of changing the tone color can be selected. When only the noise volume of the frequency section f2 is larger than the reference value, a volume changeable audio table capable of changing the volume value of the audio signal to a volume larger than the volume value set in the basic audio signal table can be selected. In other cases, the volume and tone and bandwidth change sign language audio tables may be selected.

In this manner, when noise is detected, a clear audio signal can be output by appropriately adjusting the volume value and the tone value for the audio signal.

Returning to FIG. 6, if it is determined that the custom mode type is the environment analysis mode in operation 701, the audio table selection application unit 410 can analyze the environment using the location information of the electronic device 200 and the surrounding image in operation 713. As a result of the analysis, if it is determined that the noise is included in the operation 715, the audio table for changing at least one of the bandwidth, the volume, and the tone may be selected in the operation 709 and applied to the sign language audio adjustment unit 420. For example, either a sign language audio table that can be changed to a larger width than the volume value set in the basic sign language audio table, a sign language audio table that can change the tone, or a sign language audio table that can extend the bandwidth can be selected.

If it is determined that no noise is included, the base call audio table may be selected in operation 711 and applied to the sign language audio adjustment unit 420.

If it is determined that the custom mode type is the user selection mode in operation 701, the audio table selection application unit 410 supplies the sign language audio adjustment unit 420 with a volume value, a tone value, or the like in accordance with the customized sign language audio table corresponding to the sign language in operation 719 And at least one of the bandwidth change can be set.

Next, referring to FIG. 7, a process of processing the transmitted audio signal in the custom mode will be described.

Referring to FIG. 7, the audio table selection application unit 410 can confirm the custom mode type in the operation 801. As a result of checking, if the custom mode type is the noise detection mode, operation 803 can be performed. In operation 803, the audio table selection application unit 410 detects noise from a signal input through a microphone, and proceeds to operation 805 to check whether noise is included. If it is determined that the noise is included, the audio table selection application unit 410 proceeds to operation 807 to compare the noise level with the reference value. If the noise volume for the entire frequency band constituting the noise is below the reference value, the audio table selection application unit 410 may proceed to operation 811 to select the basic transmission audio table and set it in the transmission audio adjustment unit 450.

The audio table selection application unit 410 selects an audio table in which a noise removal value is set in the operation 809 or at least one of the volume or the tone is changed in a case where the volume is greater than a reference value even in some of the entire frequency bands constituting the noise, It can be applied to the transmission audio adjusting unit 450. For example, a high-quality sound transmission audio table having a volume value larger than the volume value set in the basic transmission audio table or a high-quality sound transmission audio table in which the tone color can be changed or a high-quality sound transmission audio table in which the noise removal value is set can be selected.

For example, referring to FIG. 10, when the entire frequency bands of the noise signals 1110, 1120, and 1130 are all below the reference value, the basic transmitted audio table can be selected. However, if only the noise volume of the frequency section f1 is larger than the reference value, the tone color changing transmission audio table capable of changing the tone color can be selected. When only the noise volume of the frequency section f2 is larger than the reference value, a volume change transmission audio table capable of changing the volume value of the transmission audio signal to a volume larger than the volume value set in the basic transmission audio table can be selected. If only the noise volume of the frequency section f3 is larger than the reference value, the volume value of the transmitted audio signal can be changed to a value larger than the volume value set in the basic transmission audio table, and the noise removal value for the transmitted audio signal can be removed And a volume change transmission audio table may be selected.

In other cases than the above case, the noise volume change and tone color change and noise cancellation sign language audio tables may be selected.

In this manner, when noises are detected, noise is removed from the audio signal, or the volume value and the tone value are appropriately adjusted, thereby making it possible to transmit a clear audio signal.

Referring back to FIG. 7, if it is determined that the custom mode type is the environment analysis mode in operation 801, the audio table selection application unit 410 can analyze the environment using the location information of the electronic device 200 and the surrounding image in operation 813. As a result of the analysis, if it is determined that the noise is included in the operation 815, it is possible to select the audio table in which the noise removal value is set in the operation 809, or at least one of the volume or the tone is changed, have. If it is determined that noise is not included, the base transmission audio table may be selected in operation 811 and applied to the transmission audio adjustment unit 450. For example, a transmission audio table having a volume value larger than the volume value set in the basic transmission audio table, a transmission audio table capable of changing the tone, or a transmission audio table in which the noise elimination value is set can be selected.

If it is determined that the custom mode type is the user selection mode in operation 801, the audio table selection application unit 410 supplies the voice value, the tone value, and the noise to the sending audio adjusting unit 450 according to the high- And the removal value.

According to the procedure shown in FIGS. 6 and 7, an appropriate audio table can be set for the hydration path and the transmission path.

Meanwhile, during the call, a change request of the audio table may be input from the user. Such a user's request may occur, for example, as a specific key button provided on the electronic device 200 is pressed, or by a touch input of the touch screen. Or path switching may occur. The switching of the route may occur, for example, when the user proceeds the call using the ear microphone and then switches the call mode to the speakerphone.

The operation of the audio table selection application unit 410 in this case will be described with reference to FIG.

After the audio table setting is completed in the hydration path and the transmission path according to the operation 605 or 607 in FIG. 5, in operation 609, the audio table selection application 410 can confirm whether a path switching occurs. When the path switching occurs, the audio table selection application unit 410 may repeat the operations 601 to 607 described above.

If no path switching occurs, the audio table selection applying unit 410 can confirm whether an audio table change request is input from the user in operation 611. [ If an audio table change request is input from the user in operation 611, the audio table selection application unit 410 may set an audio table other than the audio table currently set in the sign language path and the speech path in the operation 613. For example, the audio table selection application unit 410 may randomly select any one of a plurality of input audio tables among the plurality of input audio tables except the input audio tables set in the current receiving path. Alternatively, the remaining sign language audio tables may be selected in such a manner that they are rotated in a predetermined order. The audio table selection application unit 410 may also select the audio audio table. That is, any one of the transmission audio tables among the transmission audio tables except for the transmission audio table set in the current transmission path in the plurality of transmission audio tables can be selected at random. Alternatively, the remaining transmission audio tables may be selected in such a manner that they are rotated in a predetermined order.

The audio table selection application unit 410 may repeat the operations 601 to 613 until the end of the call is confirmed in the operation 615. [

As described above, the present invention provides a plurality of audio tables so that the user can selectively set audio tables corresponding to the respective audio signal paths and transmission paths provided in the portable communication apparatus. Further, the present invention analyzes the surrounding environment during a call to determine whether or not there is noise, and thereby enables the volume or tone of the audio signal to be appropriately adjusted to be output and transmitted.

Accordingly, the present invention can provide an optimal call state in various call environments.

While the present invention has been described in connection with what is presently considered to be practical exemplary embodiments, it is to be understood that the invention is not limited to the disclosed embodiments. Therefore, the scope of the present invention should not be limited by the described embodiments but should be determined by the equivalents of the claims and the claims.

Claims (22)

In an electronic device,
At least one audio signal output device,
An audio module for applying an audio table to at least one audio signal output to the at least one audio signal output device,
A processor for modifying an audio table applied to the at least one audio signal in response to a change request of an audio table and controlling the audio module to expand the bandwidth of the at least one audio signal,
Wherein the electronic device includes a plurality of audio tables, wherein the plurality of audio tables include a basic call audio table and at least one high-quality call audio table, wherein the level value for each level of the high- Is different from the level value for each level of the electronic device. The electronic device of claim 1, wherein the high-quality call audio table includes a bandwidth extension parameter. 3. The apparatus of claim 2, further comprising at least one audio signal input device,
Wherein the processor changes the audio table to be applied to the audio signal input from the at least one audio signal input device in response to the audio table change request. 4. The electronic device according to claim 3, wherein the volume value of the high-quality voice call audio table corresponding to each volume level is obtained by adding an additional volume value to the volume value of the base call audio table. The electronic device according to claim 3, wherein the high-quality call audio table includes a volume value and a tone value corresponding to each volume level, and the tone value is information on a volume of a specific frequency band. 4. The electronic device of claim 3, wherein the high-quality voice call audio table associated with the audio input device of the high-quality voice call audio table includes a noise cancellation value. The method of claim 3,
Further comprising: a signal analyzer for detecting noise due to the surrounding environment,
Wherein the processor analyzes the noise by controlling the signal analyzer according to the surrounding environment when the audio mode is the noise detection mode and analyzes the noise by using the at least one audio signal input device Wherein the high-quality call audio table includes a value for changing at least one of a noise, a tone color, and a volume of an input audio signal to be applied to the input audio signal. 8. The apparatus of claim 7, wherein the processor comprises: a high-quality voice call audio table for changing a bandwidth of the audio signal output through the at least one audio signal output device in response to the noise analysis result; To select one of the high-quality voice call audio tables including the value for changing the audio signal to be applied to the output audio signal. 4. The apparatus of claim 3, wherein, if the audio mode is the environmental analysis mode, the processor checks whether or not there is noise based on the position information of the electronic device and the peripheral image photographed by the electronic device, A high-quality call audio table including a value for changing at least one of a noise, a tone color, and a volume of an audio signal input through at least one audio signal input device is selected and applied to the input audio signal. Lt; / RTI > The apparatus of claim 9, wherein the processor is further configured to, if it is determined that the noise exists, to change a bandwidth of the audio signal output through the at least one audio signal output apparatus, And selects a high-quality voice call audio table including a value for changing one of the plurality of voice call audio tables to be applied to the output audio signal. 4. The electronic device of claim 3, wherein the processor applies a designated high-quality call audio table if the audio output mode is a user selection mode. A method of processing an audio signal of an electronic device,
Applying an audio table to at least one audio signal output to at least one audio signal output device;
Receiving an audio table change request;
Modifying an audio table to be applied to the at least one audio signal in response to the change request, and extending a bandwidth of the at least one audio signal;
Wherein the electronic device includes a plurality of audio tables, wherein the plurality of audio tables include a basic call audio table and at least one high-quality call audio table, wherein the level value for each level of the high- Is different from a level value for each level of the audio signal. 13. The method of claim 12, wherein the high-quality voice call audio table includes a bandwidth extension parameter. 14. The method of claim 13, wherein changing the audio table comprises:
Further comprising changing an audio table to be applied to an audio signal input from at least one audio signal input device in response to the audio table change request. 15. The method of claim 14, wherein the volume value of the high-quality call audio table corresponding to each volume level is added to a volume value of the base call audio table. 15. The audio signal processing method according to claim 14, wherein the high-quality voice call audio table includes a volume value and a tone value corresponding to each volume level, and the tone value is information on a volume of a specific frequency band. 15. The method of claim 14, wherein the high-quality voice call audio table associated with the audio signal input device of the high-quality voice call audio table includes a noise cancellation value. 15. The method of claim 14, wherein the applying the audio table comprises:
Detecting noise due to the surrounding environment when the audio mode is the noise detection mode;
Analyzing the noise;
Selecting and applying a high-quality voice call audio table including a value for changing at least one of a noise, a tone color, or a volume of an audio signal input through the at least one audio input device, in response to the noise analysis result, Further comprising the steps of: 19. The method of claim 18, wherein the step of applying the audio table comprises:
A high-quality voice call audio table for changing the bandwidth of the audio signal output through the at least one audio signal output device in response to the noise analysis result, or a value for changing at least one of tone color or loudness And selecting and applying one of the high-quality voice call audio tables to the high-quality voice call audio table. 15. The method of claim 14, wherein the applying the audio table comprises:
If the audio mode is the environmental analysis mode, checking whether there is a noise based on the position information of the electronic device and the peripheral image photographed by the electronic device;
If it is determined that the noise is present, a high-quality voice call audio table including a value for changing at least one of a noise, a tone color, and a volume of the audio signal input through the at least one audio signal input device is selected and applied The method comprising the steps of: The method of claim 20, wherein the step of applying the audio table comprises:
An audio table including bandwidth extension information for an audio signal output through the at least one audio signal output device, or a value for changing at least one of a tone color or a volume level if the noise is found to be present And selecting and applying one of the tables to the audio signal. 15. The method of claim 14, wherein the applying the audio table comprises:
And if the audio mode is the user selection mode, applying the specified high-quality voice call audio table.

Images