KR101949353B1 - Mobile terminal and operation method thereof - Google Patents

Abstract

A method of operating a mobile terminal according to the present invention includes: storing a preset call volume through a hearing test; Connecting a call with a counterpart terminal in response to a call origination request or a call reception request; Determining a user's call pattern at the time of the call connection; And detecting a call volume corresponding to the determined call pattern, and outputting a voice of the other party based on the detected call volume.

Description

[0001] MOBILE TERMINAL AND OPERATION METHOD THEREOF [0002]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a mobile terminal and an operation method thereof, and more particularly, to a mobile terminal providing a user-customized talk volume and an operation method thereof.

A mobile terminal is a portable device having one or more functions capable of carrying out voice and video communication, capable of inputting and outputting information, and storing data, while being portable. As the function of the mobile terminal has diversified, it has been equipped with complicated functions such as photographing, video shooting, playback of a music file or a video file, reception of a game, broadcasting, wireless Internet, multimedia player).

Meanwhile, with the increase in the use of multimedia devices, the number of hearing-impaired people is increasing year by year due to an increase in the elderly population and noise environment. Accordingly, the range of the audible range in which a user is able to listen to a voice call or a video call through the terminal becomes different from user to user.

However, the conventional terminal outputs the voice of the other party based on the volume of the previous call within a predetermined audible frequency range without considering the hearing difference of each user. Accordingly, the user is inconvenient to adjust the volume of the call through the operation of the volume key each time he / she is talking with a third party.

In addition, when the call volume is adjusted according to the change of the external noise environment during the call connection, the user is inconvenient to adjust the call volume of the other party through manipulation of the volume key. Therefore, there is a desperate need to provide a voice volume considering the hearing ability of the user and the noise level of the surroundings.

The present invention proposes a mobile terminal providing a user-customized call volume based on a hearing test and an operation method thereof.

In addition, the present invention proposes a mobile terminal providing a call volume optimized for a user when a call is made through a speaker and an operation method thereof.

In addition, the present invention proposes a mobile terminal that provides a call volume optimized for a user during an earphone (or headphone) communication and an operation method thereof.

In addition, the present invention proposes a mobile terminal providing a user-customized call volume considering the influence of detected noises when a noise of a threshold value or more is detected during communication with the other party, and an operation method thereof.

The method includes storing a preset call volume through a hearing test; Connecting a call with a counterpart terminal in response to a call origination request or a call reception request; Determining a user's call pattern at the time of the call connection; And detecting a call volume corresponding to the determined call pattern, and outputting a voice of the other party based on the detected call volume.

In addition, the present invention provides a speech recognition apparatus comprising: a memory for storing a preset call volume through a hearing test; A wireless communication unit for connecting a call with a counterpart terminal in response to a call origination request or a call reception request; And a control unit for determining a call pattern of the user at the time of the call connection, reading out a call volume corresponding to the determined call pattern from the memory, and outputting a voice of the other party based on the read call volume, Lt; / RTI >

According to an embodiment of the present invention, the mobile terminal detects which one of the ears of the user who listens to the call through the speaker is, and then outputs the other party's voice to the detected ear-optimized call volume. In addition, even when the user is listening to the call through the earphone rather than the speaker, the earphone can output the voice of the other party with the call volume optimized for the user. Accordingly, the user can listen to the call voice of the other party with the call volume optimized for his or her hearing according to the call type.

In addition, according to another embodiment of the present invention, when a noise of a threshold value or more is detected through a microphone during communication with the other party, it is possible to provide an optimal call volume compensated for the influence of the detected noise.

Meanwhile, various other effects will be directly or implicitly disclosed in the detailed description according to the embodiment of the present invention to be described later.

1 is a block diagram of a mobile terminal according to an embodiment of the present invention;
FIG. 2 is a perspective view of a mobile terminal according to an embodiment of the present invention; FIG.
FIG. 3 is a rear perspective view of the mobile terminal shown in FIG. 2; FIG.
4 is a block diagram of a hearing test module according to an embodiment of the present invention;
FIG. 5 is a flowchart illustrating an operation of a mobile terminal providing a user-customized call volume according to an embodiment of the present invention; FIG.
6 is a diagram illustrating a process of detecting a user's ear listening to a call through a motion sensor;
7 is a diagram illustrating a process of detecting an ear through which a user hears a call through a grip sensor;
8 to 10 are diagrams illustrating a process of presetting a user-customized call volume through operation of a setup menu according to an embodiment of the present invention;
FIG. 11 is a diagram illustrating a process of presetting a user-customized call volume at the first boot according to an embodiment of the present invention; FIG.

Hereinafter, the present invention will be described in detail with reference to the drawings.

Examples of the mobile terminal described in the present specification include a mobile phone, a smart phone, a notebook computer, a digital broadcasting terminal, a PDA (Personal Digital Assistants), a PMP (Portable Multimedia Player), a camera, tablet computers, e-book terminals, and the like. In addition, suffixes "module" and " part "for the components used in the following description are given merely for convenience of description, and do not give special significance or role in themselves. Accordingly, the terms "module" and "part" may be used interchangeably.

1 is a block diagram of a mobile terminal according to an embodiment of the present invention. Referring to FIG. 1, a mobile terminal according to an exemplary embodiment of the present invention will be described in terms of functional components.

1, a mobile terminal 100 includes a wireless communication unit 110, an audio / video (A / V) input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, A controller 160, an interface 170, a controller 180, and a power supply 190. When such components are implemented in practical applications, two or more components may be combined into one component, or one component may be divided into two or more components as necessary.

The wireless communication unit 110 may include a broadcast receiving module 111, a mobile communication module 113, a wireless Internet module 115, a short distance communication module 117, and a GPS module 119.

The broadcast receiving module 111 receives at least one of a broadcast signal and broadcast related information from an external broadcast management server through a broadcast channel. At this time, the broadcast channel may include a satellite channel, a terrestrial channel, and the like. The broadcast management server may refer to a server for generating and transmitting at least one of a broadcast signal and broadcast related information and a server for receiving at least one of the generated broadcast signal and broadcast related information and transmitting the broadcast signal to the terminal.

The broadcast signal may include a TV broadcast signal, a radio broadcast signal, a data broadcast signal, and a broadcast signal in which a data broadcast signal is combined with a TV broadcast signal or a radio broadcast signal. The broadcast-related information may mean information related to a broadcast channel, a broadcast program, or a broadcast service provider. The broadcast-related information can also be provided through a mobile communication network, in which case it can be received by the mobile communication module 113. Broadcast-related information can exist in various forms.

The broadcast receiving module 111 receives broadcast signals using various broadcasting systems. In particular, the broadcast receiving module 111 may be a Digital Multimedia Broadcasting-Terrestrial (DMB-T), a Digital Multimedia Broadcasting-Satellite (DMB-S) ), Digital Video Broadcast-Handheld (DVB-H), Integrated Services Digital Broadcast-Terrestrial (ISDB-T), and the like. In addition, the broadcast receiving module 111 may be configured to be suitable for all broadcasting systems that provide broadcasting signals, as well as the digital broadcasting system. The broadcast signal and / or broadcast related information received through the broadcast receiving module 111 may be stored in the memory 160.

The mobile communication module 113 transmits and receives a radio signal to at least one of a base station, an external terminal, and a server on a mobile communication network. Here, the wireless signal may include various types of data according to a voice call signal, a video call signal, or a text / multimedia message transmission / reception.

The wireless Internet module 115 is a module for wireless Internet access, and the wireless Internet module 115 can be built in or externally attached to the mobile terminal 100. WLAN (Wi-Fi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access) and the like can be used as wireless Internet technologies.

The short-range communication module 117 refers to a module for short-range communication. Bluetooth, radio frequency identification (RFID), infrared data association (IrDA), ultra wideband (UWB), ZigBee, and Near Field Communication (NFC) may be used as the short distance communication technology.

A GPS (Global Position System) module 119 receives position information from a plurality of GPS satellites.

The A / V (Audio / Video) input unit 120 is for inputting an audio signal or a video signal, and may include a camera 121 and a microphone 123. The camera 121 processes image frames such as still images or moving images obtained by the image sensor in the video communication mode or the photographing mode. Then, the processed image frame can be displayed on the display unit 151. [

The image frame processed by the camera 121 may be stored in the memory 160 or transmitted to the outside through the wireless communication unit 110. [ The camera 121 may be equipped with two or more cameras according to the configuration of the terminal.

The microphone 123 receives an external sound signal by a microphone in a communication mode, a recording mode, a voice recognition mode, or the like, and processes it as electrical voice data. The processed voice data can be converted into a form that can be transmitted to the mobile communication base station through the mobile communication module 113 and output when the voice data is in the call mode. The microphone 123 may be a variety of noise canceling algorithms for removing noise generated in receiving an external sound signal.

The user input unit 130 generates key input data that the user inputs to control the operation of the terminal. The user input unit 130 may include a key pad, a dome switch, and a touch pad (static / static) capable of receiving commands or information by a user's pressing or touching operation. The user input unit 130 may be a jog wheel for rotating the key, a jog type or a joystick, or a finger mouse. Particularly, when the touch pad has a mutual layer structure with the display unit 151 described later, it can be called a touch screen.

The sensing unit 140 senses the current state of the mobile terminal 100 such as the open / close state of the mobile terminal 100, the position of the mobile terminal 100, Thereby generating a sensing signal. For example, when the mobile terminal 100 is in the form of a slide phone, it is possible to sense whether the slide phone is opened or closed. In addition, a sensing function related to whether or not the power supply unit 190 is powered on, whether the interface unit 170 is coupled to an external device, and the like can be handled.

The sensing unit 140 may include a proximity sensor 141, a pressure sensor 143, a motion sensor 145, a grip sensor 147, and the like. The proximity sensor 141 can detect an object approaching the mobile terminal 100 or the presence or absence of an object in the vicinity of the mobile terminal 100 without mechanical contact. The proximity sensor 141 can detect a nearby object by using a change in the alternating magnetic field or a change in the static magnetic field, or a rate of change in capacitance. The proximity sensor 141 may be equipped with two or more sensors according to the configuration.

The pressure sensor 143 can detect whether or not pressure is applied to the mobile terminal 100, the magnitude of the pressure, and the like. The pressure sensor 143 may be installed at a portion where the pressure of the mobile terminal 100 is required according to the use environment. When the pressure sensor 143 is installed on the display unit 151, the touch input through the display unit 151 and the pressure applied by the touch input The pressure touch input can be identified. Also, the magnitude of the pressure applied to the display unit 151 at the time of the pressure touch input can be determined according to the signal output from the pressure sensor 143. [

The motion sensor 145 senses the position or movement of the mobile terminal 100 using an acceleration sensor, a gyro sensor, or the like. An acceleration sensor that can be used for the motion sensor 145 is a device that converts an acceleration change in one direction into an electric signal and is widely used along with the development of MEMS (micro-electromechanical systems) technology.

The acceleration sensor measures the acceleration of a small value built in the airbag system of an automobile and recognizes the minute motion of the human hand and measures the acceleration of a large value used as an input means such as a game There are various types. Acceleration sensors are usually constructed by mounting two or three axes in one package. Depending on the usage environment, only one axis of Z axis is required. Therefore, when the acceleration sensor in the X-axis direction or the Y-axis direction is used instead of the Z-axis direction for some reason, the acceleration sensor may be mounted on the main substrate by using a separate piece substrate.

The gyro sensor is a sensor for measuring the angular velocity, and it can sense the direction of rotation with respect to the reference direction.

The grip sensor 147 can detect whether or not the user touches the outer surface of the mobile terminal by touch sensor or the like in the mobile terminal and the continuity of contact area and contact when there is contact. The grip sensor 147 may be installed at a portion where contact detection is required depending on the use environment, and preferably at both side portions of the mobile terminal.

In addition, the grip sensor 147 can detect which hand the user holds the mobile terminal, or which part of the mobile terminal the user holds, and the like, in accordance with the detected contact signal.

The output unit 150 is for outputting an audio signal, a video signal, or an alarm signal. The output unit 150 may include a display unit 151, an audio output module 153, an alarm unit 155, and a haptic module 157.

The display unit 151 displays and outputs information processed by the mobile terminal 100. For example, when the mobile terminal 100 is in the call mode, a UI (User Interface) or a GUI (Graphic User Interface) associated with a call is displayed. When the mobile terminal 100 is in the video communication mode or the photographing mode, the photographed or received images can be displayed individually or simultaneously, and the UI and the GUI are displayed.

Meanwhile, as described above, when the display unit 151 and the touch pad have a mutual layer structure to constitute a touch screen, the display unit 151 may be an input device capable of inputting information by a user's touch in addition to the output device Can also be used.

If the display unit 151 is configured as a touch screen, it may include a touch screen panel, a touch screen panel controller, and the like. In this case, the touch screen panel is a transparent panel that is attached to the outside, and can be connected to the internal bus of the mobile terminal 100. The touch screen panel keeps a watch on the contact result, and if there is a touch input, sends the corresponding signals to the touch screen panel controller. The touch screen panel controller processes the signals, and then transmits corresponding data to the controller 180 so that the controller 180 can determine whether the touch input has been made and which area of the touch screen has been touched.

The display unit 151 may be formed of an e-paper. Electronic paper (e-Paper) is a kind of reflective display, and has excellent visual characteristics such as high resolution, wide viewing angle and bright white background as conventional paper and ink. The electronic paper (e-paper) can be implemented on any substrate such as plastic, metal, paper, and the image is maintained even after the power is shut off, and the battery life of the mobile terminal 100 is long Can be maintained. As the electronic paper, a hemispherical twist ball filled with a telephone can be used, or an electrophoresis method and a microcapsule can be used.

In addition, the display unit 151 may be a liquid crystal display, a thin film transistor-liquid crystal display, an organic light-emitting diode, a flexible display, a three- (3D display). In addition, there may be two or more display units 151 according to the embodiment of the mobile terminal 100. For example, the mobile terminal 100 may include an external display unit (not shown) and an internal display unit (not shown) at the same time.

The audio output module 153 outputs audio data received from the wireless communication unit 110 or stored in the memory 160 in a call signal reception mode, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, In addition, the sound output module 153 outputs sound signals related to functions performed in the mobile terminal 100, for example, call signal reception tones, message reception tones, and the like. The sound output module 153 may include a speaker, a buzzer, and the like.

The alarm unit 155 outputs a signal for notifying the occurrence of an event of the mobile terminal 100. Examples of events that occur in the mobile terminal 100 include call signal reception, message reception, and key signal input. The alarm unit 155 outputs a signal for notifying the occurrence of an event in a form other than an audio signal or a video signal. For example, it is possible to output a signal in a vibration mode. The alarm unit 155 can output a signal to notify when a call signal is received or a message is received. Also, when the key signal is inputted, the alarm unit 155 can output the signal as the feedback to the key signal input. The user can recognize the occurrence of an event through the signal output by the alarm unit 155. A signal for notifying the occurrence of an event in the mobile terminal 100 may also be output through the display unit 151 or the sound output module 153. [

The haptic module 157 generates various tactile effects that the user can feel. A typical example of the haptic effect generated by the haptic module 157 is a vibration effect. When the haptic module 157 generates vibration with a haptic effect, the intensity and pattern of the vibration generated by the haptic module 157 can be converted, and the different vibrations can be synthesized and output or sequentially output.

In addition to the vibration, the haptic module 157 may be provided with a function of stimulating by a pin arrangement vertically moving with respect to the contact skin surface, an effect of stimulating air through the injection or suction force of the air through the injection port or the suction port, The effect of stimulation through contact of the electrode (eletrode), the effect of stimulation by the electrostatic force, and the effect of reproducing the cool / warm using the device capable of endothermic or exothermic can be generated. The haptic module 157 can be implemented not only to transmit the tactile effect through direct contact but also to feel the tactile effect through the muscular sense of the user's finger or arm. The haptic module 157 may include two or more haptic modules 157 according to the configuration of the mobile terminal 100.

The memory 160 may store a program for processing and controlling the control unit 180 and may store a function for temporarily storing input or output data (e.g., a phone book, a message, a still image, .

The memory 160 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory), a RAM , And a ROM. ≪ / RTI > In addition, the mobile terminal 100 may operate a web storage for storing the memory 150 on the Internet.

The interface unit 170 serves as an interface with all external devices connected to the mobile terminal 100. Examples of the external device connected to the mobile terminal 100 include a wired / wireless headset, an external charger, a wired / wireless data port, a memory card, a SIM (Subscriber Identification Module) card, a UIM An audio input / output (I / O) terminal, a video I / O (input / output) terminal, and an earphone. The interface unit 170 may receive data from the external device or supply power to the respective components in the mobile terminal 100 and may transmit data in the mobile terminal 100 to the external device .

The interface unit 170 may be a path through which the power from the cradle connected to the mobile terminal 100 is connected to the cradle when the mobile terminal 100 is connected to the cradle, And may be a passage to be transmitted to the terminal 100.

The controller 180 typically controls the operation of the respective units to control the overall operation of the mobile terminal 100. For example, voice communication, data communication, video communication, and the like.

In addition, the controller 180 may include a multimedia playback module 181 and a hearing test module 183 for multimedia playback. The multimedia reproducing module 181 and the audiovisual testing module 183 may be implemented by hardware in the controller 180 or software separately from the controller 180. [

The audiovisual module 183 examines the hearing of a person using the terminal under various usage environments and provides a user-customized call volume based on the results.

The power supply unit 190 receives external power and internal power under the control of the controller 180 and supplies power necessary for operation of the respective components.

The mobile terminal 100 having such a configuration can be configured to be operable in a communication system capable of transmitting data through a frame or a packet, including a wired / wireless communication system and a satellite-based communication system. have.

FIG. 2 is a perspective view of a mobile terminal according to an embodiment of the present invention, and FIG. 3 is a rear perspective view of the mobile terminal shown in FIG. Hereinafter, with reference to FIG. 2 and FIG. 3, a mobile terminal according to the present invention will be described in terms of components according to the external appearance. Hereinafter, for convenience of description, a bar type mobile terminal having a front touch screen among various types of mobile terminals such as a folder type, a bar type, a swing type, a slider type, etc. will be described as an example. However, the present invention is not limited to the bar-type mobile terminal but can be applied to all types of mobile terminals including the above-mentioned types.

Referring to FIG. 2, the case constituting the appearance of the mobile terminal 100 is formed by the front case 100-1 and the rear case 100-2. Various electronic components are incorporated in the space formed by the front case 100-1 and the rear case 100-2.

The display unit 151, the first sound output module 153a, the first camera 121a, and the first through third user input units 130a, 130b, and 130c are connected to the main body, specifically, the front case 100-1 . A fourth user input unit 130d, a fifth user input unit 130e, and a microphone 123 may be disposed on a side surface of the rear case 100-2.

The display unit 151 may be constructed such that the touch pad is overlapped with the layer structure so that the display unit 151 operates as a touch screen so that information can be input by a user's touch.

The first acoustic output module 153a may be implemented in the form of a receiver or a speaker. The first camera 121a may be implemented in a form suitable for capturing an image or a moving image of a user. The microphone 123 may be implemented in a form suitable for receiving a user's voice, other sounds, and the like.

The first to fifth user input units 130a, 130b, 130c, 130d and 130e and the sixth and seventh user input units 130f and 130g described below may be collectively referred to as a user input unit 130, Any manner can be employed in a tactile manner.

For example, the user input unit 130 may be embodied as a dome switch or a touch pad capable of receiving a command or information by a user's pressing or touching operation, or may be a wheel, jog system, Or the like. In a functional aspect, the first to third user input units 130a, 130b and 130c are for inputting commands such as start, end, and scroll, and the fourth user input unit 130d is for inputting a selection of an operation mode, . In addition, the fifth user input unit 130e may operate as a hot-key for activating a special function in the mobile terminal 100. [

 3, a second camera 121b may be additionally mounted on a rear surface of the rear case 100-2. On the side surface of the rear case 100-2, a sixth and a seventh user input units 130f, 130g, and an interface unit 170 may be disposed.

The second camera 121b has a photographing direction substantially opposite to that of the first camera 121a, and may have pixels different from those of the first camera 121a. A flash (not shown) and a mirror (not shown) may be additionally disposed adjacent to the second camera 121b. In addition, another camera may be installed adjacent to the second camera 121b to use it for shooting a three-dimensional stereoscopic image.

The flash illuminates the subject when the subject is photographed by the second camera 121b. The mirror enables the user to illuminate the user's own face or the like when the user intends to photograph (self-photograph) himself / herself using the second camera 121b.

A second sound output module (not shown) may be further disposed in the rear case 100-2. The second sound output module may implement the stereo function together with the first sound output module 153a, and may be used for talking in the speakerphone mode.

The interface unit 170 can be used as a path for exchanging data with an external device. An antenna for receiving broadcast signals (not shown) may be disposed in one area of the front case 100-1 and the rear case 100-2 in addition to the antenna for communication. The antenna may be installed to be capable of being drawn out from the rear case 100-2.

A power supply unit 190 for supplying power to the mobile terminal 100 may be mounted on the rear case 100-2. The power supply unit 190 may be a rechargeable battery, for example, and may be detachably coupled to the rear case 100-2 for charging or the like.

On the other hand, in the present embodiment, the second camera 121b and the like are disposed in the rear case 100-2, but the present invention is not limited thereto. Also, the first camera 121a may be rotatably formed so that the second camera 121b can be photographed up to the photographing direction, even if the second camera 121b is not separately provided.

The overall configuration of the mobile terminal 100 according to the present invention has been described above with reference to FIGS. 1 to 3. FIG. Hereinafter, a mobile terminal providing a user-customized call volume based on a hearing test and an operation method thereof according to a preferred embodiment of the present invention will be described in detail.

4 is a block diagram of a hearing test module according to an embodiment of the present invention.

Referring to FIG. 4, the hearing test module 183 includes a GUI providing unit 183_1, an examining unit 183_3, a user response detecting unit 183_5, and a call volume determining unit 183_7.

The GUI providing unit 183_1 performs an operation of providing graphic user interface (GUI) information for setting the user-customized call volume to the display unit 151 through the audiometry. Accordingly, the user refers to the graphical user interface information displayed on the display unit 151 to perform the audiovisual test, and sets a user-customized call volume based on the test.

The test tone generator 183_3 performs an operation of providing an audible tone for audiometry to the sound output module. Accordingly, the user hears the test tone output through the speaker, the earphone, or the like and conducts the hearing test. In this case, it is preferable that the test tone is composed of a telephone tone capable of providing the same effect as that of the other party.

The user response detecting unit 183_5 performs an operation of detecting the user's reaction to the test sound output for hearing test. For example, when the test sound output through the speaker or the earphone sounds small, the user provides a response to the volume up of the test sound through the operation of the user input unit 130. On the contrary, , And provides a response to volume down the test tone. If the audible sound is heard well after the volume up or volume down process, the user provides a response to terminate the hearing test through the operation of the user input unit 130.

As described above, the user response detector 183_5 detects a user response regarding the volume up, volume down, inspection end, or the like provided through the user input unit 130, and transmits the detected user response to the call volume determining unit 183_7.

The call volume determination unit 183_7 determines a user-customized call volume based on the test result, and then stores it in the memory 160. [ That is, when a response corresponding to the end of the test is received from the user response detecting unit 183_5, the call volume determining unit 183_7 determines the user-customized call volume based on the test sound last outputted at the end of the test, And stores the call volume in the memory 160. [

In addition, the call volume determining unit 183_7 performs the hearing test for each call pattern (or call type), and determines a user-customized call volume based on the result of the test.

For example, during a hearing test using a speaker, the call volume determination unit 183_7 performs hearing tests on each of the ears, determines a call volume optimized for each ear, and stores the conversation volume in the memory 160. [ In the hearing test using the earphone (or headphone), the call volume determining unit 183_7 performs the hearing test while wearing the earphone (or the headphone), determines the optimized call volume based on the result And stores it in the memory 160.

Then, when a call is connected to the other party's terminal, the call volume determining unit 183_7 reads information on the user-customized call volume stored in the memory 160, and provides the information to the sound output module 153. [ Then, the sound output module 153 amplifies the call voice of the other party based on the information on the received call volume, and outputs the voice.

On the other hand, when an external noise of more than a threshold value occurs during a call with the counterpart terminal, the user can not correctly understand the counterpart's speech. Therefore, in order to compensate for external noise, it is necessary to further increase the volume of the call output through the speaker or earphone. To this end, the call volume determining unit 183_7 measures the size of the noise input through the microphone, reads the correction value corresponding to the measured size from the memory 160, and reflects the correction value to the call volume . Accordingly, the call volume determining unit 183_7 can provide the user-customized call volume compensated for by the influence of the external noise.

The memory 160 stores information on a user-customized call volume preset according to the communication method. In addition, the memory 160 stores information on the correction value of the external noise in the form of a look-up table.

5 is a flowchart illustrating an operation of a mobile terminal providing a user-customized call volume according to an exemplary embodiment of the present invention.

Referring to FIG. 5, the mobile terminal 100 sets a user-customized call volume in advance according to a user command (S501). At this time, the call volume setting may be performed at the time of first booting after purchasing the terminal, or may be performed through operation of a setting menu later. A detailed description of a method for presetting the call volume will be described below.

The mobile terminal 100 connects the call with the counterpart terminal in response to a call request for the third party or a request from the third party (S503). At this time, the mobile terminal 100 detects the user's call pattern (or call mode).

That is, the mobile terminal 100 detects whether the user speaks through the earphone or through the speaker. Further, when it is detected that a call is made through the speaker, the mobile terminal 100 detects whether the user is talking via the left ear or through the right ear.

More specifically, the mobile terminal 100 first confirms whether the user listens to the call through the earphone (or headphone) (S505). To this end, the mobile terminal 100 detects whether the earphone is connected to the earphone jack.

As a result of the checking, if the user is listening to the call through the earphone, the mobile terminal 100 reads information about the talk volume optimized when the earphone is used from the memory 160 (S507).

On the other hand, if it is determined that the user has not listened to the call through the earphone, that is, if he / she listens to the call through the speaker, the mobile terminal 100 determines which one of the ears the user listens to ).

To this end, the mobile terminal 100 determines whether the user is talking via the left ear or the right ear using the measured value from the motion sensor 145. [

6 (a), when the user speaks the mobile terminal 100 to the left ear, the mobile terminal 100 normally transmits a predetermined range of the first direction around a certain reference axis in the first direction Keep the degree of tilt. 6 (b), when the mobile terminal 100 is placed in the right ear, the mobile terminal 100 moves in the second direction opposite to the first direction about the reference axis And maintains a degree of inclination of a predetermined range. Accordingly, when the mobile terminal 100 measures the spatial position, direction, and degree of tilt of the mobile terminal through the motion sensor 145 during a call connection with the counterpart terminal, the mobile terminal 100 determines, based on the measured value, To listen to the call.

Also, the mobile terminal 100 can determine whether the user is talking through the left ear or the right ear using the measured value at the grip sensor 147. [

Normally, when the user uses the left ear to perform a call using the left hand and uses the right ear to perform a conversation using the right hand, conversely, when the terminal detects which hand is held, To determine whether the call is over. At this time, whether the terminal is held or not can be detected through the grip sensor 147.

7 (a), when the mobile terminal 100 is held with the left hand, the contact information detected at the first side 710 of the mobile terminal (i.e., the contact area and continuity of contact, etc., Information) and the second side 720 are different from each other. That is, the contact information detected at the first side surface 710 includes a feature that the user's thumb portion is contacted, while the contact information detected at the second side surface 720 includes the feature that the remaining finger portions are contacted do.

7 (b), when the user holds the mobile terminal 100 with his right hand, the contact information detected at the first side surface 710 of the mobile terminal and the contact information detected at the second side surface 720 The information is also different. 7A, the contact information detected at the first side surface 710 includes a feature that the remaining finger parts are contacted except for the thumb, whereas the contact information detected at the second side surface 720 includes the contact detected at the second side surface 720, The information includes features in which the thumb portion is in contact.

Accordingly, when the contact information on both sides of the mobile terminal 100 is detected through the grip sensor 147 when the mobile terminal 100 makes a call connection with the counterpart terminal, the mobile terminal 100 detects the hand Can be used to determine if it is holding the terminal and to determine which ear to use.

On the other hand, in the present embodiment, it is exemplified that the ear to listen to the call through the motion sensor 145 or the grip sensor 147 is determined to be either ear, but the present invention is not limited thereto. For example, the first camera 121a attached to the front surface of the mobile terminal 100 may be used to determine an ear listening to a call, or may be determined through a combination of the devices 145, 147, and 121a.

5, if it is determined in step 509 that the user is talking via the left ear, the mobile terminal 100 reads information about the call volume optimized for the user's left ear from the memory 160 (S511).

Meanwhile, if it is determined in step 509 that the user is talking via the right ear, the mobile terminal 100 reads information about the call volume optimized for the right ear of the user from the memory 160 (S513).

Also, during the communication with the counterpart terminal, the mobile terminal 100 checks whether external noise of a threshold value or more is inputted through the microphone 123 (S515).

If it is determined that no noise exceeding the threshold value is detected, the mobile terminal 100 outputs the voice of the other party based on the user-customized call volume set in advance according to the calling method (S519).

If it is determined that the noise level is higher than the threshold value, the mobile terminal 100 determines a correction value corresponding to the detected noise and reflects the determined correction value in the user-customized call volume (S517). Accordingly, the mobile terminal 100 can provide a user-customized talk volume considering the influence of external noise.

Through the steps described above, the present invention provides a method of detecting a call method (whether or not a speaker or earphone is used) of a user at the time of making a call connection with a counterpart terminal and detecting a user- It is possible to output the voice of the other party.

Hereinafter, a method for presetting a user-customized call volume according to an exemplary embodiment of the present invention will be described in detail. At this time, the call volume setting may be performed through the operation of the setting menu or at the time of first booting after purchasing the terminal.

8 to 10 illustrate a process of presetting a user-customized call volume through operation of a setup menu.

Referring to FIG. 8, the mobile terminal 100 displays a menu window 811 including a setting menu 813 and the like in one area of the idle screen 810 according to a user command. Thereafter, when the setting menu 813 is selected in the menu window 811 displayed on the screen, the mobile terminal 100 displays a setting screen including wireless and network setting items, call setting items, sound setting items, 820).

When the sound setting item 821 is selected on the setting screen 820, the mobile terminal 100 displays a sound setting screen 820 including a silent mode item, a vibration item, a volume item, a bell sound setting item, 830). Then, when the volume item 831 is selected on the sound setting screen 830, the mobile terminal 100 displays a volume setting screen 841 including a ring volume setting item, a media volume setting item, a call volume setting item, .

When the call volume setting item 843 is selected on the volume setting screen 841, the mobile terminal displays a call volume setting screen 851 including a general setting item 853 and a user customized setting item 855.

When the general setting item 853 is selected in the call volume setting screen 851, the mobile terminal 100 sets the call volume in the same manner as the call volume setting method of the conventional mobile terminal. If the user customization item 855 is selected in the call volume setting screen 851, the mobile terminal 100 sets a user customization setting including the earphone auditory check item 863 and the speaker auditory check item 865 Screen 860 is displayed. Accordingly, the user can sequentially select the two items 863 and 865 to set the call volume optimized for each call method.

Meanwhile, although not shown in the figure, the call volume setting screen 851 may further include an automatic setting item (not shown) in addition to the general setting item 853 and the user customization setting item 855. At this time, the automatic setting item is selected to automatically set the talk volume to a predetermined value by the manufacturer according to the call pattern. Accordingly, when the automatic setting item is selected, the mobile terminal 100 outputs the call voice of the other party based on the call volume preset by the manufacturer in accordance with the call pattern (that is, the call through the speaker or the earphone) do.

FIG. 9 illustrates a process of presetting a user-customized call volume based on audiovisual testing through an earphone.

9, when the earphone auditory check item 913 is selected on the user customization screen 911, the mobile terminal 100 displays an alert window 923, a start icon 925, a cancel icon 927, The earphone hearing ability test screen 921 is displayed. At this time, the notification window 923 includes information for guiding the earphone to connect to the ear of the user. Then, the start icon 925 is selected to command the start of the hearing test, and the cancel icon 927 is selected to command the cancellation of the hearing test.

When the start icon 925 is selected on the earphone hearing screen 921, the mobile terminal 100 displays a volume up icon 932, a volume down icon 933, a resume icon 934, a completion icon 935, A call volume adjustment screen 931 including a cancellation icon 936, and the like, and then outputs an audible tone for auditory examination.

At this time, when the test sound output through the earphone is small, the user touches the volume up icon 932 to provide a response to volume up of the test sound. On the other hand, Down icon 933 to provide a response to turn down the corresponding test tone. Thereafter, when it is desired to continuously repeat the hearing test based on the changed test tone, the user touches the retest icon 934.

Through this repeated examination process, if the changed test tone is best heard, the user touches the completion icon 935 to end the current hearing test. Then, the mobile terminal 100 determines a user-customized call volume based on the last test sound output at the end of the test, and stores the user-customized call volume in the memory 160. In addition, the mobile terminal displays an alert window 941 indicating that the call volume setting by the user has been successfully completed. On the other hand, if the current ongoing hearing test is to be canceled on the way, the user may touch the cancel icon 936 to cancel the hearing test.

FIG. 10 illustrates a process of presetting a user-customized call volume based on a hearing test through a speaker.

10, the customized setting screen 1011 includes an earphone auditory check item 1013 and a speaker auditory check item 1015. The speaker auditory check item 1015 includes a left ear check item 1017 ) And a right ear test item (1019). Accordingly, the user can sequentially select the two items 1017 and 1019 to set the call volume optimized for both ears.

When the left ear check item 1017 is selected in the speaker auditory check item 1015, the mobile terminal 100 displays the left ear ear 1023 including the notification window 1023, the start icon 1025, the cancel icon 1027, An inspection screen 1021 is displayed. At this time, the notification window 1023 includes information for guiding the user to select the test start button after placing the mobile terminal in the left ear. The start icon 1025 is then selected to command the start of the hearing test, and the cancel icon 1027 is selected to command the hearing test to cancel.

When the start icon 1025 is selected on the left ear test screen 1021, the mobile terminal 100 displays a volume up icon 1032, a volume down icon 1033, a rescan icon 1034, a completion icon 1035, And a cancel icon 1036, and then outputs an audible tone for auditory examination.

At this time, when the test tone output through the speaker is small, the user touches the volume up icon 1032 to provide a response to volume up the corresponding test tone. On the other hand, Down icon 1033 so as to decrease the volume of the test sound. Thereafter, when it is desired to continuously repeat the hearing test on the basis of the changed test tone, the user touches the retest icon 1034.

Through this repeated examination process, if the changed test tone is best heard, the user touches the completion icon 1035 to terminate the ongoing hearing test. Then, the mobile terminal 100 determines a user-customized call volume based on the last test sound output at the end of the test, and stores the user-customized call volume in the memory 160. In addition, the mobile terminal displays a notification window 1041 indicating that the call volume setting by the user has been successfully completed. On the other hand, if the current ongoing hearing test is to be canceled on the way, the user may touch the cancel icon 936 to cancel the hearing test.

Thus, through the hearing test on the left ear, the call volume optimized for the user's left ear can be preset. In addition, the call volume optimized for the right ear of the user can be set in advance through the hearing test on the right ear in the same manner as described with reference to Fig.

On the other hand, in the present embodiment, the hearing test is performed on each of both ears, and the optimized call volume is set based on this. However, since the hearing power of both ears is similar, the hearing test is performed on only one ear, The call volume determined by the call volume may be set equal to the other ear.

In this embodiment, the user's hearing ability is inspected based on the user's response to the output test sound (i.e., volume up / down). However, the present invention is not limited to this, It will be apparent to those skilled in the art that inspection methods can be applied.

Next, FIG. 11 illustrates a process of presetting a user-customized call volume at the first boot after purchasing the terminal.

11, the mobile terminal 100 displays a setting guide screen 1110 including a notification window 1111, a confirmation icon 1113, a cancel icon 1115, and the like at the time of initial booting. At this time, the notification window 1113 includes information for guiding the user-customized call volume to be set in advance.

If the confirmation icon 1113 is selected while the setting guide screen 1110 is displayed, the mobile terminal 100 displays the same screen 1121 as the customizing setting screen 1011 shown in FIG. 10 (a) Display. Hereinafter, a method of setting the call volume through the user customization screen is the same as the method described with reference to FIG. 9 and FIG. 10, and a detailed description will be omitted.

If the cancel icon 1113 is selected while the setting guide screen 1110 is displayed, the mobile terminal 100 enters a standby mode without displaying a user-customized call volume, and displays a standby screen.

As described above, the user can set the user-customized call volume at the time of first boot after purchasing the terminal. If the user can not set the customized call volume at this time, the setting can be made later through the operation of the setting menu.

Meanwhile, in the present embodiment, a user-customized call volume is set in advance through the audiometric test. However, the present invention is not limited thereto, and it will be apparent to those skilled in the art that the present invention can be applied to media volume and system volume in addition to the call volume.

In addition, the present invention can be implemented as a code that can be read by a processor on a recording medium readable by a processor included in the mobile terminal. The processor-readable recording medium includes all kinds of recording apparatuses in which data that can be read by the processor is stored. Examples of the recording medium readable by the processor include a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like, and also a carrier wave such as transmission over the Internet. In addition, the processor readable recording medium may be distributed over networked computer systems so that code readable by the processor in a distributed manner can be stored and executed.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, but, on the contrary, It will be understood by those skilled in the art that various changes and modifications may be made without departing from the spirit and scope of the present invention.

110: wireless communication unit 120: A / V input unit
130: user input unit 140: sensing unit
150: output unit 151: display unit
160: memory 170: interface section
180: control unit 183: audiometry module

Claims (9)

Storing a preset call volume through a hearing test;
Connecting a call with a counterpart terminal in response to a call origination request or a call reception request;
Determining a user's call pattern at the time of the call connection; And
Detecting a call volume corresponding to the determined call pattern and outputting a voice of the other party based on the detected call volume,
The call pattern is an operation of a user who hears a call through an earphone or speaker,
If the determined call pattern is a speaker call,
Wherein the determining step includes the step of detecting, using at least one of the motion sensor, the grip sensor and the camera sensor, which of the ears of the user is listening to the call,
If the detected ears of the user are left,
The outputting step may include detecting a talk volume set in the left ear based on the hearing test result and outputting a voice of the other party based on the talk volume set in the detected left ear,
If the ears of the detected user are right,
Wherein the step of outputting includes detecting a call volume set in the right ear based on the hearing test result and outputting a voice of the other party based on the call volume set in the right ear detected. Lt; / RTI > The method according to claim 1,
Wherein the mobile terminal is stored at the time of initial booting or is stored through operation of a setting menu. delete 2. The method of claim 1, wherein if the determined call pattern is an earphone call,
Wherein the step of outputting includes detecting a call volume set at the time of using the earphone based on the result of the hearing test and outputting the voice of the other party based on the detected call volume. delete delete delete The method according to claim 1,
Further comprising the step of detecting an external noise of a threshold value or more at the time of the call connection and reflecting a correction value corresponding to the detected external noise to the detected call volume. A memory for storing a preset call volume through a hearing test;
A wireless communication unit for connecting a call with a counterpart terminal in response to a call origination request or a call reception request; And
And a controller for determining a call pattern of the user at the time of the call connection, reading out the call volume corresponding to the determined call pattern from the memory, and outputting the voice of the other party based on the read call volume,
The call pattern is an operation of a user who hears a call through an earphone or speaker,
If the determined call pattern is a speaker call,
Wherein,
Detecting at least one of a user's ear listening to the call using at least one of a motion sensor, a grip sensor and a camera sensor,
If the detected ears of the user are left,
The output step may include detecting a talk volume set in the left ear based on the hearing test result and outputting a voice of the other party on the basis of the talk volume set in the detected left ear,
If the ears of the detected user are right,
Wherein the output step detects the call volume set in the right ear based on a result of the hearing test and outputs the voice of the other party on the basis of the talk volume set in the right ear.

Images