KR102097494B1 - Mobile terminal and method for controlling mobile terminal - Google Patents

Abstract

A mobile terminal according to an embodiment of the present invention extracts and extracts voice feature information from a voice received from another mobile terminal through a wireless communication unit, a memory unit that stores at least one contact information including voice feature information, and a wireless communication unit. It includes a control unit for adding the identification information of the other mobile terminal to the specific contact information if the voice feature information included in the specific contact information of the at least one of the stored contact information is stored.

Description

MOBILE TERMINAL AND METHOD FOR CONTROLLING MOBILE TERMINAL}

The present invention relates to a mobile terminal using voice feature information extracted from a user's voice.

Terminal is mobile Depending on whether or not it can be divided into mobile terminals (mobile / portable terminal) and stationary terminals (stationary terminal). Again, the mobile terminal may be divided into a handheld terminal and a vehicle mount terminal according to whether the user can directly carry it.

As the function is diversified, such a terminal is a multimedia player having multiple functions, such as taking a picture or a video, playing music or a video file, receiving a game, or broadcasting. Is being implemented.

To support and increase the function of such a terminal, it may be considered to improve the structural part and / or software part of the terminal.

Since each user has unique voice characteristics such as fingerprints, it is possible to know who the user is and what phrase the user pronounced using voice print.

Accordingly, there is a need for a technology related to the protection and modification of information stored in a mobile terminal using voice feature information of a user.

The present invention is proposed to meet the above-mentioned needs, and it is an object of the present invention to provide a mobile terminal and a control method for easily providing information to a user using voice characteristic information of the user.

The technical problems to be achieved in the present invention are not limited to the technical problems mentioned above, and other technical problems that are not mentioned will be clearly understood by those skilled in the art from the following description. Will be able to.

In order to achieve the above object, a mobile terminal according to an embodiment of the present invention features a voice from voice received from another mobile terminal through a wireless communication unit, a memory unit for storing at least one contact information including voice characteristic information, and a wireless communication unit. And a control unit for extracting information and adding identification information of another mobile terminal to the specific contact information when the extracted voice feature information matches the voice feature information included in the specific contact information among at least one contact information stored.

The control unit may transmit the phrase through the wireless communication unit so that the phrase for extracting the voice feature information is displayed on the other mobile terminal, and extract the voice feature information when the voice including the phrase is received from the other mobile terminal.

In a mobile terminal according to another embodiment of the present invention, a call is received from a wireless communication unit, a sound output unit, a memory unit storing at least one contact information including voice feature information, and another mobile terminal, and the identification information of the other mobile terminal is at least. It is possible to determine specific contact information including identification information of another mobile terminal among one contact information, and apply voice feature information of specific contact information to a predetermined phrase to output a ringing tone through the sound output unit.

A microphone may be further included, and the controller may extract voice feature information from the voice received by the microphone and store the voice feature information in a memory unit.

The display may further include a display unit for displaying a lock screen, and when the lock screen is displayed, when a voice corresponding to the voice feature information stored in the memory unit is received by the microphone, the controller may stop displaying the lock screen.

The controller locks the information stored in the memory unit by using the voice feature information, and when a voice matching the voice feature information stored in the memory unit is received by the microphone, unlocks the lock to perform a function related to the information stored in the memory unit.

A method for controlling a mobile terminal according to an embodiment of the present invention includes receiving voice from another mobile terminal through a wireless communication unit, extracting voice feature information from the received voice, and at least storing the extracted voice feature information in a memory unit. Determining whether the voice feature information included in the specific contact information matches one of the contact information, and if the extracted voice feature information matches the voice feature information included in the specific contact information, the identification information of another mobile terminal is added to the specific contact information. And adding steps.

The effects of the mobile terminal and the mobile terminal control method according to the present invention are as follows.

According to at least one of the embodiments of the present invention, there is an advantage that the contact information can be easily changed using the voice feature information of the received user.

In addition, according to at least one of the embodiments of the present invention, there is an advantage that the information stored in the mobile terminal can be protected through the voice feature information of the user.

The effects obtainable in the present invention are not limited to the above-mentioned effects, and other effects not mentioned can be clearly understood by those skilled in the art from the following description. will be.

1 is a block diagram of a mobile terminal according to an embodiment of the present invention (block diagram).
2 is a front perspective view of a mobile terminal according to an embodiment of the present invention.
3 is a flowchart illustrating a mobile terminal control method according to an embodiment of the present invention.
4 is an exemplary diagram illustrating a method of extracting voice feature information and storing contact information by a mobile terminal according to an embodiment of the present invention.
5 is an exemplary view showing a method of extracting voice feature information by a mobile terminal according to an embodiment of the present invention.
6 is an exemplary view illustrating a method of outputting sound using voice feature information by a mobile terminal according to an embodiment of the present invention.
7 is an exemplary view illustrating a method of displaying information through voice feature information by a mobile terminal according to an embodiment of the present invention.
8 is an exemplary view showing a method for a mobile terminal to release a lock screen through voice feature information according to an embodiment of the present invention.

Hereinafter, a mobile terminal related to the present invention will be described in more detail with reference to the drawings. The suffixes "modules" and "parts" for the components used in the following description are given or mixed only considering the ease of writing the specification, and do not have meanings or roles distinguished from each other in themselves.

The mobile terminal described herein may include a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, personal digital assistants (PDA), portable multimedia player (PMP), navigation, and the like. However, it will be readily appreciated by those skilled in the art that the configuration according to the embodiments described herein may be applied to fixed terminals such as digital TVs and desktop computers, except when applicable only to mobile terminals.

1 is a block diagram of a mobile terminal according to an embodiment of the present invention (block diagram).

The mobile terminal 100 includes a wireless communication unit 110, an audio / video (A / V) input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, a memory 160, and an interface. It may include a unit 170, the control unit 180 and the power supply unit 190. The components shown in FIG. 1 are not essential, so a mobile terminal with more or fewer components may be implemented.

Hereinafter, the components will be described in turn.

The wireless communication unit 110 may include one or more modules that enable wireless communication between the mobile terminal 100 and the wireless communication system or between the mobile terminal 100 and the network in which the mobile terminal 100 is located. For example, the wireless communication unit 110 may include a broadcast reception module 111, a mobile communication module 112, a wireless Internet module 113, a short-range communication module 114, and a location information module 115. .

The broadcast receiving module 111 receives a broadcast signal and / or broadcast related information from an external broadcast management server through a broadcast channel. The broadcast channel may include a satellite channel and a terrestrial channel. Two or more of the broadcast reception modules may be provided to the mobile terminal 100 for simultaneous broadcast reception or switching of broadcast channels for at least two broadcast channels.

The broadcast management server may mean a server that generates and transmits broadcast signals and / or broadcast-related information or a server that receives previously generated broadcast signals and / or broadcast-related information and transmits them to a terminal. The broadcast signal may include a TV broadcast signal, a radio broadcast signal, and a data broadcast signal, and may also include a TV broadcast signal or a radio broadcast signal combined with a data broadcast signal.

The broadcast-related information refers to information related to a broadcast channel, broadcast program or broadcast service provider. The broadcast-related information may also be provided through a mobile communication network. In this case, it may be received by the mobile communication module 112.

The broadcast-related information may exist in various forms. For example, it may exist in the form of an Electronic Program Guide (EPG) of Digital Multimedia Broadcasting (DMB) or an Electronic Service Guide (ESG) of Digital Video Broadcast-Handheld (DVB-H).

The broadcast receiving module 111, for example, DMB-T (Digital Multimedia Broadcasting-Terrestrial), DMB-S (Digital Multimedia Broadcasting-Satellite), MediaFLO (Media Forward Link Only), DVB-H (Digital Video Broadcast) -Handheld), DVB-CBMS (Convergence of Broadcasting and Mobile Service), OMA-BCAST (Open Mobile Alliance-BroadCAST), CMMB (China Multimedia Mobile Broadcasting), MBBMS (Mobile Broadcasting Business Management System), ISDB-T (Integrated Services) A digital broadcast signal can be received using a digital broadcast system such as Digital Broadcast-Terrestrial). Of course, the broadcast receiving module 111 may be configured to be suitable for other broadcasting systems as well as the digital broadcasting system described above.

The broadcast signal and / or broadcast-related information received through the broadcast receiving module 111 may be stored in the memory 160.

The mobile communication module 112 includes at least one of a base station, an external terminal, and a server on a mobile communication network such as, but not limited to, a GSM (Gobal System for Mobile communications), Code Division Multiple Access (CDMA), or Wideband CDMA (WCDMA). Send and receive radio signals with one. The wireless signal may include various types of data according to transmission and reception of a voice call signal, a video call signal, or a text / multimedia message.

The wireless Internet module 113 refers to a module for wireless Internet access, and may be built in or external to the mobile terminal 100. Wireless Internet technology includes Wireless LAN (WLAN) (Wi-Fi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access), GSM, CDMA, WCDMA, LTE (Long Term) Evolution) (not limited to this) and the like.

In view of the fact that the wireless Internet access by Wibro, HSDPA, GSM, CDMA, WCDMA, LTE, etc. is made through a mobile communication network, the wireless Internet module 113 performing wireless Internet access through the mobile communication network is the mobile communication module It may be understood as a kind of (112).

The short-range communication module 114 refers to a module for short-range communication. Bluetooth, radio frequency identification (RFID), infrared data association (IrDA), ultra wideband (UWB), ZigBee, etc. may be used as short range communication technology.

The location information module 115 is a module for obtaining a location of a mobile terminal, and a representative example thereof is a Global Position System (GPS) module. According to the present technology, the GPS module 115 calculates distance information and accurate time information from three or more satellites, and then applies trigonometry to the calculated information, thereby generating a three-dimensional string according to latitude, longitude, and altitude. Position information can be calculated accurately. Currently, a method of calculating position and time information using three satellites and correcting an error of the calculated position and time information using another one satellite is widely used. In addition, the GPS module 115 may calculate speed information by continuously calculating the current position in real time.

Referring to FIG. 1, an audio / video (A / V) input unit 120 is for inputting an audio signal or a video signal, which may include a camera 121 and a microphone 122. The camera 121 processes image frames such as still images or moving images obtained by an image sensor in a video call mode or a shooting mode. The processed image frame may be displayed on the display unit 151.

The image frames processed by the camera 121 may be stored in the memory 160 or transmitted to the outside through the wireless communication unit 110. Two or more cameras 121 may be provided according to the use environment.

The microphone 122 receives an external sound signal by a microphone in a call mode, a recording mode, or a voice recognition mode, and processes it as electrical voice data. The processed voice data may be converted into a form transmittable to a mobile communication base station through the mobile communication module 112 and output. Various noise reduction algorithms for removing noise generated in the process of receiving an external sound signal may be implemented in the microphone 122.

The user input unit 130 generates input data for the user to control the operation of the terminal. The user input unit 130 may be configured with buttons 136 located on the front, rear, or side surfaces of the mobile terminal 100, and a touch sensor (static pressure / blackout) 137, although not shown, a key pad ), A dome switch, a jog wheel, a jog switch, and the like.

The sensing unit 140 detects the current state of the mobile terminal 100, such as the open / closed state of the mobile terminal 100, the location of the mobile terminal 100, the presence or absence of user contact, the orientation of the mobile terminal, and acceleration / deceleration of the mobile terminal. By generating a sensing signal for controlling the operation of the mobile terminal 100. For example, when the mobile terminal 100 is in the form of a slide phone, it may sense whether the slide phone is opened or closed. In addition, it is also possible to sense whether the power supply unit 190 supplies power, whether the interface unit 170 is coupled to external devices, or the like. Meanwhile, the sensing unit 140 may include a proximity sensor 141. (The proximity sensor will be described later).

The output unit 150 is for generating output related to vision, hearing, or tactile sense, and includes a display unit 151, an audio output module 152, an alarm unit 153, and a haptic module 154. You can.

The display unit 151 displays (outputs) information processed by the mobile terminal 100. For example, when the mobile terminal is in a call mode, a UI (User Interface) or a GUI (Graphic User Interface) related to the call is displayed. When the mobile terminal 100 is in a video call mode or a shooting mode, it displays a photographed or / and received video, UI, or GUI.

The display unit 151 includes a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), and a flexible display (flexible). display) and a 3D display.

Some of these displays may be of a transparent type or a light transmissive type so that the outside can be seen through them. This may be referred to as a transparent display, and a typical example of the transparent display is TOLED (Transparant OLED). The rear structure of the display unit 151 may also be configured as a light transmissive structure. With this structure, the user can see an object located behind the terminal body through an area occupied by the display unit 151 of the terminal body.

Two or more display units 151 may exist depending on the implementation form of the mobile terminal 100. For example, in the mobile terminal 100, a plurality of display units may be spaced apart or integrally disposed on one surface, or may be disposed on different surfaces.

When the display unit 151 and the touch sensor 137 form a mutual layer structure or are integrally formed (hereinafter referred to as a 'touch screen'), the display unit 151 may be used as an input device in addition to an output device. You can. The touch sensor may be stacked on the display unit 151 to form a layer structure, for example, in the case of having a form of a touch film, a touch sheet, a touch pad, or the like, and integrated into the configuration of the display unit 151. It can be made.

The touch sensor may be configured to convert a change in pressure applied to a specific portion of the display unit 151 or a capacitance generated in a specific portion of the display unit 151 into an electrical input signal. The touch sensor may be configured to detect not only the touched position and area, but also pressure at the time of touch.

When there is a touch input to the touch sensor, the signal (s) corresponding thereto is sent to a touch controller (not shown). The touch controller processes the signal (s) and then transmits corresponding data to the controller 180. Accordingly, the control unit 180 can know which area of the display unit 151 has been touched, and the like.

The proximity sensor 141 may be disposed inside the mobile terminal surrounded by the touch screen or near the touch screen. The proximity sensor refers to a sensor that detects the presence or absence of an object approaching a predetermined detection surface or an object present in the vicinity without mechanical contact using electromagnetic force or infrared rays. Proximity sensors have a longer lifespan and higher utilization than contact sensors.

Examples of the proximity sensor include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive type proximity sensor, a magnetic type proximity sensor, and an infrared proximity sensor. When the touch screen is capacitive, it is configured to detect the proximity of the pointer due to a change in electric field according to the proximity of the pointer. In this case, the touch screen (touch sensor) may be classified as a proximity sensor.

Hereinafter, for convenience of description, the act of allowing the pointer to be recognized as being positioned on the touch screen without being touched by the pointer on the touch screen is referred to as a “proximity touch”, and the The act of actually touching the pointer on the touch screen may be referred to as "contact touch". The location where a proximity touch is performed by the pointer on the touch screen may mean a location in which the pointer corresponds vertically to the touch screen when the pointer is touched in proximity.

The proximity sensor detects a proximity touch and a proximity touch pattern (eg, proximity touch distance, proximity touch direction, proximity touch speed, proximity touch time, proximity touch position, proximity touch movement state, etc.). Information corresponding to the sensed proximity touch operation and proximity touch pattern may be output on the touch screen.

The audio output module 152 may output audio data received from the wireless communication unit 110 or stored in the memory 160 in a call signal reception, call mode or recording mode, voice recognition mode, broadcast reception mode, or the like. The sound output module 152 may also output sound signals related to functions (eg, call signal reception sound, message reception sound, etc.) performed in the mobile terminal 100. The sound output module 152 may include a receiver, a speaker, and a buzzer.

The alarm unit 153 outputs a signal for notifying the occurrence of an event in the mobile terminal 100. Examples of events generated in the mobile terminal include call signal reception, message reception, key signal input, and touch input. The alarm unit 153 may output a signal for notifying the occurrence of an event by other forms, such as vibration, in addition to a video signal or an audio signal. Since the video signal or the audio signal can also be output through the display unit 151 or the audio output module 152, in this case, the display unit 151 and the audio and sound output module 152 are a type of the alarm unit 153. It may be classified as.

The haptic module 154 generates various tactile effects that the user can feel. A typical example of the tactile effect generated by the haptic module 154 is vibration. The intensity and pattern of vibration generated by the haptic module 154 are controllable. For example, different vibrations may be synthesized and output or sequentially output.

The haptic module 154, in addition to vibration, is a pin array that vertically moves with respect to the contact skin surface, the ejection force or inhalation force of the air through the injection port or the intake port, the stimulation of the skin surface, the contact of the electrode (electrotrode), the stimulation of electrostatic force, etc. Various tactile effects can be generated, such as an effect caused by an effect and an effect of reproducing a feeling of cold and warm using an element capable of absorbing heat or generating heat.

The haptic module 154 may not only transmit the tactile effect through direct contact, but may also implement the user to feel the tactile effect through muscle sensations such as fingers or arms. Two or more haptic modules 154 may be provided according to a configuration aspect of the mobile terminal 100.

The memory 160 may store programs for processing and control of the controller 180, and temporarily store input / output data (for example, a phone book, messages, audio, still images, videos, etc.). It can also perform the function for. The memory unit 160 may store a frequency of use for each of the data (eg, each phone number, each message, and frequency of use for each multimedia).

In addition, the memory unit 160 may store data related to various patterns of vibration and sound output when a touch is input on the touch screen.

The memory 160 is a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory, etc.), RAM (Random Access Memory, RAM), Static Random Access Memory (SRAM), Read-Only Memory (ROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), Programmable Read-Only Memory (PROM), magnetic memory, magnetic It may include a storage medium of at least one type of disk, optical disk. The mobile terminal 100 may operate in connection with a web storage performing a storage function of the memory 160 on the Internet.

The interface unit 170 serves as a passage with all external devices connected to the mobile terminal 100. The interface unit 170 receives data from an external device, receives power, transfers it to each component inside the mobile terminal 100, or allows data inside the mobile terminal 100 to be transmitted to the external device. For example, wired / wireless headset port, external charger port, wired / wireless data port, memory card port, port for connecting devices equipped with an identification module, audio input / output (I / O) port, A video input / output (I / O) port, an earphone port, and the like may be included in the interface unit 170.

The identification module is a chip that stores various information for authenticating the usage rights of the mobile terminal 100, a user identification module (UIM), a subscriber identification module (SIM), and a universal user authentication module ( Universal Subscriber Identity Module (USIM). The device provided with the identification module (hereinafter referred to as an 'identification device') may be manufactured in a smart card format. Therefore, the identification device may be connected to the terminal 100 through a port.

When the mobile terminal 100 is connected to an external cradle, the interface unit becomes a passage through which power from the cradle is supplied to the mobile terminal 100, or various command signals input by the user from the cradle are moved. It can be a passage to the terminal. Various command signals or power inputted from the cradle may be operated as signals for recognizing that the mobile terminal is correctly mounted on the cradle.

The controller 180 typically controls the overall operation of the mobile terminal. For example, it performs related control and processing for voice calls, data communication, video calls, and the like. The controller 180 may include a multimedia module 181 for multimedia playback. The multimedia module 181 may be implemented in the controller 180, or may be implemented separately from the controller 180.

The controller 180 may perform pattern recognition processing capable of recognizing handwriting input or picture drawing input performed on the touch screen as text and images, respectively.

The power supply unit 190 receives external power and internal power under the control of the controller 180 and supplies power required for the operation of each component. The power supply unit 190 may include, for example, a battery, a connection port, a power supply control unit, and a charging monitoring unit.

The battery may be a built-in battery made to be rechargeable, and may be detachably coupled to the terminal body for charging or the like. The connection port may be configured as an example of the interface 170 to which an external charger that supplies power for charging the battery is electrically connected.

The various embodiments described herein can be implemented in a computer- or similar device-readable recording medium using, for example, software, hardware, or a combination thereof.

According to a hardware implementation, the embodiments described herein include application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), It may be implemented using at least one of processors, controllers, micro-controllers, microprocessors, and electrical units for performing other functions. The described embodiments may be implemented by the controller 180 itself.

According to the software implementation, embodiments such as procedures and functions described herein may be implemented as separate software modules. Each of the software modules may perform one or more functions and operations described herein. Software code can be implemented in a software application written in an appropriate programming language. The software code may be stored in the memory 160 and executed by the controller 180.

2 is a perspective view of an example of a mobile terminal or a mobile terminal related to the present invention as viewed from the front.

The disclosed mobile terminal 100 has a bar-shaped terminal body. However, the present invention is not limited to this, and can be applied to various structures such as a slide type, a folder type, a swing type, and a swivel type in which two or more bodies are movably coupled.

The body of the mobile terminal 100 includes cases (101, 102, 103) forming an exterior. In this embodiment, the case may be divided into a front case 101 and a rear case 102. Various electronic components are embedded in a space formed between the front case 101 and the rear case 102.

Parts that need to be detached, such as a secondary storage medium 165, such as a USIM card and a memory card, may include openings in the case to be insertable from the outside into the case. A slot may be formed on the side of the case such that the auxiliary storage medium 165 is inserted and mounted on the side of the mobile terminal 100, or card slots 166 and 167 are formed on the surface of the rear case 102 to be mounted. It might be.

The cases 101, 102, and 103 may be formed by injection of synthetic resin or may be formed to have a metallic material, for example, a metallic material such as stainless steel (STS) or titanium (Ti).

A display unit 151, an audio output unit 152, a camera 121, a user input unit 130 / 131,132, a microphone 122, an interface 170, etc. may be disposed in the terminal cases 101 and 102.

The display unit 151 occupies most of the main surface of the front case 101. An acoustic output unit 152 and a camera 121 are disposed in an area adjacent to one end of both ends of the display unit 151, and a user input unit 131 and a microphone 122 are arranged in an area adjacent to the other end. The user input unit 132 and the interface 170 may be disposed on side surfaces of the front case 101 and the rear case 102.

The user input unit 130 is operated to receive a command for controlling the operation of the mobile terminal 100, and may include a plurality of operation units 131, 132, and 133. The operation units 131, 132, and 133 may also be collectively referred to as a manipulation portion.

Contents input by the first or second operation units 131 and 132 may be variously set. For example, the first operation unit 131 receives a command such as start, end, scroll, etc., and the second operation unit 132 inputs a command such as adjusting the volume of sound output from the sound output unit 152. In response, the third manipulation unit 133 may receive a command such as activation / deactivation of the touch recognition mode of the display unit 151.

The operation units 131, 132, and 133 may have a button method for recognizing when a user applies pressure. In addition to the display unit 151, the operation units 131, 132, and 133 are equipped with a touch sensor, so that the user The user's command may be input with a touch.

The present invention proposes a mobile terminal and a mobile terminal control method that extracts a user's voice features, identifies them, and provides various functions.

The mobile terminal 100 according to an embodiment of the present invention is connected to the other mobile terminal 200 by a call or an Internet phone through an external server (VoIP, voice over IP or VoLTE, voice over LTE) to the voice of the user 10 As described above, the mobile terminal 100 for storing contact information using the voice characteristics of the received voice will be described below.

3 is a flowchart illustrating a method of controlling a mobile terminal 100 according to an embodiment of the present invention. It is assumed that the mobile terminal 100 is connected to the call with the other mobile terminal 200 and receives identification information of the other mobile terminal 200 when connected to the other mobile terminal 200. As illustrated, the wireless communication unit 110 of the mobile terminal 100 is connected to the call with the other mobile terminal 200, and receives the voice signal of the other party from the mobile terminal 100 (S310).

Then, the controller 180 extracts voice feature information from the received voice (S320). The controller 180 may decompose the voice signal according to the frequency distribution and extract the voice feature information by digitizing (or diagramming) the voice signal.

Next, the controller 180 determines whether there is voice feature information that matches the extracted voice feature information among the voice feature information stored in the memory 160 (S330).

In relation to this, the controller 180 may receive a voice through the microphone 122 from one or more users 10 in advance, or receive a voice signal through the wireless communication unit 110, and receive the voice from the received voice or voice signal. Features can be parameterized. In addition, the memory unit 160 may store parameterized voice feature information for each user 10. Also, the memory unit 160 may store contact information of the user 10 corresponding to each voice feature information.

At this time, if the voice feature information stored in the memory 160 matches the extracted voice feature information stored in the memory 160, the controller 180 displays the contact information of the user 10 corresponding to the voice feature information stored in the memory 160. The identification information of the mobile terminal 200 is added (S340). At this time, the controller 180 may store the extracted voice feature information in the contact information.

Meanwhile, if the voice feature information stored in the memory 160 does not match the extracted voice feature information, the controller 180 generates new contact information in the memory 160 (S332) and extracts the generated contact information. The voice characteristic information can be stored.

Then, the controller 180 adds identification information of the other mobile terminal 200 to the generated contact information (S340).

Next, a control method of a mobile terminal 100 that stores contact information and identification information of another mobile terminal 200 through voice feature information extracted from the received voice signal will be described with reference to FIG. 4.

4 is an exemplary view showing a method of extracting voice feature information and storing contact information by the mobile terminal 100 according to an embodiment of the present invention. As shown in FIG. 4 (a), the mobile terminal 100 may be connected to another mobile terminal 200 by a call.

The mobile terminal 100 connected to the other mobile terminal 200 may display the identification information 400 of the other mobile terminal 200 on the display unit 151. Also, the display unit 151 may display an object menu 402 corresponding to a function that can be performed in connection with a call.

The wireless communication unit 110 receives a voice signal in which the voice of the user 20 of the other mobile terminal 200 is converted by the other mobile terminal 200, and the controller 180 extracts voice feature information from the received voice signal. can do.

In addition, the controller 180 may further display a notification window 404 indicating that the voice feature information is extracted on the display unit 151. The controller 180 may determine whether there is voice feature information that matches the extracted voice feature information among the voice feature information stored in the memory 160.

If there is voice feature information matching the extracted voice feature information in the memory 160, as shown in FIG. 4 (b), the controller 180 indicates that the voice feature information is consistent with the display unit 151. The notification window 408 can be displayed.

In addition, as shown in FIG. 4C, the controller 180 can display the contact information 410 corresponding to the voice feature information that matches the extracted voice feature information on the display unit 151. In addition, the controller 180 may further display a window 412 asking whether to add identification information of another mobile terminal 200 connected to the current call to the contact information corresponding to the voice feature information.

Accordingly, the mobile terminal 100 can easily add and store identification information of the other mobile terminal 200 to the previously stored contact information.

Next, a method of extracting voice feature information of the user 20 of the other mobile terminal 200 by the mobile terminal 100 will be described with reference to FIG. 5.

5 is an exemplary view showing a method of extracting voice feature information by the mobile terminal 100 according to an embodiment of the present invention. As shown in Fig. 5 (a), the other mobile terminal 200 has an object menu 502 corresponding to the identification information 500 of the mobile terminal 100 connected by a call and a function that can be performed in connection with a call. Can be displayed.

In addition, the wireless communication unit 110 may transmit a message for extracting voice feature information to another mobile terminal 200 connected by a call with the mobile terminal 100. That is, when connected to a call with another mobile terminal 200, the controller 180 may transmit a message including a phrase for extracting voice feature information through the wireless communication unit 110.

On the display unit 151 of the other mobile terminal 200 receiving the message transmitted from the mobile terminal 100, a guide phrase 504 related to extracting voice feature information and a phrase for facilitating voice feature information extraction ( 506) may be displayed together.

As shown in FIG. 5 (b), when the user 20 of the other mobile terminal 200 reads the phrase of extracting voice feature information, the voice of the user 20 of the other mobile terminal 200 reading the phrase is spoken. The signal is received by the mobile terminal 100 through the wireless communication unit 110. Then, as described in FIG. 4, the controller 180 can update the contact information through the voice feature information of the user 10 of the other mobile terminal 200.

Next, a description will be given of a method of outputting a notification phrase as voice using voice feature information stored in the mobile terminal 100.

6 is an exemplary view showing a method of outputting a sound using the voice feature information by the mobile terminal 100 according to an embodiment of the present invention. 6 (a) and 6 (b), the mobile terminal 100 may receive a call from at least one other mobile terminal 200.

For example, if the identification information of the other mobile terminal 200 to which the call originated is 010-1234-4321, and “John Park” where 010-1234-4321 is stored as a phone number in the contact information of the mobile terminal 100 exists , The mobile terminal 100 can inform the user 10 that a call is received from “John Park”.

The controller 180 may display “John Park” which is the user 20 of the other mobile terminal 200 that has sent the call to the display unit 151 and the identification information 600 of the other mobile terminal 200. In addition, the controller 180 may display a phrase 602 indicating that a call is received on the display unit 151. In addition, the controller 180 may further display an object connecting the call with the other mobile terminal 200.

At this time, if the contact information matching the identification information of the other mobile terminal 200 is stored in the memory unit 160, the controller 180 can output a notification phrase as a ring tone through the sound output module 152. Here, the ringing tone may be a ring tone output to the sound output module 152 when a call is received.

The controller 180 may output the pre-stored notification phrase using voice feature information stored in contact information matching the identification information of the other mobile terminal 200 on which the call was received.

As an example, as shown in FIG. 6 (a), the controller 180 may apply the voice feature information of “John Park” to the notification phrase and output it to the voice 606 through the sound output module 152.

As another example, as shown in FIG. 6 (b), if the identification information of the other mobile terminal 200 that originated the call is 010-4321-1234, the control unit 180 stores “Sophia Kim” in the corresponding contact information. The voice feature information of ”can be applied to the notification phrase and output through the audio output module 152 as the voice 608.

Next, with reference to FIGS. 7 and 8, functions that can be performed using voice feature information of the user 10 of the mobile terminal 100 will be described. The mobile terminal 100 may be set to restrict access to other users 10 to the information in the SIM card provided in the mobile terminal 100, information stored in the memory unit 160, and the mobile terminal 100 itself. .

Hereinafter, a file and a lock screen stored in the memory unit 160 with limited access using voice feature information will be described.

7 is an exemplary view showing a method in which the mobile terminal 100 according to an embodiment of the present invention displays access limited information through voice feature information, and FIG. 8 is a mobile terminal according to an embodiment of the present invention ( 100) is an exemplary view showing a method of releasing the lock screen through voice feature information.

As shown in FIG. 7A, the controller 180 can display an execution screen 700 of an application program for displaying at least one file stored in the memory 160. Also, the controller 180 may display the object 702 corresponding to at least one file. At this time, a file 704 in which a lock function is set by the voice feature information of the user 10 may exist in the memory 160. Then, the controller 180 may display an indicator 706 indicating that the file is a locked file on an object corresponding to the locked file.

Next, when an input for touching the object on which the indicator is displayed is received, as shown in FIG. 7B, the controller 180 can display a notification window 708 indicating that the file is a locked file. .

Then, as shown in FIG. 7 (c), the user 10 may input the unlocking voice to the mobile terminal 100. In one example, the user 10 may input the unlocking phrase 710 into the microphone 122 by voice.

Then, the controller 180 may extract voice feature information from the received unlocked voice. If the extracted voice feature information matches the voice feature information set with the lock function on the file, the controller 180 displays the file and indicates that the lock is released, as shown in FIG. 7 (d) ( 712).

Next, FIG. 8 (a) is a diagram showing a lock screen 800 of the mobile terminal 100. When receiving the input for touching the unlocking object 802 displayed on the lock screen, the controller 180 can operate the microphone 122 and receive the voice of the user 10 speaking the unlocking phrase.

As shown in FIG. 8 (b), the user 10 may input the unlocking voice to the mobile terminal 100. In one example, the user 10 may input the unlocking phrase 804 into the microphone 122 by voice.

Then, the controller 180 may extract voice feature information from the received unlocked voice. If the extracted voice feature information and the voice feature information set on the lock screen match, the controller 180 displays the home screen 806, as shown in FIG. 8 (c), and an indicator 808 indicating that the lock is released. ) Can be displayed.

It will be apparent to those skilled in the art that the present invention may be embodied in other specific forms without departing from the spirit and essential features of the present invention.

Accordingly, the above detailed description should not be construed as limiting in all respects, but should be considered illustrative. The scope of the present invention should be determined by rational interpretation of the appended claims, and all changes within the equivalent scope of the present invention are included in the scope of the present invention.

100: mobile terminal 110: wireless communication unit
120: A / V input / output unit 130: User input unit
140: sensing unit 150: output unit
160: memory 170: interface
180: control unit 190: power supply unit

Claims (7)

Wireless communication unit;
A memory storing at least one contact information including voice feature information; And
When the call is connected to the other terminal through the wireless communication unit, the wireless communication unit sends a message including the phrase so that a phrase to be input by the user of the other terminal into the other terminal is displayed on the call screen of the other terminal. Is transmitted to the counterpart terminal,
When the voice corresponding to the phrase is received from the counterpart terminal through the wireless communication unit, the voice feature information is extracted from the received voice,
And a control unit that adds identification information of the counterpart terminal to the specific contact information when the extracted voice feature information matches the voice feature information included in the specific contact information among the stored at least one contact information. delete delete According to claim 1,
And a microphone;
The controller extracts voice feature information from the voice received through the microphone, and stores the voice feature information in the memory. According to claim 4,
Further comprising a display unit for displaying the lock screen,
When the lock screen is displayed, the mobile terminal stops displaying the lock screen when a voice matching the voice feature information stored in the memory is received through the microphone. The method of claim 5,
The control unit locks the information stored in the memory using the voice feature information, and when a voice matching the voice feature information stored in the memory is received from the microphone, unlocks the lock screen to unlock the information stored in the memory. A mobile terminal that performs a related function. delete

Images