KR20160047267A - Mobile terminal and method for controlling the same - Google Patents

Abstract

The present invention relates to a mobile terminal and a method of controlling the same. The mobile terminal includes a mobile terminal main body having left, right, front and rear surfaces; a sensing unit having an acceleration sensor for sensing dynamic force generated from a tap tapping at least one of the surfaces of the main body, or a microphone for receiving an audio signal of a user; and a control unit for checking an operating state of a touch sensor provided in the main body, wherein when the touch sensor is abnormally operated as the checking result, the control unit controls at least one of executable functions of the mobile terminal based on the result of recognizing at least one of the surfaces of the main body tapped by the tap or a voice signal of a user.

Description

[0001] MOBILE TERMINAL AND METHOD FOR CONTROLLING THE SAME [0002]

The present invention relates to a mobile terminal and a control method thereof.

A terminal can be divided into a mobile / portable terminal and a stationary terminal depending on whether the terminal is movable or not. The mobile terminal can be divided into a handheld terminal and a vehicle mounted terminal according to whether the user can directly carry the mobile terminal.

The functions of mobile terminals are diversified. For example, there are data and voice communication, photographing and video shooting through a camera, voice recording, music file playback through a speaker system, and outputting an image or video on a display unit. Some terminals are equipped with an electronic game play function or a multimedia player function. In particular, modern mobile terminals can receive multicast signals that provide visual content such as broadcast and video or television programs.

Such a terminal has various functions, for example, in the form of a multimedia device having multiple functions such as photographing and photographing of a moving picture, reproduction of a music or video file, reception of a game and broadcasting, etc. .

In order to support and enhance the functionality of such terminals, it may be considered to improve the structural and / or software parts of the terminal.

Meanwhile, as the functions of the terminal are diversified as described above, various methods for controlling the mobile terminal more easily have been devised for each function. And as a method for controlling the terminal. A soft key input method using a touch input of the user on the display unit of the terminal, and the like. In this way, it is more convenient to use the soft key method, and it is possible to replace the physical key (hard key), so that the design of the terminal can be made more beautiful.

Thus, these soft key schemes are now widely used. However, in the case of such a soft key method, since the touch input of the user is detected, it is assumed that the touch sensor capable of detecting the touch input of the user operates correctly.

An object of the present invention is to provide a mobile terminal and a control method thereof that can be controlled by a user even when the touch sensor does not operate correctly.

Another object of the present invention is to provide a mobile terminal and a control method thereof that can provide a user interface including functions of a mobile terminal corresponding to a case where the touch sensor does not operate correctly.

According to an aspect of the present invention, there is provided a mobile terminal including a mobile terminal body having a left side surface, a right side surface, a front surface and a rear surface, at least one of the surfaces of the main body, An acceleration sensor for sensing a dynamic force generated from a tap for tapping a touch or a microphone for inputting a voice signal of a user, and a controller for checking the operation state of the touch sensor provided in the main body, At least one of the functions executable in the mobile terminal, based on a result of recognizing at least one surface of the body of the main body or a result of recognizing the user's voice signal when the sensor fails to operate normally, And a control unit for controlling the function of the control unit.

In one embodiment, the control unit may include a pattern formed by a sequence in which at least one of the faces of the main body is selected by the plurality of tabs when a plurality of tabs are applied to at least one of the faces of the main body, And releases the locked state of the mobile terminal based on a password input via the voice of the user.

In one embodiment, when the mobile terminal is unlocked when the touch sensor fails to operate normally as a result of the check, the control unit may be configured to allow the user to tap the specific surface of the main body And displaying a screen including graphic objects related to the set functions.

In one embodiment, when there is a user input for releasing the locked state of the mobile terminal, the control unit may determine whether the touch sensor is operating normally or not by using different patterns or different passwords, Is released from the locked state.

In one embodiment, the control unit checks whether the touch sensor operates normally when a predetermined period has expired or when there is a user's input for activating a display unit provided in the main body.

According to an aspect of the present invention, there is provided a method of controlling a mobile terminal, the method comprising: checking an operation state of a touch sensor provided in the mobile terminal; Detecting a user's input through other means than the touch sensor depending on whether the touch sensor operates normally or not, and controlling one of functions executable by the mobile terminal according to an input of the sensed user The acceleration sensor for sensing a dynamic force applied to one of the surfaces of the main body or the microphone for receiving a voice of a user.

Effects of the mobile terminal and the control method according to the present invention will be described as follows.

According to at least one of the embodiments of the present invention, it is possible to operate the mobile terminal so that a desired function can be executed even when a problem occurs in the touch sensor of the mobile terminal.

In addition, according to at least one embodiment of the present invention, even if a problem occurs in the touch sensor of the mobile terminal, the user can more easily select and execute a desired function.

1A is a block diagram illustrating a mobile terminal according to the present invention.
1B and 1C are conceptual diagrams illustrating an example of a mobile terminal according to the present invention in different directions.
2 is a diagram illustrating an example in which a mobile terminal related to the present invention operates when a problem occurs in a touch sensor.
3 is a flowchart illustrating an operation procedure of a mobile terminal according to the present invention.
FIG. 4 is a flowchart illustrating an operation performed by a mobile terminal according to an embodiment of the present invention to perform a specific function according to a user input sensed through other means when a problem occurs in the touch sensor.
5 is an exemplary diagram showing an example in which a music playback function is executed in a mobile terminal according to the present invention.
6 is an exemplary diagram illustrating an example of performing a call function according to an incoming call in a mobile terminal according to the present invention.
7 is an exemplary diagram illustrating an example in which a call is originated by a user in a mobile terminal related to the present invention.
8 is an exemplary view showing an example in which an incoming message is displayed in a mobile terminal according to the present invention.
9 is an exemplary view showing an example in which a message is transmitted in a mobile terminal according to the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings, wherein like or similar elements are denoted by the same or similar reference numerals, and redundant description thereof will be omitted. The suffix "module" and " part "for the components used in the following description are given or mixed in consideration of ease of specification, and do not have their own meaning or role. In the following description of the embodiments of the present invention, a detailed description of related arts will be omitted when it is determined that the gist of the embodiments disclosed herein may be blurred. It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory and are intended to provide further explanation of the invention as claimed. , ≪ / RTI > equivalents, and alternatives.

The mobile terminal described in this specification includes a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, a personal digital assistant (PDA), a portable multimedia player (PMP), a navigation device, a slate PC A tablet PC, an ultrabook, a wearable device such as a smartwatch, a smart glass, and a head mounted display (HMD). have.

However, it will be readily apparent to those skilled in the art that the configuration according to the embodiments described herein may be applied to fixed terminals such as a digital TV, a desktop computer, a digital signage, and the like, .

1A to 1C are block diagrams for explaining a mobile terminal according to the present invention, and FIGS. 1B and 1C are conceptual diagrams showing an example of a mobile terminal according to the present invention in different directions.

The mobile terminal 100 includes a wireless communication unit 110, an input unit 120, a sensing unit 140, an output unit 150, an interface unit 160, a memory 170, a control unit 180, ), And the like. The components shown in FIG. 1A are not essential for implementing a mobile terminal, so that the mobile terminal described herein may have more or fewer components than the components listed above.

The wireless communication unit 110 may be connected between the mobile terminal 100 and the wireless communication system or between the mobile terminal 100 and another mobile terminal 100 or between the mobile terminal 100 and the external server 100. [ Lt; RTI ID = 0.0 > wireless < / RTI > In addition, the wireless communication unit 110 may include one or more modules for connecting the mobile terminal 100 to one or more networks.

The wireless communication unit 110 may include at least one of a broadcast receiving module 111, a mobile communication module 112, a wireless Internet module 113, a short distance communication module 114, and a location information module 115 .

The input unit 120 includes a camera 121 or an image input unit for inputting a video signal, a microphone 122 for inputting an audio signal, an audio input unit, a user input unit 123 for receiving information from a user A touch key, a mechanical key, and the like). The voice data or image data collected by the input unit 120 may be analyzed and processed by a user's control command.

The sensing unit 140 may include at least one sensor for sensing at least one of information in the mobile terminal, surrounding environment information surrounding the mobile terminal, and user information. For example, the sensing unit 140 may include a proximity sensor 141, an illumination sensor 142, a touch sensor, an acceleration sensor, a magnetic sensor, A G-sensor, a gyroscope sensor, a motion sensor, an RGB sensor, an infrared sensor, a finger scan sensor, an ultrasonic sensor, A microphone 226, a battery gauge, an environmental sensor (for example, a barometer, a hygrometer, a thermometer, a radiation detection sensor, A thermal sensor, a gas sensor, etc.), a chemical sensor (e.g., an electronic nose, a healthcare sensor, a biometric sensor, etc.). Meanwhile, the mobile terminal disclosed in the present specification can combine and utilize information sensed by at least two of the sensors.

The output unit 150 includes at least one of a display unit 151, an acoustic output unit 152, a haptic tip module 153, and a light output unit 154 to generate an output related to visual, auditory, can do. The display unit 151 may have a mutual layer structure with the touch sensor or may be integrally formed to realize a touch screen. The touch screen may function as a user input unit 123 that provides an input interface between the mobile terminal 100 and a user and may provide an output interface between the mobile terminal 100 and a user.

The interface unit 160 serves as a path to various types of external devices connected to the mobile terminal 100. The interface unit 160 is connected to a device having a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, A video I / O port, and an earphone port, for example, as shown in FIG. 1. In the mobile terminal 100, corresponding to the connection of the external device to the interface unit 160, it is possible to perform appropriate control related to the connected external device.

In addition, the memory 170 stores data supporting various functions of the mobile terminal 100. The memory 170 may store a plurality of application programs or applications running on the mobile terminal 100, data for operation of the mobile terminal 100, and commands. At least some of these applications may be downloaded from an external server via wireless communication. Also, at least a part of these application programs may exist on the mobile terminal 100 from the time of shipment for the basic functions (e.g., telephone call receiving function, message receiving function, and calling function) of the mobile terminal 100. Meanwhile, the application program may be stored in the memory 170, installed on the mobile terminal 100, and may be operated by the control unit 180 to perform the operation (or function) of the mobile terminal.

In addition to the operations related to the application program, the control unit 180 typically controls the overall operation of the mobile terminal 100. The control unit 180 may process or process signals, data, information, and the like input or output through the above-mentioned components, or may drive an application program stored in the memory 170 to provide or process appropriate information or functions to the user.

In addition, the controller 180 may control at least some of the components illustrated in FIG. 1A in order to drive an application program stored in the memory 170. FIG. In addition, the controller 180 may operate at least two of the components included in the mobile terminal 100 in combination with each other for driving the application program.

The power supply unit 190 receives external power and internal power under the control of the controller 180 and supplies power to the components included in the mobile terminal 100. The power supply unit 190 includes a battery, which may be an internal battery or a replaceable battery.

At least some of the components may operate in cooperation with one another to implement a method of operation, control, or control of a mobile terminal according to various embodiments described below. In addition, the operation, control, or control method of the mobile terminal may be implemented on the mobile terminal by driving at least one application program stored in the memory 170. [

Hereinafter, the various components of the mobile terminal 100 will be described in detail with reference to FIG. 1A.

First, referring to the wireless communication unit 110, the broadcast receiving module 111 of the wireless communication unit 110 receives broadcast signals and / or broadcast-related information from an external broadcast management server through a broadcast channel. The broadcast channel may include a satellite channel and a terrestrial channel. Two or more broadcast receiving modules may be provided to the mobile terminal 100 for simultaneous broadcast reception or broadcast channel switching for at least two broadcast channels.

The mobile communication module 112 may be a mobile communication module or a mobile communication module such as a mobile communication module or a mobile communication module that uses technology standards or a communication method (e.g., Global System for Mobile communication (GSM), Code Division Multi Access (CDMA), Code Division Multi Access 2000 (Enhanced Voice-Data Optimized or Enhanced Voice-Data Only), Wideband CDMA (WCDMA), High Speed Downlink Packet Access (HSDPA), High Speed Uplink Packet Access (HSUPA), Long Term Evolution (LTE) And an external terminal, or a server on a mobile communication network established according to a long term evolution (e. G., Long Term Evolution-Advanced).

The wireless signal may include various types of data depending on a voice call signal, a video call signal or a text / multimedia message transmission / reception.

The wireless Internet module 113 is a module for wireless Internet access, and may be built in or externally attached to the mobile terminal 100. The wireless Internet module 113 is configured to transmit and receive a wireless signal in a communication network according to wireless Internet technologies.

Wireless Internet technologies include, for example, wireless LAN (WLAN), wireless fidelity (Wi-Fi), wireless fidelity (Wi-Fi) Direct, DLNA (Digital Living Network Alliance), WiBro Interoperability for Microwave Access, High Speed Downlink Packet Access (HSDPA), High Speed Uplink Packet Access (HSUPA), Long Term Evolution (LTE) and Long Term Evolution-Advanced (LTE-A) 113 transmit and receive data according to at least one wireless Internet technology, including Internet technologies not listed above.

The wireless Internet module 113 for performing a wireless Internet connection through the mobile communication network can be used for wireless Internet access by WiBro, HSDPA, HSUPA, GSM, CDMA, WCDMA, LTE or LTE- May be understood as a kind of the mobile communication module 112.

The short-range communication module 114 is for short-range communication, and includes Bluetooth ™, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB) (Near Field Communication), Wi-Fi (Wireless-Fidelity), Wi-Fi Direct, and Wireless USB (Wireless Universal Serial Bus) technology. The short-range communication module 114 is connected to the mobile terminal 100 and the wireless communication system through the wireless area networks, between the mobile terminal 100 and another mobile terminal 100, or between the mobile terminal 100 ) And the other mobile terminal 100 (or the external server). The short-range wireless communication network may be a short-range wireless personal area network.

Here, the other mobile terminal 100 may be a wearable device (e.g., a smart watch, a smart phone, etc.) capable of exchanging data with the mobile terminal 100 according to the present invention Glass (smart glass), HMD (head mounted display)). The short range communication module 114 may detect (or recognize) a wearable device capable of communicating with the mobile terminal 100 around the mobile terminal 100. [ If the detected wearable device is a device authenticated to communicate with the mobile terminal 100 according to the present invention, the control unit 180 may transmit at least a part of the data processed by the mobile terminal 100 to the short- 114 to the wearable device. Therefore, the user of the wearable device can use the data processed by the mobile terminal 100 through the wearable device. For example, according to this, when a telephone is received in the mobile terminal 100, the user performs a telephone conversation via the wearable device, or when a message is received in the mobile terminal 100, It is possible to check the message.

The position information module 115 is a module for obtaining the position (or current position) of the mobile terminal, and a representative example thereof is a Global Positioning System (GPS) module or a Wireless Fidelity (WiFi) module. For example, when the mobile terminal utilizes the GPS module, it can acquire the position of the mobile terminal by using a signal transmitted from the GPS satellite. As another example, when the mobile terminal utilizes the Wi-Fi module, it can acquire the position of the mobile terminal based on information of a wireless access point (AP) that transmits or receives the wireless signal with the Wi-Fi module. Optionally, the location information module 115 may perform any of the other functions of the wireless communication unit 110 to obtain data relating to the location of the mobile terminal, in addition or alternatively. The location information module 115 is a module used to obtain the location (or current location) of the mobile terminal, and is not limited to a module that directly calculates or obtains the location of the mobile terminal.

Next, the input unit 120 is for inputting image information (or signal), audio information (or signal), data, or information input from a user. For inputting image information, Or a plurality of cameras 121 may be provided. The camera 121 processes image frames such as still images or moving images obtained by the image sensor in the video communication mode or the photographing mode. The processed image frame may be displayed on the display unit 151 or stored in the memory 170. [ A plurality of cameras 121 provided in the mobile terminal 100 may be arranged to have a matrix structure and various angles or foci may be provided to the mobile terminal 100 through the camera 121 having the matrix structure A plurality of pieces of image information can be input. In addition, the plurality of cameras 121 may be arranged in a stereo structure so as to acquire a left image and a right image for realizing a stereoscopic image.

The microphone 122 processes the external acoustic signal into electrical voice data. The processed voice data can be utilized variously according to a function (or a running application program) being executed in the mobile terminal 100. Meanwhile, the microphone 122 may be implemented with various noise reduction algorithms for eliminating noise generated in receiving an external sound signal.

The user input unit 123 is for receiving information from a user and when the information is inputted through the user input unit 123, the control unit 180 can control the operation of the mobile terminal 100 to correspond to the input information . The user input unit 123 may include a mechanical input unit or a mechanical key such as a button located on the rear or side of the mobile terminal 100, a dome switch, a jog wheel, Jog switches, etc.) and touch-type input means. For example, the touch-type input means may comprise a virtual key, a soft key or a visual key displayed on the touch screen through software processing, And a touch key disposed on the touch panel. Meanwhile, the virtual key or the visual key can be displayed on a touch screen having various forms, for example, a graphic, a text, an icon, a video, As shown in FIG.

Meanwhile, the sensing unit 140 senses at least one of information in the mobile terminal, surrounding environment information surrounding the mobile terminal, and user information, and generates a corresponding sensing signal. The control unit 180 may control the driving or operation of the mobile terminal 100 or may perform data processing, function or operation related to the application program installed in the mobile terminal 100 based on the sensing signal. Representative sensors among various sensors that may be included in the sensing unit 140 will be described in more detail.

First, the proximity sensor 141 refers to a sensor that detects the presence of an object approaching a predetermined detection surface, or the presence of an object in the vicinity of the detection surface, without mechanical contact by using electromagnetic force or infrared rays. The proximity sensor 141 may be disposed in the inner area of the mobile terminal or in proximity to the touch screen, which is covered by the touch screen.

Examples of the proximity sensor 141 include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, and an infrared proximity sensor. In the case where the touch screen is electrostatic, the proximity sensor 141 can be configured to detect the proximity of the object with a change of the electric field along the proximity of the object having conductivity. In this case, the touch screen (or touch sensor) itself may be classified as a proximity sensor.

On the other hand, for convenience of explanation, the act of recognizing that the object is located on the touch screen in proximity to the touch screen without touching the object is referred to as "proximity touch" The act of actually touching an object on the screen is called a "contact touch. &Quot; The position at which the object is closely touched on the touch screen means a position where the object corresponds to the touch screen vertically when the object is touched. The proximity sensor 141 can detect a proximity touch and a proximity touch pattern (e.g., a proximity touch distance, a proximity touch direction, a proximity touch speed, a proximity touch time, a proximity touch position, have. Meanwhile, the control unit 180 processes data (or information) corresponding to the proximity touch operation and the proximity touch pattern sensed through the proximity sensor 141 as described above, and further provides visual information corresponding to the processed data It can be output on the touch screen. Furthermore, the control unit 180 can control the mobile terminal 100 such that different operations or data (or information) are processed according to whether the touch to the same point on the touch screen is a proximity touch or a touch touch .

The touch sensor senses a touch (or touch input) applied to the touch screen (or the display unit 151) by using at least one of various touch methods such as a resistance film type, a capacitive type, an infrared type, an ultrasonic type, do.

For example, the touch sensor may be configured to convert a change in a pressure applied to a specific portion of the touch screen or a capacitance generated in a specific portion to an electrical input signal. The touch sensor may be configured to detect a position, an area, a pressure at the time of touch, a capacitance at the time of touch, and the like where a touch object touching the touch screen is touched on the touch sensor. Here, the touch object may be a finger, a touch pen, a stylus pen, a pointer, or the like as an object to which a touch is applied to the touch sensor.

Thus, when there is a touch input to the touch sensor, the corresponding signal (s) is sent to the touch controller. The touch controller processes the signal (s) and transmits the corresponding data to the controller 180. Thus, the control unit 180 can know which area of the display unit 151 is touched or the like. Here, the touch controller may be a separate component from the control unit 180, and may be the control unit 180 itself.

On the other hand, the control unit 180 may perform different controls or perform the same control according to the type of the touch object touching the touch screen (or a touch key provided on the touch screen). Whether to perform different controls or to perform the same control according to the type of the touch object may be determined according to the current state of the mobile terminal 100 or an application program being executed.

On the other hand, the touch sensors and the proximity sensors discussed above can be used independently or in combination to provide a short touch (touch), a long touch, a multi touch, a drag touch ), Flick touch, pinch-in touch, pinch-out touch, swipe touch, hovering touch, and the like. Touch can be sensed.

The ultrasonic sensor can recognize the position information of the object to be sensed by using ultrasonic waves. Meanwhile, the controller 180 can calculate the position of the wave generating source through the information sensed by the optical sensor and the plurality of ultrasonic sensors. The position of the wave source can be calculated using the fact that the light is much faster than the ultrasonic wave, that is, the time when the light reaches the optical sensor is much faster than the time the ultrasonic wave reaches the ultrasonic sensor. More specifically, the position of the wave generating source can be calculated using the time difference with the time when the ultrasonic wave reaches the reference signal.

The camera 121 includes at least one of a camera sensor (for example, a CCD, a CMOS, etc.), a photo sensor (or an image sensor), and a laser sensor.

The camera 121 and the laser sensor may be combined with each other to sense a touch of the sensing object with respect to the three-dimensional stereoscopic image. The photosensor can be laminated to the display element, which is adapted to scan the movement of the object to be detected proximate to the touch screen. More specifically, the photosensor mounts photo diodes and TRs (Transistors) in a row / column and scans the contents loaded on the photosensor using an electrical signal that varies according to the amount of light applied to the photo diode. That is, the photo sensor performs coordinate calculation of the object to be sensed according to the amount of change of light, and position information of the object to be sensed can be obtained through the calculation.

The display unit 151 displays (outputs) information processed by the mobile terminal 100. For example, the display unit 151 may display execution screen information of an application program driven by the mobile terminal 100 or UI (User Interface) and GUI (Graphic User Interface) information according to the execution screen information .

Also, the display unit 151 may be configured as a stereoscopic display unit for displaying a stereoscopic image.

In the stereoscopic display unit, a three-dimensional display system such as a stereoscopic system (glasses system), an autostereoscopic system (no-glasses system), and a projection system (holographic system) can be applied.

The sound output unit 152 may output audio data received from the wireless communication unit 110 or stored in the memory 170 in a call signal reception mode, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, The sound output unit 152 also outputs sound signals related to functions (e.g., call signal reception sound, message reception sound, etc.) performed in the mobile terminal 100. [ The audio output unit 152 may include a receiver, a speaker, a buzzer, and the like.

The haptic module 153 generates various tactile effects that the user can feel. A typical example of the haptic effect generated by the haptic module 153 may be vibration. The intensity and pattern of the vibration generated in the haptic module 153 can be controlled by the user's selection or the setting of the control unit. For example, the haptic module 153 may synthesize and output different vibrations or sequentially output the vibrations.

In addition to vibration, the haptic module 153 may be configured to perform various functions such as a pin arrangement vertically moving with respect to the contact skin surface, a spraying force or suction force of the air through the injection port or the suction port, a touch on the skin surface, And various tactile effects such as an effect of reproducing a cold sensation using an endothermic or exothermic element can be generated.

The haptic module 153 can transmit the tactile effect through the direct contact, and the tactile effect can be felt by the user through the muscles of the finger or arm. The haptic module 153 may include two or more haptic modules 153 according to the configuration of the mobile terminal 100.

The light output unit 154 outputs a signal for notifying the occurrence of an event using the light of the light source of the mobile terminal 100. Examples of events that occur in the mobile terminal 100 may include message reception, call signal reception, missed call, alarm, schedule notification, email reception, information reception through an application, and the like.

The signal output from the light output unit 154 is implemented as the mobile terminal emits light of a single color or a plurality of colors to the front or rear surface. The signal output may be terminated by the mobile terminal detecting the event confirmation of the user.

The interface unit 160 serves as a path for communication with all external devices connected to the mobile terminal 100. The interface unit 160 receives data from an external device or supplies power to each component in the mobile terminal 100 or transmits data in the mobile terminal 100 to an external device. For example, it is possible to connect a device equipped with a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, An audio input / output port, a video I / O port, an earphone port, and the like may be included in the interface unit 160.

The identification module is a chip for storing various information for authenticating the use right of the mobile terminal 100 and includes a user identification module (UIM), a subscriber identity module (SIM) A universal subscriber identity module (USIM), and the like. Devices with identification modules (hereinafter referred to as "identification devices") can be manufactured in a smart card format. Accordingly, the identification device can be connected to the terminal 100 through the interface unit 160. [

The interface unit 160 may be a path through which power from the cradle is supplied to the mobile terminal 100 when the mobile terminal 100 is connected to an external cradle, And various command signals may be transmitted to the mobile terminal 100. The various command signals or the power source input from the cradle may be operated as a signal for recognizing that the mobile terminal 100 is correctly mounted on the cradle.

The memory 170 may store a program for the operation of the controller 180 and temporarily store input / output data (e.g., phone book, message, still image, moving picture, etc.). The memory 170 may store data related to vibration and sound of various patterns outputted when a touch is input on the touch screen.

The memory 170 may be a flash memory type, a hard disk type, a solid state disk type, an SDD type (Silicon Disk Drive type), a multimedia card micro type ), Card type memory (e.g., SD or XD memory), random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read -only memory, a programmable read-only memory (PROM), a magnetic memory, a magnetic disk, and an optical disk. The mobile terminal 100 may operate in association with a web storage that performs the storage function of the memory 170 on the Internet.

Meanwhile, as described above, the control unit 180 controls the operations related to the application program and the general operation of the mobile terminal 100. [ For example, when the state of the mobile terminal meets a set condition, the control unit 180 can execute or release a lock state for restricting input of a user's control command to applications.

In addition, the control unit 180 performs control and processing related to voice communication, data communication, video call, or the like, or performs pattern recognition processing to recognize handwriting input or drawing input performed on the touch screen as characters and images, respectively . Further, the controller 180 may control any one or a plurality of the above-described components in order to implement various embodiments described below on the mobile terminal 100 according to the present invention.

The power supply unit 190 receives external power and internal power under the control of the controller 180 and supplies power necessary for operation of the respective components. The power supply unit 190 includes a battery, the battery may be an internal battery configured to be chargeable, and may be detachably coupled to the terminal body for charging or the like.

In addition, the power supply unit 190 may include a connection port, and the connection port may be configured as an example of an interface 160 through which an external charger for supplying power for charging the battery is electrically connected.

As another example, the power supply unit 190 may be configured to charge the battery in a wireless manner without using the connection port. In this case, the power supply unit 190 may use at least one of an inductive coupling method based on a magnetic induction phenomenon from an external wireless power transmission apparatus and a magnetic resonance coupling method based on an electromagnetic resonance phenomenon Power can be delivered.

In the following, various embodiments may be embodied in a recording medium readable by a computer or similar device using, for example, software, hardware, or a combination thereof.

Meanwhile, the sensing unit 140 of the mobile terminal 100 according to an embodiment of the present invention may include a tab sensing unit for sensing a tab or a tab gesture that the user hits the main body or the display unit 151 143).

Here, the tap sensing unit 143 may sense the main body of the mobile terminal 100, the display unit 151, or a gesture of tapping an object. More specifically, the tab may be a tap object such as a finger or the like that lightly touches the body of the mobile terminal 100 or the display unit 151 or an object or tap object to the body of the mobile terminal 100, the display unit 151, It can be understood as an operation of making contact.

The tap object to which the tab is applied may be a body of the mobile terminal 100 or a display unit 151 or an object capable of applying an external force to an object. For example, a finger, a stylus pen, a pen, a pointer, a fist, and the like. The tap object is not limited to an object that can input a touch input to the mobile terminal 100 according to the present invention. The tap object may be a touch screen that can apply an external force to the mobile terminal 100, the display unit 151, If it is an object, its kind is irrelevant.

The object to which the tap gesture is applied may include at least one of the body of the mobile terminal 100, the display unit 151, and the object on which the mobile terminal 100 is placed.

Meanwhile, in the present invention, the tap or tap gesture may be detected by at least one of the acceleration sensor and the touch sensor included in the tap sensing unit 143. [ Here, the acceleration sensor is a sensor capable of measuring dynamic force such as acceleration, vibration, shock, etc. of the main body of the mobile terminal 100.

That is, the acceleration sensor can detect movement (or vibration) of the main body of the mobile terminal 100 generated by the tap gesture and detect whether the tap is applied to the object. Accordingly, the acceleration sensor may detect the taps of the mobile terminal 100 or the display unit 151, or may detect a movement or a vibration of the mobile terminal 100, It is possible to detect that an object positioned close to the object is tapped.

As long as the acceleration sensor can detect movement or vibration of the main body of the mobile terminal 100 as well as when the tab is applied to the mobile terminal 100 or the display unit 151, It is possible to detect the tab even if it is applied to an off-site.

In the mobile terminal according to the present invention, either one of the acceleration sensor and the touch sensor is used, the acceleration sensor and the touch sensor are sequentially used to detect the tabs on the main body of the mobile terminal 100 or the display unit 151 , Or an acceleration sensor and a touch sensor can be used at the same time. On the other hand, in order to sense a tap, a mode using only an acceleration sensor may be named as a first mode, a mode using a touch sensor may be referred to as a second mode, and both the acceleration sensor and the touch sensor may be used Mode) may be referred to as a third mode or a hybrid mode.

On the other hand, when the tab is sensed through the touch sensor, it is possible to more accurately grasp the position where the tab is sensed.

Meanwhile, in the mobile terminal 100 according to the present invention, in order to sense the tab through the acceleration sensor or the touch sensor, when the display unit 151 of the mobile terminal 100 is in a deactivated state, It can operate in a specific mode. This particular mode may be referred to as a 'doze mode'.

For example, in the doze mode, in a touch screen structure in which a touch sensor and a display unit 151 have a mutual layer structure, only a light emitting element for outputting a screen in the display unit 151 is turned off, The sensor may be in the on-state state. Alternatively, the doze mode may be a mode in which the display unit 151 is turned off and the acceleration sensor is kept in an on-state. Alternatively, the dose mode may be a mode in which the display unit 151 is turned off, and both the touch sensor and the acceleration sensor are kept on.

Therefore, when the user is in the doze mode, that is, when the display 151 is turned off, or when the display 151 is turned off (the display 151 is disabled) When the tap is applied to at least one point on the mobile terminal 100 or a specific point of the main body of the mobile terminal 100, it is possible to detect that the tap is applied from the user through at least one of the on- have.

Also, the tap detection unit 143 may determine that a "tab" for controlling the mobile terminal 100 has been detected only when at least two or more tabs are applied within the reference time. For example, when one tap is applied to the display unit 151 by a touch object capable of applying a touch to the display unit 151, the tab sensing unit 143 outputs the one tap as a touch input Can be recognized. That is, in this case, the control unit 180 does not control the function corresponding to the one tap, but the function corresponding to the touch input corresponding to the one tap (for example, A function of selecting an icon) can be controlled.

Accordingly, the control unit 180 may control the operation of one or more functions only when at least two or more tabs (or a plurality of times) that are continuously applied within the reference time are detected by the tap detection unit 143, Quot; tab " is detected.

That is, tap gestures may mean that at least two or more tap gestures are continuously sensed within a reference time. Accordingly, in the following description, the detection of the "tap " may mean that the touch of the user, such as the user's finger or the touch pen, has been detected to the main body or the display unit 151 of the mobile terminal 100 a plurality of times .

In addition, the controller 180 may determine whether the tab is sensed by the user's other finger or one finger, as well as that the tab is sensed within the reference time. For example, when the tabs are sensed by the display unit 151, the controller 180 determines whether the tabs are formed through one finger or through different fingers Can be detected. Alternatively, the control unit 180 recognizes the position where the taps are sensed on the display unit 151 or the acceleration generated due to the taps through at least one of the touch sensor or the acceleration sensor provided in the tap sensing unit 143, You can detect if the tabs are made with one finger or each with a different finger.

Further, the controller 180 may further determine whether the user has input the tabs through one hand or one finger, or whether the user has input through the two hands or at least two fingers It is possible to judge whether or not it is inputted.

The taps may be a plurality of tapes continuously sensed within the reference time. Here, the reference time may be a very short time, for example, 300 ms to 2 s or less.

If the tap detecting unit 143 detects that the main body of the mobile terminal 100 is tapped for the first time, the tap detecting unit 143 detects the first tapping, Can be detected. If the next tap is detected within the reference time, the tap sensing unit 143 or the control unit 180 senses a tab for controlling a specific function of the mobile terminal 100 according to an embodiment of the present invention It can be judged. In this way, the controller 180 recognizes the tab as a valid tap only when the second tab is detected within a predetermined time after the first tab is detected, thereby determining whether the user wants to control the mobile terminal 100, It is possible to distinguish whether a tab is added or not.

There are various methods for allowing the 'valid tap' to be recognized. For example, the control unit 180 may display the main body or the display unit 151 by a second reference number or a second reference number within a predetermined time after a first tap touched by a first reference number or more than a first reference number is detected, It may be recognized that the second tap that is knocked more than the number of times is detected as the 'valid tap'. Here, the number of the first reference times and the number of the second reference times may be equal to or different from each other. For example, the first reference number may be one, and the second reference number may be two. As another example, the first reference number and the second reference number may all be one.

Also, the control unit 180 can determine that the "tabs " are detected only when the tab is within the" predetermined area ". That is, when it is detected that the main body of the mobile terminal 100 or the display unit 151 is tapped for the first time, the control unit 180 may calculate a predetermined area from the point where the first tapping is detected. Then, the control unit 180 determines whether or not the first beat is followed by the first or second reference count or the first or second reference count or more within the reference time from the time when the first beat is detected, It can be determined that the first tab or the second tab is applied.

It is to be understood that the reference time and the predetermined region may be variously modified according to the embodiment.

Meanwhile, the first tap and the second tap may be sensed not only as a reference time and a predetermined area, but also as separate tabs depending on the detected position of each tab. That is, the controller 180 may determine that the first tab and the second tab are applied when the second tab is detected at a position spaced apart by a predetermined distance from the position where the first tab is sensed. When the first tap and the second tap are recognized based on the sensed position, the first tap and the second tap may be simultaneously detected.

Also, when the first tap and the second tap are configured by a plurality of touches, that is, a plurality of tapes, a plurality of touches constituting the first tap and the second tap may be simultaneously detected. For example, when the first touch constituting the first tab is detected and the first touch constituting the second tab is positioned at a position spaced apart from the position where the first touch of the first tab is sensed If it is sensed, the controller 180 can sense the first touch constituting the first tap and the second tap, respectively. The control unit 180 senses additional touch input sensed at each position and determines that the first tap and the second tap are applied when a touch is detected at a first reference frequency or at a second reference frequency at each of the positions can do.

If the tab of the main body of the mobile terminal 100 is detected a plurality of times from the tab detecting unit 143, the controller 180 determines at least one of the functions executable by the mobile terminal 100 One can be controlled.

For example, the control unit 180 may control at least one of the functions executable on the mobile terminal when the plurality of tabs meet the predetermined condition. For example, the control unit 180 may control different functions depending on whether the user uses only one finger or one hand, or at least two fingers or both hands when the user applies the plurality of tabs. Or at least one of the functions executable in the mobile terminal 100 based on the current operation state of the mobile terminal 100 and the environmental state of the mobile terminal 100 may be controlled based on the plurality of taps.

Here, the functions that can be executed on the mobile terminal 100 may mean all kinds of functions that can be executed or operated on the mobile terminal 100. For example, one of the executable functions may be an application installed in the mobile terminal 100. For example, " an arbitrary function is executed " may mean that " an arbitrary application is executed or driven in the mobile terminal 100 ".

As another example, a function executable in the mobile terminal 100 may be a function necessary for the basic operation of the mobile terminal 100. [ For example, the functions necessary for the basic operation may be a function of turning on / off the illumination provided on the display unit 151, switching the mobile terminal 100 from the released state to the locked state, A function of switching to the released state, a function of setting the communication network, a function of changing the setting information of the mobile terminal 100, and the like. Here, the locked state means that at least one of the functions available in the mobile terminal 100 according to the embodiment of the present invention is restricted. For example, when the control command reception is restricted by the user, It may mean.

Hereinafter, a structure of a mobile terminal or a mobile terminal in which components of a mobile terminal or a mobile terminal according to an embodiment of the present invention shown in FIG. 1A is arranged will be described with reference to FIGS. 1B and 1C.

Referring to FIGS. 1B and 1C, the disclosed mobile terminal 100 includes a bar-shaped terminal body. However, the present invention is not limited thereto and can be applied to various structures such as a folder type, a flip type, a slide type, a swing type, and a swivel type in which a watch type, a clip type, a glass type or two or more bodies are relatively movably coupled . A description of a particular type of mobile terminal, although relevant to a particular type of mobile terminal, is generally applicable to other types of mobile terminals.

Here, the terminal body can be understood as a concept of referring to the mobile terminal 100 as at least one aggregate.

The mobile terminal 100 includes a case (for example, a frame, a housing, a cover, and the like) that forms an appearance. As shown, the mobile terminal 100 may include a front case 101 and a rear case 102. Various electronic components are disposed in the inner space formed by the combination of the front case 101 and the rear case 102. At least one middle case may be additionally disposed between the front case 101 and the rear case 102.

A display unit 151 is disposed on a front surface of the terminal body to output information. The window 151a of the display unit 151 may be mounted on the front case 101 to form a front surface of the terminal body together with the front case 101. [

In some cases, electronic components may also be mounted on the rear case 102. Electronic parts that can be mounted on the rear case 102 include detachable batteries, an identification module, a memory card, and the like. In this case, a rear cover 103 for covering the mounted electronic components can be detachably coupled to the rear case 102. Therefore, when the rear cover 103 is separated from the rear case 102, the electronic parts mounted on the rear case 102 are exposed to the outside.

As shown, when the rear cover 103 is coupled to the rear case 102, a side portion of the rear case 102 can be exposed. In some cases, the rear case 102 may be completely covered by the rear cover 103 during the engagement. Meanwhile, the rear cover 103 may be provided with an opening for exposing the camera 121b and the sound output unit 152b to the outside.

These cases 101, 102, and 103 may be formed by injection molding of synthetic resin or may be formed of metal such as stainless steel (STS), aluminum (Al), titanium (Ti), or the like.

The mobile terminal 100 may be configured such that one case provides the internal space, unlike the above example in which a plurality of cases provide an internal space for accommodating various electronic components. In this case, a unibody mobile terminal 100 in which synthetic resin or metal is connected from the side to the rear side can be realized.

Meanwhile, the mobile terminal 100 may include a waterproof unit (not shown) for preventing water from penetrating into the terminal body. For example, the waterproof portion is provided between the window 151a and the front case 101, between the front case 101 and the rear case 102, or between the rear case 102 and the rear cover 103, And a waterproof member for sealing the inside space of the oven.

The mobile terminal 100 is provided with a display unit 151, first and second sound output units 152a and 152b, a proximity sensor 141, an illuminance sensor 142, a light output unit 154, Cameras 121a and 121b, first and second operation units 123a and 123b, a microphone 122, an interface unit 160, and the like.

1B and 1C, a display unit 151, a first sound output unit 152a, a proximity sensor 141, an illuminance sensor 142, an optical output unit (not shown) A first camera 121a and a first operation unit 123a are arranged on a side of the terminal body and a second operation unit 123b, a microphone 122 and an interface unit 160 are disposed on a side surface of the terminal body, And a mobile terminal 100 having a second sound output unit 152b and a second camera 121b disposed on a rear surface thereof.

However, these configurations are not limited to this arrangement. These configurations may be excluded or replaced as needed, or placed on different planes. For example, the first operation unit 123a may not be provided on the front surface of the terminal body, and the second sound output unit 152b may be provided on the side surface of the terminal body rather than the rear surface of the terminal body.

The display unit 151 displays (outputs) information processed by the mobile terminal 100. For example, the display unit 151 may display execution screen information of an application program driven by the mobile terminal 100 or UI (User Interface) and GUI (Graphic User Interface) information according to the execution screen information .

The display unit 151 may be a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), a flexible display display, a 3D display, and an e-ink display.

In addition, the display unit 151 may exist in two or more depending on the embodiment of the mobile terminal 100. In this case, the mobile terminal 100 may be provided with a plurality of display portions spaced apart from each other or disposed integrally with one another, or may be disposed on different surfaces, respectively.

The display unit 151 may include a touch sensor that senses a touch with respect to the display unit 151 so that a control command can be received by a touch method. When a touch is made to the display unit 151, the touch sensor senses the touch, and the control unit 180 generates a control command corresponding to the touch based on the touch. The content input by the touch method may be a letter or a number, an instruction in various modes, a menu item which can be designated, and the like.

The touch sensor may be a film having a touch pattern and disposed between the window 151a and a display (not shown) on the rear surface of the window 151a, or may be a metal wire . Alternatively, the touch sensor may be formed integrally with the display. For example, the touch sensor may be disposed on a substrate of the display or inside the display.

In this way, the display unit 151 can form a touch screen together with the touch sensor. In this case, the touch screen can function as a user input unit 123 (see FIG. 1A). In some cases, the touch screen may replace at least some functions of the first operation unit 123a.

The first sound output unit 152a may be implemented as a receiver for transmitting a call sound to a user's ear and the second sound output unit 152b may be implemented as a loud speaker for outputting various alarm sounds or multimedia playback sounds. ). ≪ / RTI >

The window 151a of the display unit 151 may be provided with an acoustic hole for emitting the sound generated from the first acoustic output unit 152a. However, the present invention is not limited to this, and the sound may be configured to be emitted along an assembly gap (for example, a gap between the window 151a and the front case 101) between the structures. In this case, the appearance of the mobile terminal 100 can be made more simple because the hole formed independently for the apparent acoustic output is hidden or hidden.

The optical output unit 154 is configured to output light for notifying the occurrence of an event. Examples of the event include a message reception, a call signal reception, a missed call, an alarm, a schedule notification, an email reception, and reception of information through an application. The control unit 180 may control the light output unit 154 to terminate the light output when the event confirmation of the user is detected.

The first camera 121a processes an image frame of a still image or a moving image obtained by the image sensor in the photographing mode or the video communication mode. The processed image frame can be displayed on the display unit 151 and can be stored in the memory 170. [

The first and second operation units 123a and 123b may be collectively referred to as a manipulating portion as an example of a user input unit 123 operated to receive a command for controlling the operation of the mobile terminal 100 have. The first and second operation units 123a and 123b can be employed in any manner as long as the user is in a tactile manner such as touch, push, scroll, or the like. In addition, the first and second operation units 123a and 123b may be employed in a manner that the user operates the apparatus without touching the user through a proximity touch, a hovering touch, or the like.

In this figure, the first operation unit 123a is a touch key, but the present invention is not limited thereto. For example, the first operation unit 123a may be a mechanical key or a combination of a touch key and a touch key.

The contents input by the first and second operation units 123a and 123b can be variously set. For example, the first operation unit 123a receives a command such as a menu, a home key, a cancellation, a search, and the like, and the second operation unit 123b receives a command from the first or second sound output unit 152a or 152b The size of the sound, and the change of the display unit 151 to the touch recognition mode.

On the other hand, a rear input unit (not shown) may be provided on the rear surface of the terminal body as another example of the user input unit 123. The rear input unit is operated to receive a command for controlling the operation of the mobile terminal 100, and input contents may be variously set. For example, commands such as power on / off, start, end, scrolling, and the like, the size adjustment of the sound output from the first and second sound output units 152a and 152b, And the like can be inputted. The rear input unit may be implemented as a touch input, a push input, or a combination thereof.

The rear input unit may be disposed so as to overlap with the front display unit 151 in the thickness direction of the terminal body. For example, the rear input unit may be disposed at the rear upper end of the terminal body such that when the user holds the terminal body with one hand, the rear input unit can be easily manipulated using the index finger. However, the present invention is not limited thereto, and the position of the rear input unit may be changed.

When a rear input unit is provided on the rear surface of the terminal body, a new type of user interface using the rear input unit can be realized. When the first operation unit 123a is not disposed on the front surface of the terminal body in place of at least a part of the functions of the first operation unit 123a provided on the front surface of the terminal body, The display unit 151 may be configured as a larger screen.

Meanwhile, the mobile terminal 100 may be provided with a fingerprint recognition sensor for recognizing the fingerprint of the user, and the controller 180 may use the fingerprint information sensed through the fingerprint recognition sensor as authentication means. The fingerprint recognition sensor may be embedded in the display unit 151 or the user input unit 123.

The microphone 122 is configured to receive the user's voice, other sounds, and the like. The microphone 122 may be provided at a plurality of locations to receive stereophonic sound.

The interface unit 160 is a path through which the mobile terminal 100 can be connected to an external device. For example, the interface unit 160 may include a connection terminal for connection with another device (for example, an earphone or an external speaker), a port for short-range communication (for example, an infrared port (IrDA Port), a Bluetooth port A wireless LAN port, or the like), or a power supply terminal for supplying power to the mobile terminal 100. The interface unit 160 may be implemented as a socket for receiving an external card such as a SIM (Subscriber Identification Module) or a UIM (User Identity Module) or a memory card for storing information.

And a second camera 121b may be disposed on a rear surface of the terminal body. In this case, the second camera 121b has a photographing direction which is substantially opposite to that of the first camera 121a.

The second camera 121b may include a plurality of lenses arranged along at least one line. The plurality of lenses may be arranged in a matrix form. Such a camera can be named an 'array camera'. When the second camera 121b is configured as an array camera, images can be taken in various ways using a plurality of lenses, and a better quality image can be obtained.

The flash 124 may be disposed adjacent to the second camera 121b. The flash 124 shines light toward the subject when the subject is photographed by the second camera 121b.

And a second sound output unit 152b may be additionally disposed in the terminal body. The second sound output unit 152b may implement a stereo function together with the first sound output unit 152a and may be used for implementing a speakerphone mode in a call.

The terminal body may be provided with at least one antenna for wireless communication. The antenna may be embedded in the terminal body or formed in the case. For example, an antenna constituting a part of the broadcast receiving module 111 (see FIG. 1A) may be configured to be able to be drawn out from the terminal body. Alternatively, the antenna may be formed in a film type and attached to the inner surface of the rear cover 103, or a case including a conductive material may be configured to function as an antenna.

The terminal body is provided with a power supply unit 190 (see FIG. 1A) for supplying power to the mobile terminal 100. The power supply unit 190 may include a battery 191 built in the terminal body or detachable from the outside of the terminal body.

The battery 191 may be configured to receive power through a power cable connected to the interface unit 160. In addition, the battery 191 may be configured to be wirelessly chargeable through a wireless charger. The wireless charging may be implemented by a magnetic induction method or a resonance method (magnetic resonance method).

The rear cover 103 is configured to be coupled to the rear case 102 so as to cover the battery 191 to restrict the release of the battery 191 and to protect the battery 191 from external impact and foreign matter . When the battery 191 is detachably attached to the terminal body, the rear cover 103 may be detachably coupled to the rear case 102.

The mobile terminal 100 may be provided with an accessory that protects the appearance or supports or expands the function of the mobile terminal 100. [ One example of such an accessory is a cover or pouch that covers or accommodates at least one side of the mobile terminal 100. [ The cover or pouch may be configured to interlock with the display unit 151 to expand the function of the mobile terminal 100. Another example of an accessory is a touch pen for supplementing or extending a touch input to the touch screen.

Meanwhile, the controller 180 of the mobile terminal 100 according to the embodiment of the present invention can check the operation state of the touch sensor according to predetermined conditions. For example, the controller 180 can check the operation state of the touch sensor when a user input (e.g., power key input) for switching the operation state of the mobile terminal 100 or the predetermined period have. In this case, the controller 180 may transmit a signal for checking the state to the touch sensor, and may determine the operation state of the touch sensor using a self-check result received from the touch sensor. Alternatively, the control unit 180 may check whether the touch sensor is operating normally according to whether a response signal to the signal transmitted to the touch sensor is returned within a predetermined time.

FIG. 2 shows an example in which the mobile terminal related to the present invention operates when a problem occurs in the touch sensor.

2, first, the controller 180 of the mobile terminal 100 according to the present invention detects an abnormality in the touch sensor as a result of checking the operation state of the touch sensor, . In this case, the control unit 180 of the mobile terminal 100 according to the embodiment of the present invention displays the image information 200 for notifying that there is a problem in the touch screen, as shown in FIG. 2A, Can be displayed on the screen.

2 (a), it goes without saying that the controller 180 may output the image information 200 of the result of checking the operation state of the touch sensor as sound information. For example, the controller 180 checks both the state of the touch sensor and the state of the display unit 151, and outputs the result of checking the operation state of the touch sensor according to the check result as image information and / or sound information . That is, in the case where there is no abnormality that the image information is displayed on the display unit 151 although a problem has occurred on the touch screen, as shown in FIG. 2 (a), in the form of image information and / The result of checking the touch sensor can be output. However, if the display unit 151 is broken and the image information can not be output, the controller 180 may output the result of checking the operation state of the touch sensor as sound information.

If the touch sensor does not operate normally, the controller 180 may operate in an operation mode that allows the user to operate the mobile terminal 100 through other means than the touch sensor. Here, the other means may be an acceleration sensor included in the microphone 122 or the tap sensing unit 143 of the mobile terminal. In this case, the control unit 180 controls the operation of the mobile terminal 120 based on a voice signal input through the microphone 122 or a point at which a dynamic force such as an acceleration, a vibration, or an impact of the main body sensed through the acceleration sensor occurs, So that the function of at least one of the executable functions in the server 100 can be controlled.

That is, the control unit 180 can recognize the respective faces of the body of the mobile terminal 100, not the display unit 151, by dividing them into respective regions. For example, as shown in FIG. 2 (b), the controller 180 controls the front surface 210, the rear surface 212, the left surface 214, and the right surface 216 of the body of the mobile terminal 100, As shown in FIG. When the user's taps are applied to one side of each surface of the main body of the mobile terminal 100, the controller 180 can sense the dynamic force generated due to the taps using the acceleration sensor. In this case, the controller 180 may recognize the surface of the body of the mobile terminal 100 to which the tap is applied, using the sensed dynamic force.

In the above description, it is mentioned that a specific function can be performed based on a plurality of tabs applied to the display unit 151. [ Here, the plurality of taps may form a specific touch pattern, and the controller 180 may perform a specific function based on a predetermined pattern matching with the touch pattern thus formed. Here, the specific function may be a function of switching the operation state of the mobile terminal 100 (for example, entering the unlocked state from the locked state) as described above. In this case, a predetermined pattern for releasing the locked state of the mobile terminal 100 will be referred to as an unlock pattern.

On the other hand, if the controller 180 determines that the touch sensor does not operate normally as a result of checking the operation state of the touch sensor, the controller 180 controls at least one of the surfaces of the main body of the mobile terminal 100, It is possible to cancel the locked state of the mobile terminal 100 based on a plurality of tabs of the user who taps one. In this case, the controller 180 controls each of the surfaces 210, 212, 214, 216 of the main body 100 in accordance with the order in which a plurality of taps are applied to the respective surfaces 210, 212, 214, 216 of the main body of the mobile terminal 100. [ The mobile terminal 100 may be unlocked based on a pattern in which at least one of the mobile terminal 100 and the mobile terminal 100 is selected. For example, each of the surfaces 210, 212, 214, and 216 of the main body may be assigned a unique number, and the controller 180 may determine that the surfaces 210, 212, 214, The lock state of the mobile terminal 100 may be released by comparing the pattern with the predetermined unlock pattern.

Meanwhile, the control unit 180 may use other input means other than the acceleration sensor. For example, the control unit 180 may sense the user's voice input through the microphone 122 provided in the input unit 120. [ In this case, when the control unit 180 is ready to recognize the user's voice, the control unit 180 displays guide information 220 for guiding the user to pronounce the predetermined password, as shown in FIG. 2C . The control unit 180 may recognize the voice input from the user and display the recognized result 222 on the display unit 151. [ In this case, the control unit 180 may compare the recognition result with a preset unlock password, and may lock the mobile terminal 100 according to the comparison result.

On the other hand, if the display unit 151 is normal even if a failure occurs in the touch sensor, as shown in FIG. 2C, the result of recognizing the user's voice is displayed as image information and / or sound information . However, if it is impossible to output the image information on the display unit 151 as a result of checking the state of the display unit 151, the control unit 180 determines that the guide information 220 and the user's voice It is also possible to output the sound information 222 as sound information.

If the locked state of the mobile terminal 100 is released through the process shown in FIG. 2B or FIG. 2C, the control unit 180 determines whether at least one A screen including a graphic object related to the function (application) can be displayed on the display unit 151 (when the display unit 151 is normally driven). In this case, the controller 180 may not display graphical objects related to functions that the user can not normally operate according to the failure of the touch sensor on the screen.

That is, when a failure of the touch sensor is sensed, the controller 180 performs a function that can be executed by the user based on another input means, that is, a voice of the user or a tab on each side of the main body of the mobile terminal 100 Applications) may be displayed on the display unit 151. In this case, For example, these functions may be phone functions, message functions, music playback functions, and camera functions. These functions may be set corresponding to the respective surfaces 210, 212, 214, and 216 of the mobile terminal body. In this case, when any one of the surfaces of the body is detected, the control unit 180 may activate or execute the function corresponding to the surface on which the tab is sensed. On the other hand, when the user's voice is used, the control unit 180 recognizes the voice inputted from the user and can perform a specific function according to the recognized result. In this case, a voice command capable of executing the functions may be stored in advance, and the controller 180 may compare the voice input from the user with the pre-stored voice commands to perform a specific function.

These functions may be preset at the time of manufacturing the mobile terminal 100 or predetermined from the user. FIG. 2 (d) shows an example in which a screen including graphic objects 230, 232, 234, and 236 corresponding to these functions is displayed on the display.

The control unit 180 may be configured to detect a user's input through the other input means, that is, a voice of the user or a tab on each side of the main body of the mobile terminal 100, Different touch patterns may be used to detect different touch patterns. That is, when the touch sensor fails to operate normally, an unlock password or an unlock pattern for use may be separately set. For example, if the touch sensor fails to operate normally, some of the user's telephone numbers may be used as a separate unlock password or unlock pattern.

The control unit 180 compares the unlocking password or the unlocking pattern stored separately from the input of the user detected through the other input means of the user based on the result of checking the operation state of the touch sensor, The lock state of the mobile terminal 100 can be released based on a plurality of taps detected through the touch sensor.

Hereinafter, embodiments related to a control method that can be implemented in a mobile terminal configured as above will be described with reference to the accompanying drawings. It will be apparent to those skilled in the art that the present invention may be embodied in other specific forms without departing from the spirit or essential characteristics thereof.

3 is a flowchart illustrating an operation procedure of a mobile terminal according to the present invention.

Referring to FIG. 3, the controller 180 of the mobile terminal 100 according to the embodiment of the present invention can check the operation state of the touch sensor when a predetermined condition is satisfied (S300). Here, the preset condition may be that a predetermined time period expires or a key input of the user for activating the mobile terminal 100, for example, the display unit 151 of the mobile terminal 100, (For example, a power key) for switching from the mode to the active state. Or tapping applied by the touch object, that is, when the tab is detected through the touch sensor or the acceleration sensor of the mobile terminal 100. [ Or at least one of these conditions is met.

In operation S302, the controller 180 may determine whether there is a problem with the operation of the touch sensor according to the result of the check in operation S300. For example, the controller 180 receives a result of performing the self-check from the touch sensor and determines whether the touch sensor is operating normally, or determines whether the response signal of the touch sensor with respect to the transmitted check signal is a predetermined time It can be determined that there is a problem in the operation of the touch sensor. If it is determined in operation S302 that there is no problem in the operation of the touch sensor, the controller 180 controls the various functions of the mobile terminal 100 based on the touch input of the user on the display unit 151 (S310).

However, if it is determined in operation S302 that there is a problem with the operation of the touch sensor, the control unit 180 may switch to an input mode in which the user can input an input through other means other than the touch sensor (S304 ). Here, the other means may be a microphone 122 or an acceleration sensor as described with reference to FIG. The controller 180 may sense the user's input according to the currently set input mode (S306).

For example, if the input mode set in step S304 is an operation mode for sensing the input of the user through the acceleration sensor, the controller 180 controls the operation of the mobile terminal 100, as shown in FIG. 2 (b) It is possible to recognize the main body by dividing the main body into a plurality of regions along the respective faces. In operation S308, the control unit 180 may control the functions of the mobile terminal 100 based on the taps applied to the respective surfaces of the main body of the mobile terminal 100 in operation S306.

For example, when a tab is applied to any one of the surfaces 210, 212, 214, and 216 of the main body, the controller 180 controls the functions of the mobile terminal 100 Can be performed. Or the control unit 180 controls the operation of the mobile terminal 100 based on a pattern formed according to the order of the faces selected by the plurality of taps when a plurality of taps are applied to at least one of the respective faces of the mobile terminal 100, 100 may be released from the locked state.

On the other hand, if the input mode set in step S304 is an operation mode for sensing the user's voice signal through the microphone 122, the control unit 180 can recognize the voice signal input from the user in step S306 . In step S308, the control unit 180 may perform the function of the mobile terminal 100 according to the result of the recognition in step S306.

For example, the function performed from the result of recognizing the user's voice signal may be any one of preset functions corresponding to an occurrence of an error in the operation state of the touch sensor. For example, the preset functions may be preset functions as functions that the user can perform by tapping the voice or specific face of the body of the mobile terminal 100. [ Alternatively, the function to be performed may be a function of releasing the locked state of the mobile terminal 100 as shown in FIG.

Meanwhile, in step S306, when a user's input is detected through the microphone 122 or the acceleration sensor, the controller 180 may output information related to the recognition result of the user's input as sound information. That is, the control unit 180 outputs the recognized input information of the user as acoustic information based on the taps applied to the main body of the mobile terminal 100 or around the main body, or recognizes the voice signal inputted through the microphone 122 And output a result as acoustic information.

In addition, the control unit 180 may output information related to the function performed in step S308 as sound information. Accordingly, although not only the touch sensor but also the display unit 151 has a problem in its operation, even if the display unit 151 can not output the image information, the user inputs the correct information through the outputted sound information And the function to be executed based on the input of the detected user.

FIG. 4 is a flowchart illustrating an operation performed by a mobile terminal according to an embodiment of the present invention to perform a specific function according to a user input sensed through other means when a problem occurs in the touch sensor.

4, the control unit 180 of the mobile terminal 100 according to the embodiment of the present invention determines whether the result of recognizing the user's voice signal input through the microphone 122 in step S306, The locked state of the mobile terminal 100 may be released by comparing the pattern formed by the taps applied to each face of the main body 100 of the terminal 100 with a predetermined unlock password or a predetermined unlock pattern.

In this case, the unlocking password or the unlocking pattern may be different from the unlocking password or the unlocking pattern when the touch sensor operates normally. That is, the mobile terminal 100 according to the embodiment of the present invention may store different unlocking passwords or unlocking patterns in the case where the touch sensor operates normally or not. The controller 180 can release the lock state of the mobile terminal 100 using any one of the unlock passwords or the unlock pattern according to the determination result of step S300 (the determination result of the normal operation of the touch sensor) .

Meanwhile, the unlock pattern and the password of the mobile terminal 100 may be complementarily used. That is, the control unit 180 first compares the result of detecting the plurality of tabs applied to each side of the mobile terminal 100 with a preset unlock pattern, and as a result, The locking state of the mobile terminal 100 can be released using the password recognized from the voice of the user when at least one of the faces of the main body is not selected in the predetermined order.

In this case, the control unit 180 may output guide information for instructing the user to tap each surface of the body of the mobile terminal 100 in order according to a predetermined pattern, in the form of acoustic information or image information. When a plurality of taps are applied for a predetermined time, it is possible to output, in the form of acoustic information or image information, whether the pattern formed by the plurality of taps coincides with a predetermined pattern. If the pattern formed by the plurality of tabs does not match the preset pattern, the guide information for guiding the user to input a password by voice may be output in the form of acoustic information or image information. When the user pronounces the password by voice, the result of comparing the result of recognizing the user's voice and the predetermined password can be output in the form of acoustic information or image information.

On the other hand, the reverse order is also possible. For example, the control unit 180 may prompt the user to input a password by voice. The control unit 180 may request that a plurality of tabs for forming a predetermined pattern be applied to each surface of the main body of the mobile terminal 100 when the password input by the voice does not match the predetermined password.

If the lock state of the mobile terminal 100 is released based on the detection result of the voice signal or the acceleration sensor, The display unit 151 may display a screen including graphic objects related to functions that can be performed by tapping a specific face of the display unit 151 (S402). In the case where the touch sensor does not operate normally, the functions that can be performed through predetermined input means (for example, the microphone 122 or the acceleration sensor) may be preset.

Meanwhile, one of these functions can be selected from a tap or a voice signal of the user, which is applied to each side of the main body of the mobile terminal 100. 2 (d), when the graphic objects related to the predetermined functions are displayed on the display unit 151, the control unit 180 controls each of the faces of the main body 100 of the mobile terminal 100 210, 212, 213, and 214, one of the functions can be selected. Alternatively, the control unit 180 may receive a user's voice signal and may select one of the functions corresponding to the graphic objects displayed on the display unit 151 based on the result of inputting the voice signal. For example, the user may pronounce a function name (for example, Call, Message, Music, Camera) corresponding to one of the graphic objects 230, 232, 234 and 236, It is possible to recognize any one of the functions.

If a specific function is selected as described above, the controller 180 can activate the currently selected function (S404). In this case, various functions for controlling the activated functions may be set to correspond to respective faces of the body of the mobile terminal 100 according to the activated functions. Accordingly, the control unit 180 can control the activated function by dividing a tab of a user applied to each side of the main body of the mobile terminal 100. [ In addition, when a voice signal is input from a user, the activated function may be controlled according to a result of recognizing the voice signal.

In the above description, when the mobile terminal 100 according to the embodiment of the present invention does not operate normally as a result of checking the operation state of the touch sensor, it detects the input of the user by using other predetermined means, The operation process performed by the function according to the input of FIG.

5 to 9, in the mobile terminal according to the embodiment of the present invention, when the touch sensor is not normally operated, the user's input is sensed using another predetermined user input sensing means, An example of controlling functions executable in the mobile terminal 100 will be described in more detail with reference to exemplary diagrams. In the following description, it is assumed that the detection result of the acceleration sensor is used when the touch sensor does not normally operate for the sake of convenience of explanation. However, it is needless to say that the present invention is not limited thereto, and it is needless to say that the present invention can also be applied to a case where a user's input is recognized through a user's voice signal.

5 illustrates an example in which, when a touch sensor does not normally operate, a mobile terminal related to the present invention detects an input of a user using an acceleration sensor and controls a music playback function accordingly.

5, the controller 180 of the mobile terminal 100 according to an embodiment of the present invention checks the operation state of the touch sensor in step S300. If the touch sensor does not operate normally, On the display unit 151, a screen including graphic objects corresponding to the graphic objects. In this state, the controller 180 can sense the tabs applied to any one of the surfaces of the mobile terminal 100 using the acceleration sensor.

5 (a) shows an example in which the tabs are applied to the front surface 210 of the mobile terminal 100. FIG. For example, if the function of the mobile terminal 100 corresponding to the main body front 210 of the mobile terminal 100 is a function of playing music, the controller 180 controls the tabs Based on this, the music reproduction function can be activated. In this case, as shown in FIG. 5 (b), information related to music data to be currently reproduced can be displayed on the display unit 151, and the currently activated function, that is, Other functions associated with the function may be matched, respectively. For example, a 'fast forward' function is provided on the right side surface 216 of the main body of the mobile terminal 100, a 'play / pause' function is provided on the left side surface 214, And the 'back' function may be matched to the back surface 212, respectively.

In this state, the control unit 180 can control the function currently being performed, that is, the function of playing music, when additional tabs are detected for any one of the faces of the body of the mobile terminal 100 from the user . For example, as shown in FIG. 5 (b), when a tab is applied to the right side surface 216 of the main body, the control unit 180 controls the right side surface 216, The playback function can be controlled. Accordingly, the 'fast forward' function can be performed. The progress bar 500 shown in FIG. 5C shows that the playback point of the currently played music data is changed as a result of performing the 'fast forward' function.

In this case, if additional tabs are applied, the controller 180 may perform another function based on the specific surface of the main body of the mobile terminal 100 to which the tab is applied. 5 (c), when a tab is applied to the left side surface 214 of the main body 100 of the mobile terminal 100, the controller 180 controls functions corresponding to the left side surface 214, Playback / pause " function. Accordingly, the control unit 180 temporarily stops the music currently being played back, and displays (510) a state in which playback is temporarily stopped, as shown in FIG. 5 (d).

In the description of FIG. 5, it is assumed that each of the functions related to the currently activated function is set to correspond to each of the faces of the main body of the mobile terminal 100, but at least two functions correspond to one face Of course, be set. In this case, the controller 180 may select any one of the two or more functions based on the number of taps applied within a predetermined time. For example, the 'fast forward' function and the 'next music selection' function may be set to correspond to the right side 214 of the main body of the mobile terminal 100. In this case, Fast forward "function or the" next music selection "function may be executed based on the number of taps applied to the right side surface 214.

Meanwhile, FIG. 6 illustrates an example of performing a call function according to an input of a user sensed by using an acceleration sensor when the touch sensor does not operate normally in a mobile terminal according to the present invention.

Referring to FIG. 6, FIG. 6A shows an example in which notification information 600 for notifying an incoming call is displayed on the display unit 151 when a call is received. For example, when an incoming call is received, the control unit 180 may notify the user of the incoming call using a vibration or a sound or a light signal emitted from the LED. If there is a user input (for example, a power key input) for activating the display unit 151, the display unit 151 can be activated and the operation state of the touch sensor can be checked in step S300.

Meanwhile, when the touch sensor is not operated normally as a result of checking the operation state of the touch sensor in step S300, the control unit 180 determines whether the touch sensor is operated by using the image information or sound information as shown in FIG. It is possible to indicate that there is a problem in the operation state of the sensor. The control unit 180 can release the locked state of the mobile terminal 100 based on the voice of the user or a plurality of taps applied to each surface of the mobile terminal 100. [ When the locked state is released, a screen including graphic objects corresponding to predetermined functions as shown in FIG. 6 (a) can be displayed on the display unit 151.

In this state, the control unit 180 can display the information related to the incoming call as shown in FIG. 6 (a). In this case, the control unit 180 may execute a function associated with the incoming call based on the user's voice sensed through the microphone 122 or a result of sensing a tab applied to a specific side of the main body of the mobile terminal 100 . For example, when the function of the mobile terminal 100 corresponding to the left side surface 214 of the main body is a telephone function, the control unit 180 controls the left side surface 214 of the main body as shown in FIG. 6 (a) ), So that the call can be connected to the other party of the call. Figure 6 (b) shows this example.

6 (b), the controller 180 may perform other functions related to the call function based on the additional tabs applied to the main body of the mobile terminal 100 have. For example, the control unit 180 may perform different functions based on the taps applied to the respective sides 214 and 216 of the main body. In other words, a 'speakerphone' function can be set on the right side surface 216 of the main body of the mobile terminal 100, and a 'call end' function can be set on the left side surface 214 of the main body. 6 (b) and 6 (c), when the display unit 151 is capable of displaying image information, functions corresponding to each side of the main body of the mobile terminal 100 The graphic objects 610 and 612 associated with the display unit 151 may be displayed on the display unit 151. [

6 (b), when the user applies a tab to the right side surface 216 of the main body, the control unit 180 controls the speaker of the mobile terminal 100 through the speaker of the mobile terminal 100 Voice can be output. In this case, the user can release the speakerphone state by tapping the right side 216 again. In this case, the graphic object 612 displaying the function corresponding to the right side surface 216 may be changed to another graphic object as shown in FIG. 6C, corresponding to this function change.

6 (c), when the user applies a tab to the left side surface 214 of the main body, the controller 180 can sense the surface to which the tab is applied through the acceleration sensor. And may perform a function corresponding to the tapped surface, that is, a 'call end' function. When the call function is terminated, the control unit 180 may display a screen including graphic objects corresponding to predetermined functions on the display unit 151 as shown in FIG. 6 (d).

In the above description, it is explained that the other functions related to the call function correspond to only the two sides 214 and 216 of the mobile terminal body. However, the other sides (the front side 210 and the rear side 212 of the main body) It is needless to say that corresponding functions may be set. For example, a 'receive rejection' function for rejecting reception of a currently received call may be corresponded to the rear surface 212 of the main body, and a front 210 of the main body may correspond to a ' Receive hold 'function may be supported. When a tab is detected on the rear surface 212 or the front surface 210 of the main body, the controller 180 may perform a call related function corresponding to the surface on which the tab is sensed.

6, the mobile terminal related to the present invention may transmit a call according to a user's input even when the touch sensor does not operate normally. Figure 7 shows this example.

7, when the user does not normally operate the touch sensor, a function that can be performed by tapping the voice or each surface of the mobile terminal 100, as shown in FIG. 7 (a) On the display unit 151, a screen including graphic objects for the display screen. In this state, the control unit 180 may perform a specific function based on the voice of the user or a tab to be applied to the specific surface. Accordingly, when a user applies a tab to the left side surface 216 of the main body of the mobile terminal 100, the control unit 180 can execute a 'telephone function' as a function corresponding to the tab.

In this case, the control unit 180 may output the sound information related to the currently executed function in order to check whether the currently executed function is the function selected by the user. In addition, it is possible to check whether the currently executed function is a function selected by the user based on the voice signal of the user inputted in response to the outputted sound signal or the tab attached to the specific side of the mobile terminal 100 body.

If the telephone function is performed in the state that the call is not received in this way, the control unit 180 may determine that the user has executed the telephone function to originate the call. In this case, the control unit 180 may receive information related to the recipient of the call to the user. For example, the control unit 180 can request the user to sound information related to the recipient of the call through the sound information or the image information displayed on the display unit 151. [ In response to such a request, a specific recipient can be selected based on a voice signal or a tap given to the main unit from the user.

For example, the control unit 180 can search for a name of a specific person entered by the user as a voice on the pre-stored phone book. Or the control unit 180 can recognize the number that the user inputs by voice. In this case, the receiver or the number string retrieved from the recognition result of the user's voice can be displayed on the display unit 151 as shown in FIG. 7 (b).

Alternatively, the control unit 180 may display the phone book list stored in advance on the display unit 151 subsequent to the request. The information included in the phone book list can be searched based on the taps applied to each side of the main body of the mobile terminal 100. For example, if a user applies a tab to the left side 214 of the body, move the cursor down in the preset phone book list and move the cursor up if a right side surface 216 of the body is tapped . And may select the information of the telephone book list in which the cursor is displayed based on the taps applied to the front surface 210 or back surface 212 of the main body as the recipient information of the call to be transmitted.

On the other hand, when the receiver information is input as described above, the controller 180 may display the currently selected receiver information 700 on the display unit 151, as shown in FIG. 7 (b). The control unit 180 may perform functions related to origination of a call based on a tab applied to the main body of the mobile terminal 100. [

For example, the control unit 180 may perform the 'call origination function' or the 're-enter recipient information' function based on the tabs applied to the right side surface 216 or the left side surface 214 of the main body. 7 (b), when the tab is applied to the right side surface 216 of the main body, the control unit 180 can originate a call based on the currently inputted recipient information, And to receive the recipient information again when it is applied to the left side 214. In this case, as shown in FIG. 7C, the control unit 180 may display a notification window 710 on the display unit 151 to confirm once again whether the currently input recipient information is correct, (For example, when the right side surface 216 of the main body is tapped again), the call function may be performed.

FIG. 7 (d) shows an example in which such a call function is performed. In this case, the control unit 180 may perform other functions related to the call function based on additional tabs applied to the main body. For example, as shown in FIG. 7 (d), the 'speakerphone' function may be set to correspond to the right side 216 of the main body, and the 'end call' function may be set to correspond to the left side 214 of the main body have. And graphic objects 712 and 714 associated with functions corresponding to each side of the main body may be displayed on the display unit 151. [

If the receiver is selected, the controller 180 may output the receiver information currently selected to the user through the sound information to determine whether the receiver is the one selected by the user. In this case, the control unit 180 may sense a tap on a specific surface of the main body or receive a voice signal from the user in response to the receiver information output as the sound information. Further, the 'call origination function' or 'receiver information re-entry' function may be performed based on the tap or voice signal.

In the above description, the mobile terminal 100 according to the embodiment of the present invention is capable of checking a received message or sending a message in a state where the touch sensor is not operating normally Of course it is. 8 and 9 show an example of such a case.

8 is a diagram illustrating an example in which an incoming message is displayed according to an input of a user sensed using an acceleration sensor when the touch sensor does not operate normally in a mobile terminal according to the present invention.

8, the control unit 180 of the mobile terminal 100 according to the embodiment of the present invention displays notification information indicating that a received message exists on the display unit (not shown) 151). Alternatively, the control unit 180 may output the received message as vibration, a light signal output from the LED, or sound information.

In this state, the control unit 180 may perform a specific function based on the voice of the user or a tab applied to the specific surface. For example, when the user places a tab on the right side surface 214 of the main body of the mobile terminal 100, the controller 180 may execute a 'message function' as a function corresponding to the tab. Figure 8 (b) shows this example.

In this case, the control unit 180 may display the contents of the received message on the display unit 151 as shown in FIG. 8 (b). And other functions related to the message function can be associated with respective sides (e.g., 214 and 216) of the main body of the mobile terminal 100, respectively. For example, the control unit 180 may make the 'reply' function correspond to the received message on the right side 216 of the body, and the 'end' function may correspond to the message function on the left side 214. For convenience of the user, the graphic objects 812 and 814 related to the functions may be displayed in corresponding areas on the display unit 151. FIG. And may generate a reply message for the received message based on the tap input applied to the left side 214 or the right side 216 of the main body or may terminate the currently executed message function.

FIG. 8C shows a case where a user applies a tab to the right side surface 216 of the main body in the state shown in FIG. 8B. In this case, as shown in FIG. 8 (c), the control unit 180 may display a screen for generating a reply message for the received message on the display unit 151. In this case, the control unit 180 may indicate to the user that the function of generating the reply message has been executed by using acoustic information, vibration, or LED light.

Meanwhile, when the function of generating the reply message is performed, the information on the sender of the received message can be displayed as the recipient information 820 of the reply message, and the character string inputted by the user can be displayed on the contents As shown in FIG. For example, the control unit 180 can input the contents of the reply message through voice.

That is, when the reply message is generated, the control unit 180 can recognize the voice signal input from the user and display the recognized result as the content of the reply message. The contents of this reply message can also be output as acoustic information. For example, when a tab is applied to the front surface 210 or the rear surface 212 of the main body of the mobile terminal 100, the control unit 180 may output the contents of the reply message created up to now as sound information.

The user can confirm the contents of the sound information or the reply message displayed on the display unit 151, and send the prepared reply message. In this case, the control unit 180 detects a tab applied to a specific surface (for example, the right surface 216 of the main body 100 of the mobile terminal 100) corresponding to the dispatch function of the reply message and transmits the created reply message in response thereto You can send it. If the reply message is sent, the control unit 180 may display a notification window 830 on the display unit 151 indicating the dispatch status of the message or notify the user that the message has been sent through the sound information.

Meanwhile, the controller 180 may output the recipient information of the reply message again through the sound information or the image information, and receive the confirmation of the user once again. The control unit 180 may rewrite the contents of the reply message created up to the present time when a tab is detected on the specific surface of the main body (for example, the left side 214 of the main body of the mobile terminal 100). In this case, the control unit 180 may initialize or at least partially delete the contents of the reply message created so far, and may generate a new message based on the voice input from the user.

9 illustrates an example in which a message is transmitted according to an input of a user sensed using an acceleration sensor when the touch sensor does not operate normally in a mobile terminal according to the present invention.

As shown in FIG. 9A, when the touch sensor does not operate normally, the user may include graphical objects for voice or functions that can be performed by tapping on each side of the mobile terminal 100 The control unit 180 can perform a specific function based on the voice of the user or a tab on the specific surface. Accordingly, when a user applies a tap to the right side surface 214 of the main body of the mobile terminal 100, the controller 180 can execute a 'message function' as a function corresponding to the tab. In this case, the message function may output the sound information related to the message function to confirm whether the function selected by the user is correct.

If the message function is performed in the absence of a newly received message, the control unit 180 may determine that the user has executed the message function to send the message. In this case, the control unit 180 may receive information related to the recipient of the message to the user. For example, the recipient information of the message can be input by selecting specific information from the phone book based on a result of searching for information of a phone book matching the voice signal input from the user or based on a tab to be applied to the main body.

On the other hand, when the receiver information is input as described above, the controller 180 can display the currently selected receiver information 900 on the display unit 151, as shown in FIG. 9 (b). The control unit 180 may perform a function related to the transmission of a message based on a tab applied to the main body of the mobile terminal 100. [

For example, the controller 180 may perform a 'message composing function' or a 're-enter recipient information' function based on the tabs on the right side 216 or the left side 214 of the main body. 9 (b), when the tab is applied to the right side surface 216 of the main body, the control unit 180 can function to create a message to be sent, And to receive the recipient information again when it is applied to the mobile terminal 214.

When the function of creating a message is performed, the control unit 180 may output image information or sound information for confirming whether the currently input recipient information is correct, and if the user confirms (for example, The right side surface 216 is again tapped) and then the message creation function is performed.

Meanwhile, when the function of creating a message is performed, a character string input by the user can be input as the content of the message. For example, the control unit 180 can input the contents of the reply message through voice. That is, when the message is created, the controller 180 can recognize the voice signal input from the user and display the recognized result as the content of the reply message. The contents of this reply message can also be output as acoustic information. For example, when a tab is applied to the front surface 210 or the rear surface 212 of the main body of the mobile terminal 100, the control unit 180 may output the contents of the reply message created up to now as sound information.

The user can confirm the contents of the sound information or the message displayed on the display unit 151, and send the message to the currently selected recipient. In this case, the control unit 180 can detect a tab applied to a specific surface corresponding to the message sending function (for example, the right surface 216 of the main body 100 of the mobile terminal 100) and send the created message in response thereto have. When the message is transmitted, the control unit 180 may display a notification window 920 on the display unit 151 indicating the dispatch status of the message or notify the user that the message has been sent through the sound information.

Meanwhile, when the transmission of the message is selected as described above, the control unit 180 outputs the receiver information of the message through the sound information or the image information again, and receives the confirmation of the user once again. The control unit 180 may rewrite the contents of the message created up to the present time when a tab is detected on a specific surface of the main body (for example, the left surface 214 of the main body of the mobile terminal 100). In this case, the control unit 180 may initialize or at least partially delete the contents of the message created so far, and may generate a new message based on the voice input from the user.

On the other hand, in the above description, even if the touch sensor is not operated, a function of playing music, a call function according to an incoming call, a function of calling a call, a function of checking a received message or sending a message . However, this is only an example of functions that can be executed in the mobile terminal 100 according to the embodiment of the present invention, and the present invention is not limited to these examples.

For example, the mobile terminal 100 according to the embodiment of the present invention may perform a photographing function as long as the touch sensor does not operate. For example, the controller 180 may execute a camera function based on a result of recognizing a tap or a voice of a user on a specific face of the mobile terminal 100. [ In addition, the controller 180 may store an image input through the image sensor based on a voice of the user or a tab applied to a specific surface of the mobile terminal 100. [

The foregoing detailed description, therefore, should not be construed in a limiting sense in all respects and should be considered illustrative. The scope of the present invention should be determined by rational interpretation of the appended claims, and all changes within the scope of equivalents of the present invention are included in the scope of the present invention.

In the above description, it is assumed that the display unit 151 of the mobile terminal 100 normally operates and image information can be displayed. However, as described in the above description of the present invention, the present invention is applicable not only to image information but also to a case where a specific function is executed through sound information or when confirmation of the user is required (for example, Etc.), the present invention can be applied to the case where the display unit 151 is broken and the image information can not be output.

Also, in the above description, it is exemplified that the function of any one of the functions executable in the mobile terminal 100 is executed based on the voice of the user or the tabs applied to the respective faces of the main body of the mobile terminal 100 However, it should be appreciated that one or more functions may be controlled based on the voice or the tap. For example, the mobile terminal 100 according to the embodiment of the present invention can execute and control the telephone function, the confirmation of the received message or the message sending function according to the user's selection, even while the music playback function is being executed.

The present invention described above can be embodied as computer-readable codes on a medium on which a program is recorded. The computer readable medium includes all kinds of recording devices in which data that can be read by a computer system is stored. Examples of the computer readable medium include a hard disk drive (HDD), a solid state disk (SSD), a silicon disk drive (SDD), a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, , And may also be implemented in the form of a carrier wave (e.g., transmission over the Internet). Also, the computer may include a control unit 180 of the terminal.

Claims (6)

A mobile terminal body having a left side and a right side, a front side and a rear side;
An acceleration sensor for sensing a dynamic force generated from a tap for tapping at least one of the faces of the main body or a microphone for receiving a user's voice signal; And
And a control unit for checking the operation state of the touch sensor provided in the main body, and when a result of the check indicates that the touch sensor fails to operate normally, a result of recognizing at least one surface of the main body, And a control unit for controlling at least one function among functions executable by the mobile terminal based on the recognition result.
The apparatus of claim 1,
A pattern formed by a sequence in which at least one of the faces of the main body is selected by the plurality of tabs when a plurality of tabs are applied to at least one of the faces of the main body, And releases the locked state of the mobile terminal based on the received information.
3. The apparatus of claim 2,
As a result of the check, if the mobile terminal is unlocked when the touch sensor fails to operate properly, the user may perform graphical objects related to predetermined functions that can perform voice or a certain function of the main body by tapping And outputs a screen.
3. The apparatus of claim 2,
And releases the lock state of the mobile terminal using different patterns or different passwords depending on whether the touch sensor is normally operated when there is an input from the user to release the lock state of the mobile terminal Mobile terminal.
The apparatus of claim 1,
Wherein the control unit checks whether the touch sensor operates normally when a preset period expires or when there is a user input for activating a display unit provided in the main body.
A method of controlling a mobile terminal,
Checking an operation state of the touch sensor provided in the mobile terminal;
Detecting a user's input through other means than the touch sensor according to whether or not the touch sensor operates normally as a result of the check; And
And controlling any one of the functions executable in the mobile terminal according to the detected user's input,
The above-
An acceleration sensor for sensing a dynamic force applied to one of the surfaces of the main body, and a microphone for receiving a voice of a user.

Images