KR101608774B1 - Mobile terminal and method for controlling the same - Google Patents

Abstract

The present invention relates to a mobile terminal capable of unlocking a locked UI object and performing a function assigned to the UI object in a touch-locked touch screen using a user's touch gesture, and a control method thereof.

Description

[0001] MOBILE TERMINAL AND METHOD FOR CONTROLLING THE SAME [0002]

The present invention relates to a mobile terminal and a control method thereof, in which usage of a terminal can be realized by further considering convenience of a user.

A terminal such as a personal computer, a notebook computer, a mobile phone, or the like can be configured to perform various functions. Examples of such various functions include a data and voice communication function, a function of photographing a video or a moving image through a camera, a voice storage function, a music file playback function through a speaker system, and an image or video display function. Some terminals include additional functions to execute games, and some other terminals are also implemented as multimedia devices. Moreover, recent terminals can receive a broadcast or multicast signal to view a video or television program.

In general, The mobile terminal can be divided into a mobile terminal and a stationary terminal depending on whether the mobile terminal is portable or not, and the mobile terminal can be divided into a handheld terminal and a vehicle mount terminal ).

Efforts are continuing to support and enhance the functions of terminals. The foregoing efforts include not only changes and improvements in structural components that form the terminal, but also improvements in software or hardware.

The mobile terminal has many touch screens that are currently used as a display device and an input device.

That is, the mobile terminal displays a UI (User Interface (UI)) object such as a function icon for executing a specific content function on the touch screen, and the user can execute the menu function by touching the UI object .

An object of the present invention is to provide a mobile terminal and a control method thereof capable of unlocking a UI object that is locked in use in a touch-locked touch screen using a user's touch gesture and executing functions assigned to the UI object, There is a purpose.

According to an aspect of the present invention, there is provided a mobile terminal including: a touch screen having at least one user interface (UI) object displayed on a touch-locked screen; A memory having a specific pattern and having at least one touch gesture for unlocking the touch and executing a function execution command of the UI object; And a control unit for performing a function of the UI object in which the touch gesture is recognized when the touch gesture having the same pattern as the touch gesture set in the memory is recognized on the UI object.

At this time, the UI objects are UI objects to which menu functions of the same kind or different kinds displayed on the idle screen or the menu screen are given.

In addition, when the touch gesture input from the user is set in the memory, the control unit may block the setting of the input touch gesture in the memory if the input touch gesture is similar to the touch gestures set in the memory .

If the input gesture is similar to the touch gestures set in the memory when the touch gesture inputted from the user is set in the memory, the control unit sets the degree of similarity between the input gesture and the touch gesture similar to the inputted touch gesture And display the similarity degree information on the touch screen.

In addition, when a plurality of UI objects are displayed on the touch screen, the controller may display a UI object located in the recognized area to be distinguished from other UI objects.

In addition, the controller may display detailed information of the UI object on which the touch gesture is recognized, around the UI object.

When the touch gesture having the same pattern as the touch gesture set in the memory is recognized on the touch screen, the controller may perform the function of the UI object located in the recognized area of the touch gesture have.

In addition, the function of the UI object is further locked, and the control unit can execute the function by releasing the function execution lock of the UI object. At this time, the controller may display an identifier indicating whether the function of the UI object is locked or not.

In addition, when the touch gesture having the same pattern as the touch gesture set in the memory is recognized on the plurality of UI objects, the controller can perform the function of the UI objects to unlock the touch of the screen and the touch gesture .

In addition, the control unit may display a list of the functions of the UI objects, and may execute selected functions on the list. In addition, the controller may execute functions of the UI objects, and display the respective function execution screens on a screen of the touch screen.

When the touch gesture having the same pattern as the touch gesture set in the memory is recognized in the area where the UI object is not located, the control unit releases the touch lock of the screen and the function execution lock of the UI objects displayed on the screen Can be released. At this time, when the touch lock and the function execution lock are released, the control unit can display the UI objects having the functions of the UI objects distinguished from the UI objects having no function. In addition, when the touch lock and the function execution lock are released, the controller may display a list of the functions of the UI objects, and execute the selected function on the list.

According to another aspect of the present invention, there is provided a method of controlling a mobile terminal, the method comprising: setting at least one touch gesture for a command for releasing a touch lock and executing a function of a UI object; Displaying at least one UI object on a touch screen having a touch lock; Releasing the touch lock of the touch screen when the touch gesture having the same pattern as the set touch gesture is recognized on the UI object; And executing a function of the UI object in which the touch gesture is recognized.

Since the mobile terminal and its control method according to the present invention can execute unlocking of a UI object that is locked in use in the touch-locked touch screen using the user's touch gesture and the function assigned to the UI object, Thereby providing a simple and convenient operability.

Hereinafter, a mobile terminal related to the present invention will be described in detail with reference to the drawings. The suffix "module" and " part "for the components used in the following description are given or mixed in consideration of ease of specification, and do not have their own meaning or role.

The mobile terminal described in this specification may include a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, a PDA (Personal Digital Assistants), a PMP (Portable Multimedia Player), navigation and the like. However, it will be understood by those skilled in the art that the configuration according to the embodiments described herein may be applied to a fixed terminal such as a digital TV, a desktop computer, and the like, unless the configuration is applicable only to a mobile terminal.

The UI (User Interface: hereinafter referred to as UI) object described in the present specification is a text, an image, an icon, animation, and a combination of two or more thereof. .

As an example, the UI object may include at least one of "phonebook", "message", "music file", "movie file", "image file", "schedule" menu, "contact information" , A "calculator file", a "web page address file", and an "electronic dictionary file".

The "touch lock state" described in the present specification is a state in which the user touches the touch screen 151 to generate a signal corresponding to the touch of the user on the touch screen 151, Means a state in which an operation corresponding to the touch signal generated in the touch screen 151 is not performed.

The "function execution lock state of the UI object" described in the present specification means a state in which the user has set a use restriction of a function assigned to a specific UI object.

1 is a block diagram of a mobile terminal according to an embodiment of the present invention.

The mobile terminal 100 includes a wireless communication unit 110, an audio / video input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, a memory 160, A controller 170, a controller 180, a power supply 190, and the like. The components shown in FIG. 1 are not essential, and a mobile terminal having more or fewer components may be implemented.

Hereinafter, the components will be described in order.

The wireless communication unit 110 may include one or more modules for enabling wireless communication between the mobile terminal 100 and the wireless communication system or between the mobile terminal 100 and the network in which the mobile terminal 100 is located. For example, the wireless communication unit 110 may include a broadcast receiving module 111, a mobile communication module 112, a wireless Internet module 113, a short range communication module 114, and a location information module 115 .

The broadcast receiving module 111 receives broadcast signals and / or broadcast-related information from an external broadcast management server through a broadcast channel.

The broadcast channel may include a satellite channel and a terrestrial channel. The broadcast management server may refer to a server for generating and transmitting broadcast signals and / or broadcast related information, or a server for receiving broadcast signals and / or broadcast related information generated by the broadcast management server and transmitting the generated broadcast signals and / or broadcast related information. The broadcast signal may include a TV broadcast signal, a radio broadcast signal, a data broadcast signal, and a broadcast signal in which a data broadcast signal is combined with a TV broadcast signal or a radio broadcast signal.

The broadcast-related information may refer to a broadcast channel, a broadcast program, or information related to a broadcast service provider. The broadcast-related information may also be provided through a mobile communication network. In this case, it may be received by the mobile communication module 112.

The broadcast-related information may exist in various forms. For example, an EPG (Electronic Program Guide) of DMB (Digital Multimedia Broadcasting) or an ESG (Electronic Service Guide) of Digital Video Broadcast-Handheld (DVB-H).

For example, the broadcast receiving module 111 may be a Digital Multimedia Broadcasting-Terrestrial (DMB-T), a Digital Multimedia Broadcasting-Satellite (DMB-S), a Media Forward Link Only A digital broadcasting system such as DVB-CB, OMA-BCAST, or Integrated Services Digital Broadcast-Terrestrial (ISDB-T). Of course, the broadcast receiving module 111 may be adapted to other broadcasting systems as well as the digital broadcasting system described above.

The broadcast signal and / or broadcast related information received through the broadcast receiving module 111 may be stored in the memory 160.

The mobile communication module 112 transmits and receives radio signals to at least one of a base station, an external terminal, and a server on a mobile communication network. The wireless signal may include various types of data depending on a voice call signal, a video call signal or a text / multimedia message transmission / reception.

The wireless Internet module 113 is a module for wireless Internet access, and may be built in or externally attached to the mobile terminal 100. WLAN (Wi-Fi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access) and the like can be used as wireless Internet technologies.

The short-range communication module 114 refers to a module for short-range communication. Bluetooth, Radio Frequency Identification (RFID), infrared data association (IrDA), Ultra Wideband (UWB), ZigBee, and the like can be used as a short range communication technology.

The position information module 115 is a module for obtaining the position of the mobile terminal, and a representative example thereof is a Global Position System (GPS) module. According to the current technology, the GPS module 115 calculates distance information and accurate time information from three or more satellites, and then applies a trigonometric method to the calculated information, thereby generating a three-dimensional string of latitude, longitude, The location information can be accurately calculated. At present, a method of calculating position and time information using three satellites and correcting an error of the calculated position and time information using another satellite is widely used. In addition, the GPS module 115 can calculate speed information by continuously calculating the current position in real time.

Referring to FIG. 1, an A / V (Audio / Video) input unit 120 is for inputting an audio signal or a video signal, and may include a camera 121 and a microphone 122. The camera 121 processes an image frame such as a still image or moving image obtained by the image sensor in the video communication mode or the photographing mode. The processed image frame can be displayed on the display unit 151. [

The image frame processed by the camera 121 may be stored in the memory 160 or transmitted to the outside through the wireless communication unit 110. [ Two or more cameras 121 may be provided depending on the use environment.

The microphone 122 receives an external sound signal through a microphone in a communication mode, a recording mode, a voice recognition mode, or the like, and processes it as electrical voice data. The processed voice data can be converted into a form that can be transmitted to the mobile communication base station through the mobile communication module 112 when the voice data is in the call mode, and output. Various noise reduction algorithms may be implemented in the microphone 122 to remove noise generated in receiving an external sound signal.

The user input unit 130 generates input data for a user to control the operation of the terminal. The user input unit 130 may include a key pad dome switch, a touch pad (static / static), a jog wheel, a jog switch, and the like.

The sensing unit 140 senses the current state of the mobile terminal 100 such as the open / close state of the mobile terminal 100, the position of the mobile terminal 100, the presence or absence of user contact, the orientation of the mobile terminal, And generates a sensing signal for controlling the operation of the mobile terminal 100. For example, when the mobile terminal 100 is in the form of a slide phone, it is possible to sense whether the slide phone is opened or closed. It is also possible to sense whether the power supply unit 190 is powered on, whether the interface unit 170 is connected to an external device, and the like. Meanwhile, the sensing unit 140 may include a proximity sensor 141. This will be discussed later in connection with touch screens.

The output unit 150 is for generating an output relating to visual, auditory or tactile sense and includes a display unit 151, an acoustic output module 152, an alarm unit 153, a haptic module 154, 155, and the like.

The display unit 151 displays (outputs) information processed by the mobile terminal 100. For example, when the mobile terminal is in the call mode, a UI (User Interface) or a GUI (Graphic User Interface) associated with a call is displayed. When the mobile terminal 100 is in the video communication mode or the photographing mode, the photographed and / or received video or UI and GUI are displayed.

The display unit 151 may be a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), a flexible display display, and a 3D display.

Some of these displays may be transparent or light transmissive so that they can be seen through. This can be referred to as a transparent display, and a typical example of the transparent display is TOLED (Transparent OLED) and the like. The rear structure of the display unit 151 may also be of a light transmission type. With this structure, the user can see an object located behind the terminal body through the area occupied by the display unit 151 of the terminal body.

There may be two or more display units 151 according to the embodiment of the mobile terminal 100. For example, in the mobile terminal 100, a plurality of display portions may be spaced apart from one another or may be disposed integrally with each other, or may be disposed on different surfaces.

(Hereinafter, referred to as a 'touch screen') in which a display unit 151 and a sensor for sensing a touch operation (hereinafter, referred to as 'touch sensor') form a mutual layer structure, It can also be used as an input device. The touch sensor may have the form of, for example, a touch film, a touch sheet, a touch pad, or the like.

The touch sensor may be configured to convert a change in a pressure applied to a specific portion of the display unit 151 or a capacitance generated in a specific portion of the display unit 151 into an electrical input signal. The touch sensor can be configured to detect not only the position and area to be touched but also the pressure at the time of touch.

If there is a touch input to the touch sensor, the corresponding signal (s) is sent to the touch controller (not shown). The touch controller processes the signal (s) and transmits the corresponding data to the controller 180. Thus, the control unit 180 can know which area of the display unit 151 is touched or the like.

The proximity sensor 141 may be disposed in an inner region of the mobile terminal or in the vicinity of the touch screen, which is enclosed by the touch screen. The proximity sensor refers to a sensor that detects the presence or absence of an object approaching a predetermined detection surface or a nearby object without mechanical contact using the force of an electromagnetic field or infrared rays. The proximity sensor has a longer life span than the contact sensor and its utilization is also high.

Examples of the proximity sensor include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, and an infrared proximity sensor. And to detect the proximity of the pointer by the change of the electric field along the proximity of the pointer when the touch screen is electrostatic. In this case, the touch screen (touch sensor) may be classified as a proximity sensor.

Hereinafter, for convenience of explanation, the act of recognizing that the pointer is positioned on the touch screen while the pointer is not in contact with the touch screen is referred to as "proximity touch & The act of actually touching the pointer on the screen is called "contact touch. &Quot; The position where the pointer is proximately touched on the touch screen means a position where the pointer is vertically corresponding to the touch screen when the pointer is touched.

The proximity sensor detects a proximity touch and a proximity touch pattern (e.g., a proximity touch distance, a proximity touch direction, a proximity touch speed, a proximity touch time, a proximity touch position, a proximity touch movement state, and the like). Information corresponding to the detected proximity touch operation and the proximity touch pattern may be output on the touch screen.

The audio output module 152 may output audio data received from the wireless communication unit 110 or stored in the memory 160 in a call signal reception mode, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, The sound output module 152 also outputs sound signals related to functions (e.g., call signal reception sound, message reception sound, etc.) performed in the mobile terminal 100. [ The audio output module 152 may include a receiver, a speaker, a buzzer, and the like.

The alarm unit 153 outputs a signal for notifying the occurrence of an event of the mobile terminal 100. Examples of events that occur in the mobile terminal include call signal reception, message reception, key signal input, touch input, and the like. The alarm unit 153 may output a signal for notifying the occurrence of an event in a form other than the video signal or the audio signal, for example, vibration. In this case, the display unit 151 and the sound / voice output module 152 may be a kind of the alarm unit 153. The display unit 151 and the sound / . ≪ / RTI >

The haptic module 154 generates various tactile effects that the user can feel. A typical example of the haptic effect generated by the haptic module 154 is vibration. The intensity and pattern of the vibration generated by the hit module 154 can be controlled. For example, different vibrations may be synthesized and output or sequentially output.

In addition to the vibration, the haptic module 154 may include a pin arrangement vertically moving with respect to the contact skin surface, a spraying force or a suction force of the air through the injection port or the suction port, a touch on the skin surface, contact with an electrode, And various tactile effects such as an effect of reproducing a cold sensation using an endothermic or exothermic element can be generated.

The haptic module 154 can be implemented not only to transmit the tactile effect through the direct contact but also to allow the user to feel the tactile effect through the muscular sensation of the finger or arm. At least two haptic modules 154 may be provided according to the configuration of the mobile terminal 100.

The projector module 155 is a component for performing an image project function using the mobile terminal 100 and is similar to the image displayed on the display unit 151 in accordance with a control signal of the controller 180 Or at least partly display another image on an external screen or wall.

Specifically, the projector module 155 includes a light source (not shown) that generates light (for example, laser light) for outputting an image to the outside, a light source And a lens (not shown) for enlarging and outputting the image at a predetermined focal distance to the outside. Further, the projector module 155 may include a device (not shown) capable of mechanically moving the lens or the entire module to adjust the image projection direction.

The projector module 155 can be divided into a CRT (Cathode Ray Tube) module, an LCD (Liquid Crystal Display) module and a DLP (Digital Light Processing) module according to the type of the display means. In particular, the DLP module may be advantageous for miniaturization of the projector module 151 by enlarging and projecting an image generated by reflecting light generated from a light source on a DMD (Digital Micromirror Device) chip.

Preferably, the projector module 155 may be provided longitudinally on the side, front or back side of the mobile terminal 100. It goes without saying that the projector module 155 may be provided at any position of the mobile terminal 100 as occasion demands.

The memory unit 160 may store a program for processing and control of the controller 180 and may store input / output data (e.g., telephone directory, message, audio, still image, electronic book, For example. The memory unit 160 may also store the frequency of use of each of the data (for example, each telephone number, each message, and frequency of use for each multimedia). In addition, the memory unit 160 may store data on vibration and sound of various patterns output when the touch is input on the touch screen.

The memory 160 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory), a RAM (Random Access Memory), SRAM (Static Random Access Memory), ROM (Read Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM A magnetic disk, a magnetic disk, an optical disk, or any other type of storage medium. The mobile terminal 100 may operate in association with a web storage that performs a storage function of the memory 160 on the Internet.

The interface unit 170 serves as a path for communication with all external devices connected to the mobile terminal 100. The interface unit 170 receives data from an external device or supplies power to each component in the mobile terminal 100 or transmits data to the external device. For example, a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, a port for connecting a device having an identification module, an audio I / O port, A video input / output (I / O) port, an earphone port, and the like may be included in the interface unit 170.

The identification module is a chip for storing various information for authenticating the use right of the mobile terminal 100 and includes a user identification module (UIM), a subscriber identity module (SIM), a general user authentication module A Universal Subscriber Identity Module (USIM), and the like. Devices with identification modules (hereinafter referred to as "identification devices") can be manufactured in a smart card format. Accordingly, the identification device can be connected to the terminal 100 through the port.

When the mobile terminal 100 is connected to an external cradle, the interface unit may be a path through which power from the cradle is supplied to the mobile terminal 100, or various command signals input by the user to the cradle may be transmitted It can be a passage to be transmitted to the terminal. The various command signals or the power source input from the cradle may be operated as a signal for recognizing that the mobile terminal is correctly mounted on the cradle.

The controller 180 typically controls the overall operation of the mobile terminal. For example, voice communication, data communication, video communication, and the like. The control unit 180 may include a multimedia module 181 for multimedia playback. The multimedia module 181 may be implemented in the control unit 180 or may be implemented separately from the control unit 180. [

The controller 180 may perform a pattern recognition process for recognizing handwriting input or drawing input performed on the touch screen as characters and images, respectively.

The power supply unit 190 receives external power and internal power under the control of the controller 180 and supplies power necessary for operation of the respective components.

The various embodiments described herein may be embodied in a recording medium readable by a computer or similar device using, for example, software, hardware, or a combination thereof.

According to a hardware implementation, the embodiments described herein may be implemented as application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays May be implemented using at least one of processors, controllers, micro-controllers, microprocessors, and electrical units for performing other functions. In some cases, May be implemented by the control unit 180 itself.

According to a software implementation, embodiments such as the procedures and functions described herein may be implemented with separate software modules. Each of the software modules may perform one or more of the functions and operations described herein. Software code can be implemented in a software application written in a suitable programming language. The software code is stored in the memory 160 and can be executed by the control unit 180. [

2A is a perspective view of an example of a mobile terminal or a mobile terminal according to the present invention.

The disclosed mobile terminal 100 includes a bar-shaped terminal body. However, the present invention is not limited thereto, and can be applied to various structures such as a slide type, a folder type, a swing type, and a swivel type in which two or more bodies are relatively movably coupled.

The body includes a case (a casing, a housing, a cover, and the like) which forms an appearance. In this embodiment, the case may be divided into a front case 101 and a rear case 102. [ A variety of electronic components are embedded in the space formed between the front case 101 and the rear case 102. At least one intermediate case may be additionally disposed between the front case 101 and the rear case 102. [

The cases may be formed by injection molding a synthetic resin or may be formed to have a metal material such as stainless steel (STS) or titanium (Ti) or the like.

The display unit 151, the sound output unit 152, the camera 121, the user input units 130/131 and 132, the microphone 122, the interface 170, and the like may be disposed in the front body 101 have.

The display unit 151 occupies most of the main surface of the front case 101. A sound output unit 151 and a camera 121 are disposed in an area adjacent to one end of both ends of the display unit 151 and a user input unit 131 and a microphone 122 are disposed in an area adjacent to the other end. The user input unit 132 and the interface 170 may be disposed on the side surfaces of the front case 101 and the rear case 102. [

The user input unit 130 is operated to receive a command for controlling the operation of the mobile terminal 100 and may include a plurality of operation units 131 and 132. The operation units 131 and 132 may be collectively referred to as a manipulating portion.

The contents inputted by the first or second operation unit 131 or 132 may be variously set. For example, the first operation unit 131 receives commands such as start, end, scroll, and the like, and the second operation unit 132 controls the size of the sound output from the sound output unit 152 or the size of the sound output from the display unit 151 The touch recognition mode can be activated or deactivated.

2B is a rear perspective view of the mobile terminal shown in FIG. 2A.

Referring to FIG. 2B, a camera 121 'may be further mounted on the rear surface of the terminal body, that is, the rear case 102. The camera 121 'may have a photographing direction substantially opposite to that of the camera 121 (see FIG. 2A), and may be a camera having the same or different pixels as the camera 121.

For example, the camera 121 may have a low pixel so that the face of the user can be photographed and transmitted to the other party in case of a video call or the like, and the camera 121 ' It is preferable to have a large number of pixels. The cameras 121 and 121 'may be installed in the terminal body so as to be rotatable or pop-upable.

A flash 123 and a mirror 124 may be additionally disposed adjacent to the camera 121 '. The flash 123 illuminates the subject when the subject is photographed by the camera 121 '. The mirror 124 allows the user to illuminate the user's own face or the like when the user intends to shoot himself / herself (self-photographing) using the camera 121 '.

An acoustic output 152 'may be additionally disposed on the rear surface of the terminal body. The sound output unit 152 'may implement the stereo function together with the sound output unit 152 (see FIG. 2A), and may be used for the implementation of the speakerphone mode during a call.

In addition to the antenna for communication, a broadcast signal receiving antenna 116 may be additionally disposed on the side of the terminal body. The antenna 116, which forms part of the broadcast receiving module 111 (see FIG. 1), can be installed to be able to be drawn out from the terminal body.

A power supply unit 190 for supplying power to the mobile terminal 100 is mounted on the terminal body. The power supply unit 190 may be built in the terminal body or may be detachable from the outside of the terminal body.

The rear case 102 may further include a touch pad 135 for sensing a touch. The touch pad 135 may be of a light transmission type for the display unit 151. [ In this case, if the display unit 151 is configured to output the time information on both sides (i.e., in the directions of both the front and back sides of the mobile terminal), the time information can be recognized through the touch pad 135 do. The information output on both sides may be all controlled by the touch pad 135. [

Meanwhile, the display for exclusive use of the touch pad 135 may be separately installed, so that the touch screen may be disposed in the rear case 102 as well.

The touch pad 135 operates in correlation with the display portion 151 of the front case 101. The touch pad 135 may be disposed parallel to the rear of the display unit 151. The touch pad 135 may have a size equal to or smaller than that of the display unit 151.

Hereinafter, a related operation of the display unit 151 and the touch pad 135 will be described with reference to FIGS. 3A and 3B.

3A and 3B are front views of a mobile terminal for explaining one operation state of the mobile terminal according to the present invention.

Various types of time information can be displayed on the display unit 151. [ These pieces of information can be displayed in the form of letters, numbers, symbols, graphics, or icons.

At least one of the letters, numbers, symbols, graphics, or icons may be displayed in a predetermined arrangement for inputting such information, thereby being implemented as a keypad. Such a keypad may be referred to as a so-called " virtual keypad ".

3A illustrates inputting a touch applied to a virtual keypad through a front surface of a terminal body.

The display unit 151 may be operated integrally with the entire area, or may be divided into a plurality of areas and operated. In the latter case, the plurality of areas can be configured to operate in association with each other.

For example, an output window 151a and an input window 151b are displayed on the upper and lower portions of the display unit 151, respectively. The output window 151a and the input window 151b are areas allocated for outputting or inputting information, respectively. In the input window 151b, a virtual keypad 151c is displayed in which a number for inputting a telephone number or the like is displayed. When the virtual keypad 151c is touched, numbers and the like corresponding to the touched virtual keypad are displayed on the output window 151a. When the first operation unit 131 is operated, call connection to the telephone number displayed on the output window 151a is attempted.

3B shows a touch input to the virtual keypad through the rear surface of the terminal body. FIG. 3A shows a case where the terminal body is vertically arranged, and FIG. 3B shows a case where the terminal body is arranged horizontally. The display unit 151 may be configured to convert an output screen according to a placement direction of the terminal body.

3B shows that the text input mode is activated in the mobile terminal. The display unit 151 displays an output window 151a 'and an input window 151b'. In the input window 151b ', a plurality of virtual keys 151c' displayed with at least one of characters, symbols, and numbers may be arranged. The virtual keys 151c 'may be arranged in the form of a QWERTY key.

When the virtual keys 151c 'are touched through the touch pad 135 (see FIG. 2B), characters, numbers, symbols corresponding to the touched virtual keys are displayed on the output window 151a'. As described above, the touch input via the touch pad 135 is advantageous in that the virtual key 151c 'can be prevented from being covered by the finger when the user touches the touch input via the display unit 151. [ In the case where the display unit 151 and the touch pad 135 are formed to be transparent, the fingers located on the rear side of the terminal body can be visually confirmed, thereby enabling a more accurate touch input.

The display unit 151 or the touch pad 135 may be configured to receive a touch input by scrolling, as well as the input method described in the above embodiments. The user can move an object (e.g., an icon, a thumbnail, a cursor, etc.) displayed on the display unit 151 by scrolling the display unit 151 or the touch pad 135. [ Further, when the finger is moved on the display portion 151 or the touch pad 135, the path along which the finger moves may be visually displayed on the display portion 151. [ This will be useful for editing the image displayed on the display unit 151. [

One function of the terminal may be executed in response to a case where the display unit 151 (touch screen) and the touch pad 135 are touched together within a predetermined time range. In the case of being touched together, there may be a case where the user clamps the terminal body using the thumb and index finger. The one function may be activation or deactivation of the display unit 151 or the touch pad 135, for example.

The proximity sensor 141 described with reference to Fig. 1 will be described in more detail with reference to Fig.

4 is a conceptual diagram for explaining the proximity depth of the proximity sensor.

As shown in FIG. 4, when a pointer such as a user's finger, a pen, or the like approaches the touch screen, the proximity sensor 141 disposed in or near the touch screen senses the proximity sensor and outputs a proximity signal.

The proximity sensor 141 may be configured to output different proximity signals according to the distance between the proximity-touched pointer and the touch screen (hereinafter referred to as "proximity depth").

In FIG. 4, for example, a cross-section of a touch screen having proximity sensors capable of sensing three proximity depths is illustrated. Of course, proximity sensors that detect less than three or more than four proximity depths are also possible.

Specifically, when the pointer is completely in contact with the touch screen (d ₀ ), it is recognized as a contact touch. If the pointer is located on the touch screen at a distance less than the distance d ₁ , it is recognized as a proximity touch of the first proximity depth. If the pointer is located on the touch screen at a distance of d ₁ or more and less than distance d ₂ , it is recognized as a proximity touch of the second proximity depth. If the pointer is located on the touch screen at a distance of d ₂ or more and less than d ₃ distance, it is recognized as a proximity touch of the third proximity depth. If the pointer is positioned apart from the touch screen by a distance d ₃ or more, it is recognized that the proximity touch is released.

Accordingly, the controller 180 can recognize the proximity touch as various input signals according to the proximity depth and proximity position of the pointer, and perform various operation control according to the various input signals.

5A and 5B are views referred to the description of the proximity touch recognition area where the proximity signal is detected and the haptic area where the tactile effect occurs.

5A shows an object such as an icon or a menu item in a circular form for convenience of explanation. An area of the object displayed on the display unit 151 can be divided into a first area A in the center and a second area B surrounding the first area A as shown in Fig. The first region A and the second region B can be configured to generate tactile effects having different intensities or patterns. For example, when the second region B is touched, a first vibration is output, and when the first region A is touched, a second vibration larger than the first vibration is output.

In the case where the proximity touch recognition area and the haptic area are simultaneously set in the area where the object is displayed, the haptic area where the tactile effect is generated and the proximity touch area where the proximity signal is detected They can be set differently. That is, the haptic area may be set narrower than the proximity touch recognition area, or the haptic area may be set wider than the proximity touch recognition area. For example, in (a) of FIG. 5A, the area including the first area A and the second area B may be a proximity touch recognition area, and the first area A may be set as a haptic area.

(N > 4) as shown in Fig. 5 (a) or (c) as shown in Fig. 5 It is also possible to divide into two areas. Each divided region can be configured to generate a tactile effect with different intensities or patterns. Even when the area in which one object is displayed is divided into three or more areas, the haptic area and the proximity touch recognition area can be set differently according to the use environment.

The size of the proximity touch recognition area may be changed depending on the proximity depth to the display unit 151. [ That is, as shown in (a) of FIG. 5, the corresponding proximity touch recognition area may be gradually reduced to 'C', 'B', and 'A' according to the proximity depth to the display unit 151, Or the contiguous touch recognition area corresponding to the proximity depth to the display unit 151 may be gradually increased. In this case as well, the haptic area can be set to a constant size regardless of the proximity depth to the display unit 151, such as the 'H' area shown in FIG. 5B (b).

 In the case of dividing the area in which the object is displayed for the setting of the haptic area or the proximity touch recognition area, in addition to the concentric segmentation as shown in FIG. 5A, the segmentation in the horizontal direction or the longitudinal direction, the radial segmentation, And various methods such as partitioning can be used.

A configuration in which the above-described projector module is provided in the bar-shaped mobile terminal 100 will be described with reference to FIGS. 6A and 6B. 6A and 6B are perspective views of an example of a mobile terminal according to the present invention.

The main body 101 of the mobile terminal may be coupled with a projector body 105 having the projector module 155 so as to be rotatable.

That is, the projector body 105 may be hinged to the main body 101, and the projection angle of the image may be adjusted when the image is projected using the projector module 155 provided in the projector body 105 And the camera 121 may be disposed on the projector body 105 so that the image projected by the projector module 155 can be photographed.

FIG. 6A shows a state before the projector body 105 rotatably coupled with the main body 101 is rotated, and FIG. 6B shows a state after the projector body 105 is rotated.

Hereinafter, embodiments related to a control method that can be implemented in the mobile terminal will be described with reference to the accompanying drawings.

≪ Embodiment 1 >

FIG. 7 is a flowchart illustrating a touch gesture setting process according to the first embodiment of the present invention.

8 to 11 are screen state diagrams illustrating a touch gesture setting process according to the first embodiment of the present invention.

7 to 11, the control unit 180 according to the first embodiment of the present invention instructs the user to unlock the touch terminal of the mobile terminal, unlock the function execution of the UI object, and execute the function of the UI object A detailed description will be given of the process of setting up the touch gesture.

7, the controller 180 of the mobile terminal 100 receives a touch of a touch screen 151 from a user through a touch screen type display unit 151 (hereinafter, referred to as 'touch screen'), If the menu for setting the touch gesture for unlocking, releasing the function execution lock of the UI object, and executing the function of the UI object is selected (S41), the touch gesture setting menu is displayed on the screen of the touch screen 151 [S42].

The control unit 180 controls the touch gesture input unit to set the touch gesture input unit in accordance with the touch gesture input [S42] having a specific pattern from the user on the touch gesture setting menu and the input touch gesture input function [S43] And stores it in the memory 160 (S44).

8 (a), when the "3. Touch gesture setting" menu 11 is selected, the control unit 180 sets the touch gesture input window 7 as shown in FIG. 8 (b) The touch gesture function setting window 12a and the touch gesture function setting window 12b.

8B shows a case where the first touch gesture 13 having the first pattern is input from the user through the touch gesture input window 12a and the touch gesture function setting window 12b has the " .

At this time, the "Unlock " function refers to a function including unlocking the touch of the touch screen 151 and unlocking the function execution of the UI object.

For example, when the first touch gesture 13 shown in FIG. 8 (b) is set in the memory 160 and the first UI object whose function is locked is displayed on the touch-locked touch screen 151 If the touch gesture having the same pattern as the first touch gesture 13 is recognized by the user on the first UI object, the control unit 180 releases the touch lock of the touch screen 151 and performs the function execution of the first object It will unlock.

At this time, although not shown in FIG. 8B, the user may separately set the touch unlock function of the touch screen 151 and the function execution unlock function of the UI object, respectively.

The user can touch the first pattern of the first touch gesture 13 by touching the touch screen 151 and can touch the proximity sensor 141 provided on the touch screen 151 with the first pattern You can touch and input. The following touch methods discussed in the present invention include both "contact touch" and "proximity touch ".

8C shows a case where a second touch gesture 14 having a second pattern is input from the user through the touch gesture input window 12a and the touch gesture function setting window 12b has an " Is set.

For example, when the second touch gesture 14 shown in FIG. 8C is set in the memory 160 and the first UI object whose function is locked is displayed on the touch-locked touch screen 151 The controller 180 recognizes that the touch gesture having the same pattern as that of the second touch gesture 14 is recognized on the first UI object by the user, Unlock function execution and execute the functions of the first UI object. That is, if the first UI object is the " Internet "connection icon, the control unit 180 controls the wireless communication unit 110 to access the web page corresponding to the" Internet "

At this time, although the touch gesture function setting window 12b of Fig. 8 (c) is shown to have the function of "unlocking the touch lock and unlocking and executing the function execution of the first UI object" The user can set "touch lock release and execution" through the setting window 12b and set "unlock and execute function execution of the first UI object".

When the second touch gesture 14 is inputted from the user through the touch gesture input window 12a, the control unit 180 can also set the touch holding time at a specific point of the input second touch gesture 14 have. For example, if the user holds a "one second" touch at the end of the second touch gesture 14, the control unit 180 determines that the second pattern of the second touch gesture 14 and the & "The touch duration will be set together.

That is, the second touch gesture 14 and the "one second" touch holding time shown in (c) of FIG. 8 are set in the memory 160, When the first UI object is displayed, the controller 180 receives a "∨" touch gesture having the same pattern as that of the second touch gesture 14 on the first UI object from the user, If it is recognized that the "one second" touch is held at the last point of the gesture, the unlocking of the touch screen 151 screen, the function execution unlocking of the first UI object and the function of the first UI object are executed . That is, if the first UI object is the " Internet "connection icon, the control unit 180 controls the wireless communication unit 110 to access the web page corresponding to the" Internet "

Figs. 9A to 9E show that various touch gestures input from the user and the touch gesture are set to "Unlock and various kinds of menu execution ".

That is, FIG. 9 shows a process of setting a touch gesture that the user can only know by function of the UI objects on the screen.

9A, a third touch gesture 15 having a third pattern is input from the user through the touch gesture input window 12a, and "Unlock and call connection" is displayed in the touch gesture function setting window 12b. Function is set. At this time, the shape of the third pattern may be a shape of "C" which is the initial of the English word " Call "

For example, a "contact information" UI object in which the third touch gesture 15 shown in FIG. 9 (a) is set in the memory 160 and the function execution is locked on the touch-locked touch screen 151 When the third touch gesture 15 having the "C" shape is recognized on the "contact information" UI object by the user, the control unit 180 releases the touch lock on the touch screen 151 screen and the "contact information" And releases the function execution of the UI object and controls the wireless communication unit 110 to connect the "contact information" call.

9B shows a case where the fourth touch gesture 16 having the fourth pattern is input from the user through the touch gesture input window 12a and the "Unlock and message transmission" function is set in the touch gesture function setting window 12b . At this time, the shape of the fourth pattern may be an "M" shape which is the initial of the English "Message"

For example, a "contact information" UI object in which the fourth touch gesture 16 shown in FIG. 9 (b) is set in the memory 160 and the function execution is locked on the touch- If the fourth touch gesture 16 of the "M" shape is recognized on the "Contact Information" UI object by the user, the control unit 180 cancels the touch unlocking of the touch screen 151 screen and the "contact information" Unlock function execution of the UI object, and a message input window to be transmitted to the "contact information ".

9 (c) shows a fifth touch gesture 17 having a fifth pattern from the user through the touch gesture input window 12a. The touch gesture function setting window 12b has "Unlock and music file playback" function Is set. At this time, the shape of the fifth pattern may be a "♪" shape indicating "music file ".

For example, when the fifth touch gesture 17 shown in FIG. 9C is set in the memory 160 and the function execution is locked in the touch-locked touch screen 151, the "a.mp3" UI object The control unit 180 determines that the fifth touch gesture 17 having the shape of "♪ " is recognized on the" a.mp3 "UI object by the user, .mp3 "UI object, and controls the sound output module 152 to play the music file" a.mp3 ".

9D shows a case where the sixth touch gesture 18 having the sixth pattern is inputted from the user through the touch gesture input window 12a and the "Unlock and Internet" function is set in the touch gesture function setting window 12b . At this time, the shape of the sixth pattern may be an "e" shape indicating "internet ".

For example, when the sixth touch gesture 18 shown in FIG. 9 (d) is set in the memory 160 and the function execution is locked on the touch-locked touch screen 151, When the object is displayed, the controller 180 recognizes the sixth touch gesture 18 having the shape "e" on the " Unlocks the function execution lock of the "my homepage.htm" UI object and controls the wireless communication unit 110 to access a web page corresponding to the URL address of "my homepage.htm ".

9E shows a seventh touch gesture 19 having a seventh pattern input from the user through the touch gesture input window 12a and a "Unlock and file storage" function in the touch gesture function setting window 12b . At this time, the shape of the seventh pattern may be an "F" shape indicating "File ".

For example, when the seventh touch gesture 19 shown in FIG. 9E is set in the memory 160 and the function execution is locked on the touch-locked touch screen 151, The controller 180 recognizes that the seventh touch gesture 19 of the "F" shape is recognized on the UI object of the "file locker menu" by the user, the unlocking of the touch screen 151 screen, Lock menu "UI object, and executes the file archive menu to display a list of files stored in the file archive.

As described above, the process of setting "Unlock and call connection", "Unlock and message transmission", "Unlock and music playback", "Unlock and Internet", "Unlock and file storage" are described in each of the touch gestures . However, the present invention is not limited to the functions described in Fig. That is, in the present invention, "Unlock and all data of the mobile terminal and all menu functions" can be set in the touch gesture.

9, when a user inputs a touch gesture that is too simple at the time of setting a touch gesture that the user can only know, there is a problem that the user can easily recognize the touch gesture set by the user There may be.

Hereinafter, FIG. 10 shows a process in which, when the user inputs a simple touch gesture, the control unit 180 requests the user to alert and re-input the touch gesture.

That is, FIG. 10A shows that the user inputs a touch gesture 20a having a shape of "?" In the touch gesture input window 12a.

At this time, the control unit 180 can determine whether the touch gesture inputted by the user has a simple pattern by referring to the amount of the color of the touch gesture input to the touch gesture input window 12a and the pattern change amount.

That is, the control unit 180 examines the amount of the color and amount of pattern change of the touch gesture input to the touch gesture input window 12a. If the amount of the detected color and the pattern change amount are less than the reference color amount and the reference pattern change amount, It is determined that the pattern of the touch gesture input from the user is appropriate if the amount of the detected pixel and the pattern variation amount are equal to or greater than the reference pixel amount and the reference pattern variation amount.

As described above, when the control unit 180 determines that the "-" pattern of the touch gesture 20a input from the user is simple, the control unit 180 displays the touch screen 151 on the screen as shown in FIG. 10 (b) An alert window 12c is displayed, and the user is requested to re-enter the touch gesture.

10 (c), if the " epsilon "pattern of the touch gesture 20b re-inputted from the user is not simple by the above-described method, The touch gesture 20b input from the user and the "Unlock and Execute" function are stored in the memory 160 as shown in Fig.

11, when a user inputs a touch gesture to the touch gesture input window 12a, if a touch gesture having a similar pattern to the touch gesture inputted by the user is found in the memory 160, By displaying the gestures and their similarity with the similar touch gestures, the user is prompted to input an independent pattern that is not similar to the touch gestures in the memory 160 at the time of inputting the touch gesture.

11A shows a touch gesture having a pattern 21a similar to the second pattern 14 shown in FIG. 8C from the user through the touch gesture input window 12a. Is input.

At this time, the controller 180 compares the input patterns 21a with the patterns of the touch gestures stored in the memory 160, and determines the degree of similarity with the second patterns 14 similar to the patterns 21a And a window 12d indicating the degree of similarity (80%) to the second pattern 14 and the second pattern 14 similar to the pattern 21a is obtained as shown in Fig. 11 (b) And prompts the user to re-enter the touch gesture.

11 (c), if the pattern 21b of the touch gesture 20b re-inputted from the user is not similar to the patterns of the touch gestures stored in the memory 160, The touch gesture 21b and the "Unlock and camera" function input from the user are stored in the memory 160, as shown in (d) of FIG.

The touch gesture setting process for commanding the unlocking of the touch, the unlocking of the function execution of the UI object, and the execution of the function of the UI object has been described in detail with reference to Figs.

12 to 26, using the touch gesture according to the first embodiment of the present invention, it is possible to unlock the touch of the touch screen, unlock the function execution of the UI object, and execute the function assigned to the UI object The process will be described in detail.

12 is a flowchart illustrating an operation control process of a mobile terminal using a touch gesture according to the first embodiment of the present invention.

13 to 26 are screen diagrams illustrating a process of controlling the operation of the mobile terminal using the touch gesture according to the first embodiment of the present invention.

12, the control unit 180 of the mobile terminal 100 displays at least one UI object whose function execution is locked on the screen of the touch-locked touch screen 151 (S121).

13 shows a state in which the idle screen 30 of the touch screen 151 is fully or partially touch-locked.

13A shows a state in which the first to third UI objects 31a, 31b and 31c are displayed on the idle screen 30 and the control unit 180 controls the UI , A portion 30a of the idle screen 30 of the touch screen 151 can be touch-locked as shown in FIG. 13 (b), and as shown in FIG. 13 (c) The entire idle screen 30 of the display unit 151 can be touch-locked.

At this time, the first to third UI objects 31a, 31b, and 31c may be objects having the same or different menu functions. For example, when the menu functions of the same kind are given to the first to third UI objects 31a, 31b, and 31c, the first to third UI objects 31a, 31b, and 31c are " &Quot;, "message sending box ", and the like. In addition, when the first to third UI objects 31a, 31b, and 31c are provided with various menu functions, the first to third UI objects 31a, 31b, Quot; message transmission ", "Internet connection ", and the like.

In addition, the controller 180 can set a partial or full touch lock on the touch screen 151 if the touch signal is not generated for a preset time from the touch screen 151 as well as the user's touch lock setting.

13B, the first area 30a of the idle screen 30 is in a locked state and the second area 30b is a UI object 32 for unlocking the touch of the first area 30a ) Are displayed. When the user touches the touch unlocking UI object 32, the controller 180 can release the touch lock state of the first area 30a.

FIG. 14 shows a state in which the menu screen 40 of the touch screen 151 is entirely or partially touch-locked.

14A shows a state in which the first to fourth UI objects 41a, 41b, 41c and 41d are displayed on the menu screen 40. The controller 180 controls the touch lock setting of the user , A portion 30a of the menu screen 40 of the touch screen 151 can be touch-locked as shown in FIG. 14 (b), and as shown in FIG. 14 (c) The entire menu screen 40 of the touch screen 151 can be touch-locked.

14 (b), the first area 40a of the menu screen 40 is in a locked state and the second area 40b is a UI object 42 for unlocking the touch of the first area 40a ) Are displayed. When the user touches the touch unlocking UI object 42, the controller 180 can release the touch lock state of the first area 40a.

If a touch gesture having a specific pattern is inputted on the screen of the touch screen 151 in step S122, the control unit 180 recognizes the pattern of the input touch gesture in step S123, A touch gesture having the same pattern as the pattern is searched (S124).

At this time, the controller 180 may search for a touch gesture having the same pattern as the recognized pattern in the memory 160, or may search for a touch gesture having a pattern similar to the recognized pattern in the memory, . For example, when the user sets the similarity to 80%, the controller 180 can search for a touch gesture 80% or more similar to the pattern of the touch gesture input from the user in the memory 160. [ The similarity degree setting is provided in the menu function of the mobile terminal 100 so that the user can set the similarity degree using the similarity degree setting menu provided in the mobile terminal 100. [

If there is a touch gesture having the same pattern as the recognized pattern in the memory 160 (S125), the controller 180 cancels the touch lock of the touch screen 151 (S126) 151 on the screen of the UI gesture (S127).

Then, the control unit 180 executes the function of the UI object in which the function execution lock is released (S128).

Hereinafter, the process of unlocking the touch of the touch screen 151, unlocking the function execution of the UI object, and executing the function assigned to the UI object using the touch gesture will be described in detail with reference to FIGS. 15 to 26 .

15 (a) shows a "call" UI object 31a, a "message" UI object 31b, and a menu UI object 31a, which are menu functions of various kinds on the idle screen of the touch- An "Internet" UI object 31c is shown.

At this time, as shown in FIG. 15 (a), the control unit 180 executes the function of each of the "call" UI object 31a, the "message" UI object 31b and the " It is possible to display the identifiers 51a and 51b indicating whether the function is locked or not in the "call" UI object 31a, the "message" UI object 31b, have.

That is, the function execution is locked and the control unit 180 determines that the "call" UI object 31a and the "message" UI object 31b are in the " It is possible to display the first identifier 51a indicating the function execution lock state. In addition, the function execution is not locked in the "Internet" UI object 31c, and the control unit 180 sets the second identifier 51b indicating that the function execution is not locked in the " Can be displayed.

On the other hand, as shown in FIG. 15 (b), when the touch gesture having the specific pattern 14 is recognized on the "message" UI object 31b, The touch gesture having the same pattern as the pattern 14 is searched.

The user touches the touch screen 151 directly in FIG. 15 (b) or touches the touch screen 151 through the proximity sensor 141 to make a touch on the "message" UI object 31b You can enter a touch gesture.

The pattern 14 input in FIG. 15 (b) is the same as the second pattern of the second touch gesture 14 set in the memory 160 in FIGS. 8 and 9, Unlocking the touch of the touch screen 151 and releasing the function execution of the "message" UI object 31b as shown in (c) of Fig. "Menu.

At this time, when the touch gesture having the pattern 14 is recognized on the "message" UI object 31b, the control unit 180 sets the "message" UI object 31b, Quot; Internet "UI object 31a and the" Internet " UI object 31c.

If the touch gesture having the pattern 14 is recognized on the "message" UI object 31b, the control unit 180 sets the transparency of the "message" UI object 31b to the "call" UI object 31a, And "Internet" UI object 31c. In addition, the control unit 180 may display highlight, underline, background color, and the like on the "message" UI object 31b to be distinguished from the "call" UI object 31a and the "internet" UI object 31c. In addition, the control unit 180 emphasizes the border of the "message" UI object 31b or changes the color, shape, and attributes of the text to create a "call" UI object 31a and an "internet" UI object 31c It can be marked to be distinguished. Also, the control unit 180 may enlarge the size of the "message" UI object 31b and display it so as to be distinguished from the "call" UI object 31a and the "internet" UI object 31c.

If the touch gesture having the pattern 14 is recognized on the "message" UI object 31b, the control unit 180 displays the "message" UI object 31b as shown in FIG. 15 (b) The details 52 of the "message" UI object 31b.

16 (a) shows a UI object 33a, 33b (corresponding to "TOM", "KIM", and "JOHN") which are the same kinds of menu functions on the idle screen of the touch- , And 33c are shown.

16 (a), when the touch gesture having the specific pattern 14 is recognized on the contact UI object 33a of the "TOM" The touch gesture having the same pattern as the pattern 14 is searched.

16 (a) is the same as the second pattern of the second touch gesture 14 set in the memory 160 in FIGS. 8 and 9, Unlocks the touch of the touch screen 151 and unlocks the functions of the "TOM" contact UI object 33a and displays the information of the "TOM" contact, as shown in (b) of FIG.

Next, FIG. 17A shows that the user inputs a touch gesture of the specific pattern 15 on the "TOM" contact UI object 33a.

In this case, since the pattern 15 of the touch gesture input from the user is the same as the third pattern of the third touch gesture 15 set in the memory 160 in FIGS. 8 and 9, unlock the touch of the touch screen 151 and release the function execution lock of the "TOM" contact UI object 33a and control the wireless communication unit 110 to display the telephone number The call connection is attempted.

Next, FIG. 18A shows that the user has input a touch gesture of the specific pattern 16 on the "TOM" contact UI object 33a.

Since the pattern 15 of the touch gesture input from the user is the same as the fourth pattern of the fourth touch gesture 16 set in the memory 160 in Figures 8 and 9, unlocking the touch screen 151 and releasing the function execution lock of the "TOM" contact UI object 33a, as shown in Fig. At this time, the control unit 180 transmits the created message to the "TOM" when the message content creation from the user is completed through the message creation window.

19 (a) shows various types of menu functions "Honesty.mp3", "File Stack" and "Camera" UI objects 34a, 34b, and 34c on the idle screen of the touch- 34c are shown.

19 (a), when the touch gesture having the specific pattern 17 is recognized on the UI object 34a of "Honesty.mp3 ", the control unit 180 determines The touch gesture having the same pattern as the recognized pattern 17 is searched.

The pattern 17 input in FIG. 19 (a) is the same as the fifth pattern of the fifth touch gesture 17 set in the memory 160 in FIGS. 8 and 9, Unlocking the touch screen 151 and releasing the function execution lock of the "Honesty.mp3" UI object 34a, as shown in (b) of Fig. Play the file "Honesty.mp3".

Next, Figure 20 (a) shows that the user has entered a touch gesture of a particular pattern 19 on the "File Stack" menu UI object 34b.

In this case, since the pattern 19 of the touch gesture input from the user is the same as the seventh pattern of the seventh touch gesture 19 set in the memory 160 in FIGS. 8 and 9, unlock the function of the touch unlocking of the touch screen 151 and the function of the "file locker" menu UI object 34b, and display the list of files stored in the file archive of the memory 160 .

Next, FIGS. 21 and 22 illustrate a case where a touch gesture is input on a plurality of UI objects displayed on the touch-locked touch screen 151, touch lock and function execution unlocking, As shown in FIG.

21A shows that the user has input a touch gesture of a specific pattern 14 on the "Honesty.mp3" and "File Stack" UI objects 34a and 34b.

That is, the control unit 180 recognizes the input pattern 14 of the touch gesture in the memory 160 and searches for the touch gesture having the same pattern as the recognized pattern 14. [

Since the recognized pattern 14 of the touch gesture is the same as the second pattern of the second touch gesture 14 set in the memory 160 in Figures 8 and 9, Quot; Honesty.mp3 "and" file " located in the area where the pattern 14 is recognized on the touch screen 151, as shown in FIGS. Lock "UI objects 34a, 34b and executes the functions of" Honesty.mp3 "and" File Stack "UI objects 34a and 34b.

21 (b), the control unit 180 displays a list 35 of the functions of the "Honesty.mp3" and "File Stack" UI objects 34a and 34b on the touch screen 151 , The control unit 180 drives the MP3 application provided in the memory 160 and displays the message "Honesty.mp3 ", as shown in FIG. 21 (c) (34a) is reproduced.

21 (d), the control unit 180 executes the functions of the "Honesty.mp3" and the "file archive" UI objects 34a and 34b, respectively, And displays it on one screen of the touch screen 151.

22 (a) shows a UI object 33a, 33b (" TOM ", " KIM ", "JOHN") of the same kind on the idle screen of the touch- , And 33c are shown.

22 (a), when the controller 180 recognizes a touch gesture having a specific pattern 16 on the "TOM" and "KIM" contact destination UI objects 33a, 33b, And searches the memory 160 for a touch gesture having the same pattern as the recognized pattern 16. [

Since the pattern 14 input in FIG. 22 (a) is the same as the fourth pattern of the fourth touch gesture 16 set in the memory 160 in FIGS. 8 and 9, Unlock the touch of the touch screen 151 and unlock the function execution of the "TOM" and "KIM" contact UI objects 33a, 33b as shown in (b) of FIG. KIM ". At this time, the control unit 180 transmits the created message to "TOM" and "KIM"

Next, FIGS. 23 to 26 illustrate a case where a touch gesture is input on an area where UI objects are not displayed on the touch-locked touch screen 151, ≪ / RTI >

23 (a) shows a "call" UI object 31a, a "message" UI object 31b, and a menu UI object 31a, which are menu functions of various kinds on the idle screen of the touch- An "Internet" UI object 31c is shown, and a user inputs a touch gesture having a specific pattern 14 in an area where the UI objects 31a, 31b, and 31c are not displayed on the touch screen 151 .

Since the pattern 14 of the touch gesture input from the user is the same as the second pattern of the second touch gesture 14 set in the memory 160 in FIGS. 8 and 9, (b), the function execution lock of the UI objects 31a, 31b, and 31c with the unlocked touch of the touch screen 151 and the execution of the function on the touch screen 151 is released, And displays the function list 36 of the UI objects 31a, 31b, and 31c capable of executing functions on the screen 151. [

At this time, if the user selects the "message" function, the control unit 180 executes a message menu on the screen of the touch screen 151, as shown in FIG. 23C.

24 (a) shows a "TOM" contact UI object 33a and a "KIM" contact UI object 33a, which are the same kind of menu functions, on the idle screen of the touch-locked touch screen 151 33b and a contact UI object 33c are shown and a user has a specific pattern 15 on an area where the contact UI objects 33a, 33b, 33c are not displayed on the touch screen 151 A touch gesture is input.

The pattern 15 of the touch gesture inputted from the user is the same as the third pattern of the third touch gesture 15 set in the memory 160 in FIGS. 8 and 9, unlocking of the functions of the contact UI objects 33a, 33b, and 33c with the touch execution of the touch screen 151 and the function execution on the touch screen 151 being unlocked is released, And displays the function list 37 of the contact UI objects 33a, 33b, and 33c capable of performing functions on the screen 151. [

At this time, as shown in (c) of FIG. 24, when the "TOM" contact is selected, the control unit 180 controls the wireless communication unit to try to make a call connection to the telephone number in the "TOM" contact.

24 (d), the control unit 180 may not display the function list 37 shown in FIG. 24 (c). In this case, when the user selects the "TOM" contact UI object 33a among the contact UI objects 33a, 33b, 33c whose function execution lock has been released, , The wireless communication unit is controlled to attempt to establish a call to a telephone number in the "TOM" contact.

Next, Fig. 25 (a) shows a "TOM" contact UI object 33a, which is a menu function of different kinds, on the idle screen of the touch-locked touch screen 151, And a contact UI object 33c are displayed on the touch screen 151 and the user has a specific pattern 15 in an area where the UI objects 33a, 34b and 33c are not displayed on the touch screen 151 A touch gesture is input.

At this time, since the pattern 15 of the touch gesture input from the user is the same as the third pattern of the third touch gesture 15 set in the memory 160 in FIGS. 8 and 9, And releases the function execution lock of the UI objects 33a, 34b, and 33c.

Since the 'call' function is mapped to the third touch gesture 15 set in the memory 160, the control unit 180 controls the UI objects 33a 'and 33b' as shown in FIG. 25 (a) The contact UI object 33a and the contact UI object 33c of the retrieved "TOM" are retrieved from the "file archive" menu 34a, 33b, 33c, And can be displayed so as to be distinguished from each other with the object 34b.

That is, the control unit 180 stores the "TOM" contact UI object 33a and the "JOHN" contact UI object 33c associated with the "call" among the UI objects 33a, 34b, The user can easily recognize the UI objects 33a and 33c related to the touch gesture 15 inputted by the user on the touch screen 151 screen.

At this time, the controller 180 can display the "TOM" contact UI object 33a and the "JOHN" contact UI object 33c with transparency different from the "file storage" menu object 34b so as to be distinguished from each other. In addition, the control unit 180 displays highlight, underline, background color, and the like on the "TOM" contact UI object 33a and the "JOHN" contact UI object 33c to be distinguished from the "file archive" menu object 34b . In addition, the control unit 180 may enhance the border of the "TOM" contact UI object 33a and the "JOHN" contact UI object 33c or change the color, shape, Can be distinguished from each other. In addition, the controller 180 may enlarge the size of the "TOM" contact UI object 33a and the "JOHN" contact UI object 33c and display them so as to be distinguished from the "file archive" menu object 34b.

On the other hand, when the user selects the "TOM" contact UI object 33a in FIG. 25A, the control unit 180 controls the wireless communication unit as shown in FIG. 25 (b) Try to connect the call to the number.

26 (a) shows a UI object 34a of "Honesty.mp3" which is a menu function of a different kind on the idle screen of the touch-locked touch screen 151, Object 34b and a "camera" menu UI object 34c are shown, and a user selects a specific pattern 15 on an area where the UI objects 34a, 34b, and 34c are not displayed on the touch screen 151. [ A touch gesture having a touch point is input.

At this time, since the pattern 15 of the touch gesture input from the user is the same as the third pattern of the third touch gesture 15 set in the memory 160 in FIGS. 8 and 9, And releases the function execution lock of the UI objects 33a, 34b, and 33c.

Since the 'call' function is mapped to the third touch gesture 15 set in the memory 160, the control unit 180 controls the UI objects 34a 'and 34b' as shown in FIG. 26 (a) , 34b, and 34c among the UI objects related to "call ".

Since the contact UI object related to the "call" does not exist in FIG. 26 (a), the controller 180 displays a call connection To display a telephone number input window.

As described above, in the first embodiment of the present invention, the process of unlocking the touch of the touch screen 151, unlocking the function execution of the UI object, and executing the function of the UI object using the touch gesture has been described in detail.

27 to 38, when a touch gesture is input on the screen of the touch screen 151, functions, information, and menu icons registered in the touch gesture are arranged and displayed in the vicinity of the input touch gesture, A second embodiment of the present invention in which function icons and preference menus that the user desires to use can be displayed and used by simply using a touch gesture without any operation.

≪ Embodiment 2 >

FIG. 27 is a flowchart illustrating a touch gesture setting process according to the second embodiment of the present invention.

28 and 29 are screen state diagrams illustrating a touch gesture setting process according to the second embodiment of the present invention.

Hereinafter, the setting process of the touch gesture in which a plurality of functions of the controller 180 according to the second embodiment of the present invention are registered will be described in detail with reference to FIGS. 27 to 29. FIG.

27, when the touch gesture setting menu according to the second embodiment of the present invention is selected from the user through the touch screen 151, the controller 180 of the mobile terminal 100 displays the touch screen 151, And displays the touch gesture setting menu on the screen (S212).

The control unit 180 displays a touch gesture input S212 having a specific pattern from the user on the touch gesture setting menu and a plurality of functions to be associated with the input touch gesture S213, And stores it in the memory 160 in association with the pattern of the gesture (S214).

28 (a), when the "3. Touch gesture setting" menu 61 is selected, the controller 180 sets the touch gesture input window The touch gesture function setting window 12a and the touch gesture function setting window 12b.

28B shows a case where the first touch gesture 62 having the first pattern ("") is input from the user through the touch gesture input window 12a, And " Paste "and" Delete "functions are set.

At this time, the user can touch and input the first pattern ("∧") of the first touch gesture 62 to the touch screen 151, and the proximity sensor 141 provided on the touch screen 151 The first pattern ("" The following touch methods discussed in the present invention include both "contact touch" and "proximity touch ".

On the other hand, the controller 180 associates the "copy", "move", "paste", and "delete" functions set in FIG. 28B with the first touch gesture 62, .

For example, when the first touch gesture 62 shown in FIG. 28B is set in the memory 160 and the content is displayed on the idle screen or the menu screen of the touch screen 151, the controller 180 Quot ;, " move ", "pasted ", " pasted ", " pasted "Quot; delete "and" delete " functions. When one of the UI objects is selected, the function corresponding to the UI object is applied to the content.

The functions that can be set in the touch gesture input window 12a include copying, moving, pasting, and deleting the content displayed on the idle screen or the menu screen of the touch screen 151 Delete, Attach, Capture, Recording, Add, Wallpaper, Hide, Show, Zoom In, Zoom Out, And may be functions such as Add, Edit, View, Sort, Search, and the like, and may include details of the content, additional information, execution information, and the like.

The functions that can be set in the touch gesture input window 12a may be an option menu, a preference menu set by a user, a favorite broadcast channel, a shortcut number for a call connection, a web favorite, and the like.

That is, the user can set all functions and menu functions for controlling the operation of all the contents provided in the mobile terminal 100 through the touch gesture input window 12a.

At this time, the contents may include at least one of text, an image, a received message, contact information in a phonebook, an audio file, a picture file, a moving picture file, a game file, a schedule file, A calculator file, and web page address information. That is, the content includes all data existing in the menu function of the mobile terminal 100. The contact information may include a mobile phone number, a name, a home telephone number, and an e-mail address of the other party.

28 (c), the second touch gesture 63 having the second pattern ("") is input from the user through the touch gesture input window 12a, and the touch gesture function setting window 12b has the " Attribute information "and" additional information "functions are set.

The control unit 180 associates the "attribute information" and "additional information" functions set in (c) of FIG. 28 with the second touch gesture 63 and stores them in the memory 160.

For example, when the second touch gesture 63 shown in FIG. 28C is set in the memory 160 and the content is displayed on the idle screen or the menu screen of the touch screen 151, the controller 180 (UI) indicating "attribute information" and "additional information" associated with the first touch gesture 62 on the content, if the same touch gesture as the second touch gesture 63 is recognized by the user from the user And displays information corresponding to the UI object when one of the UI objects is selected. Here, the "attribute information" and "additional information" may be information on a content or a menu predetermined by the user, and the touch gesture may be information on the inputted content.

28D, a third touch gesture 64 having a third pattern ("") is input from the user through the touch gesture input window 12a, and the touch gesture function setting window 12b, Shows that the "preference menu" function is set.

The control unit 180 stores the "preference menu" function set in (c) of FIG. 28 in the memory 160 in association with the third touch gesture 64.

For example, when the third touch gesture 64 shown in FIG. 28 (d) is set in the memory 160, the control unit 180 controls the third touch gesture 64 on the idle screen or the menu screen of the touch screen 151 When the same touch gesture as the touch gesture 64 is recognized, displays UI objects representing "preference menus" associated with the third touch gesture 64 on the idle screen or menu screen, If one is selected, a menu corresponding to the UI object is executed. Here, the "preference menu" means that the menus that the user himself / herself mainly uses are set in advance.

29A shows a case where a fourth touch gesture 65 having a fourth pattern ("C ") is inputted from the user through the touch gesture input window 12a, and the touch gesture function setting window 12b, Shows that the "abbreviated number" function is set.

The controller 180 associates the "shortcut number" function set in (a) of FIG. 29 with the fourth touch gesture 65 and stores it in the memory 160.

Hereinafter, the "abbreviated number" described in this specification will be described with reference to Table 1.

Abbreviation number name Phone number One SAM 010-111-xxx2 2 KIM 010-112-xxx3 3 LEE 010-112-xx21

As shown in Table 1, the "abbreviated number" is a shortcut key for a call connection, meaning that a specific number and a phone number of the other party are linked to each other. For example, if the user inputs the short cut number "1" for a short time or longer, the control unit 180 determines that the phone book stored in the memory 160 has "010-111 quot; -xxx2 "telephone number and controls the wireless communication unit 110 to connect the telephone call to the searched" 010-111-xxx2 "telephone number.

On the other hand, when the fourth touch gesture 65 shown in FIG. 29 (a) is set in the memory 160, the control unit 180 displays a standby screen of the touch screen 151 or a fourth touch Displays UI objects representing "abbreviated numbers" associated with the fourth touch gesture 65 on the idle screen or menu screen when the same touch gesture as the gesture 65 is recognized, Is selected, the call connection is attempted to the telephone number mapped with the "shortcut number" corresponding to the UI object.

29B shows a fifth touch gesture 66 having a fifth pattern ("O ") from the user through the touch gesture input window 12a, a touch gesture function setting window 12b, Quot; message transmission "and" call connection "functions are set.

The controller 180 associates the "message transfer" and "call connection" functions set in FIG. 29 (b) with the fifth touch gesture 66 and stores them in the memory 160.

For example, when the fifth touch gesture 66 shown in FIG. 29 (b) is set in the memory 160 and the contact information is displayed on the idle screen or the menu screen of the touch screen 151, 180 transmits the message transmission and the "call connection" associated with the fifth touch gesture 66 on the contact information when the same touch gesture as the fifth touch gesture 66 is recognized on the contact information from the user, And when a "call connection" UI object among the UI objects is selected, the call connection is attempted with the contact information.

29 (c) shows a sixth touch gesture 67 having a sixth pattern ("? ") From the user through the touch gesture input window 12a, a touch gesture function setting window 12b, Shows that the "sub-menu" function is set.

The control unit 180 associates the "sub-menu" function set in (c) of FIG. 29 with the sixth touch gesture 67 and stores the function in the memory 160.

For example, when the sixth touch gesture 67 shown in FIG. 29 (c) is set in the memory 160 and a specific menu is displayed on the touch screen 151, When the same touch gesture as the sixth touch gesture 67 is recognized on the information, UI objects representing "submenus" of the menu are displayed on the menu, and a specific "submenu & Is selected, the selected "submenu" is executed.

29D, a seventh touch gesture 68 having a seventh pattern (" B ") is input from the user through the touch gesture input window 12a, and a touch gesture function setting window 12b, Shows that the "favorite broadcast channel" function is set.

The control unit 180 stores the "favorite broadcast channel" function set in (d) of FIG. 28 in the memory 160 in association with the seventh touch gesture 68.

For example, when the seventh touch gesture 68 shown in FIG. 29 (d) is set in the memory 160 and a broadcast playback screen is displayed on the touch screen 151, Displays UI objects representing "favorite broadcast channels" associated with the seventh touch gesture (68) on the broadcast playback screen when the same touch gesture as the seventh touch gesture (68) is recognized on the playback screen, When any one of the UI objects is selected, a broadcast program of the broadcast channel corresponding to the UI object is received and displayed on the broadcast playback screen. At this time, the "preferred broadcast channel" means that broadcast channels that the user himself / herself mainly watches are set in advance.

Hereinabove, the touch gesture setting process according to the second embodiment of the present invention has been described in detail with reference to FIGS.

Hereinafter, the operation of the mobile terminal 100 using the touch gesture according to the second embodiment of the present invention will be described in detail with reference to FIGS. 30 to 38. FIG.

30 is a flowchart illustrating an operation control process of a mobile terminal using a touch gesture according to a second embodiment of the present invention.

31 to 38 are screen diagrams illustrating a process of controlling an operation of a mobile terminal using a touch gesture according to a second embodiment of the present invention.

Referring to FIG. 30, the controller 180 of the mobile terminal 100 detects whether a touch gesture having a specific pattern is input from the user on the screen of the touch screen 151 displayed on the idle screen or the menu screen (S311 ].

At this time, if it is detected that the touch gesture having the specific pattern is input to the touch screen 151 (S312), the controller 180 recognizes the pattern of the touch gesture input to the touch screen 151 (S313).

The controller 180 searches the memory 160 to see if there is a touch gesture that includes the pattern of the recognized touch gesture (S314). If the touch gesture includes the recognized pattern of the touch gesture in the memory 160 If it is found, the UI 160 displays UI objects for executing a plurality of functions associated with the touch gesture retrieved from the memory 160 (S316).

At this time, the controller 180 may display the UI objects around the input touch gesture by sorting the UI objects according to the frequency of use, importance, and priority set by the user in step S316.

In step S316, the controller 180 determines whether the UI objects are displayed in the vicinity of the input touch gesture in one of a grid style, a list style, a random style, a pile style, and a messy style .

In addition, the controller 180 displays a three-dimensional polyhedron shape such as a cube on the periphery of the input touch gesture, and the UI objects may be displayed on each face of the three-dimensional polyhedron shape. At this time, the three-dimensional polyhedron typically displays three faces on the screen, and the user can rotate the three-dimensional polyhedron to view UI objects displayed on the face that is not visible on the current screen.

In addition, the controller 180 may display the UI objects by arranging the UI objects in a pattern shape of the touch gesture at the position of the input touch gesture.

Meanwhile, when any one of the UI objects is selected by the user (S317), the controller 180 executes a function corresponding to the selected UI object (S318).

Hereinafter, the process of controlling the operation of the mobile terminal 100 using the touch gesture according to the second embodiment of the present invention will be described in detail with reference to FIG. 31 to FIG.

31 to 33, when the touch gesture according to the second exemplary embodiment of the present invention is recognized on the screen of the touch screen 151, the process of displaying the functions associated with the recognized touch gesture will be described in detail Explain.

31 (a) shows an idle screen displayed on the touch screen 151, and a user inputs a touch gesture having a specific pattern ("") 64 on the idle screen Respectively.

At this time, the pattern 64 of the touch gesture input from the user is the same as the third pattern of the third touch gesture 64 set in the memory 160 in FIGS. 28 and 29, The touch gesture 64 is associated with "preference menus"

31 (b) to (d), the control unit 180 displays UI objects 71a to 71c representing "preference menus" 71 associated with the third touch gesture 64, 71g on the idle screen.

At this time, the UI objects 71a to 71g may be displayed to be identified on the idle screen. That is, the control unit 180 may display the UI objects 71a to 71g on the idle screen in a transparent manner so as to be identified. In addition, the control unit 180 can display the UI objects 71a to 71g so as to be displayed by highlighting, underlining, and background color. In addition, the control unit 180 may emphasize the edges of the UI objects 71a to 71g or change the text color, shape, and attributes of the UI objects 71a to 71g so as to be displayed so as to be identified.

On the other hand, FIG. 31 (b) shows a case in which the controller 180 places the UI objects 71a to 71g representing the "preference menus " ("") 64. FIG. At this time, the UI objects 71a to 71g displayed in the shape of the pattern ("") 64 may be rearranged according to the frequency of use, importance, and priority set by the user.

31 (b), when the UI objects 71a to 71g are displayed in the pattern ("") 64 in the pattern of the touch gesture (" (180) may sequentially display the UI objects (71a to 71g) from the touch start point to the touch end point of the touch gesture pattern ("") (64).

31C shows that the control unit 180 displays the UI objects 71a to 71g indicating the above-mentioned " preference menus " on the idle screen in a grid manner .

Finally, FIG. 31 (d) shows that the control unit 180 displays the UI objects 71a to 71g representing the above-mentioned " preference menus " in a Messy manner.

32 (a) shows that a broadcast playback screen is displayed on the touch screen 151, and a user touches the touch screen 151 with a specific pattern ("B") 68 on the broadcast playback screen As shown in Fig.

At this time, the pattern 68 of the touch gesture input from the user is the same as the seventh pattern of the seventh touch gesture 68 set in the memory 160 in Figs. 28 and 29, The touch gesture 68 is associated with "preferred broadcast channels"

Accordingly, the control unit 180 can display UI objects 72a (72a) indicating "favorite broadcast channels" 72 associated with the seventh touch gesture 68 as shown in (b) To 72e) on the broadcast playback screen.

32 (b) shows a case where the controller 180 displays the UI objects 72a to 72e indicating the "favorite broadcast channels" 72 on the broadcast playback screen in a three-dimensional polyhedron method such as a cube . At this time, the three-dimensional polyhedron can be rotated according to the user's up / down or left / right flicking operation to view UI objects 72d and 72e which are not visible on the current screen.

32C shows the UI objects 72a to 72e arranged in the pattern ("B") 68 in the pattern of the touch gesture 68 . At this time, the control unit 180 may sequentially display the UI objects 72a to 72e from the touch start point to the touch end point of the touch gesture pattern ("B") 68. [

33 (a) shows that a phonebook menu is displayed on the touch screen 151, and a user touches a touch gesture having a specific pattern ("?") 67 on the phonebook menu screen Is input.

At this time, the pattern 67 of the touch gesture input from the user is the same as the sixth pattern of the sixth touch gesture 67 set in the memory 160 in Figs. 28 and 29, The touch gesture 67 is associated with a "submenus" function 73.

33 (b), the control unit 180 displays UI objects 73a to 73e indicating "submenus" 73 associated with the sixth touch gesture 67, It is displayed on the phonebook menu screen.

33 (b) shows that the UI objects 73a to 73e are displayed in the form of the pattern ("?") 67 in the pattern of the touch gesture 67 .

Next, referring to FIG. 34, when a touch gesture according to the second embodiment of the present invention is input on the screen of the touch screen 151, a plurality of touch gestures including a pattern of the input touch gesture in the memory A process of displaying UI objects associated with the searched touch gesture in the same order as the input touch gesture pattern will be described.

34A shows that the fourth touch gesture of the pattern of the fourth pattern ("C") 65 associated with the function of the "abbreviation number" 74 is input on the idle screen of the touch screen 151 .

34B shows the UI objects 74a to 74d indicating the functions of the "abbreviation number" 74 associated with the fourth touch gesture 65 on the idle screen are displayed on the pattern of the fourth touch gesture Quot;) 65 in the pattern ("C") 65 shape.

At this time, as shown in (b) of FIG. 34, the controller 180 displays the fourth pattern ("C") 65 of the fourth touch gesture in a state in which the UI objects 74a to 74d are displayed, Is changed to the fifth pattern ("o") 66 set in the memory 160 by the user, a UI object indicating the function of the "abbreviated number" 74 The UI objects 75a and 75b representing the "call connection" and "message transfer" functions associated with the fifth pattern (" .

35 (a) shows that a message list menu is displayed on the touch screen 151, and when a user selects a specific pattern (" 2. KIM ") on a specific message Quot; "" ") " 66 in Fig.

At this time, the pattern 66 of the touch gesture input from the user is the same as the fifth pattern of the fifth touch gesture 66 set in the memory 160 in FIGS. 28 and 29, The touch gesture 66 is associated with the "call connection" and "message transfer" functions.

35B, UI 180 includes UI objects 75a and 75b indicating "call connection" and "message transfer" functions associated with the fifth touch gesture 66, Is displayed on the message ("2. KIM").

At this time, if the user selects the "call connection" UI object 75b, the controller 180 controls the wireless communication unit 110 to attempt to establish a call connection to "2.KIM ".

36 (a) shows that a file list menu is displayed on the touch screen 151, and when the user selects a specific file ("1. a.jpg") on the file list menu screen ("") ≪ / RTI >

At this time, the pattern 62 of the touch gesture input from the user is the same as the first pattern of the first touch gesture 62 set in the memory 160 in FIGS. 28 and 29, The touch gesture 66 is associated with the functions "copy", "move", "paste", and "delete".

36 (a), the control unit 180 controls the UIs to display the functions of "copy", "move", "paste", and "delete" associated with the first touch gesture 62 Objects on the file ("1. a.jpg").

At this time, if the user selects the "delete" UI object, the control unit 180 can delete the "1. a.jpg" in the memory 160 as shown in FIG. 36 (b).

37 and 38, a process of executing the functions in a state where the functions associated with the touch gesture according to the second embodiment of the present invention are displayed on the touch screen 151 will be described in detail.

37A is a diagram showing the relationship between the position of the third touch gesture 64 of the third pattern ("") input on the idle screen of the touch screen 151 and the position of the third touch gesture 64 in association with the third touch gesture 64 "Preference menu" UI objects 71a to 71g are displayed.

At this time, when the number of displayed UI objects 72a to 72e associated with the touch gesture input from the user is large, the user touches the UI object 71e that the user desires to execute among the UI objects 72a to 72e It can be difficult to do.

37 (b), the controller 180 enlarges and displays the selected UI object 72e when any one of the UI objects 72a to 72e is first selected, When the UI object 72e is again selected, the function "calculator" corresponding to the UI object 72e is executed.

 38 (a), the fourth touch gesture 65 of the fourth pattern ("C") is recognized on the idle screen of the touch screen 151, and the fourth touch gesture 65 Associated "abbreviated" UI objects 74a through 74d are displayed.

At this time, when the "TOM abbreviation number" UI object 74c of the "abbreviated number" UI objects 74a to 74d is selected, the control unit 180 selects the & UI objects 74a to 76d indicating functions related to the shortcut number "UI number 74c " are displayed around the" TOM shortcut number "UI object 74c.

At this time, if the "call connection" UI object 76c among the UI objects 76a to 76d indicating functions related to the "TOM shortcut number" UI object 74c is selected, , The wireless communication unit 110 is controlled to try to make a call connection to the telephone number of the "TOM ".

It will be apparent to those skilled in the art that the present invention may be embodied in other specific forms without departing from the spirit or essential characteristics thereof.

The present invention described above can be embodied as computer-readable codes on a medium on which a program is recorded. The computer readable medium includes all kinds of recording devices in which data that can be read by a computer system is stored. Examples of the computer-readable medium include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage, and the like, and also implemented in the form of a carrier wave (for example, transmission over the Internet) . Also, the computer may include a control unit 180 of the terminal.

Accordingly, the above description should not be construed in a limiting sense in all respects and should be considered illustrative. The scope of the present invention should be determined by rational interpretation of the appended claims, and all changes within the scope of equivalents of the present invention are included in the scope of the present invention.

The above-described mobile terminal and its control method are not limited to the configuration and method of the above-described embodiments, but the embodiments may be modified such that all or some of the embodiments are selectively And may be configured in combination.

1 is a block diagram of a mobile terminal according to an embodiment of the present invention.

Figure 2a is a front perspective view of a mobile terminal according to one embodiment of the present invention. Figure 2b is a rear perspective view of a mobile terminal according to an embodiment of the present invention.

3A and 3B are front views of a mobile terminal for explaining one operation state of the mobile terminal according to the present invention.

4 is a conceptual diagram for explaining the proximity depth of the proximity sensor.

5A and 5B are conceptual diagrams for explaining a proximity touch recognition area where a proximity signal is detected and a haptic area for generating a tactile effect, respectively.

6A and 6B are perspective views of a mobile terminal according to an embodiment of the present invention.

FIG. 7 is a flowchart illustrating a touch gesture setting process according to the first embodiment of the present invention.

8 to 11 are screen state diagrams illustrating a touch gesture setting process according to the first embodiment of the present invention.

12 is a flowchart illustrating an operation control process of a mobile terminal using a touch gesture according to the first embodiment of the present invention.

13 to 26 are screen diagrams illustrating a process of controlling the operation of the mobile terminal using the touch gesture according to the first embodiment of the present invention.

FIG. 27 is a flowchart illustrating a touch gesture setting process according to the second embodiment of the present invention.

28 and 29 are screen state diagrams illustrating a touch gesture setting process according to the second embodiment of the present invention.

30 is a flowchart illustrating an operation control process of a mobile terminal using a touch gesture according to a second embodiment of the present invention.

31 to 38 are screen diagrams illustrating a process of controlling an operation of a mobile terminal using a touch gesture according to a second embodiment of the present invention.

Claims (16)

A touch screen that displays two or more UI (UI) objects within a touch-locked lock screen; A memory having a specific pattern and having at least one touch gesture for unlocking the touch and executing a function execution command of the UI object; And When the touch gesture having the same pattern as the touch gesture set in the memory is input on the UI objects, the touch gesture is unlocked by the touch gesture, and the touch gesture is controlled to display the list of the functions of the UI objects input by the touch gesture And executing a function selected from the list. The method according to claim 1, Wherein the UI objects are UI objects to which a menu function of the same type or a different kind displayed on a idle screen or a menu screen is given. The method according to claim 1, Wherein the control unit interrupts the setting of the input touch gesture in the memory when the input touch gesture is similar to the touch gestures set in the memory when setting the touch gesture input from the user to the memory, . The method according to claim 1, If the input touch gesture is similar to the touch gestures set in the memory when the touch gesture inputted from the user is set in the memory, the control unit checks the similarity with the touch gesture similar to the inputted touch gesture in the memory And displays the scanned similarity information on the touch screen. The method according to claim 1, Wherein the controller displays the UI objects input by the touch gesture on the touch screen so as to be distinguished from other UI objects. The method according to claim 1, Wherein the controller displays detailed information of the UI objects input by the touch gesture around the UI objects. delete The method according to claim 1, Wherein the UI objects are in a state that the function execution of the UI objects is further locked, Wherein the control unit releases the function execution lock of the UI objects to execute the function. 9. The method of claim 8, Wherein the control unit displays an identifier indicating whether the function of the UI objects is locked or not. delete delete The method according to claim 1, Wherein the control unit executes the functions of the UI objects and displays the respective function execution screens on a screen of the touch screen. The method according to claim 1, When the touch gesture having the same pattern as the touch gesture set in the memory is input to an area where the UI objects are not located, the control unit releases the touch lock of the screen and the function lock of the UI objects displayed on the screen And the mobile terminal. 14. The method of claim 13, Wherein the controller displays the UI objects to which the function is assigned, when the touch lock and the function execution lock are released, the UI objects to which the function is not assigned, from among the UI objects. 14. The method of claim 13, Wherein the controller displays a list of the functions of the UI objects when the touch lock and the function execution lock are released, and executes the selected function on the list. Setting at least one touch gesture for a function unlocking of the touch object and a function execution command of the UI object with a specific pattern; Displaying two or more UI objects on a touch screen with a touch lock; Releasing the touch lock of the touch screen when the touch gesture having the same pattern as the set touch gesture is inputted on the UI objects; Displaying a list of functions of the UI objects input by the touch gesture; And  And executing a function selected from the list.

Images