KR20150065340A - Mobile terminal and method for controlling thereof - Google Patents

Abstract

A mobile terminal according to the present invention comprises: a touch screen for displaying information; a touch input unit for receiving touch input by a user outside of the touch screen; and a control unit controlling at least one main menu to be displayed nearby the touch point of a first pointer when touch input of first and second touch pointers is inputted in the touch input unit, and controlling at least one sub menu belonging to the selected main menu corresponding to the touch point of the first touch pointer to be displayed nearby the touch point of the second touch pointer.

Description

[0001] MOBILE TERMINAL AND METHOD FOR CONTROLLING THEREOF [0002]

The present invention relates to a mobile terminal and a control method thereof, in which the use of the mobile terminal can be implemented in consideration of the convenience of the user.

With the development of technology, development of wearable computers is accelerating. Here, wearable computers represent computers that can be worn on the body naturally, such as clothes, watches, glasses, and accessories. Devices such as smartphones and tablet PCs can be conveniently used with a single finger or touch fan, but there may be inconveniences of having to carry it in a pocket or bag or carry it on hand. On the other hand, wearable computers can be easier to carry than smart phones or tablet PCs because they can be worn on their wrists or carried around like glasses.

Especially, as a kind of wearable computer, there are various products for wristwatch, that is, smart watch, which can search diverse services such as diary, message, notification, stock quotes through wireless. In the case of smart watch, since the size of the touch screen capable of touch input is smaller than that of the smart phone, it is necessary to adopt a method of inputting a user other than the smart phone.

SUMMARY OF THE INVENTION It is an object of the present invention to provide a mobile terminal providing a simple and intuitive user input method considering characteristics of a mobile terminal having a small touch screen size and a control method thereof.

According to an aspect of the present invention, there is provided a mobile terminal including a touch screen for displaying information, a touch input unit for receiving a user's touch input from the outside of the touch screen, And a controller for controlling at least one main menu to be displayed around a touch point of the first pointer when the touch input of the second pointer is received, And at least one sub-menu depending on the selected main menu is displayed.

In this case, when a user input to change the touch position of the first pointer is received on the touch input unit, the control unit displays at least a touch position of the second pointer, It is possible to control one sub-menu to be displayed.

Here, the user input may include sliding the first pointer along the touch input unit, or re-touching the touch input unit after the first pointer is released from the touch input unit.

Meanwhile, the control unit can control the selected main menu corresponding to the touch position of the first pointer and the selected sub menu corresponding to the touch position of the second pointer to be visually identified and displayed.

Meanwhile, when a user input for executing the submenu selected by the second pointer is received, the control unit can execute a command corresponding to the selected submenu.

Here, the user input may include sliding the second pointer from the touch input unit to the inside of the touch screen, touching the second pointer from the touch input unit, and then moving the second pointer to the touch screen And touching the selected submenu.

If the main menu selected by the first pointer is a character input menu, the control unit controls to display at least one submenu indicating a character to be input in the vicinity of a touch point of the second pointer, When the user input for executing the sub-menu selected by the 2-pointer is received, it is possible to control the characters indicated by the selected sub-menu to be input.

In this case, the user input may be to slide the second pointer from the touch input unit to the inside of the touch screen.

On the other hand, when the submenu selected by the second pointer indicates a plurality of characters, the control unit can control to input any one of the plurality of characters based on the slide direction of the second pointer .

If the main menu selected by the first pointer is changed to the text completion menu, the control unit may display at least one text indicating the text that can be completed by including characters typed around the touch point of the second pointer Submenu can be displayed.

In this case, the control unit controls to display at least one additional sub-menu depending on the sub-menu selected by the second pointer through the touch screen, wherein the at least one additional sub- You can indicate a sentence that can be completed, including the text to indicate.

Meanwhile, when the submenu selected by the second pointer is a time menu, the control unit controls the display unit to display the clock UI through the touch screen, and the user input for operating the clock UI by the second pointer is received , It is possible to control the time data indicated by the operated clock UI to be input as characters.

If the main menu selected by the first pointer is a character menu, the control unit controls the display unit to display at least one submenu indicating a character, and if the user input for rolling the submenu is received When a double-touch user input is received, a character indicated by a sub-menu corresponding to a predetermined position of the touch screen is input.

Meanwhile, the control unit may control to delete the displayed character when a user input for double-clicking the character displayed on the touch screen is received.

Meanwhile, the control unit may control to delete the displayed character when a user input for sliding a character displayed on the touch screen from the touch screen to the touch input unit is received.

Meanwhile, the control unit may control the display of the at least one main menu and the at least one sub-menu to be terminated when a user input for double-clicking the touch screen is received.

Meanwhile, the mobile terminal may be in the form of a clock, and the touch input unit may be in the form of a bezel surrounding the touch screen.

According to another aspect of the present invention, there is provided a method of controlling a mobile terminal including a touch screen according to an exemplary embodiment of the present invention and a touch input unit for receiving a touch input from a user outside the touch screen, Receiving a touch input of a first pointer and a second pointer, displaying at least one main menu around a touch point of the first pointer, and displaying at least one main menu around a touch point of the first pointer, And displaying at least one submenu subordinate to the selected main menu corresponding to the selected submenu.

Here, when a user input for changing the touch position of the first pointer is received on the touch input unit, at least one sub menu depending on the main menu corresponding to the changed touch position is displayed around the second touch point Step < / RTI >

The method may further include executing a command corresponding to the selected sub menu when a user input for executing the sub menu selected by the second pointer is received.

If the main menu selected by the first pointer is a character input menu, the at least one submenu is a submenu indicating a character, and a user input for executing the submenu selected by the second pointer is received The method may further comprise inputting a character indicated by the selected submenu.

According to the terminal and the control method thereof according to an embodiment of the present invention, a mobile terminal can be controlled according to an intuitive and convenient user input method in a small sized touch screen.

In addition, the mobile terminal according to the present invention can input text with minimized user input as compared with a touch input by a conventional touch screen.

1 is a block diagram of a mobile terminal according to an embodiment of the present invention.
2 is a perspective view of a mobile terminal according to an embodiment of the present invention.
3 is a rear perspective view of the mobile terminal shown in FIG.
4 is a block diagram of a mobile terminal according to an embodiment of the present invention.
5 is a front perspective view of a mobile terminal according to an embodiment of the present invention.
FIG. 6 is a diagram illustrating a touch sensor arrangement of a mobile terminal according to an exemplary embodiment of the present invention. Referring to FIG.
7 to 8 are diagrams for explaining a menu pop-up method according to an embodiment of the present invention.
9A to 9C and 10A to 10B are views for explaining a method of selecting a main menu according to an embodiment of the present invention.
11A to 11B and 12A to 12B are views for explaining a submenu selecting method according to an embodiment of the present invention.
13 is a diagram for explaining a command execution method according to an embodiment of the present invention.
14 (a) to 14 (c) are diagrams for explaining a character input method according to an embodiment of the present invention.
15 (a) and 15 (b) are diagrams for explaining a sentence automatic input method according to an embodiment of the present invention.
16A and 16B are diagrams for explaining a time data character input method according to an embodiment of the present invention.
17 is a diagram for explaining a character input method according to an embodiment of the present invention.
18 (a) and 18 (b) are diagrams for explaining a method for deleting input characters according to an embodiment of the present invention.
FIG. 19 is a view for explaining a menu display ending method according to an embodiment of the present invention.
20 is a diagram illustrating a submenu configuration list for a sentence automatic input method according to an embodiment of the present invention.
21 is a diagram for explaining a character input scenario according to an embodiment of the present invention.
22 is a flowchart illustrating a method of controlling a mobile terminal according to an embodiment of the present invention.
23 is a flowchart illustrating a method of controlling a mobile terminal according to an embodiment of the present invention.

Hereinafter, a mobile terminal related to the present invention will be described in detail with reference to the drawings.

The suffix "module" and " part "for the components used in the following description are given or mixed in consideration of ease of specification, and do not have their own meaning or role.

The mobile terminal described herein may include a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, a PDA (Personal Digital Assistants), a PMP (Portable Multimedia Player), a navigation device, have.

However, it will be understood by those skilled in the art that the configuration according to the embodiments described herein may be applied to a fixed terminal such as a digital TV, a desktop computer, and the like, unless the configuration is applicable only to a mobile terminal.

1 is a block diagram of a mobile terminal according to an embodiment of the present invention. 1, the mobile terminal 100 includes a wireless communication unit 110, an audio / video (A / V) input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, An interface unit 170, a control unit 180, a power supply unit 190, and the like. The components shown in FIG. 1 are not essential, and a mobile terminal having more or fewer components may be implemented.

Hereinafter, the components will be described in order.

The wireless communication unit 110 may include one or more modules for enabling wireless communication between the mobile terminal 100 and the wireless communication system or between the mobile terminal 100 and the network in which the mobile terminal 100 is located. For example, the wireless communication unit 110 may include a broadcast receiving module 111, a mobile communication module 112, a wireless Internet module 113, a short range communication module 114, and a location information module 115 .

The broadcast receiving module 111 receives broadcast signals and / or broadcast-related information from an external broadcast management server through a broadcast channel. The broadcast channel may include a satellite channel and a terrestrial channel. Two or more broadcast receiving modules may be provided to the mobile terminal 100 for simultaneous broadcast reception or broadcast channel switching for at least two broadcast channels.

The broadcast management server may refer to a server for generating and transmitting broadcast signals and / or broadcast related information, or a server for receiving broadcast signals and / or broadcast related information generated by the broadcast management server and transmitting the generated broadcast signals and / or broadcast related information. The broadcast signal may include a TV broadcast signal, a radio broadcast signal, a data broadcast signal, and a broadcast signal in which a data broadcast signal is combined with a TV broadcast signal or a radio broadcast signal.

The broadcast-related information may refer to a broadcast channel, a broadcast program, or information related to a broadcast service provider. The broadcast-related information may also be provided through a mobile communication network. In this case, it may be received by the mobile communication module 112.

The broadcast-related information may exist in various forms. For example, an EPG (Electronic Program Guide) of DMB (Digital Multimedia Broadcasting) or an ESG (Electronic Service Guide) of Digital Video Broadcast-Handheld (DVB-H).

For example, the broadcast receiving module 111 may be a Digital Multimedia Broadcasting-Terrestrial (DMB-T), a Digital Multimedia Broadcasting-Satellite (DMB-S), a Media Forward Link Only (Mobile Broadcasting Business Management System), ISDB-T (Integrated Services Digital Broadcasting (ISDB-T)), Digital Multimedia Broadcasting (MBMS) Digital Broadcast-Terrestrial) or the like. Of course, the broadcast receiving module 111 may be adapted to other broadcasting systems as well as the digital broadcasting system described above.

The broadcast signal and / or broadcast related information received through the broadcast receiving module 111 may be stored in the memory 160.

The mobile communication module 112 may be coupled to a base station on a mobile communication network such as but not limited to GSM (Gobal System for Mobile communications), CDMA (Code Division Multiple Access), WCDMA (Wideband CDMA), LTE (Long Term Evolution) And transmits and receives a radio signal to at least one of an external terminal and a server. The wireless signal may include various types of data depending on a voice call signal, a video call signal or a text / multimedia message transmission / reception.

The wireless Internet module 113 is a module for wireless Internet access, and may be built in or externally attached to the mobile terminal 100. Wireless Internet technologies include WLAN (Wi-Fi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access), GSM, CDMA, WCDMA, LTE Evolution (but not limited to) may be used.

The wireless Internet module 113, which performs wireless Internet access through the mobile communication network, is connected to the mobile communication module 110 through the mobile communication network, for example, from the viewpoint that the wireless Internet access by Wibro, HSDPA, GSM, CDMA, WCDMA, LTE, (112). ≪ / RTI >

The short-range communication module 114 refers to a module for short-range communication. Bluetooth, Radio Frequency Identification (RFID), infrared data association (IrDA), Ultra Wideband (UWB), ZigBee, and the like can be used as a short range communication technology.

The position information module 115 is a module for obtaining the position of the mobile terminal, and a representative example thereof is a Global Position System (GPS) module. According to the current technology, the GPS module 115 calculates distance information and accurate time information from three or more satellites, and then applies trigonometry to the calculated information to obtain a three-dimensional string of latitude, longitude, The location information can be accurately calculated. At present, a method of calculating position and time information using three satellites and correcting an error of the calculated position and time information using another satellite is widely used. In addition, the GPS module 115 can calculate speed information by continuously calculating the current position in real time.

Referring to FIG. 1, an A / V (Audio / Video) input unit 120 is for inputting an audio signal or a video signal, and may include a camera 121 and a microphone 122. The camera 121 processes image frames such as still images or moving images obtained by the image sensor in the video communication mode or the photographing mode. The processed image frame can be displayed on the display unit 151. [

The image frame processed by the camera 121 may be stored in the memory 160 or transmitted to the outside through the wireless communication unit 110. [ Two or more cameras 121 may be provided depending on the use environment.

The microphone 122 receives an external sound signal through a microphone in a communication mode, a recording mode, a voice recognition mode, or the like, and processes it as electrical voice data. The processed voice data can be converted into a form that can be transmitted to the mobile communication base station through the mobile communication module 112 when the voice data is in the call mode, and output. Various noise reduction algorithms may be implemented in the microphone 122 to remove noise generated in receiving an external sound signal.

The user input unit 130 generates input data for a user to control the operation of the terminal. The user input unit 130 may include a button 136 and a touch sensor (static pressure / static electricity) 137 positioned at the front, rear, or side of the mobile terminal 100, and may include a keypad, A dome switch, a jog wheel, a jog switch, and the like. According to the embodiments described below, the touch sensor 137 may be arranged to surround the display unit 151.

The sensing unit 140 senses the current state of the mobile terminal 100 such as the open / close state of the mobile terminal 100, the position of the mobile terminal 100, the presence or absence of user contact, the orientation of the mobile terminal, And generates a sensing signal for controlling the operation of the mobile terminal 100. Examples of the sensing unit 140 include a gyroscope sensor, an acceleration sensor, and a geomagnetic sensor.

For example, when the mobile terminal 100 is in the form of a slide phone, it is possible to sense whether the slide phone is opened or closed. It is also possible to sense whether the power supply unit 190 is powered on, whether the interface unit 170 is connected to an external device, and the like. Meanwhile, the sensing unit 140 may include a proximity sensor 141.

The output unit 150 is for generating output related to the visual, auditory or tactile sense and includes a display unit 151, an audio output module 152, an alarm unit 153, and a haptic module 154 .

The display unit 151 displays (outputs) information processed by the mobile terminal 100. For example, when the mobile terminal is in the call mode, a UI (User Interface) or a GUI (Graphic User Interface) associated with a call is displayed. When the mobile terminal 100 is in the video communication mode or the photographing mode, the photographed and / or received video or UI and GUI are displayed.

The display unit 151 may be a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), a flexible display display, and a 3D display.

Some of these displays may be transparent or light transmissive so that they can be seen through. This can be referred to as a transparent display, and a typical example of the transparent display is TOLED (Transparent OLED) and the like. The rear structure of the display unit 151 may also be of a light transmission type. With this structure, the user can see an object located behind the terminal body through the area occupied by the display unit 151 of the terminal body.

There may be two or more display units 151 according to the embodiment of the mobile terminal 100. For example, in the mobile terminal 100, a plurality of display portions may be spaced apart from one another or may be disposed integrally with each other, or may be disposed on different surfaces.

The display unit 151 may include a display unit 151 and a touch sensor 137. The display unit 151 and the touch sensor 137 may have a layer structure or an integrated structure, Can be used. The touch sensor may be stacked on the display unit 151 to form a layer structure when the touch sensor has a form of a touch film, a touch sheet, a touch pad, or the like. And can be integrally formed.

The touch sensor 137 may be configured to convert a change in a pressure applied to a specific part of the display part 151 or a capacitance generated in a specific part of the display part 151 into an electrical input signal. The touch sensor 137 can be configured to detect not only the position and area to be touched but also the pressure at the time of touch.

If there is a touch input to the touch sensor 137, the corresponding signal (s) is sent to the touch controller. The touch controller processes the signal (s) and transmits the corresponding data to the controller 180. Thus, the control unit 180 can know which area of the display unit 151 is touched or the like.

Referring to FIG. 2, the proximity sensor 141 may be disposed in an inner region of the mobile terminal or in the vicinity of the touch screen, which is surrounded by the touch screen. The proximity sensor refers to a sensor that detects the presence or absence of an object approaching a predetermined detection surface or a nearby object without mechanical contact using the force of an electromagnetic field or infrared rays. The proximity sensor has a longer life span than the contact sensor and its utilization is also high.

Examples of the proximity sensor include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, and an infrared proximity sensor. And to detect the proximity of the pointer by the change of the electric field along the proximity of the pointer when the touch screen is electrostatic. In this case, the touch screen (touch sensor) may be classified as a proximity sensor.

Hereinafter, for convenience of explanation, the act of recognizing that the pointer is positioned on the touch screen while the pointer is not in contact with the touch screen is referred to as "proximity touch" The act of actually touching the pointer on the screen is called "contact touch. &Quot; The position where the pointer is proximately touched on the touch screen means a position where the pointer is vertically corresponding to the touch screen when the pointer is touched.

The proximity sensor detects a proximity touch and a proximity touch pattern (e.g., a proximity touch distance, a proximity touch direction, a proximity touch speed, a proximity touch time, a proximity touch position, a proximity touch movement state, and the like). Information corresponding to the detected proximity touch operation and the proximity touch pattern may be output on the touch screen.

The audio output module 152 may output audio data received from the wireless communication unit 110 or stored in the memory 160 in a call signal reception mode, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, The sound output module 152 also outputs sound signals related to functions (e.g., call signal reception sound, message reception sound, etc.) performed in the mobile terminal 100. [ The audio output module 152 may include a receiver, a speaker, a buzzer, and the like.

The alarm unit 153 outputs a signal for notifying the occurrence of an event of the mobile terminal 100. Examples of events that occur in the mobile terminal include call signal reception, message reception, key signal input, touch input, and the like. The alarm unit 153 may output a signal for notifying the occurrence of an event in a form other than the video signal or the audio signal, for example, vibration. The video signal or the audio signal may be output through the display unit 151 or the audio output module 152 so that the display unit 151 and the audio output module 152 may be classified as a part of the alarm unit 153 have.

The haptic module 154 generates various tactile effects that the user can feel. A typical example of the haptic effect generated by the haptic module 154 is vibration. The intensity and pattern of the vibration generated by the hit module 154 can be controlled. For example, different vibrations may be synthesized and output or sequentially output.

In addition to the vibration, the haptic module 154 may include a pin arrangement vertically moving with respect to the contact skin surface, a spraying force or suction force of the air through the injection port or the suction port, a touch on the skin surface, contact with an electrode, And various tactile effects such as an effect of reproducing a cold sensation using an endothermic or exothermic element can be generated.

The haptic module 154 can be implemented not only to transmit the tactile effect through the direct contact but also to allow the user to feel the tactile effect through the muscular sensation of the finger or arm. The haptic module 154 may include two or more haptic modules 154 according to the configuration of the portable terminal 100.

The memory 160 may store a program for the operation of the controller 180 and temporarily store input / output data (e.g., a phone book, a message, a still image, a moving picture, etc.). The memory 160 may store data on vibration and sound of various patterns outputted when a touch is input on the touch screen.

The memory 160 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory), a RAM (Random Access Memory), SRAM (Static Random Access Memory), ROM (Read Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM A disk, and / or an optical disk. The mobile terminal 100 may operate in association with a web storage that performs a storage function of the memory 160 on the Internet.

The interface unit 170 serves as a path for communication with all external devices connected to the mobile terminal 100. The interface unit 170 receives data from an external device or supplies power to each component in the mobile terminal 100 or transmits data to the external device. For example, a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, a port for connecting a device having an identification module, an audio I / O port, A video input / output (I / O) port, an earphone port, and the like may be included in the interface unit 170.

The identification module is a chip for storing various information for authenticating the use right of the mobile terminal 100 and includes a user identification module (UIM), a subscriber identity module (SIM), a general user authentication module A Universal Subscriber Identity Module (USIM), and the like. Devices with identification modules (hereinafter referred to as "identification devices") can be manufactured in a smart card format. Accordingly, the identification device can be connected to the terminal 100 through the port.

When the mobile terminal 100 is connected to an external cradle, the interface unit may be a path through which power from the cradle is supplied to the mobile terminal 100, or various command signals input by the user to the cradle may be transmitted It can be a passage to be transmitted to the terminal. The various command signals or the power source input from the cradle may be operated as a signal for recognizing that the mobile terminal is correctly mounted on the cradle.

The controller 180 typically controls the overall operation of the mobile terminal. For example, voice communication, data communication, video communication, and the like. The control unit 180 may include a multimedia module 181 for multimedia playback. The multimedia module 181 may be implemented in the control unit 180 or may be implemented separately from the control unit 180. [

The controller 180 may perform a pattern recognition process for recognizing handwriting input or drawing input performed on the touch screen as characters and images, respectively.

The power supply unit 190 receives external power and internal power under the control of the controller 180 and supplies power necessary for operation of the respective components.

The battery may be an internal battery configured to be chargeable, and may be detachably coupled to the terminal body for charging or the like. The connection port may be configured as an example of an interface 170 through which an external charger for supplying power for charging the battery is electrically connected.

The various embodiments described herein may be embodied in a recording medium readable by a computer or similar device using, for example, software, hardware, or a combination thereof.

According to a hardware implementation, the embodiments described herein may be implemented as application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays May be implemented using at least one of processors, controllers, micro-controllers, microprocessors, and other electronic units for performing other functions. In some cases, May be implemented by the control unit 180.

According to a software implementation, embodiments such as procedures or functions may be implemented with separate software modules that perform at least one function or operation. The software code may be implemented by a software application written in a suitable programming language. The software codes are stored in the memory 160 and can be executed by the control unit 180. [

FIG. 2 is a perspective view of a mobile terminal or a portable terminal according to the present invention, as viewed from the front.

The disclosed mobile terminal 100 has a bar-shaped terminal body. However, the present invention is not limited thereto, and can be applied to various structures such as a slide type, a folder type, a swing type, and a swivel type in which two or more bodies are relatively movably coupled.

The body of the mobile terminal 100 includes a casing 101, 102, In this embodiment, the case may be divided into a front case 101 and a rear case 102. [ A variety of electronic components are embedded in the space formed between the front case 101 and the rear case 102.

In some cases, electronic components may be mounted on the surface of the rear case 102 as well. Electronic components mounted on the surface of the rear case 102 include a battery, a USIM card, a memory card, and the like which are detachable by the user. At this time, the rear case 102 may further include a rear cover 103 for covering the surface thereof. When the rear cover 103 is removed, the surface of the rear case 102 is exposed.

As shown in FIG. 2, when the rear cover 103 is coupled, only a part of the side surface of the rear case 102 may be exposed. When the size of the rear cover 103 is reduced, Some may also be exposed. And an opening 103 'for exposing the camera 121' or the sound output unit 152 'to the outside when the rear cover 103 covers the entire rear surface of the rear case 102.

The cases 101, 102 and 103 may be formed by injection molding of synthetic resin or may be formed of a metal material such as stainless steel (STS) or titanium (Ti).

The display unit 151, the sound output unit 152, the camera 121, the user input units 130/131 and 132, the microphone 122, and the interface 170 may be disposed in the terminal cases 101 and 102.

The display unit 151 occupies most of the main surface of the front case 101. A sound output unit 152 and a camera 121 are disposed in an area adjacent to one end of both ends of the display unit 151 and a user input unit 131 and a microphone 122 are disposed in an area adjacent to the other end. The user input unit 132 and the interface 170 may be disposed on the side surfaces of the front case 101 and the rear case 102. [

The user input unit 130 is operated to receive a command for controlling the operation of the portable terminal 100 and may include a plurality of operation units 131 and 132. The operation units 131 and 132 may be collectively referred to as a manipulating portion and may be employed in any manner as long as the user operates in a tactile manner.

The contents inputted by the first or second operation unit 131 or 132 may be variously set. For example, the first operation unit 131 receives a command such as start, end, scroll, and the like, and the second operation unit 132 inputs a command such as adjustment of the sound output from the sound output unit 152 And the third operation unit 133 can receive a command such as switching to the touch recognition mode of the display unit 151 or the like.

6 is a rear perspective view of the portable terminal shown in FIG.

Referring to FIG. 6, a camera 121 'may be further mounted on the rear surface of the terminal body, that is, the rear case 102. The camera 121 'may have a photographing direction substantially opposite to the camera 121 (see FIG. 2), and may be a camera having different pixels from the camera 121.

For example, the camera 121 may have a low pixel so that the face of the user can be photographed and transmitted to the other party in case of a video call or the like, and the camera 121 ' It is preferable to have a large number of pixels. The cameras 121 and 121 'may be installed in the terminal body so as to be rotatable or pop-upable.

A flash 123 and a mirror 124 are additionally disposed adjacent to the camera 121 '. The flash 123 illuminates the subject when the subject is photographed by the camera 121 '. The mirror 124 allows the user to illuminate the user's own face or the like when the user intends to shoot himself / herself (self-photographing) using the camera 121 '.

An acoustic output 152 'may be additionally disposed on the rear surface of the terminal body. The sound output unit 152 'may implement the stereo function together with the sound output unit 152 (see FIG. 2A), and may be used for the implementation of the speakerphone mode during a call.

In addition to the antenna for talking and the like, a broadcast signal reception antenna 116 may be additionally disposed on the side of the terminal body. The antenna 116, which forms part of the broadcast receiving module 111 (see FIG. 1), can be installed to be able to be drawn out from the terminal body.

A power supply unit 190 for supplying power to the mobile terminal 100 is mounted on the terminal body. The power supply unit 190 may be built in the terminal body or may be detachable from the outside of the terminal body.

The rear case 102 may further include a touch pad 135 for sensing a touch. The touch pad 135 may be of a light transmission type for the display unit 151. [ In this case, if the display unit 151 is configured to output the time information on both sides (i.e., in the directions of both the front and back sides of the mobile terminal), the time information can be recognized through the touch pad 135 do. The information output on both sides may be all controlled by the touch pad 135. [

Meanwhile, the display for exclusive use of the touch pad 135 may be separately installed, so that the touch screen may be disposed in the rear case 102 as well.

The touch pad 135 operates in correlation with the display portion 151 of the front case 101. The touch pad 135 may be disposed parallel to the rear of the display unit 151. The touch pad 135 may have a size equal to or smaller than that of the display unit 151.

In general, the user moves while holding the mobile terminal 100 in a bag or a pocket, and then removes the mobile terminal 100 when necessary. The user can perform operations on the mobile terminal 100 using the hand holding the mobile terminal 100 or another hand after holding the mobile terminal 100. [

As described above, in order to use the mobile terminal 100, the user has to hold the mobile terminal 100 using his or her hand. This poses a problem that when the user can not freely use his / her hand, for example, holding an object by hand, or is driving, the user may have difficulty in properly operating the mobile terminal 100. [ Accordingly, in recent years, development of a mobile terminal 100 in a form that the user can use without grasping with the hand is proceeding. For example, development of a mobile terminal 100 that can be worn on a person's body, such as a pair of glasses or a watch, is underway. As described above, the mobile terminal 100, which can be mounted on a person's body, can be referred to as a wearable device.

The mobile terminal, which will be described later, may be a watch-type mobile terminal that can be worn by the user on the wrist. In the following description of the embodiments, it is assumed that the mobile terminal according to the present invention includes at least one of the components shown in FIG. The mobile terminal includes a display unit 151, a user input unit 130 for receiving a touch input from the display unit 151, a memory 160, It is assumed that the control unit 180 is included.

Since the mobile terminal according to the present invention can be more easily implemented when the display unit 151 is a touch screen, it is assumed that the display unit 151 is a touch screen in the embodiment described below. When the display unit 151 is a touch screen, the display unit 151 can simultaneously perform both a role as an output device for outputting information and an input device for receiving a user's touch input.

In addition, in the embodiment described below, the user input unit 130 can perform a function of receiving a touch input from outside the touch screen. In order to distinguish the touch input input through the touch screen from the touch input received through the user input unit 130 from the outside of the touch screen, the function unit performing the function of receiving the touch input from outside the touch screen is referred to as a "touch input unit" It will be called new. In the following embodiments, the memory 160 is a storage unit, the wireless communication unit 110 is a communication unit, and the power supply unit 190 is a power supply unit.

3 is a block diagram of a mobile terminal according to an embodiment of the present invention. Referring to FIG. 3, the touch screen 410 can display (output) information processed in the mobile terminal 100. For example, when the mobile terminal is in the call mode, a UI (User Interface) or a GUI (Graphic User Interface) associated with a call is displayed. In this specification, the touch screen 410 displays the processed information according to the control of the controller 430, and can receive the touch input of the user and transmit the received touch input to the controller 430.

The touch input unit 420 may receive the touch input of the user from the outside of the touch screen 410. Specifically, the touch input unit 420 may include a touch sensor separate from the touch screen 410, or may include a touch sensor integrated with the touch screen 410 to receive user input. Meanwhile, in this specification, the touch input unit 420 may receive the touch input of the user and transmit it to the control unit 430.

The touch screen 410 and the touch input unit 420 will be described in detail with reference to FIG.

The control unit 430 typically controls the overall operation of the mobile terminal 100. Specifically, it is possible to execute contents received through data communication or contents stored in a storage unit, control each configuration of the mobile terminal 100, and control data between the respective configurations.

In this case, when the touch input unit 420 receives touch inputs of the first and second pointers, the control unit 430 controls to display at least one main menu around the touch point of the first pointer, At least one sub-menu dependent on the selected main menu corresponding to the touch point of the first pointer is displayed around the touch point of the second pointer.

Here, when a user input for changing the touch position of the first pointer is received on the touch input unit 420, the control unit 430 displays at least one touch point corresponding to the changed touch position around the touch point of the second pointer Can be controlled to be displayed. In this case, the user input may be a slide movement of the first pointer along the touch input unit 420 or a touch operation of the touch input unit 420 after the first pointer is released from the touch input unit 420 And may be a touch input for re-touching.

The controller 430 according to an embodiment of the present invention can control the selected main menu corresponding to the touch position of the first pointer and the selected sub menu corresponding to the touch position of the second pointer to be visually identified and displayed.

On the other hand, when a user input for executing the sub-menu selected by the second pointer is received, the controller 430 can execute the command corresponding to the selected sub-menu. In this case, the user input may include sliding the second pointer from the touch input unit to the inside of the touch screen, touching the second pointer from the touch input unit, And may be a user input for touching the selected submenu. The command is a command for instructing the operation of a specific application or a program in the mobile terminal. For example, the command may be a command for executing a 'dialing' application and a command for executing a 'text' application.

If the main menu selected by the first pointer is a character input menu, the controller 430 controls at least one sub-command for indicating a character to be input in the vicinity of the touch point of the second pointer The control unit controls the display unit to display a menu and controls the display unit to input a character indicated by the selected submenu when a user input for executing the submenu selected by the second pointer is received. In this case, the user input may be a user input for sliding the second pointer from the touch input unit to the inside of the touch screen.

On the other hand, if the submenu selected by the second pointer indicates a plurality of characters, the control unit 430 may control to input any one of the plurality of characters based on the slide direction of the second pointer have.

Meanwhile, when the main menu selected by the first pointer is changed to the text completion menu, the controller 430 according to an exemplary embodiment of the present invention may include the characters typed around the touch point of the second pointer It is possible to control so that at least one submenu indicating the text is displayed. In this case, the control unit 430 controls to display at least one additional sub-menu, which is subordinate to the sub-menu selected by the second pointer, through the touch screen 410. At least one additional sub- Quot; can indicate a sentence that can be completed, including the text to which the < / RTI >

Meanwhile, when the submenu selected by the second pointer is a time menu, the controller 430 controls the display unit 410 to display the clock UI through the touch screen 410, When the user input for operating the UI is received, the time data indicated by the operated clock UI can be controlled to be input as characters.

If the main menu selected by the first pointer is a character menu, the control unit 430 controls the display unit 420 to display at least one submenu indicating the character, When a user input for rolling a sub-menu is received and a double-touch user input is received, a character indicated by a sub-menu corresponding to a predetermined position of the touch screen 410 can be controlled to be input. Here, the predetermined position of the touch screen 410 may be located at the 12 o'clock position of the watch mobile terminal (i.e., the upper center portion of the touch screen 410). In this case, the characters indicated by the submenu corresponding to the preset position can be visually identified and displayed.

Meanwhile, the control unit 430 according to the present invention can control to delete a displayed character when a user input for double-clicking a character displayed on the touch screen 410 is received. Alternatively, the control unit 430 may control to delete the displayed character when a user input for sliding the character displayed on the touch screen 410 from the touch screen 410 to the touch input unit 420 is received.

Meanwhile, the control unit 430 according to the present invention can control the display of at least one main menu and at least one sub-menu to be terminated when a user input for double-clicking the touch screen 410 is received.

The operation of the control unit 430 will be described in more detail with reference to FIGS. 7 to 19. FIG.

The storage unit 440 can list frequently used sentence groups and store them. The storage unit 440 may store the completed text including the inputted character.

The storage unit 440 may store a program for processing and control of the controller 430 and may store data of input / output data (e.g., telephone directory, message, audio, still image, It may also perform functions for temporary storage. The storage unit 440 may store data on vibrations and sounds of various patterns that are output upon touch input on the touch screen 410.

The communication unit 450 may include one or more modules for enabling wireless communication between the mobile terminal 100 and the wireless communication system or between the mobile terminal 100 and the network in which the mobile terminal 100 is located.

The power supply unit 460 may supply power to each configuration of the mobile terminal 100 under the control of the controller 430. [

5 is a front perspective view of a mobile terminal 100 according to an embodiment of the present invention. As shown in FIG. 5, the mobile terminal 100 may be a smart watch designed in a clock shape. The mobile terminal 100 may include a touch input unit 420 on a bezel that surrounds the touch screen 410.

6 is a diagram for explaining a touch sensor arrangement of the mobile terminal 100 according to an embodiment of the present invention.

Referring to FIG. 6, the touch sensor may be disposed in each of the touch screen 410 and the touch input unit 420. The touch sensors disposed on the touch screen 410 and the touch input unit 420 may separate the user input received from the touch screen 410 and the user input received from the touch input unit 420,

Here, the touch sensor may be configured to convert a change in a pressure applied to a specific portion or a capacitance generated in a specific portion into an electrical input signal. The touch sensor can be configured to detect not only the position and area to be touched but also the pressure at the time of touch.

If there is a touch input to the touch sensor, the corresponding signal (s) is sent to the touch controller (not shown). The touch controller processes the signal (s) and then transmits the corresponding data to the controller 430. Thus, the control unit 180 can know which area of the touch screen 410 and the touch input unit 420 is touched.

On the other hand, the touch sensor can be implemented as a proximity sensor. The proximity sensor refers to a sensor that detects the presence or absence of an object approaching a predetermined detection surface or a nearby object without mechanical contact using the force of an electromagnetic field or infrared rays. Examples of proximity sensors include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, and an infrared proximity sensor.

On the other hand, the user's touch input may be a tap, a double tap, a drag, a flick, a slide, a press, a multi-touch, Pinch in, and pinch out.

The tab is a light touch operation of the touch screen 410 or the touch input unit 420 and means a touch gesture such as a click of a mouse in a general personal computer.

Further, the double tap is an operation of tapping the touch screen 410 or the touch input unit 420 twice rapidly, which means a touch gesture such as a double click of a mouse in a general personal computer.

In addition, dragging is an operation of moving the touch screen 410 or the touch input unit 420 to a specific position while keeping the touch, and when the object is dragged, the object continuously moves according to the drag direction .

The flick refers to an operation of touching the touch screen 410 or the touch input unit 420 and moving the contact in a specific direction (up, down, left, right or diagonal) A touch operation is performed based on the flick direction, speed, and the like. For example, the page turning operation of the e-book can be performed based on the flick direction.

In addition, the slide means an operation to move to a specific position while keeping the touch on the touch screen 410 or the touch input unit 420. When the touch input 410 is received by the slide, And so on. For example, a menu selection operation that is close to the slide direction can be performed.

Further, the press refers to an operation of continuously holding a touch for a predetermined time or longer after touching the touch screen 410 or the touch input unit 420. [

In addition, the multi-touch means an operation of touching a plurality of points of the touch screen 410 or the touch input unit 420 at the same time.

Also, the pinch-in refers to an operation of dragging the touch screen 410 or the touch input unit 420 in a direction in which a plurality of pointers that are multi-touching approach each other. That is, a drag that starts from at least one point among a plurality of points that are multi-touched in the touch screen 410 or the touch input unit 420 and occurs in a direction in which a plurality of points that are multi-touched approach each other.

In addition, the pinch-out means an operation of dragging the touch screen 410 or the touch input unit 420 in a direction in which a plurality of pointers which are multi-touching move away from each other. That is, a drag that starts from at least one point among a plurality of points that are multi-touched in the touch screen 410 or the touch input unit 420 and occurs in a direction in which a plurality of points that are multi-touched move away from each other.

Hereinafter, a method of controlling a mobile terminal according to an embodiment of the present invention will be described with reference to FIG. 7 to FIG. Prior to the description of the drawings, it is assumed that the first mobile terminal is powered on.

7 to 8 are diagrams for explaining a menu pop-up method according to an embodiment of the present invention.

7, when a touch input of the first pointer 10 and the second pointer 20 is received in the touch input unit 420, the mobile terminal displays at least one touch point on the touch point of the first pointer 10, And at least one submenu 721 that is dependent on the selected main menu 712 corresponding to the touch point of the first pointer is displayed around the touch point of the second pointer 20, , 722, 723).

Specifically, when the first pointer 10 and the second pointer 20 simultaneously receive a touch input to the touch input unit 420 within a predetermined time, at least one main A main menu UI (User Interface) including menus 711, 712, and 713 may be displayed. A sub-menu UI (User Interface) including at least one sub-menu 721, 722, 723 may be displayed around the touch point of the second pointer 20. The main menu 712 corresponding to the touch point of the first pointer 10 of the main menu UI is selected and the submenus 721, 722 and 723 dependent on the selected main menu 712 are selected And may be a sub-menu UI included.

Through the above method, the mobile terminal can display a menu on the touch screen 410 that can execute a specific command.

Meanwhile, as shown in FIG. 8, even when the first pointer 10 and the second pointer 20 are touched, the main menu and the submenu can be continuously displayed.

However, the user can adjust the display time of the main menu and the submenu after the touch is released, and the display of the main menu and the submenu may be terminated after the touch release according to the adjusted time.

9A to 9C and 10A to 10B are views for explaining a method of changing a main menu according to an embodiment of the present invention. Figs. 9A to 9C are diagrams for explaining a main menu changing method using a slide gesture, and Figs. 10A and 10B are diagrams for explaining a main menu changing method using a tap gesture. Fig. Prior to the description of Figs. 9 (a) to 9 (c) and 10 (a) to 10 (b), the mobile terminal assumes that at least one main menu and at least one submenu are displayed.

When a user input for changing the touch position of the first pointer 10 is received on the touch input unit, the mobile terminal selects a main menu corresponding to the changed touch position of the first pointer 10, And display at least one sub-menu dependent on the selected main menu around the location point.

9A, when a user input of a slide movement in which the first pointer 10 does not exceed a predetermined reference (dotted line section in FIG. 9A) along the touch input unit is received on the touch input unit, The terminal may perform an operation of moving the first selected main menu according to the movement of the first pointer 10. [ That is, when sliding is performed less than a preset reference, the mobile terminal may not change the main menu. Here, the preset reference may be set by the manufacturer or the user.

 9 (b), when the first pointer 10 is received along with a user input of a slide movement exceeding a predetermined reference (a dotted line section in FIG. 9 (b)) along the touch input unit, To the main menu corresponding to the touch position of the first pointer 10. The mobile terminal can display at least one sub menu dependent on the changed main menu around the touch position of the second pointer 20. That is, if the user slides more than the predetermined reference, the mobile terminal can change the main menu and select the main menu.

The mobile terminal can change the menu and select it only in the case of the slide movement with the user's intention to change the menu by setting the predetermined standard as described above.

9 (c), when the first pointer 10 slidingly moves along the touch input unit, even if the touch of the second pointer 20 is released, the mobile terminal moves to the first pointer 10 To the main menu corresponding to the touch position of the main menu.

10 (a), after the first pointer 10 is touched off from the touch input unit, when a user input for re-touching the touch input unit is received, the mobile terminal displays the touch position of the first pointer 10 To the main menu corresponding to the main menu. The mobile terminal can display at least one sub menu dependent on the changed main menu around the touch position of the second pointer 20. That is, the main menu can be changed and selected using the tap gesture.

10 (b), the first pointer 10 can change and select the main menu through the tactile gesture even when the touch of the second pointer 20 is released.

On the other hand, as shown in Figs. 9 (a) to 9 (c) and 10 (a) to 10 (b), the menu selected by the first pointer 10 and the second pointer 20 is displayed can do.

11A to 11B and 12A to 12B are views for explaining a submenu changing method according to an embodiment of the present invention. Prior to the description of Figs. 11 (a) to 11 (b) and 12 (a) to 12 (b), the mobile terminal assumes that at least one main menu and at least one submenu are displayed.

When a user input for changing the touch position of the second pointer 20 is received on the touch input unit, the mobile terminal can select and display a sub menu corresponding to the touch position of the second pointer 20. [

Referring to FIG. 12A, when a user input that the second pointer 20 slides along the touch input unit is received on the touch input unit, the mobile terminal displays a sub menu corresponding to the touch position of the second pointer 20 . That is, the submenu can be changed and selected using the slide gesture.

As shown in 9 (b), after the second pointer 20 is touched off from the touch input unit, when the user input for re-touching the touch input unit is received, the mobile terminal corresponds to the touch position of the second pointer 20 Can be changed to a sub menu. That is, the sub menu may be changed and selected using the tap gesture.

13 (a), when the user inputs the second pointer 20 to slide along the touch input unit, even if the first pointer 10 is touched, the mobile terminal moves to the second pointer 20 To the submenu corresponding to the touch position of the touch panel.

13 (b), when the second pointer 20 is touched off from the touch input unit even after the touch of the first pointer 10 is released, when a user input for re-touching the touch input unit is received, The terminal can change to a sub-menu corresponding to the touch position of the second pointer 20. [ That is, the submenu can be changed and selected in response to a user input for changing the position of the second pointer 20 regardless of whether the first pointer 10 is touched or not.

11 (a) to 11 (b) and 12 (a) to 12 (b), as described above, in the case of the menu selected by the first pointer 10 and the second pointer 20 May be displayed to be visually distinguishable.

13 is a diagram for explaining a command execution method according to an embodiment of the present invention.

When a user input for executing the submenu selected by the second pointer 20 is received, the mobile terminal can execute the command corresponding to the selected submenu.

13, when a user input for sliding the second pointer 20 from the touch input unit 420 to the inside of the touch screen 410 is received, the mobile terminal displays a popup command corresponding to the selected submenu 1320 1330).

If the second pointer 20 is touched off from the touch input unit 420 and a user input for touching the submenu 1320 selected on the touch screen 410 is received , The mobile terminal may execute a command 1330 corresponding to the selected submenu 1320. That is, when a user input that taps a sub-menu displayed on the touch screen or a user input that slides is received, the mobile terminal can execute a command corresponding to the selected sub-menu.

14 (a) to 14 (c) are diagrams for explaining a character input method according to an embodiment of the present invention. Here, the character input method corresponds to the above-described embodiment of the command execution in Fig.

Referring to FIG. 14 (a), when a user input for selecting a character input menu is received by the first pointer 10, the mobile terminal can display at least one submenu indicating a character to be input. When the second pointer 20 receives a user input for selecting one of the at least one submenu, the mobile terminal can activate (or expand) the selected submenu. Then, when a user input for executing the sub menu selected by the second pointer 20 is received, the mobile terminal can execute a command for inputting the character indicated by the selected sub menu. Here, it can be confirmed that the user input for executing the selected submenu is a user input for sliding the second pointer 20 from the touch input unit to the inside of the touch screen.

Alternatively, when the submenu selected by the second pointer 20 indicates a plurality of characters as shown in FIG. 14 (b), the mobile terminal displays a plurality of characters m , o, o, o, o) can be executed.

Meanwhile, there is a character input method capable of inputting a completed text at a time by a character input method according to an embodiment of the present invention.

Referring to FIG. 14 (c), a character 'lo' is input to the mobile terminal. When the user input to change to the character completion menu ("auto ") is received by the first pointer 10, the mobile terminal transmits the completed text (" low " "long", "lost", "love"). Then, when a user input for executing a sub menu ("love") is received by the second pointer 20, the mobile terminal can execute a command for inputting the text indicated by the sub menu ("love & .

Here, the text that can be completed including the input character may be stored in the storage unit of the mobile terminal.

By using the character completion menu as described above, the user can input the completed text at once without needing to input each character.

15 (a) and 15 (b) are diagrams for explaining a sentence automatic input method according to an embodiment of the present invention.

15A, when a user input to change to the character completion menu ("auto") is received by the first pointer 10, the mobile terminal transmits a predetermined sentence group ("greet & "sorry "," meet ", "time"). Here, the preset sentence group is a sentence frequently used by the user and can be changed by the manufacturer or the user.

Then, when a user input for selecting a sub menu ("sorry") is received by the second pointer 20 through the touch screen, the mobile terminal completes the text including the text indicated by the selected sub menu ("So sorry", "I'm really sorry", "sorry but") that can be displayed. Here, the additional submenu can be displayed separately inside the submenu.

Then, when a user input for selecting an additional sub-menu ("I'm really sorry") is received by the second pointer 20 via the touch screen, the mobile terminal displays the additional sub- ) Can be executed.

Here, the user input for selecting the submenu by the second pointer 20 and the additional submenu can be inputted at once by sliding movement.

On the other hand, when a user input for selecting a sub menu ("sorry") is received by the second pointer 20 (on the touch screen or touch input section) "sorry", "I'm really sorry", "sorry but") including the text indicated by the "sorry" ("sorry", "I'm really sorry", "sorry but") other submenus ("greet", "think", "meet" An additional submenu can be displayed.

Then, when a user input for selecting an additional sub-menu ("I'm really sorry") is received by the second pointer 20 via the touch screen, the mobile terminal displays the additional sub- ) Can be executed.

Here, the user input for selecting the submenu by the second pointer 20 and the additional submenu can be inputted at once by sliding movement.

In the case of FIG. 15 (a), there is a difference in that an additional sub-menu is displayed at a separate position, whereas in the case of FIG. 15 (b), an additional sub-menu is substituted for the sub-menu.

Meanwhile, frequently used sentence groups may be stored in the storage unit of the mobile terminal. By using the automatic sentence input menu as above, the user can easily input the completed sentence without having to input each character. This will be described in detail with reference to FIG.

16A and 16B are diagrams for explaining a time data character input method according to an embodiment of the present invention.

16A, when a user input for selecting the time menu ("time"), which is one of the submenus of the character completion menu ("auto "), to the second pointer 20 is received, A UI (User Interface) 1610 can be displayed. Here, the clock UI 1610 may be a UI including an hour hand and a minute hand in analog form. Then, when a user input for operating the clock UI 1610 is received by the second pointer 20, the mobile terminal can execute a command for inputting the time data indicated by the operated clock UI 1610 as a character. That is, according to the user input that manipulates the hour hand to point to "9 o'clock" and manipulates the minute hand to point to "15 minutes" as shown in FIG. 16 (a) As a character.

16 (b), the clock UI 1710 may be a digital UI. 16B, when a user input for selecting the time menu ("time") as one of the submenus of the character completion menu ("auto ") is received by the second pointer 20, A user interface (UI) 1710 can be displayed. Here, the mobile terminal displays the clock UI 1710 for receiving the 'hour' first, and the clock UI 1720 for receiving the 'minute' can display the 'hour' after receiving the 'hour'. As shown in FIG. 16 (b), when a user input for selecting AM 11 is received, the mobile terminal can input the time data of "11:00 AM " as a character and display a clock UI for inputting 'minutes' . Thereafter, when a user input for selecting 15 minutes is received, the mobile terminal can input the time data of "11:15 AM" as a character.

The mobile terminal can provide a user with an intuitive and emotional time character input method as shown in Figs. 16 (a) and 13 (b).

17 is a diagram for explaining a character input method according to an embodiment of the present invention.

According to the character input method of the present invention, when a user input for selecting a character menu is received by the first pointer, the mobile terminal can display at least one submenu indicating a character. When a user input for rolling a sub-menu is received in the touch input unit and then a double-touch user input is received, the mobile terminal displays a command for inputting a character indicated by the sub- .

As shown in FIG. 17, when a user input for selecting the character menu ("abc") among the main menu is received by the first pointer 10, the mobile terminal can display a sub menu indicating each of the alphabet characters have. When a user input for rolling the submenu is received by the first pointer 10 in the touch input unit, the submenu is rolled corresponding to the operation of the first pointer 10, You can activate the alphanumeric characters indicated by the located submenu. When the user inputs a double touch (or double tap) by the second pointer 20 to the touch input unit, the mobile terminal can input the activated alphabet letter.

18A and 18B are diagrams for explaining a method for deleting input characters according to an embodiment of the present invention. Prior to the description, it is assumed that a character is input to the mobile terminal of Figs. 18 (a) and 18 (b).

Referring to FIG. 18 (a), when a user input for sliding a character displayed on the touch screen from the touch screen to the touch input unit is received, the mobile terminal can execute a command to delete the displayed character.

Alternatively, as shown in FIG. 18 (b), when a user input for double-clicking a character displayed on the touch screen is received, the mobile terminal can execute a command to delete the displayed character.

FIG. 19 is a view for explaining a menu display ending method according to an embodiment of the present invention.

19, upon receiving a user input that double-clicks on the touch screen, the mobile terminal may execute a command to terminate the displayed main menu, submenu, and running application.

The end command may be executed by a user input that slightly presses a physical button (for example, a power button) provided in the mobile terminal in addition to the user input to double tap as shown in Fig.

20 is a diagram illustrating a submenu configuration list for a sentence automatic input method according to an embodiment of the present invention.

As described above with reference to FIGS. 15A and 15B, in order to perform the automatic sentence input method according to the embodiment of the present invention, the list sentence group may be stored as shown in FIG.

15 (a) and 15 (b), the description has been given only to the submenu (submenu) of level 1 and the submenu (additional submenu) of level 2. However, Level sub-menu can be used for automatic sentence input method.

21 is a diagram for explaining a character input scenario according to an embodiment of the present invention.

The user can operate the mobile terminal as shown in Fig. 21 in order to input a sentence "Meet me at 7:15 pm ".

1) The user selects a character completion menu ("auto") in the main menu with the first pointer 10, and 2) a "Meet" Select the submenu. In response to such user input, the mobile terminal enters "Meet" and displays at least one additional submenu. The at least one additional submenu includes a menu indicating a completed sentence ("Meet me at", "Meet up with") including the text indicated by the selected submenu ("Meet").

And 3) the user selects an additional submenu for indicating "Meet me at" among the additional submenus by the second pointer 20. [ In response to such user input, the mobile terminal can enter "Meet me at ".

4) The user again selects the character completion menu ("auto ") of the main menu with the first pointer 10 to move the initial submenu. 5) The second pointer 20 Select the time menu ("time") in the submenu. In response to such user input, the mobile terminal can display the clock UI.

And 6) the user selects "7 o'clock" in the clock UI with the second pointer 20, and 7) selects "15 minutes". In response to such user input, the mobile terminal may enter "Meet me at 7:15 pm. &Quot;

As described above, the mobile terminal according to the present invention can control the mobile terminal according to an intuitive and convenient user input method in a small sized touch screen.

In particular, the mobile terminal according to the present invention can input text with a minimized user input as compared with a touch input by a conventional touch screen.

According to the terminal and the control method thereof according to an embodiment of the present invention, a mobile terminal can be controlled according to an intuitive and convenient user input method in a small sized touch screen.

In addition, the mobile terminal according to the present invention can input text with minimized user input as compared with a touch input by a conventional touch screen.

22 is a flowchart illustrating a method of controlling a mobile terminal according to an embodiment of the present invention.

Referring to FIG. 22, a mobile terminal including a touch screen and a touch input unit for receiving a touch input of a user outside the touch screen receives a touch input of first and second pointers in a touch input unit (S2110) , At least one main menu may be displayed around the touch point of the first pointer (S2120).

The mobile terminal may display at least one submenu depending on the selected main menu corresponding to the touch point of the first pointer, around the touch point of the second pointer (S2130).

23 is a flowchart illustrating a method of controlling a mobile terminal according to an embodiment of the present invention.

Referring to FIG. 23, a mobile terminal including a touch screen and a touch input unit for receiving a touch input of a user outside the touch screen receives a touch input of first and second pointers in a touch input unit (S2310) , At least one main menu may be displayed around the touch point of the first pointer (S2320).

The mobile terminal may display at least one submenu dependent on the selected main menu corresponding to the touch point of the first pointer, around the touch point of the second pointer (S2330).

When a user input for changing the touch position of the first pointer is received on the touch input unit (S2340), the mobile terminal displays at least one sub-menu dependent on the main menu corresponding to the changed touch position around the touch point of the second pointer A menu can be displayed (S2345). In this case, the user input may be a sliding movement of the first pointer along the touch input unit, or a touch input that re-touches the touch input unit after the first pointer is released from the touch input unit.

On the other hand, when a user input for executing the submenu selected by the second pointer is received (S2350), the mobile terminal can execute the command corresponding to the selected submenu (S2355). In this case, the user input may include sliding the second pointer from the touch input unit to the inside of the touch screen, touching the second pointer from the touch input unit, And may be a user input for touching the selected submenu. The command is a command for instructing the operation of a specific application or a program in the mobile terminal. For example, the command may be a command for executing a 'dialing' application and a command for executing a 'text' application.

On the other hand, the selected main menu corresponding to the touch position of the first pointer and the selected submenu corresponding to the touch position of the second pointer can be visually identified.

As described in FIGS. 22 and 23, the mobile terminal according to the embodiment of the present invention can provide a simple and intuitive user input method considering characteristics of a mobile terminal having a small touch screen size.

It will be apparent to those skilled in the art that the present invention may be embodied in other specific forms without departing from the spirit or essential characteristics thereof.

The present invention described above can be implemented as computer readable codes on a medium on which a program is recorded. The computer readable medium includes all kinds of recording devices in which data that can be read by a computer system is stored. Examples of the computer-readable medium include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage, and the like, and also implemented in the form of a carrier wave (for example, transmission over the Internet) . In addition, the computer may include a controller 430 of the mobile terminal.

Accordingly, the above description should not be construed in a limiting sense in all respects and should be considered illustrative. The scope of the present invention should be determined by rational interpretation of the appended claims, and all changes within the scope of equivalents of the present invention are included in the scope of the present invention.

410: touch screen 420: touch input unit
430: control unit 440:
450: communication unit 460:

Claims (21)

A touch screen for displaying information;
A touch input unit for receiving a touch input of a user outside the touch screen; And
When the touch inputs of the first and second pointers are received in the touch input unit,
Controlling at least one main menu to be displayed around a touch point of the first pointer,
And a controller for controlling display of at least one submenu dependent on the selected main menu corresponding to the touch point of the first pointer, around the touch point of the second pointer. The method according to claim 1,
When a user input for changing a touch position of the first pointer is received on the touch input unit,
Wherein,
Wherein at least one submenu dependent on the main menu corresponding to the changed touch position is displayed around the touch point of the second pointer. 3. The method of claim 2,
The user input may include sliding the first pointer along the touch input unit,
And touches the touch input unit again after the first pointer is released from the touch input unit. The method according to claim 1,
Wherein,
And controls the selected main menu corresponding to the touch position of the first pointer and the selected sub menu corresponding to the touch position of the second pointer to be visually identified and displayed. The method according to claim 1,
When a user input for executing the submenu selected by the second pointer is received,
Wherein,
And executes a command corresponding to the selected submenu. 6. The method of claim 5,
Wherein the user input comprises:
Sliding the second pointer from the touch input unit to the inside of the touch screen,
Wherein the second pointer is touched by the touch input unit, and the second pointer is touched by the selected submenu on the touch screen. The method according to claim 1,
Wherein,
When the main menu selected by the first pointer is a character input menu,
Wherein at least one submenu indicating a character to be input is displayed around a touch point of the second pointer,
When a user input for executing the submenu selected by the second pointer is received,
And controls the inputting of the character indicated by the selected sub-menu. 8. The method of claim 7,
Wherein the user input comprises:
And sliding the second pointer from the touch input unit toward the inside of the touch screen. 9. The method of claim 8,
When the submenu selected by the second pointer indicates a plurality of characters,
Wherein,
And controls to input any one of the plurality of characters based on a slide movement direction of the second pointer. 8. The method of claim 7,
When the main menu selected by the first pointer is changed to the character completion menu,
Wherein,
Wherein the display unit displays at least one submenu indicating a text that can be completed including a character typed around a touch point of the second pointer. 11. The method of claim 10,
Wherein,
Through the touch screen
Wherein at least one additional sub-menu dependent on the sub-menu selected by the second pointer is displayed,
Wherein the at least one additional sub-menu indicates a sentence that can be completed including the text indicated by the selected sub-menu. 8. The method of claim 7,
When the submenu selected by the second pointer is a time menu,
Wherein,
Controls the display of the clock UI through the touch screen,
When a user input for operating the clock UI is received by the second pointer,
And controls the time data indicated by the manipulated clock UI to be input as characters. The method according to claim 1,
Wherein,
When the main menu selected by the first pointer is a character menu,
At least one submenu indicating a character is displayed,
When a user input for rolling a sub-menu is received in the touch input unit and a double-touching user input is received,
Wherein the control unit controls the display unit so that a character indicated by a sub-menu corresponding to a predetermined position of the touch screen is input. 8. The method of claim 7,
Wherein,
And controls to delete the displayed character when a user input for double-clicking a character displayed on the touch screen is received. 8. The method of claim 7,
Wherein,
And controls to delete the displayed character when a user input for sliding a character displayed on the touch screen from the touch screen to the touch input unit is received. The method according to claim 1,
Wherein,
And controls to display the at least one main menu and the at least one sub menu when a user input for double-clicking the touch screen is received. The method according to claim 1,
The mobile terminal is in a clock form,
Wherein the touch input unit is a bezel that surrounds the touch screen. A method of controlling a mobile terminal including a touch screen and a touch input unit for receiving a touch input of a user from outside the touch screen,
Receiving a touch input of the first and second pointers in the touch input unit;
Displaying at least one main menu around a touch point of the first pointer; And
Displaying at least one submenu dependent on a selected main menu corresponding to a touch point of the first pointer, around a touch point of the second pointer. 19. The method of claim 18,
When a user input for changing a touch position of the first pointer is received on the touch input unit,
Further comprising displaying at least one sub menu dependent on the main menu corresponding to the changed touch position around the second touch point. 19. The method of claim 18,
When a user input for executing the submenu selected by the second pointer is received,
And executing a command corresponding to the selected sub-menu. 19. The method of claim 18,
If the main menu selected by the first pointer is a character input menu, the at least one submenu is a submenu indicating a character,
When a user input for executing the submenu selected by the second pointer is received,
Further comprising the step of inputting a character indicated by the selected submenu.

Images