KR102120104B1 - Mobile terminal and method for controlling thereof - Google Patents

Abstract

In the mobile terminal of the present invention, when touch inputs of first and second pointers are received on a touch screen for displaying information, a touch input unit for receiving a user's touch input from outside of the touch screen, and a touch input unit, the first pointer Controlling so that at least one main menu is displayed around the touch point of, while controlling at least one sub-menu dependent on the selected main menu corresponding to the touch point of the first pointer is displayed around the touch point of the second pointer. It includes a control unit.

Description

Mobile terminal and its control method {MOBILE TERMINAL AND METHOD FOR CONTROLLING THEREOF}

The present invention relates to a mobile terminal and a control method for allowing the use of the mobile terminal to be implemented in consideration of user convenience.

With the development of technology, development of a wearable computer is accelerated. Here, a wearable computer refers to a computer that can be worn and worn naturally, such as clothes, watches, glasses, and accessories. Terminals such as smartphones and tablet PCs can be conveniently used with one finger or a touch fan, but there may be inconveniences of being carried in a pocket or bag or carried in a hand. In contrast, wearable computers can be worn more easily than smartphones and tablet PCs because they can be worn on the wrist or worn like glasses.

In particular, as a type of wearable computer, a variety of products for a wristwatch, that is, a smart watch, have appeared as a terminal capable of wirelessly searching various services such as diary, message, notification, and stock quote. In the case of a smart watch, since the size of a touch screen capable of touch input is smaller than that of a smart phone, a user input method different from a smart phone needs to be devised.

The present invention has been devised by the above-described need, and it is an object of the present invention to provide a simple and intuitive user input method considering a characteristic of a mobile terminal having a small touch screen and a control method thereof.

In order to achieve the above object, a mobile terminal according to an embodiment of the present invention includes a touch screen for displaying information, a touch input unit for receiving a user's touch input from outside the touch screen, and a first touch input unit. And when the touch input of the second pointer is received, while controlling at least one main menu to be displayed around the touch point of the first pointer, corresponding to the touch point of the first pointer, around the touch point of the second pointer. And a control unit that controls to display at least one sub-menu dependent on the selected main menu.

In this case, when a user input for changing a touch position of the first pointer is received on the touch input unit, the control unit is dependent on a main menu corresponding to the changed touch position around a touch point of the second pointer. One sub-menu can be controlled to be displayed.

Here, the user input may be that the first pointer slides along the touch input unit, or after the first pointer is released from the touch input unit, the touch input unit may be touched again.

Meanwhile, the control unit may control the selected main menu corresponding to the touch position of the first pointer and the selected sub-menu corresponding to the touch position of the second pointer to be visually identified and displayed.

Meanwhile, when a user input for executing a sub-menu selected by the second pointer is received, the control unit may execute a command corresponding to the selected sub-menu.

Here, the user input is to slide the second pointer from the touch input unit into the touch screen, or after releasing the second pointer from the touch input unit, move the second pointer onto the touch screen. It may be that the selected sub-menu is touched.

On the other hand, when the main menu selected by the first pointer is a character input menu, the controller controls to display at least one sub-menu indicating a character to be input around the touch point of the second pointer. When a user input for executing a sub-menu selected by the 2 pointer is received, it is possible to control the character indicated by the selected sub-menu to be input.

In this case, the user input may be to slide the second pointer from the touch input unit to the inside of the touch screen.

On the other hand, when the sub-menu selected by the second pointer indicates a plurality of characters, the controller may control one of the plurality of characters to be input based on the slide movement direction of the second pointer. .

On the other hand, when the main menu selected by the first pointer is changed to a character completion menu, the control unit may indicate at least one text indicating a text that can be completed, including characters previously input around the touch point of the second pointer. The sub menu can be displayed.

In this case, the control unit controls to display at least one additional sub-menu, which is dependent on the sub-menu selected by the second pointer through the touch screen, wherein the at least one additional sub-menu has the selected sub-menu. You can indicate a sentence that can be completed, including text that indicates it.

On the other hand, when the sub-menu selected by the second pointer is a time menu, the control unit controls the watch UI to be displayed through the touch screen, but receives a user input for operating the watch UI by the second pointer. When it does, it is possible to control the time data indicated by the manipulated clock UI to be input as text.

Meanwhile, when the main menu selected by the first pointer is a text menu, the controller controls to display at least one sub-menu indicating a text, and receives a user input for rolling the sub-menu on the touch input unit. When a double-touch user input is received, it is possible to control to input a character indicated by a sub-menu corresponding to a preset position of the touch screen.

Meanwhile, when a user input for double-clicking a character displayed on the touch screen is received, the control unit may control to delete the displayed character.

Meanwhile, the control unit may control to delete the displayed character when a user input sliding a character displayed on the touch screen from the touch screen to the touch input unit is received.

Meanwhile, when a user input for double-clicking the touch screen is received, the controller may control the display of the at least one main menu and the at least one sub-menu to end.

Meanwhile, the mobile terminal may be in the form of a clock, and the touch input unit may be in the form of a bezel surrounding the touch screen.

On the other hand, in order to achieve the above object, a control method of a mobile terminal including a touch screen according to an embodiment of the present invention and a touch input unit for receiving a user's touch input from outside the touch screen, the touch input unit Receiving touch inputs of the first and second pointers to displaying at least one main menu around the touch points of the first pointer and around the touch points of the second pointer, the touch points of the first pointer And displaying at least one sub-menu subordinate to the selected main menu corresponding to.

Here, when a user input for changing the touch position of the first pointer is received on the touch input unit, displaying at least one sub-menu subordinate to the main menu corresponding to the changed touch position around the second touch point. It may further include a step.

Meanwhile, when a user input for executing the sub-menu selected by the second pointer is received, the method may further include executing a command corresponding to the selected sub-menu.

On the other hand, when the main menu selected by the first pointer is a character input menu, the at least one sub-menu is a sub-menu indicating a character, and user input for executing the sub-menu selected by the second pointer is received. When it does, the method may further include inputting a character indicated by the selected sub-menu.

According to a terminal and a control method according to an embodiment of the present invention, it is possible to control a mobile terminal according to an intuitive and convenient user input method on a small-sized touch screen.

In addition, the mobile terminal according to the present invention is able to input text with a minimized user input compared to a touch input by a conventional touch screen.

1 is a block diagram of a mobile terminal according to an embodiment of the present invention (block diagram).
2 is a perspective view of an example of a mobile terminal related to the present invention as viewed from the front.
3 is a rear perspective view of the mobile terminal shown in FIG. 2.
4 is a block diagram of a mobile terminal according to an embodiment of the present invention.
5 is a front perspective view of a mobile terminal according to an embodiment of the present invention.
6 is a view for explaining a touch sensor arrangement of a mobile terminal according to an embodiment of the present invention.
7 to 8 are diagrams for explaining a menu pop-up method according to an embodiment of the present invention.
9(a) to 9(c) and FIGS. 10(a) to 10(b) are diagrams for explaining a main menu selection method according to an embodiment of the present invention.
11(a) to 11(b) and FIGS. 12(a) to 12(b) are diagrams for describing a sub-menu selection method according to an embodiment of the present invention.
13 is a view for explaining a method of performing a command according to an embodiment of the present invention.
14(a) to 14(c) are views for explaining a character input method according to an embodiment of the present invention.
15(a) and 15(b) are diagrams for explaining a method for automatically inputting a sentence according to an embodiment of the present invention.
16(a) and 16(b) are diagrams for explaining a method of inputting time data characters according to an embodiment of the present invention.
17 is a view for explaining a character input method according to an embodiment of the present invention.
18(a) and 18(b) are views for explaining a method of deleting input characters according to an embodiment of the present invention.
19 is a view for explaining a menu display termination method according to an embodiment of the present invention.
20 is a diagram illustrating a sub-menu configuration list for an automatic sentence input method according to an embodiment of the present invention.
21 is a view for explaining a character input scenario according to an embodiment of the present invention.
22 is a flowchart of a control method of a mobile terminal according to an embodiment of the present invention.
23 is a flowchart of a method for controlling a mobile terminal according to an embodiment of the present invention.

Hereinafter, a mobile terminal related to the present invention will be described in more detail with reference to the drawings.

The suffixes "modules" and "parts" for components used in the following description are given or mixed only considering the ease of writing the specification, and do not have meanings or roles distinguished from each other in themselves.

The mobile terminal described in this specification may include a mobile phone, a smart phone, a laptop computer, a terminal for digital broadcasting, a PDA (Personal Digital Assistants), a portable multimedia player (PMP), navigation, and a smart watch. have.

However, those skilled in the art will readily appreciate that the configuration according to the embodiments described herein may also be applied to fixed terminals such as digital TVs and desktop computers, except when applicable only to mobile terminals.

1 is a block diagram of a mobile terminal according to an embodiment of the present invention (block diagram). The mobile terminal 100 illustrated in FIG. 1 includes a wireless communication unit 110, an audio/video (A/V) input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, a memory 160, an interface unit 170, a control unit 180, a power supply unit 190, and the like. The components shown in FIG. 1 are not essential, so a mobile terminal with more or fewer components may be implemented.

Hereinafter, the components will be described in turn.

The wireless communication unit 110 may include one or more modules that enable wireless communication between the mobile terminal 100 and the wireless communication system or between the mobile terminal 100 and the network in which the mobile terminal 100 is located. For example, the wireless communication unit 110 may include a broadcast receiving module 111, a mobile communication module 112, a wireless Internet module 113, a short-range communication module 114, and a location information module 115. .

The broadcast receiving module 111 receives a broadcast signal and/or broadcast related information from an external broadcast management server through a broadcast channel. The broadcast channel may include a satellite channel and a terrestrial channel. Two or more broadcast receiving modules may be provided to the mobile terminal 100 for simultaneous broadcast reception or switching of broadcast channels for at least two broadcast channels.

The broadcast management server may refer to a server that generates and transmits broadcast signals and/or broadcast-related information or a server that receives previously generated broadcast signals and/or broadcast-related information and transmits them to a terminal. The broadcast signal may include a TV broadcast signal, a radio broadcast signal, and a data broadcast signal, as well as a TV broadcast signal or a radio broadcast signal combined with a data broadcast signal.

The broadcast-related information may mean information related to a broadcast channel, a broadcast program, or a broadcast service provider. The broadcast-related information may also be provided through a mobile communication network. In this case, it may be received by the mobile communication module 112.

The broadcast-related information may exist in various forms. For example, it may exist in the form of an Electronic Program Guide (EPG) of Digital Multimedia Broadcasting (DMB) or an Electronic Service Guide (ESG) of Digital Video Broadcast-Handheld (DVB-H).

The broadcast receiving module 111 includes, for example, DMB-T (Digital Multimedia Broadcasting-Terrestrial), DMB-S (Digital Multimedia Broadcasting-Satellite), MediaFLO (Media Forward Link Only), DVB-H (Digital Video Broadcast) -Handheld), DVB-CBMS (Convergence of Broadcasting and Mobile Service), OMA-BCAST (Open Mobile Alliance-BroadCAST), CMMB (China Multimedia Mobile Broadcasting), MBBMS (Mobile Broadcasting Business Management System), ISDB-T (Integrated Services) Digital broadcast signals can be received using digital broadcast systems such as Digital Broadcast-Terrestrial. Of course, the broadcast receiving module 111 may be configured to be suitable for other broadcasting systems as well as the digital broadcasting system described above.

The broadcast signal and/or broadcast-related information received through the broadcast receiving module 111 may be stored in the memory 160.

The mobile communication module 112 is a base station on a mobile communication network, such as, but not limited to, GSM (Gobal System for Mobile communications), Code Division Multiple Access (CDMA), Wideband CDMA (WCDMA), Long Term Evolution (LTE), but is not limited thereto. It transmits and receives wireless signals to at least one of an external terminal and a server. The wireless signal may include various types of data according to transmission and reception of a voice call signal, a video call signal, or a text/multimedia message.

The wireless Internet module 113 refers to a module for wireless Internet access, and may be built in or external to the mobile terminal 100. Wireless Internet technologies include Wireless LAN (WLAN) (Wi-Fi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access), GSM, CDMA, WCDMA, Long Term (LTE) Evolution) (but not limited to) and the like.

In view of the wireless Internet access by Wibro, HSDPA, GSM, CDMA, WCDMA, LTE, etc., through the mobile communication network, the wireless Internet module 113 performing wireless Internet access through the mobile communication network is the mobile communication module It may be understood as a kind of (112).

The short-range communication module 114 refers to a module for short-range communication. Bluetooth, radio frequency identification (RFID), infrared data association (IrDA), ultra wideband (UWB), ZigBee, etc. may be used as short range communication technology.

The location information module 115 is a module for obtaining a location of a mobile terminal, and a representative example thereof is a Global Position System (GPS) module. According to the present technology, the GPS module 115 calculates distance information and accurate time information from three or more satellites, and then applies trigonometry to the calculated information, thereby providing a three-dimensional string according to latitude, longitude, and altitude. Position information can be calculated accurately. Currently, a method of calculating position and time information using three satellites and correcting an error of the calculated position and time information using another one satellite is widely used. In addition, the GPS module 115 may calculate speed information by continuously calculating the current position in real time.

Referring to FIG. 1, the A/V (Audio/Video) input unit 120 is for inputting an audio signal or a video signal, which may include a camera 121 and a microphone 122. The camera 121 processes image frames such as still images or moving pictures obtained by an image sensor in a video call mode or a shooting mode. The processed image frame may be displayed on the display unit 151.

The image frames processed by the camera 121 may be stored in the memory 160 or transmitted to the outside through the wireless communication unit 110. Two or more cameras 121 may be provided according to the use environment.

The microphone 122 receives an external sound signal by a microphone in a call mode, a recording mode, or a voice recognition mode, and processes it as electrical voice data. The processed voice data may be converted into a form transmittable to a mobile communication base station through the mobile communication module 112 and output. Various noise reduction algorithms for removing noise generated in the process of receiving an external sound signal may be implemented in the microphone 122.

The user input unit 130 generates input data for the user to control the operation of the terminal. The user input unit 130 may be configured with buttons 136 located on the front, rear, or side surfaces of the mobile terminal 100, and a touch sensor (static pressure/blackout) 137, although not shown, a key pad , A dome switch, a jog wheel, a jog switch, and the like. According to the embodiments described below, the touch sensor 137 may be arranged in a form surrounding the display unit 151.

The sensing unit 140 detects the current state of the mobile terminal 100, such as the open/closed state of the mobile terminal 100, the location of the mobile terminal 100, the presence or absence of user contact, the orientation of the mobile terminal, and acceleration/deceleration of the mobile terminal. By generating a sensing signal for controlling the operation of the mobile terminal 100. Examples of the sensing unit 140 may include a gyroscope sensor, an acceleration sensor, a geomagnetic sensor, and the like.

For example, when the mobile terminal 100 is in the form of a slide phone, it can sense whether the slide phone is opened or closed. In addition, it is also possible to sense whether the power supply unit 190 supplies power, whether the interface unit 170 is coupled to an external device, or the like. Meanwhile, the sensing unit 140 may include a proximity sensor 141.

The output unit 150 is for generating output related to vision, hearing, or tactile sense, and includes a display unit 151, an audio output module 152, an alarm unit 153, and a haptic module 154. Can be.

The display unit 151 displays (outputs) information processed by the mobile terminal 100. For example, when the mobile terminal is in a call mode, a UI (User Interface) or a GUI (Graphic User Interface) related to the call is displayed. When the mobile terminal 100 is in a video call mode or a photographing mode, the photographed and/or received image or UI, GUI is displayed.

The display unit 151 includes a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), and a flexible display (flexible) display) and a 3D display.

Some of these displays may be of a transparent type or a light transmissive type so that the outside can be seen through them. This may be referred to as a transparent display, and a typical example of the transparent display is TOLED (Transparant OLED). The rear structure of the display unit 151 may also be configured as a light transmissive structure. With this structure, the user can see an object located behind the terminal body through an area occupied by the display unit 151 of the terminal body.

Two or more display units 151 may be present depending on the implementation form of the mobile terminal 100. For example, a plurality of display units may be spaced apart from one surface or integrally disposed in the mobile terminal 100, or may be respectively disposed on different surfaces.

When the display unit 151 and the touch sensor 137 form a mutual layer structure or are integrally formed (hereinafter, referred to as a'touch screen'), the display unit 151 may also be used as an input device in addition to an output device. Can be used. For example, when the touch sensor has a form of a touch film, a touch sheet, a touch pad, etc., the touch sensor may be stacked on the display unit 151 to form a layer structure. It can be made in one piece.

The touch sensor 137 may be configured to convert changes in pressure applied to a specific portion of the display unit 151 or capacitance generated in a specific portion of the display unit 151 into an electrical input signal. The touch sensor 137 may be configured to detect not only the touched position and area, but also the pressure at the time of touch.

When there is a touch input to the touch sensor 137, the signal(s) corresponding thereto is sent to the touch controller. The touch controller processes the signal(s) and then transmits corresponding data to the controller 180. Accordingly, the control unit 180 can know which area of the display unit 151 has been touched, and the like.

Referring to FIG. 2, a proximity sensor 141 may be disposed in an inner area of a mobile terminal surrounded by the touch screen or near the touch screen. The proximity sensor refers to a sensor that detects the presence or absence of an object approaching a predetermined detection surface or an object present in the vicinity without mechanical contact using electromagnetic force or infrared rays. Proximity sensors have a longer lifespan and higher utilization than contact sensors.

Examples of the proximity sensor include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive type proximity sensor, a magnetic type proximity sensor, and an infrared proximity sensor. When the touch screen is capacitive, it is configured to detect the proximity of the pointer due to a change in electric field according to the proximity of the pointer. In this case, the touch screen (touch sensor) may be classified as a proximity sensor.

Hereinafter, for convenience of description, an act of causing the pointer to be recognized as being located on the touch screen without being touched by the pointer on the touch screen is referred to as a “proximity touch”, and the touch The act of actually touching the pointer on the screen is referred to as "contact touch". The location on the touch screen that is a proximity touch with a pointer refers to a location where the pointer corresponds vertically to the touch screen when the pointer is touched close.

The proximity sensor detects a proximity touch and a proximity touch pattern (eg, proximity touch distance, proximity touch direction, proximity touch speed, proximity touch time, proximity touch position, proximity touch movement state, etc.). Information corresponding to the sensed proximity touch operation and proximity touch pattern may be output on the touch screen.

The audio output module 152 may output audio data received from the wireless communication unit 110 or stored in the memory 160 in a call signal reception, call mode or recording mode, voice recognition mode, broadcast reception mode, or the like. The sound output module 152 may also output sound signals related to functions (eg, call signal reception sound, message reception sound, etc.) performed in the mobile terminal 100. The sound output module 152 may include a receiver, a speaker, and a buzzer.

The alarm unit 153 outputs a signal for notifying the occurrence of an event in the mobile terminal 100. Examples of events generated in the mobile terminal include call signal reception, message reception, key signal input, and touch input. The alarm unit 153 may output a signal for notifying the occurrence of an event by vibrating in a form other than a video signal or an audio signal, for example, vibration. The video signal or the audio signal may also be output through the display unit 151 or the audio output module 152, so that the display unit 151 and the audio output module 152 may be classified as part of the alarm unit 153. have.

The haptic module 154 generates various tactile effects that the user can feel. A typical example of the tactile effect generated by the haptic module 154 is vibration. The intensity and pattern of vibration generated by the haptic module 154 are controllable. For example, different vibrations may be synthesized and output or sequentially output.

In addition to vibration, the haptic module 154 is used for stimulation such as pin arrangement that vertically moves with respect to the contact skin surface, jet or suction power of air through a jet or intake, grazing on the skin surface, contact with an electrode, and electrostatic force. Various tactile effects can be generated, such as an effect and an effect of reproducing a feeling of cold and warm using an element capable of absorbing heat or generating heat.

The haptic module 154 may not only deliver the tactile effect through direct contact, but may also be implemented so that the user can feel the tactile effect through muscle sensations such as fingers or arms. Two or more haptic modules 154 may be provided according to a configuration aspect of the portable terminal 100.

The memory 160 may store a program for the operation of the controller 180, and may temporarily store input/output data (eg, a phone book, a message, a still image, a video, etc.). The memory 160 may store data related to various patterns of vibration and sound output when a touch is input on the touch screen.

The memory 160 is a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory, etc.), RAM (Random Access Memory, RAM), Static Random Access Memory (SRAM), Read-Only Memory (ROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), Programmable Read-Only Memory (PROM), magnetic memory, magnetic It may include a storage medium of at least one type of disk, optical disk. The mobile terminal 100 may operate in connection with a web storage performing a storage function of the memory 160 on the Internet.

The interface unit 170 serves as a passage with all external devices connected to the mobile terminal 100. The interface unit 170 receives data from an external device, receives power, transfers it to each component inside the mobile terminal 100, or allows data inside the mobile terminal 100 to be transmitted to the external device. For example, wired/wireless headset port, external charger port, wired/wireless data port, memory card port, port for connecting devices equipped with an identification module, audio input/output (I/O) port, A video input/output (I/O) port, an earphone port, and the like may be included in the interface unit 170.

The identification module is a chip that stores various information for authenticating the usage rights of the mobile terminal 100, a user identification module (UIM), a subscriber identification module (SIM), and a universal user authentication module ( Universal Subscriber Identity Module (USIM). The device provided with the identification module (hereinafter referred to as'identification device') may be manufactured in a smart card format. Therefore, the identification device may be connected to the terminal 100 through a port.

When the mobile terminal 100 is connected to an external cradle, the interface unit becomes a passage through which power from the cradle is supplied to the mobile terminal 100, or various command signals input from the cradle by the user are moved. It can be a passage to the terminal. Various command signals or power inputted from the cradle may be operated as signals for recognizing that the mobile terminal is correctly mounted on the cradle.

The controller (controller, 180) usually controls the overall operation of the mobile terminal. For example, it performs related control and processing for voice calls, data communication, video calls, and the like. The controller 180 may also include a multimedia module 181 for multimedia playback. The multimedia module 181 may be implemented in the controller 180, or may be implemented separately from the controller 180.

The controller 180 may perform a pattern recognition process capable of recognizing handwriting input or picture drawing input performed on the touch screen as text and images, respectively.

The power supply unit 190 receives external power and internal power under the control of the controller 180 to supply power required for the operation of each component.

The battery may be a built-in battery made to be rechargeable, and may be detachably coupled to the terminal body for charging or the like. The connection port may be configured as an example of the interface 170 to which an external charger that supplies power for charging the battery is electrically connected.

The various embodiments described herein can be implemented in a computer- or similar device-readable recording medium using, for example, software, hardware, or a combination thereof.

According to a hardware implementation, the embodiments described herein include application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), It may be implemented using at least one of processors, controllers, micro-controllers, microprocessors, and electrical units for performing other functions. These may be implemented by the controller 180.

According to a software implementation, embodiments such as procedures or functions may be implemented with separate software modules that perform at least one function or operation. The software code can be implemented by software applications written in the appropriate programming language. The software code is stored in the memory 160 and may be executed by the controller 180.

2 is a perspective view of an example of a mobile terminal or a mobile terminal related to the present invention as viewed from the front.

The disclosed portable terminal 100 has a bar-shaped terminal body. However, the present invention is not limited to this, and can be applied to various structures such as a slide type, a folder type, a swing type, and a swivel type in which two or more bodies are movably coupled.

The body of the mobile terminal 100 includes cases (101, 102, 103) forming an exterior. In this embodiment, the case may be divided into a front case 101 and a rear case 102. Various electronic components are embedded in a space formed between the front case 101 and the rear case 102.

In some cases, electronic components may also be mounted on the surface of the rear case 102. The electronic components mounted on the surface of the rear case 102 include a battery, a USIM card, and a memory card that the user needs to detach. At this time, the rear case 102 may further include a rear cover 103 for covering its surface. The rear cover 103 is formed in a structure that can be easily attached and detached by a user, and when the rear cover 103 is removed, the surface of the rear case 102 is exposed.

When the rear cover 103 is combined as shown in FIG. 2, only a part of the side surface of the rear case 102 may be exposed, and when the size of the rear cover 103 is reduced, the rear surface of the rear case 102 may be reduced. Some may also be exposed. When the rear cover 103 covers the entire rear surface of the rear case 102, an opening 103 ′ for exposing the camera 121 ′ or the sound output unit 152 ′ to the outside may be included.

The cases 101, 102, and 103 may be formed by injecting synthetic resin or may be formed to have a metal material, for example, a metal material such as stainless steel (STS) or titanium (Ti).

A display unit 151, an audio output unit 152, a camera 121, a user input unit 130/131,132, a microphone 122, an interface 170, etc. may be disposed in the terminal cases 101 and 102.

The display unit 151 occupies most of the main surface of the front case 101. An acoustic output unit 152 and a camera 121 are disposed in an area adjacent to one end of both ends of the display unit 151, and a user input unit 131 and a microphone 122 are arranged in an area adjacent to the other end. The user input unit 132 and the interface 170 may be disposed on side surfaces of the front case 101 and the rear case 102.

The user input unit 130 is operated to receive a command for controlling the operation of the portable terminal 100, and may include a plurality of operation units 131 and 132. The operation units 131 and 132 may also be collectively referred to as a manipulating portion, and any method may be employed as long as the user operates with a tactile feeling.

Contents input by the first or second operation units 131 and 132 may be variously set. For example, the first operation unit 131 receives a command such as start, end, scroll, etc., and the second operation unit 132 inputs a command such as adjusting the volume of sound output from the sound output unit 152. In response, the third manipulation unit 133 may receive a command such as switching of the display unit 151 to a touch recognition mode.

6 is a rear perspective view of the portable terminal shown in FIG. 2.

Referring to FIG. 6, a camera 121 ′ may be additionally mounted on the rear of the terminal body, that is, the rear case 102. The camera 121 ′ has a shooting direction substantially opposite to the camera 121 (see FIG. 2 ), and may be a camera having different pixels from the camera 121.

For example, in the case of a video call, the camera 121 has a low pixel so that the user's face is taken and transmitted to the other party, and the camera 121' may not shoot the general subject and send it immediately. It is desirable to have high pixels in many cases. The cameras 121 and 121' may be installed on the terminal body to be rotatable or pop-up.

A flash 123 and a mirror 124 are additionally disposed adjacent to the camera 121'. When the flash 123 photographs the subject with the camera 121', light is directed toward the subject. The mirror 124 allows the user to reflect on his or her face when the user wants to take a picture (self-portrait) using the camera 121'.

A sound output unit 152' may be additionally disposed on the rear side of the terminal body. The audio output unit 152' may implement a stereo function together with the audio output unit 152 (see FIG. 2A), or may be used to implement a speakerphone mode during a call.

On the side of the terminal body, an antenna 116 for receiving a broadcast signal may be additionally disposed in addition to an antenna for a call. The antenna 116 forming part of the broadcast receiving module 111 (refer to FIG. 1) may be installed to be withdrawn from the terminal body.

A power supply unit 190 for supplying power to the mobile terminal 100 is mounted on the terminal body. The power supply unit 190 may be built in the terminal body or configured to be detachable directly from the outside of the terminal body.

A touch pad 135 for sensing a touch may be additionally mounted on the rear case 102. The touch pad 135 may be configured as a light transmissive type for the display unit 151. In this case, if the display unit 151 is configured to output visual information from both sides (ie, in the direction of both the front and rear of the mobile terminal), it is possible to recognize the visual information through the touch pad 135 as well. do. Information output on both sides may be controlled by the touch pad 135.

On the other hand, since the display for exclusive use of the touch pad 135 is separately mounted, a touch screen may be disposed on the rear case 102.

The touch pad 135 operates in relation to the display unit 151 of the front case 101. The touch pad 135 may be disposed parallel to the rear of the display unit 151. The touch pad 135 may have the same or smaller size than the display unit 151.

In general, the user moves the mobile terminal 100 while carrying it in a bag or a pocket, and if necessary, the mobile terminal 100 is taken out and used. After the user grips the mobile terminal 100, the user may operate the mobile terminal 100 using a hand or other hand gripping the mobile terminal 100.

As described above, in order to use the mobile terminal 100, it is traditionally necessary for the user to hold the mobile terminal 100 using the hand. This entails a problem that it is difficult for the user to properly operate the mobile terminal 100 when the user cannot freely use the hand, for example, when holding an object by hand, or when driving. Accordingly, in recent years, development of a mobile terminal 100 in a form that a user can use without holding it by hand is underway. For example, development of a mobile terminal 100 in a form that can be worn on a human body, such as glasses or a watch, is underway. As described above, the mobile terminal 100 in a form that can be mounted on a human body may be referred to as a wearable device.

The mobile terminal described below may be a watch-type mobile terminal that can be worn by a user on the wrist. Hereinafter, in describing embodiments described below, it is assumed that the mobile terminal according to the present invention includes at least one of the components illustrated in FIG. 1. Specifically, the mobile terminal according to the present invention, the display unit 151 of the components shown in Figure 1, the user input unit 130 for receiving a touch input outside the display unit 151, memory 160 and It is assumed that the controller 180 is included.

Since the mobile terminal according to the present invention can be more easily implemented when the display unit 151 is a touch screen, it is assumed that the display unit 151 is a touch screen in the embodiments described below. When the display unit 151 is a touch screen, the display unit 151 may simultaneously function as an output device for outputting information and an input device for receiving a user's touch input.

In addition, in the embodiment described below, the user input unit 130 may serve to receive a touch input from outside the touch screen. In this case, in order to distinguish the touch input input through the touch screen and the touch input received through the user input unit 130 from the outside of the touch screen, a function unit serving to receive a touch input outside the touch screen is referred to as a "touch input unit". We are going to call it new. In addition, in the embodiments described below, the memory 160 is a storage unit, the wireless communication unit 110 is a communication unit, and the power supply unit 190 is newly referred to as a power unit.

3 is a block diagram of a mobile terminal according to an embodiment of the present invention. Referring to FIG. 3, the touch screen 410 may display (output) information processed by the mobile terminal 100. For example, when the mobile terminal is in a call mode, a UI (User Interface) or a GUI (Graphic User Interface) related to the call is displayed. Meanwhile, in the present specification, the touch screen 410 may display information processed under the control of the control unit 430 and simultaneously receive a user's touch input and transmit it to the control unit 430.

The touch input unit 420 may receive a user's touch input from outside the touch screen 410. Specifically, the touch input unit 420 may include a touch screen 410 and a separate touch sensor, or may include a touch sensor integrated with the touch screen 410 to receive user input. Meanwhile, in the present specification, the touch input unit 420 may receive a user's touch input and transmit it to the control unit 430.

A detailed description of the touch screen 410 and the touch input unit 420 will be described with reference to FIG. 2.

The control unit 430 typically controls the overall operation of the mobile terminal 100. Specifically, contents received through data communication or contents stored in a storage unit may be executed, each component of the mobile terminal 100 may be controlled, and data between each component may be controlled.

On the other hand, in the present specification, when the touch input of the first and second pointers is received by the touch input unit 420, the control unit 430 controls to display at least one main menu around the touch point of the first pointer. At least one sub-menu depending on the selected main menu corresponding to the touch point of the first pointer may be displayed around the touch point of the two pointers.

Here, when a user input for changing the touch position of the first pointer is received on the touch input unit 420, the control unit 430 is at least one subordinate to the main menu corresponding to the changed touch position around the touch point of the second pointer. The sub-menu of can be controlled to be displayed. In this case, the user input is that the first pointer slides along the touch input unit 420, or after the first pointer is released from the touch input unit 420, the touch input unit 420 is moved. It may be a touch input to re-touch.

The control unit 430 according to an embodiment of the present invention may control the selected main menu corresponding to the touch position of the first pointer and the selected sub-menu corresponding to the touch position of the second pointer to be visually identified and displayed.

Meanwhile, when a user input for executing the sub-menu selected by the second pointer is received, the control unit 430 may execute a command corresponding to the selected sub-menu. In this case, the user input is to slide the second pointer from the touch input unit into the touch screen, or after releasing the second pointer from the touch input unit, move the second pointer to the touch screen. It may be a user input touching the selected sub-menu above. In addition, the command refers to a command for instructing a specific application or a program operation in a mobile terminal, and for example, a'call' application execution command and a'text' application execution command.

Meanwhile, when the main menu selected by the first pointer is a character input menu, the control unit 430 according to an embodiment of the present invention may include at least one sub indicating a character to be input around the touch point of the second pointer. The menu is controlled to be displayed, and when a user input for executing a sub-menu selected by the second pointer is received, a character indicated by the selected sub-menu can be controlled to be input. In this case, the user input may be a user input that slides the second pointer from the touch input unit into the touch screen.

On the other hand, when the sub-menu selected by the second pointer indicates a plurality of characters, the control unit 430 may control one of the plurality of characters to be input based on the slide movement direction of the second pointer. have.

Meanwhile, when the main menu selected by the first pointer is changed to a character completion menu, the control unit 430 according to an embodiment of the present invention can be completed by including characters previously input around the touch point of the second pointer. At least one sub-menu indicating text may be controlled to display. In this case, the control unit 430 controls to display at least one additional sub-menu, which is subordinate to the sub-menu selected by the second pointer through the touch screen 410, wherein at least one additional sub-menu is the selected sub-menu It can indicate a sentence that can be completed, including the text indicated by.

On the other hand, the control unit 430 according to an embodiment of the present invention, when the sub-menu selected by the second pointer is a time menu, controls to display a clock UI through the touch screen 410, the watch by the second pointer When a user input for manipulating the UI is received, time data indicated by the manipulated clock UI may be controlled to be input as text.

Meanwhile, when the main menu selected by the first pointer is a character menu, the control unit 430 according to an embodiment of the present invention controls to display at least one sub-menu indicating a character, and displays the touch on the touch input unit 420. When a user input for rolling a sub-menu is received, and when a double-touch user input is received, it is possible to control so that the character indicated by the sub-menu corresponding to the preset position of the touch screen 410 is input. Here, the preset position of the touch screen 410 may be located at 12 o'clock (ie, the upper center portion of the touch screen 410) of the clock-type mobile terminal. In this case, the character indicated by the sub-menu corresponding to the preset position may be controlled to be visually identified and displayed.

Meanwhile, the control unit 430 according to the present invention may control to delete the displayed character when a user input for double-clicking the character displayed on the touch screen 410 is received. Alternatively, the control unit 430 may control to delete the displayed character when a user input sliding a character displayed on the touch screen 410 from the touch screen 410 to the touch input unit 420 is received.

Meanwhile, when a user input for double-clicking the touch screen 410 is received, the controller 430 according to the present invention may control the display of at least one main menu and at least one sub-menu to end.

Meanwhile, the operation of the control unit 430 will be described in more detail in FIGS. 7 to 19.

The storage unit 440 may list and store frequently used sentence groups. In addition, the storage unit 440 may store text that can be completed, including previously input characters.

Meanwhile, the storage unit 440 may store programs for processing and control of the control unit 430, and input/output data (eg, a phone book, messages, audio, still images, videos, etc.). It can also perform the function for temporary storage. The storage unit 440 may store data related to various patterns of vibration and sound output when a touch is input on the touch screen 410.

The communication unit 450 may include one or more modules that enable wireless communication between the mobile terminal 100 and the wireless communication system or between the mobile terminal 100 and the network in which the mobile terminal 100 is located.

The power supply unit 460 may supply power to each component of the mobile terminal 100 under the control of the control unit 430.

5 is a front perspective view of a mobile terminal 100 according to an embodiment of the present invention. As illustrated in FIG. 5, the mobile terminal 100 may be a smart watch designed in the form of a watch. In addition, the touch input unit 420 may be located on the bezel surrounding the touch screen 410 of the mobile terminal 100.

6 is a view for explaining the arrangement of the touch sensor of the mobile terminal 100 according to an embodiment of the present invention.

Referring to FIG. 6, a touch sensor may be disposed on each of the touch screen 410 and the touch input unit 420. The touch sensors disposed in each of the user inputs may separate the user input received from the touch screen 410 and the user input received from the touch input unit 420 and transmit them to the control unit 430.

Here, the touch sensor may be configured to convert a change in pressure applied to a specific portion or capacitance generated in the specific portion into an electrical input signal. The touch sensor may be configured to detect not only the touched position and area, but also the pressure at the time of touch.

When there is a touch input to the touch sensor, the signal(s) corresponding thereto is sent to a touch controller (not shown). The touch controller processes the signal(s) and then transmits corresponding data to the control unit 430. Accordingly, the control unit 180 can know which areas of the touch screen 410 and the touch input unit 420 are touched.

Meanwhile, the touch sensor may be implemented as a proximity sensor. The proximity sensor refers to a sensor that detects the presence or absence of an object approaching a predetermined detection surface or an object present in the vicinity without mechanical contact using electromagnetic force or infrared rays. Examples of the proximity sensor include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive type proximity sensor, a magnetic type proximity sensor, and an infrared proximity sensor.

On the other hand, the user's touch input is tap, double tap, drag, flick, slide, press, multi touch, pinch, depending on the operation. It is divided into pin in, pinch out, and the like.

The tap is an operation of lightly pressing and releasing the touch screen 410 or the touch input unit 420 once, and means a touch gesture such as a mouse click on a general personal computer.

In addition, the double tap is an operation of quickly tapping the touch screen 410 or the touch input unit 420 twice, and means a touch gesture similar to a double click of a mouse in a general personal computer.

In addition, the drag is an operation of moving the touch screen 410 or the touch input unit 420 to a specific position while holding the touch, and then releasing it. When dragging an object, the object is continuously moved and displayed according to the drag direction It may be.

In addition, flick refers to an operation of touching the touch screen 410 or the touch input unit 420 and then moving in a specific direction (up, down, left, right, or diagonal) and releasing the contact point, and the mobile terminal 100 flicks When a touch input is received by, processing of a specific operation is performed based on a flick direction, speed, and the like. For example, a page turning operation of an e-book may be performed based on the flick direction.

In addition, the slide means an operation of moving to a specific position while maintaining a touch on the touch screen 410 or the touch input unit 420, and when the touch input is received by the slide, the mobile terminal 100 receives the slide direction speed. Specific actions can be processed based on the like. For example, an adjacent menu selection operation may be performed based on the slide direction.

In addition, the press means an operation of continuously maintaining a touch for a predetermined time or more after touching the touch screen 410 or the touch input unit 420.

In addition, multi-touch refers to an operation of simultaneously touching a plurality of points of the touch screen 410 or the touch input unit 420.

In addition, pinch-in refers to an operation of dragging the touch screen 410 or the touch input unit 420 in a direction in which a plurality of pointers being multi-touched approach each other. That is, it means a drag that starts from at least one of a plurality of points that are multi-touched by the touch screen 410 or the touch input unit 420, and is generated in a direction in which a plurality of points that are multi-touched close to each other.

In addition, the pinch-out means an operation of dragging the touch screen 410 or the touch input unit 420 in a direction in which a plurality of pointers in multi-touch are moving away from each other. That is, it means a drag that starts from at least one of a plurality of points that are multi-touched on the touch screen 410 or the touch input unit 420, and that the plurality of points that are multi-touched are separated from each other.

Hereinafter, a control method of a mobile terminal according to an embodiment of the present invention will be described with reference to FIGS. 7 to 19. On the other hand, prior to the description of the drawings, it is assumed that the first mobile terminal is powered on.

7 to 8 are diagrams for explaining a menu pop-up method according to an embodiment of the present invention.

As illustrated in FIG. 7, when touch inputs of the first pointer 10 and the second pointer 20 are received by the touch input unit 420, the mobile terminal may at least one around the touch point of the first pointer 10. The main menu (711, 712, 713) of the display, and at least one sub-menu (721) subordinate to the selected main menu 712 corresponding to the touch point of the first pointer around the touch point of the second pointer (20) , 722, 723 ).

Specifically, when the first pointer 10 and the second pointer 20 are simultaneously or simultaneously received within the preset time in the touch input unit 420, at least one main around the touch point of the first pointer 10 The main menu UI (User Interface) including the menus 711, 712, and 713 may be displayed. In addition, a sub-menu UI (User Interface) including at least one sub-menu 721, 722, 723 may be displayed around the touch point of the second pointer 20. Here, in the sub-menu UI, the main menu 712 corresponding to the touch point of the first pointer 10 among the main menu UIs is selected, and the sub-menus 721, 722, and 723 subordinate to the selected main menu 712 are selected. It may be an included sub-menu UI.

Through the above method, the mobile terminal can display a menu on the touch screen 410 that can execute a specific command.

On the other hand, as shown in FIG. 8, even when the touch of the first pointer 10 and the second pointer 20 is released, the main menu and the sub-menu may be continuously displayed.

However, the user may adjust the time at which the main menu and the sub-menu are displayed after the touch is released, and may display the main menu and the sub-menu after the touch is released according to the adjusted time.

9(a) to 9(c) and FIGS. 10(a) to 10(b) are views for explaining a method for changing a main menu according to an embodiment of the present invention. 9(a) to 9(c) are diagrams illustrating a method of changing a main menu using a slide gesture, and FIGS. 10(a) and 10(b) are diagrams illustrating a method of changing a main menu using a tap gesture. 9(a) to 9(c) and 10(a) to 10(b), the mobile terminal assumes a state in which at least one main menu and at least one sub-menu are displayed.

When a user input for changing the touch position of the first pointer 10 is received on the touch input unit, the mobile terminal selects a main menu corresponding to the changed touch position of the first pointer 10 and touches the second pointer 20. At least one sub-menu depending on the selected main menu may be displayed around the location point.

Referring to FIG. 9(a), when a user input of a slide movement that does not exceed a preset criterion (a dotted line section in FIG. 9(a)) is received on the touch input unit, the first pointer 10 moves. The terminal may perform an operation of moving the first selected main menu according to the movement of the first pointer 10. That is, when the slide is moved less than a preset criterion, the mobile terminal may not change the main menu. Here, the preset criteria may be set by the manufacturer or the user.

On the other hand, as shown in FIG. 9(b), when the first pointer 10 receives a user input of a slide movement exceeding a preset criterion (a dotted line section in FIG. 9(b)) along the touch input unit, the mobile terminal Can be changed to the main menu corresponding to the touch position of the first pointer 10. Also, the mobile terminal may display at least one sub-menu dependent on the changed main menu around the touch position point of the second pointer 20. That is, when the slide is moved more than a preset criterion, the mobile terminal may select the main menu by changing it.

Based on the preset criteria as described above, only in the case of a slide movement in which the user intends to change the menu, the mobile terminal can change the menu and select it.

Meanwhile, as illustrated in FIG. 9( c), when the user input for sliding the first pointer 10 along the touch input unit is received even when the touch of the second pointer 20 is released, the mobile terminal receives the first pointer 10. ) To the main menu corresponding to the touch position.

On the other hand, referring to FIG. 10(a), after the first pointer 10 is released from the touch input unit, when a user input for re-touching the touch input unit is received, the mobile terminal touches the position of the first pointer 10 It can be changed to the main menu corresponding to. Also, the mobile terminal may display at least one sub-menu dependent on the changed main menu around the touch position point of the second pointer 20. That is, the main menu may be changed and selected using a tap gesture.

Meanwhile, as shown in FIG. 10( b), even when the touch of the second pointer 20 is released, the first pointer 10 may change the main menu through a gesture to select the touch.

Meanwhile, the menus selected by the first pointer 10 and the second pointer 20 as shown in FIGS. 9(a) to 9(c) and FIGS. 10(a) to 10(b) are displayed to be visually identified. can do.

11(a) to 11(b) and FIGS. 12(a) to 12(b) are diagrams for explaining a sub-menu change method according to an embodiment of the present invention. 11(a) to 11(b) and 12(a) to 12(b), the mobile terminal assumes a state in which at least one main menu and at least one sub-menu are displayed.

When a user input for changing the touch position of the second pointer 20 is received on the touch input unit, the mobile terminal may select and display a sub-menu corresponding to the touch position of the second pointer 20.

Referring to FIG. 12(a), when a user input for sliding the second pointer 20 along the touch input unit is received on the touch input unit, the mobile terminal sub-menu corresponding to the touch position of the second pointer 20 Can be changed to That is, the sub-menu can be changed and selected using a slide gesture.

In addition, as shown in 9(b), when a user input for re-touching the touch input unit is received after the second pointer 20 is released from the touch input unit, the mobile terminal corresponds to the touch position of the second pointer 20. Can be changed to the sub menu. That is, the sub-menu may be changed by using a tap gesture.

Meanwhile, as illustrated in FIG. 13( a), even when the touch of the first pointer 10 is released, when the user input for the second pointer 20 to slide along the touch input unit is received, the mobile terminal receives the second pointer 20. ) To the sub-menu corresponding to the touch position.

In addition, even if the touch of the first pointer 10 is released, as shown in FIG. 13(b), after the second pointer 20 is released from the touch input unit, when a user input for re-touching the touch input unit is received, movement is performed. The terminal may change to a sub-menu corresponding to the touch position of the second pointer 20. That is, the sub-menu may be selected by changing the sub-menu in response to a user input changing the position of the second pointer 20 regardless of whether or not the first pointer 10 is maintained.

Meanwhile, as described above, in the case of FIGS. 11(a) to 11(b) and FIGS. 12(a) to 12(b), the menu selected by the first pointer 10 and the second pointer 20 is also selected. Can be displayed to be visually identified.

13 is a view for explaining a method of performing a command according to an embodiment of the present invention.

When a user input for executing the sub-menu selected by the second pointer 20 is received, the mobile terminal may execute a command corresponding to the selected sub-menu.

Referring to FIG. 13, when a user input for sliding the second pointer 20 from the touch input unit 420 to the inside of the touch screen 410 is received, the mobile terminal displays a pop-up command corresponding to the selected sub-menu 1320 ( 1330).

On the other hand, even when the user input for touching the sub-menu 1320 on the touch screen 410 is received after the second pointer 20 is released from the touch input unit 420 and then the second pointer 20 is touched. , The mobile terminal may execute the command 1330 corresponding to the selected sub-menu 1320. That is, when a user input for tapping a sub-menu displayed on a touch screen or a user input for sliding is received, the mobile terminal may execute a command corresponding to the selected sub-menu.

14(a) to 14(c) are views for explaining a character input method according to an embodiment of the present invention. Here, the character input method corresponds to one embodiment of the command execution of FIG. 13 described above.

Referring to FIG. 14(a), when a user input for selecting a character input menu is received by the first pointer 10, the mobile terminal may display at least one sub-menu indicating a character to be input. Then, when a user input for selecting any one of the at least one sub-menu is received by the second pointer 20, the mobile terminal may activate (or expand) the selected sub-menu. Then, when a user input for executing the sub-menu selected by the second pointer 20 is received, the mobile terminal may execute a command for inputting a character indicated by the selected sub-menu. Here, it can be confirmed that the user input for executing the selected sub-menu is a user input for sliding the second pointer 20 from the touch input unit to the inside of the touch screen.

Alternatively, when the sub-menu selected by the second pointer 20 indicates a plurality of characters, as shown in FIG. 14(b), the mobile terminal may display a plurality of characters m based on the slide movement direction of the second pointer 20. , n, o).

On the other hand, there is a character input method capable of inputting the completed text at a time with a character input method according to an embodiment of the present invention.

Referring to FIG. 14(c), a character ('lo') is input to the mobile terminal. When the user input for changing to the character completion menu ("auto") is received by the first pointer 10, the mobile terminal can complete the text ("low", including the previously input character ("lo")). It is possible to display a sub-menu indicating "long", "lost", "love"). Then, when a user input for executing a sub-menu ("love") is received by the second pointer 20, the mobile terminal may execute a command for inputting text indicated by the sub-menu ("love"). .

Here, the text that can be completed, including the previously input character, may be stored in the storage unit of the mobile terminal.

Using the above character completion menu, the user can enter the completed text at once, without having to enter each character.

15(a) and 15(b) are diagrams for explaining a method for automatically inputting a sentence according to an embodiment of the present invention.

Referring to FIG. 15(a), when a user input for changing to a character completion menu (“auto”) is received by the first pointer 10, the mobile terminal sets a predetermined sentence group (“greet”, “thank”, It is possible to display a sub-menu indicating "sorry", "meet", "time"). Here, the preset sentence group is a sentence frequently used by a user and can be changed by a manufacturer or a user.

Then, when a user input for selecting a sub-menu ("sorry") is received by the second pointer 20 through the touch screen, the mobile terminal completes including the text indicated by the selected sub-menu ("sorry"). You can display additional sub-menus that indicate possible sentences ("so sorry", "I'm really sorry", "sorry but"). Here, the additional sub-menu may be displayed separately inside the sub-menu.

Then, when a user input for selecting an additional sub-menu ("I'm really sorry") is received by the second pointer 20 through the touch screen, the mobile terminal receives the additional sub-menu ("I'm really sorry"). You can execute the command to enter the sentence indicated by ).

Here, the user input for selecting the sub-menu and the additional sub-menu by the second pointer 20 may be input at one time by moving the slide.

Meanwhile, as shown in FIG. 15(b), when a user input for selecting a sub-menu (“sorry”) is received by the second pointer 20 (on the touch screen or the touch input unit), the mobile terminal selects the selected sub-menu ( Additional sub-menus may be displayed indicating the characters (sorry", "I'm really sorry", "sorry but") that can be completed, including the text indicated by "sorry"), where the selected sub-menu Submenus other than ("sorry") ("greet", "think", "meet", "time") have been changed to additional submenus (sorry", "I'm really sorry", "sorry but") Additional sub-menus can be displayed.

Then, when a user input for selecting an additional sub-menu ("I'm really sorry") is received by the second pointer 20 through the touch screen, the mobile terminal receives the additional sub-menu ("I'm really sorry"). You can execute the command to enter the sentence indicated by ).

Here, the user input for selecting the sub-menu and the additional sub-menu by the second pointer 20 may be input at one time by moving the slide.

In the case of FIG. 15(a), an additional sub-menu is displayed in a separate location, but in FIG. 15(b), an additional sub-menu is displayed in place of the sub-menu.

Meanwhile, frequently used sentence groups may be stored in the storage unit of the mobile terminal. Using the above sentence automatic input menu, the user can easily input the completed sentence without having to input each character. 20 will be described in detail.

16(a) and 16(b) are diagrams for explaining a method of inputting time data characters according to an embodiment of the present invention.

Referring to FIG. 16(a), when a user input for selecting a time menu (“time”), which is one of sub-menus of a character completion menu (“auto”), is received in the second pointer 20, the mobile terminal watches A user interface (UI) 1610 may be displayed. Here, the clock UI 1610 may be a UI including an hour and minute hands in analog format. Then, when a user input for manipulating the clock UI 1610 is received by the second pointer 20, the mobile terminal may execute a command for inputting time data indicated by the manipulated clock UI 1610 as characters. That is, as shown in FIG. 16(a), according to a user input that operates the hour hand to point to '9 o'clock and the minute hand to point to '15', the mobile terminal has time data of "9:15". Can be entered as a character.

Meanwhile, as shown in FIG. 16(b), the clock UI 1710 may be a digital UI. Referring to FIG. 16(b), when a user input for selecting a time menu (“time”), which is one of sub-menus of a character completion menu (“auto”), is received in the second pointer 20, the mobile terminal watches A user interface (UI) 1710 may be displayed. Here, the mobile terminal displays the clock UI 1710 that can receive the'hour' first, and the clock UI 1720 that can receive the'minute' can display it after receiving the'hour'. When a user input for selecting AM 11:00 is received as shown in FIG. 16(b), the mobile terminal may input time data of "11:00 AM" as a character and display a clock UI receiving'minutes'. . Thereafter, when a user input for selecting 15 minutes is received, the mobile terminal may input time data of “11:15 AM” as a character.

The mobile terminal may provide an intuitive and emotional time character input method to a user as shown in FIGS. 16(a) and 13(b).

17 is a view for explaining a character input method according to an embodiment of the present invention.

According to a text input method according to an embodiment of the present invention, when a user input for selecting a text menu is received by the first pointer, the mobile terminal may display at least one sub-menu indicating the text. Then, when a user input for rolling a sub-menu is received on the touch input unit, and then a user input for double-touch is received, the mobile terminal inputs a character indicated by the sub-menu corresponding to a preset position of the touch screen. You can run

As illustrated in FIG. 17, when a user input for selecting a character menu (“abc”) among the main menus is received by the first pointer 10, the mobile terminal can display sub-menus indicating each alphabetic character. have. Then, when a user input for rolling a sub-menu is received by the first pointer 10 on the touch input unit, the sub-menu is rolled in response to the operation of the first pointer 10, and is displayed at the top center (12 o'clock) of the touch screen. The alphabetic characters indicated by the located sub-menu can be activated. Then, when a user input for double touch (or double tap) by the second pointer 20 is received on the touch input unit, the mobile terminal may input the activated alphabetic character.

18(a) and 18(b) are diagrams for explaining a method of deleting an input character according to an embodiment of the present invention. Prior to description, it is assumed that characters are input to the mobile terminals of FIGS. 18(a) and 18(b).

Referring to FIG. 18(a), when a user input for sliding a character displayed on a touch screen from a touch screen to a touch input unit is received, the mobile terminal may perform a command for deleting the displayed character.

Alternatively, as shown in FIG. 18(b), when a user input for double-clicking a character displayed on the touch screen is received, the mobile terminal may perform a command for deleting the displayed character.

19 is a view for explaining a menu display termination method according to an embodiment of the present invention.

Referring to FIG. 19, when a user input for double-clicking the touch screen is received, the mobile terminal may execute a command to terminate the displayed main menu, sub-menu, and running application.

In addition to the double tapping user input as shown in FIG. 19, the termination command may also be executed by a user input slightly pressing a physical button (eg, a power button) provided in the mobile terminal.

20 is a diagram illustrating a sub-menu configuration list for an automatic sentence input method according to an embodiment of the present invention.

In order to perform the automatic sentence input method according to an embodiment of the present invention, as described with reference to FIGS. 15(a) and 15(b), a group of list sentences may be stored as shown in FIG. 20.

15(a) and 15(b), the description was limited to the sub-menu of level 1 (sub-menu) and the sub-menu of level 2 (additional sub-menu). Even sub-menus of the level can be used for the automatic input method of sentences.

21 is a view for explaining a character input scenario according to an embodiment of the present invention.

The user may operate the mobile terminal as shown in FIG. 21 to input the sentence "Meet me at 7:15 pm".

1) The user selects a character completion menu ("auto") from the main menu with the first pointer 10, and 2) instructs "Meet" among the sub-menus subordinate to the character completion menu with the second pointer 20. Select the sub-menu. In response to the user input, the mobile terminal inputs "Meet" and displays at least one additional sub-menu. The at least one additional sub-menu includes a menu indicating a sentence ("Meet me at", "Meet up with") that can be completed including text indicated by the selected sub-menu ("Meet").

And, 3) the user selects an additional sub-menu indicating "Meet me at" from the additional sub-menu with the second pointer 20. In response to the user input, the mobile terminal may input “Meet me at”.

And, 4) the user selects the character completion menu ("auto") from the main menu again with the first pointer 10 to move the initial sub-menu, and 5) is dependent on the character completion menu with the second pointer 20 Select the time menu ("time") among the sub-menus. In response to the user input, the mobile terminal can display the clock UI.

Then, 6) the user selects "7 o'clock" from the clock UI with the second pointer 20, and 7) selects "15 minutes". In response to the user input, the mobile terminal may input "Meet me at 7:15 pm".

As described above, the mobile terminal according to the present invention can control the mobile terminal according to an intuitive and convenient user input method on a small-sized touch screen.

In particular, the mobile terminal according to the present invention is able to input text with a minimized user input compared to a touch input by a conventional touch screen.

According to a terminal and a control method according to an embodiment of the present invention, it is possible to control a mobile terminal according to an intuitive and convenient user input method on a small-sized touch screen.

In addition, the mobile terminal according to the present invention is able to input text with a minimized user input compared to a touch input by a conventional touch screen.

22 is a flowchart of a control method of a mobile terminal according to an embodiment of the present invention.

Referring to FIG. 22, a mobile terminal including a touch screen and a touch input unit for receiving a user's touch input from outside the touch screen, receives touch inputs of the first and second pointers on the touch input unit (S2110). , At least one main menu may be displayed around the touch point of the first pointer (S2120).

Then, the mobile terminal may display at least one sub-menu dependent on the selected main menu corresponding to the touch point of the first pointer, around the touch point of the second pointer (S2130).

23 is a flowchart of a method for controlling a mobile terminal according to an embodiment of the present invention.

Referring to FIG. 23, a mobile terminal including a touch screen and a touch input unit for receiving a user's touch input from outside the touch screen, receives touch inputs of the first and second pointers on the touch input unit (S2310). , At least one main menu may be displayed around the touch point of the first pointer (S2320).

Then, the mobile terminal may display at least one sub-menu subordinate to the selected main menu corresponding to the touch point of the first pointer, around the touch point of the second pointer (S2330).

Then, when a user input for changing the touch position of the first pointer is received on the touch input unit (S2340), the mobile terminal is provided with at least one sub which is dependent on the main menu corresponding to the changed touch position around the touch point of the second pointer The menu may be displayed (S2345). In this case, the user input may be a touch input that re-touches the touch input unit after the first pointer slides along the touch input unit or after the first pointer is released from the touch input unit.

Meanwhile, when a user input for executing the sub-menu selected by the second pointer is received (S2350), the mobile terminal may execute a command corresponding to the selected sub-menu (S2355). In this case, the user input is to slide the second pointer from the touch input unit into the touch screen, or after releasing the second pointer from the touch input unit, move the second pointer to the touch screen. It may be a user input touching the selected sub-menu above. In addition, the command refers to a command for instructing a specific application or a program operation in a mobile terminal, and for example, a'call' application execution command and a'text' application execution command.

Meanwhile, the selected main menu corresponding to the touch position of the first pointer and the selected sub-menu corresponding to the touch position of the second pointer may be visually identified and displayed.

22 and 23, a mobile terminal according to an embodiment of the present invention may provide a simple and intuitive user input method considering characteristics of a mobile terminal having a small touch screen size.

It will be apparent to those skilled in the art that the present invention may be embodied in other specific forms without departing from the spirit and essential features of the present invention.

The above-described present invention can be embodied as computer readable codes on a medium on which a program is recorded. The computer-readable medium includes all types of recording devices in which data readable by a computer system is stored. Examples of computer-readable media include ROM, RAM, CD-ROM, magnetic tapes, floppy disks, optical data storage devices, etc., which are also implemented in the form of carrier waves (eg, transmission over the Internet). Also includes. In addition, the computer may include a control unit 430 of the mobile terminal.

Accordingly, the above detailed description should not be construed as limiting in all respects, but should be considered illustrative. The scope of the invention should be determined by rational interpretation of the appended claims, and all changes within the equivalent scope of the invention are included in the scope of the invention.

410: touch screen 420: touch input
430: control unit 440: storage unit
450: communication unit 460: power supply unit

Claims (21)

touch screen;
A touch input unit formed in a bezel area surrounding the touch screen to receive a user's touch input; And
When the touch input of the first pointer and the second pointer is received on the touch input unit, control is performed so that at least one main menu is displayed around the touch point of the first pointer,
And a control unit controlling to display at least one sub-menu subordinate to the main menu around the touch point of the second pointer. According to claim 1, The control unit,
When a user input for changing the touch position of the first pointer is received through the touch input unit, at least one sub-menu subordinate to the main menu corresponding to the changed touch position is displayed around the touch point of the second pointer. A mobile terminal controlled as much as possible. According to claim 1, The control unit,
When a user input for sliding the second pointer to the inside of the touch screen is received from the touch input unit, the mobile terminal executes a command corresponding to the selected sub-menu. According to claim 1, The control unit,
When the main menu selected by the first pointer is a character input menu, control to display at least one sub-menu indicating a character to be input around the touch point of the second pointer,
When a user input for executing a sub-menu selected by the second pointer is received, the mobile terminal is controlled to input characters indicated by the selected sub-menu. According to claim 4,
The user input includes an input for sliding the second pointer from the touch input unit to the inside of the touch screen,
When the sub-menu selected by the second pointer indicates a plurality of characters,
The control unit,
Based on the direction of movement of the slide of the second pointer, the mobile terminal controls one of the plurality of characters to be input. The method of claim 4, wherein the control unit,
When the main menu selected by the first pointer is changed to a character completion menu, displaying at least one sub-menu indicating text that can be completed including characters previously input around the touch point of the second pointer, Mobile terminal. The method of claim 6, wherein the control unit,
Controlled to display at least one additional sub-menu dependent on the sub-menu selected by the second pointer through the touch screen,
The at least one additional sub menu indicates a sentence that can be completed including text indicated by the selected sub menu. The method of claim 4, wherein the control unit,
If the sub-menu selected by the second pointer is a time menu, control to display a clock UI through the touch screen,
When a user input for manipulating the clock UI is received by the second pointer, the mobile terminal is controlled to input time data indicated by the manipulated clock UI into text. According to claim 1, The control unit,
When the main menu selected by the first pointer is a text menu, control to display at least one sub-menu indicating text,
When a user input for rolling a sub-menu is received on the touch input unit, and a user input for double-touch is received, the mobile terminal is controlled to input characters indicated by a sub-menu corresponding to a preset position of the touch screen. The method of claim 4, wherein the control unit,
When a user input for double-clicking a character displayed on the touch screen is received or a user input for sliding a character displayed on the touch screen from the touch screen to the touch input unit is received, control to delete the character displayed on the touch screen is controlled. , Mobile terminal. delete delete delete delete delete delete delete delete delete delete delete

Images