KR101949734B1 - Mobile terminal and method for controlling thereof - Google Patents

Abstract

The method includes displaying a plurality of objects on a touch screen, selecting the first object through a first pen touch operation on the first object among the plurality of objects, Selecting the second object through a second pen touch operation on the second object, and performing a control operation on the selected objects through a third pen touch operation on any one of the selected objects And a mobile terminal.

Description

[0001] MOBILE TERMINAL AND METHOD FOR CONTROLLING THEREOF [0002]

The present invention relates to a mobile terminal and a control method thereof, in which usage of a terminal can be realized by further considering convenience of a user.

The terminal can move And may be divided into a mobile / portable terminal and a stationary terminal depending on whether the mobile terminal is a mobile terminal or a mobile terminal. The mobile terminal can be divided into a handheld terminal and a vehicle mount terminal according to whether the user can directly carry the mobile terminal.

Such a terminal has various functions, for example, in the form of a multimedia device having multiple functions such as photographing and photographing of a moving picture, reproduction of a music or video file, reception of a game and broadcasting, etc. .

In order to support and enhance the functionality of such terminals, it may be considered to improve the structural and / or software parts of the terminal.

2. Description of the Related Art [0002] Recently, a technique for receiving a touch operation of a user through a touch screen as an input command and performing a corresponding control operation has been developed. For example, icons and images that can be displayed on the touch screen have been directly selected to execute the selected objects.

However, according to the development of technology, there is a growing need to perform a variety of touch operations and corresponding control operations finely. In such a background, a fine touch operation capable of selecting a fine area of a touch screen and a control operation using a fine touch operation There is a need for

The present invention provides a mobile terminal capable of selecting objects to be displayed on a touch screen by using a fine touch operation that can select a fine region unlike an existing touch operation and controlling objects by fine touch operation with respect to selected objects, And a method for controlling the mobile terminal.

In addition, the present invention provides a mobile terminal and a mobile terminal control method capable of distinguishing a fine touch operation from a general touch operation and performing a corresponding control operation.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory and are not restrictive of the invention, unless further departing from the spirit and scope of the invention as defined by the appended claims. It will be possible.

According to an aspect of the present invention, there is provided a method for controlling a mobile terminal, the method including displaying a plurality of objects on a touch screen, performing a first pen touch operation on a first object among the plurality of objects, Selecting the first object, selecting the second object through a second pen touch operation on a second one of the plurality of objects, and selecting a third pen touch And performing a control operation on the selected objects through an operation.

The mobile terminal control method further comprises displaying a selection indicator indicator indicating that the object is selected for each of the selected objects.

In addition, the method further includes selecting the third object through an additional pen touch operation on the third object among the plurality of objects.

When there is a control operation associated with each of the plurality of objects, a specific area of each of the plurality of objects is matched with the control operation. In the performing of the control operation, when the specific area of one of the selected objects is touched through the third pen touch operation, a control operation matched with the specific area is performed.

Optionally, the mobile terminal control method further comprises decreasing a display size of the objects displayed on the touch screen and increasing the number of the objects when the pen touch operation is recognized.

The mobile terminal control method further includes reducing a size of a text displayed on the touch screen when the pen touch operation is recognized.

In addition, the mobile terminal control method may further include generating the selected objects as a folder object, and displaying the folder object, wherein the folder object includes sub objects corresponding to the selected objects, Sub-objects are displayed to be included in the displayed folder object.

The mobile terminal control method includes performing an object corresponding to the selected sub object when the sub object included in the folder object is selected through the pen touch operation.

According to another aspect of the present invention, there is provided a mobile terminal including a touch screen for displaying a plurality of objects and receiving a pen touch operation for a specific object among the plurality of objects, Touch operation for the first object among the plurality of objects is received, and when receiving the second pen touch operation for the second object among the plurality of objects, And a controller for performing a control operation on the selected objects when the third pen touch operation for any one of the selected objects is received.

The touch screen displays a selection indicator indicator indicating that the selected object is the selected object for each of the selected objects.

When the touch screen receives an additional pen touch operation for a third one of the plurality of objects, the control unit selects the third object.

The control unit controls the specific operation of each of the plurality of objects to match the control operation when there is a control operation related to each of the plurality of objects. The control unit performs a control operation matched with the specific area when the specific area of one of the selected objects is touched through the third pen touch operation.

When the pen touch operation is recognized, the control unit controls the touch screen to reduce the display size of the displayed objects and increase the number of the objects.

The control unit controls the touch screen to reduce the size of displayed text when the pen touch operation is recognized.

Wherein the control unit controls the touch screen to display the selected objects as a folder object and display the folder object, wherein the folder object includes sub objects corresponding to the selected objects, Is displayed to be included in the displayed folder object.

The control unit performs a control operation on an object corresponding to the selected subobject when the subobject included in the folder object is selected through the pen touch operation.

According to at least one embodiment of the present invention configured as described above, since the mobile terminal can recognize the fine touch operation that can touch the fine point of the touch screen, it is possible to distinguish and control the fine touch operation and the general touch operation There is an effect.

Also, the mobile terminal according to at least one embodiment of the present invention configured as described above has the effect of selecting a plurality of icons through the fine touch operation.

The effects obtained by the present invention are not limited to the above-mentioned effects, and other effects not mentioned can be clearly understood by those skilled in the art from the following description will be.

1 is a block diagram of a mobile terminal according to an embodiment of the present invention.
2A is a front perspective view of a mobile terminal according to an embodiment of the present invention;
FIG. 2B is a rear perspective view of a mobile terminal according to an embodiment of the present invention; FIG.
FIGS. 3A and 3B are front views of a mobile terminal for explaining one operation state of the mobile terminal according to the present invention; FIG.
4A and 4B are conceptual diagrams for explaining a detailed touch operation in connection with the present invention.
5 is a flowchart showing a flow of a mobile terminal control method according to the present invention.
6A and 6B are diagrams illustrating a multiple selection operation by fine touch operation in connection with the present invention.
7A and 7B are diagrams illustrating an icon control operation according to the fine-touch operation according to the present invention.
8 is another diagram showing an icon control operation according to the fine-touch operation according to the present invention.
9A and 9B are diagrams showing a scroll control operation according to the fine touch operation in connection with the present invention.
10 is a diagram illustrating a text selection operation according to the fine-touch operation according to the present invention.
11A to 11E are diagrams showing a mode changing operation according to recognition of a fine touch in connection with the present invention.
12 is a diagram showing a direct execution operation of an in-directory icon according to the detailed touch operation in connection with the present invention;

Hereinafter, a mobile terminal related to the present invention will be described in detail with reference to the drawings. The suffix "module" and " part "for the components used in the following description are given or mixed in consideration of ease of specification, and do not have their own meaning or role.

The mobile terminal described in this specification may include a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, a PDA (Personal Digital Assistants), a PMP (Portable Multimedia Player), navigation and the like. However, it will be understood by those skilled in the art that the configuration according to the embodiments described herein may be applied to a fixed terminal such as a digital TV, a desktop computer, and the like, unless the configuration is applicable only to a mobile terminal.

1 is a block diagram of a mobile terminal according to an embodiment of the present invention.

The mobile terminal 100 includes a wireless communication unit 110, an audio / video input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, a memory 160, A controller 170, a controller 180, a power supply 190, and the like. The components shown in FIG. 1 are not essential, and a mobile terminal having more or fewer components may be implemented.

Hereinafter, the components will be described in order.

The wireless communication unit 110 may include one or more modules for enabling wireless communication between the mobile terminal 100 and the wireless communication system or between the mobile terminal 100 and the network in which the mobile terminal 100 is located. For example, the wireless communication unit 110 may include a broadcast receiving module 111, a mobile communication module 112, a wireless Internet module 113, a short range communication module 114, and a location information module 115 .

The broadcast receiving module 111 receives broadcast signals and / or broadcast-related information from an external broadcast management server through a broadcast channel. The broadcast channel may include a satellite channel and a terrestrial channel. Two or more broadcast receiving modules 1100 may be provided to the mobile terminal 100 for simultaneous broadcast reception or broadcast channel switching for at least two broadcast channels.

The broadcast management server may refer to a server for generating and transmitting broadcast signals and / or broadcast related information, or a server for receiving broadcast signals and / or broadcast related information generated by the broadcast management server and transmitting the generated broadcast signals and / or broadcast related information. The broadcast signal may include a TV broadcast signal, a radio broadcast signal, a data broadcast signal, and a broadcast signal in which a data broadcast signal is combined with a TV broadcast signal or a radio broadcast signal.

The broadcast-related information means information related to a broadcast channel, a broadcast program, or a broadcast service provider. The broadcast-related information may also be provided through a mobile communication network. In this case, it may be received by the mobile communication module 112.

The broadcast-related information may exist in various forms. For example, an EPG (Electronic Program Guide) of DMB (Digital Multimedia Broadcasting) or an ESG (Electronic Service Guide) of Digital Video Broadcast-Handheld (DVB-H).

For example, the broadcast receiving module 111 may be a Digital Multimedia Broadcasting-Terrestrial (DMB-T), a Digital Multimedia Broadcasting-Satellite (DMB-S), a Media Forward Link Only (Mobile Broadcasting Business Management System), ISDB-T (Integrated Services Digital Broadcasting (ISDB-T)), Digital Multimedia Broadcasting (MBMS) Digital Broadcast-Terrestrial) or the like. Of course, the broadcast receiving module 111 may be adapted to other broadcasting systems as well as the digital broadcasting system described above.

The broadcast signal and / or broadcast related information received through the broadcast receiving module 111 may be stored in the memory 160.

The mobile communication module 112 may be coupled to a base station, an external terminal, or a server on a mobile communication network, such as, but not limited to, Gobal System for Mobile communications (GSM), Code Division Multiple Access (CDMA), Wideband CDMA Transmits and receives wireless signals with one. The wireless signal may include various types of data depending on a voice call signal, a video call signal or a text / multimedia message transmission / reception.

The wireless Internet module 113 is a module for wireless Internet access, and may be built in or externally attached to the mobile terminal 100. Wireless Internet technologies include WLAN (Wi-Fi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access), GSM, CDMA, WCDMA, LTE Evolution (but not limited to) may be used.

The wireless Internet module 113, which performs wireless Internet access through the mobile communication network, is connected to the mobile communication module 110 through the mobile communication network, for example, from the viewpoint that the wireless Internet access by Wibro, HSDPA, GSM, CDMA, WCDMA, LTE, (112). ≪ / RTI >

The short-range communication module 114 refers to a module for short-range communication. Bluetooth, Radio Frequency Identification (RFID), infrared data association (IrDA), Ultra Wideband (UWB), ZigBee, and the like can be used as a short range communication technology.

The position information module 115 is a module for obtaining the position of the mobile terminal, and a representative example thereof is a Global Position System (GPS) module. According to the current technology, the GPS module 115 calculates distance information and accurate time information from three or more satellites, and then applies trigonometry to the calculated information to obtain a three-dimensional string of latitude, longitude, The location information can be accurately calculated. At present, a method of calculating position and time information using three satellites and correcting an error of the calculated position and time information using another satellite is widely used. In addition, the GPS module 115 can calculate speed information by continuously calculating the current position in real time.

Referring to FIG. 1, an A / V (Audio / Video) input unit 120 is for inputting an audio signal or a video signal, and may include a camera 121 and a microphone 122. The camera 121 processes image frames such as still images or moving images obtained by the image sensor in the video communication mode or the photographing mode. The processed image frame can be displayed on the display unit 151. [

The image frame processed by the camera 121 may be stored in the memory 160 or transmitted to the outside through the wireless communication unit 110. [ Two or more cameras 121 may be provided depending on the use environment.

The microphone 122 receives an external sound signal through a microphone in a communication mode, a recording mode, a voice recognition mode, or the like, and processes it as electrical voice data. The processed voice data can be converted into a form that can be transmitted to the mobile communication base station through the mobile communication module 112 when the voice data is in the call mode, and output. Various noise reduction algorithms may be implemented in the microphone 122 to remove noise generated in receiving an external sound signal.

The user input unit 130 generates input data for a user to control the operation of the terminal. The user input unit 130 may include a key pad, a dome switch, a touch pad (static / static), a jog wheel, a jog switch, and the like.

The sensing unit 140 senses the current state of the mobile terminal 100 such as the open / close state of the mobile terminal 100, the position of the mobile terminal 100, the presence or absence of user contact, the orientation of the mobile terminal, And generates a sensing signal for controlling the operation of the mobile terminal 100. For example, when the mobile terminal 100 is in the form of a slide phone, it is possible to sense whether the slide phone is opened or closed. It is also possible to sense whether the power supply unit 190 is powered on, whether the interface unit 170 is connected to an external device, and the like. Meanwhile, the sensing unit 140 may include a proximity sensor 141.

The output unit 150 is for generating output related to the visual, auditory or tactile sense and includes a display unit 151, an audio output module 152, an alarm unit 153, and a haptic module 154 .

The display unit 151 displays (outputs) information processed by the mobile terminal 100. For example, when the mobile terminal is in the call mode, a UI (User Interface) or a GUI (Graphic User Interface) associated with a call is displayed. When the mobile terminal 100 is in the video communication mode or the photographing mode, the photographed and / or received video or UI and GUI are displayed.

The display unit 151 may be a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), a flexible display display, and a 3D display.

Some of these displays may be transparent or light transmissive so that they can be seen through. This can be referred to as a transparent display, and a typical example of the transparent display is TOLED (Transparent OLED) and the like. The rear structure of the display unit 151 may also be of a light transmission type. With this structure, the user can see an object located behind the terminal body through the area occupied by the display unit 151 of the terminal body.

There may be two or more display units 151 according to the embodiment of the mobile terminal 100. For example, in the mobile terminal 100, a plurality of display portions may be spaced apart from one another or may be disposed integrally with each other, or may be disposed on different surfaces.

(Hereinafter, referred to as a 'touch screen') in which a display unit 151 and a sensor for sensing a touch operation (hereinafter, referred to as 'touch sensor') form a mutual layer structure, It can also be used as an input device. The touch sensor may have the form of, for example, a touch film, a touch sheet, a touch pad, or the like.

The touch sensor may be configured to convert a change in a pressure applied to a specific portion of the display unit 151 or a capacitance generated in a specific portion of the display unit 151 into an electrical input signal. The touch sensor can be configured to detect not only the position and area to be touched but also the pressure at the time of touch.

If there is a touch input to the touch sensor, the corresponding signal (s) is sent to the touch controller (not shown). The touch controller processes the signal (s) and transmits the corresponding data to the controller 180. Thus, the control unit 180 can know which area of the display unit 151 is touched or the like.

The proximity sensor 141 may be disposed in an inner region of the mobile terminal or in the vicinity of the touch screen, which is enclosed by the touch screen. The proximity sensor refers to a sensor that detects the presence or absence of an object approaching a predetermined detection surface or a nearby object without mechanical contact using the force of an electromagnetic field or infrared rays. The proximity sensor has a longer life span than the contact sensor and its utilization is also high.

Examples of the proximity sensor include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, and an infrared proximity sensor. And to detect the proximity of the pointer by the change of the electric field along the proximity of the pointer when the touch screen is electrostatic. In this case, the touch screen (touch sensor) may be classified as a proximity sensor.

Hereinafter, for convenience of explanation, the act of recognizing that the pointer is positioned on the touch screen while the pointer is not in contact with the touch screen is referred to as "proximity touch" The act of actually contacting the pointer on the touch screen may be referred to as "contact touch. &Quot; The location where the pointer is proximately touched on the touch screen may refer to a position where the pointer corresponds vertically to the touch screen when the pointer is touched.

The proximity sensor detects a proximity touch and a proximity touch pattern (e.g., a proximity touch distance, a proximity touch direction, a proximity touch speed, a proximity touch time, a proximity touch position, a proximity touch movement state, and the like). Information corresponding to the detected proximity touch operation and the proximity touch pattern may be output on the touch screen.

The audio output module 152 may output audio data received from the wireless communication unit 110 or stored in the memory 160 in a call signal reception mode, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, The sound output module 152 also outputs sound signals related to functions (e.g., call signal reception sound, message reception sound, etc.) performed in the mobile terminal 100. [ The audio output module 152 may include a receiver, a speaker, a buzzer, and the like.

The alarm unit 153 outputs a signal for notifying the occurrence of an event of the mobile terminal 100. Examples of events that occur in the mobile terminal include call signal reception, message reception, key signal input, touch input, and the like. The alarm unit 153 may output a signal for notifying the occurrence of an event in a form other than the video signal or the audio signal, for example, vibration. In this case, the display unit 151 and the sound / voice output module 152 may be a kind of the alarm unit 153. The display unit 151 and the sound / . ≪ / RTI >

The haptic module 154 generates various tactile effects that the user can feel. A typical example of the haptic effect generated by the haptic module 154 is vibration. The intensity and pattern of the vibration generated by the hit module 154 can be controlled. For example, different vibrations may be synthesized and output or sequentially output.

In addition to the vibration, the haptic module 154 may include a pin arrangement vertically moving with respect to the contact skin surface, a spraying force or a suction force of the air through the injection port or the suction port, a touch on the skin surface, contact with an electrode, And various tactile effects such as an effect of reproducing a cold sensation using an endothermic or exothermic element can be generated.

The haptic module 154 can be implemented not only to transmit the tactile effect through the direct contact but also to allow the user to feel the tactile effect through the muscular sensation of the finger or arm. At least two haptic modules 154 may be provided according to the configuration of the mobile terminal 100.

The memory unit 160 may store a program for processing and controlling the control unit 180 and temporarily store the input / output data (e.g., telephone directory, message, audio, For example. The memory unit 160 may store the frequency of use of each of the data (for example, each telephone number, each message, and frequency of use for each multimedia).

In addition, the memory unit 160 may store data on vibration and sound of various patterns output when the touch is input on the touch screen.

The memory 160 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory), a RAM (Random Access Memory), SRAM (Static Random Access Memory), ROM (Read Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM A disk, and / or an optical disk. The mobile terminal 100 may operate in association with a web storage that performs a storage function of the memory 160 on the Internet.

The interface unit 170 serves as a path for communication with all external devices connected to the mobile terminal 100. The interface unit 170 receives data from an external device or supplies power to each component in the mobile terminal 100 or transmits data to the external device. For example, a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, a port for connecting a device having an identification module, an audio I / O port, A video input / output (I / O) port, an earphone port, and the like may be included in the interface unit 170.

The identification module is a chip for storing various information for authenticating the use right of the mobile terminal 100 and includes a user identification module (UIM), a subscriber identity module (SIM), a general user authentication module A Universal Subscriber Identity Module (USIM), and the like. Devices with identification modules (hereinafter referred to as "identification devices") can be manufactured in a smart card format. Accordingly, the identification device can be connected to the terminal 100 through the port.

When the mobile terminal 100 is connected to an external cradle, the interface unit may be a path through which power from the cradle is supplied to the mobile terminal 100, or various command signals input by the user to the cradle may be transmitted It can be a passage to be transmitted to the terminal. The various command signals or the power source input from the cradle may be operated as a signal for recognizing that the mobile terminal is correctly mounted on the cradle.

The controller 180 typically controls the overall operation of the mobile terminal. For example, voice communication, data communication, video communication, and the like. The control unit 180 may include a multimedia module 181 for multimedia playback. The multimedia module 181 may be implemented in the control unit 180 or may be implemented separately from the control unit 180. [

The controller 180 may perform a pattern recognition process for recognizing handwriting input or drawing input performed on the touch screen as characters and images, respectively.

The power supply unit 190 receives external power and internal power under the control of the controller 180 and supplies power necessary for operation of the respective components.

The various embodiments described herein may be embodied in a recording medium readable by a computer or similar device using, for example, software, hardware, or a combination thereof.

According to a hardware implementation, the embodiments described herein may be implemented as application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays May be implemented using at least one of a processor, controllers, micro-controllers, microprocessors, and other electronic units for performing other functions. In some cases, The embodiments described may be implemented by the control unit 180 itself.

According to a software implementation, embodiments such as the procedures and functions described herein may be implemented with separate software modules. Each of the software modules may perform one or more of the functions and operations described herein. Software code can be implemented in a software application written in a suitable programming language. The software code is stored in the memory 160 and can be executed by the control unit 180. [

2A is a perspective view of an example of a mobile terminal or a mobile terminal according to the present invention.

The disclosed mobile terminal 100 includes a bar-shaped terminal body. However, the present invention is not limited thereto, and can be applied to various structures such as a slide type, a folder type, a swing type, and a swivel type in which two or more bodies are relatively movably coupled.

The body includes a case (a casing, a housing, a cover, and the like) which forms an appearance. In this embodiment, the case may be divided into a front case 101 and a rear case 102. [ A variety of electronic components are embedded in the space formed between the front case 101 and the rear case 102. At least one intermediate case may be additionally disposed between the front case 101 and the rear case 102. [

The cases may be formed by injection molding a synthetic resin, or may be formed to have a metal material such as stainless steel (STS) or titanium (Ti) or the like.

The display unit 151, the sound output unit 152, the camera 121, the user input units 130/131 and 132, the microphone 122, the interface 170, and the like may be disposed in the front body 101 have.

The display unit 151 occupies most of the main surface of the front case 101. A sound output unit 151 and a camera 121 are disposed in an area adjacent to one end of both ends of the display unit 151 and a user input unit 131 and a microphone 122 are disposed in an area adjacent to the other end. The user input unit 132 and the interface 170 may be disposed on the side surfaces of the front case 101 and the rear case 102. [

The user input unit 130 is operated to receive a command for controlling the operation of the mobile terminal 100 and may include a plurality of operation units 131 and 132. The operation units 131 and 132 may be collectively referred to as a manipulating portion.

The contents inputted by the first or second operation unit 131 or 132 may be variously set. For example, the first operation unit 131 receives commands such as start, end, scroll, and the like, and the second operation unit 132 controls the size of the sound output from the sound output unit 152 or the size of the sound output from the display unit 151 The touch recognition mode can be activated or deactivated.

2B is a rear perspective view of the mobile terminal shown in FIG. 2A.

Referring to FIG. 2B, a camera 121 'may be further mounted on the rear surface of the terminal body, that is, the rear case 102. The camera 121 'may have a photographing direction substantially opposite to that of the camera 121 (see FIG. 2A), and may be a camera having the same or different pixels as the camera 121.

For example, the camera 121 may have a low pixel so that the face of the user can be photographed and transmitted to the other party in case of a video call or the like, and the camera 121 ' It is preferable to have a large number of pixels. The cameras 121 and 121 'may be installed in the terminal body so as to be rotatable or pop-upable.

A flash 123 and a mirror 124 may be additionally disposed adjacent to the camera 121 '. The flash 123 illuminates the subject when the subject is photographed by the camera 121 '. The mirror 124 allows the user to illuminate the user's own face or the like when the user intends to shoot himself / herself (self-photographing) using the camera 121 '.

An acoustic output 152 'may be additionally disposed on the rear surface of the terminal body. The sound output unit 152 'may implement the stereo function together with the sound output unit 152 (see FIG. 2A), and may be used for the implementation of the speakerphone mode during a call.

In addition to the antenna for communication, a broadcast signal receiving antenna 116 may be additionally disposed on the side of the terminal body. The antenna 116, which forms part of the broadcast receiving module 111 (see FIG. 1), can be installed to be able to be drawn out from the terminal body.

A power supply unit 190 for supplying power to the mobile terminal 100 is mounted on the terminal body. The power supply unit 190 may be built in the terminal body or may be detachable from the outside of the terminal body.

The rear case 102 may further include a touch pad 135 for sensing a touch. The touch pad 135 may be of a light transmission type for the display unit 151. [ In this case, if the display unit 151 is configured to output the time information on both sides (i.e., in the directions of both the front and back sides of the mobile terminal), the time information can be recognized through the touch pad 135 do. The information output on both sides may be all controlled by the touch pad 135. [

Meanwhile, the display for exclusive use of the touch pad 135 may be separately installed, so that the touch screen may be disposed in the rear case 102 as well.

The touch pad 135 operates in correlation with the display portion 151 of the front case 101. The touch pad 135 may be disposed parallel to the rear of the display unit 151. The touch pad 135 may have a size equal to or smaller than that of the display unit 151.

Hereinafter, embodiments related to a control method that can be implemented in the mobile terminal configured as above will be described with reference to the accompanying drawings.

Hereinafter, a related operation of the display unit 151 and the touch pad 135 will be described with reference to FIGS. 3A and 3B.

3A and 3B are front views of a portable terminal for explaining an operation state of the portable terminal according to the present invention.

Various types of time information can be displayed on the display unit 151. [ These pieces of information can be displayed in the form of letters, numbers, symbols, graphics, or icons.

At least one of the letters, numbers, symbols, graphics, or icons may be displayed in a predetermined arrangement for inputting such information, thereby being implemented as a keypad. Such a keypad may be referred to as a so-called " virtual keypad ".

3A illustrates inputting a touch applied to a virtual keypad through a front surface of a terminal body.

The display unit 151 may operate as an entire area or may be divided into a plurality of areas and operated. In the latter case, the plurality of areas can be configured to operate in association with each other.

For example, an output window 151a and an input window 151b are displayed on the upper and lower portions of the display unit 151, respectively. The output window 151a and the input window 151b are areas allocated for outputting or inputting information, respectively. In the input window 151b, a virtual keypad 151c is displayed in which a number for inputting a telephone number or the like is displayed. When the virtual keypad 151c is touched, numbers and the like corresponding to the touched virtual keypad are displayed on the output window 151a. When the first operation unit 131 is operated, call connection to the telephone number displayed on the output window 151a is attempted.

3B shows a touch input to the virtual keypad through the rear surface of the terminal body. FIG. 3A shows a case where the terminal body is vertically arranged, and FIG. 3B shows a case where the terminal body is arranged horizontally. The display unit 151 may be configured to convert the output screen according to the arrangement direction of the terminal body.

3B shows that the text input mode is activated in the portable terminal. The display unit 151 displays an output window 151a 'and an input window 151b'. The input window 151b 'may have a plurality of virtual keypads 151c' displayed with at least one of characters, symbols, and numbers. The virtual keypads 151c 'may be arranged in the form of a QWERTY key.

When the virtual keypads 151c 'are touched through the touch pad 135 (see FIG. 2B), characters, numbers, symbols corresponding to the touched virtual keypad are displayed on the output window 151a'. As described above, the touch input through the touch pad 135 is advantageous in that the virtual keypad 151c 'can be prevented from being covered by the finger when the user touches the touch input through the display unit 151. [ In the case where the display unit 151 and the touch pad 135 are formed to be transparent, the fingers located on the rear side of the terminal body can be visually confirmed, thereby enabling a more accurate touch input.

The display unit 151 or the touch pad 135 may be configured to receive a touch input by scrolling, as well as the input method described in the above embodiments. The user can move a cursor or a pointer located on an object displayed on the display unit 151, for example, an icon or the like, by scrolling the display unit 151 or the touch pad 135. [ Further, when the finger is moved on the display portion 151 or the touch pad 135, the path along which the finger moves may be visually displayed on the display portion 151. [ This will be useful for editing the image displayed on the display unit 151. [

One function of the terminal may be executed in response to a case where the display unit 151 (touch screen) and the touch pad 135 are touched together within a predetermined time range. In the case of being touched together, there may be a case where the user clamps the terminal body using the thumb and index finger. The one function may be activation or deactivation of the display unit 151 or the touch pad 135, for example.

For convenience of explanation, it is assumed that the mobile terminal referred to below includes at least one of the components shown in FIG.

4A and 4B are conceptual diagrams for explaining the detailed touch operation in connection with the present invention.

4A is a diagram for explaining a conventional general touch operation.

The general touch operation is an operation of touching the touch screen 151 with a finger. BACKGROUND OF THE INVENTION [0002] A mobile terminal such as a recent smart phone basically includes a touch screen having a large display screen and a touch panel. The display screen may display various objects, such as icons, images, text, and the like. In addition, since the touch panel 151 is provided, the user can directly touch the touch screen 151 by touching the displayed object.

Referring to FIG. 4A, a user selects a specific icon 401 among the icons 401 and 402 displayed on the touch screen 151 by hand. The touch area of the hand and the touch screen 151 is physically larger than a specific area. In FIG. 4 (b), when touching through the hand 410, the touch contact surface 420 is displayed. Accordingly, the control unit 180 recognizes the area and position touched by the hand, judges the object to be selected by the user stochastically or empirically, and accordingly recognizes that the specific icon 401 is selected in the drawing.

4B is a view for explaining the detailed touch operation related to the present invention.

The term "fine touch" used in the present invention refers to a touch operation in which a fine area of the touch screen 151 can be touched as compared with a conventional general touch operation. In the case of the general touch operation described with reference to FIG. 4A, the fine touch operation can not be performed due to the physical size of the finger, whereas the fine touch operation has an advantage of touching the fine area of the touch screen 151.

The fine touch operation may be received when the touch screen 151 is touched through an object having a porous surface such as a pen or a nail because the fine touch on the touch screen 151 is touched. Although an example of a pen or a fingernail is taken as an example, this example is merely an example, and an object capable of performing a fine-touch operation is not limited to the objects. In the following drawings, a detailed touch operation through a pen is shown for convenience of explanation, and a detailed touch operation through the pen is hereinafter referred to as a pen touch operation for the sake of convenience.

4B, the user selects the specific icon 401 among the icons 401 and 402 displayed on the touch screen 151 through the pen 430. In FIG. 4B, The touch point 440 touched by the fine touch operation by the touch point 440 is displayed. Compared with the general touch operation in FIG. 4A, the fine touch operation in FIG. 4B is very fine in the touch area, and thus can perform a precise touch operation.

The controller 180 distinguishes between the case where the touch operation received through the touch screen 151 is a general touch operation and the case where the touch operation is a fine touch operation and performs a corresponding control operation. For example, when the icon is touched with the general touch operation, the application related to the icon can be executed. However, when the icon is touched with the fine touch operation, the icon may be simply selected.

5 is a flowchart showing a flow of a mobile terminal control method according to the present invention.

First, the touch screen 151 displays a plurality of objects (S510). The touch screen 151 receives the detailed touch operation on the first object among the plurality of objects, and the controller 180 selects the first object in operation S520. The touch screen 151 receives the detailed touch operation on the second object among the plurality of objects, and the controller 180 selects the second object in operation S530. The control unit 180 receives a control operation for the selected objects when the detailed touch operation on any one of the selected first and second objects is received.

Here, the objects refer to all objects that can be displayed on the touch screen 151, such as, for example, icons, background images, text, and the like.

6A and 6B are diagrams illustrating a multiple selection operation by the fine touch operation in connection with the present invention.

The touch screen 151 of the mobile terminal 100 of the present invention can receive a fine touch operation such as a pen as well as a general touch operation. That is, the control unit 180 may perform a general control operation corresponding to a general touch operation such as a hand touch, and perform a control operation different from a general touch operation in the case of a fine touch operation such as a pen touch .

Referring to FIG. 6A, the operation of selecting a plurality of icons displayed on the touch screen 151 by fine touch operation is shown.

6A, an operation of touching a specific first icon 607 among a plurality of icons 601 to 614 through a fine touch operation through the pen 430 is shown. The control unit 180 recognizes that the icon is selected when recognizing the detailed touch operation of touching the specific first icon 607. [ Compared with the general touch operation, an application related to the icon can be performed when the icon is touched through the general touch operation. However, when the user touches the icon through the fine touch operation, the icon can be selected.

In (b) of FIG. 6A, the specific first icon 607 may be displayed on the specific first icon 607 indicating "V" indicating that the selected state is selected. In addition, when the specific second icon 605 is touched through the detailed touch operation through the pen 430, the control unit 180 can set it to select the specific second icon 609 that is touched.

6 (c), a specific first icon 607 and a "V" indicating that the specific second icon 605 has been selected can be displayed for each icon.

Here, when the user selects other icons by an additional fine-touch operation, icons can be selected in the same manner as the above-described process.

6 (d) shows an example of a control scheme for the selected icons. Specifically, the controller 180 can recognize the selected icons 605 and 607 as commands to be generated as a group folder icon. That is, when specific icons are touched and selected by the detailed touch operation, the selected icons can be grouped into one folder and a folder icon associated with the folder can be generated. In the drawing, a folder icon 620 including selected icons 605 and 607 is created and displayed.

Meanwhile, other control operations may be performed on the selected icons. The control operation corresponding to the control menu can be performed when the control menu to be performed according to the additional touch operation is selected for the selected icons. For example, when a control menu for deleting corresponding icons is selected, all of the icons may be deleted, or a control operation may be performed to simultaneously execute an application or a program related to icons selected when the execution menu is selected. This control operation may also be performed by fine touch operation.

Alternatively, if multiple selected icons are displayed as OSD (On Screen Display) grouping, and the touch is terminated after moving to another home screen screen while still being touched with the pen, a folder icon is created .

Referring to FIG. 6B, an operation of selecting a plurality of counterpart information displayed on the touch screen 151 by fine touch operation is shown.

On the touch screen 151, various objects can be displayed, and not only icons but also other images can be displayed. For example, when executing a phone number application or a call application, a plurality of counterpart images indicating a counterparty to be connected may be displayed.

6 (a), a plurality of counterpart images 631 to 638 can be displayed on the touch screen 151 in the telephone directory. Each counterpart image represents information of counterparty. In some cases, the counterpart image can be set to be connected to the counterpart by touching the counterpart image.

Here, the operation of touching the first specific counterpart 632 among the various counterpart images 631 to 638 by the fine touch operation through the pen 430 is shown, and in this case, It can be recognized that the first specific counterpart 632 is selected.

6B, a detailed touch operation is shown in which the selected first specific counterpart 632 is selected and the other second specific counterpart 634 is touched. The control unit 180 recognizes that the second specific counterpart 634 is also selected by the detailed touch operation and the first specific counterpart 632 and the second specific counterpart 634 thus selected are selected . ≪ / RTI >

In Figure 6b (d), the operation of performing a group chat operation using the selected particular parties 632 and 634 is shown. That is, when specific parties are selected by the fine-touch operation, the controller 180 can recognize the specific parties as commands to perform a group chat.

However, FIG. 6 (d) is an example of using the selected specific parties, and as another example, other control operations such as sending a whole message to a selected selected party, making a full call, or sending an entire email can also be performed. Also, here, this control operation may be performed through a fine touch operation as well.

7A and 7B are diagrams illustrating an icon control operation according to the fine-touch operation according to the present invention.

The mobile terminal 100 according to the present invention can touch the fine area of the touch screen 151 and thus the mobile terminal 100 or the application It can perform related hidden functions or preset functions.

In touching a specific point of the icon with the fine touch operation, FIG. 7A shows performing a function specific to each icon, and FIG. 7B shows that a general function is performed irrespective of the type of the icon.

Referring to FIG. 7A, an operation for performing a control operation related to an icon by selecting a specific point of the icon is shown.

In Figure 7a, a particular function associated with a particular icon is set to be associated with a specific fine point of the icon. Here, when each specific fine point is touched or selected by a fine touch operation, a specific function specific to a specific icon can be performed.

In (a) of FIG. 7A, a triangular mark is shown at the corner of each icon. Specifically, when there is a function specific to each icon for each icon, the triangular display matches the function specific to each icon. The first icon 710 associated with the wife is displayed such that a plurality of function display indicators 710a through 710d are positioned at corner portions of the first icon and a detailed function display indicator 710d ) Is selected, a specific function related to the function display indicator 710d is executed.

In FIG. 7A, when the specific function display indicator 710d is selected, the names 710e to 710h of the functions indicated by the respective function display indicators 710a to 710d can be displayed. Here, the selected specific function display indicator 710d is related to the message function. Accordingly, the control unit 180 selects the function display indicator 710d indicating the message by the fine touch operation, and thus can perform a function of sending a message to the wife.

In FIG. 7 (c), the operation of performing a specific function related to the calendar by selecting the calendar icon 720 is shown. The calendar icon 720 also displays function indicator indicators 720a through 720c indicating a function specific to the calendar, wherein the operation of selecting the specific function display indicator 720c by the fine touch operation through the pen 430 Respectively.

In FIG. 7 (d), the names 720d to 720f for each of the function display indicators for the calendar icon 720 are displayed, and it can be seen that the memo function is performed among them. That is, when a specific region of the calendar is selected by the fine touch operation, a memo function corresponding to the specific region can be performed.

In the case of FIG. 7A, the function specific to each icon is set in association with a specific part of the icon or function indicator indicators. Therefore, different operations can be performed for each icon in selecting a specific region of the icon by the fine touch operation. Alternatively, in FIG. 7B, a control function common to the icons may be matched to a specific portion of the icon. For example, control functions for icons such as icon deletion, icon movement, icon selection, function execution, and the like are control functions that can be performed regardless of the icon characteristics. Accordingly, the control function common to the icons may be matched to a specific area of the icon, and the control function may be performed when the specific area is selected as the detailed touch operation.

7A. In FIG. 7B, a specific function indicator of a rectangular shape is displayed at specific upper, lower, right, and left portions of the respective icons 710 to 740. Each function display indicator matches a control function common to the icons. Here, when a specific region of the icon is selected by the fine touch operation through the pen 430, the function matched to the corresponding region can be performed.

In Fig. 7B (b), an operation for performing a function related to a selected specific region is shown. Accordingly, since the portion corresponding to the function execution is selected in association with the camera icon 730, the controller 180 can perform the camera function.

On the other hand, although the figure shows that a specific function of the icon is matched with a function display indicator or a triangle or a square shape, such a display may be omitted. For example, even if the icon does not have a display such as the function display indicator, it is possible to control the hidden function to be performed when the edge area of the icon is selected by the fine touch operation.

FIG. 8 is another diagram illustrating another icon control operation according to the detailed touch operation according to the present invention.

The control method of the icon may be determined according to the moving direction of the icon by another icon control method by the fine touch method. Specifically, when the icon is moved in the first direction by the fine touch method, the icon is controlled by the first control operation, and when the icon is moved in the second direction, the icon is controlled by the second control operation.

Referring to FIG. 8 (a), the touch screen 151 displays a plurality of icons 810 to 830. Here, the specific fine area associated with each icon is only an area for fine touch operation. Specifically, the first icon 810 has a first fine area 810a, the second icon 820 has a second fine area 820a, and the third icon 830 has a third fine area 830a ). When each fine area is touched by the fine touch operation such as the pen 430, the controller 180 sets the icon to a state capable of moving the icon.

8A, when the first fine area 810a is touched by the pen 430 through the touch screen 151, the controller 180 sets the first icon 810 to a state capable of moving the first icon 810 do.

In Fig. 8 (b), an operation of moving the first icon downward after touching the first fine area with the fine touch operation is shown. The control unit 180 is matched with a control operation for performing a basic function of the icon when a specific icon is moved downward in one direction. In the figure, the function of the camera is shown.

8C, an operation of moving the first icon to the right after touching the first fine area with the fine touch operation is shown, and the control unit 180 sets the icon's preference Function, and in the figure, an operation to enter the environment setting is shown.

9A and 9B are diagrams illustrating a scroll control operation according to the fine-touch operation according to the present invention.

The scroll control operation can be performed by another control method through the fine touch operation related to the present invention. When the general touch operation is performed, if a small range of items exists in various ways, the touch can not be finely performed, and such items can not be seen. However, in the case of the fine touch operation, since the touch screen 151 can be precisely touched, a delicate control operation such as a scroll operation can be performed.

Referring to FIG. 9A, when there are various sub icons in the folder icon, the sub icons are confirmed by scrolling through the detailed touch operation.

9A, the first folder icon 910 is shown to include a plurality of sub icons, wherein when a fine-touch operation on one side of the first folder icon 910 is received, The controller 180 may perform operations of scrolling a plurality of sub icons belonging to the first folder icon 910. [

Referring to FIGS. 9A and 9B, an operation in which the detailed touch operation is continued and sub icons belonging to the first folder icon 910 are scrolled and displayed is shown.

9B, another example of the scrolling operation by the fine touch operation is shown. That is, when the touch screen 151 is composed of a plurality of divided areas and each of the divided areas displays different individual contents, the content of one of the divided areas can be scrolled through the fine touch operation. Techniques such as dual screen and N-screen can be applied to the technology utilizing the divided area.

Referring to FIG. 9B, the touch screen 151 includes a first partition area 940a and a second partition area 940b. The first partition area 940a displays real-time search contents, The second partition area 940b displays news contents.

Here, when the first divided region is touched and moved through the fine touch operation through the pen 430, the controller 180 scrolls and displays the real-time search contents displayed in the first divided region 940a . In (b) of FIG. 9B, as a result of the scrolling, a state in which the real-time search contents of the first division area 940a is scrolled is displayed.

FIG. 10 is a diagram illustrating a text selection operation according to the detailed touch operation according to the present invention.

In contrast to the general touch operation, in the case of the fine touch operation, a precise touch can be performed, so that even a small object such as text can be accurately touched, thereby performing various control operations related to the text.

Referring to FIG. 10 (a), the touch screen 151 displays a specific Internet site. Here, the specific Internet site may display a plurality of texts. Here, a specific text "strong motion" 1010 can be selected by the fine touch operation through the pen 430, and various control operations can be performed when the specific text 1010 is selected, Text search, text sharing, text deselection, etc., but are not limited to this particular control operation.

Referring to FIG. 10B, a search result for the selected specific text 1010 is displayed. The touch screen 151 can search for and display the text selected by the fine touch operation.

11A to 11E are diagrams illustrating a mode change operation according to the recognition of the fine touch in the context of the present invention.

The mobile terminal 100 may perform a control operation corresponding to the type of touch operation touched by the user. Specifically, when a fine touch operation is received unlike the general touch operation, it is possible to display the touch operation differently from the case of receiving a general touch operation, such as reducing the text size of the text or increasing the number of icons displayed.

11A and 11B show a state in which the number of display items is changed when a general touch operation is received and when a fine touch operation according to the present invention is received.

Comparing the case where the general touch operation in FIG. 11A is received and the case in which the fine touch operation in FIG. 11A is received, in FIG. 11A, when the first icon 1101 is selected In FIG. 11A, seven items 1103 can be displayed when the first icon 1101 is selected through the fine-touch operation.

In FIG. 11B, in the case of viewing specific images through the general touch operation, the controller 180 controls the touch screen 151 to display five images 1112a to 1112e. However, the controller 180 controls the touch screen 151 to display all of the 33 images 1114 in the case of viewing specific images through the detailed touch operation according to the present invention. Since the object can be precisely touched by the fine touch operation, the number of objects to be previewed as shown in the drawing increases, and the detailed movement can be performed.

Referring to FIG. 11C, subweb pages 1121a to 1121e can be displayed by the number of subweb pages to be executed when a detailed touch operation is performed during execution of the web browser. In the case where the touch screen 151 is touched by the detailed touch operation, the touch screen 151 can display a plurality of sub-web pages because the touch can be performed precisely.

11D, another example of the control operation in the case where the detailed touch operation is recognized is that when the pen 430 is held on the page link 1131, the screen of the page links is displayed in the thumbnail preview state, (b). When a specific page of the page link 1131 is selected in the case of the general touch operation, the page is moved directly to the page. However, when the page link 1131 is selected by the fine-touch operation, the preview screens 1131a to 1131e are displayed .

Referring to FIG. 11E, a specific web site 1140 is displayed through the touch screen 151. FIG. When a detailed touch operation is performed on the search window of the specific web site 1140 via the pen 430, the virtual web page 1140 is displayed in a virtual manner as shown in the handwriting recognition pad 1141 or 11E (b) The keyboard 1142 can be displayed. Since the fine touch operation such as a pen can be finely operated so as to be input through the handwriting recognition pad 1141 or the virtual keyboard 1142, when the control unit 180 recognizes the fine touch operation, the handwriting recognition pad 1141 ) Or a virtual keyboard 1142. [

11A to 11E, the control operation in the case where the fine touch operation is recognized has been described. However, the control operations are exemplary, and more various control operations may be performed when the fine touch operation is recognized.

12 is a diagram showing a direct execution operation of an in-directory icon according to the fine-touch operation in connection with the present invention.

The detailed touch operation may not touch the area of the touch screen 151 but may touch one point of the touch screen 151 with precision, so that sub icons included in the folder icon can be directly selected and executed.

In the conventional technology, when a specific sub icon among a plurality of sub icons belonging to a folder icon is desired to be executed, a sub icon is selected by expanding the folder icon and then a specific sub icon is executed did. However, in the detailed touch operation according to the present invention, it is possible to select and execute the sub icon immediately without expanding the sub icons.

12 (a), the touch screen 151 displays a plurality of icons, and a specific folder icon 1210 is displayed thereon. Here, the specific sub icon 1210a of the folder icon 1210 can be directly selected through the pen 430 according to the detailed touch operation. In this case, the control unit 180 does not recognize that the folder icon 1210 is selected, but can recognize that the specific sub icon 1210a is selected and executed. Thus, referring to FIG. 12 (b), an operation is shown in which an application corresponding to the selected specific sub icon 1210a is executed.

It will be apparent to those skilled in the art that the present invention may be embodied in other specific forms without departing from the spirit or essential characteristics thereof.

The present invention described above can be embodied as computer-readable codes on a medium on which a program is recorded. The computer readable medium includes all kinds of recording devices in which data that can be read by a computer system is stored. Examples of the computer-readable medium include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage, and the like, and also implemented in the form of a carrier wave (for example, transmission over the Internet) . Also, the computer may include a control unit 180 of the terminal.

Accordingly, the above description should not be construed in a limiting sense in all respects and should be considered illustrative. The scope of the present invention should be determined by rational interpretation of the appended claims, and all changes within the scope of equivalents of the present invention are included in the scope of the present invention.

100: mobile terminal 110: wireless communication unit
120: A / V input / output unit 130: user input unit
140: sensing unit 150: output unit
160: memory 170: interface section
180: control unit 190: power supply unit

Claims (18)

A touch screen for displaying two or more objects and receiving a pen touch operation for at least one of the objects; And
When the first pen touch operation for the first object among the objects is received, it is recognized that the first object is selected, and when the second pen touch operation for the second object of the objects is received, And a controller for performing a control operation on the selected at least one object when the third pen touch operation for at least one of the selected first and second objects is received,
Wherein the control unit decreases the display size of the objects and controls the touch screen to increase the number of the objects when the third pen touch operation is recognized. The method according to claim 1,
Wherein the control unit controls the touch screen to display each indicator indicating that the selected at least one object is a selected object. The method according to claim 1,
Wherein the control unit controls the control unit to match a specific area of each of the objects with the control operation when there is a control operation associated with each of the objects. The method of claim 3,
Wherein the control unit performs a control operation matched with the specific area when a specific area of one of the at least one object is touched. delete The method according to claim 1,
Wherein the control unit controls the touch screen to reduce a size of a text displayed on the touch screen when it is recognized that the third pen touch operation is received. The method according to claim 1,
Wherein the controller generates the at least one selected object as a folder object, controls the touch screen to display the folder object,
Wherein the folder object includes at least one sub-object corresponding to each of the selected at least one object,
Wherein the at least one sub-object is displayed to be included in the folder object. 8. The method of claim 7,
Wherein the control unit performs control operations for at least one object corresponding to the selected at least one subobject when the at least one subobject included in the folder object is selected through the pen touch operation. delete delete delete delete delete delete delete delete delete delete

Images