KR20120007384A - Mobile terminal and operation control method thereof - Google Patents

Abstract

PURPOSE: A portable terminal and operation control method thereof are provided to control various operations through the multi touch input of various types. CONSTITUTION: A display unit(151) displays a document editing screen capable of writing out an electronic document. A control unit(180) receives multi-touch input including first touch input and second touch input through the document editing screen. The control unit divides the document editing screen into first and second screens. The control unit displays the document editing screen on the first screen. The control unit displays the divided screen on the second screen.

Description

Mobile terminal and operation control method

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a portable terminal and an operation control method thereof, and more particularly, to a portable terminal capable of controlling various operations using a multi-touch input and an operation control method thereof.

A portable terminal is a portable device that is portable and has one or more functions for making voice and video calls, inputting and outputting information, and storing data. As the functions of the portable terminal have diversified, they have complicated functions such as photographing and photographing, playing music files and video files, receiving games, receiving broadcasts, and wireless internet, and have developed a comprehensive multimedia player, .

In the portable terminal implemented in the form of such a multimedia device, new attempts have been applied in various ways in terms of hardware and software to implement complex functions. For example, a user interface environment for a user to search for or select a function easily and conveniently. In addition, while a mobile terminal is regarded as a personal portable device for expressing a user's personality, various design changes such as a double-sided LCD (Liquid Crystal Display) and a front touch screen, which are seen from both sides, are used for mobile terminals. Since portability and the like must be taken into consideration, there is a limitation in allocating space for a user interface such as a display or a keypad. Accordingly, in order to efficiently use various functions provided in the portable terminal, it is necessary to control the operation of the portable terminal through a new input method different from the existing menu structure or input method.

However, since the mobile terminal must consider mobility and portability, there is a limitation in allocating space for arranging a user interface such as a display or a keypad. Accordingly, in order to conveniently use various and complicated functions provided by the portable terminal, it is necessary to control the operation of the portable terminal through a new input / output method different from the existing input / output method.

Accordingly, an object of the present invention is to provide a portable terminal capable of controlling various operations using various types of multi-touch inputs and an operation control method thereof.

According to another aspect of the present invention, there is provided a method of controlling an operation of a mobile terminal, the method including: displaying a document editing screen for creating an electronic document on a display unit; a first touch input and a second touch input through the document editing screen; Receiving a multi-touch input including; and dividing the document editing screen into first and second screens, displaying the document editing screen on the first screen, and file items arranged on the second screen. Displaying the screen.

In addition, the operation control method of the mobile terminal according to the present invention for achieving the above object is divided into a first and a second screen, to display a first operation screen on the first screen, the second screen on the second screen Displaying a screen displaying an operation screen on a display unit, receiving a multi-touch input including a first touch input and a second touch input through adjacent areas of the first and second screens; And when one of the first and second touch inputs is dragged, changing and displaying sizes of the first and second screens in response to the dragging direction.

In addition, the operation control method of the mobile terminal according to the present invention for achieving the above object, the step of displaying a first screen on the display unit, the first touch input and the second touch input through the boundary area of the operation screen; Receiving a multi-touch input, and when one of the first and second touch inputs is dragged, decreases and displays the size of the first screen in response to the dragged distance, and the first screen is displayed. And displaying a second screen in an area not displayed.

In addition, the operation control method of the mobile terminal according to the present invention for achieving the above object, the step of displaying the operation screen during the multimedia playback in the background, multi-touch including a first touch input and the second touch input through the operation screen Receiving a touch input, and if any one of the first and second touch input is dragged, executing a predetermined multimedia playback control operation corresponding to the dragged direction.

In addition, in order to achieve the above object, a method of controlling an operation of a mobile terminal according to the present invention may include: displaying a list screen including a first list in which text items are listed on a display, and touching a first item in the first list. Receiving a multi-touch input including first and second touch inputs; and dividing the list screen into first and second screens, displaying the first list on the first screen, and displaying the second list. The screen includes displaying a screen related to an additional function related to a character.

On the other hand, the portable terminal according to the present invention, when receiving a multi-touch input including a display unit for displaying a document editing screen for creating an electronic document, and a first touch input and a second touch input through the document editing screen And dividing the document editing screen into first and second screens, displaying the document editing screen on the first screen, and displaying a screen on which file items are arranged on the second screen.

In addition, the portable terminal according to the present invention is divided into a first and a second screen, a display unit for displaying a first operation screen on the first screen, and a second operation screen on the second screen, and the When one of the first and second touch inputs is dragged after the first and second screens receive a multi-touch input including a first touch input and a second touch input through an adjacent adjacent area, the dragging is performed. And a controller for changing and displaying sizes of the first and second screens in correspondence with the direction in which the first and second screens are displayed.

In addition, the portable terminal according to the present invention, after receiving a multi-touch input including a first touch input and a second touch input through the display unit for displaying a first screen, and the boundary area of the first screen, If any one of the first and second touch inputs is dragged, the controller reduces the size of the first screen in response to the dragged distance and displays the second screen in an area where the first screen is not displayed. It includes.

In addition, the portable terminal according to the present invention, after receiving a multi-touch input including a display unit for displaying an operation screen for playing a multimedia file, and a first touch input and a second touch input through the operation screen, When one of the first and second touch input is dragged, the controller may include a control unit configured to execute a predetermined multimedia playback control operation corresponding to the dragged direction.

In addition, the portable terminal according to the present invention includes a display unit for displaying a list screen including a first list in which text items are listed, and first and second touch inputs for touching a first item in the first list. When receiving the multi-touch input, the list screen is divided into first and second screens, the first screen is displayed on the first screen, and the second screen is a screen for selecting additional functions related to text. It includes a control unit for displaying.

In order to achieve the above object, the present invention provides a processor-readable recording medium having recorded thereon a program for executing the operation control method in a processor.

According to the present invention, various operations can be controlled in a mobile terminal by using a multi-touch input of a multi area and a multi-touch input of a single area. By using the multi-touch input of the multi-area and the multi-touch input of the single-area in combination with a general key input or a touch input, the convenience of operation in the portable terminal can be improved.

1 is a block diagram of a portable terminal according to an embodiment of the present invention;
2 is a perspective view of a portable terminal according to an embodiment of the present invention;
3 is a rear perspective view of the mobile terminal shown in FIG. 2;
4 and 5 are views for explaining the terms used in the operation control method of the mobile terminal according to the present invention;
6 is a flowchart provided for describing an embodiment related to multitasking in a method of controlling an operation of a portable terminal according to the present invention;
7 is a flowchart provided for explaining another embodiment related to multitasking in the method of controlling the operation of a mobile terminal according to the present invention;
8 is a flowchart provided for explaining another embodiment related to multitasking in a method of controlling an operation of a portable terminal according to the present invention;
9 to 11 are views for explaining an operation control related to multitasking according to an embodiment of the present invention together with a screen displayed on a display unit;
12 is a flowchart provided for describing an embodiment related to multimedia playback in a method for controlling an operation of a portable terminal according to the present invention;
FIG. 13 is a diagram for explaining an operation control related to multimedia playback according to an embodiment of the present invention together with a screen displayed on a display unit; FIG.
14 is a flowchart provided to explain an embodiment related to a message in a method of controlling an operation of a mobile terminal according to the present invention; and
FIG. 15 is a diagram for explaining an operation control associated with a message according to an embodiment of the present invention together with a screen displayed on a display unit.

Hereinafter, with reference to the drawings will be described the present invention in more detail.

The mobile terminal described in the present specification includes a mobile phone, a smart phone, a notebook computer, a digital broadcasting terminal, a personal digital assistant (PDA), a portable multimedia player (PMP), a navigation computer, and a tablet computer. ), E-book terminals and the like. In addition, suffixes "module" and " part "for the components used in the following description are given merely for convenience of description, and do not give special significance or role in themselves. Therefore, the "module" and "unit" may be used interchangeably.

FIG. 1 is a block diagram of a portable terminal according to an exemplary embodiment of the present invention. Referring to FIG. Referring to FIG. 1, a mobile terminal according to an embodiment of the present invention will be described in terms of components according to functions.

1, the portable terminal 100 includes a wireless communication unit 110, an A / V input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, A memory 160, an interface unit 170, a control unit 180, and a power supply unit 190. Such components may be configured by combining two or more components into one component, or by dividing one or more components into two or more components as necessary when implemented in an actual application.

The wireless communication unit 110 may include a broadcast receiving module 111, a mobile communication module 113, a wireless Internet module 115, a short distance communication module 117, and a GPS module 119.

The broadcast receiving module 111 receives at least one of a broadcast signal and broadcast related information from an external broadcast management server through a broadcast channel. In this case, the broadcast channel may include a satellite channel, a terrestrial channel, and the like. The broadcast management server may refer to a server for generating and transmitting at least one of a broadcast signal and broadcast related information and a server for receiving at least one of the generated broadcast signal and broadcast related information and transmitting the broadcast signal to the terminal.

The broadcast related information may mean information related to a broadcast channel, a broadcast program, or a broadcast service provider. The broadcast signal may include not only a TV broadcast signal, a radio broadcast signal, and a data broadcast signal, but also a broadcast signal having a data broadcast signal combined with a TV broadcast signal or a radio broadcast signal. The broadcast related information may also be provided through a mobile communication network, and in this case, may be received by the mobile communication module 113. Broadcast related information may exist in various forms. For example, it may exist in the form of Electronic Program Guide (EPG) of Digital Multimedia Broadcasting (DMB) or Electronic Service Guide (ESG) of Digital Video Broadcast-Handheld (DVB-H).

The broadcast receiving module 111 receives broadcast signals using various broadcasting systems. In particular, the broadcast receiving module 111 may be a Digital Multimedia Broadcasting-Terrestrial (DMB-T), a Digital Multimedia Broadcasting-Satellite (DMB-S) ), Digital Video Broadcast-Handheld (DVB-H), Integrated Services Digital Broadcast-Terrestrial (ISDB-T), and the like. In addition, the broadcast receiving module 111 may be configured to be suitable for all broadcast systems providing broadcast signals as well as such digital broadcast systems. The broadcast signal and / or broadcast related information received through the broadcast receiving module 111 may be stored in the memory 160.

The mobile communication module 113 transmits and receives a radio signal with at least one of a base station, an external terminal, and a server on a mobile communication network. Here, the wireless signal may include various types of data according to voice call signal, video call signal, or text / multimedia message transmission and reception.

The wireless Internet module 115 refers to a module for wireless Internet access, and the wireless Internet module 115 can be embedded in the mobile terminal 100 or externally. Wireless Internet technologies may include Wireless LAN (Wi-Fi), Wireless Broadband (Wibro), World Interoperability for Microwave Access (Wimax), High Speed Downlink Packet Access (HSDPA), and the like.

The short-range communication module 117 refers to a module for short-range communication. Bluetooth, radio frequency identification (RFID), infrared data association (IrDA), ultra wideband (UWB), ZigBee, and the like can be used as the short distance communication technology.

A GPS (Global Position System) module 119 receives position information from a plurality of GPS satellites.

The A / V (Audio / Video) input unit 120 is for inputting an audio signal or a video signal, and may include a camera 121 and a microphone 123. The camera 121 processes image frames such as still images or moving images obtained by the image sensor in the video call mode or the photographing mode. The processed image frame may be displayed on the display unit 151.

The image frame processed by the camera 121 may be stored in the memory 160 or transmitted to the outside through the wireless communication unit 110. The camera 121 may be equipped with two or more cameras according to the configuration of the terminal.

The microphone 123 receives an external sound signal by a microphone in a communication mode, a recording mode, a voice recognition mode, or the like, and processes it as electrical voice data. The processed voice data can be converted into a form that can be transmitted to the mobile communication base station through the mobile communication module 113 and output when the voice data is in the call mode. The microphone 123 may be a variety of noise reduction algorithms for eliminating noise generated in receiving an external sound signal.

The user input unit 130 generates key input data input by the user for controlling the operation of the terminal. The user input unit 130 may include a key pad, a dome switch, a touch pad (constant voltage / capacitance), etc. that may receive a command or information by a user's push or touch operation. In addition, the user input unit 130 may be configured as a jog wheel or a jog method or a joystick that rotates a key, a finger mouse, or the like. Particularly, when the touch pad has a mutual layer structure with the display unit 151 described later, it can be called a touch screen.

The sensing unit 140 senses the current state of the portable terminal 100 such as the open / close state of the portable terminal 100, the position of the portable terminal 100, Thereby generating a sensing signal. For example, when the mobile terminal 100 is in the form of a slide phone, it may sense whether the slide phone is opened or closed. In addition, it may be responsible for sensing functions related to whether the power supply unit 190 is supplied with power, whether the interface unit 170 is coupled to an external device, and the like.

The sensing unit 140 may include a detection sensor 141, a pressure sensor 143, a motion sensor 145, and the like. The detection sensor 141 detects the presence of an object approaching the portable terminal 100 or an object existing in the vicinity of the portable terminal 100 without mechanical contact. The detection sensor 141 may detect a proximity object by using a change in an alternating magnetic field or a change in a static magnetic field, or using a change rate of capacitance. The sensor 141 may be provided with two or more according to the configuration aspect.

The pressure sensor 143 may detect whether pressure is applied to the portable terminal 100, the magnitude of the pressure, and the like. The pressure sensor 143 may be installed at a portion where the pressure of the portable terminal 100 is required depending on the use environment. If the pressure sensor 143 is installed in the display unit 151, a touch input through the display unit 151 and a greater pressure than the touch input are applied according to a signal output from the pressure sensor 143. The pressure touch input can be identified. Also, the magnitude of the pressure applied to the display unit 151 at the time of the pressure touch input can be determined according to the signal output from the pressure sensor 143. [

The motion sensor 145 detects the position and movement of the portable terminal 100 using an acceleration sensor, a gyro sensor, or the like. An acceleration sensor that can be used for the motion sensor 145 is a device that converts an acceleration change in one direction into an electric signal and is widely used along with the development of MEMS (micro-electromechanical systems) technology. The acceleration sensor measures the acceleration of a small value built in the airbag system of an automobile and recognizes the minute motion of the human hand and measures the acceleration of a large value used as an input means such as a game There are various types. Acceleration sensors are usually constructed by mounting two or three axes in one package. Depending on the usage environment, only one axis of Z axis is required. Therefore, when the acceleration sensor in the X-axis direction or the Y-axis direction is used instead of the Z-axis direction for some reason, the acceleration sensor may be mounted on the main substrate by using a separate piece substrate.

The gyro sensor is a sensor for measuring the angular velocity, and it can sense the direction of rotation with respect to the reference direction.

The output unit 150 is for outputting an audio signal, a video signal, or an alarm signal. The output unit 150 may include a display unit 151, an audio output module 153, an alarm unit 155, and a haptic module 157.

The display unit 151 displays and outputs information processed by the mobile terminal 100. For example, when the portable terminal 100 is in the call mode, a UI (User Interface) or a GUI (Graphic User Interface) associated with a call is displayed. When the portable terminal 100 is in the video communication mode or the photographing mode, the photographed or received images can be displayed individually or simultaneously, and the UI and the GUI are displayed.

Meanwhile, as described above, when the display unit 151 and the touch pad form a mutual layer structure and constitute a touch screen, the display unit 151 is an input device capable of inputting information by a user's touch in addition to the output device. May also be used.

If the display unit 151 is configured as a touch screen, it may include a touch screen panel, a touch screen panel controller, and the like. In this case, the touch screen panel is a transparent panel attached to the outside and may be connected to the internal bus of the portable terminal 100. The touch screen panel keeps a watch on the contact result, and if there is a touch input, sends the corresponding signals to the touch screen panel controller. The touch screen panel controller processes the signals, and then transmits corresponding data to the controller 180 so that the controller 180 can determine whether the touch input has been made and which area of the touch screen has been touched.

The display unit 151 may be formed of an e-paper. Electronic paper (e-Paper) is a kind of reflective display, and has excellent visual characteristics such as high resolution, wide viewing angle and bright white background as conventional paper and ink. The electronic paper (e-paper) can be implemented on any substrate such as plastic, metal, paper, and the image is retained even after the power is shut off, and the battery life of the portable terminal 100 is long Can be maintained. As the electronic paper, a hemispherical twist ball filled with a telephone can be used, or an electrophoresis method and a microcapsule can be used.

In addition, the display unit 151 may include a liquid crystal display, a thin film transistor-liquid crystal display, an organic light-emitting diode, a flexible display, and a three-dimensional display. It may include at least one of (3D display). In addition, two or more display units 151 may exist according to the implementation form of the mobile terminal 100. For example, the external display unit (not shown) and the internal display unit (not shown) may be simultaneously provided in the portable terminal 100.

The audio output module 153 outputs audio data received from the wireless communication unit 110 or stored in the memory 160 in a call signal reception mode, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, The sound output module 153 outputs sound signals related to functions performed in the portable terminal 100, for example, a call signal reception tone, a message reception tone, and the like. The sound output module 153 may include a speaker, a buzzer, and the like.

The alarm unit 155 outputs a signal for notifying the occurrence of an event of the portable terminal 100. Examples of events occurring in the portable terminal 100 include call signal reception, message reception, and key signal input. The alarm unit 155 outputs a signal for notifying occurrence of an event in a form other than an audio signal or a video signal. For example, the signal may be output in the form of vibration. The alarm unit 155 can output a signal to notify when a call signal is received or a message is received. Also. When the key signal is input, the alarm unit 155 may output the signal as a feedback to the key signal input. The user may recognize the occurrence of an event through the signal output from the alarm unit 155. A signal for notifying the occurrence of an event in the portable terminal 100 may also be output through the display unit 151 or the sound output module 153. [

The haptic module 157 generates various tactile effects that the user can feel. A typical example of the haptic effect generated by the haptic module 157 is a vibration effect. When the haptic module 157 generates vibration with a haptic effect, the intensity and pattern of the vibration generated by the haptic module 157 can be converted, and the different vibrations can be synthesized and output or sequentially output.

In addition to the vibration, the haptic module 157 may be operated by a pin array that vertically moves with respect to the contact skin surface, by the stimulation through the injection force or the suction force of the air through the injection or inlet, or by the stimulus that strikes the skin surface. Various tactile effects can be generated, such as effects of stimulation through contact of electrodes, effects of stimulation using electrostatic force, and effects of reproducing a sense of warmth and heat using an endothermic or heat generating element. The haptic module 157 can be implemented not only to transmit the tactile effect through direct contact but also to feel the tactile effect through the muscular sense of the user's finger or arm. Two or more haptic modules 157 may be provided according to a configuration aspect of the mobile terminal 100.

The memory 160 may store a program for processing and controlling the controller 180 and may provide a function for temporarily storing input or output data (for example, a phone book, a message, a still image, a video, etc.). It can also be done.

The memory 160 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory), a RAM , And a ROM. ≪ / RTI > In addition, the mobile terminal 100 may operate a web storage that performs a storage function of the memory 150 on the Internet.

The interface unit 170 serves as an interface with all external devices connected to the portable terminal 100. Examples of the external device connected to the portable terminal 100 include a wired / wireless headset, an external charger, a wired / wireless data port, a memory card, a SIM (Subscriber Identification Module) card, a UIM An audio input / output (I / O) terminal, a video I / O (input / output) terminal, and an earphone. The interface unit 170 receives data from the external device or receives power from the external device and transmits the data to each component in the portable terminal 100 so that data in the portable terminal 100 can be transmitted to the external device .

The interface unit 170 is a path through which power from the cradle connected when the portable terminal 100 is connected to the external cradle is supplied to the portable terminal 100 or various command signals inputted from the cradle by the user are carried And may be a passage to be transmitted to the terminal 100.

The controller 180 typically controls the operation of the respective units to control the overall operation of the mobile terminal 100. For example, perform related control and processing for voice calls, data communications, video calls, and the like. In addition, the controller 180 may include a multimedia playback module 181 for multimedia playback. The multimedia playback module 181 may be configured in hardware in the controller 180 or may be configured in software separately from the controller 180.

The power supply unit 190 receives external power and internal power under the control of the controller 180 and supplies power necessary for operation of the respective components.

The mobile terminal 100 having such a configuration can be configured to be operable in a communication system capable of transmitting data through a frame or a packet, including a wired / wireless communication system and a satellite-based communication system. have.

2 is a perspective view of a portable terminal according to an embodiment of the present invention, and FIG. 3 is a rear perspective view of the portable terminal illustrated in FIG. 2. Hereinafter, the portable terminal according to the present invention will be described with reference to FIGS. 2 and 3 in terms of components according to the external form. Hereinafter, for convenience of description, a bar-type portable terminal having a front touch screen among various types of portable terminals such as a folder type, a bar type, a swing type, a slider type, etc. will be described as an example. However, the present invention is not limited to a bar-type portable terminal, but can be applied to all types of portable terminals including the above-mentioned type.

Referring to FIG. 2, the case constituting the outer appearance of the portable terminal 100 is formed by the front case 100-1 and the rear case 100-2. Various electronic components are incorporated in the space formed by the front case 100-1 and the rear case 100-2. The front case 100-1 and the rear case 100-2 may be formed by injecting a synthetic resin, or may be formed to have a metal material such as stainless steel (STS) or titanium (Ti).

In the main body, specifically, the front case 100-1, the display unit 151, the first audio output module 153a, the first camera 121a, and the first to third user input units 130a, 130b, and 130c are provided. Can be deployed. A fourth user input unit 130d, a fifth user input unit 130e, and a microphone 123 may be disposed on a side surface of the rear case 100-2.

The display unit 151 may be constructed such that the touch pad is overlapped with the layer structure so that the display unit 151 operates as a touch screen so that information can be input by a user's touch.

The first acoustic output module 153a may be implemented in the form of a receiver or a speaker. The first camera 121a may be implemented in a form suitable for capturing an image or a moving image of a user. The microphone 123 may be implemented in a form suitable for receiving a user's voice, other sounds, and the like.

The first through fifth user input units 130a 130b 130c 130d and 130e and the sixth and seventh user input units 130f and 130g described below may be collectively referred to as a user input unit 130, Any manner can be employed in a tactile manner.

For example, the user input unit 130 may be implemented as a dome switch or a touch pad that may receive a command or information by a user's push or touch operation, or may be operated as a wheel or jog or a joystick that rotates a key. Or the like. In functional terms, the first to third user input units 130a, 130b, and 130c are for inputting a call, a mouse point movement or a screen scroll, start, end, and the like. The fourth user input unit 130b is for inputting a selection of an operation mode and the like. In addition, the fifth user input unit 130c may operate as a hot-key for activating a special function in the mobile terminal 100.

Referring to FIG. 3, the second camera 121b may be additionally mounted on the rear surface of the rear case 100-2, and the sixth and seventh user inputs 130f and 130g may be provided on the side of the second body 100B. ) And the interface unit 170 may be disposed.

The second camera 121b may have a photographing direction substantially opposite to that of the first camera 121a, and may have different pixels from the first camera 121a. A flash (not shown) and a mirror (not shown) may be further disposed adjacent to the second camera 121b. The flash shines toward the subject when the subject is photographed with the second camera 121b. The mirror allows the user to see his / her own face or the like when photographing (self-photographing) the user using the second camera 121b.

A second sound output module (not shown) may be further disposed in the rear case 100-2. The second sound output module may implement the stereo function together with the first sound output module 153a, and may be used for talking in the speakerphone mode.

The interface unit 170 can be used as a path for exchanging data with an external device. In addition, an antenna (not shown) for receiving a broadcast signal may be disposed in one area of the proton case 100-1 and the rear case 100-2. The antenna may be installed to be capable of being drawn out from the rear case 100-2.

A power supply unit 190 for supplying power to the portable terminal 100 may be mounted on the rear case 100-2. The power supply unit 190 may be a rechargeable battery, for example, and may be detachably coupled to the rear case 100-2 for charging or the like.

In the above description, the second camera 121b and the like are disposed on the rear case 100-2, but the present invention is not limited thereto. In addition, even if the second camera 121b is not separately provided, the first camera 121a may be rotatably formed to be able to photograph up to the photographing direction of the second camera 121b.

`` Term Definition ''

4 and 5 are views referred to in the description of terms used in the operation control method of the mobile terminal according to the present invention. As shown in FIG. 4A, the operation screen 200 may be divided into at least two regions from side to side. In this case, when the left region is referred to as the first region 210 and the right region is referred to as the second region 220, the second touch input 221 and the second region 220 through the first region 210 may be used. The multi-touch input including the touch input 223 may be defined as a “multi-touch input of a multi area”. In this case, the size of the first region 210 and the second region 220 may be the same or different.

As shown in FIG. 4B, even when the first touch input 225 and the second touch input 227 touch different items, the first and second touch inputs 225 and 227 may not be touched. If only the input areas are different, this case may be defined as 'multi-touch input of the multi area'.

In contrast, as shown in FIG. 5, when the operation screen is divided into at least two regions, the multi touch screen includes a first touch input 231 and a second touch input 233 through the first region 210. Touch input is defined as 'multi-touch input of single area'. Similarly, even when there is a multi-touch input including the first and second touch inputs through the second area 220, the multi-touch input of the single area may be defined.

According to the usage environment, the operation screen 200 is divided into upper and lower regions instead of left and right, and multi-touch input including a multi-touch input including a first touch input through the upper region and a second touch input through the lower region. It can also be defined as In this case, the multi-touch input including the first and second touch inputs through the upper region and the multi-touch input including the first and second touch inputs through the lower region may be defined as the multi-touch inputs of the single region. have.

≪Multitasking≫

6 is a flowchart provided for describing an embodiment related to multitasking in a method of controlling an operation of a portable terminal according to the present invention.

Referring to FIG. 6, when an operation menu such as mail or text creation is selected according to a user command, the controller 180 displays a document editing screen on the display unit 151 for creating an electronic document corresponding to the selected operation menu. It is displayed (S300).

When the document editing screen is displayed, when there is the multi-touch input of the multi area or the multi-touch input of the single area as described above (S302), the controller 180 divides the screen into the first and second screens to the left and right. The first screen displays a document editing screen, and the second screen displays a screen in which file items that can be attached to an electronic document created on the document editing screen are arranged (S304). The file items arranged on the second screen may be displayed by a file name or an icon corresponding to the file.

If there is an input having a directionality, such as a flicking input or a touch-drag input on the second screen (S306), the controller 180 attaches a file to the electronic document or another file according to the direction of the input. The screen on which the items are arranged is displayed (S308).

For example, when touching an item on the second screen and inputting flicking in the left direction, the touched item is attached to the electronic document being created on the document editing screen, and when inputting flicking in the right direction on the second screen. Displays a screen with different file items arranged on the screen. In this case, the flicking input refers to an input state such as an operation in which a user's finger or the like lightly draws the surface of the touch screen. The touch input and the flicking input may be identified according to the time from when the user's finger or the like touches the display unit 151 to the moment when the finger or the like falls from the touched surface.

In addition, when there is a touch input for touching a file item to satisfy a predetermined condition on the second screen, the controller 180 performs an operation corresponding to the touched file item by multitasking (S312). Here, the touch input that satisfies a preset condition means a touch input that exceeds a reference set based on a touch time, a touch area, a touch pressure, and the like. The operation corresponding to the touched file item may be performed in the background, and the operation screen corresponding to the execution of the operation may be displayed on the whole or one area of the second screen.

Operations such as attachment of a file or execution of an operation corresponding to the selected file are repeatedly performed until the end of the screen division mode is selected (S314). The end of the screen division mode may be selected again when there is a multi-touch input of a multi area, a multi-touch input of a single area, or a selection of a predetermined menu icon.

If there is another user input such as a key input (S316), the controller 180 controls an operation corresponding to the user input to be performed (S318).

By such a process, a multi-touch input may be used to attach a file along with screen division or other functions may be performed by multitasking in the document editing screen.

7 is a flowchart provided for explaining another embodiment related to multitasking in the method of controlling the operation of a portable terminal according to the present invention.

Referring to FIG. 7, as the multitasking is performed, the controller 180 divides the first and second screens from side to side, and displays a first operation screen according to the execution of the first function on the first screen. The second operation screen is displayed on the display unit 151 to execute the second function on the screen (S330).

When the first and second operation screens are displayed, if there is an input for multi-touching an area adjacent to the first screen and the second screen (S332), and if there is an input for dragging any one of the multi-touch touch inputs (S334). The controller 180 changes the size of the first and second screens in response to the dragged direction and the distance (S336).

For example, if there is an input of dragging one of the touch inputs in the right direction, the size of the first screen displayed on the left becomes larger according to the dragged distance, and the size of the second screen displayed on the right becomes smaller according to the dragged distance. You lose. On the contrary, if there is an input for dragging one of the touch inputs to the left direction, the size of the second screen displayed on the right becomes larger according to the dragged distance, and the size of the first screen displayed on the left becomes smaller according to the dragged distance. You lose.

In addition, if there is an input for multi-touching an area adjacent to the first screen and the second screen (S332), and then there is a flicking input (S338), the controller 180 controls the first and second operation screens according to the flicking direction. Any one of them is displayed in full screen (S340).

For example, when the flicking input is performed in the left direction, the first screen disappears and the second screen is displayed in full screen. Similarly, when the flicking input is performed in the right direction, the second screen may disappear and the first screen may be displayed in full screen.

Depending on the setting, if there is an input having directionality such as a flicking input or an input that is touched and dragged within the first screen, an operation screen different from the operation screen currently displayed on the first screen may be displayed. have. Similarly, when there is a pseudo input in the second screen, an operation screen different from the operation screen currently displayed on the second screen may be displayed.

If there is another user input in addition to the multi-touch input (S342), the controller 180 controls to perform an operation corresponding to the user input (S344).

By the above process, the size of the screen may be changed by using the multi-touch input in the split-displayed multitasking screen.

8 is a flowchart provided for explaining another embodiment related to multitasking in the method for controlling operation of a portable terminal according to the present invention.

Referring to FIG. 8, the controller 180 displays an operation screen corresponding to the current operation mode on the display unit 151 (S360).

When the operation screen is displayed, when there is an input for dragging any one of the Dutch inputs after multi-touching the boundary area of the operation screen (S362), and there is a multitasking function currently operating in the background (S364), the controller 180 ) Displays the screen corresponding to the multitasking function operating in the background on the display unit 151 in a size corresponding to the dragged distance (S366).

However, if there is no multitasking function currently operating in the background, the controller 180 displays the additional screen related to the current operation mode on the display unit 151 in a size corresponding to the dragged distance (S368). In this case, examples of the additional screen related to the current operation mode include a menu screen related to the current operation mode, a screen for changing setting information such as information related to a background setting, control related information, event occurrence information, and other user settings. .

In addition, the screen or the additional screen corresponding to the multitasking function may be displayed up to a portion where the dragging stops. However, depending on the setting state, the additional screen may be configured to display a screen corresponding to the multitasking function at half the screen size or at the full screen size when dragged more than a predetermined distance.

If there are other user inputs in addition to the other multi-touch inputs (S370), the controller 180 controls to perform an operation corresponding to the user inputs (S372).

By such a process, a screen or an additional screen related to the multitasking function performed in the background can be displayed using the multi-touch input.

 9 to 11 are diagrams for explaining operation control related to multitasking according to an embodiment of the present invention together with a screen displayed on a display unit. First, FIG. 9 illustrates a process of entering a screen division mode according to a multi-touch input of a multi-region.

FIG. 9A illustrates a first touch input 421 through a first area 410 and a second touch input 423 through a second area 420 on a document editing screen 400 such as a mail or a message creation. It shows a case where there is a multi-domain multi-touch input including). As described above, when there is a multi-touch input of a multi area on the document editing screen 400, the screen divided into left and right by the first screen 440 and the second screen 450 as shown in FIG. 9B. 430 is displayed, a document editing screen that was originally displayed on the first screen 440 is displayed, and a screen in which file items that can be attached or executed are arranged is displayed on the second screen 450.

On the second screen 450, if there is an input having a directional direction to the left, such as an input of flicking or dragging to the left after touching an item, the touched item is attached to the electronic document being created on the document editing screen. Can be.

In the second screen 450, if there is an input having directionality to the right, such as an input for flicking or dragging to the right, file items different from those currently displayed on the second screen 450 may be displayed.

In addition, the file items displayed on the second screen 450 may vary according to the text editing screen in operation, and may be set according to a user's selection. In addition, the screen division mode may be configured to enter according to a multi-touch input of a single area.

FIG. 10A illustrates a first touch on an area where the first screen 470 and the second screen 480 are adjacent to each other in a screen 460 divided into left and right by the first screen 470 and the second screen 480. A case in which there is a multi-touch input including an input 481 and a second touch input 482 is illustrated.

After such a multi-touch input, as shown in FIG. 10B, the size of the first screen 470 is reduced according to the input 487 for dragging the second touch input 485 to the left. The size of the second screen 480 is increased. FIG. 10C illustrates the screen 480 displayed as the full screen size as the size of the second screen 480 gradually increases.

As described above, the size of the divided screen may be changed by using the multi-touch input.

FIG. 11A illustrates a case where there is a multi-touch input including a first touch input 501 and a second touch input 503 at a boundary area of the operation screen 500. After such a multi-touch input, as shown in FIG. 11B, the additional screen 510 related to the current operation mode is displayed according to the input 515 dragging the first touch input 501 to the right. Can be displayed. If there is a multitasking function operating in the background, a related screen may be displayed.

FIG. 11C illustrates a case in which the size of the associated additional screen 510 is enlarged according to a drag input and displayed as the full screen size.

As described above, the multi-touch input may be used to display an associated additional screen or a screen corresponding to a function operating by multitasking.

≪Multimedia Playback≫

12 is a flowchart provided for describing an embodiment related to multimedia playback in a method of controlling an operation of a portable terminal according to the present invention.

Referring to FIG. 12, according to a user's command, the controller 180 displays an operation screen during multimedia playback on the display unit 151 in the background, such as playing an MP3 file (S600).

In the state where such an operation screen is displayed, if there is an input for dragging any one of the touch inputs after the multi-touch of the single area through the display unit 151 (S502), the multimedia playback control is preset according to the grammed direction. The operation associated with the operation is performed (S504).

For example, dragging one of the touch inputs after the multi-touch of a single area to the right plays the next song of the currently playing song, and dragging one of the touch inputs after the multi-touch of the single area to the left, currently playing. You can play the previous song of the song. In addition, when one of the touch inputs after multi-touch of a single area is dragged up, the output volume may be increased, and when one of the touch inputs after multi-touch of the single area is dragged down, the output volume may be reduced.

In this way, the object controlled according to the drag direction can be configured to be set by the user. In addition, for convenience of control, when there is a multi-touch input of a single area, a guide menu may be displayed so that a user may know a target to be controlled according to the dragging direction. The guide menu may be configured such that the user does not touch both of the fingers on the screen, or only one finger touches the screen, so that the user does not touch the screen.

If there are other user inputs in addition to other multi-touch inputs (S606), the controller 180 controls to perform an operation corresponding to the user inputs (S608).

This process is repeatedly performed until the end of multimedia playback is selected (S610). In addition, by this process, it is possible to control the playback operation of the multimedia file in the background using the multi-touch input.

In addition, the method using the multi-touch input may be applied to control of a related function while receiving a broadcast or listening to a radio, setting a Wi-Fi or Bluetooth function, setting an alarm, and the like.

FIG. 13 is a diagram for explaining an operation control related to multimedia playback according to an embodiment of the present invention together with a screen displayed on a display unit.

FIG. 13A illustrates a case where there is a single area multi-touch input including a first touch input 701 and a second touch input 703 in a predetermined area on an operation screen 700 in which multimedia is played in the background. . When there is such a multi-touch input of a single area, as shown in FIG. 13B, a guide menu indicating an operation to be played along each direction can be displayed along with information on a song currently being played. The guide menu allows the user to know which direction to drag to control the desired function. The guide menu and the like can be displayed in a semi-transparent form on the operation screen.

As shown in FIG. 13C, when there is an input 705 for dragging the second touch input 703 to the right, information on the next song of the currently playing song is displayed and the next song is played. do.

As such, the multi-touch input may be used to control an operation related to multimedia playback in the background.

≪Message≫

14 is a flowchart provided for describing an embodiment related to a message in a method of controlling an operation of a portable terminal according to the present invention.

Referring to FIG. 14, in response to a user command or the like, a list screen including a list in which text items are listed is displayed on the display unit 151 (S800).

In the state where the list screen is displayed, if there is an input for multi-touching the same item in the list (S802), the controller 180 divides the screen into left and right sides of the first and second screens, and displays the original list screen on the first screen. In operation S904, a screen for selecting an additional function related to a character is displayed. At this time, examples of additional functions related to the text include a text reply, text storage, image storage, telephone number storage, text copying, and the like. Also, additional functions include the contents of the first item, the attachment file view, the display of the sender information, the display of the contents of the previous text and the contents of the reply text of the first item.

If any function is selected on the screen for selecting an additional function (S806), the controller 180 controls an operation corresponding to the selected function to be performed (S808).

The operation on the divided screen is repeatedly performed until the end of the screen division mode is selected (S810). The end selection of the screen division mode can be configured to end when there is a multi-touch input of a single area or by selection of a predetermined menu icon.

In addition, when there is an input for multi-touching other items in the list while the list screen is displayed (S812), the controller 180 divides the screen into left and right screens on the first and second screens. In operation S814, a list screen different from the original list is displayed on the second screen. For example, when the original text list is an SMS list, the MMS list may be displayed on the second screen.

When one of the divided first and second screens is selected (S816), the controller 180 controls an operation corresponding to the selected function to be performed (S818).

Similarly, the operation on the divided screen is repeatedly performed until the end of the screen division mode is selected (S820).

If there are other user inputs in addition to other multi-touch inputs (S822), the controller 180 controls to perform an operation corresponding to the user inputs (S824).

By such a process, various operations can be controlled in the text list screen using the multi-touch input.

15 is a diagram for explaining a message and an operation control according to an embodiment of the present invention together with a screen displayed on a display unit.

FIG. 15A illustrates a case in which the first touch input 921 and the second touch input 923 multi-touch the same item on the list screen 900 listing the text items. When there is an input for multi-touching the same item as described above, as shown in FIG. 15B, a screen divided left and right by the first screen 940 and the second screen 950 is displayed, and the first screen is displayed. On the screen 940, a list screen which was originally displayed is displayed, and on the second screen 950, a screen for selecting an additional function related to a character is displayed.

When multi-touching different items on the list screen 900 in which the text items are listed, the first screen 940 displays a list screen that was originally displayed, and the second screen 950 displays another list screen. can do.

As such, various operations related to the text may be controlled by using the multi-touch input through the list screen in which the text items are listed.

≪Unlock etc≫

In addition, when the mobile terminal 100 is in the locked state, it is possible to release the locked state only while performing a predetermined function by using the multi-touch input. That is, when releasing the lock state by multi-touching a specific area of the display unit 151, the lock state may be immediately changed after performing the selected function. Thus, in the locked state, it is possible to perform a specific function for a while. For example, after performing a function such as time viewing, text viewing, memo viewing, using a calculator, using an electronic dictionary, and the like using the multi-touch input in a locked state, it may be switched to the locked state again.

In addition, when a desired icon is selected by multi-touch during augmented reality execution, a distance or the like may be displayed on a predetermined portion of each icon. In addition, the distance may be displayed by displaying an icon differently according to the distance from the user. For example, an icon at a close distance from the user may display a larger size, and an icon at a distance from the user may display a smaller and smaller size according to the distance. In addition, the icons at a close distance from the user may display the colors darker, and the icons at a far distance may be gradually blurred according to the distance. The distance display of the icon and the display of the icon size may be applied only to an icon selected according to a user setting, or may be applied to all icons displayed on the screen.

Meanwhile, the present invention can be implemented as a processor-readable code in a processor-readable recording medium provided in a portable terminal. The processor-readable recording medium includes all kinds of recording devices that store data that can be read by the processor. Examples of the processor-readable recording medium include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage device, and the like, and may be implemented in the form of a carrier wave such as transmission through the Internet. The processor-readable recording medium can also be distributed over network coupled computer systems so that the processor-readable code is stored and executed in a distributed fashion.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, but, on the contrary, It should be understood that various modifications may be made by those skilled in the art without departing from the spirit and scope of the present invention.

110: wireless communication unit 120: A / V input unit
130: user input unit 140: sensing unit
150: output unit 151: display unit
160: memory 170: interface unit
180:

Claims (37)

Displaying a document editing screen for creating an electronic document on a display unit;
Receiving a multi-touch input including a first touch input and a second touch input through the document editing screen; And
Dividing the document editing screen into first and second screens, displaying the document editing screen on the first screen, and displaying a screen in which file items are arranged on the second screen; Control method. The method of claim 1,
And attaching a file corresponding to the first item to the electronic document when there is an input having a directionality in the first screen direction after touching the first item on the second screen. The method of claim 1,
And displaying other file items on the second screen when there is an input having a directionality through the second screen. The method of claim 1,
And displaying the file item as at least one of a file name and an icon. The method of claim 1,
And performing an operation corresponding to the touched item by multitasking when there is an input for touching one item on the second screen so as to satisfy a predetermined condition. The method of claim 5,
And the predetermined condition is a condition set based on any one of touch pressure, touch time, touch count, and touch area. The method of claim 5,
And displaying a screen related to executing an operation corresponding to the touched item in at least one region of the second screen. A display unit to display a document editing screen for creating an electronic document; And
When receiving a multi-touch input including a first touch input and a second touch input through the document editing screen, the document editing screen is divided into first and second screens, and the document editing screen is displayed on the first screen. And a controller configured to display a screen on which the file items are arranged on the second screen. The method of claim 8,
And an item attached to the electronic document or displaying another file item according to the direction of the input when there is an input having directionality through the second screen. The method of claim 8,
The controller may be configured to perform an operation corresponding to the touched item by multitasking when there is an input for touching an item on the second screen so as to satisfy a predetermined condition. Dividing the display into first and second screens, displaying a first operation screen on the first screen, and displaying a screen on which the second operation screen is displayed on the second screen;
Receiving a multi-touch input including a first touch input and a second touch input through adjacent areas of the first and second screens; And
When one of the first and second touch inputs is dragged, changing and displaying sizes of the first and second screens in response to the dragging direction. The method of claim 11,
And displaying one of the first and second screens in full screen according to the flicking input direction when the flicking input is performed after multi-touching the adjacent area. The method of claim 11,
And displaying a third operation screen on the first screen when there is an input having directionality through the first screen. The method of claim 11,
And displaying a fourth operation screen on the second screen when there is an input having directionality through the second screen. A display unit configured to divide the display into first and second screens, display a first operation screen on the first screen, and display a second operation screen on the second screen; And
If one of the first and second touch inputs is dragged after receiving the multi-touch input including the first touch input and the second touch input through the adjacent adjacent areas of the first and second screens, And a controller for changing and displaying sizes of the first and second screens in response to the dragging direction. 16. The method of claim 15,
The controller, if there is a flicking input after the multi-touch through the adjacent area, characterized in that any one of the first screen and the second screen according to the flicking input direction full-screen, characterized in that the mobile terminal. Displaying a first screen on a display unit;
Receiving a multi-touch input including a first touch input and a second touch input through a boundary area of the operation screen; And
When one of the first and second touch inputs is dragged, the size of the first screen is reduced and displayed in response to the dragged distance, and the second screen is displayed in an area where the first screen is not displayed. Operation control method of a mobile terminal comprising the step of. The method of claim 17,
And the second screen is a screen associated with a multitasking function running in the background. The method of claim 17,
And the second screen is an additional screen related to the first screen. The method of claim 17,
And displaying the second screen on a full screen when the dragged distance is equal to or greater than a predetermined distance. A display unit displaying a first screen; And
After receiving a multi-touch input including a first touch input and a second touch input through a boundary area of the first screen, and when any one of the first and second touch inputs is dragged, it corresponds to the dragged distance. And a controller for reducing the size of the first screen and displaying the second screen in an area where the first screen is not displayed. The method of claim 21,
And the second screen is one of a screen related to a multitasking function running in the background, and the second screen is one of additional screens related to the first screen. Displaying an operation screen during multimedia playback in the background;
Receiving a multi-touch input including a first touch input and a second touch input through the operation screen; And
And executing one of a multimedia playback control operation corresponding to the dragged direction when one of the first and second touch inputs is dragged. The method of claim 23, wherein
And displaying a guide menu for controlling the multimedia playback when the multi-touch input is received. The method of claim 23, wherein
And the guide menu displays at least one region transparently overlapping the operation screen. The method of claim 23, wherein
And when the at least one of the first and second touch inputs is not received, the guide further comprises a menu disappearing. A display unit displaying an operation screen of playing a multimedia file; And
After receiving a multi-touch input including a first touch input and a second touch input through the operation screen, if any one of the first and second touch inputs is dragged, a preset touch is performed corresponding to the dragged direction. A mobile terminal including a control unit for executing a multimedia playback control operation. The method of claim 27,
When the controller receives the multi-touch input, the controller displays a guide menu for controlling the multimedia playback on the operation screen. Displaying a list screen including a first list in which text items are listed on a display unit;
Receiving a multi-touch input including first and second touch inputs touching a first item in the first list; And
Dividing the list screen into first and second screens, displaying the first list on the first screen, and displaying a screen related to an additional function related to a character on the second screen; Motion control method. The method of claim 29,
The additional function includes a text reply, text storage, image storage, telephone number storage, telephone number transmission, and text copying. The method of claim 29,
The additional function includes a display of contents of the first item, a view of an attached file of the first item, and a display of sender information of the first item. The method of claim 29,
And the additional function comprises displaying of previous text contents and reply text contents of the first item. The method of claim 29,
Receiving a multi-touch input including a first touch input of touching a first item on the list screen and a second touch input of touching a second item; And
Dividing the list screen into first and second screens, displaying the first list on the first screen, and displaying a second list on the second screen. The method of claim 33, wherein
One of the first and second lists is an SMS list, and the other is an MMS list. The method of claim 33, wherein
And displaying a text reply writing screen on the second screen. A display unit for displaying a list screen including a first list of text items; And
When receiving a multi-touch input including first and second touch inputs touching a first item in the first list, the list screen is divided into first and second screens, and the first screen includes the first screen. And a control unit which displays a list, and on the second screen, a screen for selecting an additional function related to a character. The method of claim 36,
When the controller receives a multi-touch input including a first touch input of touching a first item on the list screen and a second touch input of touching a second item, the controller displays the list screen on the first and second screens. And the first list is displayed on the first screen, and the second list is displayed on the second screen.

Images