KR20100066597A - Apparatus and method for controlling operation of portable terminal using touchscreen - Google Patents

Abstract

PURPOSE: A device and a method for controlling the operation of a mobile terminal using a touch screen are provided to rapidly perform various programs of a mobile terminal when a user provides touch input. CONSTITUTION: If a function activation request for dual mode execution during the first screen data display of a first program is detected, a mobile terminal operates in dual mode(103,105). If user input is detected, the mobile terminal determines an appropriate execution command based on the user input(107,109). If the user input is an execution command, the mobile terminal performs a program according to the execution command(113). The mobile terminal displays screen data based on the executed program(115).

Description

Method and device for controlling mobile terminal using touch screen {APPARATUS AND METHOD FOR CONTROLLING OPERATION OF PORTABLE TERMINAL USING TOUCHSCREEN}

The present invention relates to a method and an apparatus for controlling a motion of a mobile terminal, and more particularly, to execute a function corresponding to a gesture input of a user in a mobile terminal having a touch screen, and simultaneously display the display data of the execution function with the existing display data. The present invention relates to a method and an apparatus for controlling an operation of a mobile terminal using a touch screen.

In recent years, with the rapid development of communication technology, the functions of the mobile terminal, which allowed only voice calls between the user and the counterpart, have been gradually expanded to provide more various user interfaces (UIs) and various functions using the same.

In accordance with this trend, the user demands convenience and simplicity as in a general personal computer (PC) environment in using various functions of the mobile terminal.

In general, a mobile terminal such as a mobile communication terminal or a PDA (Personal Digital Assistant) should be designed to easily carry out various functions such as telephone, data communication, address book scheduler, memo, etc. while carrying by the user. In addition, portable terminals tend to be miniaturized / lightened so that their size and weight do not feel uncomfortable to carry for the convenience of mobile.

However, in consideration of convenience in use, it is preferable that the size of the mobile terminal be more than a certain size. That is, the portable terminal is typically provided with a keypad provided with various buttons for the user's operation, and also has a display unit for displaying texts, images, videos, etc., and the keypad and the display unit are manipulated or visually recognized by the user. It should have a certain size so as not to cause inconvenience.

Therefore, the size problem considering the portability and convenience of use of the mobile terminal is in a mutually conflicting relationship. Considering the portability of the portable terminal, many studies have been conducted to provide convenience in use as in a personal computer environment.

SUMMARY OF THE INVENTION An object of the present invention is to provide a method and an apparatus for controlling the operation of a mobile terminal using a touch screen capable of maximizing its use in executing a program of a mobile terminal and displaying screen data thereof.

Still another object of the present invention is to execute a corresponding program of a mobile terminal according to a user gesture input on a touch screen, and use a mobile terminal using a touch screen capable of displaying screen data corresponding to the executed program together with the data currently being displayed. The present invention provides a method and apparatus for controlling the operation.

Still another object of the present invention is a touch screen capable of simultaneously displaying screen data of a program corresponding to a user gesture through a separate display area or a separate display unit during display of arbitrary screen data in a mobile terminal having a touch screen. The present invention provides a method and apparatus for controlling an operation of a portable terminal using the.

Still another object of the present invention is to use a touch screen for receiving an input according to a user gesture through one of the two display units and displaying an execution screen of a function corresponding to the user gesture input through the other display unit. The present invention provides a method and apparatus for controlling the operation of a mobile terminal.

The method according to an embodiment of the present invention for achieving the above objects, in the operation control method of the mobile terminal, corresponding to the dual mode activation, forming two output means for the user's gesture input and screen data output Process of doing; Detecting a gesture input of a user through one of the two output means; And outputting screen data of a program corresponding to the gesture through one of the two output means.

An apparatus according to an embodiment of the present invention for achieving the above object, the portable terminal, in the dual mode operation, the display unit divided into two output means for the user's gesture input and screen data display; And a controller configured to detect a gesture input transmitted by the display unit during the dual mode operation and to control output of screen data corresponding to the gesture input.

As described above, according to the method and apparatus for controlling the operation of a mobile terminal using the touch screen proposed in the present invention, it is possible to provide convenience in use as in a personal computer environment while considering the portability of the mobile terminal. According to the present invention, various programs of the mobile terminal can be easily and quickly performed by a user's simple gesture input, and the utilization thereof can be maximized in displaying respective screen data for a plurality of programs.

According to the present invention, a user can execute another program by a simple gesture input while viewing arbitrary screen data, and can check his new screen data without covering the screen data. Therefore, when using a plurality of programs at the same time, the screen data between the two can be confirmed at the same time, providing the user's field of view and convenience in using the program.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings. Note that, in the drawings, the same components are denoted by the same reference numerals as possible. In addition, detailed descriptions of well-known functions and configurations that may blur the gist of the present invention will be omitted.

The present invention relates to an operation control method and apparatus for a mobile terminal. In particular, an embodiment of the present invention proposes a method and apparatus for controlling the operation of a mobile terminal using a display unit of the mobile terminal and a user gesture input on the display unit. The gesture indicates a user's input operation performed according to a predetermined specific pattern.

The display unit of the present invention is formed as a touch screen and can execute a function according to a user gesture input on the touch screen. At this time, in the embodiment of the present invention, the screen data corresponding to the execution function may be displayed together with the screen data being displayed.

Particularly, the present invention executes a corresponding function corresponding to the gesture when the user's gesture input occurs on the data during data display according to the execution of a specific function of the mobile terminal, and displays screen data of the execution function according to the gesture, Simultaneous display may be performed through a separate display area or a separate display unit. For example, an input according to a user gesture is received through one of the two display units, and an execution screen of a function corresponding to the user gesture input is displayed through the other display unit.

Next, a method of controlling the operation of the mobile terminal using the touch screen and the user gesture in the mobile terminal having the touch screen according to an embodiment of the present invention will be described.

Hereinafter, for convenience of explanation, the display unit of the present invention will be described as two display units. In addition, a display unit for receiving a user gesture among the two display units will be referred to as an input display unit, and a display unit for displaying screen data of a program executed according to the user gesture will be referred to as an output display unit.

However, the present invention is not necessarily limited to two display units as will be described below, and of course, at least one display unit can be utilized by the application of the present invention. In addition, the division between the input display unit and the output display unit is shown for convenience of description, and each display unit may perform the same operation, and only one display unit for inputting a user's gesture is called an input display unit, and screen data according to the gesture. The other display unit for indicating a is called an output display unit. That is, it should be noted that the mobile terminal of the present invention is not limited to the contents described below, and thus can be applied to various embodiments based on the following embodiments.

1 is a diagram illustrating an operation control method of a mobile terminal using two display units according to an exemplary embodiment of the present invention.

In particular, in FIG. 1, the two display units are divided into an input display unit and an output display unit as described above. Accordingly, FIG. 1 illustrates an example of executing a corresponding program in response to a user gesture by the input display unit, and displaying screen data of an execution program through the output display unit.

Referring to FIG. 1, first, a mobile terminal displays first screen data of a first program according to a user's request in a normal mode (step 101). In this case, it is assumed that the screen data of the program may be displayed on any one of two display units, and in particular, in FIG. 1, the first screen data is displayed on the input display unit. When the mobile terminal detects a function activation request for dual mode execution while displaying the first screen data (step 103), the mobile terminal drives the dual mode (step 105). Herein, the function of the present invention is hereinafter referred to as the dual mode, and two display units will be described as being configured as a touch screen.

Therefore, the dual mode driving indicates that a gesture input for executing a program and at least two screen data are simultaneously entered through the two display units. In the dual mode, the input / output of two display units or two display regions is exchanged with each other. That is, when a gesture input occurs on any one display unit (or one sub display area), the other display unit (or the other sub display area) outputs screen data of a program corresponding to the gesture. .

In this case, in one of the two display units, the display unit performs an operation of displaying data in a general form, and the other display unit displays an input unit (for example, a keypad shape) of a general form to input a user. Perform the operation of receiving. On the other hand, any one display unit (input display unit) for displaying data in the general form in the dual mode performs an operation of receiving a user gesture on the data being displayed, and another display unit for displaying the input means (output The display unit performs an operation of displaying screen data of the corresponding program corresponding to the user gesture. Therefore, in the embodiment of the present invention, each of the display units is preferably formed of a touch screen.

In addition, in the dual mode, a function of the input display unit for receiving a user's gesture may be used by both display units, and other display units (output display units) other than the corresponding display unit (input display unit) to which the user's gestures are input may be used. The screen data of the corresponding program can be displayed.

Referring back to FIG. 1, the mobile terminal can detect a user's input after driving the dual mode (step 107). Here, the user input may occur in an input display unit displaying the first screen data or in another display unit, that is, an output display unit. That is, according to an exemplary embodiment of the present invention, a display unit for detecting a gesture input of a user is called an input display unit, and a display unit for displaying new screen data corresponding to the user's gesture input is called an output display unit. Hereinafter, it is assumed that the first screen data is displayed on the input display unit, and it is assumed that the input display unit detects a user's input while displaying the first screen data.

Next, when detecting the user's input, the portable terminal determines whether the input is an execution command for executing a set function (step 109). An operation of determining the execution command will be described in the description with reference to FIG. 2 to be described later.

As a result of the determination, if the input is not an execution command, the portable terminal can switch the first screen data of the input display unit (step 111). For example, the input may be a general touch input generated on first screen data while being displayed on the input display unit. In this case, among the objects constituting the first screen data currently displayed on the input display unit, the screen data may be converted into screen data corresponding to the corresponding object where the touch input occurs. Here, the object may be each link item of a web page or icons of a specific menu. This example will be described with reference to the following examples.

As a result of the determination, if the input is an execution command, the portable terminal executes a program according to the execution command (step 113). Subsequently, the portable terminal displays screen data (second screen data) of the program to be executed through the output display unit (step 115). That is, screen data of a program corresponding to an execution command generated in the input display unit is displayed through the output display unit. Accordingly, while displaying the existing data, that is, the first screen data through the input display unit, the data of the corresponding program corresponding to the execution command, that is, the second screen data is displayed through the output display unit, thereby displaying two different screens. Data can be displayed through each display unit.

2 is a diagram illustrating an operation of determining an execution command according to a user input in a display unit according to an exemplary embodiment of the present invention.

Referring to FIG. 2, when the mobile terminal detects a user input (step 201), the portable terminal determines a type of the input (step 203). That is, the mobile terminal checks whether the input corresponds to a set gesture or a general input (step 205).

If the input is not an input by a set gesture, the mobile terminal checks a command corresponding to the input (step 207). Subsequently, the portable terminal executes a function corresponding to the command (step 209). In this case, the portable terminal converts the display data of the input display unit into screen data corresponding to the execution of the function and displays it (step 211).

If the input is an input by a set gesture, the mobile terminal identifies the gesture by comparison with preset setting information (step 213). That is, it is determined whether there is an execution command corresponding to the gesture by the comparison (step 215). This will be described with reference to Table 1 below.

Table 1 shows definitions of user input gestures, and the user can simply execute a corresponding program mapped to the corresponding gestures through any one of the above gestures. Such a gesture and corresponding program mapping are not necessarily limited to the example of Table 1 above. Therefore, the gesture and the corresponding program mapping can be downloaded according to the user setting (editing / adding / deleting) or from an associated server providing such setting information. In addition, the gesture and mapping program as described above can be transmitted and received with other mobile terminals, and of course, can be shared with each other.

Next, if there is no execution command corresponding to the gesture input, the mobile terminal may perform the set thawing operation (step 217). For example, a registered execution command corresponding to a gesture input of a user, that is, a pop-up window may be displayed to guide that the program does not exist. In addition, the mobile terminal may provide a previously registered gesture operation and its corresponding function as described in Table 2 through a pop-up window.

In addition, the mobile terminal may perform a function of checking whether the input gesture is registered. That is, the mobile terminal may register and map a program corresponding to the input gesture in response to a user request.

Next, if there is an execution command corresponding to the gesture, the mobile terminal checks the execution command (step 219). That is, the mobile terminal checks the corresponding program mapped to the identifying gesture. Subsequently, the portable terminal executes the corresponding program according to the execution command (step 221). Thereafter, the portable terminal displays data of the executed program through the output display unit as shown in FIG.

In the above, the operation control method of the mobile terminal having two display units according to an exemplary embodiment of the present invention has been described. Next, the operation of the present invention as described above with reference to FIGS. 1 and 2 will be described through screen examples. However, it should be noted that the screen examples of the present invention are not limited to the contents described below, and thus can be applied to various embodiments based on the following embodiments.

3 is a diagram illustrating an example of a screen when the mobile terminal is in a normal mode according to an embodiment of the present invention. In particular, in FIG. 3, it is assumed that screen data of a specific web page connected by the Internet function of the portable terminal is displayed on an input display unit.

Before describing FIG. 3, when driving in a dual mode according to an exemplary embodiment of the present disclosure, any screen data (eg, screen data of a web page, etc.) is displayed through an input display unit before a user's gesture input occurs. The output display section may be in a blank state without any screen data or any screen data display as described below.

That is, of course, arbitrary screen data may be displayed on the output display unit during dual mode driving. In this case, the screen data of the program according to the gesture input may be displayed on the previous screen data of the output display unit by multitasking when the gesture is input.

Referring to FIG. 3, FIG. 3 illustrates an example in which the mobile terminal of the present invention operates in a normal mode. That is, specific screen data may be displayed on the display unit (input display unit) in charge of the display function in the normal mode, and a key signal according to a user's touch input is generated on the display unit (output display unit) in charge of the input function in the normal mode. The screen data of the input means can be displayed. The output display unit and the input display unit may be formed as a touch screen, and the input unit may be a means for detecting a user's touch input in the form of a keypad of a general key arrangement.

On the other hand, in the state as shown in FIG. 3, the user can activate the dual mode by the function key provided in the portable terminal to perform the function of the present invention. The function key is a key set to simply execute the dual mode of the present invention and is provided for the user's convenience. Therefore, when the user's gesture for the dual mode execution of the present invention is configured, the dual mode may be driven by the corresponding gesture input. In this case, the function key may be omitted.

In addition, when the mobile terminal is driven in the dual mode, the output display unit is to maintain the display of the input means, display the blank screen data, display the specific screen data (background screen, etc.) according to the user setting, and display the input display unit One of the screen data corresponding to the user setting can be displayed among the display of the screen data.

In addition, in the embodiment of the present invention, in Fig. 3 and Figs. 4 to 7 to be described later, the case where the portable terminal of the present invention is a folder type portable terminal as an example. Therefore, the folder type is generally used in a landscape mode, and when performing a function according to an embodiment of the present invention, it is possible to operate in the landscape mode as well as in the portrait mode. In particular, when operating in the portrait mode, that is, when the portable terminal is rotated in the left or right direction in the state shown in FIG. 3 to operate in the portrait mode, the direction of the screen data displayed on each display unit correspondingly Assume that the switch corresponds to the direction. Since the screen data display direction switching according to the horizontal / vertical mode is a known technique, the present invention proposes a method for displaying an operation according to a user gesture using the same. In the embodiment of the present invention, a case of operating in the portrait mode will be described as an example. Hereinafter, the operation of the present invention according to the switching to the dual mode of the present invention in the general mode as shown in FIG. 3 will be described with reference to FIGS.

4 to 7 illustrate examples of a screen data display operation according to a gesture input of a user in a mobile terminal according to an exemplary embodiment of the present invention. In particular, in FIGS. 4 to 7, it is assumed that screen data of a specific web page connected by the Internet function of the portable terminal is displayed on the input display unit.

1 to 4, FIG. 4 illustrates a screen example for simultaneously displaying a program execution and corresponding screen data according to a “flick” input among a user's gesture input. That is, in response to the user's request for vertical mode switching and dual mode activation in the state as shown in FIG. 3, the user's gesture is input while the display direction of the screen data is changed.

As shown in FIG. 4, while displaying screen data of a web page on an input display unit, a user may generate a flick input set in the present invention during a touch input. When the portable terminal detects the flick input, the portable terminal recognizes that the flick input is link execution as defined in Table 1. Subsequently, the portable terminal recognizes a corresponding coordinate at which the flick input occurs, identifies an object located at the coordinate and executes a link item linked thereto. That is, the link to the linked web page is performed. The mobile terminal then displays screen data of a new web page corresponding to the object via an output display unit. For example, when a user's flick gesture is input on an object called "news" among objects of screen data of the input display unit, the portable terminal displays a corresponding web page linked to the "news" object on the output display unit. Display. In this way, the user can display the screen data of the main web page through the input display unit and simultaneously display the screen data of the sub web page through the output display unit, thereby making web surfing simpler and more intuitive. .

1 to 5, FIG. 5 illustrates a screen example for simultaneously displaying a program execution and corresponding screen data according to a “C” type gesture input among user's gesture inputs. That is, in FIG. 5, when a gesture corresponding to the "C" form is input among the gesture inputs of the user in the same state as in FIG. 3 or 4, execution of a program (calculator) mapped to the gesture and a screen of the corresponding program are performed. An example of the operation of displaying data simultaneously is shown.

As shown in FIG. 5, while displaying screen data of a web page on an input display unit, a user may generate a gesture input of type “C” set in the present invention during a touch input. When the portable terminal detects the "C" gesture input, the portable terminal recognizes that the "C" gesture input is a calculator execution, as defined in Table 1, and executes a calculator program that is a program corresponding to the "C" gesture. Run Subsequently, the portable terminal displays screen data corresponding to the calculator program through an output display unit. In this way, the user can display the screen data of the web page through the input display unit and simultaneously display the screen data of the calculator program through the output display unit, thereby simultaneously utilizing the web surfing and calculation functions. That is, the user can view the web page through the input display unit and use the calculation function by the calculator program through the output display unit. In this case, the user may use the calculation function by the touch input method in the output display unit.

1 to 6, FIG. 6 illustrates an example of a screen for simultaneously displaying a program execution and corresponding screen data according to a gesture input of “W” type among user's gesture inputs. That is, in FIG. 6, when a gesture corresponding to the "W" form of the user's gesture input is input in the same state as in FIGS. 3 to 5, the program mapped to the gesture (QWERTY Key) is executed. And an example of an operation of simultaneously displaying screen data of the program.

As shown in FIG. 5, while displaying screen data of a web page on an input display unit, a user may generate a gesture input of “W” type set in the present invention during a touch input. When the portable terminal detects the "W" gesture input, the mobile terminal recognizes that the "W" gesture input is a QWERTY key execution as defined in Table 1, and is a QWERTY key that is a program corresponding to the "W" gesture. Run the program. Subsequently, the portable terminal displays screen data corresponding to the qwerty key program through an output display unit. In this way, the user displays the screen data of the web page through the input display unit and simultaneously displays the screen data of the QWERTY key program through the output display unit, thereby allowing keys such as keyboard input in web surfing and general personal computer environments. Inputs can be used simultaneously. That is, the user may view the web page through the input display unit and use the input function by the qwerty key through the output display unit. In this case, in the output display unit, a user may use a key input function by a qwerty key by a touch input method.

1 to 7, FIG. 7 illustrates an example of a screen for simultaneously displaying a program execution and corresponding screen data according to a gesture input of “M” type in a user's gesture history. That is, in FIG. 7, when a gesture corresponding to the "M" form of the user's gesture input is input in the same state as in FIGS. 3 to 6, execution of a program (memo pad) mapped to the gesture and a screen of the corresponding program are performed. An example of the operation of displaying data simultaneously is shown.

As illustrated in FIG. 7, while displaying screen data of a web page on an input display unit, a user may generate a gesture input of “M” type set in the present invention during a touch input. When the portable terminal detects the "M" gesture input, the mobile terminal recognizes that the "M" gesture input is notepad execution, as defined in Table 1, and executes a notepad program corresponding to the "M" gesture. Run Subsequently, the portable terminal displays screen data corresponding to the memo pad program through an output display unit. In this way, the user can simultaneously use the web surfing and notepad functions by displaying the screen data of the web page through the input display unit and simultaneously displaying the screen data of the notepad program through the output display unit. That is, the user can view the web page through the input display unit and use the memo function by the notepad program through the output display unit. In this case, the user may use the calculation function by the touch input method in the output display unit. In addition, when using the memo function, an input means (QWERTY key, keypad, etc.) for inputting information may be activated by a popup to perform input.

As described above with reference to FIGS. 4 to 7, according to an exemplary embodiment of the present disclosure, an operation for the other display unit may be determined by a gesture input generated from one of the two display units. . That is, when a gesture input occurs on one display unit, the present invention provides screen data of a result according to the gesture input on the other display unit.

Meanwhile, although the detailed description is omitted in FIGS. 3 to 7, after performing any one of FIGS. 3 to 7, other operations may be performed subsequently. For example, the user may execute the calculator program by the "C" gesture as shown in FIG. 5, and may execute the notepad program by the "M" gesture as shown in FIG. Meanwhile, the simultaneous execution of a plurality of programs may be provided by a multitasking function.

In the above, the operation when the display unit of the present invention is composed of two has been described. However, the mobile terminal of the present invention is not necessarily operated by two display units, and of course, the two or more display units can also operate. In addition, the present invention can be operated on one display unit, which will be briefly described with reference to FIGS. 8A to 9C.

8A to 8C illustrate control operations by screen division of a display unit according to an exemplary embodiment of the present invention. In particular, FIGS. 8A to 8C illustrate an example of a mobile terminal having a full touch screen.

8A to 8C, FIG. 8A illustrates an example of a screen displaying arbitrary screen data according to a user's request by the full touch screen. For example, it may be an example of a screen displaying screen data of a subject photographed by a camera function, screen data of a pre-stored photo file, screen data of a video file, and the like.

In the above state, when the activation of the function of the present invention, that is, the dual mode activation is requested by the user request, the portable terminal displays at least two sub-displays of the entire display area of the full touch screen as shown in FIG. 8B. Can be divided into regions. In this case, when dividing the entire display area of the display unit, a procedure of resizing may be performed according to the screen size of the sub display area dividing the screen data displayed on the entire display area. In addition, the number of divisions of the entire display area may depend on user setting. In addition, the sub display area displaying the screen data displayed on the entire display area may be pre-allocated by the user or set to a default value.

In addition, in FIG. 8B, another sub display area other than the sub display area for displaying the screen data is illustrated as an example. However, the other sub display area is the same as described above with the operation description of the output display unit. Any screen data according to the setting can be displayed. Subsequently, in the state as shown in FIG. 8B, when the user's gesture is input, the portable terminal simultaneously displays the program execution mapped to the gesture and the screen data of the corresponding program.

For example, as shown in FIG. 8C, while displaying the screen data on the divided sub display area, the user may generate a gesture input of type “S” set in the present invention during the touch input. When the mobile terminal detects the "S" gesture input, the mobile terminal recognizes that the "S" gesture input is a text message execution, as defined in Table 1, and is a program corresponding to the "S" gesture. Run the program. Subsequently, the portable terminal displays screen data corresponding to the text message program through the remaining sub display areas.

In this way, the user can display the specific screen data through the divided sub display area and simultaneously display the screen data of the text message program through the other sub display areas, thereby simultaneously using the video playback and text message functions. . That is, the user may view the screen data according to the image reproduction through one sub display area and use the text message checking / composing function by the text message program.

9A to 9C are diagrams illustrating a control operation by screen division of a display unit according to an exemplary embodiment of the present invention. In particular, FIGS. 9A to 9C illustrate examples of a mobile terminal having a full touch screen.

9A to 9C, FIG. 9A illustrates an example of a screen displaying arbitrary screen data according to a user's request by the full touch screen. For example, it may be an example of a screen displaying screen data of a subject photographed by a camera function, screen data of a pre-stored photo file, screen data of a video file, and the like.

Next, in the above state, when the user's gesture is input as shown in FIG. 8B, the portable terminal simultaneously displays the program execution mapped to the gesture and the screen data of the corresponding program.

For example, as shown in FIG. 8B, while displaying the screen data through the entire display area, the user may generate a gesture input of “S” type set in the present invention during the touch input. When the mobile terminal detects the "S" gesture input, the mobile terminal recognizes that the "S" gesture input is a text message execution, as defined in Table 1, and is a program corresponding to the "S" gesture. Run the program. Subsequently, the mobile terminal overlays and displays screen data corresponding to the text message program on the screen data. In this case, the overlay display may be provided through an entire display area of the full touch screen or a display area of a part of the entire display area.

As described above, the user can simultaneously display the image data and the text message function by simultaneously displaying the screen data of the text message program according to the user gesture input while displaying the specific screen data. That is, the user may view the screen data according to the image reproduction through the entire display area and use the text message checking / composing function by the text message program.

In the above, with reference to FIGS. 1 to 9C, a method and screen examples of executing a function of a mobile terminal and displaying screen data thereof in response to a gesture input of a user in a mobile terminal having a touch screen according to an embodiment of the present invention. It was described. Next, a mobile terminal performing the operation of the present invention as described above with reference to FIGS. 1 to 9 will be described. However, it should be noted that the mobile terminal of the present invention is not limited to the contents described below, and thus can be applied to various embodiments based on the following embodiments.

Here, prior to the detailed description of the mobile terminal of the present invention, the mobile terminal of the present invention will be described as a mobile communication terminal. However, the present invention is not necessarily limited to the mobile communication terminal.

Therefore, the portable terminal of the present invention includes all mobile communication terminals operating according to communication protocols corresponding to various communication systems, including a portable multimedia player (PMP), a digital broadcasting player, and a PDA (Personal Digital) having a touch screen. It may include all information communication devices and multimedia devices such as assistants, mobile game terminals and smart phones, and applications thereof. Next, a schematic structure of the mobile terminal of the present invention will be described with reference to FIG. 10.

10 is a diagram schematically illustrating a configuration of a mobile terminal according to an embodiment of the present invention. In particular, in FIG. 10, the mobile terminal of the present invention is shown as an example of a mobile communication terminal, but the mobile terminal of the present invention is not necessarily limited to the mobile communication terminal.

1 to 10, a portable terminal according to an exemplary embodiment of the present invention includes a wireless communication unit 1010, an input unit 1020, an audio processing unit 1030, a first display unit 1040, and a second terminal. The display unit 1050 includes a storage unit 1060, a control unit 1070, and the like. In addition, the storage unit 1060 includes an execution command storage area 1065.

The wireless communication unit 1010 communicates with the mobile terminal. The wireless communication unit 1010 forms a communication channel established with a supportable mobile communication network to perform communication such as voice communication, video communication, and data communication. The wireless communication unit 1010 may include an RF (Radio Frequency) transmitter for up-converting and amplifying a frequency of a transmitted signal, and an RF receiver for low-noise amplifying and down-converting a received signal. In particular, the wireless communication unit 1010 receives and provides a web page according to a user request through communication with a specific web server under the control of the controller 1070.

The input unit 1020 receives various text information, and transmits a signal input in connection with setting of various functions and function control of the mobile terminal to the controller 1070. The input unit 1020 may generate an input signal according to a user's action, and may include at least one of a keypad and a touch pad. The input unit 1020 may be configured in the form of a single touch panel (or touch screen) together with the first display unit 1040 or the second display unit 1050 to simultaneously perform input and display functions. In particular, the input unit 1020 may include at least one function key (not shown) for performing a function of the present invention. The function key may be a function key for activating the dual mode of the present invention. If the portable terminal of the present invention is operated by the first and second display units 1040 and 1050 or the full touch screen, the configuration of the input unit 1020 may be omitted.

The audio processor 1030 is connected to a microphone (MIC) and a speaker (SPK, Speaker), and outputs the audio signal input from the microphone (MIC) to the control unit 1070, the control unit 1070 The audio signal is input from the audio signal converted into an audible sound through the speaker SPK. That is, the audio processor 1030 converts the analog voice signal input from the microphone MIC into a digital voice signal, or converts the digital voice signal input from the control unit 1070 into an analog voice signal to the speaker SPK. ) The audio processor 1030 may reproduce various audio components (eg, an audio signal due to playing an MP3 file, etc.) generated in the portable terminal according to a user's selection.

The first and second display units 1040 and 1050 display screen data generated while the mobile terminal performs a function, and display status information according to a user's key operation and function setting. The first and second display units 1040 and 1050 visually display various signals and color information output from the control unit 1070. In an embodiment of the present invention, the first and second display units 1040 and 1050 represent a touch screen. Accordingly, the first and second display units 1040 and 1050 may operate as input means for receiving an input from a user.

That is, the first and second display units 1040 and 1050 are input devices and display devices capable of inputting and displaying data in one configuration. The first and second display units 1040 detect outputs 1041 and 1051 that display various screen data and a touch generated by a user, and generate a signal according to the detected touch to control the controller 1070. Each of the touch sensing unit 1043 and 1053 transmitted to each other. The controller 1070 may perform a function corresponding to an area where a touch is generated by a signal transmitted from the touch sensor 1043.

In particular, when the dual mode of the mobile terminal is activated, the first and second display units 1040 perform one or two display unit operations among the above-described operations of the input display unit and the output display unit. For example, when the first display unit 1040 detects a user's gesture input by the touch sensing unit 1043 while displaying any screen data through the output unit 1041, the first display unit 1040 controls the gesture input to the control unit. Forward to 1070. Then, the second display unit 1050 displays the screen data of a program corresponding to the gesture input through the output unit 1051 under the control of the controller 1040. In addition, each of the first and second display units 1040 and 1050 may be provided by dividing the entire display area into any number of sub display areas according to an exemplary embodiment of the present invention.

The storage unit 1060 may include a read only memory (ROM) and a random access memory (RAM). The storage unit 1060 may store various data generated and utilized in the mobile terminal. The data includes data generated according to program execution of the portable terminal and all types of data that can be generated using the portable terminal or received and stored from an external source (base station, counterpart portable terminal, personal computer, etc.). In particular, the data may include a user interface provided by the portable terminal, various setting information according to the use of the portable terminal, and an execution command for executing a program according to a user gesture in the dual mode of the present invention.

In particular, the storage unit 1060 stores information in which an execution command for executing a corresponding program according to each gesture is mapped, and this information corresponds to what has been described in the description with reference to Table 1 above. It may be stored in the storage area 1065.

In addition, the storage unit 1060 may store a program for controlling the general operation of the mobile terminal and a program for controlling the operation of the mobile terminal using the touch screen of the present invention. Such a program may be a program corresponding to the operation of the present invention as described above with reference to FIGS. 1 to 10. Such programs may be stored in an application storage area (not shown) of the storage unit 1060.

In addition, the storage unit 1060 may include one or more buffers for temporarily storing data generated during the above-described program execution. In addition, the storage unit 1060 may be configured inside the mobile terminal, and may also be configured externally, such as a smart card, and may include all internal / external storage media. . The storage unit 1060 may include a ROM, a RAM, a flash memory, and the like, and the storage unit 1060 may include one memory configured or integrated with the ROM, RAM, and flash memory. Or two memory, for example, may be composed of MCP (Multi Chip Package) memory. In addition, the storage unit 1060 may further include a dual-ported RAM (DPRAM) allocated for data sharing.

The controller 1070 performs an overall control function for the portable terminal and controls the signal flow between the blocks in the portable terminal. The controller 1070 controls signal flow between components such as the wireless communication unit 1010, the input unit 1020, the audio processor 1030, the display unit 1040, the storage unit 1060, and the like. do.

The control unit 1070 detects a gesture input transmitted by the first and second display units 1040 and 1050 when the dual mode is activated and outputs screen data corresponding to the gesture input. To control. In particular, the controller 1070 determines an operation of the other display unit by a gesture input generated by one of the first and second display units 1040 and 1050. That is, when the controller 1070 detects a user's gesture input through any one of the first and second display units 1040 and 1050, the controller 1070 controls execution of a program corresponding to the gesture and executes the execution. The screen data for the program is controlled to be output through the other display unit. For example, when the controller 1070 detects a gesture input by the first display unit 1040 while displaying any screen data through the first display unit 1040, the controller 1070 displays screen data of a program corresponding to the gesture input. Is controlled to be displayed through the second display unit 1050.

In addition, the controller 1070 divides the entire display area of the first and second display units 1040 and 1050 into any number of sub display areas, detects a gesture input through each divided sub display area, Control output of screen data corresponding to the gesture input.

The control unit 1070 for controlling the operation as described above may control the overall operation of the present invention as described in the above description with reference to FIGS. 1 to 10. The above-described function control of the controller 1070 may be implemented in software to process the operation of the present invention.

In addition, the controller 1070 may include a baseband module for a mobile communication service of the portable terminal. The baseband module converts a signal to be transmitted through channel coding and interleaving, modulates the signal to be provided to the RF module, and demodulates, equalizes, and equalizes the signal provided from the RF module. Channel decoding and deinterleaving may be performed. Herein, a baseband module is described as being provided in the controller 1070. However, the baseband module may be provided in the controller 1070 and the wireless communication unit 1010, respectively, or the controller 1070 and the wireless device. It may be provided separately from the communication unit 1010.

10 illustrates a schematic configuration example of the mobile terminal for convenience of description. However, the portable terminal of the present invention is not necessarily limited to the above configuration.

Therefore, the portable terminal of the present invention may further include components not mentioned above, such as a digital broadcasting receiving module, a short range communication module, and an internet communication module, according to the provision form thereof. These components may not be enumerated because all of them vary according to the convergence trend of digital devices, but the components equivalent to those mentioned above may be additionally included in the portable terminal. Can be. In addition, the mobile terminal of the present invention may be excluded or replaced with other blocks in the above configuration according to the form of the provision. This will be readily understood by those of ordinary skill in the art.

It should be noted that the embodiments of the present invention disclosed in the present specification and drawings are only illustrative of the present invention in order to facilitate the understanding of the present invention and are not intended to limit the scope of the present invention. It will be apparent to those skilled in the art that other modifications based on the technical idea of the present invention can be carried out in addition to the embodiments disclosed herein.

1 is a view illustrating a method of controlling a mobile terminal using two display units according to an exemplary embodiment of the present invention;

2 is a view illustrating an operation of determining an execution command according to a user input in a display unit according to an exemplary embodiment of the present disclosure;

3 is a diagram illustrating an example of a screen when the mobile terminal is in a normal mode according to an embodiment of the present invention;

4 to 7 are views showing an example of the screen data display operation according to the user's gesture input in the mobile terminal according to an embodiment of the present invention,

8A to 9C are views illustrating a control operation by screen division of a full touch screen according to an embodiment of the present invention;

10 is a view schematically showing the configuration of a mobile terminal according to an embodiment of the present invention.

Claims (23)

In the operation control method of a mobile terminal, In response to the dual mode activation, forming two output means for a user's gesture input and screen data output; Detecting a user's gesture input through any one of the two output means; And outputting screen data of a program corresponding to the gesture through one of the two output means through the other output means. The method of claim 1, wherein the two output means Any two of the two touch screens separately provided with the first touch screen and the second touch screen and two sub display areas divided into a first sub display area and a second sub display area. Operation control method of a mobile terminal using a touch screen, characterized in that one. The method of claim 2, wherein the outputting process, Determining a type of the input when the user's input is detected through any one of the two output means; If the input is not an input by a set gesture, executing a function of a command corresponding to the input; If the input is an input by a set gesture, determining whether an execution command corresponding to the gesture exists and executing a corresponding program according to the execution command; And outputting screen data of the program to be executed through one output means other than the one output means. The method of claim 3, wherein the performing of the And converting the screen data previously displayed on the output means into screen data corresponding to the execution of the function, and displaying the screen data. The method of claim 3, And if the execution command corresponding to the gesture does not exist, checking whether or not the gesture is registered. The method of claim 2, wherein the forming process, In the normal mode before the dual mode activation, performing the screen data display function through any one of the two touch screens, and performing the input means display function through the other touch screen; When the dual mode is activated, if a user's gesture input is detected through one of the two touch screens, a process of switching to a function of displaying screen data of a program corresponding to the gesture through the other touch screen is performed. Operation control method of a mobile terminal using a touch screen comprising a. The method of claim 6, When the user's gesture input is detected through the first touch screen, screen data of a program corresponding to the gesture is output through the second touch screen, And detecting a user's gesture input through the second touch screen, outputting screen data of a program corresponding to the gesture through the first touch screen. The method of claim 2, wherein the forming process, In the normal mode before the dual mode activation, performing an input / output function through the entire display area of the single touch screen; When the dual mode is activated, the entire display area is divided into two sub display areas, and when a user's gesture input is detected through one of the sub display areas, the gesture is displayed through the other sub display area. And a step of switching to a function for displaying screen data of a program corresponding to the touch screen. The method of claim 8, Displaying screen data that is being displayed previously through the previously allocated sub display area among the two sub display areas; And detecting a user's gesture input generated on the screen data, outputting screen data of a program corresponding to the gesture through a sub display area other than the sub display area for detecting the gesture input. Operation control method of a mobile terminal using a touch screen. The method of claim 9, wherein the displaying is performed. And resizing the previously displayed screen data in accordance with a size of the pre-allocated sub display area. In the mobile terminal, In the dual mode operation, the display unit is divided into two output means for the user's gesture input and screen data display, And a controller configured to detect a gesture input transmitted by the display unit during the dual mode operation and to control output of screen data corresponding to the gesture input. The method of claim 11, wherein the display unit, A first touch screen and a second touch screen, And the controller determines an operation of the other display unit by a gesture input generated from one of the first and second display units. The method of claim 12, wherein the control unit, When a gesture input is detected through any one of the first and second display units, controlling the execution of a program corresponding to the gesture and controlling the screen data for the program to be displayed through the other display unit. Characterized in a mobile terminal. The method of claim 11, wherein the display unit, Including a first display area and a second display area on one touch screen, And the controller determines an operation of the other display area by a gesture input generated in one of the first and second display areas. The method of claim 14, wherein the control unit, In the dual mode operation, the entire display area of the touch screen is divided into the first and second display areas, and previously displayed screen data of any one of the first and second display areas is previously allocated. The mobile terminal, characterized in that output to. The method of claim 15, wherein the control unit, And resizing the previously displayed screen data corresponding to the size of any one of the pre-allocated display areas and then outputting the screen data. The method of claim 11, wherein the control unit, When a gesture set through the display unit is input during the dual mode operation, it is determined whether there is an execution command corresponding to the gesture and controlling output of screen data of the corresponding program according to the execution command. The method of claim 17, wherein the control unit, In the dual mode operation, if an input other than the set gesture occurs, the mobile terminal, characterized in that for switching the screen data displayed on the display unit to the screen data corresponding to the input and output. The method of claim 17, wherein the control unit, In the dual mode operation, if a gesture other than the set gesture occurs, it is checked whether the gesture is registered. The method of claim 12, wherein the display unit, In the normal mode before the dual mode operation, a screen data display function is performed through one of the first and second touch screens, and an input means display function is performed through the other touch screen. In the dual mode operation, if a user's gesture input is detected through one of the first and second touch screens, screen data of a program corresponding to the gesture is displayed through the other touch screen. Mobile terminal. The method of claim 20, wherein the display unit, When the user's gesture input is detected through the first touch screen, screen data of a program corresponding to the gesture is displayed through the second touch screen, And detecting a user's gesture input through the second touch screen, displaying screen data of a program corresponding to the gesture through the first touch screen. The method of claim 14, wherein the display unit, In the normal mode before the dual mode operation, perform an input / output function through the entire display area of the one touch screen, In the dual mode operation, the entire display area is divided into the first and second display areas, and when the user's gesture input is sensed through any one of the first and second display areas, And a screen data of a program corresponding to the gesture through a display area. The method of claim 22, wherein the display unit, Displaying previously displayed screen data through any one of the first and second display areas previously allocated; And when a user's gesture is input on the screen data, displaying screen data of a program corresponding to the gesture through a display area other than the display area where the gesture is input.

Images