KR20120045528A - Mobile terminal and operation control method thereof - Google Patents

Abstract

PURPOSE: A portable terminal and operation control method thereof are provided to display an execution screen on an apple board area by executing an application corresponding to a gesture input signal. CONSTITUTION: A control unit displays an operation screen on a display unit(S200). The control unit establishes an apple board area which is able to be displayed on an execution screen of a specific application(S210). The control unit executes the application corresponding to a gesture input signal by sensing the gesture input signal through the apple board area(S215,S220). The control unit displays the execution screen corresponding to the execution of the application on the apple board area(S225).

Description

Mobile terminal and operation control method

The present invention relates to a mobile terminal and a method for controlling the operation thereof, and more particularly, to a mobile terminal and an operation control method for executing an application selected by the user by setting an apple board area in one area of the screen.

A portable terminal is a portable device that is portable and has one or more functions of making voice and video calls, inputting and outputting information, and storing data. As the functions of the portable terminal have diversified, they have complicated functions such as photographing and photographing, playing music files and video files, receiving games, receiving broadcasts, and wireless internet, and have developed a comprehensive multimedia player, .

In the mobile terminal implemented in the form of such a multimedia device, new attempts have been applied in various ways in terms of hardware and software to implement complex functions. For example, a user interface environment for a user to search for or select a function easily and conveniently. In addition, while the mobile terminal is regarded as a personal portable product for expressing the personality of the user, various types of design changes such as a double-sided LCD (Liquid Crystal Display) and a front touch screen are also required.

On the other hand, in the case of a mobile terminal having a front touch screen such as a tablet type, a character may be input or various other functions may be executed by a touch input through the touch screen. In the case of such a portable terminal, since the operation can be controlled using a touch screen even without a separate keypad or keyboard, the portable terminal can be more suitable for a design considering mobility and portability.

However, even in the case of such a mobile terminal, it is cumbersome in use because it is necessary to sequentially select related menus in order to execute a plurality of applications, such as executing a plurality of functions or operation menus. do.

Accordingly, in order to conveniently execute a plurality of applications in the mobile terminal having a touch screen, there is a need to control the operation of the mobile terminal through a new input method different from the existing input method.

Accordingly, an object of the present invention is to provide a portable terminal and an operation control method for setting an apple board area in one area of a screen and executing an application in the apple board area according to a preset gesture input.

According to an aspect of the present invention, there is provided a method of controlling an operation of a mobile terminal, the method comprising: displaying an operation screen on a display unit, and setting an apple board area capable of displaying an execution screen of a specific application on an area of the operation screen; And detecting a preset gesture input through the apple board region, executing an application corresponding to the preset gesture input, and displaying an execution screen corresponding to the execution of the application on the apple board region. Include.

In addition, the portable terminal according to the present invention sets a display unit for displaying an operation screen and an apple board area capable of displaying an execution screen of a specific application in one area of the operation screen, And a controller configured to execute an application corresponding to the preset gesture input and display an execution screen corresponding to the execution of the application on the apple board area when the preset gesture input is detected.

According to the present invention, an apple board area may be set in one area of an operation screen by using a touch input or the like, and a corresponding application is executed according to a preset gesture input, and the execution screen according to the execution of the application is displayed in the apple board area. I can display it. Accordingly, the user can conveniently execute several applications on the touch screen.

1 is a block diagram of a portable terminal according to an embodiment of the present invention;
2 is a perspective view of a portable terminal according to an embodiment of the present invention;
3 and 4 are flow charts provided for explaining the operation control method of the portable terminal according to an embodiment of the present invention;
5 to 11 are views referred to for the description of the process of setting the apple board area according to an embodiment of the present invention, and
12 to 29 are diagrams for describing a process of executing various applications using an apple board area according to an embodiment of the present invention.

Hereinafter, with reference to the drawings will be described the present invention in more detail.

The portable terminal described in the present specification may be used in various applications such as a mobile phone, a smart phone, a notebook computer, a digital broadcasting terminal, a PDA (Personal Digital Assistants), a PMP (Portable Multimedia Player), a camera, tablet computers, e-book terminals, and the like. In addition, suffixes "module" and " part "for the components used in the following description are given merely for convenience of description, and do not give special significance or role in themselves. Therefore, the "module" and "unit" may be used interchangeably.

FIG. 1 is a block diagram of a portable terminal according to an exemplary embodiment of the present invention. Referring to FIG. Referring to FIG. 1, a mobile terminal according to an embodiment of the present invention will be described in terms of components according to functions.

1, the portable terminal 100 includes a wireless communication unit 110, an A / V input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, A memory 160, an interface unit 170, a control unit 180, and a power supply unit 190. Such components may be configured by combining two or more components into one component, or by dividing one or more components into two or more components as necessary when implemented in an actual application.

The wireless communication unit 110 may include a broadcast receiving module 111, a mobile communication module 113, a wireless Internet module 115, a short distance communication module 117, and a GPS module 119.

The broadcast receiving module 111 receives at least one of a broadcast signal and broadcast related information from an external broadcast management server through a broadcast channel. In this case, the broadcast channel may include a satellite channel, a terrestrial channel, and the like. The broadcast management server may refer to a server for generating and transmitting at least one of a broadcast signal and broadcast related information and a server for receiving at least one of the generated broadcast signal and broadcast related information and transmitting the broadcast signal to the terminal.

The broadcast related information may mean information related to a broadcast channel, a broadcast program, or a broadcast service provider. The broadcast signal may include not only a TV broadcast signal, a radio broadcast signal, and a data broadcast signal, but also a broadcast signal having a data broadcast signal combined with a TV broadcast signal or a radio broadcast signal. The broadcast related information may also be provided through a mobile communication network, and in this case, may be received by the mobile communication module 113. Broadcast related information may exist in various forms. For example, it may exist in the form of Electronic Program Guide (EPG) of Digital Multimedia Broadcasting (DMB) or Electronic Service Guide (ESG) of Digital Video Broadcast-Handheld (DVB-H).

The broadcast receiving module 111 receives broadcast signals using various broadcasting systems. In particular, the broadcast receiving module 111 may be a Digital Multimedia Broadcasting-Terrestrial (DMB-T), a Digital Multimedia Broadcasting-Satellite (DMB-S) ), Digital Video Broadcast-Handheld (DVB-H), Integrated Services Digital Broadcast-Terrestrial (ISDB-T), and the like. In addition, the broadcast receiving module 111 may be configured to be suitable for all broadcasting systems that provide broadcasting signals, as well as the digital broadcasting system. The broadcast signal and / or broadcast related information received through the broadcast receiving module 111 may be stored in the memory 160.

The mobile communication module 113 transmits and receives a radio signal with at least one of a base station, an external terminal, and a server on a mobile communication network. Here, the wireless signal may include various types of data according to voice call signal, video call signal, or text / multimedia message transmission and reception.

The wireless Internet module 115 refers to a module for wireless Internet access, and the wireless Internet module 115 can be embedded in the mobile terminal 100 or externally. Wireless Internet technologies may include Wireless LAN (Wi-Fi), Wireless Broadband (Wibro), World Interoperability for Microwave Access (Wimax), High Speed Downlink Packet Access (HSDPA), and the like.

The short-range communication module 117 refers to a module for short-range communication. Bluetooth, radio frequency identification (RFID), infrared data association (IrDA), ultra wideband (UWB), ZigBee, and the like can be used as the short distance communication technology.

A GPS (Global Position System) module 119 receives position information from a plurality of GPS satellites.

The A / V (Audio / Video) input unit 120 is for inputting an audio signal or a video signal, and may include a camera 121 and a microphone 123. The camera 121 processes image frames such as still images or moving images obtained by the image sensor in the video call mode or the photographing mode. The processed image frame may be displayed on the display unit 151.

The image frame processed by the camera 121 may be stored in the memory 160 or transmitted to the outside through the wireless communication unit 110. The camera 121 may be equipped with two or more cameras according to the configuration of the terminal.

The microphone 123 receives an external sound signal by a microphone in a communication mode, a recording mode, a voice recognition mode, or the like, and processes it as electrical voice data. The processed voice data can be converted into a form that can be transmitted to the mobile communication base station through the mobile communication module 113 and output when the voice data is in the call mode. The microphone 123 may be a variety of noise reduction algorithms for eliminating noise generated in receiving an external sound signal.

The user input unit 130 generates key input data input by the user for controlling the operation of the terminal. The user input unit 130 may include a key pad, a dome switch, a touch pad (constant voltage / capacitance), etc. that may receive a command or information by a user's push or touch operation. In addition, the user input unit 130 may be configured as a jog wheel or a jog method or a joystick that rotates a key, a finger mouse, or the like. Particularly, when the touch pad has a mutual layer structure with the display unit 151 described later, it can be called a touch screen.

The sensing unit 140 senses the current state of the portable terminal 100 such as the open / close state of the portable terminal 100, the position of the portable terminal 100, Thereby generating a sensing signal. For example, when the mobile terminal 100 is in the form of a slide phone, it may sense whether the slide phone is opened or closed. In addition, it may be responsible for sensing functions related to whether the power supply unit 190 is supplied with power, whether the interface unit 170 is coupled to an external device, and the like.

The sensing unit 140 may include a detection sensor 141, a pressure sensor 143, a motion sensor 145, and the like. The detection sensor 141 detects the presence of an object approaching the portable terminal 100 or an object existing in the vicinity of the portable terminal 100 without mechanical contact. The detection sensor 141 may detect a proximity object by using a change in an alternating magnetic field or a change in a static magnetic field, or using a change rate of capacitance. The sensor 141 may be provided with two or more according to the configuration aspect.

The pressure sensor 143 may detect whether pressure is applied to the portable terminal 100, the magnitude of the pressure, and the like. The pressure sensor 143 may be installed at a portion where the pressure of the portable terminal 100 is required depending on the use environment. If the pressure sensor 143 is installed in the display unit 151, a touch input through the display unit 151 and a greater pressure than the touch input are applied according to a signal output from the pressure sensor 143. The pressure touch input can be identified. Also, the magnitude of the pressure applied to the display unit 151 at the time of the pressure touch input can be determined according to the signal output from the pressure sensor 143. [

The motion sensor 145 detects the position and movement of the portable terminal 100 using an acceleration sensor, a gyro sensor, or the like. An acceleration sensor that can be used for the motion sensor 145 is a device that converts an acceleration change in one direction into an electric signal and is widely used along with the development of MEMS (micro-electromechanical systems) technology. The acceleration sensor measures the acceleration of a small value built in the airbag system of an automobile and recognizes the minute motion of the human hand and measures the acceleration of a large value used as an input means such as a game There are various types. Acceleration sensors are usually constructed by mounting two or three axes in one package. Depending on the usage environment, only one axis of Z axis is required. Therefore, when the acceleration sensor in the X-axis direction or the Y-axis direction is used instead of the Z-axis direction for some reason, the acceleration sensor may be mounted on the main substrate by using a separate piece substrate.

The gyro sensor is a sensor for measuring the angular velocity, and it can sense the direction of rotation with respect to the reference direction.

The output unit 150 is for outputting an audio signal, a video signal, or an alarm signal. The output unit 150 may include a display unit 151, an audio output module 153, an alarm unit 155, and a haptic module 157.

The display unit 151 displays and outputs information processed by the mobile terminal 100. For example, when the portable terminal 100 is in the call mode, a UI (User Interface) or a GUI (Graphic User Interface) associated with a call is displayed. When the portable terminal 100 is in the video communication mode or the photographing mode, the photographed or received images can be displayed individually or simultaneously, and the UI and the GUI are displayed.

Meanwhile, as described above, when the display unit 151 and the touch pad form a mutual layer structure and constitute a touch screen, the display unit 151 is an input device capable of inputting information by a user's touch in addition to the output device. May also be used.

If the display unit 151 is configured as a touch screen, it may include a touch screen panel, a touch screen panel controller, and the like. In this case, the touch screen panel is a transparent panel attached to the outside and may be connected to the internal bus of the portable terminal 100. The touch screen panel keeps a watch on the contact result, and if there is a touch input, sends the corresponding signals to the touch screen panel controller. The touch screen panel controller processes the signals, and then transmits corresponding data to the controller 180 so that the controller 180 can determine whether the touch input has been made and which area of the touch screen has been touched.

The display unit 151 may be formed of an e-paper. Electronic paper (e-Paper) is a kind of reflective display, and has excellent visual characteristics such as high resolution, wide viewing angle and bright white background as conventional paper and ink. The electronic paper (e-paper) can be implemented on any substrate such as plastic, metal, paper, and the image is retained even after the power is shut off, and the battery life of the portable terminal 100 is long Can be maintained. As the electronic paper, a hemispherical twist ball filled with a telephone can be used, or an electrophoresis method and a microcapsule can be used.

In addition, the display unit 151 may include a liquid crystal display, a thin film transistor-liquid crystal display, an organic light-emitting diode, a flexible display, and a three-dimensional display. It may include at least one of (3D display). In addition, two or more display units 151 may exist according to the implementation form of the mobile terminal 100. For example, the external display unit (not shown) and the internal display unit (not shown) may be simultaneously provided in the portable terminal 100.

The audio output module 153 outputs audio data received from the wireless communication unit 110 or stored in the memory 160 in a call signal reception mode, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, The sound output module 153 outputs sound signals related to functions performed in the portable terminal 100, for example, a call signal reception tone, a message reception tone, and the like. The sound output module 153 may include a speaker, a buzzer, and the like.

The alarm unit 155 outputs a signal for notifying the occurrence of an event of the portable terminal 100. Examples of events occurring in the portable terminal 100 include call signal reception, message reception, and key signal input. The alarm unit 155 outputs a signal for notifying occurrence of an event in a form other than an audio signal or a video signal. For example, the signal may be output in the form of vibration. The alarm unit 155 can output a signal to notify when a call signal is received or a message is received. In addition, when the key signal is input, the alarm unit 155 may output the signal as a feedback to the key signal input. The user may recognize the occurrence of an event through the signal output from the alarm unit 155. A signal for notifying the occurrence of an event in the portable terminal 100 may also be output through the display unit 151 or the sound output module 153. [

The haptic module 157 generates various tactile effects that the user can feel. A typical example of the haptic effect generated by the haptic module 157 is a vibration effect. When the haptic module 157 generates vibration with a haptic effect, the intensity and pattern of the vibration generated by the haptic module 157 can be converted, and the different vibrations can be synthesized and output or sequentially output.

In addition to the vibration, the haptic module 157 may be provided with a function of stimulating by a pin arrangement vertically moving with respect to the contact skin surface, an effect of stimulating air through the injection or suction force of the air through the injection port or the suction port, The effect of stimulation through contact of an electrode (eletrode), the effect of stimulation by electrostatic force, and the effect of reproducing a cold sensation using a device capable of endothermic or exothermic can be generated. The haptic module 157 can be implemented not only to transmit the tactile effect through direct contact but also to feel the tactile effect through the muscular sense of the user's finger or arm. Two or more haptic modules 157 may be provided according to a configuration aspect of the mobile terminal 100.

The memory 160 may store a program for processing and controlling the controller 180 and may provide a function for temporarily storing input or output data (for example, a phone book, a message, a still image, a video, etc.). It can also be done.

The memory 160 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory), a RAM , And a ROM. ≪ / RTI > In addition, the mobile terminal 100 may operate a web storage that performs a storage function of the memory 150 on the Internet.

The interface unit 170 serves as an interface with all external devices connected to the portable terminal 100. Examples of the external device connected to the portable terminal 100 include a wired / wireless headset, an external charger, a wired / wireless data port, a memory card, a SIM (Subscriber Identification Module) card, a UIM An audio input / output (I / O) terminal, a video I / O (input / output) terminal, and an earphone. The interface unit 170 receives data from the external device or receives power from the external device and transmits the data to each component in the portable terminal 100 so that data in the portable terminal 100 can be transmitted to the external device .

The interface unit 170 is a path through which power from the cradle connected when the portable terminal 100 is connected to the external cradle is supplied to the portable terminal 100 or various command signals inputted from the cradle by the user are carried And may be a passage to be transmitted to the terminal 100.

The controller 180 typically controls the operation of the respective units to control the overall operation of the mobile terminal 100. For example, perform related control and processing for voice calls, data communications, video calls, and the like. In addition, the controller 180 may include a multimedia playback module 181 for multimedia playback. The multimedia playback module 181 may be configured in hardware in the controller 180 or may be configured in software separately from the controller 180.

The power supply unit 190 receives external power and internal power under the control of the controller 180 and supplies power necessary for operation of the respective components.

The mobile terminal 100 having such a configuration can be configured to be operable in a communication system capable of transmitting data through a frame or a packet, including a wired / wireless communication system and a satellite-based communication system. have.

The portable terminal related to the present invention has been described above in terms of components according to functions. Hereinafter, referring to FIG. 2, a portable terminal, particularly a tablet computer, according to the present invention will be further described in terms of components according to appearance.

2 is a perspective view of a portable terminal according to an embodiment of the present invention viewed from the front. Referring to FIG. 2, the case constituting the outer appearance of the portable terminal 100 is formed by the front case 100-1 and the rear case 100-2. Various electronic components are incorporated in the space formed by the front case 100-1 and the rear case 100-2. The front case 100-1 and the rear case 100-2 may be formed by injecting a synthetic resin, or may be formed to have a metal material such as stainless steel (STS) or titanium (Ti).

The display unit 151, the audio output module 153, the camera 121, and the user input unit 130 may be disposed in the main body, specifically, the front case 100-1.

The display unit 151 may be constructed such that the touch pad is overlapped with the layer structure so that the display unit 151 operates as a touch screen so that information can be input by a user's touch.

The sound output module 153 may be implemented in the form of a receiver or a speaker. The camera 121 may be implemented in a form suitable for capturing an image or a video of a user or the like.

Other user input units (not shown), a microphone (not shown), and an interface unit (not shown) may be additionally disposed in terms of the front case and the rear case.

The user input unit 130 may be adopted in any manner as long as the user is operating in a tactile manner while giving a tactile feeling. For example, the user input unit 130 may be implemented as a dome switch or a touch pad that may receive a command or information by a user's push or touch operation, or may be operated as a wheel or jog or a joystick that rotates a key. Or the like. In the functional aspect, the user input unit 130 may input a command such as start, end, scroll, etc., input letters, numbers, special symbols, etc., select an operation mode, and activate a special function in the mobile terminal 100. It can act as a hot-key or the like. The microphone may be implemented in a form suitable for receiving a user's voice or other sound.

Another camera (not shown) may be additionally mounted on the rear of the rear case 100-2, wherein another camera to be mounted has a shooting direction substantially opposite to that of the camera 121 disposed at the front, and is different from each other. It may have a pixel. For example, the camera 121 disposed at the front has a low pixel so that it is not overwhelming to take a user's face and transmit it to a counterpart in the case of a video call. In many cases, it is desirable to have a high pixel.

Another sound output module (not shown) may be further disposed on the rear case 100-2. The sound output module disposed on the rear case 100-2 may implement a stereo function together with the sound output module 153 disposed on the front surface, and may be used for a call in the speakerphone mode.

In addition, an antenna (not shown) for receiving a broadcast signal may be disposed in one area of the proton case 100-1 and the rear case 100-2. The antenna may be installed to be capable of being drawn out from the rear case 100-2.

A power supply unit (not shown) for supplying power to the portable terminal 100 may be mounted on the rear case 100-2 side. The power supply unit is, for example, a rechargeable battery, and may be detachably coupled to the rear case 100-2 for charging.

3 is a flowchart provided to explain a process of executing an application by setting an apple board area in a method of controlling an operation of a portable terminal according to an embodiment of the present invention.

Referring to FIG. 3, the controller 180 displays an operation screen corresponding to the selected menu or operation on the display unit 151 (S200). At this time, examples of the operation screen to be displayed include a standby screen, a message reception screen, a message transmission screen, a main menu screen, an image or video viewer screen, a broadcast screen, a map screen, and a web page screen.

When there is an input for setting the apple board area while the operation screen is displayed (S205), the controller 180 sets an area corresponding to the input for setting the apple board area on the operation screen as the apple board area (S210). ).

The apple board area is a kind of window for launching a new application, and can display an execution screen of a specific application in the apple board area. The input for setting the Apple board area may be a touch and drag input, a multi touch input, a long touch input, or the like. Using this input, you can set the Apple board area to the shape and size you want in one area of the operation screen.

After the apple board area is set, the controller 180 determines whether a preset gesture input is detected through the set apple board area (S215).

Here, the gesture input refers to an input in which a form of the dragged path corresponds to a preset form among touch and drag inputs through the display unit 151. If a proximity touch input is possible using the proximity sensor 141 or the like, a gesture input of a method of moving a user's finger or the like in a predetermined form may be used in proximity to the display unit 151 within a predetermined distance. . The form of the gesture input may be preset and stored by the user, or a form set as a default when the portable terminal is manufactured may be used.

As a result of the determination in step S215, when a preset gesture input is detected, the controller 180 executes an application preset in response to the gesture input (S220), and displays an execution screen corresponding to the execution of the application on the apple board area. (S225).

In this manner, the apple board region may be set in one region of the current operation screen according to a preset input, and an application corresponding to the gesture input may be executed according to the gesture input through the apple board region. In addition, by repeatedly performing the above process, one or more Apple board regions may be set, and various applications may be executed simultaneously.

4 is a flowchart provided to explain a process of transmitting content to another device by setting an apple board area in a method of controlling a mobile terminal according to an embodiment of the present invention.

Referring to FIG. 4, after the apple board region is set according to the process described in the above-described embodiment (S300), the controller 180 detects a gesture input corresponding to a specific device through the set apple board region. It is determined whether or not (S305)

In this case, the specific device refers to a device that can be communicatively connected to the mobile terminal 100 through short-range communication or other wired or wireless communication.

As a result of the determination in step S305, when the gesture input corresponding to the specific device is detected, the controller 180 searches for a device corresponding to the gesture input and connects the communication in operation S310. In this case, more than one device may be communicatively connected.

In operation S315, a content candidate window in which a content icon corresponding to content that is transmittable to a device that is communicatively connected is displayed is displayed.

If there is an input of touching a content icon in the content candidate window and dragging it to the set Apple board area (S320), the controller 180 transmits the content corresponding to the dragged content icon to a device that is communicatively connected. (S325).

By doing this, the Apple board area can be set to transfer content to other devices. In addition, content transmitted from a device communicatively connected to the set Apple board area may be displayed.

5 to 29 are views for explaining an operation control method of a mobile terminal according to an embodiment of the present invention.

First, FIGS. 5 to 11 are views referred to for describing a process of setting an apple board area according to an embodiment of the present invention.

FIG. 5 illustrates a case in which a touch and drag input 405 for touching and dragging a point on the operation screen 400 is present. As described above, the apple board region 410 may be set according to the touch and drag input 405.

FIG. 6 illustrates a case where a multi-touch input including a first touch input 413 and a second touch input 415 is present on the operation screen 400. The apple board region 420 may be set according to the multi-touch input.

FIG. 7 illustrates a case in which an input 423 for long touching a point on the operation screen 410 is present. The long touch input may be recognized when the touch time is longer than a predetermined time or more than a predetermined pressure. The apple board region 430 may also be set by the long touch input 423. When the long touch input is used, the size of the apple board region 430 may be increased in proportion to the touch time or the pressure.

In addition, the Apple board area can be set using proximity touch input or continuous touch input.

As shown in FIG. 8A, the apple board area of the operation screen 450 may be set in various shapes and sizes such as a rectangle, a triangle, a circle, and a heart shape. In addition, as illustrated in FIG. 8B, one or more apple board regions may be set by overlapping each other on the operation screen 460.

As shown in the operation screen 470 of FIG. 9A and the operation screen 480 of FIG. 9B, the Apple board region may be set in a 3D shape such as a trapezoidal shape.

FIG. 10 illustrates a case in which the size of the apple board region 493 is adjusted according to an input 495 of touching and dragging the boundary of the apple board region 493 set on the operation screen 490. As described above, the size of the Apple board area can be adjusted according to the input of touching and dragging the border of the Apple board area.

As shown in FIG. 11A, when the apple board region 510 is set according to an input 505 for touching and dragging a point on the operation screen 500, the apple board region 510 is located behind the apple board region 510. As shown in (b) of FIG. 11, the displayed icons may be rearranged by moving to any one area of the operation screen 500 so as not to overlap the set apple board area 510.

12 to 29 are diagrams for describing a process of executing various applications using an apple board area according to an embodiment of the present invention.

FIG. 12A illustrates a case in which the apple board region 530 is set according to an input 525 of touching and dragging a point on the operation screen 520. When the apple board area 530 is set as shown in FIG. 12B, icons 535 for selecting a background screen may be displayed on the apple board area 530. If there is an input 535 that touches any of the displayed icons 533, as shown in FIG. 12C, a background screen corresponding to the touched icon is displayed on the apple board area 530. can do.

As shown in FIG. 13A, when the apple board region 550 is set on the operation screen 540 and the gesture input 555 having the form 'web' is present in the apple board region 550. In addition, as shown in FIG. 13B, a web page screen may be displayed on the apple board area 550 by performing a web access function.

As shown in FIG. 14A, when the Apple board region 570 is set in one region of the operation screen 560 and there is a gesture input 575 such as 'DMB', FIG. As shown in FIG. 6, a DMB broadcast screen may be displayed on the apple board area 570.

In this way, the corresponding application can be executed according to the gesture input through the Apple board area. In this case, if the starting point of the gesture input is in the Apple board area, the gesture input may be regarded as a gesture input for executing an application even if the gesture input leaves the Apple board area. In addition, the size of the apple board area may be automatically adjusted according to the size of the gesture input, and the execution screen of the corresponding application may be displayed.

FIG. 15A illustrates a state in which the candidate group 585 of an application corresponding to a recently input touch input is displayed when the apple board area 583 is set in one area of the operation screen 580. As shown in FIG. 15B, the candidate application may be displayed in the form of an icon 593.

If any one of such candidate applications is selected, the corresponding application can be executed.

FIG. 16A illustrates a case where a gesture input 603 is present in an apple board area set in an area of an operation screen 600. In this case, if there is no application corresponding to the gesture input, as illustrated in FIG. 16B, the guide message 610 may be displayed.

However, when there is an application corresponding to the gesture input, as shown in FIG. 16C, the execution screen 613 of the corresponding application can be displayed. If there is more than one application corresponding to the gesture input, as illustrated in FIG. 16D, the apple board area 615 for selecting an application to be executed may be displayed.

FIG. 17A illustrates a case where a gesture input 623 is provided in the apple board area. In this case, when the gesture input cannot recognize the shape, as illustrated in FIG. 17B, the candidate window 630 for selecting the input gesture shape may be displayed.

FIG. 18A illustrates an operation screen 640 in which a plurality of Apple board regions are set. The apple board area may be aligned and displayed by selecting an alignment menu on the operation screen 640 or by shaking the portable terminal 100.

For example, as shown in (b) of FIG. 18, the screen 650 in which apple board areas are arranged in size order may be displayed, and as shown in (c) or (d) of FIG. The screens 660 and 670 may be displayed in which the board areas are arranged in order of generation or frequency of use.

As shown in FIG. 19A, the first apple board region 710 is opened as shown in FIG. 19B by an input 703 of touching and dragging an area of the operation screen. Can be set. In addition, when there is a gesture input 705 in the form of 'TV' in the first apple board region 710, as shown in FIG. 19C, the TV is watched in the first apple board region 710. The screen can be displayed.

As shown in FIG. 20A, in response to the first and second touch inputs 713 and 715, as illustrated in FIG. 20B, the second apple board region 720 is set. If there is a 'Gallery' and a gesture input 723, the gallery screen 730 may be displayed on the second apple board area 730, as shown in FIG. 20C.

As shown in FIG. 21A, in response to an input 7330 for long touching any point of the operation screen 700, as shown in FIG. 21B, the third Apple board area ( 740 is set, and when there is a gesture input 735 such as 'book', as shown in FIG. 21C, an e-book screen may be displayed on the third Apple board region 740.

As shown in Fig. 22A, according to the multi-touch inputs 743 and 745, as shown in Fig. 22B, a fourth apple board region 780 having a trapezoidal shape is set. When there is a gesture input 777 such as 'web' in the fourth apple board region 780, as shown in FIG. 22C, a web page screen may be displayed on the fourth apple board region 780. Can be.

In this way, several Apple board regions can be set in various forms, and different applications can be executed using each Apple board region.

As illustrated in FIG. 23, a plurality of apple board regions 803 and 805 may be set on the operation screen 800, and different chat windows may be displayed on each apple board region to perform a messenger function. As illustrated in (b) of FIG. 23, an image to be projected may be selected through the apple board area 813 set on the operation screen 810 in the portable terminal having the projector function.

As shown in FIG. 24A, after setting the apple board region 823 in one region of the operation screen 820, as shown in FIG. 24B, the apple board region 823 is shown. If there is a gesture input 825 such as 'device', the Apple board area corresponding to the device may be set.

FIG. 24C illustrates a screen 830 in which apple board areas corresponding to five devices are displayed by searching for devices that can be communicatively connected. In this case, the content candidate window 840 including a content icon corresponding to content that can be transmitted to another device may be displayed together.

As illustrated in (d) of FIG. 24, the selected content may be transmitted to a specific device according to an input 843 of selecting one content icon from the content candidate window 840 and dragging the content icon to one of the apple board regions. .

As such, the content may be transmitted or received to another device using the apple board area corresponding to the device.

As shown in FIG. 25A, after setting the apple board region 850 on the operation screen 840, as shown in FIG. 25B, handwriting recognition is performed on the apple board region 850. If there is a gesture input 853 corresponding to, as illustrated in FIG. 25C, text may be input using the apple board area 850 as a handwriting recognition input window.

In addition, as shown in FIG. 26A, after setting the apple board region 870 on the operation screen 860, as shown in FIG. 26B, the apple board region 870 is displayed. If there is a gesture input 875 corresponding to keypad recognition, as illustrated in FIG. 26C, a keypad may be displayed on the apple board area 870 to input characters.

As such, the Apple board area may be used as a keypad input window, a handwriting recognition input window, a continuous writing input window, and a Qwerty input window.

As shown in FIG. 27A, after setting the apple board region 890 on the operation screen 880, as shown in FIG. 27B, a mouse function is performed on the apple board region 890. As shown in FIG. If there is a gesture input 833 corresponding to, as shown in Fig. 27C, the apple board area 890 is used as the area corresponding to the mouse operation, and then the cursor 895 is moved to a desired function. You can run

As shown in FIG. 28A, when there is a gesture input 913 for requesting a call in the apple board area 910 set on the operation screen 900, as shown in FIG. 28B. In response to the call candidate group, the window 915 may be displayed. At this time, as shown in (c) of FIG. 28, as the mobile terminal moves, the changed operation screen 920 and the changed apple board area 930 are displayed, and the call candidate group is changed to the changed apple board area 930. The number displayed in the displayed window 935 can also be modified.

In addition, the Apple board area can be used for various purposes. In addition, the portable terminal and its operation control method according to the present invention are not limited to the configuration and method of the embodiments described as described above, the embodiments are all of the embodiments so that various modifications can be made Or some may be selectively combined.

Meanwhile, the present invention can be implemented as a processor-readable code in a processor-readable recording medium provided in a portable terminal. The processor-readable recording medium includes all kinds of recording devices that store data that can be read by the processor. Examples of the processor-readable recording medium include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage device, and the like, and also include a carrier wave such as transmission through the Internet. The processor-readable recording medium can also be distributed over network coupled computer systems so that the processor-readable code is stored and executed in a distributed fashion.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, but, on the contrary, It should be understood that various modifications may be made by those skilled in the art without departing from the spirit and scope of the present invention.

110: wireless communication unit 120: A / V input unit
130: user input unit 140: sensing unit
150: output unit 151: display unit
160: memory 170: interface unit
180:

Claims (20)

Displaying an operation screen on a display unit;
Setting an apple board area capable of displaying an execution screen of a specific application in one area of the operation screen; And
And detecting a preset gesture input through the apple board area, executing an application corresponding to the preset gesture input, and displaying an execution screen corresponding to the execution of the application on the apple board area. Operation control method. The method of claim 1,
The apple board area may be set according to any one of an input for touching and dragging the operation screen, an input for multi-touching the operation screen, and an input for long touching the operation screen. Way. The method of claim 1,
And displaying an icon for selecting a background screen of the apple board area. The method of claim 1,
And the apple board area is set in plural. The method of claim 1,
And changing the size of the apple board in response to the size of the gesture input. The method of claim 1,
And displaying an executable candidate application corresponding to the gesture input. The method of claim 1,
And aligning and displaying the apple board area displayed on the display unit according to a predetermined criterion according to an alignment command. The method of claim 7, wherein
The predetermined criterion is one of an order of size, an order of generation, and an order of use frequency. The method of claim 1,
And changing the size of the apple board according to the movement of the main body. The method of claim 1,
If there is a gesture input defined as a function by the device search, searching for a device that can be communicatively connected, and displaying an apple board area corresponding to the searched device. The method of claim 10,
In the case of touching any content icon in the content candidate window including at least one content icon and dragging the content icon to the Apple board area corresponding to the first device, transmitting the content corresponding to the dragged content icon to the first device. Operation control method of a mobile terminal further comprising. The method of claim 1,
And inputting text by setting the apple board area as a text input window. The method of claim 12,
The text input window includes a keypad input window, a handwriting recognition input window, a continuous handwriting input window, and a qwerty input window. The method of claim 1,
Controlling the pointer displayed on the operation screen by setting the apple board area as a mouse control window. The method of claim 1,
If there is no application corresponding to a gesture input detected through the apple board area, displaying a guide message requesting another gesture input. A display unit displaying an operation screen; And
An apple board area for displaying an execution screen of a specific application is set in one area of the operation screen, and when a preset gesture input is detected through the apple board area, an application corresponding to the preset gesture input is executed. And a controller configured to display an execution screen corresponding to the execution of the application on the apple board area. The method of claim 16,
The controller may be configured to set the apple board area according to any one of an input for touching and dragging the operation screen, an input for multi-touching the operation screen, and an input for long touching the operation screen. The method of claim 16,
Further comprising a sensing unit for outputting a detection signal corresponding to the movement of the main body,
The controller may be arranged to display the Apple board displayed on the operation screen according to a predetermined criterion when the movement of the main body preset according to the detection signal is detected. The method of claim 16,
Further comprising a wireless communication unit for providing a communication interface,
If there is a gesture input defined as a function by device search, the controller searches for a device that can be communicatively connected through the wireless communication unit, and displays an apple board area corresponding to the found device on the display unit. Portable terminal. 20. The method of claim 19,
The controller may display a content candidate window including a content icon on the display unit, and if there is an input of touching a content icon selected in the content candidate window and dragging the content icon to an apple board area corresponding to the first device, the selected content And a content corresponding to the icon to the first device through the wireless communication unit.

Images