KR101750342B1 - Mobile terminal and application or contents controlling method using touch gesture thereof - Google Patents

Abstract

The present invention differently controls display and execution of an application or content by peeling a display screen of various applications or contents displayed on the screen like an onion skin. To this end, the present invention comprises a method of displaying a plurality of applications or contents hierarchically; Detecting a touch gesture that appears to strip the screen from the displayed application or content; And controlling display or execution of the application or the content according to the sensed touch gesture, wherein the control step controls the display or execution of the application or the content according to the degree, position and direction of the screen being peeled off by the touch gesture Controls display or execution differently. Therefore, the present invention has the effect of providing convenience to the user by controlling various display and execution of applications or contents by a simple touch gesture.

Description

TECHNICAL FIELD [0001] The present invention relates to a mobile terminal and a method of controlling an application and a content using the touch gesture,

The present invention relates to a mobile terminal capable of controlling display and execution of an application and contents by a peeling operation of a touch gesture, an application thereof, and a content control method.

The mobile terminal may be configured to perform various functions. Examples of such various functions include a data and voice communication function, a function of photographing a video or a moving image through a camera, a voice storage function, a music file playback function through a speaker system, and an image or video display function. Some mobile terminals include additional functions to execute games, and some other mobile terminals are also implemented as multimedia devices. Moreover, recent mobile terminals can receive a broadcast or multicast signal to view a video or television program.

Further, efforts for supporting and increasing the functions of the mobile terminal continue. Such efforts include not only changes and improvements in structural components that form the mobile terminal, but also improvements in software or hardware. Among them, the touch function of the mobile terminal allows a user who is unfamiliar with the button / key input to conveniently perform the operation of the terminal by using the touch screen. In recent years, not only simple input but also user interface (UI) Is becoming an important function of Accordingly, as the touch function is applied to a mobile terminal in various forms, development of a user interface (UI) corresponding thereto is further demanded.

Generally, when working with multiple applications on the screen, the application or the content displayed on the current screen belongs to the upper layer, and the running application or the content (hidden) that is not visible on the current screen Belongs. This hierarchical structure has a form in which a plurality of lower hierarchies exist in an upper hierarchy as in the case of an onion shell. The upper layer and the lower layer may include application, content and other menu items at the same level or at different levels, and the number of applications or contents may be different.

However, in the execution screen having the above-mentioned onion type hierarchical structure, when a user performs a predetermined task in one application or content and then performs an operation in another application or contents, You must close or hide it and access the desired application or content.

However, in an execution screen having an onion type hierarchical structure, in general, a user tends to locate one application or content in the order in which the user has executed. In particular, a plurality of items (pictures, MP3 and memo) exist, they can not know which item is included unless they directly select each item.

Accordingly, when a user performs an operation on an application or content on an execution screen having an onion type hierarchical structure, when switching to the same layer or upper / lower layer, the user closes or hides the application or contents and selects a new application or content There was a problem.

Accordingly, it is an object of the present invention to provide a mobile terminal, an application thereof, and a content control method capable of controlling an application and contents by a peeling operation of a touch gesture.

It is another object of the present invention to provide a mobile terminal and an application thereof and a content control method capable of controlling display and execution of applications and contents according to the position, degree and direction of peeling.

According to another aspect of the present invention, there is provided a method for controlling an application and a content of a mobile terminal in a mobile terminal, the method comprising: hierarchically displaying a plurality of applications or contents; Detecting a touch gesture that appears to strip the screen from the displayed application or content; And controlling display or execution of the application or the content according to the sensed touch gesture, wherein the control step controls the display or execution of the application or the content according to the degree, position and direction of the screen being peeled off by the touch gesture Controls display or execution differently.

The application or the content has a hierarchical structure in which at least one application or content, which is the same layer or a different layer, is overlapped.

When the screen is peeled off, the upper layer application or content displayed on the current screen disappears, and the hidden lower layer application or content is displayed.

When the screen is peeled off, switching is performed between the previous or next application having a hierarchical structure or an application or contents in which content is displayed.

The display and execution of the application and the content are controlled by at least one of a position, an extent and a direction in which the screen is peeled off.

The extent to which the screen is peeled off is divided into a plurality of steps, and different applications or contents are displayed for each step.

The position where the screen is peeled includes right and left sides of left and right and upper and lower ends of the top of the screen, and different applications or contents are displayed each time the respective positions are peeled off.

Different applications or contents are displayed or executed depending on the degree of stripping by the multi-touch.

According to an aspect of the present invention, there is provided a mobile terminal of a mobile terminal including: a display unit for hierarchically displaying a plurality of applications or contents; And a controller for controlling display or execution of the application or the content according to the sensed touch gesture when a touch gesture as if the screen is peeled off is displayed on the displayed application or content, And controls the display or execution of the application or the content according to the direction and direction.

The present invention according to the embodiment of the present invention performs application or content switching according to screen peeling using a touch gesture and controls various display and execution of the application or content according to the position, There is an effect that application or content display and switching can be conveniently performed between the same layer or another layer.

1 is a block diagram of a mobile terminal according to an embodiment of the present invention;
2 is a block diagram of a wireless communication system in which a mobile terminal may operate in accordance with an embodiment of the present invention.
FIGS. 3A and 3B illustrate an embodiment in which display of different applications or contents is controlled according to screen peeling in the present invention. FIG.
4A to 4C are diagrams illustrating an example of controlling the display of an application or content according to the degree of screen stripping in the embodiment of the present invention.
5 is a view showing an example of controlling display and execution of content tagged with geographical information according to the degree of screen stripping in the embodiment of the present invention.
6A and 6B are views illustrating an example of controlling screen display on a web browser according to the degree and position of screen stripping in the present invention.
7A and 7B illustrate a first embodiment in which display of an application or content at the same level is controlled according to screen peeling in the present invention.
8 is a view showing a second embodiment for controlling the display of applications or contents at the same level in accordance with the screen peeling in the present invention.
9A to 9E illustrate a third embodiment of the present invention in which applications or contents at the same level are displayed in accordance with screen peeling.
10 is a view showing a first embodiment of displaying applications or contents at different levels according to screen peeling in the present invention.
11A and 11B illustrate an embodiment in which applications or contents at different levels are displayed according to a direction in which a screen is stripped in the present invention.
12 is a view showing a second embodiment in which applications or contents at different levels are displayed according to the direction in which the screen is peeled off according to the present invention.
13A and 13B illustrate an embodiment in which different applications or contents are displayed according to the degree of screen stripping when performing local communication in the present invention.
14A to 14B show a first embodiment in which different applications or contents are displayed according to a multi-touch gesture in a specific application.
15A and 15B illustrate a second embodiment in which different applications or contents are displayed according to a multi-touch gesture in a specific application.
16 is a flowchart illustrating a method of controlling an application and a content by a peeling operation of a touch gesture according to an embodiment of the present invention.

Hereinafter, a mobile terminal related to the present invention will be described in detail with reference to the drawings. The suffix "module" and " part "for components used in the following description are given merely for convenience of description, and do not give special significance or role in themselves. Accordingly, it should be noted that the above-mentioned "module" and "part"

The terminal may be implemented in various forms. For example, the terminal described in this specification may include a mobile terminal such as a mobile phone, a smart phone, a notebook computer, a digital broadcasting terminal, a PDA (Personal Digital Assistants), a PMP (Portable Multimedia Player) And fixed terminals such as a digital TV, a desktop computer, and the like. In the following description, it is assumed that the terminal is a mobile terminal. However, it will be readily apparent to those skilled in the art that the configuration according to the following description may be applied to the fixed terminal, except for components specifically configured for mobile use.

1 is a block diagram of a mobile terminal according to an embodiment of the present invention.

The mobile terminal 100 includes a wireless communication unit 110, an audio / video input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, a memory 160, A controller 170, a controller 180, a power supply 190, and the like. 1 shows a mobile terminal having various components. However, not all illustrated components are required. A mobile terminal may be implemented by more components than the illustrated components, or a mobile terminal may be implemented by fewer components.

Hereinafter, the components will be described in order.

The wireless communication unit 110 may include one or more components that allow wireless communication between the mobile terminal 100 and the wireless communication system or wireless communication between the mobile terminal 100 and a network on which the mobile terminal 100 is located. For example, the wireless communication unit 110 may include a broadcast receiving module 111, a mobile communication module 112, a wireless Internet module 113, a short range communication module 114, and a location information module 115 .

The broadcast receiving module 111 receives broadcast signals and / or broadcast-related information from an external broadcast management server through a broadcast channel. The broadcast channel may include a satellite channel and a terrestrial channel. The broadcast management server may refer to a server for generating and transmitting broadcast signals and / or broadcast related information, or a server for receiving broadcast signals and / or broadcast related information generated by the broadcast management server and transmitting the generated broadcast signals and / or broadcast related information. The broadcast-related information may refer to a broadcast channel, a broadcast program, or information related to a broadcast service provider. The broadcast signal may include a TV broadcast signal, a radio broadcast signal, a data broadcast signal, and a broadcast signal in which a data broadcast signal is combined with a TV broadcast signal or a radio broadcast signal.

Meanwhile, the broadcast related information may be provided through a mobile communication network, and in this case, it may be received by the mobile communication module 112.

The broadcast-related information may exist in various forms. For example, an EPG (Electronic Program Guide) of DMB (Digital Multimedia Broadcasting) or an ESG (Electronic Service Guide) of Digital Video Broadcast-Handheld (DVB-H).

The broadcast receiving module 111 receives broadcasting signals using various broadcasting systems. In particular, the broadcasting receiving module 111 may be a Digital Multimedia Broadcasting-Terrestrial (DMB-T), a Digital Multimedia Broadcasting-Satellite (DMB-S) Only Digital Broadcast-Handheld (DVB-H), Integrated Services Digital Broadcast-Terrestrial (ISDB-T), and the like. Of course, the broadcast receiving module 111 is configured to be suitable for all broadcasting systems that provide broadcasting signals as well as the digital broadcasting system described above.

The broadcast signal and / or broadcast related information received through the broadcast receiving module 111 may be stored in the memory 160.

In addition, the mobile communication module 112 transmits and receives radio signals to at least one of a base station, an external terminal, and a server on a mobile communication network. Here, the wireless signal may include various types of data depending on a voice call signal, a video call signal, or a text / multimedia message transmission / reception.

The wireless Internet module 113 is a module for wireless Internet access, and the wireless Internet module 113 can be built in or externally. WLAN (Wi-Fi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access) and the like can be used as wireless Internet technologies.

The short-range communication module 114 refers to a module for short-range communication. Bluetooth, radio frequency identification (RFID), infrared data association (IrDA), ultra wideband (UWB), ZigBee, and the like can be used as the short distance communication technology.

The location information module 115 is a module for confirming or obtaining the location of the mobile terminal. A typical example of the position information module 115 is a Global Position System (GPS) module. According to the present technology, the GPS module calculates distance information and accurate time information from three or more satellites, and then applies trigonometry to the calculated information to obtain three-dimensional current position information according to latitude, longitude, and altitude It can be calculated accurately. At present, a method of calculating position and time information using three satellites and correcting an error of the calculated position and time information using another satellite is widely used. In addition, the GPS module can calculate speed information by continuously calculating the current position in real time.

An audio / video (A / V) input unit 120 is for inputting an audio signal or a video signal, and may include a camera 121 and a microphone 122. The camera 121 processes an image frame such as a still image or a moving image obtained by the image sensor in the video communication mode or the photographing mode. Then, the processed image frame can be displayed on the display module 151.

The image frame processed by the camera 121 may be stored in the memory 160 or transmitted to the outside through the wireless communication unit 110. [ The camera 121 may be equipped with two or more cameras according to the configuration of the terminal.

The microphone 122 receives an external sound signal through a microphone in a communication mode, a recording mode, a voice recognition mode, or the like, and processes it as electrical voice data. The processed voice data can be converted into a form that can be transmitted to the mobile communication base station through the mobile communication module 112 when the voice data is in the call mode, and output. The microphone 122 may be implemented with various noise reduction algorithms for eliminating noise generated in the process of receiving an external sound signal.

The user input unit 130 generates input data for a user to control the operation of the terminal. The user input unit 130 may include a key pad, a dome switch, a touch pad (static / static), a jog wheel, a jog switch, and the like. Particularly, when the touch pad has a mutual layer structure with the display module 151 described later, it can be called a touch screen.

The sensing unit 140 senses the current state of the mobile terminal 100 such as the open / close state of the mobile terminal 100, the position of the mobile terminal 100, the presence or absence of user contact, the orientation of the mobile terminal, And generates a sensing signal for controlling the operation of the mobile terminal 100. For example, when the mobile terminal 100 is in the form of a slide phone, it is possible to sense whether the slide phone is opened or closed. Also, it is responsible for a sensing function related to whether or not the power supply unit 190 is powered on, whether the interface unit 170 is connected to an external device, and the like. Meanwhile, the sensing unit 140 may include a proximity sensor 141. This will be discussed later in connection with touch screens.

The sensing unit 140 includes a geomagnetic sensor for calculating a moving direction when a user moves, a gyro sensor for calculating a rotating direction, and an acceleration sensor.

The interface unit 170 serves as an interface with all external devices connected to the mobile terminal 100. For example, a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, a port for connecting a device having an identification module, an audio I / O port, Video input / output (I / O) ports, earphone ports, and the like.

Here, the identification module is a chip that stores various information for authenticating the use right of the mobile terminal 100, and includes a user identification module (UIM), a subscriber identity module (SIM) ), A Universal Subscriber Identity Module (" USIM "), and the like. In addition, an apparatus having an identification module (hereinafter referred to as 'identification device') can be manufactured in a smart card format. Accordingly, the identification device can be connected to the terminal 100 through the port. The interface unit 170 receives data from an external device or receives power from the external device to transfer the data to each component in the mobile terminal 100 or to transmit data in the mobile terminal 100 to an external device.

The interface unit 170 may be a path through which power from the cradle is supplied to the mobile terminal 100 when the mobile terminal 100 is connected to an external cradle, Various command signals may be transmitted to the mobile terminal. The various command signals or the power source input from the cradle may be operated as a signal for recognizing that the mobile terminal is correctly mounted on the cradle.

The output unit 150 is for outputting an audio signal, a video signal, or an alarm signal. The output unit 150 may include a display module 151, an audio output module 152, and an alarm unit 153.

The display module 151 displays and outputs information processed by the mobile terminal 100. For example, when the mobile terminal is in the call mode, a UI (User Interface) or a GUI (Graphic User Interface) associated with a call is displayed.

Meanwhile, as described above, when the display module 151 and the touch pad have a mutual layer structure to constitute a touch screen, the display module 151 can be used as an input device in addition to the output device. The display module 151 may be a liquid crystal display, a thin film transistor-liquid crystal display, an organic light-emitting diode, a flexible display, a three-dimensional display 3D display). Some of these displays can be configured to be transparent so that they can be viewed from outside. This may be referred to as a transparent display. A typical example of the transparent display is a transparent organic light emitting diode (TOLED) or the like. In addition, there may be two or more display modules 151 according to the embodiment of the mobile terminal 100. For example, the mobile terminal 100 may be provided with an external display module (not shown) and an internal display module (not shown) at the same time. The touch screen may be configured to detect not only the touch input position and area but also the touch input pressure.

The audio output module 152 outputs audio data received from the wireless communication unit 110 or stored in the memory 160 in a call signal reception mode, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, The sound output module 152 outputs an acoustic signal related to functions (e.g., call signal reception sound, message reception sound, etc.) performed in the mobile terminal 100. [ The sound output module 152 may include a speaker, a buzzer, and the like.

The alarm unit 153 outputs a signal for notifying the occurrence of an event of the mobile terminal 100. Examples of events that occur in the mobile terminal include call signal reception, message reception, key signal input, touch input, and the like. The alarm unit 153 may output a signal for informing occurrence of an event in a form other than an audio signal or a video signal. For example, it is possible to output a signal in a vibration mode. When a call signal is received or a message is received, the alarm unit 153 can output a vibration to notify it. Alternatively, when the key signal is input, the alarm unit 153 can output the vibration by the feedback to the key signal input. The user can recognize the occurrence of an event through the vibration output as described above. Of course, a signal for notifying the occurrence of an event may also be output through the display module 151 or the sound output module 152. [

The memory 160 may store a program for processing and controlling the control unit 180 and may store a function for temporarily storing input / output data (e.g., a phone book, a message, a still image, . In addition, the memory 160 may store data on vibration and sound of various patterns outputted when a touch is input on the touch screen.

The memory 160 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory), a RAM (Random Access Memory) SRAM (Static Random Access Memory), ROM (Read Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM (Programmable Read- And an optical disc. Also, the mobile terminal 100 may operate a web storage for performing a storage function of the memory 160 on the Internet.

The control unit 180 typically controls the overall operation of the mobile terminal. For example, voice communication, data communication, video communication, and the like. In addition, the control unit 180 may include a multimedia module 181 for multimedia playback. The multimedia module 181 may be implemented in the control unit 180 or may be implemented separately from the control unit 180. [

The controller 180 may perform a pattern recognition process for recognizing handwriting input or drawing input performed on the touch screen as characters and images, respectively.

The power supply unit 190 receives external power and internal power under the control of the control unit 180 as a battery, and supplies power necessary for operation of the respective components.

The various embodiments described herein may be embodied in a recording medium readable by a computer or similar device using, for example, software, hardware, or a combination thereof.

According to a hardware implementation, the embodiments described herein may be implemented as application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays May be implemented using at least one of processors, controllers, micro-controllers, microprocessors, and electrical units for performing functions. In some cases, And may be implemented by the control unit 180.

According to a software implementation, embodiments such as procedures or functions may be implemented with separate software modules that perform at least one function or operation. The software code may be implemented by a software application written in a suitable programming language. In addition, the software codes may be stored in the memory 160 and executed by the control unit 180. [

In the foregoing, the mobile terminal related to the present invention has been described in terms of components according to functions. Hereinafter, the mobile terminal related to the present invention will be further described with reference to FIGS. 2 and 3 in view of the components according to the outline. Hereinafter, for simplicity of explanation, a slider type mobile terminal will be described as an example among various types of mobile terminals such as a folder type, a bar type, a swing type, a slider type, and the like. Therefore, the present invention is not limited to the slider type mobile terminal but can be applied to all types of mobile terminals including the above-mentioned type.

The terminal 100 shown in Fig. 1 is configured to be operable in a communication system capable of transmitting data through a frame or packet, including a wired / wireless communication system and a satellite-based communication system .

Hereinafter, a communication system capable of operating a terminal according to the present invention will be described with reference to FIG.

The communication system may use different air interfaces and / or physical layers. For example, wireless interfaces that can be used by communication systems include, but are not limited to, Frequency Division Multiple Access ('FDMA'), Time Division Multiple Access ('TDMA'), Code Division Multiple Access (CDMA), Universal Mobile Telecommunications Systems (UMTS) (especially Long Term Evolution (LTE)), Global System for Mobile Communications (GSM) . Hereinafter, for the sake of convenience of description, the description will be limited to CDMA. However, the present invention is applicable to all communication systems including CDMA wireless communication systems.

2, the CDMA wireless communication system includes a plurality of terminals 100, a plurality of base stations (BSs) 270, and base station controllers (BSCs) 275 , And a mobile switching center ('MSC') 280. MSC 280 is configured to be coupled to a Public Switched Telephone Network (" PSTN ") 290, and is also configured to be coupled to BSCs 275. BSCs 275 may be coupled in pairs with BS 270 through a backhaul line. The backhaul line may be provided according to at least one of E1 / T1, ATM, IP, PPP, Frame Relay, HDSL, ADSL or xDSL. Thus, a plurality of BSCs 275 may be included in the system shown in FIG.

Each BS 270 may comprise at least one sector, and each sector may comprise an omnidirectional antenna or an antenna pointing to a particular direction of radial from BS 270. [ In addition, each sector may include two or more antennas of various types. Each BS 270 may be configured to support a plurality of frequency assignments and each of the plurality of frequency assignments has a specific spectrum (e.g., 1.25 MHz, 5 MHz, etc.).

The intersection of sector and frequency assignment may be referred to as a CDMA channel. BS 270 may be referred to as a Base Station Transceiver Subsystem (BTSs). In this case, the word "base station" may be referred to as a combination of one BSC 275 and at least one BS 270. [ The base station may also indicate a "cell site ". Alternatively, each of the plurality of sectors for a particular BS 270 may be referred to as a plurality of cell sites.

2, a broadcasting transmitter (BT) 295 transmits a broadcasting signal to the terminals 100 operating in the system. The broadcast receiving module 111 shown in FIG. 1 is provided in the terminal 100 to receive a broadcast signal transmitted by the BT 295.

In addition, FIG. 2 illustrates several Global Positioning System ('GPS') satellites 300. The satellites 300 help to locate at least one of the plurality of terminals 100. Although two satellites are shown in FIG. 2, useful location information may be obtained by two or more satellites. The location information module 115 shown in FIG. 1 cooperates with satellites 300 to obtain desired location information. Here, you can track your location using all of the technologies that can track your location, as well as your GPS tracking technology. Also, at least one of the GPS satellites 300 may optionally or additionally be responsible for satellite DMB transmission.

Among the typical operations of a wireless communication system, the BS 270 receives a reverse link signal from the various terminals 100. At this time, the terminals 100 are connecting a call, transmitting or receiving a message, or performing another communication operation. Each of the reverse link signals received by the particular base station 270 is processed by the particular base station 270. The data resulting from the processing is transmitted to the connected BSC 275. The BSC 275 provides call resource allocation and mobility management functions, including the organization of soft handoffs between the base stations 270. The BSC 275 also transmits the received data to the MSC 280 and the MSC 280 provides additional transmission services for connection with the PSTN 290. [ Similarly, the PSTN 290 connects to the MSC 280, the MSC 280 connects to the BSCs 275, and the BSCs 275 communicate with the BSs 270 ).

The present invention is a method for controlling display and execution of previous or next applications and contents of an execution screen by stripping an execution screen for an application or contents by using a touch gesture that peels off the onion skin I suggest.

In the present invention, the touch gesture for removing the onion skin (stripping off the screen) is a state in which at least one application or content is overlapped (hierarchical structure), the edge portion of the currently displayed application or content screen is touched Quot; portion " is displayed on the screen, and the peeled portion is dragged in a certain direction to increase the degree of peeling, thereby making the currently displayed screen disappear.

Particularly, the meaning of "peel off the onion skin" means that each application or content is regarded as an onion skin in a plurality of overlapping applications or contents, and the application or contents displayed on the screen disappear from the screen by the touch gesture.

Preferably, the next application or content is displayed when the specific position of the screen is removed, and the previous application or the content is displayed when the portion other than the position is removed (e.g., upward or downward) May be displayed.

The application or content displayed on the execution screen is divided into an upper layer and a lower layer such as an onion skin.

The application and the content are performed differently depending on the position (left and right) (first touch point), the degree of peeling, and the peeling direction (depending on the movement path after touching) The level at which the screen stripping information is detected has a plurality of levels and is stored in the memory 160 after being set in the user menu according to the application type or the number of the application or the content to be multitasked. In addition, the display and operation of the application or contents according to the position of the peeled screen, the degree of peeling, and the direction of peeling can also be appropriately set by the user depending on the type and number of applications or contents to be multitasked.

The 3D effect or transparency displayed on the screen is different depending on the position (left and right) (first touch point), the degree of peeling, and the stripping direction (depending on the movement path after touch) .

3A and 3B illustrate an embodiment in which display of different applications or contents is controlled according to the screen peeling in the present invention.

3A, when a menu screen is displayed on an idle screen, which is an upper layer, and a screen saver screen is hidden in a lower hierarchy of the menu screen, the user can select a desired menu by touch gesture (touch and drag) You can peel off the onion screen. At this time, the controller 180 senses the position where the first touch point is removed from the idle screen, and detects the direction of peeling off the idle screen based on the path that is dragged (moved) after the touch.

When the user touches the upper right portion of the idle screen and then drags the idle screen in a diagonal direction (when the idle screen is removed), the controller 180 detects the screen peeling and makes the icons displayed on the idle screen (upper layer) disappear, A screen for the layer, that is, a screen saver screen is displayed. At this time, the level at which the control unit 180 detects the screen peeling is set in advance and stored in the memory 160.

As shown in FIG. 3B, when the idle screen is removed from the idle screen by the touch gesture, the upper idle screen disappears and a screen saver screen, which is a lower hierarchy, is displayed. After the screen saver screen is displayed for a predetermined time, a slideshow of a picture or a moving picture is automatically displayed. That is, the slide show mode is automatically operated when there is a folder in which the photo / movie is located in the lower layer or a photo / movie copied in the standby screen.

4A to 4C illustrate an example of controlling the display of an application or contents according to the degree of screen stripping in the embodiment of the present invention.

If the execution screen of the application is touched and dragged off by peeling off (peeling) the application, the display of different applications or contents can be controlled.

For example, as shown in FIG. 4A, when the lower right portion of the execution screen is slightly peeled off, the controller 180 detects the degree of peeling and displays a list 50 of applications currently being multi-stacked on the peeled portion, Further stripping will show the entire multi-stackable application. At this time, the degree of peeling is determined based on a plurality of peeling steps stored in the memory 160 in advance in the user menu.

In another embodiment, as shown in FIG. 4B, when three applications are running, the bottom running portion of the running screen is slightly peeled off to display the currently running overheaded application, and if more stripped, the second application is displayed, By displaying the third application, the switching between applications can be performed quickly according to the degree of stripping the execution screen.

In addition, the present invention can be selectively performed according to the position where the screen display, which is operated differently according to the degree of peeling, is peeled off.

As shown in FIG. 4C, in a state where a plurality of applications are being executed and one application is displayed on the current screen, the embodiment shown in FIG. 4A and the embodiment shown in FIG. . That is, when the corresponding application displayed on the current screen is peeled off from the lower left end, as shown in FIG. 4B, switching between applications is performed according to the degree of peeling, Displays a list of all applications that can be tasked.

FIG. 5 is an example of controlling display and execution of content tagged with geographical information according to the degree of screen stripping in the embodiment of the present invention.

Generally, certain contents (photographs, moving pictures) are linked to geographical information so that the user can more easily understand the geographical information of the contents. Therefore, in order to know the geographical information tagged (linked) to the content, the detailed information menu should be selected.

The present invention can easily perform a series of operations for viewing the tagged geographical information in a predetermined content by selecting a detailed information menu according to the degree of stripping of the corresponding content screen.

As shown in FIG. 5, when the user removes the lower right portion of the photograph by touching and dragging with the content (eg, photo) to which the geographic information is tacked (linked) displayed, And displays different information related to the geographical information according to the degree of peeling after detecting the peeling. For example, if the photograph is slightly peeled off (one step is peeled off), the geo tagging information and / or the corresponding interlocking function are displayed in a pop-up form 51 at a predetermined position (lower end in this embodiment) (Step 2 peeled off) Display map (MAP) or detailed contents for the corresponding location (Seoul, Gangnam-gu, Yeoksam-dong)

6A and 6B illustrate an embodiment in which screen display is controlled on a web browser according to the degree and position of screen stripping in the present invention.

When one or more web sites are running and the screen of a specific site (eg, Naver) is displayed, if the user removes the screen by the touch gesture, the control unit 180 detects the degree and position of the screen, Or display or execute the content. For example, as shown in FIG. 6A, when the user removes the lower left portion of the screen, the controller 180 displays a list of other websites currently being executed (eg, Google and the next) 52 in a thumbnail form in the stripped region . On the other hand, when the user removes the lower right portion of the screen as shown in FIG. 6B, the control unit 180 displays the three favorite lists 53 in a thumbnail form in the peeled area.

In addition, the controller 180 may sequentially display the two web site lists (e.g., Google and the next) or three favorite lists according to the degrees (steps) shown in Figs. 6A and 6B. That is, if the bottom left corner of the screen is peeled off, only one web site listing (Google) is displayed from two web site listings (eg Google and the next one), two web site listings (eg Google and next) Display all. When the user peels off the bottom right of the screen (peeled off 1 step), the first favorite list is displayed first, and when peeled off (peeled off 2 steps), the second favorite list is displayed. ) Displays the third favorite list.

Typically, the Photos, Videos, MP3, and Memo menus (upper layer) contain multiple individual icons (photos, videos, MP3s and notes) at the same level (lower layer) Depending on the settings, multiple pictures, videos, MP3s and memos are included.

Accordingly, in the present invention, when any one of a plurality of pictures, a moving picture, an MP3, and memos is included in an individual icon, the previous or next item (photo, movie, MP3 and memo) is displayed by peeling each icon or group of icons .

7A and 7B show a first embodiment in which display of an application or content at the same level is controlled in accordance with the screen peeling in the present invention.

As shown in FIG. 7A, when the user selects a photo icon, the control unit 180 displays a plurality of pictures photographed by date, for example, on the screen. When the user removes a specific picture from the displayed pictures, the control unit 180 displays the next picture of the currently displayed picture, and the user can view a plurality of pictures by repeating the operation.

7B, at least one photograph is set to a group (for example, four photographs) 54 by touching and dragging, and then the designated photo group 54 is peeled off to form a plurality You can see previous or next pictures for several photos at once.

FIG. 8 is a second embodiment of the present invention for controlling the display of applications or contents at the same level in accordance with the screen peeling.

When a plurality of SNS applications are being executed and the first SNS application, for example, Facebook is displayed, if the user removes the Facebook screen, the control unit 180 displays the previous or next SNS application do. That is, when the first Facebook screen is removed, the second Twitter application is displayed, and when the Twitter screen is removed again, the next SNS application is displayed. At this time, the SNS application currently displayed in the SNS application list 55 at the top of the screen is displayed.

9A to 9E illustrate a third embodiment of the present invention in which applications or contents at the same level are displayed according to the screen peeling.

The example shown in FIG. 9A is an example in which tab-to-tab switching is performed using a touch gesture.

If a specific group is initially selected, the control unit 180 displays a plurality of phone number lists related to the group on the phone book. In this state, when the user removes the right side of the telephone directory, a plurality of telephone number lists related to the next telephone directory group are displayed on the screen.

Also, when a specific consonant 'a' is initially selected, a plurality of telephone number lists related to the 'A' are displayed on the screen. In this state, if the user removes the right side of the telephone directory, a list of a plurality of telephone numbers related to the next consonant 'B' is displayed on the screen. In this way, the previous / next phone numbers related to a plurality of consonants (a, b, c, ...) can be displayed on the screen by the touch gesture, and each phone number group belongs to the same level.

FIG. 9B illustrates an example in which a web browser switches a web page by a touch gesture. When a user removes one side of a currently displayed web page, the previous / next web page is displayed.

FIG. 9C is an example of performing switching between multi-home screens by a touch gesture on a multi-home screen (idle screen), the concept of which is the same as that of FIG. 9B. That is, when the home screen is peeled off by a touch gesture (screen peeling) in a state where a plurality of home screens are overlapped like an onion skin, the previous or next home screen is displayed depending on the position where the home screen is peeled off.

FIG. 9D shows an example of switching between thumbnail images by a touch gesture on a thumbnail display screen, which is also the same as FIGS. 9B and 9C. For example, when one thumbnail screen is composed of nine thumbnails, the other thumbnail screen is composed of one thumbnail, and the two thumbnail screens are overlapped with each other, the touch gesture (screen stripping) The thumbnail screen of chapters 1 to 9 is displayed.

9E is an example of switching the input mode by the touch gesture on the input screen.

As shown in FIG. 9E, on the virtual keypad, the user can switch the input mode between Hangul, numeric, upper-case and lower-case English when the input screen is peeled off with a touch gesture. For example, when the screen on the upper right side is continuously peeled off, switching between character input modes such as Hangul mode-English mode-Chinese mode is performed. When the screen on the lower left side is peeled off, switching between upper case and lower case is performed. It is possible to perform switching between the character input mode and the numeric input mode.

FIG. 10 shows a first embodiment for displaying applications or contents at different levels according to a touch gesture according to the present invention. This embodiment shows an example of switching from a lower layer to an upper layer.

As shown in Fig. 10, when a user selects a specific photo folder in a plurality of upper photo folders, a plurality of photos (lower layer) included in the folder are displayed.

In this state, when the screen displaying the plurality of pictures is peeled off by the touch gesture, the upper folder list (upper layer) 56 is displayed at the peeled position, and the user selects another folder from the upper folder list 56, You can watch the pictures included in the video or watch the video.

11A and 11B show a first embodiment in which applications or contents at different levels are displayed according to a direction in which a screen is stripped in the present invention.

In the foregoing, the display and execution of the application or contents are controlled according to the degree and position of the touch gesture (screen peeling). However, the present invention is not limited to this, and the present invention may control display and execution of detailed information of applications or contents or geographic information (or geo tagging information) according to the direction of the touch gesture (screen peeling).

11A, in a state in which specific contents (eg, pictures) including the geographical information G are displayed on the display unit 151 of the mobile terminal, the user moves the corresponding picture upward from the lower right side by the touch gesture The control unit 180 displays the geographical tagging information and the corresponding interlocking function in the pop-up form 51 at the peeled position. On the other hand, as shown in FIG. 11B, when the user removes the corresponding picture from the lower right side by the touch gesture to the left, the controller 180 displays detailed information about the corresponding picture at the removed position.

12 is a second embodiment of the present invention in which applications or contents at different levels are displayed according to the direction in which the screen is stripped.

The embodiment shown in FIG. 12 is an example of displaying an option menu or a shortcut menu related to the specific function according to a stripping direction when a corresponding function screen is removed using a touch gesture on a specific function screen (e-mail, telephone directory, . For example, when the user removes the screen from the upper left part to the lower part by the touch gesture by the user in the email receiving screen, the control unit 180 displays the main option menu of the email, and when the corresponding screen is removed from the upper right part to the right, Displays the menu.

13A and 13B show embodiments in which different applications or contents are displayed according to the degree of screen stripping when short-range communication is performed.

When a list of devices that perform close-range communication (e.g., Bluetooth or Wi-fi) is displayed on the display unit 151 and the user taps off the device list by a touch gesture as shown in FIG. 13A, And displays a device performing short-range communication in Zone 1, and displays a device performing short-range communication in Zone 2 if it is further stripped.

In addition, the present invention can display different applications or contents according to the degree of stripping when a plurality of devices are registered and used in a specific SNS. For example, when the user accesses the SNS and displays a list of registered devices, and then slightly peels off the device list by a touch gesture, the control unit 180 displays the list of registered devices, 2 villages) to display the user. That is, if the registered device list is slightly peeled, only one user can be displayed.

14A and 14B show a first embodiment in which different applications or contents are displayed according to a multi-touch gesture in a specific application. 14A is an example of photo filtering, and FIG. 14B is an example of a display font.

As shown in FIG. 14A, when a user removes a corresponding picture with one finger in a picture to which the filter is applied, the control unit 180 displays the picture filtered by the first filter and displays the picture filtered with the two fingers The photo filtered by the second filter is displayed. The output of the photo filtered by the first filter or the second filler may be controlled not only by the number of fingers to be peeled but also by the degree and position of peeling as described above.

In the same way, when the user removes the text with the finger while the translated text or the text to which the font is applied is displayed on the display unit 151, the language display of the text and the font are displayed differently according to the number of the fingers. For example, as shown in FIG. 14B, when the text translated into Korean is peeled off with one finger, the control unit 180 displays the text of English, and if the finger is peeled off, the text of the German is displayed. When the text to which the original is applied is displayed, the control unit 180 displays the text of the rolled font when the text is peeled off with one finger, and displays the text of the human letter font when the finger is peeled off with two fingers. In addition, the language display and the font change of the text may be controlled not only according to the number of fingers stripping the text, but also according to the degree and position of peeling as described above.

15A and 15B show a second embodiment in which different applications or contents are displayed according to a multi-touch gesture in a specific application.

In particular, FIGS. 15A and 15B show an operation mode for the corresponding broadcast content according to the number of fingers (1, 2, ..., n) when the broadcast content is displayed using the multi-touch gesture when specific broadcast contents are displayed This is an example of different control. The operation mode includes all modes (recording, playback, pause, fast forward and rewind, and other operations) used for executing the current broadcast contents.

For example, when the user strips the broadcast content with one finger, the controller 180 captures the broadcast content displayed on the current screen and performs the recording of the broadcast content when the user removes the broadcast content with two fingers.

In addition to the above-described embodiments, the present invention can adjust the stereoscopic effect (3D) of the currently displayed application or content according to the degree of stripping the screen. That is, a difference in depth of display is set according to the degree of peeling, for example, when a user peels off a picture, the degree of peeling is detected, and the depth of the picture corresponding to the detected result is adjusted. Displays the uncontrolled picture (Clean View).

Further, if the display unit 151 is composed of two displays, for example, an opaque display (electronic paper, LCD) under the transparent display (TOLED), the application or contents displayed on the screen have a three-dimensional effect. If the user removes a stereoscopic application or content, the controller 180 maintains the current state and removes the transparent display by removing the content more than a predetermined position, thereby displaying an application or content without a stereoscopic effect.

16 is a flowchart illustrating a method of controlling an application and a content by a peeling operation of a touch gesture according to an embodiment of the present invention.

As shown in FIG. 16, the user displays a specific application or content on the display unit 151 of the mobile terminal (S10). The displayed application or content may have a hierarchical structure in which a plurality of applications or contents are overlapped with each other like one or an onion.

When the application or content is displayed, the user performs a touch operation (touching) on the application or the content screen using the touch gesture (touch and drag) (S20).

The control unit 180 detects the position, degree and direction of the screen peeling performed by the user (S30), and controls the display and execution of the application or the content according to the detected position, degree and direction of the screen peeling (S40 , S50). That is, as described above, the control unit 180 sequentially displays or displays the previous or next application or contents, displays the geographical information, or executes the application according to the position, degree and direction of the screen peeling.

As described above, according to the present invention, an application or content is switched according to a screen peeling using a touch gesture, and various displays and execution of the application or contents are controlled according to the removed position, degree and direction, It is possible to conveniently perform display or switching of an application or a content between layers.

Further, according to an embodiment of the present invention, the above-described method can be implemented as computer-readable code on a medium on which a program is recorded. The computer readable medium includes all kinds of recording devices in which data that can be read by a computer system is stored. Examples of the computer-readable medium include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage, and the like, and also implemented in the form of a carrier wave (for example, transmission over the Internet) . Further, the computer may include a control unit of the terminal.

The mobile terminal described above can be applied to not only the configuration and method of the embodiments described above but also all or some of the embodiments may be selectively combined so that various modifications may be made to the embodiments It is possible.

110: wireless communication unit 111: broadcast receiving module
112: mobile communication module 113; Wireless Internet Module
140; Sensing unit 150: output unit
151: display unit 160: memory
180:

Claims (22)

Hierarchically displaying a plurality of applications or contents;
Detecting a touch gesture that appears to strip the screen from the displayed application or content; And
And controlling the display or execution of the application or the content corresponding to the degree, position, and direction of the screen peeling by the sensed touch gesture,
The control step
Displaying a stripped portion when an edge of the application or content screen is touched;
Increasing the degree of screen peeling when the displayed peeled portion is dragged in a predetermined direction; And
And displaying the step of detecting the increasing degree of peeling of the screen according to the stored step and executing different functions of the application or the content for each step. The method of claim 1, wherein the application or content
Wherein at least one application or content, which is the same layer or a different layer, has a hierarchical structure in which the contents overlap. delete The method of claim 1, wherein the upper layer application or content displayed on the current screen disappears according to the peeling of the screen, and the hidden lower layer application or content is displayed. The method of claim 1, wherein the application or content is switched according to peeling of the screen. 6. The method of claim 5, wherein switching between the application or content
Displaying the previous or next application or content, including switching between SNS applications, switching between tabs, switching between web pages, switching between idle screens, and switching between input modes. delete The method of claim 1, wherein the application and the content are controlled by at least one of a position, an extent, and a direction of the screen. delete [2] The method of claim 1,
Wherein the application and the content are displayed on the screen. The method of claim 1, wherein the application and the content are displayed on the screen. The method of claim 1, wherein the touch gesture comprises
A touch and a drag, and a multi-touch. A display unit for hierarchically displaying a plurality of applications or contents;
A control unit for differently controlling display or execution of the application or the content corresponding to the degree, position and direction of the screen peeling off by the input touch gesture when a touch gesture as if the screen is peeled off is displayed on the displayed application or content ≪ / RTI &
The control unit
(a) when a corner portion of an application or a content screen is touched, a peeled portion is displayed,
(b) increasing the degree of peeling of the screen when the displayed peeled portion is dragged in a predetermined direction,
(c) detecting the degree of the peeling of the screen in a pre-stored step, and executing different functions of the application or the content in each step. delete 13. The mobile terminal of claim 12, further comprising a memory that stores the degree of screen peeling at a predetermined level and stores an application or content corresponding to each level. 13. The method of claim 12, wherein the application or content
Wherein the mobile terminal has a hierarchical structure in which at least one application or content, which is the same layer or different layers, overlaps. 13. The method of claim 12, wherein the touch gesture comprises
Touch & drag ", and " multi-touch ". 13. The apparatus of claim 12, wherein the control unit
Removes an application or content of a higher layer displayed on the current screen when the screen is peeled off, and displays an application or a content of a hidden lower layer. 13. The apparatus of claim 12, wherein the control unit
And the switching between the SNS application, the switching between the tabs, the switching between the web pages, the switching between the idle screens, and the switching between the input modes are performed. Mobile terminal. 13. The apparatus of claim 12, wherein the control unit
And controls display and execution of the application or the content on the basis of at least one of a position, an extent and a direction of the screen being peeled off. delete [14] The method of claim 12,
And the left and right sides of the upper and lower ends of the upper part of the screen, and the control unit displays different applications or contents each time the respective positions are removed. delete

Images