KR102172792B1 - Display apparatus and method for controlling thereof - Google Patents

Abstract

Disclosed is a method of controlling a display device including a touch screen that executes at least one application. The control method according to the present invention includes the step of receiving an application execution command for executing at least one application, and determining at least one of a size and a location of a window for executing the application according to a location where the application execution command is input, and And displaying the window based on at least one of the determined position and size.

Description

Display device and its control method {DISPLAY APPARATUS AND METHOD FOR CONTROLLING THEREOF}

The present invention relates to a display device and a control method thereof, and more particularly, to a display device that controls the display of a window in which an application is executed, and a control method thereof.

A desktop computer has at least one display device (eg, a monitor). A mobile device (eg, a mobile phone, a smartphone, or a tablet PC) using a touch screen has one display device.

A user of a desktop computer may divide the screen of the display device according to the work environment (eg, horizontally or vertically divided by opening a plurality of windows and working). When the web browser is executed, the web page can be moved upward or downward using a page up button or a page down button on the keyboard. When using a mouse instead of a keyboard, you can select a scroll bar on the side of a web page with the cursor of the mouse and move it up or down the web page. In addition, you can move to the top part of the web page by selecting the top button displayed as text or icon at the bottom of the web page.

Compared to a desktop computer, a mobile device has a smaller size of a displayed screen and has a limitation on input. It is difficult to use a mobile device by dividing the screen.

In addition, various applications, such as basic applications manufactured by the device manufacturer and installed on the device, and additional applications downloaded through an application sales site on the Internet, may be executed on the mobile device. The additional applications can be developed by general users and registered on the sales site. Accordingly, anyone can freely sell applications developed by himself/herself to users of the mobile device through the application sales site. Accordingly, tens of thousands to hundreds of thousands of applications are currently provided to mobile devices for free or for a fee depending on the product.

In this way, various applications that stimulate the consumer's curiosity and satisfy the consumer's desires are provided on the mobile device, but since the mobile device is manufactured in a portable size, the size of the display and the user interface (UI) There are limitations. Accordingly, it is inconvenient for the user to execute a number of applications on the mobile device. For example, in a mobile device, when one application is executed, it is displayed on the entire display area of the display. In addition, in order to execute another desired application, the currently running application must be terminated first, and then an execution key for executing the desired application must be selected again. That is, in the mobile device, in order to execute various applications, it is troublesome to repeat execution and termination processes for each application. In addition, a method for simultaneously executing multiple applications on a mobile device is not provided.

In this way, various applications that stimulate the consumer's curiosity and satisfy the consumer's desires are provided on the mobile device, but since the mobile device is manufactured in a portable size, the size of the display and the user interface (UI) There are limitations. Accordingly, it is inconvenient for the user to execute a number of applications on the mobile device.

Accordingly, there is a need to develop a technology for displaying a plurality of windows on one display. In addition, there is a need to develop a technology capable of easily executing a plurality of windows and facilitating window arrangement after execution. In particular, when a user executes a window, development of a user interface that allows the window to be easily arranged in a desired size and position is requested.

In particular, when a plurality of windows are overlapped and displayed, a configuration for switching a screen from a currently displayed window to another subordinate window has not been disclosed.

The invention was conceived in response to the above-described technology development request, and the present invention is capable of easily switching between a window displayed after execution and a subordinate window while executing a plurality of windows in various sizes on one display. A display device and a control method thereof are provided.

In order to achieve the above, a method of controlling a display device including a touch screen, which executes at least one application according to an embodiment of the present invention, includes receiving an application execution command to execute at least one application. ; And determining at least one of a size and a location of a window for executing the application according to a location where the application execution command is input, and displaying the window based on at least one of the determined location and size.

Meanwhile, a display device according to another aspect of the present invention includes: a touch screen receiving an application execution command for executing at least one application; And determining at least one of a size and a location of a window executing the application according to a location where the application execution command is input, and controlling to display the window on the touch screen based on at least one of the determined location and size. It includes;

According to various embodiments of the present disclosure, a display device capable of easily switching between a window displayed after execution and a subordinate window while executing a plurality of windows on one display, and a control method thereof are provided. Accordingly, a user can simultaneously use a plurality of applications displayed on a plurality of windows. In addition, when several windows are overlapped and displayed, an effect of easily switching the screen from the currently displayed window to another subordinate window can be created. In addition, in an environment in which a plurality of windows are displayed, a user can maximize the convenience of executing a window in a desired location and size.

1 is a schematic block diagram showing an apparatus according to an embodiment of the present invention.
2A to 2K are conceptual diagrams for explaining a method of executing a window according to an embodiment of the present invention.
3A to 3I are conceptual diagrams of an activity stack corresponding to various embodiments of the present disclosure.
4A is a flowchart illustrating a method of controlling a display device according to an embodiment of the present invention.
4B is a flowchart illustrating a method of controlling a display device according to another embodiment of the present invention.
5 is a conceptual diagram for explaining the Z-order.
6A to 6D are conceptual diagrams illustrating a method of executing an application according to another embodiment of the present invention.
7 is a flowchart illustrating a method of controlling a display device according to an embodiment of the present invention.
8A to 8M are conceptual diagrams illustrating a method of displaying a plurality of windows according to an embodiment of the present invention.
9A to 9H are conceptual diagrams for explaining layout according to various embodiments of the present disclosure.
10 is a conceptual diagram of a screen of a display device according to an embodiment of the present invention.
11 is a conceptual diagram of a screen of a display device according to an embodiment of the present invention.
12 is a conceptual diagram of a screen of a display device according to an embodiment of the present invention.
13 is a conceptual diagram of a screen of a display device according to an embodiment of the present invention.
14 is a conceptual diagram of a screen of a display device according to an embodiment of the present invention.
15 is a conceptual diagram of a screen of a display device according to an embodiment of the present invention.
16A to 16D are conceptual diagrams of a display device according to various embodiments of the present disclosure.
17 is a conceptual diagram of a screen of a display device according to an embodiment of the present invention.
18A and 18B are conceptual diagrams for a 9-split mode according to an embodiment of the present invention.
19 is a flowchart illustrating a method of controlling a display device according to an embodiment of the present invention.
20 is a flowchart illustrating a method of controlling a display device according to an embodiment of the present invention.
21A to 21C are conceptual diagrams of a display device according to various embodiments of the present disclosure.
22 is a conceptual diagram of an activity stack according to the present invention.
23A and 23B are conceptual diagrams of a display device for explaining a z-order change command.
24 is a conceptual diagram of an activity stack according to the present invention.
25A and 25B are conceptual diagrams of a display device for explaining a z-order change command according to another embodiment of the present invention.
26 is a conceptual diagram of an activity stack according to the present invention.
27A and 27B are conceptual diagrams of a display device according to another exemplary embodiment of the present invention.
28 is a conceptual diagram of an activity stack according to the present invention.
29A and 29B are conceptual diagrams of a display device according to another embodiment of the present invention.
30 is a conceptual diagram of an activity stack according to the present invention.
31A and 31B are conceptual diagrams of a display device according to another embodiment of the present invention.
32 is a conceptual diagram of an activity stack according to the present invention.
33A and 33B are conceptual diagrams of a display device according to another embodiment of the present invention.
34 is a conceptual diagram of an activity stack according to the present invention.
35 is a flowchart illustrating a method of controlling a display device according to an embodiment of the present invention.
36A to 36C are conceptual diagrams for explaining a z-order change command according to an embodiment of the present invention.
37A to 37C are conceptual diagrams of an activity stack corresponding to each of FIGS. 36A to 36C.
38A to 38C are conceptual diagrams for explaining a z-order change command according to an embodiment of the present invention.
39A to 39C are conceptual diagrams of an activity stack corresponding to each of FIGS. 38A to 38C.

Hereinafter, exemplary embodiments according to the present invention will be described in detail with reference to the contents described in the accompanying drawings. However, the present invention is not limited or limited by exemplary embodiments. The same reference numerals shown in each drawing indicate members that perform substantially the same function.

1 is a schematic block diagram showing an apparatus according to an embodiment of the present invention.

Referring to FIG. 1, the display device 100 may be connected to an external device (not shown) using a mobile communication module 120, a sub communication module 130, and a connector 165. “External device” includes other devices (not shown), mobile phones (not shown), smart phones (not shown), tablet PCs (not shown), and servers (not shown).

Referring to FIG. 1, the display device 100 includes a touch screen 190 and a touch screen controller 195. In addition, the display device 100 includes a control unit 110, a mobile communication module 120, a sub communication module 130, a multimedia module 140, a camera module 150, a GPS module 155, an input/output module ( 160), a sensor module 170, a storage unit 175, and a power supply unit 180. The sub communication module 130 includes at least one of a wireless LAN module 131 and a short-range communication module 132, and the multimedia module 140 is a broadcast communication module 141, an audio playback module 142, and a video playback module. It includes at least one of (143). The camera module 150 includes at least one of a first camera 151 and a second camera 152, and the input/output module 160 includes a button 161, a microphone 162, a speaker 163, and a vibration It includes at least one of a motor 164, a connector 165, and a keypad 166.

The controller 110 stores the CPU 111, a ROM (ROM) 112 in which a control program for controlling the display device 100 is stored, and a signal or data input from the outside of the display device 100, or It may include a RAM (RAM) 113 used as a storage area for a task performed in 100). The CPU 111 may include a single core, a dual core, a triple core, or a quad core. The CPU 111, the ROM 112, and the RAM 113 may be interconnected through an internal bus.

The control unit 110 includes a mobile communication module 120, a sub communication module 130, a multimedia module 140, a camera module 150, a GPS module 155, an input/output module 160, and a sensor module 170. , The storage unit 175, the power supply unit 180, the first touch screen 190a, the second touch screen 190b, and the touch screen controller 195 may be controlled.

The mobile communication module 120 allows the display device 100 to be connected to an external device through mobile communication using at least one-one or a plurality of antennas (not shown) under the control of the controller 110. The mobile communication module 120 includes a mobile phone (not shown), a smart phone (not shown), a tablet PC, or other device (not shown) having a phone number input to the display device 100 for a voice call or a video call. , Transmitting/receiving wireless signals for text messages (SMS) or multimedia messages (MMS).

The sub communication module 130 may include at least one of a wireless LAN module 131 and a short range communication module 132. For example, it may include only the wireless LAN module 131, only the short-range communication module 132, or both the wireless LAN module 131 and the short-range communication module 132.

The wireless LAN module 131 may be connected to the Internet at a place where a wireless access point (AP) (not shown) is installed under the control of the controller 110. The wireless LAN module 131 supports the wireless LAN standard (IEEE802.11x) of the American Institute of Electrical and Electronic Engineers (IEEE). The short-range communication module 132 may wirelessly perform short-range communication between the display device 100 and an image forming device (not shown) under the control of the controller 110. The short-range communication method may include Bluetooth, infrared data association (IrDA), and Zig-bee method.

The display apparatus 100 may include at least one of a mobile communication module 120, a wireless LAN module 131, and a short-range communication module 132 according to performance. For example, the display apparatus 100 may include a combination of a mobile communication module 120, a wireless LAN module 131, and a short-range communication module 132 according to performance.

The multimedia module 140 may include a broadcast communication module 141, an audio playback module 142, or a video playback module 143. The broadcast communication module 141 is a broadcast signal (eg, a TV broadcast signal, a radio broadcast signal or a data broadcast signal) transmitted from a broadcast station through a broadcast communication antenna (not shown) under the control of the control unit 110 and the broadcast unit information (Eg, Electric Program Guide (EPS) or Electric Service Guide (ESG)) may be received. The audio reproducing module 142 may play a stored or received digital audio file (eg, a file having a file extension of mp3, wma, ogg, or wav) under the control of the controller 110. The video reproducing module 143 may play a stored or received digital video file (eg, a file having a file extension of mpeg, mpg, mp4, avi, mov, or mkv) under the control of the controller 110. The video reproducing module 143 may reproduce digital audio files.

The multimedia module 140 may include an audio playback module 142 and a video playback module 143 except for the broadcast communication module 141. In addition, the audio playback module 142 or the video playback module 143 of the multimedia module 140 may be included in the control unit 100.

The camera module 150 may include at least one of a first camera 151 and a second camera 152 for capturing a still image or a video under control of the controller 110. In addition, the first camera 151 or the second camera 152 may include an auxiliary light source (eg, a flash (not shown)) that provides an amount of light required for photographing. The first camera 151 may be disposed on the front side of the display device 100, and the second camera 152 may be disposed on the rear side of the display device 100. In a manner taken differently, the first camera 151 and the second camera 152 are adjacent (e.g., the distance between the first camera 151 and the second camera 152 is greater than 1 cm and less than 8 cm). It can be arranged to take a 3D still image or a 3D video.

The GPS module 155 receives radio waves from a plurality of GPS satellites (not shown) in orbit of the earth, and uses a time of arrival from the GPS satellites (not shown) to the display device 100. Thus, the position of the display device 100 may be calculated.

The input/output module 160 may include at least one of a plurality of buttons 161, a microphone 162, a speaker 163, a vibration motor 164, a connector 165, and a keypad 166.

The button 161 may be formed on the front, side or rear of the housing of the display device 100, and a power/lock button (not shown), a volume button (not shown), a menu button, a home button, and a return button. It may include at least one of a back button and a search button 161.

The microphone 162 receives a voice or sound under the control of the controller 110 and generates an electrical signal.

The speaker 163 is a mobile communication module 120, a sub-communication module 130, a multimedia module 140, or a variety of signals of the camera module 150 under the control of the controller 110 (e.g., wireless signal, broadcast signal, Sound corresponding to a digital audio file, a digital video file, or taking a picture) may be output to the outside of the display device 100. The speaker 163 may output a sound corresponding to a function performed by the display apparatus 100 (eg, a button operation sound corresponding to a phone call, or a call connection sound). One or more speakers 163 may be formed at appropriate positions or positions of the housing of the display device 100.

The vibration motor 164 may convert an electrical signal into mechanical vibration under the control of the controller 110. For example, when the display device 100 in the vibration mode receives a voice call from another device (not shown), the vibration motor 164 operates. One or more may be formed in the housing of the display device 100. The vibration motor 164 may operate in response to a user's touch motion of touching the touch screen 190 and a continuous motion of the touch on the touch screen 190.

The connector 165 may be used as an interface for connecting the display device 100 and an external device (not shown) or a power source (not shown). Data stored in the storage unit 175 of the display device 100 is transmitted to an external device (not shown) or an external device (not shown) through a wired cable connected to the connector 165 under the control of the controller 110 You can receive data from ). Power may be input from a power source (not shown) or a battery (not shown) may be charged through a wired cable connected to the connector 165.

The keypad 166 may receive a key input from a user to control the display device 100. The keypad 166 includes a physical keypad (not shown) formed on the display device 100 or a virtual keypad (not shown) displayed on the touch screen 190. A physical keypad (not shown) formed on the display device 100 may be excluded depending on the performance or structure of the display device 100.

The sensor module 170 includes at least one sensor that detects the state of the display device 100. For example, the sensor module 170 may include a proximity sensor that detects whether a user approaches the display device 100, an illuminance sensor (not shown) that detects the amount of light around the display device 100, or a display. A motion sensor (not shown) that detects the operation of the device 100 (eg, rotation of the display device 100, acceleration or vibration applied to the display device 100) may be included. At least one sensor may detect a state, generate a signal corresponding to the detection, and transmit it to the controller 110. Sensors of the sensor module 170 may be added or deleted according to the performance of the display device 100.

The storage unit 175 is a mobile communication module 120, a sub communication module 130, a multimedia module 140, a camera module 150, a GPS module 155, an input/output module under the control of the controller 110. The input/output signals or data may be stored in correspondence with the operation of the sensor module 170 and the touch screen 190. The storage unit 175 may store control programs and applications for controlling the display apparatus 100 or the controller 110.

The term “storage unit” refers to a memory card (not shown) mounted in the storage unit 175, the ROM 112, the RAM 113, or the display device 100 (eg, SD card, memory Stick). The storage unit may include a nonvolatile memory, a volatile memory, a hard disk drive (HDD), or a solid state drive (SSD).

The power supply unit 180 may supply power to one or a plurality of batteries (not shown) disposed in the housing of the display apparatus 100 under the control of the controller 110. One or more batteries (not shown) supply power to the display device 100. In addition, the power supply unit 180 may supply power input from an external power source (not shown) to the display device 100 through a wired cable connected to the connector 165.

The touch screen 190 may provide a user interface corresponding to various services (eg, call, data transmission, broadcasting, and photography) to a user. The touch screen 190 may transmit an analog signal corresponding to at least one touch input to the user interface to the touch screen controller 195. The touch screen 190 may receive at least one touch input through a user's body (eg, a finger including a thumb) or a touchable input means (eg, a stylus pen). In addition, the touch screen 190 may receive a continuous motion of one touch among at least one touch. The touch screen 190 may transmit an analog signal corresponding to a continuous movement of an input touch to the touch screen controller 195.

In the present invention, the touch is not limited to the contact between the touch screen 190 and the user's body or the touchable input means, and non-contact (e.g., the touch screen 190 and the user's body or the touchable input means and the detectable distance are 1 mm or less). The interval detectable on the touch screen 190 may be changed according to the performance or structure of the display device 100.

The touch screen 190 may be implemented in, for example, a resistive method, a capacitive method, an infrared method, or an ultrasonic wave method.

The touch screen controller 195 converts the analog signal received from the touch screen 190 into a digital signal (eg, X and Y coordinates) and transmits it to the controller 110. The controller 110 may control the touch screen 190 using a digital signal received from the touch screen controller 195. For example, the controller 110 may select a shortcut icon (not shown) displayed on the touch screen 190 or execute a shortcut icon (not shown) in response to a touch. In addition, the touch screen controller 195 may be included in the control unit 110.

2A to 2K are conceptual diagrams for explaining a method of executing a window according to an embodiment of the present invention. Meanwhile, those skilled in the art will readily understand that the display device 200 may be implemented in various forms such as a general TV, Internet TV, and medical data display device, as well as the mobile device described above with respect to FIG. 1. That is, the display device is not limited as long as it is a device including a means capable of displaying a rendered image.

As shown in FIG. 2A, the display apparatus 200 may set a plurality of window display spaces 201 to 204 on the touch screen. In more detail, the control unit (not shown) may set the first window display space 201, the second window display space 202, the third window display space 203, and the fourth window display space 204. The control unit (not shown) includes a first boundary line 211, a third window display space 203, and a fourth window display space 204, which are boundary lines between the first window display space 201 and the second window display space 202. The second boundary line 212, which is the boundary of the first window display space, and the third boundary line 213 and the second window display space 202, and the fourth window display space 204 are boundary lines of the third window display space 203. A fourth boundary line 214 that is a boundary line of) may be set. Here, the first boundary line 211 and the second boundary line 212 may form one line segment, and the third boundary line 213 and the fourth boundary line 214 may form one line segment. The control unit (not shown) sets the first to fourth window display spaces 201 to 204 so as not to overlap each other. For example, as shown in FIG. 2A, the control unit (not shown) sets the first window display space 201 on the upper left side, sets the second window display space 202 on the upper right side, and the third The window display space 203 is set at the lower left side, and the fourth window display space 204 is set at the lower right side. The control unit (not shown) sets the first and second boundary lines 211 and 212 to divide the screen horizontally, and sets the third and fourth boundary lines 213 and 214 to divide the screen vertically.

Meanwhile, the controller (not shown) displays the center button 210 at the intersection of the first and second boundary lines 211 and 212 and the third and fourth boundary lines 213 and 214. The center button may be a function key for providing a function of changing the size of the application display space or entering a window position change mode.

The control unit (not shown) controls the window display spaces 201 to 204 to arrange and display windows for executing applications one by one. For example, the control unit (not shown) controls to display windows in each of the window display spaces 201 to 204 as shown in FIGS. 2B to 2K.

Here, the window may be an area including an execution screen of a specific application and a title of an executed application. Objects related to the application may be displayed on the execution screen of the application. The object may be formed in various shapes such as text, figure, icon, button, check box, photo, video, web, map, etc. When a user touches an object, a predetermined function or event may be performed in an application corresponding to the object. The object may be called a view depending on the operating system. The title bar may include at least one control key for controlling the display of the window. For example, the control keys may be a window display minimize button, a window display maximize button, and a window end button.

Meanwhile, the applications are programs implemented independently from each other by the display device 200 manufacturer or the application developer. Accordingly, in order for one application to be executed, it is not required that another application be executed in advance. In addition, even if one application is terminated, another application may continue to be executed.

Since applications are programs implemented independently of each other, a complex function application (or dual function application) in which some functions (memo function, message transmission function) provided by other applications are added within one application (for example, a video application). Application). However, such a multifunctional application is a single application newly manufactured to have various functions, and is different from existing applications. Accordingly, the complex function application does not provide various functions like existing applications, and provides limited functions, and the user has a burden to separately purchase such a new complex function application.

Referring to FIG. 2B, a controller (not shown) controls to display a window 230 running a launcher application on the first window display space 201. The launcher application displays application icons 231 to 238 that can be executed as shown in FIG. 2B. When an application execution command for touching one of the application icons 231 to 238 is input, the launcher application displays the application corresponding to the touched icon in the first window display space 201 to the fourth window display space 204 which is a window display space. ).

Meanwhile, FIG. 3A is a conceptual diagram of an activity stack managed by a display device. The controller (not shown) creates and manages the launcher application stack 301 on the activity stack in response to execution of the launcher application.

In FIG. 2C, the user 1 may touch an icon corresponding to application B. When the icon corresponding to the B application is touched, the controller (not shown) controls to display the second window 240 executing the B application on the second window display space 202 as shown in FIG. 2D. The controller (not shown) may determine a window display space in which windows are displayed in a preset order. For example, the control unit (not shown) may control the display of new windows in a clockwise order of the second window display space 202, the third window display space 203, and the fourth window display space 204. have. Meanwhile, the above-described order is a simple example, and the controller (not shown) may control the display of new windows in a counterclockwise order. The order in which new windows are displayed in the window display space can be changed.

Meanwhile, FIG. 3B is a conceptual diagram of an activity stack corresponding to FIG. 2D. The controller (not shown) generates the B application stack 302 on the activity stack in response to the execution of the B application. Meanwhile, the control unit (not shown) arranges the stack 302 of the most recently executed B application on the stack 301 of the launcher application. This may mean that the z-order of the B application is higher than the z-order of the launcher application.

In FIG. 2E, the user 1 may touch the icon 233 corresponding to the C application. Meanwhile, FIG. 3C is a conceptual diagram of an activity stack corresponding to FIG. 2E. As shown in FIG. 2E, since the user inputs an application execution command to the launcher application, it can be seen that the z-order of the launcher application is higher than the z-order of the B application.

When the icon 233 corresponding to the C application is touched, the controller (not shown) controls to display the third window 250 executing the C application on the fourth window display space 204 as shown in FIG. 2F.

Meanwhile, FIG. 3D is a conceptual diagram of an activity stack corresponding to FIG. 2F. The control unit (not shown) creates a C application stack 303 on the activity stack in response to the execution of the C application. Meanwhile, the control unit (not shown) arranges the stack 303 of the most recently executed C application on the stack 301 of the launcher application. This may mean that the z-order of the C application is higher than the z-order of the launcher application.

In FIG. 2G, the user 1 may touch the icon 234 corresponding to the D application. Meanwhile, FIG. 3E is a conceptual diagram of an activity stack corresponding to FIG. 2G. As shown in FIG. 2G, since the user inputs an application execution command to the launcher application, it can be confirmed that the z-order of the launcher application is higher than the z-order of the C application.

When the icon 234 corresponding to the D application is touched, the controller (not shown) controls to display the fourth window 260 executing the D application on the third window display space 203 as shown in FIG. 2H.

Meanwhile, FIG. 3F is a conceptual diagram of an activity stack corresponding to FIG. 2H. The controller (not shown) generates the D application stack 304 on the activity stack in response to the execution of the D application. Meanwhile, the controller (not shown) arranges the stack 304 of the most recently executed D application on the stack 301 of the launcher application. This may mean that the z-order of the D application is higher than the z-order of the launcher application.

Meanwhile, the user 1 can manipulate the B application as shown in FIG. 2I. 3G is a conceptual diagram of an activity stack corresponding to FIG. 2I. The control unit (not shown) places the stack 302 of the most recently executed B application at the top in response to a user input to the B application.

In FIG. 2J, the user 1 may touch the icon 235 corresponding to the E application. Meanwhile, FIG. 3H is a conceptual diagram of an activity stack corresponding to FIG. 2K. As shown in FIG. 2J, since the user inputs an application execution command to the launcher application, it can be seen that the z-order of the launcher application is higher than the z-order of the D application.

When the icon 235 corresponding to the E application is touched, the controller (not shown) controls to display the fifth window 270 executing the D application on the fourth window display space 204 as shown in FIG. 2K. When there is no empty window display space, the controller (not shown) may refer to the activity stack of FIG. 3H. The control unit (not shown) may check the application with the lowest z-order among the activity stacks. For example, in FIG. 3H, the control unit (not shown) can confirm that the z-order of the C application is the lowest. The controller (not shown) controls to display the fifth window 270 executing the E application on the fourth window display space 250 in which the C application of the lowest z-order is displayed.

Meanwhile, FIG. 3I is a conceptual diagram of an activity stack corresponding to FIG. 2K. The controller (not shown) creates the E application stack 305 on the activity stack in response to the execution of the E application. Meanwhile, the controller (not shown) arranges the stack 305 of the most recently executed E application on the stack 301 of the launcher application. This may mean that the z-order of the E application is higher than the z-order of the launcher application.

4A is a flowchart illustrating a method of controlling a display device according to an embodiment of the present invention.

As illustrated in FIG. 4A, the display device may execute a plurality of applications (S401 ). The display device may execute the corresponding application, for example, based on an execution command of a user touching an icon for executing the application. In the display device, in more detail, a window manager may generate a window for executing a corresponding application.

The display device may check a layout for arranging windows. Here, the layout is a concept defining a window display space in which windows can be arranged. In more detail, the layout can be largely divided into a split mode and a freestyle mode.

The split mode may be a display mode in which a screen is divided and displayed so that a plurality of windows do not overlap each other. For example, it is assumed that the display device displays a first window and a second window. The display device may divide a screen such as a touch screen into preset layouts, and the divided portions may be referred to as a window display space. The display device may display windows by arranging them on each window display space. As described above, since each window display space is divided on the screen, the display device can display a plurality of windows so as not to overlap each other.

Meanwhile, in the split mode, the display device may arrange a plurality of windows in one window display space. For example, the display device may arrange the first window and the second window on the first window display space. In this case, the display device may compare the z-order of the first window and the second window. For example, when it is determined that the z-order of the first window is higher than the z-order of the second window, the display device may display the first window on the first window display space. In this case, the display device manages the arrangement of the second window on the first window display space, but does not display the second window.

The freestyle mode may be a display mode in which a plurality of windows may be displayed by being overlapped with each other based on respective display rankings. For example, when the area in which the first window is displayed overlaps the area in which the second window is displayed, the display device may compare the z-order of each of the first window and the second window. . Here, the z-order may mean a display order between each window. For example, when the z-order of the first window is higher than the z-order of the second window, the display device may control to display the first window instead of the second window in a portion where the display overlaps.

On the other hand, the split mode may be subdivided into various layouts such as a top and bottom 2-split layout, a left and right 2-split layout, a 3-split layout, and a 4-split layout. In S405, the display device may determine whether the layout of the window arrangement is a split mode or a freestyle mode. In addition, when the layout of the window arrangement is a split mode, the display device may additionally determine whether or not the layout is divided into two, a two-sided layout, a three-sided layout, and a four-part layout.

Upon checking the layout (S405), the display device may determine a window position on the layout (S407). For example, if the layout is determined to be a top and bottom two-split layout, the display device determines to place the first window and the third window in the upper window display space, and to place the second window in the lower window display space. Can decide. Alternatively, when it is determined that the layout is the freestyle mode, the display device may determine a coordinate area in which the first window is displayed and a coordinate area in which the second window is displayed.

The display device may check the z-order of each of the plurality of applications (S409). The display device may display a plurality of windows based on the z-order (S411). For example, when the layout is determined as the top and bottom two-split mode, the display device may compare the z-order of the first window and the third window disposed in the first window display space. In addition, the display device may control to display a window having a relatively high z-order on a corresponding window display space. Meanwhile, when the layout is determined as, for example, the freestyle mode, the display device may compare the z-order of each of the first window and the second window, and in an area where windows having a relatively high z-order overlap each other. It can be controlled to be displayed.

4B is a flowchart illustrating a method of controlling a display device according to another embodiment of the present invention.

As illustrated in FIG. 4B, the display device may execute a plurality of applications (S401 ). The application execution command may be, for example, a drag gesture input from an icon executing an application to a point where a window is to be displayed. However, the drag gesture input as described above is merely exemplary, and it will be easily understood by those skilled in the art that the application can be executed in various ways, and the scope of the present invention is not limited by the method of executing the application.

The display device may determine whether the set layout is in the freestyle mode (S421). If it is determined that the set layout is in the freestyle mode (S421-Y), the display device may check the z-order of each window executing a plurality of applications (S423). The display device may display the windows by overlapping each other in the order of the checked z-order (S425).

Meanwhile, if it is determined that the set layout is the split mode (S421-N), the display device may arrange windows in each of the window display spaces (S431). In addition, the display device may check the z-order of windows in each window display space (S433). For example, the display device may check the z-order shown in Table 1.

window Window display space (page) z-order A One One B 2 5 C 3 6 D 2 2 E One 3 F 4 4

As described above, the display device may control to display an A window having a relatively high z-order rather than an E window in the first window display space. In addition, the display device may control to display a D window having a relatively high z-order rather than a B window in the second window display space. In addition, the display device may display the C window in the third window display space and the F window in the fourth window display area. That is, the display device may display a window of the highest z-order in each window display space (S435).

5 is a conceptual diagram for explaining the Z-order. The Z-order of the screen is divided into N layers, and the Nth layer may correspond to a higher layer positioned higher than the N-1th layer. A corresponding window exists in each layer, and each application can be executed on the window. That is, when the first application is executed, it is executed in the window on the first layer, and when the second application is executed thereafter, it is executed in the window on the second layer, and when the third application is executed, it is executed in the window on the third layer. Layers 1, 2, and 3 are hierarchically created. That is, the layer created at the last may exist at the highest level and may be displayed at the highest level. For example, a plurality of windows a to d may be displayed on the main screen 196 to overlap each other. In more detail, the first window (a) is displayed to cover the second to fourth windows (b to d), and the second window (b) is to cover the third and fourth windows (c and d). Is displayed, and the third window c is displayed to cover the fourth window d. That is, when a plurality of windows (a to d) overlap, they may have a display order, and the displayed order may be referred to as a Z-order. The Z-order may be a display order of a window about the z axis. The layer viewer (e) may be a screen that displays the layered Z-order. Meanwhile, the Z-order may be referred to as a display order.

6A to 6D are conceptual diagrams illustrating a method of executing an application according to another embodiment of the present invention. 6A to 6D are conceptual diagrams for explaining a method of executing an application, in particular, when the freestyle mode is set.

In FIG. 6A, the display device 600 displays a window display space 620. The display device 600 displays a tray 610 including icons 611 to 617 of executable applications on the left side of the window display space 620. The user 10 may manipulate the display device 600 to execute the first application A1. For example, as shown in FIG. 6B, the user 10 may input a drag gesture 625 from the icon 611 of the first application A1 to the first point of the window display space 620. The display device 600 displays the first window 630 executing the first application A based on the input execution command, that is, the drag gesture 625, corresponding to the first point of the window display space 620 can do. The size and shape of the first window 630 may be a default value or a value set by a user before termination.

The user 10 may manipulate the display device 600 to additionally execute the third application A3. For example, as shown in FIG. 6C, the user 10 may input a drag gesture 635 from the icon 613 of the third application A3 to the second point of the window display space. The display device 600 displays a third window 640 that executes the third application A3 based on an input execution command, that is, a drag gesture 635, corresponding to a second point of the window display space 620 can do. The size and shape of the second window 630 may also be a default value or a value set by the user before the end. On the other hand, since the window to which the user 10 inputs the gesture more recently is the third window 640, the control unit (not shown) gives a higher task priority to the third application A3 than the first application A1. Can be given. Accordingly, the controller (not shown) may control the third application A3 to be displayed while covering the first application A1.

7 is a flowchart illustrating a method of controlling a display device according to an embodiment of the present invention.

The display device may display at least one icon for executing an application (S701). For example, the display device may display a tray displaying at least one icon on a partial area of the touch screen.

The display device may receive a drag gesture from the icon to the first point where the window is arranged (S703). The display device may recognize a drag gesture from the input icon to the first point as a corresponding application execution command. In particular, the display device may determine a position on the layout of the first point that is the end point of the drag gesture (S705). For example, when the set display mode is the split mode, the display device may check which window display space corresponds to the layout of the first point.

The display device may determine at least one of the size and position of the window according to the position on the layout (S707). The display device may determine at least one of the determined window size and position of the window (S709).

8A to 8M are conceptual diagrams illustrating a method of displaying a plurality of windows according to an embodiment of the present invention.

In FIG. 8A, the display device 800 displays a menu screen 817. The menu screen 817 may be an execution screen of a launcher program and may include icons capable of executing various applications. In addition, the menu screen 817 may include information on the current time, and may additionally include various widgets. The display device 800 displays a tray 810 including icons 811 to 816 of executable applications on the left side of the touch screen.

The user 10 may manipulate the display apparatus 800 to execute the first application A, as shown in FIG. 8B. For example, the user 10 may touch the icon 811 of the first application A and input a drag gesture to the menu screen 817 as shown in FIG. 8C. The controller (not shown) may control the corresponding icon 811 to be displayed at a point touched by the user 10. In addition, the controller (not shown) may control to display a ghost view 818 to correspond to a point touched by the user 10. Here, the ghost view 818 refers to a view in which the size and shape of a window in which a corresponding application is executed is displayed in advance so that a user can select a window arrangement position. Since there is no window to be displayed, the controller (not shown) can control the ghost view 818 of the full screen to be displayed. Meanwhile, as will be described later in more detail, the controller (not shown) may control to display a ghost view of the full screen when there is no window displayed on the touch screen. In addition, when there is one window displayed on the touch screen, the controller (not shown) may control to display a ghost view having a size and shape of the touch screen divided in half. In addition, when there are two windows displayed on the touch screen, the controller (not shown) may control to display a ghost view having a size and shape obtained by dividing one of the two windows into half. This will be described later in more detail with reference to FIG. 8R. In addition, when there are three windows displayed on the touch screen, the controller (not shown) may control to display a ghost view having a size and shape obtained by dividing the largest window in half. This will be described later in more detail with reference to FIG. 8R.

The controller (not shown) may recognize the above-described drag gesture as a new application execution command to execute a new application. In addition, the control unit (not shown) may generate a first window for executing the first application A. The controller (not shown) may control the generated first window 819 to be displayed on a full screen as shown in FIG. 8D.

Meanwhile, the user 10 may additionally manipulate the display device 800 to execute the second application B. For example, after touching the icon 812 of the second application B as shown in FIG. 8E, the user 10 may drag the icon 812 of the second application B below the first window 819 as shown in FIG. 8F. The controller (not shown) controls to display the corresponding icon 812 at a point touched by the user 10. In addition, the control unit (not shown) may control to display the ghost view 823 in response to a point touched by the user 10. As described above, since one window 819 is displayed on the touch screen, the controller (not shown) can control the ghost view 823 to be displayed to have a half size and shape of the touch screen. . Although not shown, when the touch position of the user 10 is the upper part of the touch screen, it is obvious that the controller (not shown) controls the ghost view to be displayed on the upper half instead of the lower half. In addition, displaying the ghost view on the lower half is also merely an example, and the controller (not shown) may control to display the ghost view on any one by dividing the touch screen into left/right.

On the other hand, when the drag input of the user 10 ends below the touch screen as shown in FIG. 8F, the controller (not shown) determines that a new application execution command has been input. As shown in FIG. 8G, the controller (not shown) controls to display the second window 830 on the lower half of the touch screen corresponding to the ghost view 823 of FIG. 8F. In addition, the controller (not shown) controls the size and shape of the first window 820 to be reduced and displayed to correspond to the upper half of the touch screen. In addition, the control unit (not shown) generates a center button 825 and displays the center button 825 by placing it on the boundary line between the first window 820 and the second window 830.

Meanwhile, the user 10 may additionally manipulate the display device 800 to execute the third application C. For example, after touching the icon 813 of the third application C as shown in FIG. 8H, the user 10 may drag the icon 813 of the third application C to the right portion of the first window 820 as shown in FIG. 8I. The controller (not shown) controls to display the corresponding icon 813 at a point touched by the user 10. In addition, the controller (not shown) may control to display the ghost view 827 in correspondence to a point touched by the user 10. As described above, since the two windows 820 and 830 are displayed on the touch screen, the controller (not shown) displays the ghost view 827 to have a half size and shape of the first window 820. Can be controlled. Although not shown, when the touch position of the user 10 is the left portion of the first window 820, it is obvious that the controller (not shown) controls the ghost view to be displayed on the left half instead of the right half. Also, that the ghost view is displayed on the right half is also merely an example, and the control unit (not shown) may control to display the ghost view in any one by dividing the first window 820 upward/downward. On the other hand, it is merely exemplary for the control unit (not shown) to display the ghost view 827 on the half of the first window 820. The control unit (not shown) may control to set and display the size and shape of the ghost view 827 based on the center button 825.

On the other hand, when the drag input of the user 10 ends in the right part of the first window 820 as shown in FIG. 8I, the controller (not shown) determines that a new application execution command has been input. As shown in FIG. 8J, the controller (not shown) controls to display the third window 840 on the right half of the first window 820 corresponding to the ghost view 827 of FIG. 8I. Alternatively, the controller (not shown) may control to display the third window 840 to correspond to the position of the center button 825.

In addition, the controller (not shown) controls the size and shape of the first window 820 to be reduced and displayed to correspond to the generation of the third window 840. In more detail, the controller (not shown) may control the first window 820 to be displayed on the remaining area where the third window 840 is not displayed.

Meanwhile, the user 10 may additionally manipulate the display device 800 to execute the fourth application C. For example, after touching the icon 814 of the fourth application D as shown in FIG. 8K, the user 10 may drag the icon 814 of the fourth application D to the right portion of the second window 830 as shown in FIG. 8L. The control unit (not shown) controls to display the icon 814 at a point touched by the user 10. In addition, the control unit (not shown) may control to display the ghost view 831 in response to a point touched by the user 10. As described above, since three windows 820, 830, and 840 are displayed on the touch screen, the controller (not shown) displays the ghost view 831 to have a half size and shape of the second window 830. Can be controlled. Although not shown, when the touch position of the user 10 is the left portion of the second window 830, it is obvious that the controller (not shown) controls the ghost view to be displayed on the left half instead of the right half. Also, that the ghost view is displayed on the right half is also simply an example, and the control unit (not shown) may control to display the ghost view in any one by dividing the second window 830 up and down. Meanwhile, it is merely exemplary for the control unit (not shown) to display the ghost view 831 on the half of the second window 830. The controller (not shown) may control to set and display the size and shape of the ghost view 831 based on the center button 825. This will be described later in more detail with reference to FIGS. 8N to 8Q.

On the other hand, when the drag input of the user 10 ends in the right part of the second window 830 as shown in FIG. 8L, the control unit (not shown) determines that a new application execution command has been input. As shown in FIG. 8M, the controller (not shown) controls to display the fourth window 850 on the right half of the second window 830 corresponding to the ghost view 831 of FIG. 8L. Alternatively, the controller (not shown) may control to display the fourth window 850 to correspond to the position of the center button 825.

In addition, the controller (not shown) controls the size and shape of the second window 830 to be reduced and displayed to correspond to the creation of the fourth window 850.

As described above, the display device may control to display a window in a window display space corresponding to an end point of the drag gesture. However, in FIGS. 8A to 8M, only the positions of the windows to be executed are different, and all the sizes are for the same embodiment. In FIGS. 9A to 17 to be described later, an embodiment in which the location and size of the executed window may be variously implemented will be described.

9A to 9H are conceptual diagrams for explaining layout according to various embodiments of the present disclosure.

9A is a conceptual diagram of a full screen layout when a split mode is not set. In FIG. 9A, the display device defines a first window display space 901 for the entire screen. 9B is a conceptual diagram of an input space 902 corresponding to the first window display space 901.

9C is a conceptual diagram of a screen layout in case of a top and bottom split mode. In FIG. 9C, the display device may define a first window display space 911 and a second window display space 912 adjacent to the entire screen vertically. 9D is a conceptual diagram of an input space in the case of the upper and lower two split mode. Here, the first input space 913 may correspond to the first window display space 911, the third input space 915 may correspond to the second window display space 912, and the second input space Reference numeral 914 may correspond to a boundary line between the first window display space 911 and the second window display space 912. For example, when a user inputs a drag gesture from an icon to the first input space 913, the display device may display the corresponding window in the first window display space 911 of FIG. 9C. For example, when a user inputs a drag gesture from an icon to the third input space 915, the display device may display the corresponding window in the second window display space 912 of FIG. 9C. For example, when a user inputs a drag gesture from an icon to the second input space 912, the display device opens the corresponding window to the entire first window display space 911 and the second window display space 912 of FIG. 9C. Can be marked on.

9E is a conceptual diagram of a screen layout in the case of a left and right split mode. In FIG. 9E, the display device may define a first window display space 921 and a second window display space 922 adjacent to the entire screen left and right. 9F is a conceptual diagram of an input space in the case of a left and right split mode. Here, the first input space 923 may correspond to the first window display space 921, the third input space 925 may correspond to the second window display space 922, and the second input space Reference numeral 924 may correspond to a boundary line between the first window display space 921 and the second window display space 922. For example, when a user inputs a drag gesture from an icon to the first input space 923, the display device may display the corresponding window in the first window display space 921 of FIG. 9E. For example, when the user inputs a drag gesture from the icon to the third input space 925, the display device may display the corresponding window in the second window display space 922 of FIG. 9E. For example, when the user inputs a drag gesture from the icon to the second input space 922, the display device opens the corresponding window to the entire first window display space 921 and the second window display space 922 of FIG. 9E. Can be marked on.

9G is a layout according to an embodiment of the present invention, and may be a layout for a 4-division split mode. 9H is a conceptual diagram of an input space in a 4-division split mode corresponding to FIG. 9G. In FIG. 9G, the display device defines a first window display space 931, a second window display space 932, a third window display space 933, and a fourth window display space 944. Accordingly, the user can manipulate the display device to execute a window in any one of the first to fourth window display spaces. For example, when a user inputs a drag gesture from an icon executing an application to the second window display space 932, the display device may arrange and display a window on the second window display space 932. Meanwhile, as described above, when the user inputs, for example, the end point of the drag gesture as a boundary line between the first window display space 931 and the second window display space 932, the display device The corresponding window may be displayed in the entire 931 and the second window display space 932. That is, the display device may define a first input space 941 corresponding to the first window display space 931. In addition, a second input space 942 corresponding to the second window display space 932 may be defined. In addition, the display device may define a fifth input space 945 corresponding to a boundary line between the first window display space 931 and the second window display space 932. Similar to the above, the display device may define a third input space 943 corresponding to the third window display space 933 and a fourth input space 944 corresponding to the fourth window display space 934. have. In addition, the display device may define a sixth input space 946 corresponding to a boundary line between the first window display space 931 and the third window display space 933. In addition, the display device may define a seventh input space 947 corresponding to a boundary line between the second window display space 932 and the fourth window display space 934. In addition, the display device may define an eighth input space 948 corresponding to a boundary line between the third window display space 933 and the fourth window display space 934. In addition, the display device includes a ninth input space corresponding to an intersection of the first window display space 931, the second window display space 932, the third window display space 933, and the fourth window display space 934. (949) can be defined. When the end point of the drag gesture in the display device is a specific input space, a correspondence relationship defining a window display space for displaying a window is shown in Table 2.

Input space Window display space in which the window is displayed First input space First window display space 2nd input space 2nd window display space 3rd input space 3rd window display space 4th input space 4th window display space 5th input space First window display space, second window display space 6th input space 1st window display space, 3rd window display space 7th input space 2nd window display space, 4th window display space 8th input space 3rd window display space, 4th window display space 9th input space First window display space, second window display space, third window display space, fourth window display space

That is, as described above, the display device may define an input space for determining an application display space in which an end point of a drag gesture is input. In particular, the display device may define an input space corresponding to a boundary line of a plurality of window display spaces or an intersection point of a plurality of window display spaces. When the end point of the drag gesture is input to an input space corresponding to a boundary line of the window display space, the display device may display a window in all of the window display spaces adjacent to the boundary line. In addition, when the end point of the drag gesture is input into the input space corresponding to the end point of the window display space, the display device may display the window in all of the window display spaces adjacent to the intersection point. Accordingly, the display device may display the size and position of the window differently according to the position where the end point of the drag gesture is input. Hereinafter, in FIGS. 10 to 17, configurations for displaying different window sizes and positions according to the above will be described in more detail. In particular, FIGS. 10 to 17 are cases in which the layout is set to the four-split mode, and accordingly, will be described with reference to FIGS. 9G and 9H.

10 is a conceptual diagram of a screen of a display device according to an embodiment of the present invention.

In FIG. 10A, the controller controls to display a window display space 1000 and a tray 1010 including icons 1011 to 1017 for executing applications. The control unit may control the tray 1010 to be always displayed. Alternatively, the controller may control the tray 1010 to be displayed when a tray call command is input. The tray call command may be, for example, an edge flick input from the left edge of the touch screen, and it will be readily understood by those skilled in the art that there is no limitation on the type. Meanwhile, it is assumed that the display device displays the first window for executing application A in the window display space 1000.

In FIG. 10B, the user 10 may input a drag gesture 1021 from the icon 1016 corresponding to the F application to the first point 1027 at the bottom of the window display area. In FIG. 10C, the controller may determine a space to display the window. When a 4-split layout is set, the control unit can determine which input space the end point 1027 of the drag gesture corresponds to. For example, if it is determined that the first point 1027 corresponds to the eighth input space 948 of FIG. 9H, the control unit is configured to the third window display space 933 and the fourth window display space ( 934), it may be determined to display the F window 1024 over the entirety. Accordingly, the control unit may display the area determined to be displayed as the ghost view 1023.

The user 10 can check the ghost view 1023 to see if a window is displayed at a desired location. The user 10 may release the drag gesture 1021, and the F window 1024 may be displayed in the third window display space 933 and the fourth window display space 934 as shown in FIG. 10C. . Meanwhile, as the window F 1024 is displayed, the controller may control the size of the window A 1000 to be reduced to the upper half and displayed. Here, the controller may reduce and display the window A 1000 in the same horizontal-to-vertical ratio as before the reduction, or may control the display to be reduced by newly setting the horizontal-vertical ratio.

11 is a conceptual diagram of a screen of a display device according to an embodiment of the present invention. 11 is a conceptual diagram for a subsequent situation of FIG. 10. In FIG. 11A, the display device displays the A window 1000 and the F window 1024 in the upper and lower split modes, respectively. Meanwhile, the user 10 may additionally manipulate the display device to execute the E application. The user 10 may input a drag gesture 1032 input to the second point 1033 starting from the icon 1015 executing the E application. In FIG. 11B, the controller may determine which input space the second point 1033 corresponds to. If the control unit determines that the second point 1033 corresponds to the eighth input space 948 of FIG. 9H, the control unit determines the third window display space 933 and the fourth window display space 934 as shown in Table 2 It may be determined to display the E window 1034 in the whole. Accordingly, the control unit can display the area determined to be displayed as the ghost view 1031.

The user 10 can check the ghost view 1031 to see if the window is displayed at a desired location. The user 10 may release the drag gesture 1032, and the E window 1034 may be displayed on the entire third window display space 933 and the fourth window display space 934 as shown in FIG. 11C. .

12 is a conceptual diagram of a screen of a display device according to an embodiment of the present invention. 12 is a conceptual diagram of a subsequent situation of FIG. 11. In FIG. 12A, the display device displays the A window 1000 and the E window 1034 in the upper and lower split modes, respectively. Meanwhile, the user 10 may additionally manipulate the display device to execute the G application. The user 10 may input a drag gesture 1041 inputted to the third point 1042 starting from the icon 1017 executing the G application. In FIG. 12B, the controller may determine which input space the third point 1042 corresponds to. If the control unit confirms that the third point 1042 corresponds to the ninth input space 949 of FIG. 9H, the control unit provides the first window display space 931 and the second window display space 932 as shown in Table 2 , It may be determined to display the G window 1044 in the entire third window display space 933 and the fourth window display space 934. Accordingly, the control unit may display the area determined to be displayed as the ghost view 1043.

The user 10 may check the ghost view 1043 to check whether a window is displayed at a desired location. The user 10 may release the drag gesture 1042, and the G window 1044 may be displayed on the entire screen as shown in FIG. 12C.

13 is a conceptual diagram of a screen of a display device according to an embodiment of the present invention. 13 is a conceptual diagram for a subsequent situation of FIG. 12.

In FIG. 13A, it is assumed that the display device is displaying the G window 1044. In FIG. 13B, the user 10 may input a drag gesture 1051 from the icon 1012 corresponding to the B application to the fourth point 1052 at the bottom of the window display area. If the control unit determines that the fourth point 1052 corresponds to the eighth input space 948 of FIG. 9H, the control unit displays the third window display space 933 and the fourth window display space 934 as shown in Table 2. ) It may be determined to display the B window 1054 throughout. Accordingly, the control unit may display the area determined to be displayed as the ghost view 1053.

The user 10 may check the ghost view 1053 to check whether a window is displayed at a desired location. The user 10 may release the drag gesture 1051, and as shown in FIG. 10C, the B window 1054 may be displayed in the third window display space 933 and the fourth window display space 934. . Meanwhile, as the F window 1024 is displayed, the controller may control the size of the G window 1044 to be reduced to the upper half and displayed.

14 is a conceptual diagram of a screen of a display device according to an embodiment of the present invention. 14 is a conceptual diagram for a subsequent situation of FIG. 13. In FIG. 14A, the display device displays the G window 1044 and the B window 1054 in the upper and lower split modes, respectively. Meanwhile, the user 10 may additionally manipulate the display device to execute the C application. The user 10 may input a drag gesture 1061 input to the fifth point 1062 starting from the icon 1013 executing the C application. In FIG. 14B, the controller may determine which input space the fifth point 1062 corresponds to. If the control unit confirms that the fifth point 1062 corresponds to the second input space 942 of FIG. 9H, the control unit displays the C window 1064 in the second window display space 932 as shown in Table 2. You can decide. Accordingly, the control unit may display the area determined to be displayed as the ghost view 1063.

The user 10 may check the ghost view 1063 to check whether a window is displayed at a desired location. The user 10 may release the drag gesture 1061, and the C window 1064 may be displayed on the second window display space 932 as shown in FIG. 14C.

15 is a conceptual diagram of a screen of a display device according to an embodiment of the present invention. 15 is a conceptual diagram of a subsequent situation of FIG. 14. In FIG. 15A, the display device displays the G window 1044, the B window 1054 and the C window 1064 in a three-divided split mode, respectively. Meanwhile, the user 10 may additionally manipulate the display device to execute the D application. The user 10 may input a drag gesture 1071 inputted to the sixth point 1072 starting from the icon 1014 executing the D application. In FIG. 15B, the controller may determine to which input space the sixth point 1072 corresponds. If the control unit confirms that the sixth point 1072 corresponds to the fourth input space 944 of FIG. 9H, the control unit displays the D window 1074 in the fourth window display space 934 as shown in Table 2. You can decide. Accordingly, the control unit may display the area determined to be displayed as the ghost view 1073.

The user 10 may check the ghost view 1073 to check whether a window is displayed at a desired location. The user 10 may release the drag gesture 1071, and the window D 1074 may be displayed in the fourth window display space 934 as shown in FIG. 15C.

16A to 16D are conceptual diagrams of a display device according to various embodiments of the present disclosure.

16A is a conceptual diagram of a screen of a display device according to an embodiment of the present invention. 16A is a conceptual diagram of a subsequent situation of FIG. 15. In FIG. 16A, the display device displays a G window 1044, a B window 1054, a C window 1064, and a D window 1074 in a 4 division split mode, respectively. Meanwhile, the user 10 may additionally manipulate the display device to execute the H application. The user 10 may input a drag gesture input to the seventh point 1081 starting from the icon 1018 running the H application. In FIG. 16A, the controller may determine to which input space the seventh point 1081 corresponds. If the control unit determines that the seventh point 1071 corresponds to the fifth input space 945 of FIG. 9H, the control unit displays the first window display space 931 and the second window display space 932 as shown in Table 2 It may be determined to display the H window 1083 at. Accordingly, the control unit can display the area determined to be displayed as the ghost view 1082. Meanwhile, E application icons 1015 to K applications 1026 may be disposed on the tray 1010. The user 10 additionally displays the H application 1018, the I application 1019, the J application 1025 and the K application 1026, which were not displayed, by inputting, for example, an upward drag gesture on the tray 1010. It can be manipulated as much as possible.

The user 10 can check the ghost view 1082 to see if the window is displayed at a desired location. The user 10 may release the drag gesture, and the H window 1083 may be displayed in the first window display space 931 and the second window display space 932.

16B is a conceptual diagram of a screen of a display device according to an embodiment of the present invention. 16B is a conceptual diagram for a subsequent situation of FIG. 15. In FIG. 16B, the display device displays the G window 1044, the B window 1054, the C window 1064, and the D window 1074 in a four-division split mode, respectively. Meanwhile, the user 10 may additionally manipulate the display device to execute the H application. The user 10 may input a drag gesture input to the eighth point 1084 starting from the icon 1018 executing the H application. In FIG. 16B, the controller may determine which input space the eighth point 1084 corresponds to. If the control unit determines that the eighth point 1084 corresponds to the sixth input space 946 of FIG. 9H, the control unit displays the first window display space 931 and the third window display space 933 as shown in Table 2 It may be determined to display the H window 1086 at. Accordingly, the control unit may display the area determined to be displayed as the ghost view 1085.

The user 10 may check the ghost view 1085 to check whether a window is displayed at a desired location. The user 10 may release the drag gesture, and the H window 1086 may be displayed in the first window display space 931 and the third window display space 933.

16C is a conceptual diagram illustrating a screen of a display device according to an embodiment of the present invention. 16C is a conceptual diagram for a subsequent situation of FIG. 15. In FIG. 16C, the display device displays the G window 1044, the B window 1054, the C window 1064, and the D window 1074 in a 4-division split mode, respectively. Meanwhile, the user 10 may additionally manipulate the display device to execute the H application. The user 10 may input a drag gesture input to the ninth point 1087 starting from the icon 1018 running the H application. In FIG. 16C, the controller may determine to which input space the ninth point 1087 corresponds. When the control unit confirms that the ninth point 1087 corresponds to the eighth input space 948 of FIG. 9H, the control unit displays the third window display space 933 and the fourth window display space 934 as shown in Table 2 It may be determined to display the H window 1089 at. Accordingly, the control unit may display the area determined to be displayed as the ghost view 1088.

The user 10 may check the ghost view 1088 to check whether a window is displayed at a desired location. The user 10 may release the drag gesture, and the H window 1089 may be displayed in the third window display space 933 and the fourth window display space 934.

16D is a conceptual diagram illustrating a screen of a display device according to an embodiment of the present invention. 16D is a conceptual diagram of a subsequent situation of FIG. 15. In FIG. 16D, the display device displays a G window 1044, a B window 1054, a C window 1064, and a D window 1074 in a 4-division split mode, respectively. Meanwhile, the user 10 may additionally manipulate the display device to execute the H application. The user 10 may input a drag gesture input to the tenth point 1090 starting from the icon 1018 running the H application. In FIG. 16D, the controller may determine which input space the tenth point 1090 corresponds to. If the control unit confirms that the tenth point 1090 corresponds to the seventh input space 947 of FIG. 9H, the control unit displays the second window display space 932 and the fourth window display space 934 as shown in Table 2. It may be determined to display the H window 1092 at. Accordingly, the control unit can display the area determined to be displayed as the ghost view 1091.

The user 10 may check the ghost view 1091 to check whether a window is displayed at a desired location. The user 10 may release the drag gesture, and the H window 1092 may be displayed in the second window display space 932 and the fourth window display space 934.

17 is a conceptual diagram of a screen of a display device according to an embodiment of the present invention. 17 is a conceptual diagram for a subsequent situation of FIG. 15. In FIG. 17, the display device displays a G window 1044, a B window 1054, a C window 1064, and a D window 1074 in a 4 division split mode, respectively. Meanwhile, the user 10 may additionally manipulate the display device to execute the H application. The user 10 may input a drag gesture input to the eleventh point 1093 starting from the icon 1018 for executing the H application. In FIG. 17, the controller may determine which input space the eleventh point 1093 corresponds to. When the control unit confirms that the eleventh point 1093 corresponds to the ninth input space 949 of FIG. 9H, the control unit provides a first window display space 931 and a second window display space 932 as shown in Table 2 , It may be determined to display the H window 1095 in the third window display space 933 and the fourth window display space 934. Accordingly, the control unit may display the area determined to be displayed as the ghost view 1094.

The user 10 can check the ghost view 1094 to see if a window is displayed at a desired location. The user 10 may release the drag gesture, and the H window 1095 may be displayed on the entire screen.

As described above, the display device may provide windows of different positions and sizes according to the end point of the drag gesture. On the other hand, although the above description has been made for the four-division split mode, it can be extended to a nine-division split mode.

18A and 18B are conceptual diagrams for a 9-split mode according to an embodiment of the present invention. As shown in FIG. 18A, the display device may define a 9-segmented window display space. In addition, the display device includes input spaces (A,C,E,K,M,O,U,W,Y) corresponding to each of the window display spaces, and input spaces (B,D, and) corresponding to boundary lines of the window display space. F, H, J, L, N, P, R, T, V, X) and input spaces (G, I, Q, S) corresponding to the intersection of the window display space can be defined. When the end point of the drag gesture is input to an input space corresponding to a boundary line of the window display space, the display device may display a window in all of the window display spaces adjacent to the boundary line. In addition, when the end point of the drag gesture is input into the input space corresponding to the end point of the window display space, the display device may display the window in all of the window display spaces adjacent to the intersection point. Accordingly, the display device may display the size and position of the window differently according to the position where the end point of the drag gesture is input.

19 is a flowchart illustrating a method of controlling a display device according to an embodiment of the present invention.

The display device may display at least one icon for executing an application on the touch screen (S1901). The display device may receive a drag gesture from one icon to the first point (S1903). The display device may determine which part of the layout the end point of the drag gesture corresponds to (S1905).

The display device may determine whether the end point of the drag gesture corresponds to a boundary line of the window display space (S1907). When the end point of the drag gesture corresponds to the boundary line of the window display space (S1907-Y), the display device may display the corresponding window on all of the window display areas adjacent to the boundary line (S1909).

Meanwhile, the display device may determine whether the end point of the drag gesture corresponds to an intersection point of the window display space (S1911). When the end point of the drag gesture corresponds to an intersection of the window display space (S1911-Y), the display device may display the corresponding window on all of the window display areas adjacent to the intersection (S1913).

Meanwhile, the display device may determine whether the end point of the drag gesture corresponds to the window display space (S1915). When the end point of the drag gesture corresponds to the window display space (S1915-Y), the display device may display a window in the corresponding window display area (S1917).

20 is a flowchart illustrating a method of controlling a display device according to an embodiment of the present invention.

The control unit may set the layout to the split mode (S2001). The control unit may set a plurality of window display spaces according to the split mode (S2003). In addition, the controller may arrange a plurality of windows in each window display space (S2005). In particular, the controller may arrange a plurality of windows in one window display space.

The control unit may control to display a window of the highest z-order in each window display space. For example, when a plurality of windows are arranged in the first window display space, the window having the highest z-order among the arranged windows may be displayed.

Meanwhile, the control unit may determine whether a z-order change command is input on the touch screen (S2009). Here, the z-order change command is a command to change the z-order of the window, and may be, for example, a flick gesture input on the touch screen. If it is determined that the z-order change command has been input (S2009-Y), the control unit can change at least one z-order based on the z-order change command and change the window displayed based on the changed z-order. Yes (S2011).

21A to 21C are conceptual diagrams of a display device according to various embodiments of the present disclosure.

In FIG. 21A, the display apparatus 2100 displays a first window 2101 for executing application A in a first area, a second window 2102 for executing application B in a second area, and A third window 2103 for executing application C is displayed in the area, and a fourth window 2104 for executing application D is displayed in the fourth area. The display device 2100 displays a center button 2110.

The controller (not shown) may manage the activity stack as shown on the left side of FIG. 22. The control unit (not shown) manages z-orders in the order of C application, F application, G application, A application, D application, B application, J application, K application, H application, M application, L application, I application. I can. The control unit (not shown) arranges the windows running C, F, and G applications in the third area, the windows running the A, J, and L applications in the first area, and executes D, H, M applications The window to be executed is placed in the fourth area, and the window that executes the B, K, I application is placed in the second area.

The control unit (not shown) searches for an application running in the first area, and compares the z-order of the searched application. The control unit (not shown) may confirm that application A has the highest z-order in the first area. Accordingly, the control unit (not shown) controls to display the first window 2101 executing application A in the first area. The controller (not shown) searches for an application running in the second area, and compares the z-order of the searched application. The control unit (not shown) may confirm that the B application has the highest z-order in the second area. Accordingly, the controller (not shown) controls to display the second window 2102 for executing the B application in the second area. The controller (not shown) searches for an application running in the third area and compares the z-order of the searched application. The controller (not shown) can confirm that the C application has the highest z-order in the third area. Accordingly, the control unit (not shown) controls to display the third window 2103 for executing the C application in the third area. The controller (not shown) searches for an application executed in the fourth area and compares the z-order of the searched application. The controller (not shown) may confirm that the D application has the highest z-order in the fourth area. Accordingly, the controller (not shown) controls to display the fourth window 2104 for executing the D application in the fourth area.

Referring back to FIG. 21A, the user 1 may input a z-order change command in the third area. For example, the user 1 may input a right flick gesture in the third area, and the controller (not shown) may recognize the right flick gesture as a z-order change command. Meanwhile, the right flick gesture may be promised as a command to assign the highest z-order to the application of the lowest z-order in the corresponding window display space. Accordingly, the control unit (not shown) assigns the highest z-order to the G application of the lowest z-order in the third area. This may be reflected in the activity stack displayed on the right side of FIG. 22. As shown in the activity stack on the right, it can be seen that the G application is placed at the top of the activity stack. Meanwhile, the right flick gesture is simply an example, and a person skilled in the art may change and design the z-order change command in a direction other than the right direction. For example, a person skilled in the art may change and design various gestures such as a left flick gesture, a downward flick gesture, and an upward flick gesture, not a right flick gesture, into a z-order change command. In addition, those skilled in the art will be able to design and change various gestures such as tilting, dragging, and shaking, not flick gestures, with z-order change commands, and the scope of the present invention is limited by the z-order change command. Won't be. Accordingly, the right side can be generalized and expressed in the first direction, and it should be clarified that the first direction is not limited to the right side.

The controller (not shown) may control to display the fifth window 2113 executing the G application in the third area as shown in FIG. 21B. Meanwhile, when a command to change the z-order of the right flick gesture is input to the third area, the control unit (not shown) may confirm that the application having the lowest z-order in the third area is the F application as shown in FIG. 21C. The controller (not shown) controls to display the sixth window 2123 for executing the F application in the third area.

23A and 23B are conceptual diagrams of a display device for explaining a z-order change command. 23A may be a view substantially the same as that of FIG. 21C. The activity stack corresponding to FIG. 23A may be the activity stack on the left side of FIG. 24.

In FIG. 23A, the user 1 may input a z-order change command by inputting a right flick gesture in the first area. The controller (not shown) can confirm that the application having the lowest z-order in the first area is the L application. The control unit (not shown) may assign the highest z-order to the L application, like the activity stack on the right side of FIG. 24.

The controller (not shown) may control to display the seventh window 2131 executing the L application in the first area as shown in FIG. 23B.

25A and 25B are conceptual diagrams of a display device for explaining a z-order change command according to another embodiment of the present invention.

The user 1 may input a z-order change command by inputting a left flick gesture in the second area. The controller (not shown) may recognize the left flick gesture as a z-order change command. Meanwhile, the left flick gesture may be promised as a command to assign the lowest z-order to the application of the highest z-order in the corresponding window display space. On the other hand, the left side may be referred to as the second direction.

Accordingly, the control unit (not shown) may assign the lowest z-order to the B application having the highest z-order in the second area, like the activity stack on the right side of FIG. 26. As application B has the lowest z-order, the controller (not shown) may manage the K application so that the K application has the highest z-order in the second area.

Accordingly, as shown in FIG. 25B, the controller (not shown) can control to display the eighth window 2142 executing the K application in the second area. The change of the activity stack for the above-described process is illustrated in FIG. 26.

As described above, the controller (not shown) may process the left flick gesture as a command to assign the highest z-order to the application having the lowest z-order in the corresponding window display space. In addition, the control unit (not shown) may process the right flick gesture as a command to assign the lowest z-order to the application having the highest z-order in the corresponding window display space. Accordingly, an effect that the user can easily switch and use the application screen of the lowest z-order or the application screen of the next highest z-order may be created.

27A and 27B are conceptual diagrams of a display device according to another exemplary embodiment of the present invention. In FIG. 27A, the display apparatus 2100 displays a first window 2101 for executing application A in a first area, a second window 2102 for executing application B in a second area, and A third window 2103 for executing application C is displayed in the area, and a fourth window 2104 for executing application D is displayed in the fourth area. In addition, the control unit may manage the activity stack as shown in FIG. 28. Meanwhile, the user 1 may input a command to change the z-order in the third area. For example, the user 1 may input a right tilting 2700 gesture while touching the third area 2701, and the control unit (not shown) z-orders the right tilting gesture after the touch. It can be recognized as a change order.

The control unit may change the z-order in the activity stack as shown in FIG. 28 based on the z-order change command. Since this has been described above with respect to FIG. 22, further descriptions thereof will be omitted. As shown in FIG. 27B, the controller may control to display the fifth window 2113 executing the G application in the third area.

29A and 29B are conceptual diagrams of a display device according to another embodiment of the present invention. In FIG. 29A, the display device 2100 displays a first window 2101 for executing application A in a first area, a second window 2102 for executing application B in a second area, and A third window 2103 for executing application C is displayed in the area, and a fourth window 2104 for executing application D is displayed in the fourth area. In addition, the control unit may manage the activity stack as shown in FIG. 30. Meanwhile, the user 1 may input a z-order change command in the second area. For example, the user 1 may input a left tilting 2900 gesture while touching the second area 2901, and the controller (not shown) z-orders the left tilting gesture after the touch. It can be recognized as a change order.

The control unit may change the z-order in the activity stack as shown in FIG. 30 based on the z-order change command. Since this has been described above with reference to FIG. 26, further descriptions thereof will be omitted. As shown in FIG. 29B, the controller (not shown) may control to display the eighth window 2142 executing the K application in the second area.

31A and 31B are conceptual diagrams of a display device according to another embodiment of the present invention.

In FIG. 31A, the display apparatus 2100 displays a first window 2101 for executing application A in a first area, a second window 2102 for executing application B in a second area, and A third window 2103 for executing application C is displayed in the area, and a fourth window 2104 for executing application D is displayed in the fourth area. In addition, the control unit may manage the activity stack as shown in FIG. 32. Meanwhile, the user 1 may input a command to change the z-order in the third area. For example, the user 1 may input a right edge flick 3101 gesture in the third area, and the controller (not shown) recognizes the right edge flick gesture as a z-order change command after the touch can do.

The control unit may change the z-order in the activity stack as shown in FIG. 32 based on the z-order change command. Since this has been described above with respect to FIG. 22, further descriptions thereof will be omitted. The controller may control to display a fifth window 2113 executing the G application in the third area as shown in FIG. 31B.

33A and 33B are conceptual diagrams of a display device according to another embodiment of the present invention. In FIG. 33A, the display device 2100 displays a first window 2101 for executing application A in a first area, a second window 2102 for executing application B in a second area, and A third window 2103 for executing application C is displayed in the area, and a fourth window 2104 for executing application D is displayed in the fourth area. In addition, the control unit may manage the activity stack as shown in FIG. 30. Meanwhile,

The user 1 may input a z-order change command in the second area. For example, the user 1 may input a left edge flick 3301 gesture in the second area, and the controller (not shown) may recognize the left edge flick gesture as a z-order change command.

The control unit may change the z-order in the activity stack as shown in FIG. 34 based on the z-order change command. Since this has been described above with reference to FIG. 26, further descriptions thereof will be omitted. As shown in FIG. 33B, the controller (not shown) may control to display the eighth window 2142 executing the K application in the second area.

In the above, a method of changing a z-order in a split mode has been described, and hereinafter, a method of changing a z-order in a freestyle mode will be described.

35 is a flowchart illustrating a method of controlling a display device according to an embodiment of the present invention.

The control unit may set the layout in the freestyle mode (S3501). The control unit may receive an application execution command, and accordingly, may generate a plurality of windows for executing each of the plurality of applications (S3503). The controller may check the z-order of each of the plurality of windows (S3505), and may overlap and display the windows based on the checked z-order (S3507).

Meanwhile, the control unit may determine whether a z-order change command is input (S3509). If it is determined that the z-order change command has been input (S3509-Y), the control unit may control to overlap and display the window based on the changed z-order (S3511).

36A to 36C are conceptual diagrams for explaining a z-order change command according to an embodiment of the present invention. In addition, FIGS. 37A to 37C are conceptual diagrams of an activity stack corresponding to each of FIGS. 36A to 36C.

In FIG. 36A, the controller may manage the activity stack as shown in FIG. 37A. That is, a 3rd-rank z-order is given to the A window that runs the C application, a second-rank z-order is given to the B window that runs the B application, and the first-rank z-order is assigned to the C window that runs the C application. Can be given. Accordingly, as shown in FIG. 36A, the controller may control to display the C windows 3632 and 3632, the B windows 361 and 3662, and the A windows 3611 and 3612 in order.

Meanwhile, the user 1 may input a command to change the z-order. The z-order change command in FIG. 36A may be a left pinch-out 3642 gesture input while touching the title bar 3633 of the C window (3641). Here, the pinch-out may be a gesture in which the distance between two touch points increases. In this case, the z-order of the corresponding windows 3632 and 3632 may be reset to the lowest level. Accordingly, as shown in FIG. 37B, the control unit assigns a second-rank z-order to the A window, assigns a first-rank z-order to the B window running the B application, and a third-rank z-order to the C window running the C application. Orders can be assigned. That is, the control unit may assign the lowest z-order to the C window, and control the z-order of the remaining windows to increase by one. Accordingly, the controller may control to display the B windows 361 and 3622, the A windows 3611 and 3612, and the C windows 363 and 3632 in this order. On the other hand, the pinch-out is simply an example, and as described above, it will be easily understood by those skilled in the art that it may be changed in various embodiments such as flick, drag, edge flick, tilt after touch, tilt, shake gesture, etc.

Meanwhile, the user 1 may input a command to change the z-order. The z-order change command in FIG. 36B may be a left pinch-out 3652 gesture input while touching the application execution screen 3632 of the C window (3651). In this case, the z-order of the corresponding window 361,3622 may be reset to the lowest position. Accordingly, as shown in FIG. 37C, the control unit assigns a first-order z-order to window A, assigns a third-order z-order to window B that executes application B, and assigns a second-order z-order to window C running application C. Orders can be given. That is, the control unit may assign the lowest z-order to the window B, and control the z-order of the remaining windows to increase by one. Accordingly, the controller may control to display the windows A 3611 and 3612, windows 363 and 3632, and windows B 361 and 3622 in this order.

38A to 38C are conceptual diagrams for explaining a z-order change command according to an embodiment of the present invention. In addition, FIGS. 39A to 39C are conceptual diagrams of an activity stack corresponding to each of FIGS. 38A to 38C.

In FIG. 38A, the controller may manage the activity stack as shown in FIG. 39A. That is, a 3rd-rank z-order is given to the A window that runs the C application, a second-rank z-order is given to the B window that runs the B application, and the first-rank z-order is given to the C window that runs the C application. Can be given. Accordingly, as shown in FIG. 38A, the controller may control to display the C windows 3632 and 3632, the B windows 361 and 3662, and the A windows 3611 and 3612 in order.

Meanwhile, the user 1 may input a command to change the z-order. The z-order change command in FIG. 36A may be a left pinch-in 3842 gesture input while touching the title bar 3633 of the C window (3841). Here, the pinch in may be a gesture in which the distance between two touch points decreases. In this case, the control unit may reset the windows 3611 and 3612 having the lowest z-order to the highest z-order. In addition, it is possible to control to decrease the z-order of the remaining windows by one. That is, as shown in FIG. 39B, the control unit assigns a first-order z-order to the A window, assigns a third-order z-order to the B window running the B application, and a second-order z-order to the C window running the C application. Orders can be given.

As shown in FIG. 38B, the control unit may control to display the windows A 3611 and 3612, windows 363 and 3632, and windows B 361 and 3622 in this order. Meanwhile, the user 1 may input a command to change the z-order. The z-order change command in FIG. 38B may be a left pinch-in 3852 gesture input in a state in which the title bar 3631 of the C window is touched (3851). In this case, the z-order of the windows 361,3622 having the lowest z-order may be reset to the highest. In addition, it is possible to control to decrease the z-order of the remaining windows by one. That is, as shown in FIG. 39C, the control unit assigns a second-order z-order to window A, assigns a first-order z-order to window B executing application B, and gives a third-order z-order to window C executing application C. Orders can be given.

Accordingly, as shown in FIG. 38C, the controller may control to display B windows 361 and 3622, A windows 3611 and 3612, and C windows 363 1 and 3632 in this order.

That is, as described above, when a pinch-out z-order change command is input, the control unit assigns the lowest z-order to the window of the highest z-order, and when a pinch-in z-order change command is input, the lowest z -You can assign the highest z-order to the order window. A user can change the z-order between windows through a simple operation, so that a desired window can be easily operated at the top, and user convenience can be increased.

It will be appreciated that the embodiments of the present invention can be realized in the form of hardware, software, or a combination of hardware and software. Any such software, for example, whether erasable or rewritable, may be a volatile or nonvolatile storage device such as a storage device such as a ROM, or a memory device such as a RAM, memory chip, device or integrated circuit, for example. Or, for example, it may be optically or magnetically recordable, such as a CD, DVD, magnetic disk or magnetic tape, and stored in a storage medium readable by a machine (eg, a computer). The graphic screen update method of the present invention may be implemented by a computer or portable terminal including a control unit and a memory, and the memory is a machine suitable for storing a program or programs including instructions for implementing the embodiments of the present invention. You can see that it is an example of a readable storage medium. Accordingly, the present invention includes a program including code for implementing the apparatus or method described in any claim of the present specification, and a machine (computer, etc.) readable storage medium storing such a program. Further, such a program may be transferred electronically through any medium, such as a communication signal transmitted through a wired or wireless connection, and the present invention suitably includes equivalents thereto.

In addition, the device may receive and store the program from a program providing device connected by wire or wirelessly. The program providing device provides a program including instructions for the graphic processing device to perform a preset content protection method, a memory for storing information necessary for the content protection method, and wired or wireless communication with the graphic processing device. It may include a communication unit to perform, and a control unit for automatically transmitting a request from the graphic processing device or a corresponding program to the transmission/reception device.

Claims (46)

In the control method of an electronic device,
An operation of executing a first application corresponding to the first application icon based on reception of a first touch input for the first application icon, and
Displaying an execution screen of the first application in the first application window on the touch screen of the electronic device based on the execution of the first application, and
Receiving a second touch input for executing a second application corresponding to a second application icon while the execution screen of the first application is displayed; and
Based on the second touch input, the first application window corresponding to the first application is displayed on a first portion of the touch screen, and the second application window corresponding to the second application is displayed on a second portion of the touch screen. Displaying a second application window, and
An operation of determining a portion of the touch screen for displaying an execution screen of a third application corresponding to the third application icon based on a third touch input on the third application icon, and the third touch input 3 It includes a drag input released from one of the first part and the second part starting from the application icon, and the third application icon and the designated visual effect are applied to the touch screen while the third touch input is maintained. Is displayed on the image, and the size of the designated visual effect is changed and displayed according to the size of the first application window or the size of the second application window,
Displaying a third application window corresponding to the third application on the determined part, and the determined part is inside one of the first part and the second part,
When the determined part is the first part, the display of the second application window on the second part is maintained, and when the determined part is the second part, the first application window on the first part The display of
When the third touch input is released at the boundary between the first application window and the second application window, the execution screen of the third application is displayed in the entire area of the touch screen. Way.
The method of claim 1,
And displaying the first application icon, the second application icon, and the third application icon on a predetermined portion of the touch screen.
The method of claim 1,
The second touch input comprises a drag gesture of dragging the second application icon to a first point on the first application window.
The method of claim 1,
The method of controlling an electronic device, wherein the first portion is larger than the second portion.
delete The method of claim 1,
The first application icon, the second application icon, and the third application icon are displayed along an edge of the touch screen.
The method of claim 1,
The method of controlling an electronic device, characterized in that the first part and the second part are separate parts.
In the electronic device,
Touch screen, and
It includes a control unit, the control unit,
Based on the reception of a first touch input for the first application icon, execute a first application corresponding to the first application icon,
Based on the execution of the first application, an execution screen of the first application is displayed in the first application window on the touch screen,
While the execution screen of the first application is displayed, receiving a second touch input for executing a second application corresponding to a second application icon,
Based on the second touch input, the first application window corresponding to the first application is displayed on a first portion of the touch screen, and the second application window corresponding to the second application is displayed on a second portion of the touch screen. Display a second application window,
Based on a third touch input on a third application icon, a portion of the touch screen for displaying an execution screen of a third application corresponding to the third application icon is determined, and the third touch input is the third application Includes a drag input released from one of the first part and the second part starting from an icon, and the third application icon and a designated visual effect are displayed on the touch screen while the third touch input is maintained. And, the size of the designated visual effect is changed and displayed according to the size of the first application window or the size of the second application window,
It is set to display a third application window corresponding to the third application on the determined part, and the determined part is inside one of the first part and the second part,
When the determined part is the first part, the display of the second application window on the second part is maintained, and when the determined part is the second part, the first application window on the first part The display of
When the third touch input is released at a boundary between the first application window and the second application window, the electronic device is configured to display an execution screen of the third application in the entire area of the touch screen.
The method of claim 8,
The electronic device, wherein the controller is further configured to display the first application icon, the second application icon, and the third application icon on a predetermined portion of the touch screen.
The method of claim 8,
Wherein the second touch input includes a drag gesture of dragging the second application icon to a first point on the first application window.
The method of claim 8,
The electronic device, characterized in that the first portion is larger than the second portion.
delete The method of claim 8,
The electronic device, wherein the first application icon, the second application icon, and the third application icon are displayed along an edge of the touch screen.
The method of claim 8,
The electronic device, characterized in that the first portion and the second portion are separate portions from each other. delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete

Images