KR102084548B1 - Display apparatus and method for controlling thereof - Google Patents

Abstract

A method of launching an application execution window on a screen and an application execution window on a screen is disclosed. The control method according to the present invention includes the steps of displaying a window in which the application is executed, entering a display change control mode for changing the display of the window, setting a plurality of reference areas on the screen, and setting the Displaying a plurality of reference areas and controlling to display at least one of a position and a size of the window corresponding to the selected reference area when at least one of the plurality of reference areas is selected.

Description

Display device and control method thereof {DISPLAY APPARATUS AND METHOD FOR CONTROLLING THEREOF}

The present invention relates to a display apparatus and a control method thereof, and more particularly, to a display apparatus and a control method for controlling the display of a window in which an application is executed.

The desktop computer has at least one display device (eg a monitor). Mobile devices (eg, mobile phones, smartphones or tablet PCs) that use a touch screen have one display device.

The user of the desktop computer may divide the screen of the display apparatus according to a working environment (for example, horizontally or vertically by using a plurality of windows to work). When the web browser is executed, the page up button or the page down button on the keyboard may be used to move up or down the web page. When using a mouse instead of a keyboard, the mouse cursor can select a scroll bar on the side of the web page to move up or down the web page. In addition, the user can move to the top part of the web page by selecting the top button indicated by the text or icon at the bottom part of the web page.

Mobile devices have a smaller screen size and limited input compared to desktop computers. Mobile devices are difficult to use by splitting the screen.

In addition, the mobile device may execute various applications, such as basic applications manufactured by the manufacturer of the device and installed in the device, and additional applications downloaded through an application sales site of the Internet. The additional applications may be developed by general users and registered at the sales site. Therefore, anyone can freely sell their applications to the user of the mobile device through the application sales site. As a result, tens of thousands to hundreds of thousands of applications are currently available for free or for a fee, depending on the product.

 As such, various applications that stimulate consumer's curiosity and satisfy consumer's needs are provided in the mobile device. However, since the mobile device is manufactured to be portable, the display size and the user interface (UI) There is a limit. Accordingly, there is a user's inconvenience in executing a plurality of applications in the mobile device. For example, in a mobile device, when one application is executed, it is displayed in the entire display area of the display. In order to execute another desired application, the currently running application must be terminated first, and then an execution key for executing the desired application must be selected again. In other words, in order to execute various applications in a mobile device, it is cumbersome to repeat the execution and termination processes for each application. In addition, a number of applications do not provide a method for running simultaneously on a mobile device.

On the other hand, the conventional window size changing method adopts a method of changing the size of the window by touching and dragging the bottom edge or corner of the window. However, in the case of the touch screen, it is difficult for a user to accurately touch the boundary of the window using a pen or a finger. Accordingly, when the conventional window size changing method is applied to the touch screen, there is a problem in that an incorrect input is increased because the user does not touch to clean the boundary of the window.

SUMMARY OF THE INVENTION The present invention has been made to solve the above-described problem, and an object of the present invention is to provide a display apparatus and a method of controlling the same, which control at least one of the size and display of a window using a reference area.

In order to achieve the above, a control method of a display apparatus for displaying an application execution window on a screen according to an embodiment of the present invention, the method comprising: displaying a window in which the application is executed; Entering a display change control mode for changing the display of the window; Setting a plurality of reference areas on the screen and displaying the set plurality of reference areas; And controlling to display at least one of a position and a size of the window corresponding to the selected reference area when at least one of the plurality of reference areas is selected.

In addition, the display device according to another aspect of the present invention, a touch screen for displaying a window in which an application is executed, and receives a gesture to enter a display change control mode for changing the display of the window; And when the gesture is input, enters the display change control mode, sets a plurality of reference areas on the screen, controls to display the set plurality of reference areas, and when at least one of the plurality of reference areas is selected. And a controller configured to control to display at least one of a position and a size of the window corresponding to the selected reference area.

On the other hand, the control method of the display device for displaying an application execution window on the screen according to another embodiment of the present invention, the method comprising: displaying a window in which the application is executed; Entering a display change control mode for changing the display of the window; Setting a plurality of reference areas on the screen; Detecting that a specific area is designated on the screen; And comparing the specified specific area with the plurality of reference areas, and controlling to display at least one of a position and a size of the window based on the comparison result.

On the other hand, the display device according to another embodiment of the present invention, a touch screen for displaying a window in which the application is executed, and receives a gesture to enter a display change control mode for changing the display of the window; And enters the display change control mode when the gesture is input, sets a plurality of reference areas on the screen, compares the specified specific area and the plurality of reference areas, and based on the comparison result. And a controller for controlling to display at least one of a position and a size thereof.

On the other hand, the control method of the display device including a touch screen according to another embodiment of the present invention, the step of displaying a window in which the application is executed; Entering a control mode to change the display of the window; Dividing and setting an area of the touch screen into a plurality of reference areas; Receiving a display change gesture for changing the window display on the touch screen; And changing the display of the window based on the input display change gesture and the divided plurality of areas.

On the other hand, the display device according to another embodiment of the present invention, a touch screen for displaying a window in which the application is executed; And a display change gesture for entering a control mode for changing the display of the window, dividing and setting an area of the touch screen into a plurality of reference areas, and changing the window display on the touch screen. And a control unit which controls to change the display of the window based on the input display change gesture and the divided plurality of regions when input to the input unit.

On the other hand, a control method of a display device for displaying an application execution window on the screen according to another embodiment of the present invention, the method comprising: displaying a first window in which the first application is executed and a second window in which the second application; Entering a display change control mode for changing the display of the first window; Setting a plurality of reference areas on the screen and displaying the set plurality of reference areas; Receiving a drag gesture from the first window to a reference area corresponding to the second window; And swapping and displaying positions of the first window and positions of the second window in response to the drag gesture.

On the other hand, the display device according to another embodiment of the present invention, a display change control mode for displaying a first window in which the first application is executed and a second window in which the second application is executed, and to change the display of the window A touch screen for receiving a gesture of entering the device; And when the gesture is input, enter the display change control mode, control a plurality of reference areas to be set on the screen, and display the set plurality of reference areas, and correspond to the second window from the first window. And a control unit which controls to display the position of the first window and the position of the second window in response to the drag gesture to the reference region.

According to various embodiments of the present disclosure, a display apparatus and a control method thereof for controlling at least one of a size and a display of a window using a reference area are provided. Accordingly, the problem of incorrect input caused by touching the boundary line of the window based on the conventional method can be solved.

1 is a schematic block diagram showing an apparatus according to an embodiment of the present invention.
2A is a perspective view of an apparatus according to an embodiment of the present invention.
2B is a conceptual diagram for explaining a framework according to the present invention.
3 is a flowchart illustrating a control method of a display apparatus according to an exemplary embodiment.
4A to 4E are conceptual views of a screen for explaining the control method of FIG. 3.
4F is a flowchart illustrating a control method of a display apparatus according to another exemplary embodiment.
5A to 5E are conceptual diagrams of a screen for explaining a configuration of changing the size of a window based on a reference area.
5F is a flowchart for explaining a control method of a display apparatus according to another exemplary embodiment.
6 is a flowchart illustrating a control method of a display apparatus according to another exemplary embodiment.
FIG. 7A is a flowchart illustrating an example in which a second window is displayed while being hidden by the first window in the embodiment of FIG. 6.
7B is a conceptual diagram for explaining a z-order.
8A through 8C are conceptual views of screens for describing an exemplary embodiment of FIG. 7A.
FIG. 9 is a flowchart for describing a control method of a display apparatus according to another exemplary embodiment.
10A through 10C are screens of the display apparatus for describing the exemplary embodiment of FIG. 9.
11A is a flowchart illustrating a control method of a display apparatus according to another exemplary embodiment.
11B is a flowchart for describing a method of controlling a display device according to an attribute of an application.
12A and 12B are conceptual views of a screen for explaining a control method of the display apparatus of FIG. 11B.
13 is a flowchart illustrating a control method of a display apparatus according to another exemplary embodiment.
14A to 14D are conceptual views of screens for describing a method of controlling the display apparatus of FIG. 13.
15 is a flowchart illustrating a control method of a display apparatus according to another exemplary embodiment.
16 is a flowchart illustrating a control method of a display apparatus according to another exemplary embodiment.
17A to 17D are conceptual diagrams of a screen for explaining the control method of FIG. 16.
18A is a flowchart illustrating a control method of a display apparatus according to an exemplary embodiment.
18B is a flowchart illustrating a control method of a display apparatus according to another exemplary embodiment.
19 is a flowchart illustrating a control method of a display apparatus according to another exemplary embodiment.
20A through 20C are conceptual views illustrating a display apparatus for describing the exemplary embodiment of FIG. 19.

Hereinafter, with reference to the contents described in the accompanying drawings will be described in detail an exemplary embodiment according to the present invention. However, the present invention is not limited or limited by the exemplary embodiments. Like reference numerals in the drawings denote members that perform substantially the same function.

1 is a schematic block diagram showing an apparatus according to an embodiment of the present invention.

Referring to FIG. 1, the display apparatus 100 may be connected to an external device (not shown) using the mobile communication module 120, the sub communication module 130, and the connector 165. "External device" includes other devices (not shown), mobile phones (not shown), smartphones (not shown), tablet PCs (not shown), and servers (not shown).

Referring to FIG. 1, the display apparatus 100 includes a touch screen 190 and a touch screen controller 195. In addition, the display apparatus 100 may include a controller 110, a mobile communication module 120, a sub communication module 130, a multimedia module 140, a camera module 150, a GPS module 155, and an input / output module ( 160, a sensor module 170, a storage unit 175, and a power supply unit 180. The sub communication module 130 includes at least one of a wireless LAN module 131 and a short range communication module 132, and the multimedia module 140 includes a broadcast communication module 141, an audio play module 142, and a video play module. 143 at least one. The camera module 150 includes at least one of the first camera 151 and the second camera 152, and the input / output module 160 includes a button 161, a microphone 162, a speaker 163, and vibrations. At least one of a motor 164, a connector 165, and a keypad 166.

The controller 110 may store a signal or data input from the ROM 111 and the outside of the display apparatus 100, in which the CPU 111, a control program for controlling the display apparatus 100 is stored, or the display apparatus ( 100 may include a RAM 113 used as a storage area for a task performed at 100. The CPU 111 may include a single core, dual cores, triple cores, or quad cores. The CPU 111, the ROM 112, and the RAM 113 may be interconnected through an internal bus.

The controller 110 may include a mobile communication module 120, a sub communication module 130, a multimedia module 140, a camera module 150, a GPS module 155, an input / output module 160, and a sensor module 170. The controller 175 may control the storage unit 175, the power supply unit 180, the first touch screen 190a, the second touch screen 190b, and the touch screen controller 195.

The mobile communication module 120 allows the display apparatus 100 to be connected to an external device through mobile communication using at least one, one, or a plurality of antennas (not shown) under the control of the controller 110. The mobile communication module 120 performs a voice call or a video call with a mobile phone (not shown), a smartphone (not shown), a tablet PC or another device (not shown) having a phone number input to the display device 100. Transmit / receive wireless signals for text messages (SMS) or multimedia messages (MMS).

The sub communication module 130 may include at least one of the WLAN module 131 and the short range communication module 132. For example, only the WLAN module 131 may be included, only the local area communication module 132 may be included, or both the WLAN module 131 and the local area communication module 132 may be included.

The WLAN module 131 may be connected to the Internet at a place where a wireless access point (AP) (not shown) is installed under the control of the controller 110. The WLAN module 131 supports a WLAN standard (IEEE802.11x) of the Institute of Electrical and Electronics Engineers (IEEE). The short range communication module 132 may wirelessly perform short range communication between the display apparatus 100 and an image forming apparatus (not shown) under the control of the controller 110. The short range communication method may include Bluetooth, infrared data association (IrDA), and the like.

The display apparatus 100 may include at least one of the mobile communication module 120, the wireless LAN module 131, and the short range communication module 132 according to performance. For example, the display apparatus 100 may include a combination of the mobile communication module 120, the wireless LAN module 131, and the short range communication module 132 according to performance.

The multimedia module 140 may include a broadcast communication module 141, an audio play module 142, or a video play module 143. The broadcast communication module 141 may control a broadcast signal (eg, a TV broadcast signal, a radio broadcast signal or a data broadcast signal) transmitted from a broadcast station through a broadcast communication antenna (not shown) under the control of the controller 110 and the broadcast unit information. For example, an electric program guide (EPS) or an electric service guide (ESG) may be received. The audio play module 142 may play a digital audio file (eg, a file extension of mp3, wma, ogg, or wav) stored or received under the control of the controller 110. The video player module 143 may play a digital video file (eg, a file extension of mpeg, mpg, mp4, avi, mov, or mkv) stored or received under the control of the controller 110. The video play module 143 may play a digital audio file.

The multimedia module 140 may include the audio play module 142 and the video play module 143 except for the broadcast communication module 141. In addition, the audio playback module 142 or the video playback module 143 of the multimedia module 140 may be included in the controller 100.

The camera module 150 may include at least one of the first camera 151 and the second camera 152 for capturing a still image or a video under the control of the controller 110. Also, the first camera 151 or the second camera 152 may include an auxiliary light source (eg, a flash (not shown)) that provides an amount of light necessary for photographing. The first camera 151 may be disposed on the front surface of the display apparatus 100, and the second camera 152 may be disposed on the rear surface of the display apparatus 100. In a different manner, the first camera 151 and the second camera 152 are adjacent (eg, the distance between the first camera 151 and the second camera 152 is greater than 1 cm and less than 8 cm). It is arranged to take a three-dimensional still image or a three-dimensional video.

The GPS module 155 receives radio waves from a plurality of GPS satellites (not shown) on Earth's orbit, and uses a time of arrival from the GPS satellites (not shown) to the display device 100. The position of the display apparatus 100 can be calculated.

The input / output module 160 may include at least one of a plurality of buttons 161, a microphone 162, a speaker 163, a vibration motor 164, a connector 165, and a keypad 166.

Button 161 may be formed on the front, side or rear of the housing of the display device 100, the power / lock button (not shown), the volume button (not shown), the menu button, the home button, the back It may include at least one of a back button and a search button 161.

The microphone 162 generates an electrical signal by receiving a voice or sound under the control of the controller 110.

The speaker 163 may control various signals (eg, wireless signals, broadcast signals, etc.) of the mobile communication module 120, the sub communication module 130, the multimedia module 140, or the camera module 150 under the control of the controller 110. Sound corresponding to a digital audio file, a digital video file, or a photo capture) may be output to the outside of the display apparatus 100. The speaker 163 may output a sound corresponding to a function performed by the display apparatus 100 (for example, a button operation sound corresponding to a phone call, or a call connection sound). One or more speakers 163 may be formed at appropriate positions or positions of the housing of the display apparatus 100.

The vibration motor 164 may convert an electrical signal into mechanical vibration under the control of the controller 110. For example, when the voice call is received from another device (not shown) in the vibration mode, the vibration motor 164 operates. One or more may be formed in the housing of the display apparatus 100. The vibration motor 164 may operate in response to a touch operation of a user who touches the touch screen 190 and a continuous movement of the touch on the touch screen 190.

The connector 165 may be used as an interface for connecting the display apparatus 100 to an external device (not shown) or a power source (not shown). Under the control of the controller 110, data stored in the storage unit 175 of the display apparatus 100 is transmitted to an external device (not shown) or an external device (not shown) through a wired cable connected to the connector 165. Data can be received. Power may be input from a power source (not shown) or a battery (not shown) may be charged through a wired cable connected to the connector 165.

The keypad 166 may receive a key input from the user for the control of the display apparatus 100. The keypad 166 includes a physical keypad (not shown) formed on the display device 100 or a virtual keypad (not shown) displayed on the touch screen 190. The physical keypad (not shown) formed in the display apparatus 100 may be excluded according to the performance or structure of the display apparatus 100.

The sensor module 170 includes at least one sensor that detects a state of the display apparatus 100. For example, the sensor module 170 may include a proximity sensor that detects whether the user approaches the display device 100, an illumination sensor that detects an amount of light around the display device 100, or a display. It may include a motion sensor (not shown) for detecting the operation of the device 100 (eg, rotation of the display device 100, acceleration or vibration applied to the display device 100). The at least one sensor may detect a state, generate a signal corresponding to the detection, and transmit the signal to the controller 110. The sensor of the sensor module 170 may be added or deleted according to the performance of the display apparatus 100.

The storage unit 175 is a mobile communication module 120, a sub communication module 130, a multimedia module 140, a camera module 150, a GPS module 155, an input / output module under the control of the controller 110. The input / output signal or data corresponding to the operation of the 160, the sensor module 170, and the touch screen 190 may be stored. The storage unit 175 may store a control program and applications for controlling the display apparatus 100 or the controller 110.

 The term “storage unit” refers to a memory card (not shown) mounted on the storage unit 175, the ROM 112 in the control unit 110, the RAM 113, or the display device 100 (eg, an SD card, a memory). Sticks). The storage unit may include a nonvolatile memory, a volatile memory, a hard disk drive (HDD), or a solid state drive (SSD).

The power supply unit 180 may supply power to one or a plurality of batteries (not shown) disposed in the housing of the display apparatus 100 under the control of the controller 110. One or more batteries (not shown) supply power to the display apparatus 100. In addition, the power supply unit 180 may supply power input from an external power source (not shown) to the display apparatus 100 through a wired cable connected to the connector 165.

The touch screen 190 may provide the user with a user interface corresponding to various services (eg, a call, data transmission, broadcasting, and photography). The touch screen 190 may transmit an analog signal corresponding to at least one touch input to the user interface to the touch screen controller 195. The touch screen 190 may receive at least one touch through a user's body (eg, a finger including a thumb) or a touchable input means (eg, a stylus pen). In addition, the touch screen 190 may receive a continuous movement of one touch among at least one touch. The touch screen 190 may transmit an analog signal corresponding to continuous movement of an input touch to the touch screen controller 195.

In the present invention, the touch is not limited to the contact between the touch screen 190 and the user's body or touchable input means, and there is no contact between the touch screen 190 and the user's body or touchable input means. 1 mm or less). The detectable interval on the touch screen 190 may be changed according to the performance or structure of the display apparatus 100.

The touch screen 190 may be implemented by, for example, a resistive method, a capacitive method, an infrared method, or an ultrasonic wave method.

The touch screen controller 195 converts an analog signal received from the touch screen 190 into a digital signal (for example, X and Y coordinates) and transmits it to the controller 110. The controller 110 may control the touch screen 190 by using a digital signal received from the touch screen controller 195. For example, the controller 110 may select a shortcut icon (not shown) displayed on the touch screen 190 or execute a shortcut icon (not shown) in response to the touch. In addition, the touch screen controller 195 may be included in the controller 110.

2A is a perspective view of an apparatus according to an embodiment of the present invention.

Referring to FIG. 2A, the touch screen 190 is disposed in the center of the front surface 100a of the display apparatus 100. The touch screen 190 is largely formed to occupy most of the front surface 100a of the display apparatus 100. The first camera 151 and the illumination sensor 170a may be disposed at an edge of the front surface 100a of the display apparatus 100. The side surface 100b of the display apparatus 100 may include, for example, a power / reset button 160a, a volume button 161b, a speaker 163, a terrestrial DMB antenna 141a for receiving broadcasts, a microphone (not shown), A connector (not shown) may be disposed, and a second camera (not shown) may be disposed on the rear surface (not shown) of the display apparatus 100.

The touch screen 190 includes a main screen 210 and a bottom bar 390. In FIG. 2A, the display apparatus 100 and the touch screen 190 are arranged such that the length in each horizontal direction is greater than the length in the vertical direction. In this case, the touch screen 190 is defined as being arranged in a horizontal direction.

The main screen 196 is an area in which one or a plurality of applications are executed. 2A illustrates an example in which a home screen is displayed on the touch screen 190. The home screen is the first screen displayed on the touch screen 190 when the display apparatus 100 is turned on. On the home screen, execution keys 197 for executing a plurality of applications stored in the display apparatus 100 are arranged in rows and columns. The execution keys 197 may be formed of icons, buttons, text, or the like. When each execution key 197 is touched, an application corresponding to the touched execution key 197 is executed and displayed on the main screen 196.

The bottom bar 390 is elongated horizontally from the bottom of the touch screen 190 and includes standard function buttons 391 to 394. The home screen moving button 391 displays a home screen on the main screen 196. For example, when the home screen moving key 391 is touched while applications are executed on the main screen 196, the home screen illustrated in FIG. 2A is displayed on the main screen 196. A back button 392 displays a screen executed just before the currently running screen or terminates the most recently used application. The multi view mode button 393 displays the applications on the main screen 196 in a multi view mode according to the present invention. The mode switch button 394 switches and displays a plurality of currently running applications in different modes on the main screen 196. For example, when the mode switch button 394 is touched, the display apparatus 100 may freely display a plurality of applications at the same position and partially overlap each other, and the plurality of applications The split mode may be switched between split modes that are separately displayed in different areas on the main display screen 196.

In addition, an upper bar (not shown) indicating a state of the display apparatus 100 such as a battery charging state, a received signal strength, and a current time may be formed at an upper end of the touch screen 190.

The lower bar 390 and the upper bar (not shown) are displayed on the touch screen 190 according to an operating system (OS) of the display device 100 or an application executed in the display device 100. It may not be. If neither the bottom bar 390 nor the top bar (not shown) is displayed on the touch screen 190, the main screen 196 may be formed in the entire area of the touch screen 190. In addition, the lower bar 390 and the upper bar (not shown) may be superimposed and displayed on the main screen 196.

2B is a conceptual diagram for explaining a framework according to the present invention.

As shown in FIG. 2B, in framework 270, activity manager 291, window manager 292, and view system 294 may be compatible with multi-window framework 400. Here, the compatibility with the multi-window framework 400 may be, for example, an API (Application Program Interface) call.

The multi window framework 400 includes a multi window manager 320 and a multi window service 330.

The activity manager 291, the window manager 292, and the view system 294 may perform a function of calling application program interfaces (APIs) 311, 312, 313, and 314 for multiple windows. Meanwhile, as will be described later in more detail, the window manager 292 may generate title bars of respective windows.

The multi-window manager 320 provides a function of the multi-window service 330 to the user in an API form, and the Manager / Service structure may operate based on IPC.

The multi-window service 330 tracks a lifecycle of applications executed in the multi-window and manages states such as size and position of each application.

The called API can manage the size, position, and visibility of each window.

As described above, the framework according to the present invention may be performed in a manner of calling an API by providing an independent multi-window framework.

In addition, the application layer 260 may call 404 APIs directly from the multi-window manager 320. That is, a user may receive and use an API provided from the multi-window manager 320 even when developing a new application.

As described above, the present invention employs the multi-window framework 400 and can display two or more applications simultaneously.

3 is a flowchart illustrating a control method of a display apparatus according to an exemplary embodiment. The control method of the display apparatus of FIG. 3 will be described with reference to the conceptual diagrams of FIGS. 4A to 4D.

As shown in FIG. 3, the display device may display a window for executing an application (S301).

The window may be an area including an execution screen of a specific application and a title bar and a control area for the executed application. Objects related to the application may be displayed on the execution screen of the application. The object may be formed in various shapes such as a text, a figure, an icon, a button, a check box, a photo, a video, a web, a map, and the like. When a user touches an object, a predetermined function or event corresponding to the object may be performed in an application corresponding to the object. The object may be called a view according to an operating system. The title bar may include at least one control key for controlling the display of the window. For example, the control key may be a window display minimize button, a window display maximize button, and a window end button.

On the other hand, each application is a program implemented independently of each other by the manufacturer or application developer of the display device 300. Accordingly, it does not require that another application be executed in advance in order for one application to be executed. In addition, even if one application terminates, another application may continue to run.

Since the applications are programs that are implemented independently of each other, a multi-function application (or dual) that includes some functions (memo function, message transmission / reception function) provided by another application in one application (for example, a video application). Application). However, such a composite function application is a single application newly produced to have various functions, which is different from existing applications. Therefore, the composite function application does not provide various functions like the existing applications, provides limited functions, and the user has a burden of separately purchasing such a new composite function application.

4A is a conceptual diagram of a screen displayed at step S301. As shown in FIG. 4A, the screen 400 of the display device displays first windows 411 and 412, second windows 421 and 422, and third windows 431 and 432. The first windows 411 and 412 may include a first title bar 411 and an execution screen 412 of the first application. The second windows 421 and 422 may include a second title bar 421 and an execution screen 422 of the second application. The third windows 431 and 432 may include a third title bar 431 and an execution screen 432 of the third application. The first title bar 411 may include at least one control key for controlling the display of the first window. For example, the control key may be a first window display minimize button, a first window display maximize button, and a first window end button.

The display device may display third windows 431 and 432 on the right half of the screen 400. Meanwhile, the display device displays first windows 411 and 412 on the upper half of the left half of the screen 400 and displays second windows 421 and 422 on the lower half. The display device may display the first to third windows so as not to overlap with each other as shown in FIG. 4A. Meanwhile, it is merely an example that the display apparatus displays the plurality of windows so as not to overlap each other, and as will be described later in detail, the display apparatus may display the plurality of windows overlapping based on the display order.

The display device may enter a display change control mode for changing at least one of a position and a size at which the window is displayed (S305). For example, as shown in FIG. 4B, the user may long-press the title bar 411 of the window (eg, the first windows 411 and 412) whose display is to be changed. The display device may recognize the gesture of long-pressing the title bar as a gesture of entering the display change control mode. On the other hand, the gesture of long-pressing the title bar is merely exemplary, and those skilled in the art will readily understand that various manners of gestures can be set as the gesture to enter the display change control mode. For example, a gesture for specifying the title bar 411 while pressing the button of the stylus pen or a gesture for specifying the action bar (not shown) while pressing the button of the long-press or the stylus pen enters the display change control mode. It can be set to. When the button of the stylus pen is pressed, the frequency or phase of the signal input from the stylus pen may be changed, and the controller (not shown) may detect the change and confirm that the button of the stylus pen is pressed.

If the display change control mode is not entered (S305-N), the display device may display a window as shown in FIG. 4A (S301).

When entering the display change control mode (S305-Y), the controller (not shown) may display a plurality of reference areas on the screen 400 (S307). 4C is a screen of a display device displaying a reference area according to an embodiment of the present invention. As illustrated in FIG. 4C, the controller (not shown) may set reference regions 451, 452, 453, 454, 455, 456, 457, 458, and 459 divided by at least one reference line 441, 442, 443, 444, 445 and reference lines 441, 442, 443, 444, 445. The controller (not shown) may display the set reference lines 441, 442, 443, 444, 445 and the reference areas 451, 452, 453, 454, 455, 456, 457, 458, 459 on the screen 400. Meanwhile, as will be described in detail later, the controller (not shown) may control not to display the set reference lines 441, 442, 443, 444, 445 and the reference areas 451, 452, 453, 454, 455, 456, 457, 458, 459 on the screen 400.

The controller (not shown) may control a window (for example, a first window) 440 designated to change the display to be displayed in the first brightness or the first color. In addition, the controller (not shown) may control an area other than the window 440 designated to change the display to be displayed in the second brightness or the second color. Accordingly, the user can identify which portion of the window 440 is designated to change the display. The controller (not shown) may control to display the reference lines 441, 442, 443, 444 and 445 in the third brightness or the third color on an area other than the window 440 displayed in the second brightness or the second color. Accordingly, the user can identify which part of the reference area 451, 452, 453, 454, 455, 456, 457, 458, 459 is.

The user may designate at least one of the reference areas 451, 452, 453, 454, 455, 456, 457, 458, and 459, and the controller (not shown) may change the display of the window in correspondence with the designated at least one reference area. The controller (not shown) may change at least one of the size and position of the window 440.

As illustrated in FIG. 4C, the user may select the first reference area 461 and the second reference area 462. The controller (not shown) may control to enlarge the size of the window 440 to the first reference area 461 and the second reference area 462. FIG. 4D is a screen 400 illustrating that the first windows 471 and 472 are enlarged to the first reference region 461 and the second reference region 462 of FIG. 4C. In addition, the controller (not shown) may control to further display the second windows 481 and 482 and the third windows 491 and 492 on the screen 400. In particular, the controller (not shown) controls the third windows 491 and 492 to be reduced in size as compared to the third windows 431 and 432 in FIG. 4A. However, the size reduction of the above-described third windows 491 and 492 is merely an example, and the controller (not shown) may cause the first windows 471 and 472 to become the third window in FIG. 4A as the display size of the first windows 471 and 472 increases. It may be controlled to display as covering the (431,432). Examples thereof will be described later in more detail.

As described above, the user may solve the above-mentioned problem due to the wrong input by adjusting the size of the window based on the reference area and the selection without adjusting the size after designating the boundary of the window.

4E is a conceptual diagram of a display device according to another embodiment of the present invention. As shown in screen 400 of FIG. 4E, the user may select one reference area 452. The controller (not shown) may change and display the reference region based on the reference line change based on the selected reference region 452. The screen 400 of FIG. 4E may be compared with the screen 400 of FIG. 4C, and it may be confirmed that the reference line 441 and the reference line 442 are not displayed. The controller (not shown) may change and display the reference area so that the shape of the window after the display change maintains a rectangle. When the reference line 441 and the reference line 442 are displayed as shown in the screen of FIG. 4C, when the user further selects the reference area 451, the shape of the window may not be rectangular. Accordingly, the controller (not shown) may control the reference line 441 and the reference line 442 not to be displayed to provide reference areas for allowing the shape of the window after the display change to become a rectangle.

4F is a flowchart of a control method of a display apparatus for describing the exemplary embodiment of FIG. 4E.

The display device may display a window for executing an application on the screen (S493). The display device may receive a gesture for entering the display change control mode for changing the display of the window from the outside, and thus may enter the display change control mode (S494). If a gesture for entering the display change control mode is not received (S494-N), the display device may maintain display of the window (S493).

The display device may display a plurality of reference areas on the screen (S495). On the other hand, when one reference area is selected and the window is enlarged or reduced (S496-Y), the display device may control to display a plurality of changed reference areas based on the enlargement or reduction (S497). For example, the display device may reset and display a plurality of reference areas that allow the shape of the window after the last display change to become a rectangle.

In the above, in FIG. 4A-4G, the structure which changes the size of a window based on the reference area was demonstrated. 5A to 5G, the configuration of changing the size of the window based on the reference area will be described.

The display device displays an action bar 501 and first windows 511 and 512 on the screen 500 as shown in FIG. 5A. On the action bar 501, various action items that provide a shortcut menu or support a tab may be displayed. In contrast to FIG. 4B, in FIG. 5A, the gesture of long-pressing the action bar 501 may be set as a gesture of entering the display change control mode. The controller (not shown) may enter the display change control mode when the action bar 501 is long-pressed.

When entering the control mode, the controller (not shown) controls to display the window 540 for changing the display in the first brightness or the first color. In addition, the controller (not shown) controls to display an area other than the window 540 in the second brightness or the second color. Also, the controller (not shown) may display at least one reference line 541, 542, 543, 544, 545, 546 in a third brightness or a third color. Accordingly, the controller (not shown) may control to display the reference areas 551, 552, 553, 554, 555, 556, 557, 558, 559 identified by the at least one reference line 541, 542, 543, 544, 545, 546.

The user may input a drag gesture 560 from the window 540 to which the position is to be changed, for example, to the first reference region 559. The controller (not shown) may recognize the drag gesture from the window 540 to change the position to the first reference region 559 as the display change gesture. The controller (not shown) may change the position of the window 540 to the first reference region 559.

5C is a screen of which display is changed according to an exemplary embodiment. As illustrated in FIG. 5C, the controller (not shown) may control to display the first windows 561 and 562 at a position corresponding to the first reference region 559 of FIG. 5B.

Referring back to FIG. 5B, the user may input a drag gesture 570 from the window 540 to change its position to the second reference region 554. The controller (not shown) may recognize the drag gesture from the window 540 to change the position to the second reference region 554 as the display change gesture. The controller (not shown) may change the position of the window 540 to the second reference area 554. The controller (not shown) may control to reduce and display the size of the window 540 corresponding to the second reference area 554. 5D is a screen for changing and displaying the size and position of a window at the same time. The controller (not shown) controls the sizes and positions of the first windows 511 and 512 in FIG. 5A to display the windows 571 and 572 on the basis of the second reference region 554 in FIG. 5B. On the other hand, controlling the size and position at the same time is merely exemplary, and the controller (not shown) may control to change only the position of the window.

Meanwhile, as shown in FIG. 5B, when a touch or drag is input to change the position of the window 540, the controller (not shown) may control the gesture input to the window 540 not to be dispatched. . For example, the controller (not shown) may temporarily generate a view that is displayed on the entire screen 500, and may control the gesture that is input in the display change control mode to accommodate the temporarily generated view. You can control that a gesture is not dispatched to an existing view.

5E is a conceptual diagram of a display device according to another embodiment of the present invention. As in the screen 500 of FIG. 5E, the user may input a drag gesture for moving the window from the previous display window 540-1 to the subsequent display window 540-2.

As described above, when the window 540-2 is moved, the controller (not shown) may reset and display the reference area corresponding to the changed window 540-2. For example, the controller (not shown) sets the reference lines 581, 582, 583, 585, 586, 587, and 588 with extension lines of the boundary line of the changed window 540-2. Accordingly, the controller (not shown) may provide the reference areas 591, 592, 593, 594, 595, 596, 597, and 598 set by the reference lines 581, 582, 583, 585, 586, 587, and 588.

FIG. 5F is a flowchart of a control method of a display apparatus for describing the exemplary embodiment of FIG. 5E.

The display device may display a window for executing an application on the screen (S573). The display device may receive a gesture for entering the display change control mode for changing the display of the window from the outside, thereby entering the display change control mode (S574). If a gesture for entering the display change control mode is not received (S574-N), the display device may maintain display of the window (S573).

The display device may display a plurality of reference areas on the screen (S575). On the other hand, when the drag gesture is input to change the position of the window (S576-Y), the display device may control to display the plurality of changed reference areas based on the position of the window (S577). For example, the display apparatus may set the extension lines of the boundary line of the changed window to be the reference line, and control to display the reference regions partitioned by the set reference line.

6 is a flowchart illustrating a control method of a display apparatus according to another exemplary embodiment.

The display apparatus displays a first window for executing the first application and a second window for executing the second application on the screen (S601). The display device may receive a gesture for entering the display change control mode for changing the display of the first window from the outside, thereby entering the display change control mode (S603). If a gesture for entering the display change control mode is not received (S603 -N), the display device may maintain display of the first window and the second window (S601).

After entering the display change control mode (S603-Y), the display device may display a plurality of reference areas (S605). Here, the reference area is obtained by dividing the screen of the display device, and may be implemented as, for example, rectangles of various sizes. However, there is no limitation on the size and shape of each reference area.

The display apparatus may receive selection of at least one reference area from the outside, and change the display of the first window in response to the selected reference area (S607). In more detail, the display device may change at least one of the size and position of the first window.

The display device may determine whether the changed first window is displayed while being hidden by the second window (S609). If it is determined that the first window is not displayed while the second window is hidden (S609-N), the display device displays the first window and the second window in which the change is reflected (S613). On the other hand, if it is determined that the first window is displayed while the second window is hidden (S609-Y), the display device may change the display of the second window in response to the first window display change (S611). For example, the display device may reduce and display the display of the second window so as not to overlap the first window. Alternatively, the display device may control such that the second window is covered and displayed by the first window. The display apparatus controls to display the first window in which the change is reflected and the second window in which the change is reflected (S613).

FIG. 7A is a flowchart illustrating an example in which a second window is displayed while being hidden by the first window in the embodiment of FIG. 6. The display control method of FIG. 7A may operate after step S609 of FIG. 6.

The display apparatus may check pixel coordinates of the display area of the first window in which the display is changed (S701). In addition, the display apparatus may check pixel coordinates of the display area of the second window (S703). The display apparatus may compare the pixel coordinates of the display area of the first window and the pixel coordinates of the display area of the second window, and thus, identify the overlapping portions of the first window and the second window (S705). The display apparatus controls to display the first window in a portion where the first window and the second window overlap (S707). That is, the display device controls not to display the second window in a portion where the first window and the second window overlap.

Alternatively, the display device may control to display a portion where the first window and the second window overlap. The user may select whether the first window or the second window is displayed in the overlapping portion. For example, the user may touch the overlapping portion, and the display device may control the first window to display while covering the second window. Alternatively, when the user does not touch the overlapping portion and the preset time is elapsed, the display apparatus may control to display the second window while covering the second window.

More specifically, the display device compares the z-order of the first window and the z-order of the second window, and indicates that the z-order of the first window is higher than the z-order of the second window. You can check it. The display device may control to display the first window on which the z-order is set relatively high on the second window. 7B is a conceptual diagram for explaining a z-order. The Z-order of the screen may be divided into N layers, and the Nth layer may correspond to an upper layer located above the N-1th layer. Each layer has a corresponding window, and each application can be executed on the window. That is, when the first application is executed, it is executed in the window on the first layer, and when the second application is executed, it is executed in the window on the second layer, and when the third application is executed, it is executed in the window on the third layer. First, second and third layers are created hierarchically. That is, the last layer created may be at the top and be displayed at the top. For example, the plurality of windows 1 to 4 may overlap each other and be displayed on the main screen 196. More specifically, the first window 1 is displayed to cover the second to fourth windows 2 to 4, and the second window 2 covers the third and fourth windows 3 and 4. The third window 3 is displayed to cover the fourth window 4. That is, when the plurality of windows 1 to 4 overlap, they may have a display order, and the displayed order may be called Z-order. Z-order may be a display order of a window about the z axis. The hierarchical viewer 5 may be a screen displaying hierarchical Z-orders. On the other hand, Z-order may be called a display order.

8A through 8C are screens of the display apparatus for describing the exemplary embodiment of FIG. 7A.

8A is a screen before the display of the window is changed. As illustrated in FIG. 8A, the screen 800 of the display device displays first windows 811 and 812, second windows 821 and 822, and third windows 831 and 832. The first windows 811 and 812 may include a first title bar 811 and an execution screen 812 of the first application. The second windows 821 and 822 may include a second title bar 821 and an execution screen 822 of the second application. The third windows 831 and 832 may include a third title bar 831 and an execution screen 832 of the third application. The first title bar 811 may include at least one control key for controlling the display of the first window. For example, the control key may be a first window display minimize button, a first window display maximize button, and a first window end button.

As described above with reference to FIGS. 4B and 4C, the controller (not shown) may enter a display change control mode and display a plurality of reference regions. In addition, the controller (not shown) may change the display of the first windows 811 and 812 based on the selected reference region.

8B is a screen when the sizes of the first windows 811 and 812 are changed. The controller (not shown) may enlarge and display the first windows 811 and 812 in FIG. 8A as shown in the first windows 841 and 842 in FIG. 8B based on the selected reference region. The controller (not shown) may control the first windows 841 and 842 to display the third windows 833 while covering the third windows 833. For example, the controller (not shown) may compare pixel coordinates of the display area of the first windows 841 and 842 to which the changes are reflected with pixel coordinates of the third windows 831 and 832 in FIG. 8A. Accordingly, the controller (not shown) may confirm that the pixel coordinates of the display areas of the first windows 841 and 842 reflecting the change overlap with the pixel coordinates of the display areas of the third windows 831 and 832 in FIG. 8A. The controller (not shown) confirms that the z-order of the first windows 841 and 842 is higher than the z-order of the third windows 831 and 832, and displays the first window 841 and 842 covering the third window 833. To control. That is, the controller (not shown) controls to display only the portion 833 except for the portion where the third window overlaps with the first windows 841 and 842 as shown in FIG. 8B.

8C is a screen when the positions of the first windows 811 and 812 are changed. The controller (not shown) may move and display the first windows 811 and 812 in FIG. 8A and the display areas as shown in the first windows 811 and 812 in FIG. 8C based on the selected reference region. Meanwhile, the controller (not shown) may confirm that the first windows 811 and 812 cover the second windows 821 and 822 and the third windows 831 and 832 in FIG. 8A. For example, the controller (not shown) may compare the pixel coordinates of the display areas of the first windows 811 and 812 in which the changes are reflected with the pixel coordinates of the second windows 821 and 822 and the third windows 831 and 832 in FIG. 8A. have. Accordingly, the controller (not shown) determines that the pixel coordinates of the display areas of the first windows 811 and 812 in which the changes are reflected are the pixel coordinates of the display areas of the second windows 821 and 822 and the third windows 831 and 832 in FIG. 8A. You can see that they overlap. The controller (not shown) confirms that the z-orders of the first windows 811, 812 are higher than the z-orders of the second windows 821, 822 and the third windows 831, 832, and the first windows 811, 812 are the second windows. Controls to display 821 and 822 and the third windows 831 and 832 while covering the display. That is, the controller (not shown) controls to display only the portions 823 and 824 except for the portion where the second window overlaps with the first windows 811 and 812 as shown in FIG. 8C. In addition, the controller (not shown) controls to display only the portions 834 and 835 except for the portion where the third window overlaps with the first windows 811 and 812.

FIG. 9 is a flowchart for describing a control method of a display apparatus according to another exemplary embodiment.

The display apparatus may check pixel coordinates of the display area of the first window where the display is changed (S901). In addition, the display apparatus may check pixel coordinates of the display area of the second window (S903). The display apparatus may compare the pixel coordinates of the display area of the first window and the pixel coordinates of the display area of the second window, thereby checking the overlapping portions of the first window and the second window (S905).

The display device may control to display the second window in the remaining area except for the portion where the first window and the second window overlap (S907). That is, the display device may control the first window and the second window not to overlap each other. For example, the display device may change and display at least one of a size and a position of the second window so as not to overlap the first window in which the change is reflected.

10A through 10C are screens of the display apparatus for describing the exemplary embodiment of FIG. 9.

10A is a screen before the display of the window is changed. As shown in FIG. 10A, the screen 1000 of the display apparatus displays first windows 1011 and 1012, second windows 1021 and 1022, and third windows 1031 and 1032. The first windows 1011 and 1012 may include a first title bar 1011 and an execution screen 1012 of the first application. The second windows 1021 and 1022 may include a second title bar 1021 and an execution screen 1022 of the second application. The third windows 1031 and 1032 may include a third title bar 1031 and an execution screen 1032 of the third application. The first title bar 1011 may include at least one control key for controlling the display of the first window. For example, the control key may be a first window display minimize button, a first window display maximize button, and a first window end button.

As described above with reference to FIGS. 4B and 4C, the controller (not shown) may enter a display change control mode and display a plurality of reference regions. In addition, the controller (not shown) may change the display of the first windows 1011 and 1012 based on the selected reference region.

10B is a screen when the sizes of the first windows 1011 and 1012 are changed. The controller (not shown) may enlarge and display the first windows 1011 and 1012 in FIG. 10A as shown in the first windows 1041 and 1042 in FIG. 10B based on the selected reference region. The controller (not shown) may control the first windows 1041 and 1042 so as not to overlap the third window 1033.

For example, the controller (not shown) may compare the pixel coordinates of the display areas of the first windows 1041 and 1042 to which the changes are reflected with the pixel coordinates of the third windows 1031 and 1032 in FIG. 10A. Accordingly, the controller (not shown) indicates that the pixel coordinates of the display areas of the first windows 1041 and 1042 reflecting the change overlap with the pixel coordinates of the display areas of the third windows 1031 and 1032 in FIG. 10A. You can check it.

The controller (not shown) controls the third windows 1031 and 1032 in FIG. 10A to be reduced and displayed like the third windows 1041 and 1042 in FIG. 10B so that the windows do not overlap each other. The controller (not shown) may control the display to maintain the aspect ratio of the third windows 1041 and 1042 as it is, for example. Alternatively, the controller (not shown) may change the horizontal-to-vertical ratio based on the corresponding reference region and display the same.

10C is a screen when the positions of the first windows 1011 and 1012 are changed. The controller (not shown) may move and display the first windows 1011 and 1012 in FIG. 10A and the display areas as shown in the first windows 1011 and 1012 in FIG. 10C based on the selected reference region.

The controller (not shown) may confirm that the first windows 1011 and 1012 cover the second windows 1021 and 1022 and the third windows 1031 and 1032 in FIG. 10A. For example, the controller (not shown) may display the pixel coordinates of the display area of the first window 1011 or 1012 in which the change is reflected, and the second window 1021 and 1022 and the third window 1031 and 1032 in FIG. 10A. It can be compared with the pixel coordinate of. Accordingly, the controller (not shown) determines that the pixel coordinates of the display area of the first windows 1011 and 1012 reflecting the change are determined by the second windows 1021 and 1022 and the third windows 1031 and 1032 of FIG. 10A. It can be seen that the pixel coordinates of the display area overlap.

The controller (not shown) controls the second windows 1021 and 1022 in FIG. 10A to be reduced to the second windows 1024 and 1025 in FIG. 10C so that the windows do not overlap each other. Here, the second windows 1024 and 1025 may be displayed while maintaining the aspect ratio of the second windows 1021 and 1022 in FIG. 10A. In addition, the controller (not shown) controls the third windows 1031 and 1032 in FIG. 10A to be reduced to the third windows 1034 and 1035 in FIG. 10C so that the windows do not overlap each other. Here, the third windows 1034 and 1035 may be displayed to have horizontal and vertical ratios different from the horizontal and vertical ratios of the third windows 1031 and 1032 in FIG. 10A.

11A is a flowchart illustrating a control method of a display apparatus according to another exemplary embodiment.

The display device may display a window for executing an application on the screen (S1101). The display apparatus may receive a gesture for entering the display change control mode for changing the display of the window from the outside, thereby entering the display change control mode (S1103). If a gesture for entering the display change control mode is not received (S1103-N), the display device may maintain display of the window (S1101).

When a gesture for entering the display change control mode is input (S1103-Y), the controller (not shown) may check the property of an application executed in the window (S1105). Here, the attribute of the application may be for the change of the execution screen of the application. For example, the attributes of the application may be as shown in Table 1 below.

application property First application Can change size, position, aspect ratio 2nd application Size, position can be changed
Can't change aspect ratio 3rd application Repositionable
Size, aspect ratio cannot be changed 4th application Can't change size, position, aspect ratio

As described above, the attribute of the application may relate to the change of at least one of the size, location, and aspect ratio of the application execution screen. The controller (not shown) may confirm that the execution screen of the first application may be changed in size, position, and aspect ratio. The controller (not shown) may confirm that the execution screen of the second application may change in size and position, and that the aspect ratio may not be changed. The controller (not shown) may confirm that only the position of the execution screen of the third application is changeable and that the size and the aspect-ratio cannot be changed. The controller (not shown) may confirm that the execution screen of the fourth application is not changeable in size, position, and aspect ratio. The controller (not shown) may check the metadata of the application at the time when each application is installed, and may check and store the attributes included in the metadata.

After checking the property of the application executed in the window (S1105), the controller (not shown) controls to display the reference area based on the checked property (S1107). The controller (not shown) may display different reference areas according to the attributes of the application. For example, the controller (not shown) controls the first application to display various reference regions without limitations in changing the size, position, and aspect ratio. The controller (not shown) has no limitation on the size and position change of the second application, but controls the horizontal-to-vertical ratio to display the same various reference areas as the window before the change. The controller (not shown) controls to display various reference areas for maintaining the size and the aspect ratio, although there is no limitation on the change of position with respect to the third application. The controller (not shown) may control to output a message indicating that display change is impossible without providing a reference area for the fourth application.

11B is a flowchart for describing a method of controlling a display device according to an attribute of an application. The control method of the display apparatus of FIG. 11B will be described with reference to FIGS. 12A and 12B.

The display apparatus may enter a display change control mode (S1111). The display device may determine whether the size of the execution screen of the application executed in the window whose display is to be changed is not changeable (S1113). If it is determined that the size of the execution screen of the application cannot be changed (S1113-Y), the display device may display a plurality of reference areas having the same size (S1115).

12A is a screen for describing a plurality of reference areas having the same size. If it is determined that the size of the execution screen of the application cannot be changed, the controller (not shown) may control the reference lines 1231, 1232, 1223, 1224, and 1225 so that the reference lines 1231, 1232, 1223, and 1225 have the same size. 1235). Accordingly, even if the user selects at least one of the reference areas 1221, 1222, 1223, 1224, and 1225, the controller (not shown) may change the display of the window to have the same size as the window 1201 before the change. Can be. Can be set.

On the other hand, if it is determined that the size of the execution screen of the application is changeable (S1113-N), the display device may determine whether the aspect ratio of the execution screen of the application cannot be changed (S1117). If it is determined that the aspect ratio of the execution screen of the application cannot be changed (S1117-Y), the display apparatus may control to display a plurality of reference regions having the same aspect ratio and different sizes (S1119). .

12B is a screen for describing a plurality of reference areas having the same aspect ratio and different sizes. If it is determined that the aspect ratio of the execution screen of the application is not changeable, the controller (not shown) controls the reference lines 1210 such that the respective reference regions 1211, 1213, 1215, 1217, and 1219 have the same aspect ratio. , 1212, 1214, 1216, 1218 can be set. Accordingly, even if the user selects at least one of the reference areas 1211, 1213, 1215, 1217, and 1219, the controller (not shown) may have the same horizontal-to-vertical ratio as the window 1201 before the change. You can change the display.

On the other hand, if it is determined that the aspect ratio of the execution screen of the application is changeable (S1117-N), the display device may display various reference regions having no limitation on the aspect ratio, size, and position.

As described above, the display device controls to display the reference area in various ways according to the attributes of the application.

13 is a flowchart illustrating a control method of a display apparatus according to another exemplary embodiment. The control method of the display apparatus of FIG. 13 will be described with reference to FIGS. 14A to 14D.

The display device may display a window for executing an application on the screen (S1301). The display apparatus may receive a gesture for entering the display change control mode for changing the display of the window from the outside, and thus may enter the display change control mode (S1303). If a gesture for entering the display change control mode is not received (S1303-N), the display device may maintain display of the window (S1301).

When a gesture for entering the display change control mode is input (S1303-Y), a plurality of reference areas may be displayed (S1305). For example, the display device may check a property of an application and display a plurality of reference areas corresponding thereto.

When a plurality of reference areas is displayed (S1305), the display device may determine whether the reference area is edited (S1307). The user may edit at least one of the plurality of reference areas.

14A is a screen for explaining editing of a reference area. The display apparatus may display the plurality of reference areas in response to the entry of the display change control mode.

As shown in FIG. 14A, the controller (not shown) is controlled by at least one reference line 1411, 1412, 1413a, 1414, and 1415 and reference lines 1411, 1412, 1413a, 1414, and 1415 on the screen. The divided reference regions 1421, 1422, 1423, 1424, 1425, 1426, 1427, 1428, and 1429 can be set. The controller (not shown) may display the set reference lines 1411, 1412, 1413a, 1414, and 1415 and the reference areas 1421, 1422, 1423, 1424, 1425, 1426, 1427, 1428, and 1429 on the screen 1400. Can be.

Meanwhile, the user may designate the reference line 1413a and input a drag gesture 1430 upward. That is, the display device may receive an edit of the reference area (S1307-Y). When editing of the reference area is input (S1307-Y), the display device controls to display the edited plurality of reference areas (S1309). If editing of the reference area is not input (1307-N), the display device maintains display of the plurality of reference areas (S1305).

14B is a screen displaying a reference area edited corresponding to a reference area editing input. As illustrated in FIG. 14B, the controller (not shown) may change the reference line 1413a into the reference line 1413b and display the corresponding reference area edit input in FIG. 14A. Accordingly, the reference area 1425 is changed to the reference area 1435, the reference area 1426 is displayed as the reference area 1434, and the reference area 1743 is changed to the reference area 1435. The reference area 1428 may be changed to the reference area 1438 and displayed. The portion where the reference line 1413b is determined may be a point where the drag gesture 1430 ends.

The display device may display the edited plurality of reference areas (S1309). In FIG. 13, after the editing of the reference area is completed, it is described as displaying the reference area. However, this is merely an example, and the display apparatus may simultaneously display the edited and edited reference area of the reference area. . As the display device performs editing of the reference area and display of the edited reference area at the same time, the effect of allowing the user to edit the reference area more accurately is created.

The display device may receive a selection of at least one reference area from among the plurality of reference areas, and controls to change the display of the window in response to the selection.

As shown in FIG. 14C, the user may select the reference area 1435 and the reference area 1434. The display device may enlarge and display the windows 1451 and 1452 as shown in FIG. 14D corresponding to the selected reference regions 1435 and 1436.

15 is a flowchart illustrating a control method of a display apparatus according to another exemplary embodiment.

The display apparatus may display a window for executing an application on the screen (S1501). The display apparatus may receive a gesture for entering the display change control mode for changing the display of the window from the outside, and thereby enter the display change control mode (S1503). If a gesture for entering the display change control mode is not received (S1503-N), the display device may maintain display of the window (S1501).

When a gesture for entering the display change control mode is input (S1503-Y), a plurality of reference areas may be displayed, and a display change for selecting the reference area may be input (S1505).

In addition, the display apparatus may receive an end gesture for terminating the display change control mode from the outside (S1507). For example, the end gesture may be set as a gesture of pressing a button of the stylus pen. Alternatively, when the predetermined time elapses, the display device may end the display change control mode.

If the display change control mode is not terminated (S1507-N), the display device may continuously receive the display change in the display change control mode (S1505). On the other hand, when the display change control mode ends (S1507-Y), the display device may enter the window execution mode (S1509). Here, the window execution mode means that an application executed in the window is executed.

16 is a flowchart illustrating a control method of a display apparatus according to another exemplary embodiment. The control method of FIG. 16 will be described with reference to FIGS. 17A to 17D.

The display device may display a window for executing an application on the screen (S1601). The display apparatus may receive a gesture for entering the display change control mode for changing the display of the window from the outside, and thereby enter the display change control mode (S1603). If a gesture for entering the display change control mode is not received (S1603-N), the display device may maintain display of the window (S1601).

When the gesture for entering the display change control mode is input (S1603-Y), the display device enters the display change control mode. For example, as shown in FIG. 17A, the display device may display a window 1701 to be changed in display with different brightness or color.

The display device may detect that a specific area of the screen is designated (S1605). For example, as shown in FIG. 17B, the display device detects that a specific area of the screen is designated 1710 using the stylus pen 10 or a finger (not shown). On the other hand, the control method of the display apparatus described above, in contrast to the display of a plurality of reference areas, the control method of FIG. 16 may set, but not display, a plurality of reference areas.

When it is detected that a specific area of the screen is designated (S1605), the non-displayed reference area may be compared with the specified specific area, and the window display may be changed based on the comparison result (S1607). For example, as shown in FIG. 17C, the controller (not shown) sets reference lines 1711, 1712, 1713, 1714, 1715, 1716, 1717, and 1718, and the reference areas 1721, 1722, and 1723 are divided by the reference lines. , 1724,1725,1726,1727,1728,1729,1730,1731,1732,1733,1734,1735,1736,1737,1738,1739,1740,1741,1742,1743. On the other hand, the control unit (not shown), the reference area (1721, 1722, 1723, 1724, 1725, 1726, 1723, 1728, 1729, 1730, 1731, 1732, 1732, 1734, 1735, 1736, 1735, 1738, 1739, Only 1740,1741,1742,1743 may be set and control not to be displayed.

The control unit (not shown) may include the set reference areas 1721, 1722, 1723, 1724, 1725, 1726, 1727, 1728, 1729, 1730, 1731, 1732, 1733, 1734, 1735, 1736, 1737, 1738, 1739, 1740, 1741,1742,1743 may be compared to a specific area 1710 designated. The controller (not shown) may confirm that the specified specific region 1710 overlaps the reference regions 1721, 1722, 1723, 1726, 1728, 1731, 1732, 1735, 1736, and 1737. Accordingly, the controller (not shown) may control the display to be enlarged on the screen 1700 as shown in the windows 1175 and 1552 as illustrated in FIG. 17D.

As described above, the display apparatus according to the present invention may control not to display the set reference area.

Hereinafter, a description will be given of an embodiment of displaying the above-described reference area and an embodiment of not displaying the reference area.

18A is a flowchart illustrating a control method of a display apparatus according to an exemplary embodiment.

The display device may display a window for executing an application on the screen (S1801). The display device may receive a gesture for entering the display change control mode for changing the display of the window from the outside, and thereby enter the display change control mode (S1803). If a gesture for entering the display change control mode is not received (S1803-N), the display device may maintain display of the window (S1801).

The display apparatus may set a plurality of reference areas on the screen (S1830). For example, the display device may set a reference area for the remaining areas except for the window whose display is to be changed. Alternatively, the display device may set a reference area over the entire screen.

The display device may receive a display change gesture (S1840). Here, the display change gesture may be to designate a part of the screen.

The display device may change and display the display of the window based on the input display change gesture (S1850).

18B is a flowchart illustrating a control method of a display apparatus according to another exemplary embodiment.

The display device may display a window for executing an application on the screen (S1801). The display device may receive a gesture for entering the display change control mode for changing the display of the window from the outside, and thereby enter the display change control mode (S1803). If a gesture for entering the display change control mode is not received (S1803-N), the display device may maintain display of the window (S1801).

The display apparatus may set a plurality of reference areas on the screen (S1830).

The display device may determine whether to display the set reference area (S1835). Here, whether to display the reference area may be set by the user or by the manufacturer.

If it is determined to display the reference area (S1835-Y), the display device displays the reference area. The user may select at least one of the displayed plurality of reference areas (S1840a). The display apparatus changes the display of the window corresponding to the selected reference region (S1850a).

On the other hand, if it is determined not to display the reference area (S1835-N), the display device may receive a display change gesture from the user (S1840b). Here, the display change gesture may be a gesture for designating a part of an area of the screen.

The display device may compare the display change gesture and the non-displayed reference area with each other (S1845), and change the window display based on the comparison result (S1850b).

19 is a flowchart illustrating a control method of a display apparatus according to another exemplary embodiment. The control method of FIG. 19 will be described with reference to the conceptual diagrams of FIGS. 20A to 20C.

The display device may display a first window for executing the first application and a second window for executing the second application on the screen (S1901). For example, the display device may display the first windows 2011 and 2012 and the second windows 2021 and 2022 on the screen 2000 as shown in FIG. 20A.

The display apparatus may receive a gesture for entering the display change control mode for changing the display of the window from the outside, thereby entering the display change control mode (S1903). If a gesture for entering the display change control mode is not received (S1903-N), the display device may maintain display of the window (S1901).

When a gesture for entering the display change control mode is input (S1903-Y), the display device displays a plurality of reference areas (S1905). For example, as illustrated in FIG. 20B, the display device may display at least one reference line 2041, 2042, 2043, and a plurality of reference regions 2051, 2052, 2053, 2054, and 2055 partitioned thereby.

In operation S1907, the display apparatus may receive a window position change gesture for replacing positions of the first window and the second window. For example, the window position change gesture may be a drag gesture 2060 input from the first window 2011, 2012 to the reference region 2052 corresponding to the second window 2021, 2022.

When the window position change gesture is input, the display device replaces and displays positions of the first window and the second window (S1909).

The display apparatus controls to display the second windows 2071 and 2082 at the positions where the first windows 2011 and 2012 were displayed, and the first windows 2061 and 2062 at the positions where the second windows 2021 and 2022 were displayed. Control to display.

Accordingly, the user can easily change the positions between the windows.

It will be appreciated that embodiments of the present invention may be implemented in the form of hardware, software or a combination of hardware and software. Any such software may be, for example, volatile or nonvolatile storage devices such as storage devices such as ROM, whether or not erasable or rewritable, or memories such as, for example, RAM, memory chips, devices or integrated circuits. Or, for example, CD or DVD, magnetic disk or magnetic tape and the like can be stored in a storage medium that is optically or magnetically recordable and simultaneously readable by a machine (eg computer). The graphic screen updating method of the present invention may be implemented by a computer or a portable terminal including a control unit and a memory, wherein the memory is a machine suitable for storing a program or programs including instructions for implementing embodiments of the present invention. It will be appreciated that this is an example of a readable storage medium. Accordingly, the present invention includes a program comprising code for implementing the apparatus or method described in any claim herein and a storage medium readable by a machine (such as a computer) storing such a program. In addition, such a program may be transferred electronically through any medium, such as a communication signal transmitted over a wired or wireless connection, and the present invention includes equivalents thereof as appropriate.

In addition, the device may receive and store the program from a program providing device connected by wire or wirelessly. The program providing apparatus includes a memory for storing a program including instructions for causing the graphic processing apparatus to perform a preset content protection method, information required for the content protection method, and the like, and wired or wireless communication with the graphic processing apparatus. A communication unit for performing, and a control unit for automatically transmitting the program or the corresponding program to the request or the graphics processing device.

Claims (50)

In the control method of the display device for displaying an application execution window on the screen,
Displaying a window in which the application is executed;
Entering a display change control mode for changing the display of the window;
Setting a plurality of reference areas on the screen and displaying the set plurality of reference areas; And
And controlling to display at least one of a position and a size of the window corresponding to the selected reference area when at least one of the plurality of reference areas is selected.
The method of claim 1,
The displaying of the window may include displaying a title bar including an application execution screen on which the application is executed and at least one control key for controlling the window,
The step of entering the display change control mode for changing the display of the window may include entering the display change control mode when a gesture of long-pressing the title bar is input. Control method.
The method of claim 1,
The displaying of the window may further include displaying an action bar including various action items that provide a shortcut menu or support a tab.
The step of entering the display change control mode for changing the display of the window may include entering the display change control mode when a gesture of long-pressing the action bar is input. Control method.
The method of claim 1,
Setting a plurality of reference areas on the screen and displaying the set plurality of reference areas,
And a plurality of preset reference areas are set and displayed in the remaining areas except for the area where the window is displayed.
The method of claim 4, wherein
Setting a plurality of reference areas on the screen and displaying the set plurality of reference areas,
And setting at least one reference line to distinguish the plurality of reference areas.
The method of claim 5, wherein
Setting a plurality of reference areas on the screen and displaying the set plurality of reference areas,
Displaying the window in a first brightness or first color;
Displaying the remaining areas except the area where the window is displayed in a second brightness or second color; And
And displaying the at least one reference line at a third brightness or a third color.
delete delete delete delete delete delete delete The method of claim 1,
The controlling of changing and displaying at least one of the position and the size of the window corresponding to the selected reference area may include:
And controlling the size of the window to be displayed in correspondence with the selected reference area.
The method of claim 1,
The controlling of changing and displaying at least one of the position and the size of the window corresponding to the selected reference area may include:
Receiving a drag gesture from the window to the selected reference area; And
And changing the position of the window to display the position of the selected reference area.
delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete In the control method of the display device for displaying an application execution window on the screen,
Displaying a window in which the application is executed;
Entering a display change control mode for changing the display of the window;
Setting a plurality of reference areas on the screen;
Detecting that a specific area is designated on the screen; And
Comparing the specified specific area with the plurality of reference areas, and controlling to display at least one of a position and a size of the window based on the comparison result.
42. The method of claim 41 wherein
Comparing the specified specific area and the plurality of reference areas, and controlling to display by changing at least one of the position and size of the window based on the comparison result,
Detecting a reference region overlapping the specified specific region among the plurality of reference regions; And
And controlling to display at least one of a position and a size of the window based on the overlapping reference region.
A touch screen for displaying a window on which an application is executed on the screen and receiving a gesture for entering a display change control mode for changing the display of the window; And
Upon receiving the gesture, the display enters the display change control mode, sets a plurality of reference areas on the screen, detects that a specific area is designated on the screen, and detects the specified specific area and the plurality of reference areas. And a controller configured to compare and control at least one of the position and the size of the window to be displayed based on the comparison result.
The method of claim 43,
The control unit detects a reference area overlapping with the specified specific area among the plurality of reference areas, and controls to display at least one of the position and size of the window based on the overlapping reference area. Display device.
In the control method of a display device including a touch screen,
Displaying a window in which the application is executed;
Entering a control mode to change the display of the window;
Dividing and setting an area of the touch screen into a plurality of reference areas;
Receiving a display change gesture for changing the window display on the touch screen; And
And changing the display of the window based on the input display change gesture and the divided plurality of regions.
The method of claim 45,
After dividing and setting the area of the touch screen into a plurality of reference areas,
And determining whether to display the plurality of set reference areas.
A touch screen displaying a window on which an application is executed; And
A display change gesture for entering a control mode for changing the display of the window, dividing and setting the area of the touch screen into a plurality of reference areas, and changing the window display on the touch screen is performed on the touch screen. And a controller configured to control to change the display of the window based on the input display change gesture and the divided plurality of regions when input.
The method of claim 47,
And the control unit determines whether to display the plurality of set reference areas.
In the control method of the display device for displaying an application execution window on the screen,
Displaying a first window in which the first application is executed and a second window in which the second application is executed;
Entering a display change control mode for changing the display of the first window;
Setting a plurality of reference areas on the screen and displaying the set plurality of reference areas;
Receiving a drag gesture from the first window to a reference area corresponding to the second window; And
And swapping and displaying the position of the first window and the position of the second window in response to the drag gesture.
A touch screen displaying a first window on which a first application is executed and a second window on which a second application is executed, and receiving a gesture for entering a display change control mode for changing a display of the window; And
When the gesture is input, the display enters the display change control mode, sets a plurality of reference areas on the screen, controls to display the set plurality of reference areas, and corresponds to the second window from the first window. And a controller configured to control to display the position of the first window and the position of the second window in response to a drag gesture to a reference area.

Images