KR102360249B1 - Display apparatus and method for controlling thereof - Google Patents

Abstract

Disclosed is a method of controlling a display device including a touch screen. The control method according to the present invention includes a process of displaying a plurality of windows each executing an application so as not to overlap each other on the touch screen, and a center button disposed at the intersection of a plurality of boundary lines dividing the plurality of windows a process of displaying on the touch screen, receiving a window size change command to change the size of at least one of the plurality of windows, and at least one of the plurality of windows in response to the window size change command It includes a process of displaying by changing the size of , and a process of enlarging and displaying the size of the remaining windows while controlling not to display some of the plurality of windows.

Description

Display device and control method {DISPLAY APPARATUS AND METHOD FOR CONTROLLING THEREOF}

The present invention relates to a display apparatus and a control method thereof, and more particularly, to a display apparatus and a control method for controlling the display of a window in which an application is executed.

A desktop computer has at least one display device (eg, a monitor). A mobile device using a touch screen (eg, a mobile phone, a smart phone, or a tablet PC) has one display device.

A user of a desktop computer may divide the screen of the display device according to a work environment (eg, horizontally or vertically by a method of working with a plurality of windows open) and use it. When a web browser is running, it is possible to move up or down a web page by using a page up button or a page down button on the keyboard. When using a mouse instead of a keyboard, you can move up or down a web page by selecting a scroll bar on the side of the web page with the mouse cursor. You can also navigate to the top part of a web page by selecting the top button, indicated by text or an icon at the bottom of the web page.

Compared with a desktop computer, a mobile device has a small size of a screen to be displayed and has limitations in input. It is difficult to use a mobile device with a split screen.

In addition, various applications, such as basic applications produced by a manufacturer of the device and installed in the device, and additional applications downloaded through an application sales site on the Internet, may be executed on the mobile device. The additional applications may be developed by general users and registered on the sales site. Accordingly, anyone can freely sell the applications developed by him/her to the user of the mobile device through the application selling site. Accordingly, tens of thousands to hundreds of thousands of applications are currently provided to mobile devices for free or for a fee, depending on the product.

As described above, various applications that stimulate consumer curiosity and satisfy consumer needs are provided to mobile devices, but since the mobile devices are manufactured in a portable size, the size of the display and the user interface (UI) There are limitations. Accordingly, it is inconvenient for users to execute a plurality of applications on the mobile device.

Accordingly, development of a technology for displaying a plurality of windows on one display is requested. In addition, while easily executing a plurality of windows, the development of a technology capable of facilitating arranging windows after execution is required.

The present invention has been devised in response to the above-described technical development request, and the present invention provides a display device and a control method capable of adjusting the arrangement of a plurality of windows after execution while executing a plurality of windows on one display.

In order to achieve the above, in the method for controlling a display device including a touch screen according to an embodiment of the present invention, a process of displaying a plurality of windows each executing an application on the touch screen so as not to overlap each other and displaying a center button disposed at the intersection of a plurality of boundary lines dividing the plurality of windows; receiving a window size change command to change the size of at least one of the plurality of windows; and displaying by changing the size of at least one of the plurality of windows in response to a size change command, and enlarging and displaying the sizes of the remaining windows while controlling not to display some of the plurality of windows. .

On the other hand, a display device according to another aspect of the present invention displays a plurality of windows each executing an application so as not to overlap each other, and displays a center button disposed at the intersection of a plurality of boundary lines dividing the plurality of windows When a touch screen and a window size change command to change the size of at least one of the plurality of windows are input, control to change and display the size of at least one of the plurality of windows in response to the window size change command, and a controller configured to control display of some of the plurality of windows while enlarging the size of the remaining windows to be displayed.

On the other hand, in the method for controlling the display of the touch screen according to another aspect of the present invention, the process of dividing the touch screen into a plurality of windows, and disposing a center button at the intersection of a plurality of boundary lines dividing the divided plurality of windows and displaying, changing the size of at least one of the plurality of windows in response to movement of the center button and displaying the changed size.

According to various embodiments of the present disclosure, a display apparatus and a method for controlling the same may be provided which can control the arrangement of a plurality of windows after execution while executing a plurality of windows on one display. Accordingly, the user may simultaneously use a plurality of applications displayed on a plurality of windows. In addition, the user can easily manipulate the arrangement state of the plurality of applications, and thus user convenience can be maximized. In addition, the user can easily switch between the full-screen mode and the split mode.

1 is a schematic block diagram illustrating an apparatus according to an embodiment of the present invention.
2A to 2K are conceptual diagrams for explaining a window execution method according to an embodiment of the present invention.
3A to 3I are conceptual diagrams of an activity stack corresponding to various embodiments of the present disclosure;
4 is a flowchart illustrating a method of controlling a display apparatus according to an embodiment of the present invention.
5A to 5G are conceptual diagrams for explaining a window size change according to another embodiment of the present invention.
6 is a flowchart illustrating a method of changing a window size according to an embodiment of the present invention.
7A to 7E are conceptual views of a display device according to an embodiment of the present invention.
8 is a flowchart illustrating a method of controlling a display apparatus according to an embodiment of the present invention.
9A to 9D are conceptual views of a display device according to another embodiment of the present invention.
10A to 10C are conceptual views of a display device displaying a center button according to various embodiments of the present disclosure.
11 is a flowchart illustrating a method of controlling a display apparatus according to an embodiment of the present invention.
12A to 12D are conceptual diagrams illustrating a method of executing a full screen mode according to another embodiment of the present invention.
13 is a flowchart illustrating a method of controlling a display apparatus according to an embodiment of the present invention.
14A and 14B are conceptual views of a display device for explaining an embodiment of re-creating and displaying a center button.
15 is a flowchart illustrating a method of controlling a display apparatus according to an embodiment of the present invention.

Hereinafter, exemplary embodiments according to the present invention will be described in detail with reference to the contents described in the accompanying drawings. However, the present invention is not limited or limited by the exemplary embodiments. The same reference numerals provided in the respective drawings indicate members that perform substantially the same functions.

1 is a schematic block diagram illustrating an apparatus according to an embodiment of the present invention.

Referring to FIG. 1 , the display device 100 may be connected to an external device (not shown) using a mobile communication module 120 , a sub communication module 130 , and a connector 165 . The external device includes another device (not shown), a mobile phone (not shown), a smart phone (not shown), a tablet PC (not shown), and a server (not shown).

Referring to FIG. 1 , the display apparatus 100 includes a touch screen 190 and a touch screen controller 195 . In addition, the display device 100 includes a control unit 110 , a mobile communication module 120 , a sub communication module 130 , a multimedia module 140 , a camera module 150 , a GPS module 155 , an input/output module ( 160 ), a sensor module 170 , a storage unit 175 , and a power supply unit 180 . The sub communication module 130 includes at least one of a wireless LAN module 131 and a short-range communication module 132, and the multimedia module 140 includes a broadcast communication module 141, an audio reproduction module 142, and a video reproduction module. (143); The camera module 150 includes at least one of a first camera 151 and a second camera 152 , and the input/output module 160 includes a button 161 , a microphone 162 , a speaker 163 , and vibration. at least one of a motor 164 , a connector 165 , and a keypad 166 .

The control unit 110 stores a signal or data input from the outside of the CPU 111 , a ROM 112 in which a control program for controlling the display device 100 is stored, and the display device 100 , or 100) may include a RAM (RAM) 113 used as a storage area for the work performed. The CPU 111 may include a single core, a dual core, a triple core, or a quad core. The CPU 111 , the ROM 112 , and the RAM 113 may be interconnected through an internal bus.

The control unit 110 includes a mobile communication module 120 , a sub communication module 130 , a multimedia module 140 , a camera module 150 , a GPS module 155 , an input/output module 160 , and a sensor module 170 ). , the storage unit 175 , the power supply unit 180 , the first touch screen 190a , the second touch screen 190b , and the touch screen controller 195 can be controlled.

The mobile communication module 120 allows the display apparatus 100 to be connected to an external device through mobile communication using at least one-one or a plurality of antennas (not shown) under the control of the controller 110 . The mobile communication module 120 is a mobile phone (not shown), a smart phone (not shown), a tablet PC, or another device (not shown) having a phone number input to the display device 100 and voice calls and video calls , transmits/receives wireless signals for text messages (SMS) or multimedia messages (MMS).

The sub communication module 130 may include at least one of a wireless LAN module 131 and a short-range communication module 132 . For example, it may include only the wireless LAN module 131 , only the short-range communication module 132 , or both the wireless LAN module 131 and the short-range communication module 132 .

The wireless LAN module 131 may be connected to the Internet at a place where a wireless access point (AP) (not shown) is installed under the control of the controller 110 . The wireless LAN module 131 supports the wireless LAN standard (IEEE802.11x) of the American Institute of Electrical and Electronics Engineers (IEEE). The short-range communication module 132 may perform wireless short-range communication between the display apparatus 100 and an image forming apparatus (not shown) under the control of the controller 110 . The short-distance communication method may include a Bluetooth (bluetooth) method, an infrared data association (IrDA) method, a Zig-bee method, and the like.

The display apparatus 100 may include at least one of a mobile communication module 120 , a wireless LAN module 131 , and a short-range communication module 132 according to performance. For example, the display apparatus 100 may include a combination of the mobile communication module 120 , the wireless LAN module 131 , and the short-range communication module 132 according to performance.

The multimedia module 140 may include a broadcast communication module 141 , an audio playback module 142 , or a video playback module 143 . The broadcasting communication module 141 includes a broadcasting signal (eg, a TV broadcasting signal, a radio broadcasting signal, or a data broadcasting signal) transmitted from a broadcasting station through a broadcasting communication antenna (not shown) under the control of the controller 110 and the broadcasting unit information (eg, EPG (Electronic Program Guide) or ESG (Electronic Service Guide)) may be received. The audio reproduction module 142 may reproduce a stored or received digital audio file (eg, a file having a file extension of mp3, wma, ogg, or wav) under the control of the controller 110 . The video playback module 143 may play a stored or received digital video file (eg, a file having a file extension of mpeg, mpg, mp4, avi, mov, or mkv) under the control of the controller 110 . The video reproduction module 143 may reproduce a digital audio file.

The multimedia module 140 may include an audio playback module 142 and a video playback module 143 excluding the broadcast communication module 141 . Also, the audio reproduction module 142 or the video reproduction module 143 of the multimedia module 140 may be included in the controller 100 .

The camera module 150 may include at least one of a first camera 151 and a second camera 152 for capturing still images or moving images under the control of the controller 110 . Also, the first camera 151 or the second camera 152 may include an auxiliary light source (eg, a flash (not shown)) that provides an amount of light required for photographing. The first camera 151 may be disposed on the front side of the display device 100 , and the second camera 152 may be disposed on the back side of the display device 100 . In a different manner, the first camera 151 and the second camera 152 are adjacent (eg, the first camera 151 and the second camera 152 are greater than 1 cm and less than 8 cm apart). arranged so that a three-dimensional still image or a three-dimensional moving image can be taken.

The GPS module 155 receives radio waves from a plurality of GPS satellites (not shown) on Earth's orbit, and uses a time of arrival from the GPS satellites (not shown) to the display device 100 . Thus, the position of the display apparatus 100 may be calculated.

The input/output module 160 may include at least one of a plurality of buttons 161 , a microphone 162 , a speaker 163 , a vibration motor 164 , a connector 165 , and a keypad 166 .

The button 161 may be formed on the front, side, or rear of the housing of the display device 100, and may include a power/lock button (not shown), a volume button (not shown), a menu button, a home button, and a return button. It may include at least one of a back button and a search button 161 .

The microphone 162 receives a voice or sound according to the control of the controller 110 and generates an electrical signal.

The speaker 163 includes various signals (eg, wireless signals, broadcast signals, A sound corresponding to a digital audio file, a digital video file, or a picture taking, etc.) may be output to the outside of the display apparatus 100 . The speaker 163 may output a sound corresponding to a function performed by the display apparatus 100 (eg, a button operation sound corresponding to a phone call, or a ring-back sound). One or a plurality of speakers 163 may be formed at an appropriate location or locations of the housing of the display device 100 .

The vibration motor 164 may convert an electrical signal into mechanical vibration under the control of the controller 110 . For example, in the display device 100 in the vibration mode, when a voice call is received from another device (not shown), the vibration motor 164 operates. One or more may be formed in the housing of the display device 100 . The vibration motor 164 may operate in response to a user's touch operation touching the touch screen 190 and a continuous movement of the touch on the touch screen 190 .

The connector 165 may be used as an interface for connecting the display device 100 and an external device (not shown) or a power source (not shown). Data stored in the storage unit 175 of the display apparatus 100 is transmitted to an external device (not shown) or an external device (not shown) through a wired cable connected to the connector 165 under the control of the controller 110 . ) can receive data from Power may be input from a power source (not shown) through a wired cable connected to the connector 165 or a battery (not shown) may be charged.

The keypad 166 may receive a key input from a user to control the display apparatus 100 . The keypad 166 includes a physical keypad (not shown) formed on the display device 100 or a virtual keypad (not shown) displayed on the touch screen 190 . A physical keypad (not shown) formed on the display apparatus 100 may be excluded depending on the performance or structure of the display apparatus 100 .

The sensor module 170 includes at least one sensor that detects the state of the display apparatus 100 . For example, the sensor module 170 is a proximity sensor that detects whether the user approaches the display device 100, an illuminance sensor (not shown) that detects the amount of light around the display device 100, or a display It may include a motion sensor (not shown) that detects an operation of the device 100 (eg, rotation of the display device 100 , acceleration or vibration applied to the display device 100 ). At least one sensor may detect a state, generate a signal corresponding to the detection, and transmit it to the controller 110 . A sensor of the sensor module 170 may be added or deleted according to the performance of the display apparatus 100 .

The storage unit 175 includes a mobile communication module 120 , a sub communication module 130 , a multimedia module 140 , a camera module 150 , a GPS module 155 , and an input/output module according to the control of the controller 110 . ( 160 ), the sensor module 170 , and a signal or data input/output corresponding to the operation of the touch screen 190 may be stored. The storage 175 may store control programs and applications for controlling the display apparatus 100 or the controller 110 .

The term storage unit refers to the storage unit 175, the ROM 112 in the control unit 110, the RAM 113, or a memory card (not shown) mounted in the display device 100 (eg, SD card, memory stick). includes The storage unit may include a non-volatile memory, a volatile memory, a hard disk drive (HDD), or a solid state drive (SSD).

The power supply unit 180 may supply power to one or a plurality of batteries (not shown) disposed in the housing of the display apparatus 100 under the control of the control unit 110 . One or a plurality of batteries (not shown) supplies power to the display apparatus 100 . Also, the power supply unit 180 may supply power input from an external power source (not shown) to the display apparatus 100 through a wired cable connected to the connector 165 .

The touch screen 190 may provide the user with a user interface corresponding to various services (eg, call, data transmission, broadcasting, photo taking). The touch screen 190 may transmit an analog signal corresponding to at least one touch input to the user interface to the touch screen controller 195 . The touch screen 190 may receive at least one touch input through a user's body (eg, a finger including a thumb) or a touchable input means (eg, a stylus pen). Also, the touch screen 190 may receive a continuous movement of one touch among at least one touch. The touch screen 190 may transmit an analog signal corresponding to the continuous movement of the input touch to the touch screen controller 195 .

In the present invention, the touch is not limited to the contact between the touch screen 190 and the user's body or touchable input means, and non-contact (eg, the touch screen 190 and the user's body or touchable input means has a detectable distance 1 mm or less). The detectable interval on the touch screen 190 may be changed according to the performance or structure of the display apparatus 100 .

The touch screen 190 may be implemented by, for example, a resistive method, a capacitive method, an infrared method, or an acoustic wave method.

The touch screen controller 195 converts an analog signal received from the touch screen 190 into a digital signal (eg, X and Y coordinates) and transmits it to the controller 110 . The controller 110 may control the touch screen 190 using a digital signal received from the touch screen controller 195 . For example, the controller 110 may select a shortcut icon (not shown) displayed on the touch screen 190 or execute a shortcut icon (not shown) in response to the touch. Also, the touch screen controller 195 may be included in the controller 110 .

2A to 2K are conceptual diagrams for explaining a window execution method according to an embodiment of the present invention. Meanwhile, those skilled in the art will readily understand that the display device 200 may be implemented in various forms, such as a general TV, Internet TV, and medical data display device, as well as the mobile device described above with reference to FIG. 1 . That is, the display device is not limited as long as it has means for displaying the rendered image.

As shown in FIG. 2A , the display apparatus 200 may set a plurality of window display spaces 201 to 204 on the touch screen. In more detail, the controller (not shown) may set the first area 201 , the second area 202 , the third area 203 , and the fourth area 204 . Although FIG. 2A shows an example of setting a window in four areas on the touch screen, this is only an example, and the present invention may set at least two windows on the touch screen. In addition, the controller (not shown) controls the first boundary line 211 as the boundary line between the first area 201 and the second area 202 , and the second boundary line as the boundary line between the third area 203 and the fourth area 204 . 212, a third boundary line 213 that is a boundary between the first region 201 and the third region 203, and a fourth boundary line 214 that is a boundary between the second region 202 and the fourth region 204 can be set. Here, the first boundary line 211 and the second boundary line 212 may form one line segment, and the third boundary line 213 and the fourth boundary line 214 may form one line segment. The controller (not shown) sets the first region 201 to the fourth region 204 not to overlap each other. For example, as shown in FIG. 2A , the controller (not shown) sets the first region 201 to the upper left side, sets the second region 202 to the upper right side, and sets the third region 203 to the upper left side. is set to the lower left side, and the fourth area 204 is set to the lower right side. The controller (not shown) sets first and second boundary lines 211 and 212 to divide the screen into left and right, and sets third and fourth boundary lines 213 and 214 to divide the screen vertically.

Meanwhile, the controller (not shown) may display the center button 220 at a portion where the first and second boundary lines 211 and 212 and the third and fourth boundary lines 213 and 214 intersect. 2A to 2L, the center button 220 has a rectangular shape, but this is only an example, and the present invention may include a polygonal shape, a circular shape, or an oval shape as well as a rectangular shape. In addition, the center button may be a function key that provides a function of changing the size of the application display space or enters a window position change mode.

The controller (not shown) may control to display one window for executing an application in each of the regions 201 to 204 . Alternatively, the controller (not shown) may execute at least one application in each or all of the regions 201 to 204 . For example, the controller (not shown) controls to display a window in each of the regions 201 to 204 as shown in FIGS. 2B to 2K .

Here, the window may be an area including an execution screen of a specific application and a title bar and a control area for the executed application. Objects related to the application may be displayed on the execution screen of the application. The object may be formed in various shapes such as text, figure, icon, button, checkbox, photo, video, web, map, and the like. When the user touches the object, a function or event predetermined to the object may be performed in the corresponding application. The object may be called a view depending on the operating system. The title bar may include at least one control key for controlling the display of the window. For example, the control key may be a window display minimize button, a window display maximize button, and a window end button.

On the other hand, each application is a program implemented independently of each other by the display device 200 manufacturer or application developer. Accordingly, in order to execute one application, it is not required that another application is being executed in advance. Also, even when one application is terminated, the other application may continue to be executed.

In that the applications are programs implemented independently of each other, a complex function application (or dual application) is different. However, this multi-function application is a single application newly produced to have various functions, and is different from existing applications. Accordingly, the multi-function application cannot provide various functions like the existing applications, and provides limited functions, and the user is burdened with separately purchasing such a new multi-function application.

Referring to FIG. 2B , a controller (not shown) controls to display a window 230 for executing a launcher application on the first area 201 . The launcher application displays application icons 231 to 238 that can be executed as shown in FIG. 2B . When an application execution command for touching one of the application icons 231 to 238 is input, the launcher application displays the application corresponding to the touched icon in one of the first area 201 to the fourth area 204 that is the window display space. indicate

Meanwhile, FIG. 3A is a conceptual diagram of an activity stack managed by a display device. The controller (not shown) creates and manages the launcher application stack 301 on the activity stack in response to the execution of the launcher application.

In FIG. 2C , the user 1 may touch an icon corresponding to the B application. When an icon corresponding to the B application is touched, the controller (not shown) may control to display the second window 240 for executing the B application on the second area as shown in FIG. 2D . The controller (not shown) may determine a window display space in which windows are displayed in a preset order. For example, the controller (not shown) may control the new windows to be displayed in the clockwise order of the second area, the third area, and the fourth area. Meanwhile, the above-described order is a simple example, and the controller (not shown) may control the new windows to be displayed in a counterclockwise order. The order in which new windows are displayed in the window display space can be changed.

Meanwhile, FIG. 3B is a conceptual diagram of an activity stack corresponding to FIG. 2D . The controller (not shown) generates the B application stack 302 on the activity stack in response to the execution of the B application. Meanwhile, the controller (not shown) arranges the stack 302 of the most recently executed application B on the stack 301 of the launcher application. This may mean that the activity stack rank of application B is higher than the activity stack rank of the launcher application.

In FIG. 2E , the user 1 may touch the icon 233 corresponding to the C application. Meanwhile, FIG. 3C is a conceptual diagram of an activity stack corresponding to FIG. 2E . As shown in FIG. 2E , since the user inputs an application execution command to the launcher application, it can be confirmed that the activity stack rank of the launcher application is higher than the activity stack rank of the B application.

When the icon 233 corresponding to the C application is touched, the controller (not shown) controls the third window 250 for executing the C application to be displayed on the fourth area as shown in FIG. 2F .

Meanwhile, FIG. 3D is a conceptual diagram of an activity stack corresponding to FIG. 2F . The controller (not shown) generates the C application stack 303 on the activity stack in response to the execution of the C application. Meanwhile, the controller (not shown) arranges the stack 303 of the most recently executed C application on the stack 301 of the launcher application. This may mean that the activity stack rank of the C application is higher than the activity stack rank of the launcher application.

In FIG. 2G , the user 1 may touch the icon 234 corresponding to the D application. Meanwhile, FIG. 3E is a conceptual diagram of an activity stack corresponding to FIG. 2G . As shown in FIG. 2G , since the user inputs an application execution command to the launcher application, it can be confirmed that the activity stack rank of the launcher application is higher than the activity stack rank of the C application.

When the icon 234 corresponding to the D application is touched, the controller (not shown) controls the fourth window 260 for executing the D application to be displayed on the third area as shown in FIG. 2H .

Meanwhile, FIG. 3F is a conceptual diagram of an activity stack corresponding to FIG. 2H . The controller (not shown) generates the D application stack 304 on the activity stack in response to the execution of the D application. Meanwhile, the controller (not shown) arranges the stack 304 of the most recently executed D application on the stack 301 of the launcher application. This may mean that the activity stack rank of the D application is higher than the activity stack rank of the launcher application.

Meanwhile, the user 1 may operate the application B as shown in FIG. 2I . 3G is a conceptual diagram of an activity stack corresponding to FIG. 2I. The controller (not shown) arranges the stack 302 of the most recently executed application B in response to a user input to the application B at the top.

In FIG. 2J , the user 1 may touch the icon 235 corresponding to the E application. Meanwhile, FIG. 3H is a conceptual diagram of an activity stack corresponding to FIG. 2K . As shown in FIG. 2J , since the user inputs an application execution command to the launcher application, it can be confirmed that the activity stack rank of the launcher application is higher than the activity stack rank of the D application.

When the icon 235 corresponding to the E application is touched, the controller (not shown) controls the fifth window 270 for executing the D application to be displayed on the fourth area as shown in FIG. 2K . When there is no empty window display space, the controller (not shown) may refer to the activity stack of FIG. 3H . The controller (not shown) may identify an application having the lowest activity stack rank among the activity stacks. For example, in FIG. 3H , the controller (not shown) may determine that the C application has the lowest activity stack rank. The controller (not shown) controls to display the fifth window 270 for executing the E application on the fourth area 250 in which the C application having the lowest activity stack rank is displayed.

Meanwhile, FIG. 3I is a conceptual diagram of an activity stack corresponding to FIG. 2K . The controller (not shown) generates the E application stack 305 on the activity stack in response to the execution of the E application. Meanwhile, the controller (not shown) arranges the stack 305 of the most recently executed application E on the stack 301 of the launcher application. This may mean that the activity stack rank of the E application is higher than the activity stack rank of the launcher application.

4 is a flowchart illustrating a method of controlling a display apparatus according to an embodiment of the present invention.

The display apparatus may set, for example, a plurality of window display spaces as shown in FIG. 2A ( S401 ). The display apparatus executes a launcher application capable of executing a new application in one of the plurality of window display spaces (S403). More specifically, the display device displays a window for executing the launcher application in one of a plurality of window display spaces.

The display device may receive a new application execution command on a window executing the launcher application (S405). For example, the display device may receive a new application execution command for touching an icon corresponding to the application as shown in FIG. 2C .

The display device may display a window for executing a new application in one of the remaining window display spaces except for the application display space in which the launcher application is executed ( S407 ).

5A to 5G are conceptual diagrams for explaining a window size change according to another embodiment of the present invention.

5A is a conceptual diagram of a display device according to an embodiment of the present invention. A touch screen is divided into four areas, and different windows are displayed in each area. The controller (not shown) of the display apparatus 500 may set a layout that divides the screen into four equal parts. In more detail, the controller (not shown) may set the first area 501 , the second area 502 , the third area 503 , and the fourth area 504 . The controller (not shown) controls a first boundary line 511 that is a boundary between the first region 501 and the second region 502 , and a second boundary line 512 that is a boundary between the third region 503 and the fourth region 504 . ), a third boundary line 513 that is a boundary between the first region 501 and the third region 503 and a fourth boundary line 514 that is a boundary between the second region 502 and the fourth region 504 can be set. have.

A controller (not shown) controls to display one by one window for executing an application in each of the areas 501 to 504 . For example, the controller (not shown) displays a first window for executing application A on the first area 501, and displays a second window for executing application B on the second area 502, A third window for executing application C is displayed on the third area 503 , and a fourth window for executing application D is controlled to be displayed on the fourth area 504 .

Also, the controller (not shown) may execute and display at least one application in each or all of the areas 501 to 501 .

Meanwhile, the controller (not shown) displays the center button 510 at the intersection of the first and second boundary lines 511 and 512 and the third and fourth boundary lines 513 and 514 . Although the center button 510 has a rectangular shape in FIGS. 5A to 5G , this is only an example, and the present invention may include a polygonal shape, a circular shape, or an oval shape as well as a rectangular shape.

As shown in FIG. 5B , the user 1 performs a first gesture from the center button 510 to the first end point 522 (eg, a left drag gesture 521 or a point where the second and fourth regions are located). A gesture 521) in a direction away from , may be input as a window size change command. The controller (not shown) controls the display by changing the position of the center button 510 to the first end point 522 as shown in FIG. 5C . In addition, the controller (not shown) may control the display by resetting the boundary lines 511 to 514 based on the center button 510 . For example, the control unit (not shown) resets the first boundary line 511 upward from the center button 510 , resets the second boundary line 512 downwardly from the center button 510 , and the center button 510 . ) to reset the third boundary line 513 to the left, and reset the fourth boundary line 514 to the right from the center button 510 . In addition, the controller (not shown) controls to display by changing the sizes of the first to fourth regions 526 to 529 based on the reset boundary lines 511 to 514 . That is, in the embodiment of FIG. 5B , in contrast to FIG. 2C , sizes of all window display areas may be changed together.

5D is a conceptual diagram illustrating a method of changing a window size according to another embodiment of the present invention. As shown in FIG. 5D , the user selects a second gesture from the center button 510 to the second end point 536 (eg, an upward drag gesture 535 or a third region 503 and a fourth region ( A gesture 535) in a direction away from the point where 504 is located may be input as a window size change command. The controller (not shown) controls the display by changing the position of the center button 510 to the second end point 536 as shown in FIG. 5E . In addition, the controller (not shown) may control the display by resetting the boundary lines 511 to 514 based on the center button 510 . The controller (not shown) controls to display by changing the sizes of the first to fourth regions 531 to 534 based on the reset boundary lines 511 to 514 .

5F is a conceptual diagram illustrating a method of changing a window size according to another embodiment of the present invention. As shown in FIG. 5F , the user selects a third gesture from the center button 510 to the third end point 565 (ie, an upper-left drag gesture 564 or a direction away from the fourth region 504 ). Gesture 564) may be input as a window size change command. The controller (not shown) controls the display by changing the position of the center button 510 to the third end point 565 as shown in FIG. 5G . In addition, the controller (not shown) may control the display by resetting the boundary lines 511 to 514 based on the center button 510 . The controller (not shown) controls to display by changing the sizes of the first to fourth regions 541 to 544 based on the reset boundary lines 511 to 514 . Also, when the center button 510 is moved in a direction away from the point where the fourth region 504 is located (eg, a third gesture), the size of the fourth region is enlarged and displayed, and the first region 501 is displayed. ) is reduced in size and displayed. A ratio at which the first area is reduced may be the same as a ratio at which the fourth area is expanded.

6 is a flowchart illustrating a method of changing a window size according to an embodiment of the present invention.

The display apparatus may display a plurality of windows by setting a plurality of window display spaces, such as, for example, the first to fourth regions of FIG. 5A ( S601 ). The display apparatus may set a plurality of window display spaces by, for example, setting at least one boundary line. Here, a center button may be formed at the intersection of at least one boundary line.

When a plurality of window display spaces are set, the display apparatus may receive a window size change command for dragging a center button (S603). After moving the center button to the drag end point, the display device resets the boundary line based on the moved center button (S605). The display apparatus resets and displays the window size based on the reset at least one boundary line (S607).

7A to 7E are conceptual views of a display device according to an embodiment of the present invention.

As shown in FIG. 7A , the display apparatus 700 may display the first windows 701 to the fourth windows 704 by arranging them in the first to fourth areas, respectively. The display device 700 may display the first boundary line 701 to the fourth boundary line 704 , and a center button 710 may be displayed at the intersection of the first boundary line 701 to the fourth boundary line 704 . have. 7A to 7D , the center button 710 has a rectangular shape, but this is only an example, and the present invention may include a polygonal shape, a circular shape, or an oval shape as well as a rectangular shape.

Meanwhile, the user 1 may input a drag gesture 720 to the left starting from the center button 710 . As shown in FIG. 7B , the control unit (not shown) reduces the horizontal length of the first window 701 and the third window 703 while simultaneously reducing the width of the second window 702 and the fourth window 704 . It can be controlled to display by enlarging the horizontal length. The controller (not shown) may control the display by moving the center button 710 to a point where the drag gesture 720 is touched.

Meanwhile, as shown in FIG. 7C , when the drag gesture 720 reaches the boundary line of the touch screen and the center button 710 reaches the boundary line of the touch screen, the controller (not shown) controls the first window 701 and the second 3 It is possible to control not to display the window 703. The controller (not shown) may control the horizontal length of the second window 712 to be further enlarged and displayed on the upper half. The controller (not shown) may control the horizontal length of the fourth window 714 to be further enlarged and displayed on the lower half. In addition, the controller (not shown) may control to display only the fourth boundary line 714 and not display the remaining boundary lines.

7D , the user may end input of the drag gesture. The controller (not shown) may determine that the drag gesture input is terminated based on the release of the touch of the drag gesture. The controller (not shown) may control not to display the center button 710 as shown in FIG. 7E . For example, the controller (not shown) may control not to display the center button 710 after a preset time after the drag gesture input is terminated.

On the other hand, when the position of the center button 710 is the left boundary line or the right boundary line of the touch screen, the control unit (not shown) displays the touch screen by dividing the touch screen up and down, and the position of the center button 710 is the position of the touch screen. In the case of the upper boundary line or the lower boundary line, the touch screen may be controlled to be divided into left and right to be displayed. In more detail, when the center button 710 is moved to the left boundary of the touch screen by a left drag gesture, the control unit displays the touch screen in two vertical divisions, and the center button 710 is displayed by a right drag gesture. When the touch screen is moved to the right boundary of the touch screen, the touch screen is divided and displayed in two parts, and when the center button 710 is moved to the upper boundary of the touch screen by an upward drag gesture, the touch screen is moved left and right It is divided and displayed, and when the center button 710 is moved to the lower boundary of the touch screen by a downward drag gesture, the touch screen is controlled to be divided into left and right to be displayed.

8 is a flowchart illustrating a method of controlling a display apparatus according to an embodiment of the present invention.

The display device may display a plurality of windows on the touch screen (S801). In addition, the display apparatus may display a center button for window size adjustment at a point where boundary lines for dividing a plurality of windows intersect (S803).

The display device may receive a window size change command for dragging the center button (S805). For example, the window size change command may be a drag gesture starting from a center button. The display apparatus may control the display to change the size of the windows based on the input window size change command.

Meanwhile, the display device may determine whether the center button is dragged to the touch screen boundary (S807). When a drag gesture up to the border of the touch screen is input (S807-Yes), the display device may control not to display some windows (S811). In more detail, the display device may increase the size of other windows to display them, and accordingly, control some windows not to be displayed while reducing the size.

On the other hand, if the drag gesture up to the boundary line of the touch screen is not input (S807 - No), the display device may display the center button by moving the center button to the end point of the drag gesture (S809). Meanwhile, the display device may display while moving the center button in response to the touch point of the drag gesture.

The display apparatus may display a boundary line by resetting the boundary line based on the moved center button (S813), and may display the window size by changing the corresponding window size (S815).

9A to 9D are conceptual views of a display device according to another embodiment of the present invention.

As shown in FIG. 9A , the display apparatus 900 may display the first windows 901 to the fourth windows 904 by arranging them in the first to fourth areas, respectively. The display device 900 may display the first boundary line 901 to the fourth boundary line 904 , and a center button 910 may be displayed at the intersection of the first boundary line 901 to the fourth boundary line 904 . have. 9A to 9C, the center button 910 has a rectangular shape, but this is only an example, and the present invention may include a polygonal shape, a circular shape, or an oval shape as well as a rectangular shape.

Meanwhile, the user 1 may input a drag gesture 920 upward and left starting from the center button 910 . As shown in FIG. 9B , the controller (not shown) may control to enlarge and display the horizontal and vertical lengths of the fourth window 904 . When the center button 910 is moved to the edge of the touch screen, the controller (not shown) may display the fourth area 904 in a full screen. The fourth area 904 is a window located farthest from the corner among a plurality of windows displayed on the touch screen 914 . In addition, the remaining areas (first to third areas) except for the fourth area 904 are not displayed. In addition, the controller (not shown) may control the display by moving the center button 910 to a point where the drag gesture 920 is touched.

Meanwhile, as shown in FIG. 9C , when the drag gesture 920 reaches the boundary line of the touch screen and the center button 910 reaches the edge of the touch screen, the controller (not shown) controls the first window 901, the second It is possible to control not to display the second window 902 and the third window 903 . The controller (not shown) may control the horizontal and vertical lengths of the fourth window 904 to be further enlarged and displayed on the entire touch screen. The controller (not shown) may control the boundary lines not to be displayed.

9D , the user may end input of the drag gesture. The controller (not shown) may determine that the drag gesture input is terminated based on the release of the touch of the drag gesture. The controller (not shown) may control the center button 910 not to be displayed, as shown in FIG. 9D . For example, the controller (not shown) may control not to display the center button 910 after a preset time after the drag gesture input is terminated.

10A to 10C are conceptual views of a display device displaying a center button according to various embodiments of the present disclosure.

As shown in FIG. 10A , the display apparatus 1000 may display a center button 1010 in the center of the touch screen. Although the center button 1010 has a rectangular shape in FIGS. 10A to 10C , this is only an example, and the present invention may include a polygonal shape, a circular shape, or an oval shape as well as a rectangular shape. In addition, the controller (not shown) controls to display the first boundary line 1011 , the second boundary line 1012 , the third boundary line 1013 , and the fourth boundary line 1014 connected to the center button 1010 . In particular, the controller (not shown) may determine the location of the center button 1010 on the touch screen. For example, in FIG. 10A , the controller (not shown) may determine that the position of the center button 1010 is located at the center of the touch screen, that is, at a 50:50 horizontal division point. The controller (not shown) may also determine the positions of the first boundary line 1011 and the second boundary line 1012 based on the position of the center button on the touch screen. For example, the control unit (not shown) determines that the first boundary line 1011 and the second boundary line 1012 are 50 of the center button 1010 based on the center button being located at the 50:50 horizontal division point of the touch screen. : It can be controlled to display connected to the horizontal division point of 50.

10B is a conceptual diagram of a display device according to another embodiment of the present invention. As shown in FIG. 10B , the display apparatus 1000 may display the center button 1010 at a horizontal division point of 30:70 of the touch screen. The controller (not shown) may determine the location of the center button 1010 on the touch screen. In addition, the control unit (not shown) determines that the center button 1010 is located at a horizontal division point of 30:70 of the touch screen, so that the first boundary line 1011 and the second boundary line 1012 are the center button 1010. It can be controlled to display connected to the horizontal division point of 30:70.

Meanwhile, when the center button 1010 is disposed on the boundary line of the touch screen as shown in FIG. 10C , the controller (not shown) may control the boundary line not to be displayed.

11 is a flowchart illustrating a method of controlling a display apparatus according to an embodiment of the present invention.

The display device may display a plurality of windows (S1101). The display apparatus may display a plurality of boundary lines dividing the plurality of windows. In addition, the display apparatus may display a center button for controlling window display at a point where a plurality of boundary lines intersect (S1103).

The display device may receive a window size change command for dragging the center button (S1105). The display device may determine the location of the center button on the touch screen. The display device may reset and display the boundary line corresponding to the location of the center button on the touch screen (S1107). For example, the display device may recognize that the center button is located at a dividing point of a specific ratio of the touch screen. The display device may display the boundary line so that the boundary line is connected to the dividing point of the specific ratio of the center button. In addition, the display device may change and display the window size corresponding to the final position of the center button (S1109).

12A to 12D are conceptual diagrams illustrating a method of executing a full screen mode according to another embodiment of the present invention.

As shown in FIGS. 12A and 12C , the display device 1200 selects a center button of any shape among a square-shaped center button ( 1210 in FIG. 12A ) and a circular-shaped center button ( 1210 in FIG. 12C ) of the touch screen. It can be marked so as to be tangent to the boundary line. 12A to 12D, the center button 1210 has a rectangular shape or a circular shape, but this is only an example. have. In addition to these various types, the present invention may include various types of buttons that allow the user to move freely on the touch screen. In addition, the second boundary line 1212 and the fourth boundary line 1214 may be displayed to be connected to the center button 1210 . Accordingly, there may be a problem that the fourth window 1204 is not displayed in full screen.

Accordingly, the controller (not shown) may further receive an additional drag gesture input even when the center button 1210 comes into contact with the boundary line of the touch screen. The controller (not shown) may display only a part of the center button 1210 in response to an additional drag gesture, as shown in FIGS. 12B and 12D . In addition, when the center of the center button 1210 is not displayed, the controller (not shown) may control not to display the boundary line. Accordingly, the fourth window 1204 may be displayed in full screen.

13 is a flowchart illustrating a method of controlling a display apparatus according to an embodiment of the present invention.

The display device may display a plurality of windows (S1301). The display apparatus may display a plurality of boundary lines dividing the plurality of windows. In addition, the display device may display a center button for controlling window display at a point where a plurality of boundary lines intersect (S1303).

The display device may receive a window size change command for dragging the center button (S1305). The display device may display a center button at a point where the drag gesture is touched.

The display device may determine whether the center button reaches the touch screen boundary line (S1307). When the center button is positioned so as to be in contact with the boundary line of the touch screen (S1307-Yes), the boundary line may not be displayed while displaying only a part of the center button (S1309). On the other hand, when the center button does not come into contact with the boundary line of the touch screen (S1307 - No), the display device may change and display the window size corresponding to the final position of the center button (S1311). Meanwhile, in the case of S1309, the display device may display a specific window in full screen.

14A and 14B are conceptual views of a display device for explaining an embodiment of re-creating and displaying a center button.

In FIG. 14A , the display device may display a specific window 1404 in full screen. In the case of the full screen mode, the display device may control not to display the center button and the boundary line. Meanwhile, the user 1 may want to display the center button again, and accordingly, may input a center button creation command. In FIG. 14A , the center button creation command may be double edge flicks 1401 and 1402 simultaneously input from the upper boundary line and the left boundary line of the touch screen. Meanwhile, in FIG. 14A , the double edge flick simultaneously input from the upper boundary line and the left boundary line of the touch screen is merely exemplary, and there is no limitation on the boundary line of the touch screen to which the double edge flick is input. In addition, those skilled in the art will be able to change and implement the center button creation command in various ways other than the double edge flick, and the scope of the present invention will not be limited by the characteristics of the center button creation command.

In FIG. 14B , the controller (not shown) may control to display the center button 1410 again based on the center button creation command. 14B , the center button 1410 has a rectangular shape, but this is only an example, and the present invention may include a polygonal shape, a circular shape, or an oval shape as well as a rectangular shape. In addition, the controller (not shown) may control the center button 1410 to be displayed again at the most recent location of the center button 1410 .

15 is a flowchart illustrating a method of controlling a display apparatus according to an embodiment of the present invention.

The display device may display a plurality of windows (S1501). The display apparatus may display a plurality of boundary lines dividing the plurality of windows. In addition, the display apparatus may display a center button for controlling window display at a point where a plurality of boundary lines intersect (S1503).

The display device may receive a window size change command for dragging the center button (S1505). The display device may display a center button at a point where the drag gesture is touched.

Meanwhile, the display apparatus may display a specific window as a full screen in response to a window size change command and control not to display a center button (S1507). The display device determines whether a center button creation command is input (S1509). When the center button creation command is not input (S1509-Yes), the display device may maintain the full screen mode. When a center button creation command is input (S1509 - Yes), the display device may display the center button again at a position before non-display, that is, at a position where the center button is most recently located (S1511).

It will be appreciated that the embodiments of the present invention can be realized in the form of hardware, software, or a combination of hardware and software. Any such software, for example, whether erasable or rewritable, may be stored in a volatile or non-volatile storage device such as a ROM, or a memory such as, for example, RAM, a memory chip, device or integrated circuit. , or an optically or magnetically recordable storage medium such as a CD, DVD, magnetic disk, or magnetic tape, for example, and a machine (eg, computer) readable storage medium. The graphic screen updating method of the present invention may be implemented by a computer or portable terminal including a control unit and a memory, wherein the memory is a machine suitable for storing a program or programs including instructions for implementing embodiments of the present invention. It will be appreciated that this is an example of a readable storage medium. Accordingly, the present invention includes a program including code for implementing the apparatus or method described in any claim of the present specification, and a machine (computer, etc.) readable storage medium storing such a program. Also, such a program may be transmitted electronically through any medium such as a communication signal transmitted through a wired or wireless connection, and the present invention suitably includes the equivalent thereof.

Also, the device may receive and store the program from a program providing device connected by wire or wirelessly. The program providing device includes a program including instructions for the graphic processing device to perform a preset content protection method, a memory for storing information necessary for the content protection method, and wired or wireless communication with the graphic processing device. It may include a communication unit for performing the operation, and a control unit for automatically transmitting the program to the transceiver at the request of the graphic processing device or automatically.

110: control unit 120: mobile communication module
130: sub communication module 140: multimedia module
150: camera module 155: GPS module
160: input/output module 170: sensor module
175: storage 180: power supply
190: touch screen 195: touch screen controller

Claims (10)

In an electronic device,
a touch screen display, and
at least one processor, the at least one processor comprising:
In the split mode, the first screen of the first application and the second screen of the second application are displayed in the first area and the second area, respectively, and a graphical object is displayed on a boundary line between the first screen and the second screen. become,
Receive a first touch input for moving the graphical object toward an edge of the touch screen display on the touch screen display while the first screen, the second screen, and the graphical object are being displayed, and the first touch The input is a single touch gesture,
After removing the second screen and the graphical object from the touch screen display based on the reception of the first touch input, the first screen is displayed in a full screen mode,
While the first screen is being displayed in the full-screen mode, a second touch input directed toward a center of the touch screen display is received from at least two points of the edge of the touch screen display, the second touch input is It is a multi-touch gesture,
Based on the reception of the second touch input, after the second touch input is released, the first screen of the first application, the second screen of the second application, and the graphical object before the first touch input An electronic device, characterized in that it is set to display in the same position as the position that was placed on the .
According to claim 1,
The second touch input includes a flick gesture.
According to claim 1,
the at least one processor is further configured to move the boundary line dividing the first screen and the second screen toward the edge together with the graphical object based on the first touch input in the split mode with an electronic device.
According to claim 1,
The first touch input is received in a first direction, and the second touch input is received in a second direction opposite to the first direction.
According to claim 1,
The edge of the touch screen display is characterized in that parallel to the boundary line between the first screen and the second screen, the electronic device.
A method for controlling an electronic device, comprising:
In the split mode, displaying the first screen of the first application and the second screen of the second application in the first area and the second area, respectively, and a graphical object on the boundary line between the first screen and the second screen is displayed,
receiving a first touch input for moving the graphical object toward an edge of the touch screen display on the touch screen display of the electronic device while the first screen, the second screen, and the graphical object are being displayed; , the first touch input is a single touch gesture,
removing the second screen and the graphical object from the touch screen display based on the reception of the first touch input, and then displaying the first screen in a full screen mode;
receiving a second touch input directed toward a center of the touch screen display from at least two points of the edge of the touch screen display while the first screen is being displayed in the full screen mode; The input is a multi-touch gesture,
Based on the reception of the second touch input, after the second touch input is released, the first screen of the first application, the second screen of the second application, and the graphical object before the first touch input A method of controlling an electronic device, comprising displaying the display at the same position as the position placed on the .
7. The method of claim 6,
The method of controlling an electronic device, wherein the second touch input includes a flick gesture.
7. The method of claim 6,
In the split mode, the method further comprising moving the boundary line dividing the first screen and the second screen toward the edge together with the graphical object based on the first touch input How to control the device.
7. The method of claim 6,
The method of claim 1 , wherein the first touch input is received in a first direction, and the second touch input is received in a second direction opposite to the first direction.
7. The method of claim 6,
The method of controlling an electronic device, characterized in that the edge of the touch screen display is parallel to the boundary line between the first screen and the second screen.

Images