KR102132390B1 - User terminal device and method for displaying thereof - Google Patents

Abstract

A user terminal device and a display method thereof are provided. The display method of the user terminal device displays a first screen, and when a user interaction is detected in a diagonal direction after touching one of the corner areas of the first screen, at least part of the first screen is continuously displayed. In one state, the second screen is displayed on the touch position of the corner area where user interaction is detected.

Description

USER TERMINAL DEVICE AND METHOD FOR DISPLAYING THEREOF}

The present invention relates to a user terminal device and a display method thereof, and more particularly, to a user terminal device including a square type display panel and a display method thereof.

With the development of electronic technology, various types of user terminal devices have been developed and distributed. Recently, as the size of a user terminal device is also minimized, its functions are more diversified, and the demand is increasing.

The user terminal device may provide various contents such as multimedia contents or application screens according to a user's request. The user may select a function to be used by the user by using a button or a touch screen provided in the user terminal device. The user terminal device may selectively execute a program according to interaction with a user, and display the execution result.

Meanwhile, as functions that can be provided by a user terminal device are gradually diversified, various needs are generated for a method of displaying content or a user interaction method. That is, when the method of displaying content changes and the type and function of the content greatly increases, the conventional interaction method of simply selecting a button or touching the touch screen is insufficient to perform various functions of the user terminal device. Can occur.

Accordingly, there is a need for a user interaction technology that enables a user to use a user terminal device in a more convenient manner.

The present invention is in accordance with the above-described needs, and an object of the present invention is to perform a user terminal device through a user interaction by touching and dragging one of the corner areas of the first screen on the user terminal device. It is to provide a terminal device and a display method thereof.

Another object of the present invention is to display a plurality of objects on a grid screen including a plurality of square cells in a user terminal device having a square type display panel, and provide various functions for a plurality of objects according to user interaction. It is to provide a user terminal device and a display method thereof.

According to an embodiment of the present invention for achieving the above object, a display method of a user terminal device includes: displaying a first screen; And when a user interaction dragging after touching one of the corner areas of the first screen is detected, on a touch position of the corner area where the user interaction is detected while continuously displaying at least a portion of the first screen. And displaying the second screen.

Then, in the displaying of the second screen, when a user interaction that is dragged in a diagonal direction after touching one of the corner areas of the first screen is detected, the user interaction is detected within the first screen. While the corner area is folded by the user interaction, the second screen may be displayed in the folded corner area.

In addition, the second screen may include different information according to the position of the corner area where the user interaction is detected among the four corner areas of the first screen.

In addition, the displaying of the second screen includes: information on an application currently being executed on the second screen according to the location of the corner area where the user interaction is detected, information that guides the user to move to the home screen, and the current user terminal. One of the device status information and quick access information for a user-designated application may be displayed.

In addition, the size of the second screen is different according to the drag amount of the user interaction, and the amount of information included in the second screen may be changed differently according to the size of the second screen.

The first screen may have a square shape, and when the user interaction extends to a corner area in the opposite direction, replacing the first screen with the second screen.

In addition, when the first screen displays e-book content, the step of displaying the second screen includes touching one of the corner areas of the first screen and dragging it diagonally. When a user interaction is detected, a second screen including a bookmark display may be displayed in a corner area where the user interaction is detected.

Then, when a message is received from the outside, the step of displaying the second screen may include detecting the user interaction when a user interaction touching a corner of the first screen and dragging in a diagonal direction is detected. A second screen including at least one of an icon indicating that the message is received and information on the received message may be displayed in the corner area.

In addition, when the first screen displays the picture content, the step of displaying the second screen is when the user interaction of touching one of the corner areas of the first screen and dragging in the diagonal direction is detected. A second screen including at least one icon capable of performing a plurality of tasks on the photo content may be displayed in a corner area where user interaction is detected.

In addition, the first screen and the second screen are square, and the first screen and the second screen may share one corner area.

On the other hand, according to an embodiment of the present invention for achieving the above object, the user terminal device, a display unit for displaying a first screen; A sensing unit that detects user interaction; And when a user interaction touching and dragging one of the corner areas of the first screen through the sensing unit is detected, while displaying at least a portion of the first screen continuously, the user interaction of the corner area where the user interaction is detected is detected. It includes; a control unit for controlling the display unit to display a second screen on the touch position.

In addition, when the user interaction of dragging in the diagonal direction after touching one of the corner areas of the first screen through the sensing unit is detected, the control unit detects the user interaction within the first screen. The display unit may be controlled to display the second screen in a folded corner area while being folded by the user interaction.

In addition, the second screen may include different information according to the position of the corner area where the user interaction is detected among the four corner areas of the first screen.

And, the control unit, the information on the application currently being executed on the second screen according to the location of the corner area where the user interaction is detected through the detection unit, information to guide the movement to the home screen, the current user terminal device The display unit may be controlled to display one of status information and quick access information for a user-designated application.

In addition, the control unit may change the size of the second screen differently according to the drag amount of the user interaction, and change the amount of information included in the second screen differently according to the size of the second screen. .

In addition, the first screen is in a square shape, and the control unit may control the display unit to replace the first screen with the second screen when the user interaction extends to a corner area in the opposite direction.

In addition, when the first screen displays e-book content, the control unit detects a user interaction that touches one of the corner areas of the first screen and drags in a diagonal direction, The display unit may be controlled to display a second screen including a bookmark display in a corner area where the user interaction is detected.

In addition, when a message is received from the outside, when the user interaction dragging in a diagonal direction after touching one of the corner areas of the first screen is detected, the control unit displays the message in the corner area where the user interaction is detected. The display unit may be controlled to display a second screen including at least one of an icon for guiding reception and information on the received message.

In addition, when the first screen displays the picture content, when the user interaction that touches one of the corner areas of the first screen and drags in a diagonal direction is detected, the user interaction is detected at the corner. The display unit may be controlled to display a second screen including at least one icon capable of performing a plurality of tasks on the photo content in an area.

In addition, the first screen and the second screen are square, and the first screen and the second screen may share one corner area.

On the other hand, according to an embodiment of the present invention for achieving the above object, the display method of the user terminal device, displaying a plurality of objects on a grid screen including a plurality of square cells; And when a user interaction by touching and dragging a first object among the plurality of objects is detected, the size of the first object is adjusted by adjusting the number of cells in which the first object is displayed according to a drag distance and direction of the user interaction. It includes; adjusting the.

In addition, the adjusting step may include switching a mode of the user terminal device to a grid editing mode when a user interaction preset for the grid screen is detected; Determining a square cell in which the first object is displayed according to a drag distance and direction of the user interaction when a user interaction dragging the first object is detected during the grid editing mode; And adjusting and displaying the size of the first object in the determined square cell.

In addition, the adjusting step increases the number of square cell regions in which the first object is displayed when the first user interaction dragging in the outer direction of the first object is detected after touching the first object. To increase the size of the first object, touch the first object, and then detect a second user interaction dragging in the inner direction of the first object, in the square cell area where the first object is displayed. The size of the first object may be reduced by reducing the number.

In addition, when the first user interaction is detected, when some of the plurality of objects other than the first object are moved to another square cell area, the other part is removed from the display screen, and the second user interaction is detected. , Moving some of the plurality of objects except the first object to another square cell area, and adding a new object to the display screen.

Also, contents included in the first object may be different according to the number of square cells occupied by the first object.

And, when the first object is displayed in a first number of square cells, the first object displays an icon of an application corresponding to the first object, and the first object is displayed in a second number of square cells If it is, the first object displays brief information of the application corresponding to the first object, and when the first object is displayed in a third number of square cells, the first object corresponds to the first object When the first object is displayed in a fourth number of square cells, the first object may display an execution screen of an application corresponding to the first object.

And, in the adjusting step, when the first object is maintained in a square shape and the first object is changed to a rectangular shape according to user interaction, some of the square cells in which the first object is displayed are displayed with the first object. And displaying a related menu.

Also, in the displaying of the menu related to the first object, a menu related to the first object of a different type may be displayed according to the direction of the user interaction.

In addition, the grid screen including the plurality of square cells may be displayed on a square type display panel.

In addition, when a user interaction of dragging in a diagonal direction after touching one of the corner areas included in the first object among the plurality of objects is detected, an application corresponding to the first object is displayed in an area where the first object is displayed. And displaying a screen for.

On the other hand, according to an embodiment of the present invention for achieving the above object, the user terminal device, a display unit for displaying a plurality of objects on a grid screen including a plurality of square cells; A sensing unit that detects user interaction; And when a user interaction by touching and dragging a first object among the plurality of objects is detected through the sensing unit, the number of cells in which the first object is displayed is adjusted according to a drag distance and a direction of the user interaction. 1, a control unit for adjusting the size of the object.

In addition, when a predetermined user interaction with respect to the grid screen is detected through the detection unit, the control unit switches a mode of the user terminal device to a grid editing mode, and drags the first object during the grid editing mode. When a user interaction is detected, the square cell on which the first object is displayed is determined according to the drag distance and direction of the user interaction, and the display unit is adjusted to display the size of the first object on the determined square cell. Can be controlled.

In addition, the controller increases the number of square cell regions in which the first object is displayed when the first user interaction of touching the first object and dragging in the outer direction of the first object is detected. When the size of the first object is increased, and after the first object is touched and a second user interaction dragging in the inner direction of the first object is detected, the number of square cell regions in which the first object is displayed is determined. By reducing, the size of the first object may be reduced.

In addition, when the first user interaction is detected, the controller moves some of the plurality of objects except the first object to another square cell area, removes other parts from the display screen, and the second user interaction. When this is detected, some of the plurality of objects other than the first object may be moved to another square cell area, and a new object may be added to the display screen.

Also, contents included in the first object may be different according to the number of square cells occupied by the first object.

In addition, when the first object is displayed in a first number of square cells, the control unit displays an icon of an application corresponding to the first object, and the first object has a second number of objects. When displayed in a square cell, the first object displays brief information of an application corresponding to the first object, and when the first object is displayed in a third number of square cells, the first object is the first object Displays detailed information of an application corresponding to one object, and when the first object is displayed in a fourth number of square cells, the first object is displayed to display an execution screen of an application corresponding to the first object We can control wealth.

In addition, when the first object is maintained in a square shape and the first object is changed to a rectangular shape according to user interaction, the controller may control a part of the square cells in which the first object is displayed, related to the first object. The display unit may be controlled to display.

In addition, the control unit may control the display unit to display a menu related to a first object of a different type according to the direction of the user interaction.

In addition, the display unit may display a grid screen including the plurality of square cells on a square type display panel.

In addition, when the user interaction of dragging in the diagonal direction after touching one of the corner regions included in the first object among the plurality of objects is detected through the detection unit, the control unit may display a region in which the first object is displayed. The display unit may be controlled to display a screen for an application corresponding to the first object.

According to various embodiments of the present invention as described above, a user can perform various functions through a user terminal device having a square display panel. Accordingly, user convenience and satisfaction may be improved.

1 is a block diagram briefly showing the configuration of a user terminal device according to an embodiment of the present invention;
2 is a block diagram showing in detail the configuration of a user terminal device according to an embodiment of the present invention;
3A and 3B are diagrams illustrating a user terminal device having a square type display panel according to an embodiment of the present invention;
4 is a diagram for explaining a configuration of software stored in a storage unit according to an embodiment of the present invention;
5A to 18C are diagrams for explaining an embodiment of performing various functions of a user terminal device according to user interaction with a corner area, according to an embodiment of the present invention;
19A to 32C are diagrams for explaining an embodiment of performing various functions of a user terminal device on a grid screen composed of a plurality of square cells, according to an embodiment of the present invention;
33 to 38 are diagrams for explaining an embodiment of performing various functions using a plurality of user terminal devices according to an embodiment of the present invention,
39 to 48B are diagrams for explaining an embodiment of performing various functions of a user terminal device according to folding interaction, according to an embodiment of the present invention;
49 to 55C are diagrams for explaining an embodiment of performing various functions of a user terminal device according to user interaction with a corner area according to various embodiments of the present invention; and
56 and 57 are flowcharts for describing a display method of a user terminal device according to various embodiments of the present invention.

Since the present embodiments can apply various conversions and have various embodiments, specific embodiments will be illustrated in the drawings and described in detail in the detailed description. However, this is not intended to limit the scope of the specific embodiments, it should be understood to include all conversions, equivalents, or substitutes included in the scope of the disclosed ideas and techniques. In describing the embodiments, when it is determined that the detailed description of the related known technology may obscure the subject matter, the detailed description will be omitted.

Terms such as first and second may be used to describe various components, but the components should not be limited by the terms. The terms are only used to distinguish one component from other components.

Terms used in the present application are only used to describe specific embodiments, and are not intended to limit the scope of rights. Singular expressions include plural expressions unless the context clearly indicates otherwise. In this application, terms such as “comprises” or “consist of” are intended to indicate that a feature, number, step, operation, component, part, or combination thereof described in the specification exists, one or more other It should be understood that features or numbers, steps, operations, components, parts, or combinations thereof are not excluded in advance.

In an embodiment, the'module' or the'unit' performs at least one function or operation, and may be implemented by hardware or software or a combination of hardware and software. In addition, a plurality of'modules' or a plurality of'units' are integrated into at least one module except for a'module' or a'unit' that needs to be implemented with specific hardware to be implemented with at least one processor (not shown). Can be.

Hereinafter, embodiments will be described in detail with reference to the accompanying drawings. 1 is a block diagram briefly showing a configuration of a user terminal device 100 according to an embodiment of the present invention. As illustrated in FIG. 1, the user terminal device 100 includes a display unit 110, a sensing unit 120, and a control unit 130. At this time, the user terminal device 100 may be implemented as various types of devices, such as a TV, PC, laptop PC, mobile phone, tablet PC, PDA, MP3 player, kiosk, electronic picture frame, table display device, and the like. When implemented as a portable type device such as a mobile phone or tablet PC, PDA, MP3 player, laptop PC, etc., it may be referred to as a mobile device, but will be referred to as a user terminal device in this specification.

The display 110 displays various image data and UIs. In particular, the display 110 includes a square display panel, and may display at least one object (eg, an icon) having a square shape on the square display panel. In addition, the display 110 may provide various UIs and screens according to user interaction detected through the detector 120.

Meanwhile, the display 110 may be implemented as a touch screen in combination with the touch sensing unit included in the sensing unit 120.

The sensing unit 120 detects user interaction. In particular, the sensing unit 120 may include a touch sensing unit that detects a user touch interaction. In addition, the sensing unit 120 may detect a drag interaction that touches one of a plurality of corner areas included in the display unit 110 and drags in a diagonal direction through the touch sensing unit.

The control unit 130 controls the overall operation of the user terminal device 100. In particular, the control unit 130 may control the user terminal device 100 having a square display panel according to various user interactions detected through the detection unit 120.

In one embodiment of the present invention, when the display unit 110 touches one of the corner areas of the first screen and then drags while the display unit 110 displays the first screen, the control unit 130 may display the first The display 110 may be controlled to display the second screen on the touch position of the corner area where user interaction is sensed while at least a part of the screen is continuously displayed. At this time, the first screen and the second screen are square, and the first screen and the second screen may share one corner area. Here, the corner areas shared by the first screen and the second screen may be corner areas where user interaction is detected. Meanwhile, according to an embodiment of the present invention, the first screen and the second screen are not physically divided screens, but refer to screens as a logical layout for displaying content, applications, and the like. That is, when a user interaction is detected in a corner area of the first screen while only the first screen is displayed while the second screen is covered by the first screen, the controller 190 displays the first screen in which the user interaction is detected. While folding the corner area, the display 110 may be controlled to display a second screen hidden in the folded corner area.

Specifically, the display 110 including a square display panel may display a first screen having a square shape. At this time, if a user interaction that touches one of the four corner areas of the first screen through the detector 120 and drags in a diagonal direction is detected, the controller 130 detects the user interaction within the first screen. The display 110 may be controlled to display the second screen in the folded corner area while the corner area is folded by the user interaction.

At this time. The second screen displayed on the corner area may include different information according to the position of the corner area where user interaction is detected among the four corner areas of the first screen. For example, according to the location of the corner area where user interaction is detected, the control unit 130 may display information about an application currently being executed on a second screen, information that can be moved to a home screen, status information of a current user terminal device, and The display 110 may be controlled to display one of quick access information for a user-designated application.

Also, the size of the second screen displayed in the corner area may be different according to the amount of dragging of the user interaction. Specifically, the controller 130 may increase the size of the second screen in proportion to the drag length of the user interaction.

Also, the amount of information included in the second screen may be changed differently according to the size of the second screen. That is, the control unit 130 may increase the amount of information included in the second screen as the size of the second screen increases.

While the user interaction dragging in the diagonal direction is detected, if the user interaction extends to the corner area in the opposite direction, the controller 130 displays the display unit to replace the first screen displayed on the display unit 110 with the second screen. 110 can be controlled. That is, the controller 130 may control the display 110 to remove the first screen and display the second screen in full screen.

Meanwhile, the second screen may include different information depending on the type of image content or application displayed on the first screen. For example, when the video content displayed on the first screen is broadcast content, the second screen displays relevant information (eg, program name, channel number, channel name, etc.) about the broadcast content displayed on the first screen. The display 110 may be controlled to display. In addition, when the image content displayed on the first screen is photo content, the second screen displays 110 to display at least one icon capable of performing various tasks on the photo content displayed on the first screen. Can be controlled.

In addition, when a message is received from the outside, the control unit 130 controls the display unit 110 to display at least one of an icon for guiding that the message is received from the outside and information on the message received from the outside on the second screen. can do.

In another embodiment of the present invention, while the display unit 110 displays a plurality of objects on a grid screen including a plurality of square cells, the first object among the plurality of objects is touched and dragged through the sensing unit 120. When a user interaction is detected, the controller 130 may adjust the size of the first object by adjusting the number of cells in which the first object is displayed according to the drag distance and direction of the user interaction.

Specifically, the display 110 may display a grid screen including a plurality of square cells on a display panel having a square shape. At this time, at least one object may be displayed on the plurality of square cells. At this time, the object may occupy at least one square cell to form a rectangular or square shape.

When a predetermined user interaction with respect to the grid screen is detected through the sensing unit 120 while the display unit 110 displays the grid screen, the controller 130 sets the mode of the user terminal device 100 to the grid editing mode. You can switch.

In addition, when a user interaction dragging a first object among a plurality of objects is detected during the grid editing mode, the controller 130 determines a square cell in which the first object is displayed according to the drag distance and direction of the user interaction, and determines The display 110 may be controlled to display by adjusting the size of the first object in the square cell.

Specifically, when a first user interaction that touches the first object and drags it to the outside direction of the first object is detected, the controller 130 increases the number of square cell regions in which the first object is displayed to increase the number of square cell regions. You can increase the size of the object. At this time, the control unit 130 may control the display unit 110 to move some of the plurality of objects except the first object to another square cell area and remove the other part from the display screen.

However, if a second user interaction is detected after touching the first object and dragging in the inner direction of the first object, the controller 130 decreases the number of square cell regions in which the first object is displayed, thereby reducing the number of square cell regions. Can reduce the size of. At this time, the controller 130 may move some of the plurality of objects except the first object to another square cell area, and control the display unit 110 to add a new object to the display screen.

Meanwhile, the control unit 130 may have different contents included in the first object according to the number of square cells occupied by the first object. Specifically, when the first object is displayed in a first number (eg, 1) of square cells, the controller 130 displays the display unit to display an icon of the application corresponding to the first object in the first object ( 110) can be controlled. In addition, when the first object is displayed in a second number (for example, four) of square cells, the controller 130 displays the first unit to display brief information of the application corresponding to the first object ( 110) can be controlled. In addition, when the first object is displayed in a third number (for example, 9) of square cells, the controller 130 displays the detailed information of the application corresponding to the first object in the first object. 110) can be controlled. In addition, when the first object is displayed in a fourth number of square cells (for example, 16), the controller 130 displays the display unit to display the execution screen of the application corresponding to the first object in the first object ( 110) can be controlled.

On the other hand, in the above-described embodiment, it was described as providing four different types of content according to the size of the object, but this is only one embodiment, and provides a plurality of different types of content except four depending on the size of the object. can do.

When the first object maintains a square shape and the first object is changed to a rectangular shape according to user interaction, the controller 130 displays some of the square cells in which the first object is displayed to display a menu related to the first object The part 11 can be controlled. At this time, the controller 130 may control the display 110 to display a menu related to the first object of a different type according to the direction of user interaction.

In addition, when a user interaction that touches one of the corner areas included in the first object among the plurality of objects and drags in a diagonal direction is detected through the sensing unit 120, the controller 130 displays the first object. The display 110 may be controlled to display a screen for an application corresponding to the first object in the region.

According to various embodiments of the present invention as described above, a user can perform various functions through a user terminal device having a square display panel.

Hereinafter, the present invention will be described in more detail with reference to FIGS. 2 to 46B. 2 is a block diagram showing in detail the configuration of the user terminal device 200 according to an embodiment of the present invention. 2, the user terminal device 200 includes an image receiving unit 210, an image processing unit 220, a display unit 230, a communication unit 240, a storage unit 250, an audio processing unit 260, It includes a speaker unit 270, a sensing unit 280 and a control unit 290.

On the other hand, Figure 2, for example, when the user terminal device 200 is a device having various functions such as a content providing function, a display function, etc., for example, shows various components. Accordingly, according to an embodiment, some of the components illustrated in FIG. 2 may be omitted or changed, and other components may be further added.

The image receiving unit 210 receives image data through various sources. For example, the image receiving unit 210 may receive broadcast data from an external broadcasting station, receive VOD data in real time from an external server, and receive image data from an external device.

The image processing unit 220 is a component that performs processing on image data received by the image receiving unit 210. The image processing unit 220 may perform various image processing such as decoding, scaling, noise filtering, frame rate conversion, and resolution conversion on the image data.

The display 230 displays at least one of video frames received by the image receiving unit 210 and video frames processed by the image processing unit 220 and various screens generated by the graphic processing unit 293.

In particular, the display 230 may include a display panel for outputting image data and a driver for driving the display panel. At this time, the display panel may have a square shape, as shown in FIG. 3A. In addition, as shown in FIG. 3B, the display panel includes a hinge portion 310 in the center of a square display panel, and the user terminal device 200 can be folded based on the hinge portion 310.

Meanwhile, FIG. 3B illustrates that the display unit 230 does not include a bezel, but this is only an example, and as illustrated in FIG. 3C, a bezel 320 housing a square display panel may be included. have.

At this time, the bezel 320 may include a touch sensor, a proximity sensor, and the like, which detect a user's touch.

The communication unit 240 is a component that performs communication with various types of external devices according to various types of communication methods. The communication unit 240 includes a Wi-Fi chip 241, a Bluetooth chip 242, a wireless communication chip 243, and an NFC chip 244. The control unit 290 communicates with various external devices using the communication unit 240.

In particular, the Wi-Fi chip 241 and the Bluetooth chip 242 perform communication using a WiFi method and a Bluetooth method, respectively. In the case of using the Wi-Fi chip 241 or the Bluetooth chip 242, various connection information such as an SSID and a session key can be first transmitted and received, and then communication is connected using this to transmit and receive various information. The wireless communication chip 243 means a chip that performs communication according to various communication standards such as IEEE, Zigbee, 3G (3rd Generation), 3GPP (3rd Generation Partnership Project), and LTE (Long Term Evoloution). The NFC chip 244 refers to a chip operating in a Near Field Communication (NFC) method using a 13.56 MHz band among various RF-ID frequency bands such as 135 kHz, 13.56 MHz, 433 MHz, 860 to 960 MHz, and 2.45 GHz.

The storage unit 250 may store various programs and data necessary for the operation of the user terminal device 200. Specifically, the main area and the storage unit (0)

Programs and data for configuring various screens to be displayed in the sub-region may be stored. Hereinafter, the structure of the software stored in the user terminal device 200 will be described with reference to FIG. 4. According to FIG. 4, software including an OS 410, a kernel 420, middleware 430, and an application 440 may be stored in the storage unit 250.

The operating system (OS, 410) controls and manages the overall operation of the hardware. That is, the OS 410 is a layer in charge of basic functions such as hardware management, memory, and security.

The kernel 420 serves as a path for transmitting various signals including a touch signal sensed by the display unit 230 to the middleware 430.

The middleware 430 includes various software modules that control the operation of the user terminal device 200. According to FIG. 4, the middleware 430 includes an X11 module 430-1, an APP manager 430-2, a connection manager 430-3, a security module 430-4, and a system manager 430-5. It includes a multimedia framework 430-6, a UI framework 430-7, a window manager 430-8, and a handwriting recognition module 430-9.

The X11 module 430-1 is a module that receives various event signals from various hardware provided in the user terminal device 200. Here, the event may be variously set, such as an event in which a user gesture is detected, an event in which a system alarm occurs, an event in which a specific program is executed or terminated, and the like.

The APP manager 430-2 is a module that manages execution states of various applications 440 installed in the storage unit 250. When the application execution event is detected from the X11 module 430-1, the APP manager 430-2 calls and executes an application corresponding to the event.

The connection manager 430-3 is a module for supporting wired or wireless network connection. The connection manager 430-3 may include various detailed modules such as a DNET module and UPnP module.

The security module 430-4 is a module that supports hardware certification, request permission, and secure storage.

The system manager 430-5 monitors the state of each component in the user terminal device 200, and provides the monitoring result to other modules. For example, when a battery level is low, an error occurs, or a communication connection state is disconnected, the system manager 430-5 displays the monitoring result in the main UI framework 430-7 or subUI frame. It can be provided to the work (430-9) to output a notification message or notification sound.

The multimedia framework 430-6 is a module for playing multimedia content stored in the user terminal device 200 or provided from an external source. The multimedia framework 430-6 may include a player module, a camcorder module, and a sound processing module. Accordingly, an operation of generating and playing screens and sounds by playing various multimedia contents may be performed.

The main UI framework 430-7 is a module for providing various UIs to be displayed on the main area of the display unit 230, and the sub UI framework 430-9 is providing various UIs to be displayed on the sub area. It is a module for. The main UI framework 430-7 and the sub UI framework 430-9 include an image compositor module that composes various objects, a coordinate composer that calculates coordinates to display objects, and coordinates that compute the constructed object. It may include a rendering module for rendering in, a 2D/3D UI toolkit that provides a tool for constructing a 2D or 3D UI.

The window manager 430-8 may detect a touch event or other input event using the user's body or pen. When such an event is detected, the window manager 430-8 transmits an event signal to the main UI framework 430-7 or the sub UI framework 430-9 to perform an operation corresponding to the event.

In addition, when the user touches and drags the screen, the pitch angle, roll angle, yaw angle, etc. are calculated based on the sensor value detected by the motion detection unit 282 or the handwriting module for drawing a line according to the drag trajectory. Various program modules, such as an angle calculation module for doing so, may be stored.

The application module 440 includes applications 440-1 to 440-n for supporting various functions. For example, a program module for providing various services such as a navigation program module, a game module, an e-book module, a calendar module, and an alarm management module may be included. These applications may be installed by default, or the user may install and use them arbitrarily during the use process. When the object is selected, the main CPU 294 may execute an application corresponding to the selected object using the application module 440.

Since the software structure shown in FIG. 4 is only an example, it is not necessarily limited thereto. Therefore, it is needless to say that some may be omitted, modified, or added as necessary. For example, the storage unit 250 includes a sensing module for analyzing signals sensed by various sensors, a messaging module such as a messenger program, a short message service (SMS) & multimedia message service (MMS) program, an email program, and telephone information. Various programs such as a Call Info Aggregator program module, a VoIP module, and a web browser module may be additionally provided.

Referring again to FIG. 2, the audio processing unit 260 is a component that processes audio data of video content. The audio processing unit 260 may perform various processes such as decoding or amplification of audio data, noise filtering, and the like. The audio data processed by the audio processing unit 260 may be output to the audio output unit 270.

The audio output unit 270 is a component that outputs various notification sounds or voice messages as well as various audio data performed by various processing operations such as decoding, amplification, and noise filtering by the audio processing unit 260. In particular, the audio output unit 270 may be implemented as a speaker, but this is only an embodiment, and may be implemented as an output terminal capable of outputting audio data.

The sensing unit 280 detects various user interactions. Particularly, as illustrated in FIG. 2, the sensing unit 280 may include a touch sensing unit 281, a motion sensing unit 282, and a bending sensing unit 283.

Specifically, the touch sensing unit 281 may detect a user's touch interaction using a touch panel attached to the back side of the display panel. The motion detector 282 may detect the motion (eg, rotational motion, etc.) of the user terminal device 200 using at least one of an acceleration sensor, a geomagnetic sensor, and a gyro sensor. The bending detection unit 283 may detect whether the user terminal device is bent based on the hinge unit 310 using a bending sensor, an illuminance sensor, or the like.

The control unit 290 controls the overall operation of the user terminal device 200 using various programs stored in the storage unit 250.

2, the RAM 291, the ROM 292, the graphics processor 293, the main CPU 294, the first to n interfaces 295-1 to 295-n, as shown in FIG. Bus 296. At this time, the RAM 291, the ROM 292, the graphic processing unit 293, the main CPU 294, the first to n interfaces 295-1 to 295-n, etc. may be connected to each other through the bus 296. .

The ROM 292 stores a set of instructions for booting the system and the like. When a turn-on command is input and power is supplied, the main CPU 294 copies the O/S stored in the storage unit 250 to the RAM 291 according to the command stored in the ROM 292, and executes the O/S. To boot the system. When the booting is completed, the main CPU 294 copies various application programs stored in the storage unit 250 to the RAM 291 and executes the application programs copied to the RAM 291 to perform various operations.

The graphic processing unit 293 generates a screen including various objects, such as items, images, and text, by using a calculation unit (not shown) and a rendering unit (not shown). The calculation unit calculates attribute values such as coordinate values, shapes, sizes, colors, etc. to be displayed according to the layout of the screen using the control command received from the sensing unit 280. The rendering unit generates screens of various layouts including objects based on attribute values calculated by the calculation unit. The screen generated by the rendering unit is displayed in the display area of the display unit 230.

The main CPU 294 accesses the storage unit 250 to boot using the O/S stored in the storage unit 250. In addition, the main CPU 294 performs various operations using various programs, contents, data, etc. stored in the storage unit 250.

The first to n interfaces 295-1 to 295-n are connected to various components described above. One of the interfaces may be a network interface connected to an external device through a network.

In particular, the controller 290 may provide various functions for the user terminal device 200 having a square display panel.

<User interaction on the corner area>

According to an embodiment of the present invention, while the display 230 displays the first screen, the user interaction touches one of the corner areas of the first screen through the sensing unit 280 and drags in a diagonal direction ( Hereinafter, when “diagonal interaction” is detected, the control unit 290 displays the second screen on the touch position of the corner area where diagonal interaction is detected while at least a portion of the first screen is continuously displayed. The control unit 230 may be controlled. Hereinafter, various functions provided by the user terminal device 200 according to the diagonal interaction will be described with reference to FIGS. 5A to 18C.

5A and 5B are diagrams for describing a function provided by the user terminal device 200 when user interaction and diagonal interaction in the horizontal direction are detected.

As shown in FIG. 5A, while the first page 510 of the E-book content is displayed on the display screen, a user interaction dragging in a horizontal direction (particularly, a left direction) from one of a plurality of corners included in the display screen When this is detected, the controller 290 may control the display 230 to switch the page of the E-book content to the next page and switch to the second page 520 of the E-book content.

As illustrated in FIG. 5B, when the third page 530 of the E-book content is displayed on the display screen, when a diagonal interaction is detected in one of a plurality of corner areas included in the display screen, the controller 290 The display unit 230 may be controlled to maintain the current page screen, provide an image effect in which a corner area where diagonal interaction is detected is folded, and display a bookmark icon 545 in the folded corner area.

In addition, the control unit 290 may include information on functions that the user terminal device 200 can provide on the second screen according to the position of the corner area where diagonal interaction is detected among the four corner areas of the first screen. Can.

Specifically, as illustrated in FIG. 6A, the control unit 290 may display the display unit 230 to display the image content 600.

When diagonal interaction is detected in the upper right corner area while the image content 600 is being displayed, the control unit 290, as shown in FIG. 6B, is the most recently executed application in the corner area of the upper right corner where the diagonal interaction is detected. The display 230 may be controlled to display information (eg, an icon, a recent execution screen, etc.) 615 and an execution screen 610 for the most recently executed application. At this time, if information on the most recently executed application 615 is displayed along with the video content 600, and the diagonal interaction is continuously detected in the corner area of the upper right corner, the control unit 290 is the upper right corner where the diagonal interaction is detected. The display unit 230 may be controlled to display information on a second recently executed application in a corner area of.

When diagonal interaction is detected in the upper left corner area while the image content 600 is displayed, the controller 290 may move to the home screen in the upper left corner area where the diagonal interaction is detected, as illustrated in FIG. 6C. The display 230 may be controlled to display guide information (eg, an icon) 620. In this case, when the diagonal interaction extends to the lower right corner area, the control unit 290 may control the display unit 230 to display the home screen.

When a diagonal interaction is detected in the lower left corner area while the image content 600 is being displayed, the controller 290 displays the current user terminal device in the lower left corner area where the diagonal interaction is detected, as illustrated in FIG. 6D. The display unit 230 may be controlled to display the status information (eg, network information, battery information, etc.) 630 of the 200.

When a diagonal interaction is detected in the lower right corner area while the image content 600 is displayed, the control unit 290 is an application designated by the user in the lower right corner area where the diagonal interaction is detected, as illustrated in FIG. 6E. The display 230 may be controlled to display quick access information for (for example, an icon corresponding to a camera application) 640.

In addition, when a diagonal interaction is detected on the lock screen, the control unit 290 may control the display 230 to display information on the object where the diagonal interaction is detected on the lock screen.

Specifically, as illustrated in FIG. 7A, when four objects are displayed on the lock screen, when a diagonal interaction is detected in the first object 710 for guiding a missed call, the controller 290 is illustrated in FIG. 7B. As described above, the display 230 may be controlled to display information about missed calls (for example, caller information of missed calls) 720 in an area where the first object 710 is displayed.

However, as described with reference to FIGS. 7A and 7B, it is only an embodiment that the control unit 290 provides information about missed calls on the lock screen, and provides various information and functions through diagonal interaction on the lock screen. Can. For example, the control unit 290 may provide received message information through a diagonal interaction on a lock screen, and may provide a quick access function for a camera application.

Also, the control unit 290 may provide information on functions and application functions that the user terminal device 200 can provide on the second screen according to the position of the corner area where diagonal interaction is detected among the four corner areas of the first screen. It may include.

Specifically, as shown in FIG. 8A, the control unit 290 may display the display unit 230 to display the photo content 800.

When a diagonal interaction is detected in the upper right corner area while the picture content 800 is displayed, the controller 290 collapses the corner area of the upper right corner where the diagonal interaction is detected according to the diagonal interaction, as shown in FIG. 8B. , The display 230 may be controlled to display related information (eg, a photographing date, a photographing location, etc.) 810 about photographic content in a folded corner area. At this time, when the diagonal interaction extends to the lower left corner area, the control unit 290, as shown in FIG. 8C, displays information related to the picture content on the display screen (for example, the shooting date, the shooting location, The display unit 230 may be controlled to display the map information, associated photo information, and the like 820.

As illustrated in FIG. 9A, when a diagonal interaction is detected in the upper left corner area while the picture content 800 is displayed, the control unit 290, as illustrated in FIG. 9B, detects a diagonal interaction at the upper left corner. The display unit 230 may be controlled to display a menu (eg, delete, edit, share, etc.) 910 that can perform various tasks on the photo content in the area.

As shown in FIG. 10A, when diagonal interaction is detected in the lower right corner area while the picture content 800 is displayed, the controller 290 reduces the picture content 1000 as shown in FIG. 10B. By doing so, the display 230 may be controlled to be displayed on the right side of the display screen. Then, the control unit 290, the display unit 230 to display a menu window 1010 including a plurality of icons (1011 to 1018) capable of performing various functions of the user terminal device 100 in the left area of the display screen ) Can be controlled. Then, when the fifth icon 1015 is selected from the plurality of icons 1011 to 1018 included in the menu window 1010, the control unit 290 displays the Internet browsing screen 1020 corresponding to the fifth icon 1015. The display 230 may be controlled to display.

As described above, the user can be provided with various functions according to the position of the corner area where diagonal interaction is detected while the picture content is displayed.

In addition, the controller 290 may change the size of the second screen according to the drag amount of the diagonal interaction, and may change the amount of information included in the second screen according to the size of the second screen.

Specifically, when a message is received from the outside while receiving the video content 1100, when a diagonal interaction is detected in the upper right corner area, the controller 290 displays to display information on the received message in the upper right corner area. The control unit 230 may be controlled.

In particular, when the drag amount of the diagonal interaction is less than the first value, the control unit 290 may display the second screen 1110 including an icon for guiding that a message is received in the upper right corner area, as shown in FIG. 11A. The display 230 may be controlled.

In addition, when the drag amount of the diagonal interaction is greater than or equal to the first value and less than the second value, the control unit 290 shows information about the sender of the message in the upper right corner area (for example, the sender name). , A display unit 230 to display a second screen 1120 including a caller's picture, etc.).

In addition, when the drag amount of the diagonal interaction is greater than or equal to the second value and less than the third value, the control unit 290, as shown in FIG. 11C, displays information about the sender of the message in the upper right corner area and the content included in the message. The display 230 may be controlled to display the second screen 1130 including at least some information.

In addition, when the drag amount of the drag interaction is greater than or equal to the third value, the control unit 290 displays the display unit 230 to display the chat screen 1140 for responding to the received message in full screen, as illustrated in FIG. 11D. Can be controlled.

In addition, when a plurality of diagonal interactions are detected in the same corner area, the controller 290 may continuously provide information corresponding to the same corner area according to the diagonal interaction.

Specifically, when a diagonal interaction is detected in the lower right corner area while the image content is being displayed, the controller 290 is configured to fold the lower right corner area once the diagonal interaction is detected, as illustrated in FIG. 12A. The display unit 230 is controlled, and the display unit 230 is controlled to display quick access information (for example, an icon corresponding to a camera application) 1210 for an application specified by a user in a lower right corner area. Can.

In addition, when diagonal interaction is detected again in a corner area of the lower right corner while the video content and the quick access information 1210 are displayed together, the control unit 290, as illustrated in FIG. 12B, detects diagonal interaction at the lower right corner. The display unit 230 is controlled to fold the corner area of the screen twice, and a quick access information (for example, an icon corresponding to an Internet application) 1220 for another application designated by the user is displayed in the lower right corner area. The display 230 can be controlled to do so.

In addition, the control unit 290 may perform a check function through diagonal interaction. Specifically, when a part of a plurality of items is previously selected, when a part of the plurality of items is touched, the control unit 290 checks one side (for example, the upper right) of the touched item, as shown in FIG. 13A. The display 230 may be controlled to display a mark.

According to an embodiment of the present invention, when a part of a plurality of items is selected, when a diagonal interaction is detected on a part of the plurality of items, the controller 290, as shown in FIG. 13B, detects a part of the diagonal interaction. The display unit 230 may be controlled to provide an image effect in which an item of the product is folded.

In addition, when a diagonal interaction is detected in at least one of a plurality of display items included in one screen, the controller 290 converts at least one display item in which the diagonal interaction is detected to another screen related to the at least one display item. The display 230 may be controlled to display.

Specifically, as shown in FIG. 14A, the control unit 290 may control the display unit 230 to display a home screen including an icon 1410 for a photo application and an icon 1420 for an SNS application. have.

In this case, when a diagonal interaction is detected between the icon 1410 for the photo application and the icon 1420 for the SNS application, the controller 290 sets the icon 1410 for the photo application to information about the photo application (for example, , Switch to a thumbnail image 1415 including new photo content information, etc., and an icon 1420 for the SNS application, a thumbnail image 1425 including information about the SNS application (for example, new mention information, etc.) ), the display 230 may be controlled.

At this time, the converted thumbnail images 1415 and 1425 may include different amounts of information depending on the size of the display item. For example, when an icon for a photo application of a first preset size is switched to a thumbnail image, the control unit 290, as shown on the left side of FIG. 15A, displays a first mode in which only the latest photographed image is displayed. The display 230 may be controlled to display the thumbnail image 1510 of. In addition, when the icon for the SNS application of the first preset size is switched to a thumbnail image, the control unit 290, as shown on the right side of FIG. 15A, includes a first mode including two latest updated information of mentions. The display 230 may be controlled to display the thumbnail image 1520 of. However, when the icon for the photo application of the second preset size is switched to a thumbnail image, the control unit 290 of the second mode for displaying the latest four photographs, as shown on the left side of FIG. 15B. The display 230 may be controlled to display the thumbnail image 1530. In addition, when the icon for the SNS application of the second preset size is switched to a thumbnail image, the control unit 290 displays one latest updated information and three updated information as shown on the right side of FIG. 15B. The display unit 230 may be controlled to display the thumbnail image 1540 of the second mode including.

On the other hand, if a user interaction of touching one of a plurality of corner areas included in the thumbnail images 1510 and 1520 in the first mode and dragging in the outer direction of the thumbnail images 1510 and 1520 is detected, the controller 290 May convert the first mode thumbnail images 1510 and 1520 into the second mode thumbnail images 1530 and 1540. In addition, when a user interaction that touches one of a plurality of corner areas included in the thumbnail images 1530 and 1540 in the second mode and drags it to the outside direction of the thumbnail images 1530 and 1540 is detected, the controller 290. Can convert the thumbnail images 1530 and 1540 in the second mode to thumbnail images 1510 and 1520 in the first mode.

In addition, when a diagonal interaction is detected in the display item, the control unit 290 may provide a folding image effect in which the display item in which the diagonal interaction is detected is folded, and when providing the folding image effect, shadow for realistic graphic expression Image effects can also be provided.

Specifically, the control unit 290 may control the display unit 230 to display a screen 1600 including four display items 1610 to 1640 having a square shape. In addition, when a diagonal interaction is detected in at least one of the four display items 1610 to 1640, the controller 290 may provide a folding image effect in which the display item in which the diagonal interaction is detected is folded, and a shadow for a specific light source Image effects can also be provided. In one embodiment of the present invention, it is assumed that a specific light source is located at the top of the image.

Specifically, when a diagonal interaction is detected in the second display item 1620 among the four display items 1610 to 1640, the controller 290 folds the second display item 1620 as shown in FIG. 16A. A folding image effect may be provided, and a shadow effect may be provided under the folded second display item 1620. In addition, when a diagonal interaction is detected between the first and second display items 1610 and 1620 among the four display items 1610 to 1640, the control unit 290, as shown in FIG. 16B, first and second A folding image effect of folding the display items 1610 and 1620 may be provided, and a shadow effect may be provided on the bottom sides of the folded first and second display items 1610 and 1620. In addition, when a diagonal interaction is detected between the first and fourth display items 1610 and 1640 among the four display items 1610 to 1640, the control unit 290, as illustrated in FIG. 16C, displays the first and fourth The folding image effect of folding the display items 1610 and 1640 may be provided, and a shadow effect may be provided on the bottom of the folded first display item 1610 and the diagonal of the fourth display item 1640.

In addition, when multiple diagonal interactions are detected in one display item, the controller 290 may control the display 230 to provide an image effect of folding the display item in which the diagonal interaction is sensed multiple times. Specifically, when n diagonal interactions are detected in one display item 1710, the control unit 290 may display the display unit 1710 to provide an image effect in which the display item 1710 is folded n times, as illustrated in FIG. 17. 230) can be controlled.

In addition, when a diagonal interaction is detected from one of the corner areas of the first screen, the control unit 290 may control the display unit 230 to display a menu of a plurality of items in the corner area where the diagonal interaction is detected. . In addition, when the direction of the drag interaction is changed and a drag interaction directed to one of the plurality of items is detected, the controller 290 may execute a function corresponding to the item where the drag interaction is detected.

Specifically, as illustrated in FIG. 18A, when a diagonal interaction is detected in the upper left corner area, the control unit 290 displays a contact item 1811 and a recorded item 1813 in the upper left corner area as shown in FIG. 18B. ), the display unit 230 may be controlled to display the menu 1810 including the phone item 1815. At this time, the number of items included in the menu may be different depending on the drag length of the diagonal interaction.

When the user changes the drag direction to the upper right corner of the phone item 1815 while the menu 1810 is displayed, the controller 290 may execute a phone application corresponding to the phone item 1815.

As described above, it is possible to simultaneously perform the display and function execution of the menu through diagonal interaction and drag interaction in which direction is switched.

On the other hand, in the above-described embodiment, when a diagonal interaction dragging in a diagonal direction after touching one of the corner areas of the first screen is detected, the display unit 230 is applied to the corner area where the diagonal interaction is detected. Although it has been described as displaying a screen, this is only an example, and even when another user interaction is detected in the corner area, the display 230 may display the second screen in the corner area where the user interaction is detected.

Hereinafter, functions performed on the user terminal device 200 according to various user interactions input to the corner area will be described with reference to FIGS. 49 to 55C.

For example, as illustrated in the upper part of FIG. 49, when a user interaction touching the corner area of the upper right corner for a predetermined time is detected while the first application screen 4900 is displayed, the control unit 290 displays As shown in the middle of 49, a page 230 is applied to the first application screen 4900 and the display 230 is controlled to display the second application screen 4910 in the upper right corner area. can do. Then, when a user interaction tapping the second application screen 4910 displayed in the upper right corner area is detected, the control unit 290 displays the second application screen 4910 as illustrated in the lower part of FIG. 49. The display 230 may be controlled to display in full screen.

As another example, as illustrated at the top of FIG. 50, when a user interaction continuously tapping a corner area of the lower right is detected while the first application screen 5000 is displayed, the controller 290 of FIG. 50. As shown in the middle, the display unit 230 may be controlled to switch the first application screen 5000 to the running second application screen 5010 for display. In addition, as illustrated in the middle of FIG. 50, when the user interaction continuously tapping the lower right corner area while the second application screen 5010 is displayed, the control unit 290 controls the bottom of FIG. 50. As illustrated in FIG. 2, the display unit 230 may be controlled to switch to and display another third application screen 5020 that is executing the second application screen 5010.

As another example, as shown at the top of FIG. 51, while a plurality of screens corresponding to a plurality of applications are displayed on the display unit 230, the upper left corner area and the lower right corner area of the display unit 230 are displayed. When a user interaction that touches at the same time for a predetermined time or more is detected, the controller 290 may switch the mode of the user terminal device 200 to the application deletion mode. When the mode of the user terminal device 200 is switched to the application deletion mode, the control unit 290 displays a delete icon for deleting an application on the upper right of each of the plurality of screens, as shown in the lower part of FIG. 51. The display 230 may be controlled.

As another example, as illustrated in the upper portion of FIG. 52, while a plurality of screens corresponding to a plurality of applications are displayed on the display unit 230, the upper left corner area and the lower right corner of the gallery application screen 5200. When a user interaction that simultaneously touches an area for a predetermined time or longer is detected, the controller 290 may switch the mode of the user terminal device 200 to a content deletion mode of the gallery application. When the mode of the user terminal device 200 is switched to the content deletion mode, the control unit 290 deletes the content in the upper right area of each of the plurality of content included in the gallery application, as shown at the bottom of FIG. 52. The display 230 may be controlled to display a delete icon for the display.

As another example, as illustrated at the top of FIG. 53, while a plurality of screens corresponding to a plurality of applications are displayed on the display unit 230, the upper left corner area and the lower right corner of the first application screen 5300 are displayed. After touching the corner area, when a pinch-out interaction dragging in a direction away from each other is detected, the control unit 290 displays the display unit to enlarge the size of the first application 5300, as shown in the lower part of FIG. 53. (230) can be controlled.

As another example, as illustrated in the upper portion of FIG. 54, while a plurality of screens corresponding to a plurality of applications are displayed on the display unit 230, a new SNS message is received in the upper right area of the SNS application screen 5400. When a user interaction touching the notification message for a preset time is detected while the guided notification message is displayed, the control unit 290 newly receives the SNS application screen 5400, as shown in the lower part of FIG. 54. The display 230 may be controlled to switch to the list screen 5420 including the SNS message.

As described above, functions performed according to various types of user interactions input to the corner area are summarized in Table 1 below.

Gesture type Corner area of the display Corner area of a plurality of screens included in the display unit When an event does not occur When an event (for example, receiving a new message) occurs Single touch Drag interaction Display the home menu, status bar, quick access menu, etc. in the corner area Quick view mode to browse events or contents of related applications Display the screen related to the event on the selected screen Long press interaction Navigation of currently running applications Screen editing mode Display the history of the event on the selected screen Double tap interaction Switch to another running application Create an integrated folder at the intersection where interaction is entered Create an integrated folder at the intersection where interaction is entered Multi touch Finch interaction 蕪 Change the size of a selected screen among multiple screens Change the size of a selected screen among multiple screens Two Finger Long Press Interaction Application deletion mode Application content deletion mode Application content deletion mode

Meanwhile, in the above-described embodiment, the first screen is described as a square shape, but this is only an example, and the first screen may be a shape other than a square shape. For example, as illustrated in FIG. 55A, when a user interaction that touches the upper right corner area among the corner areas of the rectangular first screen 5500 and then drags in a diagonal direction is detected, the controller 290. In a state in which a portion of the first screen 5500 is continuously displayed, the display 230 may be controlled to display the second screen 5510 in the upper right corner area. As another example, as illustrated in FIG. 55B, when a user interaction touching a first corner area of the corner areas of the first screen 5520 in a hexagonal shape and dragging in a diagonal direction is detected, the controller 290 The control unit 230 may control the display unit 230 to display the second screen 5530 in the first corner area where user interaction is sensed while continuously displaying a portion of the first screen 5520. As another example, as illustrated in FIG. 55C, when a user interaction that touches a first point among the outlines of the first screen 5540 in a circular shape and drags in a diagonal direction is detected, the control unit 290 may first In a state in which a portion of the screen 5540 is continuously displayed, the display 230 may be controlled to display the second screen 5550 at a first point where user interaction is detected.

<Grid screen>

According to another embodiment of the present invention, the display 230 may display a grid screen including a plurality of square cells. Also, the display 230 may display a plurality of objects in a plurality of square cells. At this time, each of the plurality of objects may be displayed on at least one of the plurality of square cells. In addition, when a user interaction by touching and dragging the first object among the plurality of objects is detected, the controller 290 adjusts the number of cells in which the first object is displayed according to the drag distance and direction of the user interaction, thereby controlling the first object. You can adjust the size.

Specifically, as illustrated in FIG. 19A, the display 230 may display 16 objects in each of the plurality of square cells included in the grid screen. Then, when a preset user interaction (for example, an interaction of pressing the first object for a preset time) is detected in the first object, the control unit 290 switches the mode of the user terminal device 200 device to the grid editing mode. can do. When the grid editing mode is switched, the size of 16 objects displayed in the square cell may be reduced, as shown in FIG. 19B.

Then, after touching an intersection between the first object, the second object, the fifth object, and the sixth object, as illustrated in FIG. 19B, when a user interaction dragging at 4 o'clock is detected, the controller 290 As shown in FIG. 19C according to user interaction, it is determined that the square cells in which the first objects are displayed are the first through eighth square cells, and the first objects are displayed in the determined first through eighth cells. The display unit 230 may be controlled to enlarge and display an object size. At this time, when the 10th to 16th objects are removed from the display screen, the 2nd to 9th objects may change the position of the displayed square cell, as shown in FIG. 19C.

In particular, when a first user interaction that touches the first object and drags it to the outside direction of the first object is detected, the control unit 290 increases the number of square cell regions in which the first object is displayed, thereby increasing the number of square cell regions. To increase the size of, move some of the plurality of objects except the first object to another square cell area, and remove the other part from the display screen. In addition, when a second user interaction is detected after touching the first object and dragging in the inner direction of the first object, the controller 290 decreases the number of square cell areas in which the first object is displayed, thereby reducing the number of square cell regions. To reduce the size of, move some of the plurality of objects except the first object to another square cell area, and add a new object to the display screen.

Specifically, as illustrated in FIG. 20A, after the sixth object is touched while the sixteen objects are displayed on each of the sixteen square cells included in the grid screen 2000, the sixth object is touched to the upper right direction, which is the external direction of the sixth object. When dragging user interaction is detected, the control unit 290 removes the first object, the second object, and the fifth object from the display screen, and increases the size of the sixth object to place the sixth object in four square cells. I can do it.

That is, in the case of an object whose size is increased and an object where a line segment or a vertex touches, it may be moved in a direction opposite to the line segment or the vertex abutting according to a user interaction. Also, an object in which a square cell does not exist in the moved position may be removed from the display screen. Then, when an object is created later, the object removed from the display screen may be positioned again in accordance with user interaction. For example, as illustrated in the fourth screen of FIG. 20A, when a user interaction dragging in the internal direction while the sixth object is located in four square cells is detected, the control unit 290 may display the first screen of FIG. 20A, The first object, the second object, and the fifth object removed from the display screen may be returned to the original position.

In addition, as illustrated in the first screen of 20b, if a user interaction of touching the first point 2010 of the sixth object and dragging it to the second point 2020 in the lower right direction, which is an external direction, is detected, the control unit 290 indicates that the third object, the seventh object, the ninth object, the tenth object, and the eleventh object in contact with the line segment or a vertex of the sixth object correspond to the drag direction, as shown in the third screen of FIG. 20B. The display unit 230 may be controlled to move to another location and remove the previously displayed fourth object, eighth object, thirteenth object, fourteenth object, and sixteenth object on the display screen.

In addition, when the object displayed on the display unit 230 is a widget of the application, if the length of one side of the enlarged object is the same as the length of one side of the display unit 230, the control unit 290 displays the widget of the application. It can be converted to an execution screen.

Specifically, as illustrated in the first screen of FIG. 20C, when a user interaction of touching the first object in the form of a widget and dragging it to an area in which the eighth object is displayed is detected, the controller 290 of the first object It can increase the size and convert the first object in the form of a widget into an application screen.

Then, when a user interaction that scrolls a region in which the second to ninth objects are displayed is detected, the controller 290 fixes the first object, and the second to fifth objects among the second to ninth objects are fixed. The display unit 230 may be controlled to remove the display screen, move the positions of the sixth to ninth objects upward, and add the tenth to thirteenth objects newly.

Then, as illustrated in the third drawing of FIG. 20C, when a user interaction of touching the third point 2030 of the first object and dragging it to the fourth point 2040 is detected, the controller 290 may As shown in the fourth drawing of 20c, while reducing the size of the first object, the positions of the ninth and thirteenth objects are moved upward, and a display unit is displayed to display the 14th and 15th objects, which are new objects. (230) can be controlled.

Then, as illustrated in the fourth drawing of FIG. 20C, when a user interaction touching the fifth point 2050 of the first object and dragging it to the sixth point 2060 is detected, the controller 290 may As shown in the fifth drawing of 20c, while reducing the size of the first object, the ninth object is removed from the display screen, and the sixth object, the seventh object, the eighth object, and the tenth to fifteenth objects are different. The display unit 230 may be controlled to move upward and display new objects 16th to 19th objects.

Also, the control unit 290 may change contents included in the first object differently according to the number of square cells occupied by the first object on the grid screen.

Specifically, when an object for a photo application is located in one square cell, the control unit 290 displays the icon corresponding to the photo application as an object 2110, as shown in FIG. 21A. Can be controlled.

Then, when the object for the photo application is located in four square cells, the control unit 290, as shown in Figure 21b, the object 2120 containing the brief information (for example, stored photo information) of the photo application ), the display 230 may be controlled.

Then, when an object for a photo application is located in nine square cells, the control unit 290, as shown in Figure 21c, detailed information of the photo application (eg, thumbnail image information for a recently taken photo, etc.) ), the display 230 may be controlled to display the object 2130.

And, when the object for the photo application is located in 16 square cells, the control unit 290, as shown in Figure 21d, an object 2140 including an execution screen (for example, a photo list, etc.) of the photo application ), the display 230 may be controlled.

On the other hand, as described above, there are only four embodiments of different shapes depending on the number of square cells or the size of the objects occupied by the object, and may include other multiple steps. For example, the controller 290 may display the object differently in three steps according to the number of square cells occupied by the object or the size of the object.

Specifically, as illustrated in FIG. 22A, when the object is an object corresponding to the watch application, when the size of the object occupies the first number of square cells, the controller 290 is an object in the form of an icon corresponding to the watch application The display 230 may be controlled to display 2211. Then, when the size of the object occupies the second number of square cells, the control unit 290 may control the display unit 230 to display the object 2213 in a simple clock form. Then, when the size of the object occupies the third number of square cells, the control unit 290 displays the object 2215 in a detailed clock form (ie, a clock form including second hand and minute intervals). Can be controlled.

Then, as illustrated in FIG. 22B, when the object is an object corresponding to a weather application, when the size of the object occupies the first number of square cells, the controller 290 may generate an object (in the form of an icon corresponding to the weather application). The display unit 230 may be controlled to display 2221. Then, when the size of the object occupies the second number of square cells, the control unit 290 displays the object 2231 including brief weather information (for example, current weather in a region where the user is located). (230) can be controlled. Then, when the size of the object occupies a third number of square cells, the control unit 290 displays the object 2225 including detailed weather information (for example, current weather and future weather information). 230) can be controlled.

And, as shown in Figure 22c, when the object is an object corresponding to the phone application, if the size of the object occupies the first number of square cells, the control unit 290 is an object in the form of an icon corresponding to the phone application ( 2231), the display 230 may be controlled. Then, when the size of the object occupies the second number of square cells, the control unit 290 may control the display unit 230 to display the object 2233 including two contact information. Then, when the size of the object occupies the third number of square cells, the control unit 290 may control the display unit 230 to display the object 2235 including the phone screen including five contact information. .

And, as shown in Figure 22d, when the object is an object corresponding to the video sharing application, if the size of the object occupies the first number of square cells, the control unit 290 in the form of an icon corresponding to the video sharing application The display 230 may be controlled to display the object 2241. Then, when the size of the object occupies the second number of square cells, the control unit 290 may control the display unit 230 to display the object 2243 that includes a thumbnail image of a specific video. Then, when the size of the object occupies the third number of square cells, the control unit 290 may control the display unit 230 to display the object 2245 including the video execution screen.

And, as shown in Figure 22e, when the object is an object corresponding to the email application, if the size of the object occupies the first number of square cells, the control unit 290 is an object in the form of an icon corresponding to the email application ( 2251), the display 230 may be controlled. Then, when the size of the object occupies the second number of square cells, the control unit 290 displays the object 2253 including brief information of the received email (eg, sender name, subject, etc.) (230) can be controlled. Then, when the size of the object occupies the third number of square cells, the control unit 290 includes an object (2255) containing detailed information of the received email (eg, sender's name, subject, received date, email content, etc.) ), the display 230 may be controlled.

And, as shown in Figure 22f, when the object is an object corresponding to the SNS application, if the size of the object occupies the first number of square cells, the control unit 290 object in the form of an icon corresponding to the SNS application ( 2261), the display 230 may be controlled. Then, when the size of the object occupies the second number of square cells, the control unit 290 displays the object 2263 including brief information of the recently updated article (eg, the author, some contents of the article). The display 230 can be controlled to do so. Then, when the size of the object occupies the third number of square cells, the control unit 290 includes an object 2265 including detailed information (eg, a profile image, a recommendation icon, a comment, etc.) of the recently updated article. The display 230 may be controlled to display.

Hereinafter, as described above with reference to FIGS. 23A to 23D, the number of square cells occupied by an object is adjusted according to user interaction on a grid screen, and the shape of the content displayed on the object where the number of cells is adjusted is changed. Let me explain an example.

As shown in FIG. 23A, the display 230 displays 16 objects 2310-1 to 2310-16 on a grid screen. At this time, the 16 objects 2310-1 to 2310-16 may each include icons of corresponding applications.

Then, if a user interaction toward the upper right direction is detected after touching the sixth object 2310 corresponding to the SNS application among the 16 objects 2310-1 to 2310-16, the controller 290 controls the sixth object ( 2310-6) increases the size of the sixth object 2310-6 so that it occupies four cells, and the sixth object 2310-6 including an icon includes brief information about the latest updated article. The display unit 230 may be controlled to change to 2320 to display. At this time, the control unit 290 may control the display unit 230 to remove the first object 2310-1, the second object 2310-2, and the fifth object 2310-5 from the display screen.

Then, as illustrated in FIG. 23C, when the user interaction of dragging the object 2320 including brief information about the latest updated article in the lower right direction is detected, the control unit 290 displays the latest updated article. The size of the sixth object 2320 is increased so that the object 2320 containing the brief information occupies 9 cells, and the object 2320 containing the brief information about the latest updated text is used for the latest updated text. The display unit 230 may be controlled to be displayed by changing to an object 2330 including detailed information. In this case, the control unit 290 may include a third object 2310-3, a seventh object 2310-7, a ninth object 2310-9, a tenth object 2310-10, and an eleventh object 2310-11. ), the display 230 may be controlled to be removed from the display screen.

Then, as illustrated in FIG. 23D, when the user interaction dragging the object 2330 including detailed information on the latest updated article in the lower right direction is detected, the control unit 290 displays the latest updated article. The size of the sixth object 2330 is increased so that the object 2330 including detailed information occupies all 16 cells, and the SNS application execution screen is displayed on the object 2330 containing detailed information about the latest updated article. The display unit 230 may be controlled to change and display the included object 2340. At this time, the controller 290 displays the fourth object 2310-4, the eighth object 2310-8, and the twelfth object 2310-12 to the sixteenth object 2310-16 from the display screen. (230) can be controlled.

In addition, when the number of square cells occupied by the object increases according to user interaction, the controller 290 may change the size and content of the object in different ways according to the shape of the object displayed on the plurality of square cells.

Specifically, as illustrated in FIG. 24A, when a user interaction that touches an object 2410 displaying a chat screen on four square cells and drags it in the bottom right direction is detected, the control unit 290 displays the content of the chat screen. The size of the object 2415 can be increased to display the chat screen in nine square cells by increasing the aspect ratio without changing.

In addition, as illustrated in FIG. 24B, when a user interaction that touches an object 2420 displaying a chat screen on four square cells and drags it to the right direction is detected, the controller 290 chats on the four square cells. The size of the object 2425 may be increased to display a screen and display a menu related to a chat application in two cells.

In addition, as illustrated in FIG. 24C, when a user interaction of touching an object 2430 displaying a chat screen on 9 square cells and dragging it to the left is detected, the control unit 290 chats on the 9 square cells The size of the object 2435 may be increased to display a screen and display chat targets in three cells.

In addition, as illustrated in FIG. 24D, when a user interaction of touching an object 2440 displaying a chat screen on four square cells and dragging it in a downward direction is detected, the control unit 290 displays more chat contents than before. The size of the object 2435 may be increased to display a chat screen.

In addition, when a user interaction is input while displaying image content on a plurality of square cells, the controller 290 may enlarge or reduce the image content according to the position of the square cell to which the user interaction is input and the direction of the user interaction. .

Specifically, as illustrated in FIG. 25A, after the photo content 2510 is displayed in two square cells, the first point 2511 of the photo content is touched and then dragged to the right to the second point 2513 When a user interaction is detected, the control unit 290 may control the display unit 230 to display an enlarged image 2520 of the cell located at the top of the two square cells, as shown on the right side of FIG. 25A. have.

In addition, as illustrated in FIG. 25B, a user touching the third point 2515 of the photo content and dragging it to the right direction to the fourth point 2517 while the photo content 2510 is displayed on the two square cells. When an interaction is detected, the control unit 290 may control the display unit 230 to display an enlarged image 2530 of the cell located at the bottom of the two square cells, as shown on the right side of FIG. 25B. .

In addition, as illustrated in FIG. 25C, a user touching the third point 2515 of the photo content and dragging diagonally to the fifth point 2519 while the photo content 2510 is displayed on the two square cells. When an interaction is detected, the control unit 290 displays the display unit 230 to display the image 2540 of the photograph content 2510 as a whole, so as to be displayed in eight square cells, as shown in the right side of FIG. 25B. Can be controlled.

In addition, when a user interaction of touching and dragging two fingers simultaneously while one object is displayed on the grid screen is detected, the controller 290 moves the object according to the user interaction, and moves the user terminal device 200. The display 230 may be controlled to display a menu for controlling.

Specifically, as illustrated in FIG. 26A, when a user interaction of simultaneously touching two fingers on a specific application screen 2610 and dragging in the lower left direction is detected while the specific application screen 2610 is displayed, the control unit ( 290) may control the display unit 230 to move the specific application screen 2610 in the bottom left direction and to display the menu 2620 corresponding to various functions provided by the user terminal device on the upper and right sides of the display screen. have.

In addition, when two user fingers are simultaneously touched on the specific application screen 2610 while dragging in the right direction while the specific application screen 2610 is displayed, the controller 290 displays the specific application screen 2610. The display unit 230 may be controlled to move in the right direction and display a menu 2630 corresponding to various functions provided by the user terminal device on the left side of the display screen.

In this case, the menu generated as the specific application screen 2610 moves may include different menus according to the display location. For example, the menu displayed in the upper area is a notification menu such as received message guidance, received telephone guidance, received email guidance, etc., and the menu displayed on the left or right side is a menu for executing frequently used applications. The menu displayed on the vertex area may be a menu that moves to the home screen.

In addition, when a user interaction for touching and dragging two fingers is input multiple times, the controller 290 may control the display 230 to move the application screen and display a new application screen according to the user interaction. .

Specifically, as illustrated in FIG. 27A, when two fingers are simultaneously touched on the first application screen 2710 while the first application screen 2710 is displayed and then a user interaction dragging in the lower left direction is detected, As illustrated in FIG. 27B, the control unit 290 moves the first application screen 2710 ′ in a lower left direction and displays a portion of the second application screen 2720 in upper and right areas of the display screen. The control unit 230 may be controlled. In this case, the second application may be an application executed before the first application.

In addition, as illustrated in FIG. 27C, after simultaneously touching two fingers on the second application screen 2720 while the first application screen 2710 ′ and the second application screen 2720 are simultaneously displayed, the lower left direction When a user interaction dragging to is detected, the control unit 290 moves the first application screen 2710 ″ and the second application screen 2720 ′ in the bottom left direction as shown in FIG. 27D, and displays The display 230 may be controlled to display a part of the third application screen 2730 in upper and right areas of the screen. In this case, the third application may be an application executed before the second application.

On the other hand, while the first application screen 2710' and the second application screen 2720 are simultaneously displayed, user interaction by simultaneously touching two fingers on the first application screen 2710' and dragging in the lower left direction is detected. If it is, the control unit 290 may continue to move the first application screen 2710' in the bottom left direction, and expand the area where the second application screen 2720 is displayed.

When a user interaction dragging after touching an intersection of an area in which a plurality of objects is displayed is detected, the controller 290 may adjust the screen division ratio for the plurality of objects and the number of displayed objects according to the user interaction.

Specifically, as illustrated in FIG. 28A, when four objects are displayed and a user interaction moving in the right direction by one square cell size is detected after touching an intersection, the control unit 290 is illustrated in FIG. 28B As described above, the sizes of the first and third objects may be increased, and the sizes of the second and fourth objects may be reduced.

In addition, as illustrated in FIG. 28B, when a user interaction that moves downward by one square cell size after touching an intersection while four objects are displayed is detected, the control unit 290 is illustrated in FIG. 28B. As described above, the sizes of the first and second objects may be increased, and the sizes of the third and fourth objects may be decreased.

In addition, as illustrated in FIG. 28C, when four objects are displayed and a user interaction moving in the right direction by one square cell size is detected after touching an intersection, the control unit 290 is shown in FIG. 28D As described above, the sizes of the first and third objects may be increased, and the second and fourth objects may be removed from the display screen.

In addition, as illustrated in FIG. 28D, when two objects are displayed and a user interaction moving downward by one square cell size is detected after touching an intersection, the control unit 290 is shown in FIG. 28E. As described above, the size of the first object may be increased, and the third object may be removed from the display screen.

As described above, by touching and dragging the intersection, it is possible to simultaneously control the aspect ratio of an object capable of performing a plurality of tasks and the number of objects.

When a user interaction (that is, a long press interaction) that touches an intersection point of an area in which a plurality of objects is displayed is preset, a control unit 290 generates a new object by integrating a plurality of objects sharing the intersection point. The display 230 may be controlled to display.

Specifically, as illustrated in FIG. 29A, while the first to ninth objects 2910-1 to 2910-9 are displayed, the first object 2910-1, the second object 2910-2, and the When a user interaction that touches a crossing point of the 4th object 2910-4 and the 5th object 2910-5 at a preset time is detected, the controller 290 controls the first object 2910-1 and the second object 2910 -2), the display unit 230 may be controlled to display the tenth object 2920 by integrating the fourth object 2910-4 and the fifth object 2910-5.

And, when a user interaction is detected that touches the intersection of the tenth object 2920, the sixth object 2910-6, the eighth object 2910-8, and the ninth object 2910-9 at a preset time, The control unit 290 displays the new eleventh object 2930 by integrating the tenth object 2920, the sixth object 2910-6, the eighth object 2910-8, and the ninth object 2910-9. The display 230 can be controlled to do so.

Alternatively, when a user interaction that touches an intersection of the tenth object 2920, the third object 2910-3, and the sixth object 2910-6 for a preset time is detected, the controller 290 controls the tenth object ( 2920 ), the display unit 230 may be controlled to display the new twelfth object 2940 by integrating the third object 2910-3 and the sixth object 2910-6.

In particular, when a plurality of objects are a plurality of application execution icons, when a long press interaction is detected at a crossing point of a plurality of objects, the control unit 290 may create an upper folder of objects sharing the intersection where the long press interaction is detected. have.

Specifically, as illustrated in FIG. 29B, while displaying the first to ninth running icons 2950-1 to 2950-9, the first running icon 2950-1 and the second running icon 2950- 2), when an interaction of long pressing the intersection of the fourth execution icon 2950-4 and the fifth execution icon 2950-5 is detected, the control unit 290 may display the first execution icon 2950-1, the second The run icon 2950-2, the fourth run icon 2950-4, and the fifth run icon 2950-5 are removed from the display screen, and the first run icon 2950-1 and the second run icon 2950 -2), the display 230 may be controlled to display the SNS folder 2960, which is an upper folder of the fourth execution icon 2950-4 and the fifth execution icon 2950-5. At this time, the folder name may be specified by the user.

In particular, when a plurality of objects are a plurality of content icons, when a long press interaction is detected at an intersection of a plurality of objects, the controller 290 generates a play list including contents sharing the intersection where the long press interaction is detected. Can.

Specifically, as illustrated in FIG. 29C, while displaying the first content icon to the ninth content icon 2960-1 to 2960-9, the first content icon 2960-1 and the second content icon 2960- 2), when an interaction of long-pressing the intersection of the fourth content icon 2960-4 and the fifth content icon 2960-5 is detected, the controller 290 may display the first content icon 2960-1 and the second. The content icon 2960-2, the fourth content icon 2950-4, and the fifth content icon 2960-5 are removed from the display screen, and the first content icon 2960-1 and the second content icon 2960 are removed. -2), the display 230 may be controlled to display the POP lease 2970, which is a play list including the fourth content icon 2960-4 and the fifth content icon 2960-5. At this time, the name of the play list may be specified by the user.

When a user interaction of touching and dragging one of the intersections of a plurality of objects located on one side of the display screen is detected, the controller 290 may adjust the number of objects displayed on the display screen.

Specifically, as shown in FIG. 30A, while displaying the first to third objects 3010 to 3030, touch the intersection of the first object 3010 and the third object 3030 and then drag in the right direction When a user interaction is detected, the control unit 290 increases the size of the first object 3010 and decreases the sizes of the second object 3020 and the third object 3030, and the third object 3030 The display 230 may be controlled to display the fourth object 3040 at the bottom of the screen.

And, while displaying the first to fourth objects 3010 to 3040, when a user interaction touching the intersection of the first object 3010 and the fourth object 3040 and dragging in the right direction is detected, the control unit 290 increases the size of the first object 3010, decreases the size of the second to fourth objects 3040 to 3030, and reduces the size of the fifth object 3050 to the bottom of the fourth object 3040. The display 230 may be controlled to display.

In particular, as shown in FIG. 30B, the intersection of the news content 3060 and the second photo content 3080 while the news content 3060 and the first photo content 3070 and the second photo content 3080 are displayed. If a user interaction dragging in the right direction after touching is detected, the control unit 290 increases the size of the news content 3060, and increases the size of the first photo content 3070 and the second photo content 3080. The display unit 230 may be controlled to reduce and display the new third photo content 3090. Then, when a user interaction continuously dragging in the right direction is detected, the controller 290 may control the display 230 to generate and display a new fourth photo content 3095. At this time, the first to fourth photo content (3070, 3080, 3090, 3095) may be a picture related to the news content (3060).

In addition, the control unit 290 may provide different functions for the main object according to the number of line segments that the main object abuts among the plurality of line segments included in the display unit 230. Specifically, the control unit 290, as shown in Figure 31a, when the main object 3110 is in contact with the display unit 230 and the four segments, as shown in Figure 31b, the main object 3120 is the display unit When it is in contact with the 230 and two line segments, as shown in FIG. 31C, when the main object 3130 contacts the display unit 230 and one line segment, as shown in FIG. 31D, the main object 3140 is When a line segment does not come into contact with the display 230, different functions may be provided.

Specifically, when the main object is an object corresponding to a telephone application, as shown in FIG. 31A, when the main object 3150 touches four lines of the display 230, the control unit 290 is a user terminal device The 200 may be controlled to perform a telephone function. In addition, as illustrated in FIG. 31B, when the main object 3160 touches two line segments of the display unit 230, the control unit 290 may pause the telephone function of the user terminal device 200 for a while. Can be controlled. In addition, as illustrated in FIG. 31C, when the main object 3170 touches a line segment of the display unit 230, the control unit 290 simultaneously performs other functions as well as a telephone function by the user terminal device 200. You can enter multi-tasking mode. In addition, as illustrated in FIG. 31D, when the main object 3180 does not contact one line segment of the display 230, a user interaction dragging another object 3190 to the area where the main object 3180 is displayed. When this is detected, the control unit 290 may control the communication unit 240 to share content corresponding to another object 3190 with the other party of the phone call.

When the mode of the user terminal device 200 is a general mode other than the grid editing mode, when a user interaction of selecting and dragging one of a plurality of objects is detected, the controller 290 is connected to the selected object in an area corresponding to the drag direction. The display unit 230 may be controlled to display items.

Specifically, as illustrated in FIG. 32A, when a user interaction dragging the sixth object is detected while the first to sixteenth objects are displayed, the controller 290 displays the seventh and eighth objects on the display screen. In addition, the display unit 230 may be controlled to display items 6'and 6'for the sixth object in an area where the seventh object and the eighth object are displayed.

Looking at a specific embodiment, as shown in FIG. 32B, while displaying a plurality of objects 3210-1 to 3210-16 corresponding to a plurality of applications, a sixth application 3210-6 corresponding to an SNS application is displayed. When a user interaction dragging in the right direction is detected, the control unit 290 displays recently updated articles 3220, which are execution items of the SNS application, in the areas where the seventh object 3210-7 and the eighth object 3210-8 are displayed. The display unit 230 may be controlled to display. In this case, the recently updated articles 3220 and 3225 may be larger than one square cell, but this is only an example, and the recently updated articles 3220 and 3225 may be displayed in one square cell, respectively. .

Further, as shown in FIG. 32C, while displaying a plurality of objects 3210-1 to 3210-16 corresponding to a plurality of applications, drag the second application 3210-2 corresponding to the contact application downward. When a user interaction is detected, the control unit 290 displays the execution item of the contact application in the area where the sixth object 3210-7, the tenth object 3210-10, and the fourteenth object 3210-14 are displayed. The display 230 may be controlled to display information 3230 and 3235 about the contact information. At this time, the information about the recently contacted contact (3230,3235) may be larger than one square cell, but this is only an example, and the information about the recently contacted contact (3230,3235) is one square cell Can be displayed on each.

<between multiple user terminal devices contents Share>

According to another embodiment of the present invention, as shown in FIG. 33, a plurality of user terminal devices 200-1,200-2,200-3,200-4 having a square display panel share content when a predetermined condition is satisfied can do. Specifically, since the display panel has a square shape having the same length and width, when a plurality of user terminal devices 200-1, 200-2, 200-3, and 200-4 touch one line segment regardless of the direction, the user terminal touches the line segment Content can be shared between devices.

At this time, the plurality of user terminal devices 200-1, 200-2, 200-3, 200-4 may determine the proximity direction through various methods. In one embodiment of the present invention, the plurality of user terminal devices 200-1,200-2,200-3,200-4 may determine the proximity direction using NFC communication technology. Specifically, each of the plurality of user terminal devices 200-1,200-2,200-3,200-4 includes four NFC chips 244 on four sides, and when the NFC chips 244 included in abutting segments are tagged with each other , It is possible to determine a proximity direction between user terminal devices. In another embodiment of the present invention, the plurality of user terminal devices 200-1,200-2,200-3,200-4 may use the infrared sensor to determine the proximity direction between the user terminal devices. Specifically, each of the plurality of user terminal devices 200-1,200-2,200-3,200-4 includes four infrared sensors on four sides, and the proximity direction between the user terminal devices can be determined through the infrared sensor. Also, the plurality of user terminal devices 200-1, 200-2, 200-3, 200-4 may use a touch sensor to determine whether a line segment touches the user terminal devices. However, as described above, it is only an embodiment to determine whether the proximity direction and the line segment between the user terminal devices are contacted using the NFC communication technology, the infrared sensor, and the touch sensor, and the user terminal using another method It may be determined whether the proximity direction and the line segments between the devices are in contact.

At this time, the plurality of user terminal devices 200-1, 200-2, 200-3, 200-4 may determine the connection state by determining the sides that are in contact with each other, and display a sharing area capable of sharing content based on the connection state. Then, when a user interaction dragging the content icon displayed on one of the plurality of user terminal devices 200-1,200-2,200-3,200-4 to the shared area is detected, the content corresponding to the detected content icon is displayed. It can be shared with other user terminal devices.

Specifically, when the right segment of the first user terminal device 200-1 and the left segment of the second user terminal device 200-2 contact, the first user terminal device 200-1 and the second user terminal device (200-2) determines the connection state through at least one sensor, and as shown in FIG. 34A, based on the determined connection state, displays the shared area 3401 in the lower area of the line segment that the user terminal device abuts. can do.

In addition, the right line segment of the first user terminal device 200-1 and the left line segment of the second user terminal device 200-2 contact, and the bottom line segment and the third user of the first user terminal device 200-1 When the upper line segment of the terminal device 200-3 comes into contact, the first to third user terminal devices 200-1 to 200-3 determine a connection state through at least one sensor, as shown in FIG. 34B. Similarly, based on the determined connection state, the shared area 3411 may be displayed in an area where three user terminal devices abut.

In addition, the right line segment of the first user terminal device 200-1 and the left line segment of the second user terminal device 200-2 contact, and the bottom line segment and the third user of the first user terminal device 200-1 The upper line segment of the terminal device 200-3 abuts, the lower line segment of the second user terminal device 200-2 and the upper line segment of the fourth user terminal device 200-4 abut, and the third user terminal device When the right line segment of (200-3) and the left line segment of the fourth user terminal device (200-4) are in contact, the first to fourth user terminal devices (200-1 to 200-4) may pass through at least one sensor. The connection state may be determined, and as illustrated in FIG. 34C, the shared area 3421 may be displayed in an area where four user terminal devices abut based on the determined connection state.

In addition, the right line segment of the first user terminal device 200-1 and the left line segment of the second user terminal device 200-2 contact, and the right line segment of the second user terminal device 200-2 and the third user When the left line segment of the terminal device 200-3 contacts, the first to third user terminal devices 200-1 to 200-3 determine a connection state through at least one sensor, as shown in FIG. 34D. Likewise, based on the determined connection state, the shared area 3431 may be displayed in the lower area of the line segment where the first user terminal device 200-1 and the second user device 200-2 contact, and the second user The shared area 3432 may be displayed in the lower area of the line segment where the terminal device 200-2 and the third user terminal device 200-3 contact.

In addition, the right line segment of the first user terminal device 200-1 and the left line segment of the second user terminal device 200-2 contact, and the right line segment of the second user terminal device 200-2 and the third user When the left line segment of the terminal device 200-3 contacts, and the upper line segment of the third user terminal device 200-3 and the bottom line segment of the fourth user terminal device 200-4 contact, the first to fourth lines The user terminal devices 200-1 to 200-4 determine a connection state through at least one sensor, and as shown in FIG. 34E, the first user terminal device 200-1 based on the determined connection state. And the second user terminal device 200-2 may display the shared area 3344 in the lower area of the line segment, and the second to fourth user terminal devices 200-2 to 200-4 may be displayed. The shared area 3442 may be displayed on the abutting area.

Meanwhile, the shared area may be implemented in various forms. Specifically, as illustrated in FIG. 35, one user terminal device displays the shared area 3510 in a fan shape, and one user terminal device displays the shared area 3520 in a triangular form, and one The user terminal device of the may display the shared area 3530 in a form excluding the fan shape in the semicircle.

In addition, the plurality of user terminal devices 200-1,200-2,200-3,200-4 display a shared area after being connected to each other, and when the shared areas are connected to each other, content can be shared.

Specifically, as illustrated in FIG. 36A, the first shared area 3610-1 is displayed at the bottom right of the first user terminal device 200-1, and the upper right side of the second user terminal device 200-2 is displayed. The second shared area 3610-2 is displayed on the screen, the third shared area 3610-3 is displayed on the lower left of the third user terminal device 200-3, and the fourth user terminal device 200-4 is displayed. ), in the state where the fourth shared area 3610-4 is present at the bottom right, as shown in FIG. 36B, four user terminal devices 200-1 to 200-4 may be connected to each other. In addition, when the second user terminal device 200-2 is rotated 180 degrees clockwise, the first sharing area 3610-1 and the second sharing area 3610-2 may connect to each other. When the first shared area 3610-1 and the second shared area 3610-2 are connected, one of the first user terminal device 200-1 and the second user terminal device 200-2 is the content as the other. Can send.

Looking at a specific embodiment, the first user terminal device to the fourth user terminal device 200-1 to 200-4 may display one video content 3710 as shown in FIG. 37B in close proximity to each other. . In this case, the image content 3710 may be stored in the second user terminal device 200-2. In addition, when operating in the sharing mode, the four user terminal devices 200-1 to 200-4 may display the sharing areas 3721, 3723, 3725, 3767 respectively, as illustrated in FIG. 37B. Then, when the second user terminal device 200-2 rotates 180 degrees clockwise, the first shared areas 3721 and 3723 are connected to each other, as illustrated in FIG. 37C, when the second user terminal device 200-2 is connected to each other. 2) may transmit the data of the video content 3710 to the first user terminal device 200-1. During transmission, an icon 3731 indicating a file format of image content may be displayed. After the file transfer is completed, the first user terminal device to the fourth user terminal device 200-1 to 200-4 may again display one image content 3710 as illustrated in FIG. 37D.

In addition, when a plurality of user terminal devices 200-1 to 200-4 are connected to each other, the plurality of user terminal devices 200-1 to 200-4 may provide various types of group playback functions.

Specifically, as illustrated in FIG. 38, the fourth user terminal device 200-4 while the first to third user terminal devices 200-1 to 200-3 simultaneously display a map screen for a specific area. When is connected, the fourth user terminal device 200-4 may further display the west area of the specific area. However, when the first to third user terminal devices 200-1 to 200-3 push the third user terminal device 200-3 to the left while simultaneously displaying the map screen for a specific area, the third The user terminal device 200-3 may determine a distance from the second user terminal device 200-2 and further display a western area of a specific area based on the distance.

As described above, various types of content sharing and group playback functions are possible using a plurality of user terminal devices having a square display panel.

< Folding Interaction >

According to an embodiment of the present invention, when a folding interaction folding over a predetermined angle based on the hinge part 310 is detected, the control unit 290 changes the object displayed in the plurality of square cells to another object to display The display 230 may be controlled. At this time, the control unit 290 may detect that folding interaction has occurred when a predetermined angle is folded by using the bending detection unit 283 including the bending sensor.

Specifically, as illustrated in FIG. 39, when folding interaction is detected while the first to ninth objects 3910-1 to 3910-9 are displayed in a square cell, the control unit 290 controls the first object to The display unit 230 may be controlled to remove the ninth objects 3910-1 to 3910-9 from the display screen and display new 10th to 18th objects 3920-1 to 3920-2.

In particular, when a folding interaction is detected after touching one of the plurality of square cells, the controller 290 changes the object existing in the row including the touched square cell to another object, and the object existing in the other row Can be maintained without changing.

Specifically, as shown on the left side of FIG. 40A, after the fourth object 3910-4 is touched while the first to ninth objects 3910-1 to 3910-9 are displayed, folding interaction is sensed. When the control unit 290 is shown in the right side of FIG. 40A, the second row of objects including the fourth object 3910-4 is the new 10th to 12th objects 3930-1 to 3930-3. The display unit 230 may be controlled to change to and maintain the objects displayed in the remaining 1 and 3 rows.

In addition, as shown on the left side of FIG. 40B, after the seventh object 3910-7 is touched while the first to ninth objects 3910-1 to 3910-9 are displayed, when folding interaction is detected , As shown on the right side of FIG. 40B, the control unit 290 converts three rows of objects including the seventh object 3910-7 into new 10th to 12th objects 3930-1 to 3930-3. The display unit 230 may be controlled to change and maintain the objects displayed in the remaining 1 and 2 rows.

Looking at a specific embodiment, as shown in the second screen of FIG. 41A, folding interaction folding the left display panel in the direction of the right display panel while displaying the general map screen 4110 in the first square cell to the ninth square cell. When this is detected, the control unit 290 may change the general map screen 4110 displayed in a plurality of square cells to a traffic situation screen 4111, as shown in the first screen of FIG. 41A. When the folding interaction of folding the right display panel in the direction of the left display panel is detected while displaying the general map screen 4110 in the first square cell to the ninth square cell, as shown in the second screen of FIG. 41A, the control unit As illustrated in the third screen of FIG. 41A, 290 may change the general map screen 4110 to a satellite map screen 4113. And, as shown in the screen shown in the third of Figure 41a, when the folding interaction of folding the right display panel in the direction of the left display panel is detected while displaying the satellite map screen 4113 in the first square cell to the ninth square cell. , The controller 290 may change the satellite map screen 4113 to an AR screen 4115, as shown in the fourth screen of FIG. 41A. That is, when the folding interaction is detected, the controller 290 may change the map display mode based on the direction in which the folding interaction is detected.

However, as shown in the second screen of FIG. 41B, after displaying the general map screen 4120 in the first square cell to the ninth square cell, after touching the square cell included in the second row, the left display panel When folding interaction is detected in the direction of the right display panel, the control unit 290 maintains the normal map mode in rows 1 and 3, and in the traffic situation mode 2, as shown in the first screen of FIG. 41B. The display 230 may be controlled to display the screen 4121 changed to. However, as shown in the second screen of FIG. 41B, after displaying the general map screen 4120 in the first square cell to the ninth square cell, after touching the square cell included in the second row, the right display panel When folding interaction is detected in the direction of the left display panel, the control unit 290 maintains a normal map mode in rows 1 and 3, and a satellite map mode in row 2, as shown in the third screen of FIG. 41B. The display 230 may be controlled to display the screen 4123 changed to. Then, as shown in the third screen of FIG. 41B, the square included in the second row while displaying the screen 4123 simultaneously displaying the general map mode and the satellite map mode in the first square cell to the ninth square cell. After the touch of the cell, when a folding interaction in which the right display panel is folded in the direction of the left display panel is detected, the control unit 290, as shown in the fourth screen of FIG. 41B, rows 1 and 3 are in a normal map mode. It is maintained, and the display unit 230 may be controlled to display the screen 4125 in which two rows are changed to the AR mode. That is, when a folding interaction is detected after touching a specific square cell, the controller 290 may control the display 230 to change only the row containing the touched square cell.

In addition, after a specific square cell is touched while displaying the main content in a plurality of square cells, when a folding interaction is detected, the controller 290 differs in a column containing the specific square cell according to the touched position of the specific square cell. You can provide content or menus.

Specifically, as illustrated in FIG. 42A, after a ninth square cell is touched while displaying image content on nine square cells, if folding interaction is detected, the controller 290 displays the content related to the image content in the third column. The display 230 may be controlled to display 4210. In a specific embodiment, as illustrated in FIG. 42B, after touching the ninth square cell while displaying news content in nine square cells, if folding interaction is detected, the control unit 290 displays the news content in the third column. The display 230 may be controlled to display three related news 4220 for.

In addition, as illustrated in FIG. 43A, after touching the seventh square cell while displaying image content on nine square cells, if folding interaction is detected, the control unit 290 displays the user terminal device 200 in the first column. The display 230 may be controlled to display a menu 4310 for controlling the function of. In a specific embodiment, as illustrated in FIG. 43B, after touching the seventh square cell while displaying news content in nine square cells, if folding interaction is detected, the control unit 290 displays the user terminal device in the first column. The display 230 may be controlled to display the menu 4230 for.

Also, the control unit 290 may divide or integrate the display screen using folding interaction and rotation interaction.

Specifically, as illustrated in the first screen of FIG. 44, when folding interaction is detected based on the hinge unit 310 while displaying one image content 4410, the control unit 290 may control the second of FIG. 44. As illustrated on the screen, the display 230 may be controlled to divide the display screen into two and display two image contents 4420 and 4525. In addition, as shown in the second screen of FIG. 44, while two image contents 4420 and 4525 are displayed, a sensor for detecting rotation of the user terminal device 200 (eg, a tilting sensor, a gyro sensor, an acceleration sensor, etc.) When a rotation interaction that rotates 45 degrees clockwise through is detected, the control unit 290 displays two image contents 4420' and 4425' to maintain the dividing line of the two screens as shown in the third screen of FIG. The display unit 230 may be controlled to rotate and display. Then, as shown in the third screen of FIG. 44, when folding interaction is detected in a state in which two video contents 4420' and 4425' are divided, the controller 290 is shown in the fourth screen of FIG. 44. As shown, the display unit 230 may be controlled to divide the display screen into four and display four image contents 4431, 4333, 4435 and 4375.

In addition, as illustrated in the first screen of FIG. 45, when folding interaction is detected based on the hinge unit 310 while the six image contents 4511 to 4416 are displayed, the control unit 290 controls the hinge unit ( 310), the display 230 may be controlled to display four image contents 4521,4523,4525,4527 by removing the dividing line displayed based on the second screen of FIG. have. Then, as illustrated in the second screen of FIG. 45, when four video contents 4521,4523,4525,4527 are displayed, rotation control that rotates 45 degrees clockwise is detected. As shown in the third screen of FIG. 44, the display 230 is controlled to rotate and display the four image contents 4521',4523',4525',4527' to maintain the dividing lines of the four screens. can do. And, as shown in the third screen of FIG. 44, when the folding interaction is detected based on the hinge unit 310 while the four image contents 4521', 4523', 4525', 4527' are displayed, The control unit 290 removes the dividing line displayed based on the hinge unit 310 to display the display unit 230 to display two image contents 4531 and 4533 as shown in the fourth screen of FIG. 45. Can be controlled.

Also, the screen may be switched as the three-dimensional cube rotates the control unit 290 according to the direction of the hinge unit 310. Specifically, as illustrated in FIG. 46A, when folding interaction is detected in a state in which the hinge unit 310 is vertical, the control unit 290 rotates the cube in the horizontal direction, such as “A screen -> B screen -> C screen-> D screen -> A screen ->....." In addition, as illustrated in FIG. 46B, when folding interaction is detected in a state in which the hinge unit 310 is horizontal, the control unit 290 rotates the cube vertically, such as “A screen -> B screen- > C screen-> D screen -> A screen ->....."

In addition, when folding interaction of folding the user terminal device 200 at a preset angle is detected while the user holds the user terminal device 200 while the image content is being displayed, the controller 290 is an area that the user grips. The control unit 230 may control the display unit 230 to display at least one icon for controlling at least one of the user terminal device 200 and the video content in an area gripped by the user. At this time, the controller 290 may determine a region gripped by the user using a proximity sensor or a touch sensor located on the bezel 320.

Specifically, as illustrated in FIG. 47A, when a folding interaction of folding the user terminal device 200 at a predetermined angle is detected while the user grips the bottom of the user terminal device 200 while the image content is being displayed. , The control unit 290 detects that the user grips the bottom of the user terminal device 200 through the sensor included in the bezel 320, and controls the user terminal device 200 at the bottom of the display unit 230 The display 230 may be controlled to display a plurality of icons 4710-1 to 4710-4. At this time, the plurality of icons 4710-1 to 4710-4 may include icons for entering the home screen, icons for executing frequently used applications, icons for changing the settings of the user terminal device 200, and the like. have.

In addition, as illustrated in FIG. 47B, when a folding interaction of folding the user terminal device 200 at a predetermined angle is detected while the user grips the left side of the user terminal device 200 while the video content is displayed, The control unit 290 detects that the user grips the left side of the user terminal device 200 through a sensor included in the bezel 320, and controls the user terminal device 200 on the left side of the display unit 230. The display 230 may be controlled to display a plurality of icons 4720-1 to 4720-6. At this time, the plurality of icons 4720-1 to 4720-6 may include icons for entering the home screen, icons for executing frequently used applications, icons for changing the settings of the user terminal device 200, and the like. have.

In addition, as illustrated in FIG. 47C, folding interaction is detected in which the user terminal device 200 is folded at a preset angle while the user simultaneously holds the left and right sides of the user terminal device 200 while the picture content is displayed. If it is, the control unit 290 detects that the user grips the left and right sides of the user terminal device 200 through the sensors included in the bezel 320, and edits the picture content on the left side of the display unit 230 The display unit 230 is displayed to display menu icons 4730-1 to 4730-4 for display, and display share icons 4740-1 to 4740-3 for sharing picture content on the right side of the display unit 230. Can be controlled.

In addition, when a user grips the user terminal device 200 while displaying e-book content, the control unit 290 turns the page according to an area where the user grips the user terminal device 200. The control area can be set differently.

Specifically, as shown in FIG. 48A, when a user grips the lower end of the user terminal device 200 while displaying e-book content, the controller 290 of the display 230 The lower area may be set as a control area 4810 for turning pages. At this time, the control area 4810 may be displayed differently from other areas, as shown in FIG. 48A. Then, when an interaction (for example, flip interaction in left and right directions) for turning a page in the control area 4810 is detected, the control unit 290 displays the page 230 to turn the page in a direction corresponding to the interaction. Can be controlled.

In addition, as illustrated in FIG. 48B, when the user grips the left and right sides of the user terminal device 200 while displaying e-book content, the controller 290 displays the display 230 The right and left areas of can be set as control areas 4820-1 and 4820-2 for turning pages. At this time, the control regions 4820-1 and 4820-2 may be displayed differently from other regions, as shown in FIG. 48B. Then, when an interaction (for example, a left-right flip interaction) for turning a page in the control areas 4820-1, 4820-2 is detected, the control unit 290 turns the page in a direction corresponding to the interaction. The display unit 230 can be controlled.

Hereinafter, a display method of the user terminal device 200 according to an embodiment of the present invention will be described with reference to FIGS. 56 and 57. 49 is a flowchart illustrating a method of displaying a user terminal device 100 according to diagonal interaction according to an embodiment of the present invention.

First, the user terminal device 100 displays a first screen (S5610). At this time, the first screen may have a square shape.

Then, the user terminal device 100 determines whether a user interaction dragging in a diagonal direction from one of the vertices of the first screen is detected (S5620).

When a user interaction dragging in a diagonal direction is detected (S5620-Y), the user terminal device 100 displays a second screen in a corner area corresponding to the vertex where the user interaction is detected (S5630). At this time, the user terminal device 100 may change the size of the second screen according to the drag amount of the user interaction, and may change the amount of information displayed on the second screen according to the size of the second screen. Also, the user terminal device 100 may display different types of content on the second screen according to the position of the vertex where the user interaction is detected.

57 is a flowchart illustrating a display method of a user terminal device 100 displaying a grid screen according to an embodiment of the present invention.

First, the user terminal device 100 displays a plurality of objects on a grid screen including a plurality of square cells (S5710). At this time, the user terminal device 100 may include a square type display panel.

Then, the user terminal device 100 determines whether a user interaction is detected on the first object among the plurality of objects (S5720). At this time, the user interaction may be a drag interaction.

When a user interaction is detected (S5720-Y), the user terminal device 100 adjusts the size of the first object by adjusting the number of square cells in which the first object is displayed according to the drag distance and direction of the user interaction ( S5730). Specifically, when a first user interaction is detected after touching the first object and dragging in the outer direction of the first object, the user terminal device 100 increases the number of square cell regions in which the first object is displayed. The size of the first object may be increased. However, if a second user interaction is detected after touching the first object and dragging in the inner direction of the first object, the user terminal device 100 decreases the number of square cell regions in which the first object is displayed. 1 You can reduce the size of an object.

According to various embodiments of the present invention as described above, a user can perform various functions through a user terminal device having a square display panel. Accordingly, user convenience and satisfaction may be improved.

In addition, the display method of the user terminal device according to various embodiments described above may be implemented as a program and provided to the user terminal device. Specifically, a non-transitory computer readable medium in which a program including a control method of a user terminal device is stored may be provided.

The non-transitory readable medium means a medium that stores data semi-permanently and that can be read by a device, rather than a medium that stores data for a short time, such as registers, caches, and memory. Specifically, the various applications or programs described above may be stored and provided in a non-transitory readable medium such as a CD, DVD, hard disk, Blu-ray disk, USB, memory card, ROM, and the like.

In addition, although the preferred embodiments of the present invention have been illustrated and described above, the present invention is not limited to the specific embodiments described above, and the technical field to which the present invention pertains without departing from the gist of the present invention claimed in the claims. In addition, various modifications can be made by those skilled in the art, and these modifications should not be individually understood from the technical idea or prospect of the present invention.

110, 230: display unit 120, 280: detection unit
130, 290: Control unit 210: Video receiving unit
220: image processing unit 240: communication unit
250: storage unit 260: audio processing unit
270: audio output

Claims (40)

In the display method of the user terminal device,
Displaying a first screen related to the first application;
Receiving an event related to a second application while the first screen is displayed;
After the event related to the second application is received, a first user touching one of the corner areas of the first screen and dragging with a drag amount less than a first value in a diagonal direction toward the inside of the first screen When the interaction is detected, in a state in which the first portion of the first screen is continuously displayed, the first folded area corresponding to the corner area where the first user interaction is detected and the first exposed by the first folded area Displaying a second screen related to the second application on a corner area; And
After touching one of the corner areas of the first screen and detecting a second user interaction dragging in a diagonal direction toward the inside of the first screen in a drag amount greater than or equal to the first value and less than a second value, the first In a state in which the second part of the screen is continuously displayed, the second folded area corresponding to the corner area where the second user interaction is detected and the second corner area exposed by the second folded area It includes the step of switching the screen to the third screen related to the second application to display;
The second screen and the third screen related to the second application include information on the received event,
The second screen,
It characterized in that it includes different information according to the position of the corner area where the first or second user interaction is detected among the four corner areas of the first screen,
The third screen is a screen different from the second screen, the size of the second corner area is larger than the size of the first corner area, and the size of the second folded area is greater than the size of the first folded area, The size of the second portion of the first screen is smaller than the size of the first portion of the first screen. delete delete According to claim 1,
The step of displaying the second screen,
According to the location of the corner area where the first user interaction is detected, information on an application currently being executed on the second screen, information that guides the user to move to a home screen, status information of the current user terminal device, and an application designated by the user. Displaying one of the quick access information for the display method. delete According to claim 1,
The first screen is a square shape,
After touching one of the corner areas of the first screen and dragging to the corner area of the opposite direction in a diagonal direction toward the inside of the first screen, when the third user interaction is detected, the first screen is applied to the second application. And a full screen associated with the display method. According to claim 1,
When the first screen displays e-book content,
The step of displaying the second screen,
And displaying the second screen including a bookmark display. According to claim 1,
When a message is received from outside,
The step of displaying the second screen,
Displaying the second screen including an icon for guiding that the message is received,
The step of displaying the third screen,
And displaying the third screen including information on the received message. According to claim 1,
When the first screen displays the picture content,
The step of displaying the second screen,
And displaying the second screen including at least one icon capable of performing a plurality of tasks on the photo content. According to claim 1,
The first screen and the second screen are in a square shape,
The display method of claim 1, wherein the first screen and the second screen share one corner area. In the user terminal device,
Display unit;
A sensing unit that detects user interaction; And
Control the display unit to display a first screen related to the first application,
While the first screen is displayed, receives an event related to a second application,
After the event related to the second application is received, a first user touching one of the corner areas of the first screen and dragging with a drag amount less than a first value in a diagonal direction toward the inside of the first screen When the interaction is detected, in a state in which the first portion of the first screen is continuously displayed, the first folded area corresponding to the corner area where the first user interaction is detected and the first exposed by the first folded area The display unit is controlled to display a second screen related to the second application on a corner area,
After touching one of the corner areas of the first screen and detecting a second user interaction dragging in a diagonal direction toward the inside of the first screen in a drag amount greater than or equal to the first value and less than a second value, the first In a state in which the second part of the screen is continuously displayed, the second folded area corresponding to the corner area where the second user interaction is detected and the second corner area exposed by the second folded area It includes a control unit for controlling the display unit to display the screen is switched to the third screen related to the second application,
The second screen and the third screen related to the second application include information on the received event,
The second screen,
It characterized in that it comprises different information according to the position of the corner area where the first or second user interaction is detected among the four corner areas of the first screen,
The third screen is a screen different from the second screen, the size of the second corner area is larger than the size of the first corner area, and the size of the second folded area is greater than the size of the first folded area, The size of the second part of the first screen is smaller than the size of the first part of the first screen. delete delete The method of claim 11,
The control unit,
Depending on the location of the corner area where the first user interaction is sensed through the detection unit, information on an application currently being executed on the second screen, information that guides the user to move to a home screen, status information of the current user terminal device, and a user And controlling the display unit to display one of the quick access information for the application designated by the user terminal device. delete The method of claim 11,
The first screen is a square shape,
The control unit,
When a third user interaction that touches one of the corner areas of the first screen and drags to the corner area of the opposite direction in a diagonal direction toward the inside of the first screen is detected through the sensing unit, the first screen And controlling the display unit to replace the entire screen related to the second application. The method of claim 11,
When the first screen displays e-book content,
The control unit,
And controlling the display unit to display the second screen including a bookmark display. The method of claim 11,
When a message is received from outside,
The control unit,
The display unit is controlled to display the second screen including an icon indicating that the message is received,
And controlling the display unit to display the third screen including information on the received message. The method of claim 11,
When the first screen displays the picture content,
The control unit,
And controlling the display unit to display the second screen including at least one icon capable of performing a plurality of tasks on the photo content. The method of claim 11,
The first screen and the second screen are in a square shape,
The first screen and the second screen is a user terminal device characterized in that it shares a single corner area.
delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete

Images