KR20140010351A - Method for controlling user terminal and providing user interface - Google Patents

Abstract

The present invention relates to a user terminal control method. The user terminal control method displays, on a user terminal, at least one window which outputs the result of object execution and a controller which controls the execution of an object to be outputted on the window while surrounding at least part of the edge of the window. The control method includes: a step of arranging multiple objects which is to be executed on a user terminal and of which the execution result is displayed on the window and organizing an object structure by virtual structuring; a step of executing and displaying a selected object from the object structure on the window; and a step of, when a drag input in a preset conversion direction for the controller is detected, converting the selected object to a different object based on the object structure as an object of which the execution result is outputted. According to the present invention, it is possible to display and control various objects executed on a user terminal or various objects provided on a webpage. [Reference numerals] (11) Interface providing unit; (12) Input detecting unit; (13) Window control unit; (14) Controller control unit; (15) Object structure setting unit; (16) Object executing unit; (17) Log file generating unit

Description

User terminal control method {METHOD FOR CONTROLLING USER TERMINAL AND PROVIDING USER INTERFACE}

The present invention relates to a method for controlling a user terminal, and more particularly, to generate a screen for each object so that a user can display, control and store a plurality of objects efficiently and effectively, and perform parallel processing and convenient screen switching of a plurality of objects. It relates to a method for providing a user interface for enabling the.

In recent years, various types of devices including full touch screens such as smartphones or tablet PCs have spread, and users can use virtual icons or keypads displayed on the full touch screen without using a hardware input device such as a mouse or keyboard. The method of directly inputting information is widely used.

In addition, as an input method using such a touch screen, a method of switching, enlarging or reducing the screen using various touch input patterns, for example, touch and drag, double touch, and multi touch, has been used.

Meanwhile, in the terminal including the full touch screen, user interactive screen control according to a touch input is free, while the size of the display is relatively small to increase the portability of the terminal. Accordingly, there is a problem that the amount of data that can be displayed on one screen is limited.

In addition, when executing a plurality of objects accordingly, there is a problem that each object is executed in a separate window, and a newly executed object is displayed superimposed on the window of another existing object, it is difficult to switch the objects and display each other.

In particular, when several objects are executed in different windows, the window displaying the object to be controlled must be selected to control one object, and when the window displaying the object to be controlled is not selected, the other window is reduced or You had to select the window of the object you want to close or control by selecting the index of each object.

However, when the size of the display is small, such as a smartphone or tablet PC, it is difficult to display several windows at the same time, and the size of the index is small so that it can be divided into indexes and switched one by one. .

Furthermore, when displaying a web page in a web browser, it is difficult to display all the objects included in the web page on one screen, so that not only excessive screen scrolling is required but also the user needs to be provided with an unwanted object. .

Therefore, a technique for solving the above-described problems is required.

One embodiment of the present invention is to provide a user interface that virtually arranges each object displayed on the screen of the user terminal horizontally and vertically, and different objects are switched according to the control direction.

An embodiment of the present invention is to display a controller that can receive input from a user in a predetermined area of the user terminal screen, to execute a plurality of objects through the controller, to provide a user interface that can be controlled efficiently and intuitively There is a purpose.

One embodiment of the present invention is to provide a user interface to control the switching or resizing of a window executing a plurality of objects in an efficient and intuitive manner.

One embodiment of the present invention is to provide a user interface that can selectively display only the objects required by the user on the screen.

One embodiment of the present invention is an object to execute the object in the user terminal and to store the edited work state as a whole, so that the same work state can be reproduced after elapse of time.

As a technical means for achieving the above-described technical problem, the user terminal control method according to the first aspect of the present invention, so as to surround at least a portion of the window and at least a portion of each of the output of the result of the object running; A method of controlling a user terminal by displaying a controller on the user terminal, the controller configured to control an execution state of an object in which an execution result is output to the window, the method being performed by the user terminal and outputting the execution result to the window. Arranging and virtually structuring the objects to form an object structure; Executing and displaying a selected object included in the object structure on the window; And a step of sequentially switching an object outputting an execution result to the window from the selected object to another object based on the object structure when a drag input of a preset switching direction with respect to the controller is detected.

According to any one of the problem solving means of the present invention described above, by providing a user interface to virtually arrange each object displayed on the user terminal screen horizontally and vertically, and to switch different objects according to the control direction This minimizes user input for running and switching objects.

In addition, according to any one of the problem solving means of the present invention, a controller capable of receiving input from a user in a predetermined area of the screen of the user terminal, and executes a plurality of objects through the controller, can be efficiently and intuitively controlled By providing a user interface, a plurality of objects can be easily controlled.

Furthermore, according to any one of the problem solving means of the present invention, by providing a user interface that can be controlled in an efficient and intuitive way to switch or resize the window running the plurality of objects, the display state of the plurality of objects It can be controlled easily.

In addition, according to any one of the problem solving means of the present invention, it is possible to selectively display only the objects required by the user on the screen.

And according to any one of the problem solving means of the present invention, by executing the object in the user terminal and save the edited work state as a whole, so that the same work state can be reproduced after a time, to reproduce the same work state again later It can reduce the effort required for reducing the waste of time and effort caused by temporary work interruption such as power off of the user terminal.

1 is a block diagram showing the functional configuration of a user terminal according to an embodiment of the present invention.
2 is an exemplary view for explaining a controller and a window of a user terminal according to an embodiment of the present invention.
3 is an exemplary diagram of objects grouped for execution in a window of a user terminal according to an embodiment of the present invention.
4 is a flowchart illustrating a method for controlling a user terminal according to an embodiment of the present invention in stages.
5 and 6 are exemplary diagrams for explaining a drag pattern generated in a window and a controller and an execution state of an object switched corresponding thereto in the method of controlling a user terminal according to an embodiment of the present invention.
7 and 8 are exemplary diagrams for explaining a drag pattern generated in a plurality of windows and a controller and a window and a controller display state switched corresponding thereto in a method of controlling a user terminal according to an embodiment of the present invention.
FIG. 9 is an exemplary diagram for describing a process of displaying a minimap for an object structure and object switching using the minimap in a method of controlling a user terminal according to an embodiment of the present invention.
10 and 11 are exemplary diagrams for explaining a drag pattern generated from a controller to an inside of a window and a display state of a window and a controller that are switched corresponding thereto in the method of controlling a user terminal according to an embodiment of the present invention.
12 is a view illustrating a drag pattern generated in a longitudinal direction of a controller formed along one side of two windows and a display state of a window and a controller switched corresponding thereto in a lengthwise direction of a controller formed along one side of two windows according to an embodiment of the present invention; It is an illustration.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings, which will be readily apparent to those skilled in the art. The present invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. In order to clearly illustrate the present invention, parts not related to the description are omitted, and similar parts are denoted by like reference characters throughout the specification.

Throughout the specification, when a part is referred to as being "connected" to another part, it includes not only "directly connected" but also "electrically connected" with another part in between . Also, when an element is referred to as "comprising ", it means that it can include other elements as well, without departing from the other elements unless specifically stated otherwise.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, the present invention will be described in detail with reference to the accompanying drawings.

After defining each term, the user terminal control method of FIG. 1 is demonstrated.

In the following description, an object is an object executed by a user terminal or a set of respective objects by a user's selection, and is distinguished from each other such as data in the file unit executed and edited by an application or the application itself, a web page, a website, and the like. It can be anything possible or a set of unit objects. The set of unit objects may also include a plurality of structured objects, that is, an "object structure" to be described later.

For example, the object may be a desktop metaphor in which a shortcut icon of at least one of an application or a set of applications / files or files executed by an application / application, a file, or a set of files is arranged. It may be a web page browsed by the operating system of the terminal / a web browser / and the object structure itself.

'Object identification information' is information that a user terminal arbitrarily assigns to distinguish an object displayed in one window. For example, an object name or a process ID may be used.

'Window' means an area on the display where an object is displayed, and each window may display an execution result of each object or objects. The size, position, and arrangement of the windows may vary according to the user's choice. In the present invention, by using a virtual monitor (VM), a virtual display (VD) or a virtual window (VW) technology while simultaneously executing or applying one or more objects, employing a method of working between a plurality of virtual monitors or virtual displays. In this case, the currently displayed screen is a window, and a virtual screen, which is not currently displayed but is assigned an execution result of an executed object, is classified as a 'virtual window'.

The controller can be created when a window is created, and can select or control an object displayed in the window, switch screens, call a new window or an object to be displayed in a new window, or control a user terminal. It can include a graphical user interface. In addition, it may be dependent on one or more windows to control an object displayed in the window, and may be displayed adjacent to or separated from the window. For example, the controller may be configured to form at least a portion of the edge of the window.

'Object switching' means that an object displayed in one window is changed to another object according to a user's selection among a plurality of objects. For example, in one window, the controller or the window itself may be slid to change an object displayed in the window.

Furthermore, the object structure is a virtual structure or object arrangement system formed by virtually arranging a plurality of objects, and is used to specify an object to be converted at the time of object conversion. For example, if the mail object is arranged adjacent to the news object to the right, when the command for moving the object to the left is input, the news object may be converted into the mail object. In addition, the object structure is not necessarily set in advance for all existing objects. For example, the object structure may be separately created to structure the objects for which the user has not finished execution and to facilitate switching between them. For example, each of the objects executed in the window displayed on the display and the plurality of virtual windows to be described later are allocated, and the execution order or switching direction between the window displayed on the display and the virtual windows is structured and executed. It can facilitate the transition between objects. Therefore, in the following, the object structure is not necessarily set in advance, but may be not only for all objects executable in the user terminal 10 but also for running objects.

Furthermore, the object structure may be three-dimensionally constructed. Each object may be coordinated by being arranged in three dimensions, and thus, an object switching command to be described later may be input using a user interface for switching objects up, down, left, and right.

In addition, the 'object switching command' is a command according to a user's input, and is a preset pattern input to a controller or a window. For example, the touch input pattern set to 'object switching command' may include a left or right sliding touch input, an upward or downward sliding touch input, and a double touch or a multi-touch input toward or away from each other. And so on. However, the object switching command is not limited to the illustrated pattern, and may be variously determined. When switching an object based on the object structure, the object switching command may be determined to coincide with the input direction of the object switching command.

In addition, in the following description, the 'work state' refers to an object structure currently being applied, identification information of content dependent on an object running in each window being displayed, display state such as size and layout state of each window, And optionally, identification information of an application (object) that is the execution subject of the content, the current execution state of the content being executed depending on the object (for example, the current playback time of the media object, audio volume, etc.), and the current content of the content. This expression is used to refer to the editing status. The user can then create a job log file by saving the job status.

The job log file is a file that stores the work status of the user at a desired time. When the user executes the saved work log file, the stored work status is reproduced as it is. For example, a user can execute a plurality of other documents used as document data together to create a new document, and can also run an editing program such as a graph or an image to be inserted into the document. If the work is stopped in this state and the user terminal is turned off, much effort is required to reproduce the same work state again later. Therefore, after generating the job status as a single file, the job log file can be created so that it can be reproduced later. At this time, the object structure to be applied, the size and the arrangement of the window are reproduced as it is to reproduce the optimal working environment.

In the following description, 'user terminal' is a control target and a control subject of the method for controlling a user terminal according to an embodiment of the present invention. It may be implemented as a computer, a portable terminal, or a television. Here, the computer includes, for example, a notebook computer, a desktop computer, a laptop computer, and the like, each of which is equipped with a web browser (WEB Browser), and the portable terminal may be a wireless communication device , Personal Communication System (PCS), Global System for Mobile communications (GSM), Personal Digital Cellular (PDC), Personal Handyphone System (PHS), Personal Digital Assistant (PDA), International Mobile Telecommunication (IMT) Handheld based wireless communication devices such as W-CDMA (Code Division Multiple Access) -2000, W-CDMA (W-CDMA), Wibro (Wireless Broadband Internet) terminals, can do. In addition, the television may include an Internet Protocol Television (IPTV), an Internet Television (Internet Television), a terrestrial TV, a cable TV, or the like.

Hereinafter, a user terminal control method according to an embodiment of the present invention with reference to the drawings. In this case, the control method of the user terminal may be executed by the user terminal in accordance with an operating system, other applications, or a web browser.

Hereinafter, with reference to the drawings will be described in more detail the configuration of the user terminal. 1 is a block diagram showing the configuration of a user terminal according to an embodiment of the present invention. The user terminal 10 includes an interface providing unit 11. The interface providing unit 11 provides a user interface on the display of the user terminal 10. In this case, the user interface displayed by the interface providing unit 11 may include the above-described controller. The controller is displayed on one side of the display of the user terminal 10 as a graphic user interface and simultaneously receives a user's drag input (which may include at least one of touch drag and mouse drag) or selection input (touch or click). Can be. The user interface may also include one or more windows according to user input to the controller. Each window may be an output area for executing and displaying one object and may be implemented as an input area for receiving a drag input or a selection input of a user.

In addition, the user terminal 10 includes an input sensing unit 12. The input detector 12 detects a user's input to the window or the controller as described above. In addition to the drag input or the selection input described above, a user input of various predetermined patterns can be detected.

Meanwhile, the user terminal 10 may include a window control unit 13. The window controller 13 may control whether the window provided by the interface providing unit 11 is displayed, a display position, a display size, an arrangement, or the like, according to a user input sensed by the input detector 12. In addition, the controller control unit 14 of the user terminal 11 controls the display or display position, size, etc. of the controller provided by the interface providing unit 11 according to the user input detected by the input sensing unit 12, and the user input. You can also change the display state.

In addition, the window controller 13 may generate and control a virtual window. The virtual window is not currently displayed to the user through the interface providing unit 11, but the execution result screen of the object is displayed so that the execution result of the object can be immediately displayed in the window according to a user command while executing each object in the background. As a virtual window generated by image data, a virtual window corresponding to each object may be generated in advance or according to a user's object switching command according to the order or arrangement defined in the above-described object structure. Each of the virtual windows generated as described above may be virtually arranged to correspond to the order or arrangement defined in the object structure.

That is, the virtual window is formed and arranged corresponding to the object structure, and each object included in the object structure may be assigned to each virtual window. Only one object of each object included in the object structure is allocated to the window displayed on the display, and the other window is assigned to the virtual window. If an object switching command is input, the current window becomes a virtual window. One virtual window arranged in the next order with respect to the object switching direction becomes a window (a window displayed on the actual display).

Accordingly, when the user inputs an object switching command through the input sensing unit 12, the virtual window image data of the objects arranged in the next order according to the switching direction may be displayed on the window through the interface providing unit 11.

For example, when the first object is displayed in the window and the second object allocated to the virtual window is called, the window controller 13 may move the first object to the virtual window. As described above, the window control unit 13 may display the objects displayed in the window and the objects allocated to the virtual window by switching between the objects displayed in the window and the objects arranged in the object structure.

However, the virtual window for an object not currently being executed, for example, an object not loaded into memory among the objects included in the object structure, may be configured to include only a user interface for querying whether the object is executed or displayed. .

The controller controller 14 may display the controller, but the controller may be displayed on at least one side of the edge of the window. Alternatively, the border of the window itself may be displayed as one with the window as a controller.

In addition, the controller controller 14 may selectively display the controller. For example, when the controller is not displayed, the controller can be displayed only when the mouse is over, the user's touch input is detected, or when the stylus pen's approach is detected. have. When the mouse position leaves the controller again or the touch input is released, the controller controller 14 may stop displaying the controller. Of course, as a controller, the area for detecting the user's input may not be displayed to be distinguished visually. For example, a user may recognize that an input area of a controller role exists on one side of a window in accordance with an implied promise, and may not separately display an actual controller. That is, the controller C distinguishes some areas of the input area of the screen from other areas so as to sense a user input for the divided input area, but corresponds to the input area to indicate that the input area is the controller C. The display area may be configured to selectively display a specific image. That is, the controller C occupies a certain input area but may not include a separate image corresponding thereto. In other words, the controller C may include an input area corresponding to at least a portion of the display area of other content. For example, the controller C may be provided at a position where other content is displayed.

In addition, the controller controller 14 may display specific content in the controller. The controller controller 14 displays an image corresponding to an input pattern of a command that can be input using a controller, such as displaying an image for inducing a user's input in the controller, for example, an arrow image for receiving left and right drag inputs. You can also display icons to perform specific functions or menus.

Furthermore, the controller controller 14 may display a background image or advertisement content in the controller. In particular, the controller controller 14 may change the advertisement image displayed in the controller whenever an object switch command is input and the object is switched in receiving the object switch command through the controller controller 14, for example. Alternatively, an object switching command may be input so that the content corresponding to the newly displayed object in the window is displayed in the controller.

On the other hand, the user terminal 10 is provided with an object structure setting unit 15. The object structure setting unit 15 may provide an interface to the user to newly set the above-described object structure or to edit an already set object structure. Accordingly, the user can create an object structure of his or her desired form and store it.

Furthermore, the object structure setting unit 15 may select and apply one or more object structures to be currently applied from among a plurality of object structures generated as described above. Accordingly, the object execution unit 16 to be described later may switch objects according to the object structure currently applied by the object structure setting unit 15.

In addition, the user terminal 10 may include an object execution unit 16. The object executing unit 16 executes an object to be displayed on the window. When the switch command for the object displayed in the window is received, the switch is executed to execute the newly executed object, and the execution of the object previously executed may be terminated or stopped and the execution may be continued while maintaining the last state. The object executing unit 16 executes an arbitrary object and receives an object switching command, executes a new object and displays the object in the window. The object structure is set in advance by the object structure setting unit 15. Can be based on.

In addition, the object execution unit 16 may execute some of the objects allocated to the virtual window in addition to the object currently displayed on the window. That is, the object execution unit 16 may continue to execute while some of the objects included in the object structure are loaded into the memory, and some of them may be objects allocated to the virtual window.

Furthermore, the user terminal 10 according to the embodiment of the present invention may further include a log file generation unit 17. When the log file generation unit 17 receives a job log file creation command from the user, the log file generation unit 17 identifies one or more object structures that are being applied when the command is received, the arrangement status of the windows, and identification information of the objects displayed in each of the arranged windows. You can create a job log file that contains. In addition, the job log file may store the execution status or edit status of each object. Accordingly, if the job log file is executed again later, the interface providing unit 11 of the user terminal 10 displays the windows and the controller recorded in the job log file under the control of the window controller 130 and the controller controller 14. Reproducing the state, the object executing unit 16 executes the object based on the identification information of the object recorded in the job log file, and can control the object according to the execution state or edit state of the recorded object. At this time, the task log file may also store the execution state or edit state of the object assigned to the virtual window.

Hereinafter, the controller and the window displayed using the user terminal 10 according to the embodiment of the present invention described above will be described in more detail. FIG. 2 is an exemplary diagram for describing a controller and a window of a user terminal according to an embodiment of the present invention, and FIG. 3 is an exemplary diagram of objects grouped for execution in a window of a user terminal according to an embodiment of the present invention.

First, as shown in FIG. 2, the controller C is displayed on the display of the user terminal 10, and may have a line or bar type shape extending in a horizontal or vertical direction with respect to the display. In this way, the direction of the object change command may be a bidirectional drag input corresponding to the length direction of the controller C with respect to the controller C having a shape extending in one direction.

Of course, the shape of the controller C is not limited to the bar type, but may be formed in another shape, as well as no indication for indicating the position of the controller C or the area where the controller C recognizes the user's input. May not be displayed. In addition, the shape of the controller C may be actively changed according to a user input.

On the other hand, when a drag input is detected from one point t of the inside of the controller C to the one point t 'of the upper direction as shown on the left side of FIG. 2, the controller C as shown on the right side is shown. A new window W may be created at the top. Of course, when a drag input is detected from the inner side point t to the lower side point of the controller C, a new window may be generated at the lower end of the controller C. Here, for example, when the controller (C) is in the form extending in the left and right direction, the window (W) can be implemented to be created in each of the upper and lower, on the contrary, the controller (C) has a form extending in the vertical direction The windows W may be generated in left and right directions, respectively.

That is, for example, when one window W is generated, a user input for receiving a user input in at least a partial area of the edge portion of the window W so that the edge portion of the window W functions as the controller C. An input area can be allocated. In addition, a function corresponding to a user input occurring in a corresponding region may be preset. For example, as described above, when at least a part of the edge of the window W is set to the controller C, when a drag input is detected from the inside to the outside of the window W, the new window W is displayed. Can be created.

However, this is only some embodiments, and the shape of the controller C or the arrangement of the windows W may be variously modified.

Accordingly, when the window W is generated, the shape of the controller C may be transformed into a border shape surrounding the window W as shown in the right side of FIG. 2.

In such a state, only the part corresponding to the edge part below the window W may function as a controller C, and all four upper, lower, left, and right edges may function as a controller C. As shown in FIG.

For example, in a state shown in the right side of FIG. 2, when the user performs a touch drag input from the portion corresponding to the left edge of the window W to the outside of the left side, a new window may be additionally generated on the left side. Alternatively, when the user performs a touch drag input downward from the portion corresponding to the upper edge of the window W in the state shown in the right side of FIG. 2, the display of the window W is terminated and the state as shown in the left side of FIG. The screen may be switched to.

On the other hand, as shown on the right side of FIG. 2, the controller C displays an image in which the object currently displayed in the window W corresponds to a position in the object structure and how many objects exist in the left and right directions. Can be.

For example, if the currently used object structure includes nine objects arranged in a horizontal line, and the currently displayed document objects are arranged in the center, each object is shaped as a node. Only nodes corresponding to document objects arranged in the center may be displayed in different colors so that the user may easily recognize which position in the object structure the document object currently displayed in the window W corresponds to. In this state, by simply selecting a specific node, an object currently assigned to the window W may be directly converted into an object corresponding to the node.

Alternatively, an icon indicating an object switching direction may be displayed on one side of the window W, and the number of virtual windows virtually arranged in the switching direction indicated by the icon may be displayed.

In this case, regardless of whether the controller C includes an image of the object structure as described above, the controller C may adjust the number of objects to be switched according to the length of the drag input in the switching direction. This will be described later.

In addition, as shown in FIG. 3, in the embodiment of the present invention, the object structure 100 may include a plurality of objects O, and the plurality of objects O may be arranged in a matrix form.

In this case, a plurality of contents C may be dependent on each object O. FIG. Each object O in the object structure 100 may be arranged in a line as shown in the figure, or may be arranged in a matrix form as each component on a plane, for example. In the drawing, for example, chat objects, document objects, and music objects are arranged in a line as independent objects.

In addition, one or more object structures 100 may be set in one user terminal 10. A user may create a plurality of object structures 100 in a desired form and selectively use some of them.

Furthermore, the object structure 100 is generated separately for each layer of objects, and the object structures 100 of different layers may be applied together in parallel at once. For example, when a plurality of operating systems are installed in one user terminal 10, each of the operating systems may be arranged in one object structure as an object. Each application program executed according to the operating system may be separately configured as an object structure lower than the object structure of the operating system. Similarly, there may be an object structure that is lower than the object structure of the operating system and above the object structure in which applications are arranged, and a plurality of desktop metaphors in which icons of different applications are arranged. Alternatively, there may be an object structure in which each of the plurality of user accounts existing in the user terminal 10 is lower than the object structure of the operating system and higher than the object structure in which the application programs are arranged.

Hereinafter, a method of controlling the user terminal 10 according to an embodiment of the present invention, which executes a plurality of objects, which are represented by a controller and a window as described above, and is configured in advance, will be described. 4 is a flowchart illustrating a method for controlling a user terminal according to an embodiment of the present invention, and FIGS. 5 and 6 are drags generated in a window and a controller in the method for controlling a user terminal according to an embodiment of the present invention. It is an exemplary diagram for explaining a pattern and an execution state of an object that is converted correspondingly.

As shown in FIG. 4, in the method of controlling a user terminal according to an exemplary embodiment of the present invention, when an arbitrary object is executed, the content dependent on the object is displayed in the window (S110), and the object is switched in the window in which the content is displayed. If a command is input (S120), the content may be switched to another content dependent on the same object as the currently displayed content (S130). That is, when a drag input of the user is detected in the window, the user terminal 10 may not switch the object currently assigned to the window, but may switch only the content to other content other than the content currently displayed among the content dependent on the object. .

For example, in the object structure as shown in FIG. 3, when a drag input of a predetermined direction is detected in the window while any one of documents # 1 dependent on the document object is displayed in the current window, the currently displayed document is displayed. The display of # 1 can be terminated and the document # 2 can be displayed in a window.

However, when the object is displayed in the window (S110), when a drag input (object switching command) is detected by the controller that is dependent on the window (S140), the user terminal 10 executes another object adjacent to the currently displayed object. The object may be switched by displaying in the window (S150). For example, in the embodiment illustrated in FIG. 3, when an object switching command is input to the controller while content dependent on the current document object is displayed, one of the document object, the neighboring music object, and the chat object according to the drag direction is selected. By selecting an object, the display of the window and the execution state of the object can be switched to the object itself or its contents.

For example, referring to FIGS. 5 and 6 together, while document # 1 is displayed in one window W in FIG. 5, the other point in the right direction at any point t in the window W ( When the drag input 1 (D1) to t ') occurs, as shown in the upper left of FIG. 6, the display of the document # 1 may be terminated and the document # 2 may be displayed. That is, the document object itself is not switched, and only the content dependent on the document object can be switched.

In addition, in FIG. 5, when the document # 1 is displayed in the window W, when a drag input 2 D2 occurs from one point t in the controller C to another point t 'located in the right direction, As shown in the upper right of FIG. 6, the display of the document object may be terminated, and the state of the execution result of the chat object, which is another object, may be displayed.

In this case, when the object switching command is a drag input in the longitudinal direction of the controller C as described above, the user terminal 10 may adjust the number of objects to be switched according to the length of the drag input of the object switching command.

For example, if a drag input of 1 cm occurs, the object is switched to the immediately adjacent object based on the object structure, and when a 2 cm drag input occurs, the objects arranged in the order after the immediately adjacent object based on the object structure. Can be switched sequentially.

Furthermore, in the embodiment of the present invention, as shown in FIG. 5, the document # 1 subordinate to the document object is located outside the controller located downward at any point t in the controller C in the state displayed in the window W. FIG. When drag input 3 D3 to another point t 'occurs, as shown in the lower left of FIG. 6, a new second window W' is displayed at the bottom of the controller and the second window W is displayed. ') May execute memo objects that are dependent on or associated with the document object. Of course, in the illustrated example, the second window W 'is described as displaying another object that is dependent on or associated with an object executed in the window W that has already been displayed. However, this is not necessarily the case. It may be displayed in the windows W and W ', respectively.

The drag input 3 (D3) for displaying a new window may be a drag input in an extension direction preset in a direction perpendicular to the drag input direction of the object change command described above. In addition, in the embodiment of the present invention, as shown in Figure 5, the document # 1 is displayed in the window (W), one point (t) of both ends of the controller (C) around the other point (t ') or the controller When the drag input 4 (D4) in the direction of rotating about the longitudinal center of (C) is detected, the controller control unit 13 actually controls the controller so that the controller C displayed on the user terminal 10 is displayed as rotating. As shown in the lower right of FIG. 6, the display of the window W and the execution of the object executed in the window may be terminated. Of course, besides terminating execution of the object, other functions can be performed.

Here, the object switching command is described as drag input in the left and right directions to the bar type controller C of the lower edge of the window W, but the length of any one of the four edges in the up, down, left and right directions of the window W. It may be a direction drag input, or may be an input method having another direction.

In addition, the object change command is described as an example of a drag input having one touch point, but the multi-touch drag input may also be recognized as an object change command. For example, as described above, the object structure may be set differently for objects of different layers. In this way, two or more object structures of different layers may be applied at the same time. In this case, a drag input using a single touch point is recognized as an object switch command for the sub-object structure, a drag input using a double touch point is recognized as an object switch command for the middle object structure, and a triple touch point is used. The drag input may be recognized as an object switching command for the parent object structure.

For example, while logging in to the account of the user 'Park Byung-jun' and executing the document object in the window using the user terminal 10, if the object switching command using a single touch point is recognized, the document object is converted into the chat object. When the object change command using the double touch point is recognized, the display of the document object can be continued and the user can log out of the current user account and switch to the "Guest" account accessible to anyone. Of course, if the content displayed according to the execution of the document object is data accessible only from the user account of 'Pak Byung-jun', the execution of the document content may be stopped when the account is switched to the guest account.

As described above, in the embodiment of the present invention, the object switching instruction applied to the window is recognized as a switching instruction of the content dependent in the same object, and the object switching instruction applied to the controller is recognized as a switching instruction to different objects. It can be set in advance.

As a result, the user does not have to go through complicated procedures such as repositioning the window, terminating the display of the window, and searching for another object in order to execute another object. In addition, such an object switching method may be used as a method for the operating system of the user terminal 10 to call various objects or applications provided by the user terminal 10 and to switch the execution state thereof, as well as an online portal. It can also be applied to web pages to make it easier to implement and switch between the various functions or objects provided by the company's website. In particular, such a method may be particularly suitable to be applied to a mobile terminal in which display size is limited and other input means other than touch input is minimized.

In addition, in FIG. 5, when a multi-touch drag input toward the center occurs from both ends of the controller C corresponding to the edge portion under the window W, the display of the window W and the execution of the object displayed in the window W are performed. Can be terminated completely. Of course, depending on the embodiment, only the display may be terminated and the execution of the object may continue. In this case, the display of the controller C can also be terminated.

Furthermore, although not shown in FIG. 5, as described above, in the user terminal 10 according to the embodiment of the present invention, four borders surrounding the window may function as a controller as a whole. For example, the upper edge of the window When a touch drag input is generated from the vicinity of the right vertex to the bottom left vertex, the touch drag input may be recognized as the execution end command of the object in which the execution result is displayed through the corresponding window. Alternatively, when a touch drag input is generated from near the lower left corner of the edge of the window to the upper right corner of the window, the touch drag input may be recognized as an execution stop command of the object on which the execution result is displayed through the corresponding window. As illustrated in the above example, when a drag input in a diagonal direction with respect to the controller and the window occurs, this may be recognized as an execution command of a preset function and the corresponding function may be performed.

Meanwhile, referring to the drawings, a window and a controller control method according to a drag input while a plurality of windows are displayed will be described. 7 and 8 are exemplary diagrams for explaining a drag pattern generated in a plurality of windows and a controller and a window and a controller display state switched corresponding thereto in a method of controlling a user terminal according to an embodiment of the present invention.

As shown in FIG. 7, the drag input 5 for moving the controller C downward while the two windows W and W ′ are displayed in the expansion direction with respect to the controller C, that is, inside the controller C When the drag input 5 (D5) is sensed downward from one point t to another point t 'located below the predetermined range, the controller C as shown in the left side of FIG. The first window (W) located at the top of the) is displayed in a position where the lower border of the controller (C) is moved downward, and the display of the second window (W ') may be terminated or reduced. . On the contrary, if a drag input 6 (D6) for moving the controller C is detected while two windows W and W 'are displayed, the second window located at the bottom of the controller C as shown in the center of FIG. The controller C moves upward while the W 'is expanded and the display of the first window W may be terminated or reduced. Of course, in this case, if the controller C is returned to the center of the screen through a drag input again, the window in which the display is terminated or reduced is expanded and displayed again, and the expanded and displayed window can also be restored to its original size.

In this case, an arrow A may be displayed at the bottom of the controller C in order to enable a user to recognize that the second window W ′ exists below the state shown in the left side of FIG. 8. Similarly, in the state shown in the center of FIG. 8, an arrow A may be displayed on the top of the controller C in order to allow a user to recognize that the first window W exists upward.

Meanwhile, as shown in FIG. 7, another one point t1 'and another two point t2' located above and below the one point t1 and any two points t2 inside the controller C, respectively. When the multi drag input 1 (M1) is detected, the controller control unit 13 of the user terminal 10 extends and displays the controller C as shown in the right side of FIG. And the controller C by executing an object that is dependent on, or associated with, the object displayed in the second window W 'or an independent object or a preset object or other additional function to be executed upon detection of the multi drag input 1 (M1). Can be displayed within. Of course, if the controller C does not include an image displayed on the screen, when the multi-drag input 1 M1 is detected in the input area corresponding to the controller C, a new window W is newly generated and the inside of the window C is generated. Objects that are dependent on, or associated with, or associated with objects displayed in the first and second windows W 'may be displayed in advance or upon execution of the detection of the multi drag input 1 (M1).

In other words, the expansion of the controller C described herein is not substantially different from that in which a new window W is created. The controller C thus expanded or the new window W corresponding thereto is extended to an area where the other windows W and W 'previously displayed are displayed, and at least temporarily displayed in the existing window. The display of (W, W ') may be stopped and the controller C or the new window W corresponding thereto may be displayed throughout the screen, or a plurality of windows may be displayed together as shown in the drawing. It will be apparent to those skilled in the art. Of course, the extended area of the new window W may be determined by the range of the multi drag input 1 M1 of the user.

In this case, in FIG. 7, when the multi-drag input 1 M1 that is relatively far from each other from the inside of the controller C occurs while the two windows are displayed, the controller C is expanded and the execution result of another object therein. Although is described as being displayed, even in the state where only the controller (C) is displayed or only one window (W) and the controller (C) is displayed, the controller (C) is extended and displayed for this multi-drag input, and the other Of course, the execution result of the object can be displayed. Of course, at this time, as the controller C is expanded, the display of the window W may be stopped.

For example, as shown in the drawing, when the controller C or a part of the controller C is expanded, therein, a list of objects or objects frequently used by the user, or displayed in the user terminal 10 or the current window. The configuration menu of the object being used, or an object (diary, public certificate, etc.) for the user's private data may be displayed. For example, if the controller C is expanded while the document object is running, the folder designated by the user is displayed and the user moves data or content to the folder displayed in the controller C by touching and dragging the document object currently being edited. It can also be saved or copied.

Furthermore, in the expanded state of the controller C as described above, a menu for generating the above-described work log file may be provided therein. In addition, a list of job log files already created may be provided.

Accordingly, the user can create and save the current job status as a new job log file, or select and execute a previously saved job log file to reproduce the previous job status.

Of course, a menu for creating a job log file may be provided in other ways. Alternatively, even when a separate menu is not provided, when a user input of a predetermined pattern occurs, a job log file for a time when the input occurs may be newly generated.

Meanwhile, referring to FIG. 9, a process of displaying a minimap for an object structure in a method of controlling a user terminal according to an embodiment of the present invention will be described. FIG. 9 is an exemplary diagram for describing a process of displaying a minimap for an object structure and object switching using the minimap in a method of controlling a user terminal according to an embodiment of the present invention.

As shown in the left side of FIG. 9, when the multi-drag input 2 M2 that fully extends the controller C to the display is detected, the user terminal 10 terminates the display state of the window W and visually displays the object structure. The mini-map (M) expressed as can be provided through the display. Here, the multi drag input 2 (M2) is the other one point (t1 ') and the other two points (t2') located in the up and down diagonal directions from one point (t1) and any two points (t2) inside the controller (C), respectively. May include a drag input to). Of course, it can be set differently. As such, when the multi drag input 2 (M2) is detected, the user terminal 10 may display a mini map M of the object structure composed of a combination of icons representing each object on the display. Of course, you can also visually represent the object structure in other ways.

As such, when the user selects a specific object while the minimap of the object structure is displayed, the object execution unit 16 of the user terminal 10 may execute the selected object and display it on the window W. FIG. As a result, the object previously displayed in the window may be terminated.

Of course, in the state in which the minimap M of the object structure is displayed as described above, the user may edit the minimap M or select another minimap M among the plurality of minimaps M. FIG.

That is, the user can change the arrangement order or position of a plurality of icons included in the minimap M while the minimap M of the object structure is displayed, or remove some of the icons and add new icons. You can edit the object structure. That is, the object structure can be modified to be convenient for the user and a new object structure can be created. The object structure to be currently applied may be changed among a plurality of preset object structures.

For example, a user can set and use a laptop computer separately from an object structure that is convenient for personal use at home and an object structure that is convenient for public use in a company. For example, at home, an object structure that arranges objects related to the user's hobbies such as music object, movie object, internet object, etc., and in the company, objects containing objects which are convenient for work such as document object, company intranet object, etc. The structure can be selected and used.

To this end, the user terminal 10 may provide icons of all selectable objects to one side when minimap M is edited, and provide a user interface for selecting and dragging and arranging them.

Accordingly, users can improve the convenience of using the user terminal 10 by creating one or more object structures that are convenient to use, and selecting and using an object structure suitable for the current situation among the generated object structures.

Meanwhile, the object switching method using the window and the controller based on the object structure may be applied to be set on / off according to a user's selection. That is, when the user wants to use such an object control method, the user terminal 10 may be used in a general manner by controlling the object switching method and controlling the object switching method if it is unnecessary.

Meanwhile, with reference to FIGS. 10 and 11, the drag pattern generated from the controller to the inside of the window and the display state of the window and the controller switched corresponding thereto in the control method of the user terminal according to an embodiment of the present invention will be described. . 10 and 11 are exemplary diagrams for explaining a drag pattern generated from a controller to an inside of a window and a display state of a window and a controller that are switched corresponding thereto in the method of controlling a user terminal according to an embodiment of the present invention.

As described above, in the present invention, the controller may be both upper, lower, left, and right edges of the window. Accordingly, in the control method of the user terminal according to the embodiment of the present invention, as shown in FIG. 10, a touch drag input moving from the controller C corresponding to one side edge portion of the window W into the window W is performed. When 7 (D7) occurs, the controller C is partially expanded into the window W, so that thumbnails of objects or other various function menus may appear in the expanded portion. Accordingly, the user may select and execute a function to be executed by simply dragging the controller C to extend into the part of the window W. FIG.

In this case, the objects provided as thumbnails may be objects included in the current object structure, or may include only objects not included in the currently used object structure. This is because objects included in the currently used object structure can be easily accessed by only object switching commands, but objects not included in the currently used object structure must be accessed in a different manner. As such, it is of course possible to navigate the plurality of objects by scrolling if necessary in displaying the objects or thumbnails of the objects.

Alternatively, the function menus displayed in the extended controller C may be function menus of functions provided in relation to an object executed in the window W, or may be a function menu for setting a control.

In this case, an arrow A indicating that the controller C can be expanded or an arrow indicating that the controller C which has already been expanded can be displayed may be displayed on the corresponding border.

On the other hand, as shown in FIG. 11, when a touch drag input 8 (D8) that moves from the part of the controller C corresponding to one of the upper, lower, left, and right edges of the window W to the inside of the window W occurs, the controller ( As C) partially expands into the window W, the object structure currently applied to the expanded portion may be displayed. At this time, the user may grasp the entire object structure by scrolling the screen in the object switching direction, and at the same time, change the object by selecting an icon corresponding to another object.

Meanwhile, the drag pattern generated in the longitudinal direction of the controller formed along one side of the two windows and the display state of the window and the controller that are switched corresponding thereto will be described below with reference to FIG. 12. 12 is a view illustrating a drag pattern generated in a longitudinal direction of a controller formed along one side of two windows and a display state of a window and a controller switched corresponding thereto in a lengthwise direction of a controller formed along one side of two windows according to an embodiment of the present invention; It is an illustration.

As shown on the left side of FIG. 12, two windows W and W 'are displayed together, and one side border in the same direction of each of the two windows W and W' (each window W and W 'in the figure). Touch drag input 9 (D9) may be generated by dragging the controller C, which is composed of an edge formed at the right side, of the controller C as a whole to cross both the windows W and W '.

In this case, as shown in the right side of FIG. 12, while the first window W and the second window W 'overlap, the first window W extends to an area where the second window W' is displayed. The second window W 'is displayed by being overlaid with the lower layer of the first window W, so that the display is stopped, and the user recognizes the existence of the second window W' and at the same time the first window W 'is displayed. A tab Tab for selecting the second window W 'may be displayed on the upper side of the first window W so that the display layers of the W) and the second window W' may be changed and displayed. .

Of course, in FIG. 12, when the touch drag input in the opposite direction of the touch drag input 9 (D9) occurs again, the arrangement of the windows W and W ′ or the controller C returns to the state shown on the left side of FIG. 12. can do.

Alternatively, when a multi-touch drag input occurs in which one touch input is fixed at one end and one touch drag input is closer to one end from the other end with respect to both edges of one window of one window, the object structure The virtual windows of the objects arranged in the other end direction of the image may be overlapped with the currently displayed window as shown in the right side of FIG. 12. That is, for example, in a state where the first object is executed in one window, multi-touch input occurs at one point of the upper edge of the window and another point located to the right of the one point, and the multi-touch input of the other point. If the user moves to the left side and approaches one point, a virtual window displaying the execution result of the second object arranged on the right side with respect to the first object may be displayed as a new window and overlapped with the window in which the first object is executed. .

As described above, the present invention includes various control methods performed by using an object structure in which objects are arranged, a window in which objects are executed and displayed, and a controller controlling their display and switching. In particular, the controller is provided in the border area of the window, so the entire four-room area surrounding the window can be used for window control. Instead of simply resizing the window using the border, it is possible to create a new window or execute a new object. By controlling, anyone can easily control the user terminal intuitively.

The user terminal control method according to the embodiment described above may also be implemented in the form of a recording medium including instructions executable by a computer, such as a program module executed by the computer. Computer readable media can be any available media that can be accessed by a computer and includes both volatile and nonvolatile media, removable and non-removable media. In addition, the computer-readable medium may include both computer storage media and communication media. Computer storage media includes both volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data. Communication media typically includes any information delivery media, including computer readable instructions, data structures, program modules, or other data in a modulated data signal such as a carrier wave, or other transport mechanism.

The foregoing description of the present invention is intended for illustration, and it will be understood by those skilled in the art that the present invention may be easily modified in other specific forms without changing the technical spirit or essential features of the present invention. will be. It is therefore to be understood that the above-described embodiments are illustrative in all aspects and not restrictive. For example, each component described as a single entity may be distributed and implemented, and components described as being distributed may also be implemented in a combined form.

The scope of the present invention is shown by the following claims rather than the above description, and all changes or modifications derived from the meaning and scope of the claims and their equivalents should be construed as being included in the scope of the present invention. do.

Claims (16)

One or more windows each outputting the result of the execution of the object, and the user terminal by providing a controller to surround the at least a portion of the edge of the window to control the execution state of the object outputting the execution result in the window to the user terminal As a method for controlling, performed by the user terminal,
Forming an object structure by arranging a plurality of objects to be outputted in the window and virtually structuring the objects;
Executing and displaying a selected object included in the object structure on the window;
And switching an object outputting an execution result to the window from the selected object to another object based on the object structure when a drag input of a preset switching direction with respect to the controller is detected. The method of claim 1,
Forming the object structure,
And arranging the plurality of objects in a matrix form. The method of claim 1,
The window is formed in a rectangle,
And the controller comprises a user interface surrounding at least one side of the rectangular window. The method of claim 3,
The controller comprising:
And a graphical user interface surrounding all edges of the window. The method of claim 1,
Forming the object structure,
Forming a plurality of different object structures having different arrangements; And
And selecting an object structure to be currently applied among the plurality of object structures. The method of claim 1,
The object included in the object structure,
An application or a set of applications / A file or a set of files executed by an application / A desktop metaphor in which a shortcut icon of at least one of an application, a file, or a set of files is arranged / An operating system of the user terminal / Web browser And at least one of a web page / browsed by the object and the object structure itself. 5. The method of claim 4,
Wherein the switching comprises:
Temporarily storing a current execution state of the selected object when the object whose execution result is output to the window is changed from the selected object to another object;
If the selected object is an application program or a file executed by the application program, maintaining the operation of the application program in a virtual window arranged virtually with the window according to the object structure but not displayed on the user terminal; , User terminal control method. The method of claim 7, wherein
The method comprises:
When a multi-drag input is generated from both ends of the control bar which is a part of the controller surrounding one predetermined side of the window, respectively, toward the center of the control bar, the execution state of the object executed in the window and the virtual window ends. Further comprising a step, the user terminal control method. 5. The method of claim 4,
The method comprises:
Displaying a controller extending from the one side of the window to the inside of the window when a drag input is generated from the portion of the controller surrounding the one side of the window to the inside of the window; ;
And displaying a menu corresponding to an object on which the execution result is output in the window on the expanded controller, or displaying thumbnails of objects included in the object structure according to the object structure. Way. The method of claim 7, wherein
The method comprises:
And displaying an icon representing the switching direction on one side of the window, and displaying the number of virtual windows virtually arranged in the switching direction indicated by the icon. 5. The method of claim 4,
The method comprises:
Generating a new window in a drag input direction and displaying the drag input direction when a drag input in a direction relatively outward with respect to the window is detected from a portion of the controller surrounding each side of the window. 12. The method of claim 11,
The method comprises:
Selecting an object to output an execution result in the new window; And
And executing a selected object to output a result in the new window. The method of claim 3,
The method comprises:
When a multi-drag input is detected that is relatively far from each other from the part of the controller, extending and displaying the width direction of the part of the controller, and further comprising executing a new object in the region inside the controller and outputting the execution result, User terminal control method. The method of claim 1,
The method comprises:
If a command for creating a job log file is received from a user, the method further includes creating and storing a job log file including an arrangement state of the window and identification information of an object in which an execution result is output to the window, respectively. Control method. 15. The method of claim 14,
The job log file,
And at least one of an execution state or an edit state of an object corresponding to the virtual window, which is virtually arranged with the window according to the one or more windows and the object structure, and which is not displayed on the user terminal. The method of claim 1,
Forming the object structure,
Forming at least one different object structure for each object belonging to a different hierarchy,
Wherein the switching comprises:
And switching objects according to object structures of different hierarchies according to the number of touch points of the drag input in the switching direction.

Images