KR20100133186A - Method, terminal and recording medium for executing application using multi-screen architecture - Google Patents

Abstract

PURPOSE: A method, a terminal and a recording medium for executing an application by using a multi-screen architecture are provided to normally execute the application programs, which is applicable to a terminal having a keypad, in a terminal having a touch screen instead a keypad. CONSTITUTION: A multi-screen control unit(110) displays an application program screen, displays a virtual screen for controlling an application program on a front screen, and controls the multi-screen including the front screen and the application program screen. A touch event sensor(120) recognizes a touch event through the front screen. An event converter(130) converts the touch event into a key event which enables the processing of the application program. An application program execution controller(140) controls the execution of the application program according to the key event.

Description

Method, Terminal and Recording Medium for Executing Application using Multi-Screen Architecture}

An embodiment of the present invention relates to a method, a terminal, and a recording medium for executing an application program using a multi-screen structure. More specifically, in a terminal having a touch screen instead of a keypad, a method of executing an application using a multi-screen structure that allows many applications to be applied to a terminal with a keypad to be normally executed and to be operated by a user. And a recording medium.

These days, due to the explosive increase in the number of subscribers to mobile communication services, the terminal is considered to be a modern necessity.

In this situation, in order to further improve user convenience, the terminal is gradually changing the input method from the input method through the keypad to the input method through the touch screen. That is, the input method is changing from an input method through a key event to an input method through a touch event.

As such, as the input method is changed into an input method through a touch event, many applications that are designed to be applied to a terminal with a conventional keypad are touched without a keypad because they are executed only by a key event or can be operated by a user. In a terminal provided with a screen, there is a problem in that it is not executed or user operation cannot be performed.

In this context, an embodiment of the present invention aims at allowing a large number of application programs designed to be applied to a terminal with a keypad to be normally executed and to be operated by a user in a terminal having a touch screen instead of a keypad.

According to an embodiment of the present invention, an application window displaying an execution content of an application program is displayed on an application screen, a virtual screen for user control of the application program is displayed on a foreground screen, and the application screen and the foreground. A multi-screen controller for controlling the multi-screen including the screen; A touch event recognition unit recognizing a touch event through the foreground screen; An event converter configured to convert the recognized touch event into a key event that can be processed by the application program; And an application program execution control unit for controlling the execution of the application program according to the converted key event.

In addition, an embodiment of the present invention, an application window displaying the execution content of the application program is displayed on the application screen, a virtual screen for controlling the user of the application on the foreground screen, the application screen And a multi screen control step of controlling a multi screen including the foreground screen. A touch event recognition step of recognizing a touch event through the foreground screen; An event conversion step of converting the recognized touch event into a key event that can be processed by the application program; And an application program execution control step of controlling the execution of the application program according to the converted key event.

In addition, according to an embodiment of the present invention, in a recording medium on which a program for executing a method of executing an application program is executed by using a multi-screen structure, an application program window displaying execution contents of the application program is displayed on the application program screen. A multi-screen control function for displaying a virtual screen for user control of the application on a foreground screen and controlling the multiple screen including the application screen and the foreground screen; A touch event recognition function for recognizing a touch event through the foreground screen; An event conversion function for converting the recognized touch event into a key event that can be processed by the application program; And a computer-readable recording medium having recorded thereon a program implementing an application program execution control function for controlling the execution of an application program according to the converted key event.

In addition, another embodiment of the present invention, the sorting order for a multi-screen including a first screen on which the execution content of the application program running on the terminal is displayed, and a second screen on which the virtual screen for the user control of the application program is displayed A multi-screen alignment control unit for controlling the; A multi-screen output control unit outputting one or more screens of the multi-screens to a display of the terminal based on the controlled sorting order; And an event controller configured to transfer the event recognized through the display to one or more screens of the multi-screen to control processing of the delivered event on the one or more screens. To provide.

As described above, according to the exemplary embodiment of the present invention, in a terminal having a touch screen instead of a keypad, many application programs designed to be applied to a terminal having a keypad are normally executed and a user operation can be performed.

Hereinafter, some embodiments of the present invention will be described in detail through exemplary drawings. In adding reference numerals to the components of each drawing, it should be noted that the same reference numerals are assigned to the same components as much as possible even though they are shown in different drawings. In the following description of the present invention, a detailed description of known functions and configurations incorporated herein will be omitted when it may make the subject matter of the present invention rather unclear.

In addition, in describing the component of this invention, terms, such as 1st, 2nd, A, B, (a), (b), can be used. These terms are only for distinguishing the components from other components, and the nature, order or order of the components are not limited by the terms. If a component is described as being "connected", "coupled" or "connected" to another component, that component may be directly connected to or connected to that other component, but there may be another configuration between each component. It is to be understood that the elements may be "connected", "coupled" or "connected".

1 is a block diagram of a terminal 100 for executing an application program using a multi-screen structure according to an embodiment of the present invention.

Referring to FIG. 1, a terminal 100 executing an application program using a multi-screen structure according to an embodiment of the present invention may include a multi-screen controller 110 controlling a plurality of screens and a touch for recognizing a touch event. The event recognizer 120, an event converter 130 that converts the recognized touch event into a key event that can be processed by the application, and an application program execution controller 140 that controls the execution of the application according to the converted key event. It includes.

The multi-screen control unit 110 displays an application window on which the execution contents of an application program executed in the terminal 100 is displayed on an “application screen” and displays a virtual screen for user control of the application program. Appears on the "Foreground screen" and controls the "Multi-screen" including these application screens and foreground screens.

The above-described touch event recognition unit 120 recognizes the touch event through the foreground screen on which the virtual screen is displayed.

The above-described event converter 130 converts the touch event recognized by the touch event recognizer 120 into a key event that can be processed by the corresponding application program.

The above-described application program execution control unit 140 controls the execution of the corresponding application program according to the key event converted by the event conversion unit 130. Here, the application program may be, for example, a game program executed in the terminal 100 and executed as a key event.

According to the terminal 100 for executing an application program using a multi-screen structure according to an embodiment of the present invention, a virtual touch event may be recognized for user control of the application program executed in the terminal 100. By displaying the screen on the "foreground screen", the "foreground screen" recognizes touch events, and converts the recognized touch events into key events, allowing users to manipulate applications that were not possible with touch events alone. Will be. That is, according to the present invention, even through the multi-screen control and event conversion, even in the terminal 100 having no keypad, it is possible to operate a keypad-specific application program that is operated by receiving a key event of the keypad.

The "multi-screen" disclosed in this embodiment refers to an application program executed in the terminal 100, in particular, an application program (eg, a game program) operated according to a key event in a terminal 100 having no keypad. It refers to a collection of virtual logical screens (or surfaces) to enhance the expressive power expressed on the display and to be operable with touch events.

In the following description, the structure of the multi-screen is described with reference to FIG. 3.

The "multi-screen" disclosed in the present embodiment may include a plurality of logical screens. For example, referring to FIG. 3, an "application screen" in which execution contents (screens) of an application program are displayed is displayed. Application screen 320 " and a " foreground screen 310 " displaying a virtual screen for user control of the application program.

Referring to FIG. 3, such a "multi-screen" is a background screen of a standby screen, a general menu screen, etc. which may be displayed on the display 300 of the terminal 100 regardless of the application program mentioned in the present embodiment. 330 may be further included, in the present embodiment, for convenience of description, the wallpaper 330 is arranged at the bottom so that the application screen 320 and the foreground screen 310 are at the top of the wallpaper 330. By assuming that it is overlaid, it is assumed that only the application screen 320 and the foreground screen 310 are included in the multi-screen.

The multi-screen controller 110 may control screen alignment so that the application screen 320 and the foreground screen 310 included in the multi-screen are arranged in an overlay form.

In addition, the aforementioned multi-screen controller 110 may control the order in which the application program screen 320 and the foreground screen 310 are aligned by a function call (Call) according to the execution of the application program. As shown in FIG. 3, the sorting order may be controlled such that the foreground screen 310 is overlaid on the application screen 320, and a specific function is called according to the execution of the application, so that the application screen 320 is displayed on the foreground screen 310. You can also control the sort order to overlay on top of the

 On the other hand, the above-described multi-screen control unit 110, for each of the application screen 320 and the foreground screen 310, to be displayed on each screen (310, 320) through the control of a separate graphic context (Graphic Context) Mark the contents and preserve the marked contents.

On the other hand, the above-described multi-screen control unit 110, the application program screen through at least one of the static method defined by the Extensible Markup Language (XML) and the dynamic method by the function call of the application program. The screen configuration of each of the 320 and the foreground screen 310 may be controlled.

Each of the components of the application screen 320 and the foreground screen 310 may include a master component that is a parent component of all the components displayed on the screen, a text component that displays a string, a button component that handles a user's pressing operation, It may include one or more list components for displaying multiple items at the same time.

The above-mentioned master component includes a component for designating an area occupied by the component, a component for designating a border of the component, a component for designating a background color to fill the area of the component, And a component for designating an image file name to be displayed in an area of the corresponding component.

In addition, the above-mentioned text component includes at least one of a component for specifying a string to be displayed, a component for specifying a color of the string, and a component for specifying a font of the string. can do.

In addition, the above-mentioned button component may include one or more of an image component in a state where a button is not pressed, an image component in a state in which the button is pressed, an image component to be delivered to an application when the button is pressed, and the like. Can be.

In addition, the above-mentioned list component is a direction button component for moving the selected item in a list including several items up, down, left and right, a component for designating the number of items to be displayed in the list, and the direction (vertical or horizontal) of the list. One or more components may be included in the component for designating, and the component for designating whether to rotate beyond the boundary when the item selected in the list is the last or the first.

As described above, the multi-screen control unit 110 may control the multi-screen including the application screen 320 and the foreground screen 310. For example, the multi-screen control unit 110, the application screen ( One or more may be controlled in the position, size, color, and shape of the application program window displayed on 320.

In addition, the aforementioned multi-screen controller 110 may display one or more virtual screens on the foreground screen 310 as a recognition area of a touch event for user control of an application program.

Here, the virtual screen displayed on the foreground screen 310 may be one or more of an image form and a text form, and may include a specific function of an application program (for example, a menu selection function, an item selection function, an input / output function, a user manipulation function, and the like). One or more virtual function buttons may be included.

The above-mentioned virtual function buttons include a menu selection button for selecting a specific menu, an item selection button for selecting a specific item, an input / output button for inputting or outputting specific information, and a direction or a specific item (e.g. a game item). ) May be included in one or more operation buttons for operating. The virtual function button refers to a button operated by a touch event, not a button operated according to a key event through a keypad.

As another example for the multi-screen control unit 110 to control the multi-screen including the application screen 320 and the foreground screen 310, the above-described multi-screen control unit 110, the virtual screen to be displayed on the foreground screen 310 One or more of the number, type, position, size, color, and shape of the screen may be controlled, or one or more of the number, type, position, size, color, and shape of the virtual function buttons included in the virtual screen may be controlled.

As another example for the multi-screen controller 110 to control the multi-screen including the application screen 320 and the foreground screen 310, the aforementioned multi-screen controller 110 is displayed on the application screen 320. Some contents of the execution contents of the application displayed in the application window may be enlarged according to a predetermined magnification, and the enlarged contents may be displayed on the foreground screen 310 overlaid on the application screen 320.

Referring to FIG. 3, when a user touches an arbitrary point of the foreground screen 310 output to the display 300, a specific virtual function button included in the virtual screen displayed on this point (for example, the foreground screen 310). The touch event 3000 is generated from the displayed point), and the touch event 3000 is recognized by the touch event recognition unit 120. For the touch event 300 recognized as described above, the above-described event converting unit 130 converts the recognized touch event into a key event of a form that an application program can process. As an example of the conversion, the recognized touch event Determines the type of and converts the recognized touch event into a key event based on the identified type.

The touch event mentioned above may be one type in a click event, a drag event, a flick event, a press event, a release event, and the like.

A click event is a type of touch event, such as a mouse click on a regular PC, that is a light touch of a point. For example, a click event can be used to select a particular menu of a game or a specific game item.

A drag event is selected and held (touched) to another specific point by selecting an image (such as an item displayed on each screen 310 or 320 or a virtual function button displayed on the foreground screen 310) at a specific point. This is an outstanding action after moving, and continuously moving according to the moving direction of the image moved while pressed (for example, it may be an item displayed on each screen 310 or 320 or a virtual function button displayed on the foreground screen 310). It is fixed in the striking motion. For example, a drag event can be used to move a particular game item in a game.

The flick event is an operation in which a contact floats after moving in a specific direction (up, down, left, right, or diagonal) after a touch, and a specific operation is processed according to an operation direction and a moving speed of the flick event. For example, a flick event may be used to move or fly a particular game item in a specific direction in a game that is one of applications.

The press event refers to an event of an operation of continuously pressing a contact after a touch, and a release event refers to an event of an operation of floating a contact after a touch.

After the touch event is converted by the aforementioned event converting unit 130 into a key event of a form that an application can process, the application program executing control unit 140 receives the converted key event and inputs the input key event. Based on this, a specific function (eg, a menu selection function, an item selection function, an input / output function, an operation function, etc.) of an application program corresponding to the virtual screen displayed on the foreground screen 310 is executed.

The terminal 100 for executing an application program such as a game program using the multi-screen structure described above with reference to FIG. 1 includes a touch display 300, an application program screen 320 and a foreground screen 310. ) May be output to the display 300 or one or more of the multiple screens may be output to the display 300.

2 is a flowchart illustrating a method in which the terminal 100 executes an application program using a multi-screen structure according to an embodiment of the present invention.

Referring to FIG. 2, in the method of executing an application program using a multi-screen structure according to an embodiment of the present invention, an application window displaying execution contents of the application program is displayed on the application screen 320. A multi-screen control step of displaying a virtual screen for user control of an application on the foreground screen 310 and controlling the multiple screen including the application screen 320 and the foreground screen 310 (S200); A touch event recognition step (S202) of recognizing a touch event through the foreground screen 310; An event conversion step (S204) of converting the recognized touch event into a key event that can be processed by an application program; And an application program execution control step (S206) for controlling execution of an application program according to the converted key event.

The above description will be exemplarily described with reference to FIGS. 4 to 8, which follow a method for executing an application program using a multi-screen structure (see FIG. 3) according to an embodiment of the present invention. In the description of FIGS. 4 to 8, it is assumed that the application program is a game program that operates only as a key event.

4 shows menu selection buttons 4110, 4120, 4130, and 4140 that can be operated as touch events as virtual function buttons to execute an application program using a multi-screen structure (see FIG. 3) according to an exemplary embodiment of the present invention. The foreground screen 410 on which the virtual screen 4100 including) is displayed and the application screen 420 overlap.

Fig. 4A shows an application program screen (i.e. game screen) 420 for a game program as an application program. The application program screen (i.e. game screen) 420 executes a game program. An application program window (ie, a game window) 4200 in which the contents are displayed is displayed. In addition, in the example illustrated in FIG. 4A, game menus 4210, 4220, 4230, and 4240 are displayed in an application program window (ie, a game window) 4200. As described above, since the game program in the example shown in Fig. 4A operates only as a key event, the user cannot select or operate the displayed game menus 4210, 4220, 4230, 4240.

In order to select or manipulate the game menus 4210, 4220, 4230, and 3240, the game menus 4210, 4220, 4230, and 4240 are provided as virtual function buttons on the foreground screen 410 as shown in FIG. 4B. ) And a virtual screen 4100 including menu selection buttons 4110, 4120, 4130, and 4140, respectively.

If the application screen (i.e., game screen) 420 and the foreground screen 410 on which the virtual screen 4100 is displayed are superimposed and output on the display shown in FIG. )

Referring to FIG. 4C, a screen 430 in which an application program screen (that is, a game screen) 420 and a foreground screen 410 overlap each other is output to the display. , An application window (ie, a game window) 4200 is displayed, and menu selection buttons 4110, 4120, 4130, and 4140 included in the game menus 4210, 4220, 4230, and 4240 and the virtual screen 4100 are displayed. Overlapping game menus 4310, 4320, 4330, 4340 are displayed.

5 is a foreground screen displaying a virtual screen 5100 including an input / output button 5110 that can be operated as a touch event as a virtual function button to execute an application program using a multi-screen structure according to an embodiment of the present invention. It is an exemplary view showing that the 510 and the application program screen 520 overlap.

FIG. 5A shows an application program screen (i.e. game screen) 520 for a game program as an application program. The application program screen (i.e. game screen) 520 executes a game program. The application program window (ie, game window) 5200 in which the contents are displayed is displayed.

Referring to FIG. 5B, a virtual screen 5100 including an input / output button 5110 as a virtual function button is displayed on the foreground screen 510.

When the application screen (i.e., game screen) 520 and the foreground screen 510 on which the virtual screen 5100 is displayed are superimposed and output on the display shown in FIG. )

Referring to FIG. 5C, a screen 530 in which an application program screen (that is, a game screen) 520 and a foreground screen 510 overlap each other is output to the display. In addition, the input / output button 5110 included in the virtual screen 5100 is displayed together with the application program window (ie, game window) 5200.

FIG. 6 illustrates a virtual screen 6100 including an operation button 6110 that a user can operate as a touch event as a virtual function button to execute an application program using a multi-screen structure according to an embodiment of the present invention. It is an exemplary view showing that the foreground screen 610 and the application program screen 620 overlap.

FIG. 6A shows an application program screen (i.e. game screen) 620 for a game program as an application program. The application program screen (i.e. game screen) 620 executes a game program. An application program window (ie, game window) 6200 in which the contents are displayed is displayed.

Referring to FIG. 6B, a virtual screen 6100 including an operation button 6110 that a user can operate as a touch event as a virtual function button is displayed on the foreground screen 610.

When the application screen (i.e., game screen) 620 and the foreground screen 610 on which the virtual screen 6100 is displayed are overlapped and displayed on the display of FIG. )

Referring to FIG. 6C, a screen 630 in which an application program screen (that is, a game screen) 620 and a foreground screen 610 overlap each other is output to the display. In addition, the operation button 6110 included in the virtual screen 5100 is displayed together with the application program window (ie, the game window) 6200.

7 is an exemplary diagram illustrating executing a game program as an application program using a multi-screen structure according to an embodiment of the present invention.

Referring to FIG. 7, a game screen (ie, an application screen) 720 displayed on a display for executing a game program operated only by a key event as an application program using a multi-screen structure according to an embodiment of the present invention 720 ) Displays a game window (that is, an application window) 7200, and has a virtual screen 7100 area that is not visible on the foreground screen overlaid thereon. When a user touches the area of the virtual screen 7100 to recognize a touch event, a game operation corresponding to the recognized touch event is executed.

For example, when a user makes a touch to click an arbitrary point in the area of the virtual screen 7100, the terminal 100 recognizes the touch event, recognizes that the recognized touch event is a type of the click event, The function of rotating the block 700 may be performed by converting the click event into a key event to perform a predefined function corresponding thereto (the function of rotating the block 700).

As another example, when the user touches an arbitrary point in the area of the virtual screen 7100 and performs flickering, which is an action of flying in a specific direction (for example, upward, downward, left, and right directions), the terminal 100 Recognizes the touch event, determines that the recognized touch event is a type of flick event, and detects the identified flick event corresponding to a predefined function (the function of moving the block 700 in a specific direction). By converting to a key event to be performed, a function of moving the block 700 in a specific direction (eg, up, down, left, and right directions) may be performed.

FIG. 8 illustrates another example of executing an application program using a multi-screen structure according to an embodiment of the present invention, and includes a game screen including a game window (ie, an application window) 8200 of a Go game. That is, the application screen) 820 and the foreground screen 810 by a predetermined size are displayed, and if any specific point on the foreground screen 810 is touched by the user, The vicinity of the point is enlarged according to a predetermined magnification (eg, 2 times, 3 times, etc.), and the enlarged partial content (some screens) is specified on the foreground screen 810 overlaid on the application screen 320 as shown in FIG. 8. It may be indicated by the form 8100.

The method for executing an application program using the multi-screen structure according to the embodiment of the present invention described above may be implemented in a program and recorded in a computer-readable recording medium.

A program recorded on a recording medium for implementing a method of executing an application program using a multi-screen structure according to an embodiment of the present invention may include an application program window displaying execution contents of the application program on the application screen 320. A multi-screen control function for displaying and displaying a virtual screen for controlling a user of an application on the foreground screen 310, and controlling the multiple screen including the application screen 320 and the foreground screen 310; A touch event recognition function for recognizing a touch event through the foreground screen 310; An event conversion function for converting the recognized touch event into a key event that can be processed by an application; And an application program execution control function for controlling execution of an application program according to the converted key event.

Examples of computer-readable recording media include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage, and the like, which are also implemented in the form of a carrier wave (for example, transmission over the Internet). It also includes. The computer readable recording medium can also be distributed over network coupled computer systems so that the computer readable code is stored and executed in a distributed fashion.

In addition, functional programs, codes, and code segments for implementing the present invention can be easily inferred by programmers in the art to which the present invention belongs.

9 is a block diagram of a terminal 900 for executing an application program using a multi-screen structure according to another embodiment of the present invention.

9, a terminal 900 for executing an application program using a multi-screen structure according to another exemplary embodiment of the present invention may include a multi-screen alignment controller 910, a multi-screen output controller 920, and an event controller ( 930) and the like.

The multi-screen alignment control unit 910 arranges a multi-screen including a first screen on which execution contents of an application executed in the terminal 900 are displayed, and a second screen on which a virtual screen for user control of the application is displayed. Control the order The multi-screen output controller 920 outputs one or more screens among the multi-screens to the display of the terminal 900 based on the controlled sort order. The event controller 930 transmits the event recognized through the display of the terminal 900 to one or more screens among the multiple screens so that the event transmitted from the one or more screens is processed.

In addition to the first screen and the second screen, the aforementioned multi-screen may further include one or more additional screens (eg, a background screen). The above-described first screen and the second screen are illustrated in FIG. 3. As an example, the application program screen 320 and the foreground screen 310 included in the illustrated multiple screens may correspond to each other.

In addition, the application program mentioned above may be, for example, a game program executed in the terminal 900 and executed as a key event.

The multi-screen alignment control unit 910 may control the arrangement order of the multi-screens such that the multi-screens are arranged in an overlay form according to a call of an application program.

The multi-screen output control unit 920 described above may output one of the multi-screens to the display or output two or more of the multi-screens to the display based on the sorting order controlled by the multi-screen alignment control unit 910. Can be.

The event controller 930 may transmit the recognized event based on the controlled sorting order to one of the multiple screens, and then, if the event transmitted from one screen is not processed, based on the controlled sorting order. Then, the recognized event is transferred to the other screens in the following order.

The terminal 900 for executing an application program using the multi-screen structure according to another embodiment of the present invention described above with reference to FIG. One or more of a graphic context management unit 940 for controlling a graphic context and a multi-screen operation control unit 950 for controlling an operation for multiple screens through a separate interface for each of the multiple screens and a common interface for the multiple screens. It may further include.

The individual interface for each screen included in the multi-screen mentioned above and the common interface for the entire multi-screen are called from an application program executed in the terminal 900.

As described above, according to an exemplary embodiment of the present invention, in a terminal having a touch screen instead of a keypad, many application programs (eg, game programs, etc.) made to be applied to a terminal having a keypad are normally executed and user manipulation is possible. It has the effect of making it work.

In the above description, all elements constituting the embodiments of the present invention are described as being combined or operating in combination, but the present invention is not necessarily limited to the embodiments. In other words, within the scope of the present invention, all of the components may be selectively operated in combination with one or more. In addition, although all of the components may be implemented in one independent hardware, each or all of the components may be selectively combined to perform some or all functions combined in one or a plurality of hardware. It may be implemented as a computer program having a. Codes and code segments constituting the computer program may be easily inferred by those skilled in the art. Such a computer program may be stored in a computer readable storage medium and read and executed by a computer, thereby implementing embodiments of the present invention. The storage medium of the computer program may include a magnetic recording medium, an optical recording medium, a carrier wave medium, and the like.

In addition, the terms "comprise", "comprise" or "having" described above mean that the corresponding component may be included, unless otherwise stated, and thus excludes other components. It should be construed that it may further include other components instead. All terms, including technical and scientific terms, have the same meanings as commonly understood by one of ordinary skill in the art unless otherwise defined. Terms commonly used, such as terms defined in a dictionary, should be interpreted to coincide with the contextual meaning of the related art, and shall not be construed in an ideal or excessively formal sense unless explicitly defined in the present invention.

The foregoing description is merely illustrative of the technical idea of the present invention, and various changes and modifications may be made by those skilled in the art without departing from the essential characteristics of the present invention. Therefore, the embodiments disclosed in the present invention are not intended to limit the technical idea of the present invention but to describe the present invention, and the scope of the technical idea of the present invention is not limited by these embodiments. The protection scope of the present invention should be interpreted by the following claims, and all technical ideas within the equivalent scope should be interpreted as being included in the scope of the present invention.

1 is a block diagram of a terminal for executing an application program using a multi-screen structure according to an embodiment of the present invention;

2 is a flowchart illustrating a method of executing an application program using a multi-screen structure according to an embodiment of the present invention;

3 conceptually illustrates a multi-screen structure according to an embodiment of the present invention;

4 illustrates an example of overlapping an application screen with a foreground screen on which a virtual screen including a menu selection button is displayed as a virtual function button to execute an application using a multi-screen structure according to an embodiment of the present invention. Degree,

FIG. 5 is an exemplary view illustrating that an application screen is overlapped with a foreground screen on which a virtual screen including an input / output button is displayed as a virtual function button to execute an application using a multi-screen structure according to an embodiment of the present invention. ,

FIG. 6 is an exemplary view illustrating that an application screen is overlapped with a foreground screen on which a virtual screen including an operation button is displayed as a virtual function button to execute an application using a multi-screen structure according to an embodiment of the present invention. ,

7 is an exemplary diagram illustrating executing an application program using a multi-screen structure according to an embodiment of the present invention.

8 is another exemplary diagram illustrating executing an application program using a multi-screen structure according to an embodiment of the present invention.

9 is a block diagram of a terminal for executing an application program using a multi-screen structure according to another embodiment of the present invention.

<Description of Symbols for Main Parts of Drawings>

100: terminal

110: multi-screen control

120: touch event recognition unit

130: event conversion unit

140: application execution control unit

300: display

310: foreground screen

320: application screen

330: Wallpapers

3000: touch event

Claims (21)

Displaying an application window displaying the execution contents of an application on an application screen, displaying a virtual screen for user control of the application on a foreground screen, and controlling the multiple screens including the application screen and the foreground screen; A multi-screen control unit; A touch event recognition unit recognizing a touch event through the foreground screen; An event converter configured to convert the recognized touch event into a key event that can be processed by the application program; And Application program execution control unit for controlling the execution of the application program according to the converted key event A terminal for executing an application program using a multi-screen structure comprising a. The method of claim 1, The multi-screen control unit, A terminal for executing an application program using a multi-screen structure characterized in that the screen arrangement is controlled so that the application screen and the foreground screen are aligned in the form of an overlay. The method of claim 1, The multi-screen control unit, The terminal for executing the application program using a multi-screen structure, characterized in that for controlling the order in which the application screen and the foreground screen is arranged by a function call according to the execution of the application program. The method of claim 1, The multi-screen control unit, A terminal for executing an application program using a multi-screen structure for displaying the corresponding contents and preserving the displayed contents through the control of an individual graphic context for each of the application program screen and the foreground screen. . The method of claim 1, The multi-screen control unit, Controlling the screen configuration of each of the application screen and the foreground screen through at least one of a static method defined by an Extensible Markup Language (XML) and a dynamic method by calling a function of the application. A terminal for executing an application program using a multi-screen structure, characterized in that. The method of claim 1, The multi-screen control unit, A terminal for executing an application program using a multi-screen structure, characterized in that for controlling at least one of the position, size, color, and shape of the application window displayed on the application screen. The method of claim 1, The multi-screen control unit, In order to control the application, at least one virtual screen is displayed on the foreground screen as a recognition area of the touch event. The virtual screen, A terminal for executing an application program using at least one of an image form and a text form, and including at least one virtual function button corresponding to a specific function of the application program. The method of claim 7, wherein The virtual function button, A terminal executing an application program using a multi-screen structure, characterized in that it comprises at least one of a menu selection button, an item selection button, an input / output button, and an operation button. The method of claim 7, wherein The multi-screen control unit, Control one or more of the number, type, position, size, color, and shape of the virtual screen to be displayed on the foreground screen, or the number, type, position, size, color, and shape of the virtual function buttons included in the virtual screen. A terminal for executing an application program using a multi-screen structure, characterized in that for controlling one or more of the. The method of claim 1, The multi-screen control unit, Executing an application program using a multi-screen structure characterized in that a part of the execution contents of the application program displayed on the application program window is enlarged according to a predetermined magnification, and the enlarged partial content is displayed on the foreground screen. terminal. The method of claim 1, The event conversion unit, And identifying the type of the recognized touch event and converting the recognized touch event into the key event based on the identified type. The method of claim 11, The recognized touch event, A terminal that executes an application using a multi-screen structure, which is one of a click event, a drag event, a flick event, a press event, and a release event. . The method of claim 1, The application program execution control unit, Receiving the converted key event, based on the received key event, the application program using a multi-screen structure, characterized in that for executing a specific function of the application program corresponding to the virtual screen displayed on the foreground screen Terminal running. The method of claim 1, The terminal, A display having a touch type and outputting one of the multiple screens including the application screen and the foreground screen to the display, or outputting two or more of the multiple screens to the display, wherein the application program is a key. A terminal for executing an application program using a multi-screen structure, characterized in that the game program is executed by the event. Displaying an application window displaying the execution contents of an application on an application screen, displaying a virtual screen for user control of the application on a foreground screen, and controlling the multiple screens including the application screen and the foreground screen; Multiple screen control step; A touch event recognition step of recognizing a touch event through the foreground screen; An event conversion step of converting the recognized touch event into a key event that can be processed by the application program; And An application execution control step of controlling execution of an application according to the converted key event Method for executing an application using a multi-screen structure comprising a. A recording medium having recorded thereon a program for executing a method of executing an application program using a multi-screen structure, Displaying an application window displaying the execution contents of an application on an application screen, displaying a virtual screen for user control of the application on a foreground screen, and controlling the multiple screens including the application screen and the foreground screen; Multi-screen control function; A touch event recognition function for recognizing a touch event through the foreground screen; An event conversion function for converting the recognized touch event into a key event that can be processed by the application program; And An application execution control function for controlling execution of an application according to the converted key event A computer-readable recording medium that records a program that implements the program. A multi-screen alignment control unit controlling a sorting order for multiple screens including a first screen displaying execution contents of an application program executed in a terminal and a second screen displaying a virtual screen for user control of the application program; A multi-screen output control unit outputting one or more screens of the multi-screens to a display of the terminal based on the controlled sorting order; And An event controller for transmitting the event recognized through the display to one or more screens of the multiple screens so that the delivered event is processed on the one or more screens; A terminal for executing an application using a multi-screen structure comprising a. The method of claim 17, The multi-screen alignment control unit, In response to a call of the application program, the terminal executing the application program using a multi-screen structure, characterized in that for controlling the sorting order of the multi-screen so that the multiple screen is arranged in an overlay (Overlay) form. The method of claim 17, The multi-screen output control unit, Based on the controlled sorting order, outputting one of the multiple screens to the display, or outputting two or more of the multiple screens to the display to execute the application program using the multi-screen structure terminal. The method of claim 17, The event control unit, When the recognized event is delivered to one of the multiple screens based on the controlled sort order, and the delivered event is not processed on the one screen, the recognized event is based on the controlled sort order. A terminal for executing an application program using a multi-screen structure, characterized in that to deliver the event to the other screen in the next order. The method of claim 17, The terminal, A graphic context manager configured to control an individual graphic context for each of the multiple screens such that contents displayed on each of the multiple screens are preserved; And A multi-screen operation control unit for controlling the operation of the multi-screen through the individual interface for each of the multi-screen and the common interface for the multi-screen Include at least one of The individual interface and the common interface, A terminal for executing an application program using a multi-screen structure, characterized in that it is called from the application program running in the terminal.

Images