KR20140135276A - Method and Apparatus for processing a gesture input on a game screen - Google Patents

Abstract

A method to process a gesture input of a user on a game screen, including at least one selectable object according to an embodiment of the present invention, includes the following steps of: determining whether the gesture of the user is a multi-touch input having at least two touch-in points or not; deactivating a selection function of the object on the game screen if the gesture of the user is determined as the multi-touch input; and converting the view of the game screen from a first observation point to a second observation point based on the multi-touch input.

Description

Field of the Invention [0001] The present invention relates to a method and apparatus for processing a user's gesture input to a game screen,

The present invention relates to a method and apparatus for processing a user's gesture input to a gaming screen.

In recent years, the mobile game market has also grown significantly due to the rapid spread of mobile terminals such as smart phones and tablet PCs. In the early days, the quality of the game was inferior due to the performance problem of the terminal. However, even though the CPU and the graphic performance are supported at present, the user interface of the keyboard and the mouse is not enough, It is giving difficulties to do.

Accordingly, a mobile terminal employing a front touch screen is developed, and without a separate key pad, the mobile terminal outputs a virtual keypad screen, a virtual direction key, and a virtual operation key on a touch screen screen. However, such a virtual user interface occupies a part of the screen of a small-sized mobile terminal, thereby interfering with the visibility of the user and interfering with the play screen of the online game.

On the other hand, gesture systems have been applied to many applications as smartphones or tablet PCs have been popularized and evolved, but their application has been limited due to technical limitations in online games. For example, in an online game including a MMOPRG (Massively Multiplayer Online Role Playing Game, hereinafter referred to as MMORPG), it is difficult to apply the gesture system because the gesture input must be detected while continuously checking the state of the character or the state of the monster .

In addition, there are many game commands to be implemented, but there is a difficulty that the gesture that the user can easily memorize and intuitively input is limited. For example, in the case of a game executed in a three-dimensional virtual space, commands for manipulating characters or items as well as commands for virtual spaces must be implemented as gesture input. However, if it is desired to implement all of them as a gesture input, it is difficult to distinguish between a command for a character or an item and a command for a virtual space, and non-rotational movement, rotational movement, and zoom in / There is a problem that it is difficult to clearly distinguish and process them.

The present invention has been made to solve the above-mentioned problems occurring in the prior art, and it is an object of the present invention to provide an apparatus and method for minimizing a gesture input required for performing an efficient and quick operation in a game using a terminal having a touch screen, And to provide a method for processing gesture input in a game that can be played.

It is another object of the present invention to provide a gesture input method and a gesture input method capable of minimizing a gesture input required for performing an efficient and quick operation in a game using a terminal having a touch screen, And a method of processing a gesture input in a game that can be provided.

Yet another embodiment of the present invention is to minimize the input of a gesture required to perform an efficient and quick operation when playing a game using a terminal having a touch screen, to improve the operation feeling, and to provide a comfortable view And to provide a device capable of performing the above-described operation.

According to one embodiment of the present invention, a method of processing a user's gesture input to a game screen including at least one selectable object comprises: determining whether the user's gesture is a multi-touch input having at least two touch- ; Deactivating the selection function of the object on the game screen when the gesture of the user is determined as the multi-touch input; And switching a view of the game screen from the first observation point to the second observation point based on the multi-touch input.

Preferably, the step of switching the view of the game screen further comprises the step of selecting at least one of the coordinates of the touch-in and touch-out points of the multi-touch input, the moving direction, the moving speed, Determining a second observation time point; And rotating the game screen from the first observation point to the second observation point.

Advantageously, the step of switching the view of the game screen further comprises: if the multi-touch input includes a plurality of drag inputs rotated in the same rotation direction, a straight line passing through the touch-in points and a straight line passing through the touch- Calculating a rotation angle defined by the intersection; And rotating the game screen in proportion to the rotation angle based on a predetermined point in the game screen,

Wherein the predetermined point is an intersection of the straight lines, a midpoint of the touch-in points or an origin of the game screen,

A condition that the distance difference of the touch-in points is equal to or greater than a first threshold value, a condition that the rotation angle is equal to or greater than a second threshold value, and a condition that a difference between touch- in times is equal to or less than a third threshold value.

Advantageously, the step of toggling the view of the game screen comprises: if the multi-touch input includes a plurality of drag inputs running side by side towards the same point, the touch-in points, touch- Calculating a rotation angle using a predetermined point in the screen; And rotating the game screen based on a predetermined point in the game screen using the rotation angle,

The calculating of the rotation angle may include calculating an angle between a midpoint of the touch-in points and a straight line passing through the predetermined point and a straight line passing through the midpoint of the touch-

The predetermined point is the origin of the game screen,

A condition that the distance difference between the touch-in points is equal to or less than a fourth threshold value, a condition that the calculated rotation angle is equal to or greater than a fifth threshold value, and a condition that an input time difference of the drag inputs is equal to or less than a sixth threshold value.

Preferably, the step of rotating the game screen rotates the game screen in the azimuth direction of the virtual space of the game when the multi-touch input advances in the horizontal direction, and when the multi-touch input advances in the vertical direction The game screen can be rotated in the vertical direction of the virtual space.

Preferably, the step of switching the view of the game screen comprises: if the multi-touch input includes a stopped touch-and-hold input and a drag input, And can be rotated and moved in accordance with the drag input.

Preferably, when the difference between the touch-in times of the multi-touch input and the touch-out times is a tap input or a double tap input having a seventh threshold value or less, the additional information on the object is pop- .

Preferably, the game screen comprises a three-dimensional background, a three-dimensional object layer including a building or a character, a two-dimensional text displayed during game execution, a plane object layer containing an image or an animation message, And a graphics layer including a game menu item,

In the rotating and moving step, only the three-dimensional object layer among the layers of the game screen may be rotated.

Preferably, the method further comprises the step of displaying, when the gesture of the user is judged to be the multi-touch input, a graphic effect indicating that the mode has been entered for switching the view of the game screen during the multi-

Wherein the graphic effect includes at least one of a mini-map display, a direction display, a contrast control, a transparency adjustment, and a path display for guiding view switching,

The mini-map display and the azimuth display may be rotated to reflect the view of the game screen.

Advantageously, the game screen includes a game simulation game, an RPG game including an MMORPG / MORPG, an AOS (Aeon of Strife) game, an RTS (Real Time Strategy) game, a FPS / TPS Person Shooters) game, or a screen of a sports game.

According to another embodiment of the present invention, there is provided a computer-readable recording medium on which a program for executing the above-described method is recorded.

According to another aspect of the present invention, there is provided a terminal for executing a game, the terminal including: a touch screen displaying a game screen including at least one selectable object and receiving a user's gesture on the game screen; A gesture analyzer for determining whether the user's gesture is a multi-touch input having at least two touch-in points; And disabling the selection function of the object on the game screen when the gesture is determined to be the multi-touch input, and displaying a view of the game screen on the basis of the multi- As shown in FIG.

According to the gesture input processing method according to an embodiment of the present invention, it is possible to simplify various commands necessary for executing a game to intuitive gesture inputs, clearly distinguish and correctly process the gesture inputs, and perform efficient and quick operations It is possible to minimize the input of the gesture necessary for the user to improve the operation feeling of the user and to provide the user with a comfortable view.

1 is a schematic diagram illustrating a terminal 110 and 120 processing gesture input in a game system 100, in accordance with an embodiment of the present invention.
2 is a flow chart illustrating a method for processing a gesture input, in accordance with another embodiment of the present invention.
3 is a flowchart illustrating a method of determining an observation time according to a type of a multi-touch input according to an embodiment of the present invention.
4A and 4B are views for explaining movement of an observation time according to an embodiment of the present invention.
5 through 7 illustrate multi-touch input and representation according to an embodiment of the present invention.
8A to 8C are views for explaining continuous input and presentation of a single touch and a multi-touch according to an embodiment of the present invention.
Figures 9A and 9B are diagrams illustrating game screens at different observation points in accordance with an embodiment of the present invention.
10A and 10B are views illustrating a game screen before and after displaying additional information according to an embodiment of the present invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, the present invention will be described in detail with reference to the accompanying drawings. The following examples are intended to illustrate the present invention and should not be construed as limiting the scope of the present invention. Accordingly, equivalent inventions performing the same functions as the present invention are also within the scope of the present invention. In the following description, the same reference numerals denote the same components, and unnecessary redundant explanations and descriptions of known technologies will be omitted.

In the embodiments of the present invention, " communication ", " communication network ", and " network " The three terms refer to wired and wireless local area and wide area data transmission and reception networks capable of transmitting and receiving a file between a user terminal, a terminal of another user, and a download server.

In the following description, the term " game server " means a server computer to which users are connected and connected to use game contents. In the case of a game having a small capacity or a small number of users, a plurality of game programs can be operated in one game server. In addition, in the case of a game having a very large capacity or a large number of real-time connections, there may be one or more game servers for operating one game depending on the functions of the game. In addition, middleware for the database and servers performing payment processing can be connected to the game server, but the description thereof will be omitted in the present invention.

Also, the game server may be interworked with a server of the SNS system or a server of the mobile messaging system. The game server may invite a new user by using a list of users registered in the server of the SNS system or a server of the mobile messaging system, or may exchange game scores among users who use the game or exchange or provide items used in the game .

In the present invention, the term "game " includes an online game and an offline game, but for the sake of convenience, an online game is assumed. Those skilled in the art will be able to apply the invention to off-line games, with reference to the following description of the on-lime game. In the present invention, the online game refers to game contents that are accessible to users by accessing the above-mentioned game server. Particularly, it means a game in which a plurality of users can simultaneously access and enjoy the game, and the level is raised through an act of acquiring experience while fostering a character by advancing the game. It also means a game in which various kinds of items can be purchased in order to facilitate the progress of the game in the game.

Also, in an online game, various community systems can be used. For example, a guild of an online game, or a clan may be formed. The above concept means that users who use online games gather to form a group and organize a group. Depending on the number of users or the level of the characters of the users, each group can have a high reputation of a guild or a clan, so that various benefits within the game can be utilized. For example, if the reputation of a guild or a clan increases, the character's display on the game screen may vary (e.g., the effect of changing the color of the displayed character's name), or the use of items and villages within the game .

Also, the community system available in online games is party play. Party play is a group on game play through users' requests, invitations, and acceptances. The formed party members can use their own chat system or use specific markers to identify party members on the game screen.

Also, the users who play the party can distribute the items to each other or share the contents of the result obtained as a result of the game play. The manner of sharing can also be set by holding each resultant content, distributing at least part of the resulting content to other characters, and so on.

In the present invention, the resultant content refers to all the content that can be obtained by the characters of the play-out users during the play of the game. For example, in the case of a shooting game, the experiential value and cyber money that can be obtained at the end of one game may belong to the result content, and in the case of a sports game, the experience value obtained at the end of one game, . In the case of role-playing games, experience can be obtained when completing a specific quest, monster, or reward cyber money.

When the character of the user in the online game acquires a specific result content, it is a basic matter that all of the result contents belong to the character of the user. However, when you are in a party play or guild, clan, etc., at least some of the content of the result you have acquired may be distributed to other users' characters belonging to the party, guild, clan,

An item here refers to all the data that can help the progress of the game and can be understood as an item in a game in general. For example, in a role-playing game, an item that allows a character on behalf of a user to gain more experience when controlling a monster, an item that can change the appearance of the character, a harvesting game in a farming game And the like may correspond to items in the present invention, but are not limited thereto.

A game screen means a screen displayed on a terminal that executes a game. In the case of a game performed in a three-dimensional virtual space, the entire virtual space can be displayed on one screen, but only a part of the virtual space can be enlarged and displayed. Therefore, the game screen does not necessarily mean the entire virtual space, and there may be a virtual space that is not displayed outside the game screen.

A view of a game screen means a viewpoint for observing a virtual space. When a virtual camera exists that photographs a virtual space and relays it to a user, the image of the photographed virtual space corresponds to the game screen, and the coordinates on the virtual space in which the virtual camera exists include an observation point . The enlargement and reduction of the game screen may be performed by moving the observation point at which the virtual camera exists, but may also be performed without moving the observation point by zooming in / out of the virtual camera. Hereinafter, it is assumed that enlargement and reduction of the game screen are performed by zooming in / out of the virtual camera without changing the observation time. That is, the movement of the observation point is defined as excluding the simple enlargement / reduction of the game screen.

The game screen may include at least one selectable object, wherein the object refers to an item, a menu item, a character, a building or a sculpture existing in a virtual space, and the like. Those skilled in the art will understand that the game screen may include not only selectable objects, but also non-selectable objects. In addition, the game screen may include a plurality of layers, and may belong to different layers depending on the properties of the objects. When the user selects a selectable object through the gesture, the game command mapped to the selected object is executed.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Reference will now be made in detail to the preferred embodiments of the present invention, examples of which are illustrated in the accompanying drawings.

Figure 1 is a schematic diagram illustrating mobile terminals 110 and 120 for processing gesture input in a gaming system 100, in accordance with an embodiment of the invention.

1, a tablet PC or notebook 110 and a mobile phone or a smartphone 120 are shown as an example of a mobile terminal and are connected to a game server 140 through a network 130 to play an online game . Here, the network 130 includes a wired or wireless communication network. The game server 140 provides the online game to the mobile terminal. Here, the online game may be a simulation RPG game in which a plurality of mobile users jointly participate. Depending on the simulation subject, it can be classified into, but not limited to, upbringing, construction / management, racing, flying, kite and battle simulation games. The simulation RPG game may be a role playing game including MMORPG or MORPG. According to the number of users, it can be divided into MMORPG and MORPG, or generally, "community" can be divided into MORPG if users are simulated only within the community, and MMORPG if they are simulated in public areas where all users can communicate with each other.

In addition, the online game may be an Aeon of Strife (RTS) game, a Real Time Strategy (RTS) game, a First / Third Person Shooters (FPS) game, or a sports game.

A program necessary for game implementation may be installed and executed in the mobile terminal.

The mobile terminal may sense a single touch input having a single touch-in / out point through the touch screen or may sense multi-touch input having multiple touch-in / out points. Here, the touch-in point refers to the position on the touch screen where the touch input is started, and the touch-out point refers to the position on the touch screen where the touch input ends. The start and end of a touch input include, but are not limited to, physical contact with which the body touches and falls on the touch screen. For example, even when physical contact with the touch screen is maintained, if there are a series of logically distinguishable touch inputs, e.g., a drag input contiguous to the touch and hold input, the touch- Corresponds to the touch-in point of the input. Thus, the start and end of the touch input may include the beginning and end of the logical contact.

The gesture input that can be detected by the mobile terminal is typically a tap, a double tap, a touch and hold, a touch and drag, a drag and drop, and the like.

A gesture input function is implemented in a mobile terminal, and a game can be played through an input of a gesture when executing an online game. A mobile terminal according to an embodiment of the present invention processes a user gesture input in an online game. The mobile terminal uses a touch screen to display a game screen including at least one selectable object, and receives a user's gesture on the game screen.

The touch screen of the mobile terminal may include an electrostatic or static pressure touch panel to sense the gesture. The touch screen may further include a tactile sensor or a proximity sensor. The tactile sensor refers to a sensor capable of detecting information such as the texture, hardness, and temperature of a body or object in contact with the touch screen, similar to human tactile sensation.

When the touch screen includes a proximity sensor, it may detect a non-contact gesture. A proximity sensor is a sensor that detects when a thing or body exists within a certain distance and can grasp its movement. Examples of the proximity sensor include an infrared sensor and a photoelectric sensor.

The gesture analyzer included in the mobile terminal determines whether the user's gesture is a multi-touch input having at least two touch-in points. The controller included in the mobile terminal deactivates the object selection function on the game screen when the gesture is determined to be the multi-touch input. Subsequently, the control unit of the mobile terminal switches the view of the game screen from the first observation point to the second observation point based on the multi-touch input.

On the other hand, when the user's gesture is a single-touch input having a single touch-in point, it is determined whether an object of the online game is selected. When the object is selected, it performs a function corresponding to the gesture including at least one drag direction. On the other hand, when the object is not selected, the user character is moved according to the touch-drag input, or the item or virtual space is moved. Here, the object includes a character of a monster or another user in the RPG game, includes an enemy in a first person / third person shooter game, and includes an opponent character in a sports game. The gesture includes various predefined drag directions, and may include up, down, left, and right directions, eight directions including diagonal directions, circular gestures, repetitive gestures, and the like. In the case of an RPG game, the skill may be a skill that can be used by a user character. If a specific skill is mapped to a specific gesture, and a specific gesture is input, a specific skill may be used for the target character.

2 is a flow chart illustrating a method for processing a gesture input, in accordance with another embodiment of the present invention.

Referring to FIG. 2, in step 205, the mobile terminal executes a game. In the case of an online game, the mobile terminal can access the game server and start the game. When the game is started, the mobile terminal may display the last game screen view stored on the game server on the mobile terminal or the game screen in the default view. As described above, the game screen may include at least one selectable object.

In step 207, the mobile terminal receives the user's gesture on the game screen through the touch screen and interprets the gesture. The interpretation of the gesture in step 207 refers to grasping the coordinates of the touch-in point and the touch-in time, the coordinates of the touch-out point, and the touch-out time, the moving speed, and the moving direction.

In step 209, the mobile terminal determines whether the input user's gesture is multi-input with at least two touch-in points. That is, if it is determined in step 207 that there is a plurality of touch-in points, it is determined that the touch input is a single-touch input when there is only one touch-in point.

If it is determined that the input gesture is a single-touch input, the mobile terminal determines in step 211 whether an object on the game screen is selected through the analysis result in step 207. For example, when the coordinate of the touch-in point is located in the area where the object is displayed or adjacent thereto, it is determined that the object is selected.

If the object is a single-touch input selected, the game command mapped to the object is executed in step 215. For example, when an object 913 is selected in FIG. 9A, a game menu is displayed, a friend list is displayed when an object 912 is selected, and a message content is displayed when an object 921 is selected.

In the case of a single-touch input in which no object is selected, a function corresponding to the gesture is performed in step 213. [ For example, when the single-touch input is a drag input, a non-rotation movement command corresponding to the page turning function of the virtual space is executed. If the current game screen shows the first area of the entire virtual space, the game screen after dragging shows the second area of the entire virtual space. The details of the non-rotational movement command will be described later with reference to FIG. 4B.

If it is determined in step 209 that the user's gesture is a multi-touch input, the mobile terminal in step 218 deactivates the selection function of the object such that the object on the game screen can not be selected. For example, if the selection function of the objects 911, 913, 912, and 921 of FIG. 9A is inactivated, game commands mapped to the objects 911, 913, 912, and 921 are not executed even if multi-touch input is detected in an area where the objects 911, 913, 912, and 921 exist.

At step 220, the mobile terminal determines whether the multi-touch input includes at least one drag input. That is, it is determined whether or not the coordinates of the touch-in point and the touch-out point are separated by a predetermined distance or more with reference to the gesture analysis result in step 207.

If it is determined in step 220 that any of the plurality of touch inputs included in the multi-touch input corresponds to the drag input, the mobile terminal switches the view of the game screen in step 224. That is, the mobile terminal enters the game screen view switching mode, and switches the view of the game screen from the first observation point to the second observation point corresponding to the current observation point. More details of this will be described later with reference to Fig.

If it is determined in step 220 that the multi-touch input does not include the drag input, the mobile terminal pops up additional information about the object included in the game screen. That is, when the difference between the touch-in times of the multi-touch input and the touch-out times is a tab input or a double tap input having a predetermined threshold value or less, the mobile terminal pops up additional information about the object.

10A and 10B, when the game screen 1010 is briefly tapped with two fingers, the character's name, physical strength information, and building information 1021 are displayed. At this time, the text 1011 may disappear from the game screen 1010 by the tap input 1012.

According to another embodiment of the present invention, when a multi-touch input does not include a drag input and a plurality of touch and hold inputs are held for a predetermined time or longer, a predetermined game command may be executed. The game command of the subscriber may, for example, illustrate, but not be limited to, displaying the entire virtual space zoomed out, or switching the view of the game screen with the default view.

In the following, step 224 of switching the view of the game screen is described in more detail with reference to Fig.

At step 302, the mobile terminal enters the game screen view switching mode. That is, if the multi-touch input includes at least one drag input, the mobile terminal enters the game screen view switching mode.

At this time, the mobile terminal may display a graphical effect indicating that the view of the game screen has entered the switch mode, during multi-touch input. The user can ascertain through the graphic effect that he / she has entered the view switching mode of the game screen. The graphic effect may include at least one of a mini-map display in which the entire virtual space is shortened, a direction display of the virtual space, a contrast control of the game screen, a transparency adjustment, and a path display for guiding view switching.

As the game screen rotates, mini-maps and azimuth indicia of virtual space can be rotated together to reflect the rotation of the game screen. In particular, when a mini-map is displayed, on the mini-map, a highlight indication can be displayed in the mini-map to indicate the area currently displayed in the entire virtual space.

In step 304, the mobile terminal determines whether the multi-touch input includes a plurality of drag inputs. In step 220 of FIG. 2, it is confirmed that there is a drag input in the multi-touch input. Therefore, in step 304, it is checked whether there is one drag input or two or more drag input.

If it is determined that the multi-touch input includes a plurality of drag inputs, step 306 determines whether the plurality of drag inputs rotate with the same rotation direction. Referring to FIG. 5, a plurality of clockwise rotating drag inputs 501 and 502 are shown.

According to another example of the present invention, step 306 may further determine whether the distance difference of the touch-in points of the drag inputs is above a first threshold. In FIG. 5, it is determined whether the distance difference between the first touch-in point SP1 and the second touch-in point SP2 is equal to or greater than the first threshold value. If the distance difference is less than the first threshold value, 501 and 502 can be ended without going to step 308 even if they are the same.

According to another exemplary embodiment of the present invention, it is possible to further determine whether the difference in touch-in times of the drag inputs is below a third threshold value. In FIG. 5, it is determined whether or not the difference of the touch start times of the touch-in points SP1 and SP2 is equal to or less than the third threshold. If the time difference exceeds the third threshold value, The process can be terminated without proceeding to step 308 even if the direction of rotation is the same.

If it is determined in step 306 that the plurality of drag inputs rotate with the same rotation direction, the mobile terminal calculates the rotation angle of the plurality of drag inputs in step 308. 5, the mobile terminal calculates a rotation angle arg1 defined by intersecting straight lines passing through touch-in points SP1 and SP2 and straight lines passing through touch-out points EP1 and EP2 do.

According to another embodiment, in step 306, it is determined whether the calculated rotation angle arg1 is equal to or greater than the second threshold, and if the calculated rotation angle arg1 is less than the second threshold, have.

If it is determined in step 306 that the plurality of drag inputs do not rotate with the same rotation direction, then in step 314 the mobile terminal determines whether a plurality of drag inputs proceed side by side towards the same point. That is, the mobile terminal determines whether the multi-touch input includes a plurality of drag inputs running side-by-side toward a predetermined point on the game screen.

Here, the meaning that the drag inputs proceed side by side is not limited to proceeding at the shortest distance toward the same point, and includes that the drag inputs proceed in the same direction while maintaining an interval within a certain range.

Referring to FIG. 6, the first drag input that is touched in and out to the points SP3 and EP3 and the second drag input that is touched in and out to the points SP4 and EP4 are dragged in parallel toward the same point ≪ / RTI > Here, the same point may be a point on a straight line passing through CP2 and CP3.

According to another example of the present invention, at step 314, it may further be determined whether the distance difference of the touch-in points of the drag inputs is below a fourth threshold. In FIG. 6, it is determined whether the distance difference between the third touch-in point SP3 and the fourth touch-in point SP4 is equal to or less than the fourth threshold. If the distance difference exceeds the fourth threshold value, The process may be terminated without proceeding to step 316 even though the process 601 proceeds to the same point. Similarly, those skilled in the art can appreciate that the distance difference between touch-out point points EP3 and EP4 can be determined to be below a predetermined value.

According to another embodiment of the present invention, it may further be determined whether the difference in touch-in times of the drag inputs is below a sixth threshold. In FIG. 6, it is determined whether or not the difference between the touch start times of the touch-in points SP3 and SP4 is equal to or less than the sixth threshold. If the time difference exceeds the sixth threshold value, the drag inputs 601 The process can be terminated without proceeding to step 316 even if it proceeds toward the same point.

If it is determined in step 314 that a plurality of drag inputs proceed side by side towards the same point, then in step 316 the mobile terminal calculates the rotation angle using a plurality of drag inputs. Referring to FIG. 6, the mobile terminal determines a point CP2 interpolating the touch-in points SP3 and SP4 and a point CP3 interpolating the touch-out points EP3 and EP4. It is assumed that the point CP2 is the midpoint of the touch-in points SP3 and SP4 and the point CP3 is the midpoint of the touch-out points EP3 and EP4. However, the present invention is not limited thereto.

Then, the mobile terminal calculates a rotation angle arg2 defined by intersecting a straight line passing through the point CP2 and a predetermined point (OP) on the game screen and a straight line passing through the point CP3 and the predetermined point (OP).

According to another embodiment, step 316 determines whether the calculated rotation angle arg2 is greater than or equal to the fifth threshold, and if the calculated rotation angle arg2 is less than the fifth threshold, have.

In the embodiment of FIG. 6, it is assumed that the predetermined point OP is the origin corresponding to the center of the game screen 600, but is not limited thereto. For example, the predetermined point may be determined according to which region of the game screen 600 the touch-in points are located. For example, if there is a two-dimensional coordinate system centered on the origin on the game screen 600, the predetermined point may be a point located on the third quadrant if the touch-in points are in the first quadrant.

Returning to FIG. 3, if it is determined in step 314 that the drag inputs are moving toward different points, the mobile terminal magnifies or shrinks the game screen in step 318. As described above, when there is a virtual camera that photographs a virtual space and relays it to a user, the captured virtual space image corresponds to a game screen, and the coordinates on a virtual space in which a virtual camera exists include a view of a game screen It corresponds to the observation time to decide. The enlargement / reduction of the game screen is performed by zooming in / out of the virtual camera, so there is no need to move the observation point. Therefore, in the present invention, movement at an observation point is defined as excluding zoom in / out of a simple game screen.

Returning to step 304 of FIG. 3, if the multi-touch input includes a single drag input, for example, if the multi-point input includes one stationary touch and hold input and one drag input, The rotation angle is calculated. Referring to FIG. 7, the touch-in point SP5 and the touch-out point SP6 in the touch and hold input are the same or less than a predetermined distance.

The mobile terminal has a line passing through the touch-in point SP5 of the touch-and-hold input and the touch-in point SP6 of the drag input, a touch-in point SP5 of the touch- And calculates a rotation angle (arg3) defined by intersecting straight lines passing through the point EP6.

According to another embodiment, in step 320, it is determined whether or not the calculated rotation angle arg3 is equal to or greater than the eighth threshold value. If the calculated rotation angle arg3 is equal to or less than the eighth threshold value, have.

In step 310, the rotation angle calculated in step 308 or 316 or 320 is used to determine a second observation point to switch the view of the game screen. That is, the mobile terminal determines the second observation time to be moved from the current first observation time using the rotation angle.

The method of determining the second observation point in step 310 may vary depending on the type of the multi-touch input. In other words, a method of determining the second observation point in accordance with whether the calculated rotation angle is the rotation angle arg1 in step 308, the rotation angle arg2 in step 316, or the rotation angle arg3 in step 308 Can vary.

Before explaining the method for determining the second observation point in step 310, the movement of the observation point according to an embodiment of the present invention will be described with reference to FIGS. 4A and 4B.

Referring to FIG. 4A, the virtual space 403 is briefly shown as a plane parallel to the x-y plane, ignoring the height value in the z direction for convenience of explanation. The point P0 located on the virtual space 403 is a point on which the observation point shift and the game screen view switching are based. The point P0 is displayed on the game screen before and after the observation point shift and the game screen view switching.

The path for observing the virtual space 403 is infinite but only the first observation trajectory 401 and the second observation trajectory 402 parallel to the virtual space 403 are shown in FIG.

The first observation point VP1 is a point located on the first observation orbit 401 and corresponds to a view of the current game screen. The second observation point of time VP2 can be calculated by rotating the first observation point of time VP1 by the rotation angle? In the clockwise direction with respect to the point P0.

Here, the first observation point of time VP1 and the second observation point of time are different from each other by an azimuth angle, but altitude angles are equal to each other. 9A and 9B, the game screen 900 of FIG. 9A is the image at the first observation time VP1, and the game screen 950 of FIG. 9B is the image at the second observation time VP2 .

When the observation point is rotated by θ in the clockwise direction, the user experiences the effect that the virtual space 403 is rotated by θ in the counterclockwise direction . In other words, the clockwise rotation movement of the observation point can be understood as a counterclockwise rotation movement of the virtual space 403 in a relative sense.

The third observation point VP3 is a point located on the second observation orbit 402. The third observation point VP3 can be calculated by changing the elevation angle of the first observation point VP1 by a counterclockwise angle? The azimuth angles of the first observation point VP1 and the third observation point VP3 are the same. On the other hand, when the altitude angle reaches 90 degrees, the user observes the virtual space 403 vertically.

4B is a diagram for explaining the non-rotational movement of the first observation time point VP1. 4A is a rotational movement in which the azimuth or rotation angle of the first observation time point is changed, and FIG. 4B is a non-rotational movement in which the azimuth and elevation angle of the first observation time point VP1 are unchanged.

Referring to FIG. 4B, the fourth observation point of time VP4 can be determined by moving in parallel with the x-y plane in a direction parallel to the first observation point VP1. At this time, since the reference point of the virtual space 403 is also changed from P0 to P1, it can be understood that the first observation trajectory 401 is translated to 404.

From the viewpoint of the user observing the displayed game screen, when the observation point moves from VP1 to VP4, the virtual space experiences the same effect as parallel movement. That is, it can be understood that the game screen displays the first area of the entire virtual space 403, and then displays the second area according to the page turnover.

4A is a rotation movement of the observation point by the multi-touch input, and FIG. 4B is a non-rotation movement of the observation point by the single-touch input. Referring to FIGS.

Returning to Fig. 3, the description of step 310 is continued.

First, when the rotation angle input in step 310 is the rotation angle calculated in step 308, that is, when the multi-touch input includes a plurality of drag inputs whose rotation direction is the same as in Fig. 5 .

The current view of the game screen is provided at the first observation time, and the coordinates of the first observation time in the virtual space are already known. Further, since the magnitude of the rotation angle arg1 calculated in step 308 and the rotation direction (clockwise or counterclockwise) are known, it is possible to determine the second observation point of time by knowing the point as the reference of the rotation movement. That is, since the coordinates and the rotation angle? Of the point VP1 in FIG. 4A are known, the point VP2 can be determined by knowing the coordinates of the point P0 serving as a reference of the rotation movement.

The point of rotation may be the origin located at the center of the currently displayed game screen. According to another embodiment, the point of rotation may be the interpolation point of the touch-in points SP1, SP2 in FIG. 5, for example, the center point. According to another embodiment, the point at which rotation is based may be a point CP1 at which a line passing through the touch-in points SP1 and SP2 intersects with a line passing through the touch-out points EP1 and EP2 .

The mobile terminal determines the second observation point by rotating the azimuth of the first observation point in the counterclockwise direction when the rotation direction of the drag input is clockwise. Thus, the effect that the virtual space is rotated clockwise along the drag input is provided. The mobile terminal rotates the azimuth of the first observation time clockwise when the rotation direction of the drag input is counterclockwise.

The first observation time may be rotated only by the rotation angle calculated in the step 308 during the rotation movement. However, according to another embodiment, the first observation time may be rotated in proportion to the rotation angle. That is, the calculated rotation angle may be multiplied by a predetermined weight or may be added to adjust the sensitivity of the rotation movement.

Next, when the rotation angle input in step 310 is the rotation angle calculated in step 316, i.e., when the multi-touch input includes a plurality of drag inputs proceeding to the same point as in FIG. 6, the second observation point We will explain how to decide.

Since the magnitude and rotation direction (clock or counterclockwise direction) of the rotation angle arg2 calculated in step 316 are known, it is possible to determine the second observation time point by knowing the point that is the reference of the rotation movement. Hereinafter, it is assumed that the point of rotation is the origin of the game screen, but is not limited thereto.

According to the embodiment of the present invention, since the rotation direction of the rotation angle arg2 is counterclockwise, the mobile terminal rotates the azimuth of the first observation time clockwise by the magnitude of the rotation angle arg2, Determine the point of view. Therefore, the effect that the virtual space is rotated counterclockwise along the drag input about the origin of the game screen is provided. If the rotation direction of the rotation angle arg2 is clockwise, the first observation point is rotated counterclockwise.

According to another embodiment of the present invention, the mobile terminal may change the azimuth or elevation angle of the first observation point depending on whether the direction of the drag inputs is the horizontal direction or the vertical direction. For example, when a plurality of drag inputs move in the horizontal direction (right and left), the azimuth of the first observation time is changed to the direction of rotation opposite to the rotation angle arg2, The altitude angle can be changed in the opposite direction of rotation of the rotational angle arg2.

If the drag inputs include both the transverse length component and the longitudinal length component, it can be classified into either the horizontal drag input or the longitudinal drag input whether the magnitude of the component in which direction is larger. That is, a length component having a small size can be ignored. Alternatively, the azimuth and elevation angles of the first observation time may be simultaneously changed by taking both the horizontal length component and the longitudinal length component into consideration.

The first observation time may be rotated only by the rotation angle calculated in the step 316 during the rotation movement. However, according to another embodiment, the first observation time may be rotated in proportion to the rotation angle. That is, the calculated rotation angle may be multiplied by a predetermined weight or may be added to adjust the sensitivity of the rotation movement.

Next, when the rotation angle input in step 310 is the rotation angle calculated in step 320, i.e., when the multi-touch input includes a touch-and-hold input and a drag input as shown in FIG. 7, .

Since the magnitude and rotation direction (clockwise or counterclockwise) of the rotation angle arg3 calculated in step 320 are known, it is possible to determine the second observation point of time by knowing the point that is the reference of the rotation movement.

The point at which rotation is based may be a touch-in point (SP5) of the touch-and-hold input or may be the origin of the game screen, but is not limited thereto.

According to one embodiment of the present invention, since the rotation direction of the rotation angle arg3 is clockwise, the mobile terminal rotates the azimuth of the first observation time counterclockwise by the magnitude of the rotation angle arg3, Determine the point of view. Thus, an effect is provided such that the virtual space rotates clockwise on the rotation axis about the origin of the game screen or the touch-and-hold input. If the rotation direction of the rotation angle arg3 is counterclockwise, the first observation point is rotated in the clockwise direction.

The first observation time may be rotated by the rotation angle calculated in step 320 during the rotation movement. However, according to another embodiment, the first observation time may be rotated in proportion to the rotation angle. That is, the calculated rotation angle may be multiplied by a predetermined weight or may be added to adjust the sensitivity of the rotation movement.

In step 312, the mobile terminal rotates the game screen from the first observation point to the second observation point. The mobile terminal may also provide a game screen at points located in the middle of the path from the first observation point to the second observation point to provide a seamless image to the user.

When the game screen includes a plurality of layers, the mobile terminal can rotate only some of the layers and the remaining layers can be displayed without moving or moving at a fixed position.

For example, the game screen may include a three-dimensional background building and a three-dimensional object layer including a character, a two-dimensional text displayed during game execution, a plane object layer including an image or an animation message, and a game menu item displayed at a fixed position And a graphics layer including the graphics layer. At this time, the mobile terminal rotates only the three-dimensional object layer.

Referring to FIGS. 9A and 9B, the game screen 900 of FIG. 9A and the game screen 950 of FIG. 9B are different from each other at observation points, and each includes a plurality of layers. The game menu items 913 and 912 and the game information 911 are included in the graphics layer and the in-game conversation text 922 and the message 921 are included in the plane object layer and the building 931 and the background are included in the three- . According to an embodiment, the building layer, the character layer, and the background layer may exist as independent layers in the three-dimensional object layer.

The game menu items 913 and 912 and the game information 911 included in the graphics layer are displayed as they are without moving the position and the in-game conversation text 922 and the message 921 included in the plane object layer are displayed Horizontal, and vertical directions, but not rotationally moved. Only the three-dimensional object layer including the building 931 is rotated in accordance with the movement of the observation point. Accordingly, it is possible to solve the problem caused by the rotational movement of the two-dimensional objects. For example, if the text rotates, the user may be unable to read or read the text, so the two-dimensional objects are excluded from the rotation movement.

Taken together, the mobile terminal differs from the method of processing gesture input and switching the game screen view according to the type of multi-touch input. 5, 6 and 7 are shown as an example of the types of multi-touch input capable of switching the game screen view, and in accordance with the type of multi-touch input shown in FIGS. 5, The processing method of the touch input is also determined differently.

In the above description, all the processes are performed in the mobile terminal. However, the above processes may be performed using resources of the game server. It will be appreciated by those skilled in the art that the mobile terminal may provide input to the gesture and display of the game screen, and may transfer the information about the input gesture to the game server to switch the game screen view at the game server and provide the image to the mobile terminal. .

In the above description, it is assumed that the view of the game screen is fixed to the second observation time after switching to the second observation time by the multi-touch input. However, according to another embodiment of the present invention, The game screen may be provided at the second observation point and may be returned from the second observation point to the first observation point as soon as the multi-touch input is completed.

8A to 8C are views for explaining continuous input and presentation of a single touch and a multi-touch according to an embodiment of the present invention. The description overlapping with the above description is omitted in the description, and therefore, Figs. 1 to 7 can be referred to as necessary.

Figures 8a-8c illustrate continuous gesture inputs, which may include the multi-touch inputs of Figures 5-7. Also, the numbers of '1', '2', and '3' are shown to logically separate consecutive gesture inputs, and the meaning of numbers means the input order of the gestures. In the case of a multi-touch input, there are two or more gestures having the same number.

Referring to FIG. 8A, the gesture # 1 is a drag input of a single touch, and the gesture # 2 is continuously input to the gesture # 1. The second gesture includes a plurality of drag inputs that rotate in the same direction as a multi-touch input. Since the first and second gestures are continuous, the touch-out point of the first gesture becomes the touch-in point of the second gesture.

The mobile terminal determines whether the object is selected by the first gesture. When the object is not selected, the page turning function, that is, the non-rotational movement of the virtual space is performed according to the No. 1 gesture. Then, the second gesture is input. That is, since the second gesture includes a drag input as a multi-touch input, the game screen view switching mode is entered. The mobile terminal calculates the rotation angle in the second gesture according to the embodiment of FIG. 5 and rotates the game screen.

Referring to FIG. 8B, the gesture 1,3 is a drag input of a single touch, and the gesture 2 is a multi-touch input. Gestures 1, 2, and 3 are sequentially input in order. The second gesture includes a plurality of drag inputs that run side by side to the same point.

As in FIG. 8A, the mobile terminal determines whether the object is selected by the first gesture. When the object is not selected, the page turning function, that is, the non-rotational movement of the virtual space is performed according to the No. 1 gesture. Then, the second gesture is input. That is, since the second gesture includes a drag input as a multi-touch input, the game screen view switching mode is entered. The mobile terminal computes the rotation angle in the second gesture according to the embodiment of FIG. 6 and rotates the game screen.

Referring to FIG. 8C, the gestures 1 and 2 are all multi-touch inputs. Gestures 1 and 2 are sequentially entered in sequence. The first gesture includes a plurality of drag inputs running in opposite directions, and the second gesture includes one touch and hold input and one drag input.

The mobile terminal performs a reduction function of the game screen according to the number 1 gesture. That is, the zooming-out function of the virtual camera is performed while the observation time of the virtual space remains the same. Therefore, switching of the game screen view is not performed. Then, the mobile terminal calculates the rotation angle in the second gesture according to the embodiment of FIG. 7 and rotates the game screen. At this time, the virtual space is rotated along the drag input based on the touch and hold input.

As described above, the method of processing gesture input according to the embodiment of the present invention is performed by an application installed in the mobile terminal (which may include a program included in a platform or an operating system basically installed in the terminal) And may be executed by an application (that is, a program) directly installed on a terminal by a user through an application providing server such as an application store server, an application, or a web server related to the service. In this regard, the method for processing the gesture input according to the above-described embodiment of the present invention is implemented in an application installed in a terminal or directly installed by a user (i.e., a program) Lt; / RTI >

Such a program may be recorded on a recording medium that can be read by a computer and executed by a computer so that the above-described functions can be executed.

Thus, in order to execute the method of processing the user gesture input according to each embodiment of the present invention, the above-mentioned program is coded in a computer language such as C, C ++, JAVA, And may include a code.

The code may include a function code related to a function or the like that defines the functions described above and may include an execution procedure related control code necessary for the processor of the computer to execute the functions described above according to a predetermined procedure.

In addition, such code may further include memory reference related code as to what additional information or media needed to cause the processor of the computer to execute the aforementioned functions should be referenced at any location (address) of the internal or external memory of the computer .

In addition, when a processor of a computer needs to communicate with any other computer or server, etc., to perform the above-described functions, the code may be stored in a computer's communication module (e.g., a wired and / ) May be used to further include communication related codes such as how to communicate with any other computer or server in the remote, and what information or media should be transmitted or received during communication.

The functional program for implementing the present invention and the related code and code segment may be implemented by programmers in the technical field of the present invention in consideration of the system environment of the computer that reads the recording medium and executes the program, Or may be easily modified or modified by the user.

Examples of the computer-readable recording medium on which the above-described program is recorded include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical media storage, and the like.

Also, the computer-readable recording medium on which the above-described program is recorded may be distributed to a computer system connected via a network so that computer-readable codes can be stored and executed in a distributed manner. In this case, any of at least one of the plurality of distributed computers may execute some of the functions presented above and transmit the result of the execution to at least one of the other distributed computers, and transmit the result The receiving computer may also perform some of the functions described above and provide the results to other distributed computers as well.

In particular, a computer-readable recording medium having recorded thereon an application that is a program for executing a method for processing a user gesture input according to each embodiment of the present invention includes an application store server, an application, (E.g., a hard disk, etc.) included in an application provider server such as a Web server, or an application providing server itself.

A computer capable of reading a recording medium on which an application, which is a program for executing a method for processing a user gesture input according to each embodiment of the present invention, can be read by a general PC such as a general desktop or a notebook computer, , A personal digital assistant (PDA), and a mobile terminal, and the present invention should be interpreted as all devices capable of computing.

In addition, a computer capable of reading a recording medium on which an application, which is a program for executing a method for processing user gesture input according to an embodiment of the present invention, is read is a smart phone, a tablet PC, a PDA (Personal Digital Assistants) The application may be downloaded from the application providing server to the general PC and installed in the mobile terminal through the synchronization program.

While the present invention has been described in connection with what is presently considered to be the most practical and preferred embodiments, it is to be understood that the invention is not limited to the disclosed embodiments. That is, within the scope of the present invention, all of the components may be selectively coupled to at least one. In addition, although all of the components may be implemented as one independent hardware, some or all of the components may be selectively combined to perform a part or all of the functions in one or a plurality of hardware. As shown in FIG. The codes and code segments constituting the computer program may be easily deduced by those skilled in the art. Such a computer program can be stored in a computer-readable storage medium, readable and executed by a computer, thereby realizing an embodiment of the present invention. As a storage medium of the computer program, a magnetic recording medium, an optical recording medium, or the like can be included.

It is also to be understood that the terms such as " comprises, "" comprising," or "having ", as used herein, mean that a component can be implanted unless specifically stated to the contrary. But should be construed as including other elements. All terms, including technical and scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs, unless otherwise defined. Commonly used terms, such as predefined terms, should be interpreted to be consistent with the contextual meanings of the related art, and are not to be construed as ideal or overly formal, unless expressly defined to the contrary.

The foregoing description is merely illustrative of the technical idea of the present invention and various changes and modifications may be made by those skilled in the art without departing from the essential characteristics of the present invention. Therefore, the embodiments disclosed in the present invention are intended to illustrate rather than limit the scope of the present invention, and the scope of the technical idea of the present invention is not limited by these embodiments. The scope of protection of the present invention should be construed according to the following claims, and all technical ideas falling within the scope of the same shall be construed as falling within the scope of the present invention.

Claims (18)

A method of processing a user's gesture input to a game screen including at least one selectable object,
Determining whether the gesture of the user is a multi-touch input having at least two touch-in points;
Deactivating the selection function of the object on the game screen when the gesture of the user is determined as the multi-touch input; And
And switching the view of the game screen from the first observation point to the second observation point based on the multi-touch input. The method of claim 1, wherein the step of switching the view of the game screen comprises:
Determining the second observation point using at least one of coordinate, movement direction, movement speed, touch-in and touch-out time of the touch-in and touch-out points of the multi-touch input; And
And rotating the game screen from the first observation point to the second observation point. The method of claim 1, wherein the step of switching the view of the game screen comprises:
Calculating a rotation angle at which a straight line passing through the touch-in points intersects with a straight line passing through the touch-out points, when the multi-touch input includes a plurality of drag inputs rotated in the same rotation direction; And
And rotating the game screen in proportion to the rotation angle based on a predetermined point in the game screen. 4. The apparatus of claim 3,
The intersection of the straight lines, the center of the touch-in points, or the origin of the game screen. 4. The method of claim 3, wherein rotating the game screen comprises:
In points are satisfied when at least one of a condition that the distance difference of the touch-in points is equal to or greater than a first threshold value, a condition that the rotation angle is equal to or greater than a second threshold value, and a condition that a difference between touch- How to. The method of claim 1, wherein the step of switching the view of the game screen comprises:
Calculating a rotation angle using the touch-in points, the touch-out points and a predetermined point in the game screen if the multi-touch input includes a plurality of drag inputs that run side by side toward the same point; And
And rotating the game screen in proportion to the rotation angle based on a predetermined point in the game screen. 7. The method of claim 6, wherein the calculating the rotation angle comprises:
And calculating an angle between a midpoint of the touch-in points and a straight line passing through the predetermined point and a straight line passing through the midpoint between the touch-out points and the predetermined point. 7. The method of claim 6, wherein rotating the game screen comprises:
When the difference between the touch-in points is equal to or less than the fourth threshold value, the calculated rotation angle is equal to or greater than the fifth threshold value, and the input time difference between the drag inputs is equal to or less than the sixth threshold value ≪ / RTI > 7. The method according to claim 6,
Wherein the game screen is an origin of the game screen. 7. The method of claim 6, wherein rotating the game screen comprises:
When the multi-touch input advances in the horizontal direction, the game screen is rotated in the azimuth direction of the virtual space of the game,
And rotating the game screen in an altitude direction of the virtual space when the multi-touch input advances in a vertical direction. The method of claim 1, wherein the step of switching the view of the game screen comprises:
A touch-in input point of the touch-and-hold input and a touch-in point of the drag input and a touch-in input point of the touch-and-hold input and a drag- Calculating a rotation angle formed by a straight line passing through the touch-out point of the drag input; And
And rotating the game screen in proportion to the rotation angle based on a predetermined point in the game screen. The method according to claim 1,
And displaying the pop-up information on the game screen on the game screen when the difference between the touch-in times and the touch-out times of the multi-touch input is a tap input or a double tap input having a seventh threshold value or less . ≪ / RTI > 3. The method of claim 2,
The game screen comprises:
A three-dimensional background, a three-dimensional object layer including a building or character, a two-dimensional text displayed during game execution, a plane object layer including an image or an animation message, and a graphics layer including a game menu item displayed at a fixed position Lt; / RTI >
The rotating and moving step includes:
And rotating only the three-dimensional object layer among the layers of the game screen. The method according to claim 1,
Further comprising the step of displaying, when the gesture of the user is judged to be the multi-touch input, a graphic effect indicating that the mode has been entered for switching the view of the game screen during the multi-touch input. 15. The method of claim 14,
Wherein the graphic effect includes at least one of a mini-map display, a direction display, a contrast control, a transparency adjustment, and a path display for guiding view switching,
Wherein the mini-map display and the azimuth display are rotated to reflect the view of the game screen. The game system according to claim 1,
(RPG) game including MMORPG / MORPG, Aeon of Strife game, Real Time Strategy (RTS) game, FPS / TPS (First / Third Person Shooters) game, or sports game Of the screen. A computer-readable recording medium on which a program for executing the method according to any one of claims 1 to 16 is recorded. In a terminal that executes a game,
A touch screen displaying a game screen including at least one selectable object and receiving a user's gesture on the game screen;
A gesture analyzer for determining whether the user's gesture is a multi-touch input having at least two touch-in points; And
Disabling the object selection function on the game screen when the gesture is determined to be the multi-touch input, and moving the view of the game screen from the first observation time to the second observation time based on the multi- And a controller for switching the terminal.

Images