KR101594249B1 - Rhythem action game method through hand tracking - Google Patents

Abstract

A method of rhythm action game through hand tracking is disclosed. A method of playing a rhythm action game using a hand track according to an embodiment of the present invention includes the steps of outputting music played through a speaker and simultaneously outputting a note to at least one of note lines of a play area on a monitor screen, Tracking the position of the hand or the finger and reflecting the position of the hand or the finger in the progress of the game, thereby obtaining the position of the hand or the finger using the camera; Confirming whether the note has arrived at a guideline of the play area; Confirming that the position of the obtained hand or finger is included in the note space corresponding to the note line to which the note is outputted as the note reaches the guide line; And giving a score according to whether the obtained hand or finger position is included in the note space.

Description

{RHYTHEM ACTION GAME METHOD THROUGH HAND TRACKING}

The present invention relates to a rhythm action game method through hand tracking. More specifically, the present invention relates to a rhythm action game in which a movement of a hand or a finger of a player is tracked through hand tracking and reflected in a rhythm action game, This invention relates to a technique for enabling a user (player) to feel a sense of reality while inducing interest in a rhythm action game without being bored without using an input device such as a joystick, a mouse, or a button.

A rhythm action game collectively refers to an action game that uses the player's rhythm sense. This game requires that the specified operation be performed at the correct timing, and the screen displays the type of operation that should normally be performed and the accuracy of the operation performed.

In other words, a rhythm action game generates a note as a graphic object according to music, and when a note reaches a predetermined position, when a player inputs a button, a stick, or a mouse, a score is calculated according to the accuracy of the input It is a game.

Since the manipulation of such a rhythm action game is performed only through an input device such as a joystick or a mouse or a button, irrespective of the will of the player, the rhythm action game has a disadvantage that the reality is deteriorated and the player (user) Respectively.

Therefore, there is a need for a technique that allows a player to feel a sense of reality while inducing interest in a rhythm action game without being bored without using a joystick or a mouse or a button.

The prior art related to the present invention is Korean Patent Publication No. 10-2002-0055551 (published on July, 2002).

A rhythm action game method using a hand tracking is proposed so that a user (player) may be interested in a rhythm action game without being bored, without using an input device such as a joystick or a mouse or a button.

The problems to be solved by the present invention are not limited to the above-mentioned problems, and other problems that are not mentioned can be clearly understood by those skilled in the art from the following description.

According to one aspect of the present invention, music played through a speaker is outputted, and at the same time, a note is outputted to at least one of note lines of a play area on a monitor screen and a position of a hand or a finger ) To reflect the rhythm action game in the progress of the game, the rhythm action game method comprising the steps of: acquiring the position of the hand or the finger using a camera; Confirming whether the note has arrived at a guideline of the play area; Confirming that the position of the obtained hand or finger is included in the note space corresponding to the note line to which the note is outputted as the note reaches the guide line; And giving a score according to whether the obtained hand or finger position is included in the note space.

The note space may be formed in a front space of the monitor and correspond to each of the note lines.

The degree of difficulty of the rhythm action game may be determined by at least one of the moving speed of the note and the size of the note.

The moving speed of the note may vary depending on the speed of the music to be reproduced.

According to the embodiment of the present invention, by controlling the rhythm action game through hand tracking in the space through the camera, the user (player) can enjoy the rhythm action game without being bored without using the input device such as the joystick, It can stimulate interest and make it feel realistic.

FIG. 1 is a view for explaining a basic concept of a rhythm action game method by hand tracking according to an embodiment of the present invention.
FIG. 2 is a block diagram of a rhythm action game system using hand tracking according to an embodiment of the present invention.
3 is a flowchart of a rhythm action game method using hand tracking according to an embodiment of the present invention.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings.

Embodiments of the present invention are provided to more fully describe the present invention to those skilled in the art, and the following embodiments may be modified in various other forms, The present invention is not limited to the following embodiments. Rather, these embodiments are provided so that this disclosure will be more thorough and complete, and will fully convey the concept of the invention to those skilled in the art.

The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. As used herein, the singular forms "a", "an," and "the" include plural forms unless the context clearly dictates otherwise. Also, " comprise "and / or" comprising "when used herein should be interpreted as specifying the presence of stated shapes, numbers, steps, operations, elements, elements, and / And does not preclude the presence or addition of one or more other features, integers, operations, elements, elements, and / or groups. As used herein, the term "and / or" includes any and all combinations of one or more of the listed items.

Although the terms first, second, etc. are used herein to describe various elements, regions and / or regions, it should be understood that these elements, components, regions, layers and / Do. These terms do not imply any particular order, top, bottom, or top row, and are used only to distinguish one member, region, or region from another member, region, or region. Thus, the first member, region or region described below may refer to a second member, region or region without departing from the teachings of the present invention.

Hereinafter, embodiments of the present invention will be described with reference to the drawings schematically showing embodiments of the present invention. In the figures, for example, variations in the shape shown may be expected, depending on manufacturing techniques and / or tolerances. Accordingly, embodiments of the present invention should not be construed as limited to any particular shape of the regions illustrated herein, including, for example, variations in shape resulting from manufacturing.

FIG. 1 is a view for explaining a basic concept of a rhythm action game method by hand tracking according to an embodiment of the present invention.

1, a note 7 is output to at least one of the note lines 2, 3, 4, and 5 constituting the play area of the rhythm action game, and the note 7 is hit Tracking the position of the hand or finger and reflecting it in the progress of the rhythm action game. At this time, four note lines are exemplified, but the present invention is not limited thereto and various changes can be made.

Note spaces corresponding to the note lines 2, 3, 4 and 5 are virtually formed in the front space of the monitor 1 in which the note lines 2, 3, 4 and 5 are outputted. The note line 2 corresponds to the note space 8, the note line 3 corresponds to the note space 9, the note line 4 corresponds to the note space 10, the note line 5 Corresponds to the note space 11. The distinction of the note spaces 8, 9, 10, 11 is based on the x-axis coordinate. The division of the note spaces 8, 9, 10, 11 is not limited to this, As shown in FIG.

9, 10, and 11 in which the knot is blown while the rhythm action game is being performed can be grasped through the photographing of the camera 13.

That is, when the note 7 reaches the guideline 6 of the play area, the note 7 reaching the guide line 6 is moved to the note space 9 corresponding to the moved note line 3, It is possible to grasp the position of the hand 12 by the photographing of the camera 13. [ At this time, the position of the guide line 6 of the play area is located at the lower end of the note lines 2, 3, 4, 5, And the like, and may be variously changed.

In this way, a score can be given when the hand 12 is placed in the note space 9. This rhythm action game can proceed according to the flow of music played through the speaker 27 shown in Fig. That is, the music is reproduced through the speaker 27 and the note lines 2, 3, 4 and 5 are outputted to the screen of the monitor 1 at the same time.

The difficulty level of the rhythm action game may be determined by at least one of the moving speed of the note 7 and the size of the note 7. The moving speed of the note 2 may vary depending on the speed of the music to be reproduced.

The position of the hand 12 located in the note space 9 may be stored in a memory (not shown) for a preset time, for example one second, in accordance with the timeline of the music to be reproduced, The position of the hand 12 stored in the memory can be deleted.

FIG. 2 is a block diagram of a rhythm action game system using hand tracking according to an embodiment of the present invention.

2, the rhythm action game system through hand tracking includes a memory 20 including sound source data 21 and note data 22, a camera 13, a control unit 23, an interface unit 24, A playback unit 25, a game image playback unit 26, a speaker 27, and a monitor 1.

The speaker 27 is a device for reproducing the sound source data 21 stored in the memory 20 in advance for the rhythm action game progression and is used to select the player (user) And outputs sound source data 21.

The monitor 1 outputs the note data 22 related to the sound source data 21 being played back through the game image playback section 26. At this time, the note data 22 indicates the appearance timing of the note, . ≪ / RTI > Here, the modeling information of the note may include the note size, shape, shape, color information, and the like.

The camera 13 photographs a hand or a finger of the player.

The interface unit 24 is provided for connection with other external devices.

The control unit 23 controls each unit including the speaker 27, the monitor 1, the camera 13, the music playback unit 25, the game image playback unit 26, and the memory 20, 2 controls each sub-apparatus shown in FIG. 2 so that the rhythm action game proceeds according to the rhythm action game method through hand tracking as shown in FIG.

The memory 20 stores not only the sound source data 21 and the note data 22 but also various data and programs necessary for executing the rhythm action game.

3 is a flowchart of a rhythm action game method using hand tracking according to an embodiment of the present invention.

3, the rhythm action game through hand tracking is a game in which the music played through the speaker 27 is outputted and simultaneously the note lines 2, 3, 4 and 5 of the play area are displayed on the screen of the monitor 1, (7) is outputted to at least one of the notes (7) and tracks the position of a hand or a finger hitting the note (7) and reflects the position of the hand or the finger in the progress of the game. At this time, the degree of difficulty of the rhythm action game may be determined by at least one of the moving speed of the note and the size of the note, and the moving speed of the note may vary according to the speed of the music to be reproduced.

In order to perform the rhythm action game method according to the embodiment of the present invention, the position of the hand or the finger is acquired using the camera 13 (S10).

It is checked whether the note 7 has reached the guide line 6 of the play area (S20). In this case, steps S10 and S20 may be performed in the order of S10 and S20, S20 may be performed first, S10 may be performed, and S10 and S20 may be performed simultaneously.

Thereafter, as the note 7 reaches the guide line 6, the position of the obtained hand or finger 12 is shifted to a note space (not shown) corresponding to the note line 3 to which the note 7 is outputted 9), that is, whether it is located (S30). At this time, the note space 9 is formed in the front space of the monitor 1 and can be set corresponding to the note line 3, and the other note spaces 8, 10 and 11 are also connected to the note lines 2, 4, and 5, respectively.

A score is given according to whether the position of the obtained hand or finger 12 is included in the note space 9 (S40). That is, a score is given if the position of the obtained hand or finger 12 is included in the note space 9, and no score is given if it is not included.

The present invention has been described above with reference to the embodiments. It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims. Therefore, the disclosed embodiments should be considered in an illustrative rather than a restrictive sense. Therefore, the scope of the present invention is not limited to the above-described embodiments, but should be construed to include various embodiments within the scope of the claims and equivalents thereof.

1: Monitor
13: camera 20: memory
21: sound source data 22: note data
23: control unit 24: interface unit
25: music playback unit 26: game video playback unit
27: Speaker

Claims (4)

The music reproduced through the speaker is outputted and at the same time a note is outputted to at least one of the note lines of the play area on the screen of the monitor and the position of the hand or finger hitting the note is tracked, A method for playing a rhythm action game,
The method comprising the steps of: acquiring a position of the hand or finger using a camera; confirming whether the note has reached a guideline of the play area; and when the note reaches the guideline, Confirming whether the position of the hand or the finger is included in the note space corresponding to the note line from which the note is outputted; and giving a score according to whether the obtained position of the hand or the finger is included in the note space , ≪ / RTI &
The difficulty level of the rhythm action game is determined by at least one of the moving speed of the note and the size of the note,
The position of the hand located in the note space is stored in the memory for one second, which is a preset time according to the timeline of the music to be reproduced, and the position of the hand stored in the memory is deleted after the set time has elapsed,
The memory includes sound source data and note data, and outputs sound source data required by a player through a music playback unit. The monitor outputs note data related to sound source data being reproduced through a game image playback unit, Wherein the data includes an appearance timing of a note, a moving speed, and modeling information, and the modeling information of the note includes a note size, shape, shape, and color information. The method according to claim 1,
The notebook computer according to claim 1,
Wherein the rhythm action game is formed in a front space of the monitor and corresponds to each of the note lines. delete The method of claim 3,
The moving speed of the note is,
Wherein the rhythm action game is variable according to the speed of the music being reproduced.

Images