KR20050047024A - Dance game apparatus for arcade using image recognition and method thereof - Google Patents

Abstract

The present invention relates to an arcade dance game apparatus and a dance game method using image recognition, comprising: a CCD camera for recognizing a player's motion; An illumination device that illuminates the CCD camera so as to recognize the movement of the player and determines the position of the player; A bitmap extraction program for converting the image signal recognized by the CCD camera into bitmap data through a call-back function; An image output unit for synthesizing the video signal converted into bitmap data and the game progress image through the bitmap extracting program; An audio output unit for producing music; Computer game board; Game software; And a fuselage recognition algorithm which compares and analyzes the image recognized by the CCD camera for each frame and compares the color data of the pixels to determine whether the player moves.

A game start step in which a game is started by putting a coin; An image synthesis output step of synthesizing the video of the player and the game screen captured by the CCD camera and outputting them to the screen; A game difficulty determination step of determining a difficulty level of a game as a first step of the image synthesis output step; A game song determination step of determining a song to be played as a second step of the image synthesis output step; A game progress step of playing a game as a third step of the image synthesis output step; An instruction shape movement step of moving the instruction shape using both arms of the player toward a predetermined target position in five directions or more moving on the screen in accordance with the beat and speed of the music in the game progress step; A motion detection step of determining whether a motion of a player is detected in a region of a target point when the indication shape reaches a target point; A motion response step of differentiating image effects and sounds in the game and giving a game score according to whether motion detection is performed in the motion detection step; A final score indicating step of showing a final score after the music is finished as the fourth step of the image synthesis output step; A commemorative photographing step of notifying the player when the player has obtained a high score as the fifth step of the image synthesizing output step and taking a commemorative photographing step; And a game waiting step showing an example of playing the game and a screen of the high scorer and the game taken,

The present invention shows the actual image of the player on the game through a CCD camera, the player's motion is recognized through a bitmap analysis algorithm, the game is progressed, and the actual video and the video of the game in progress is synthesized By letting the dance game, you can feel the virtual reality combining reality and virtual space in the game, and let the user control the game through the action of his actual appearance displayed on the screen without using a separate game control device. Since the gameplay method is intuitive and does not require an input unit other than the CCD camera, there is an advantage in that the structure of the game machine is simple and easy to install. In addition, since the present invention uses a CCD camera, it is possible to quickly process an image and to quickly and effectively detect a pattern of a user's movement through the image bitmap analysis method proposed by the present invention.

Description

Dance game apparatus for arcade using image recognition and method

The present invention relates to an arcade dance game apparatus and a dance game method using image recognition, and in particular, a rhythm beat dance game which is performed by hand motion, converts a player's motion obtained through a CCD camera into a bitmap image signal, and then receives the same. The present invention relates to an arcade dance game device and a dance game method using image recognition that detects a player's motion by analyzing and synthesizes a game screen with a live action video of the player.

Existing sensational games mainly use the sensor installed on the scaffold to detect the user's foot motion and proceed with the game, and the motion sensor installed near the player detects the specific motion of the player. It was a way to proceed, and there is a conventional Patent Publication No. 10-0361791.

The dance game device disclosed in the Dongbobo is about a dance game device and a footstep for a dance game that can express a rhythmic feeling by using the whole body in accordance with music, and generate a powerful and rhythmic feeling. The instruction data is read from the tread position instruction data memory, and the tread position instruction contents are displayed on the monitor by the display control unit, and the tread position and brightness operation timing are instructed based on this.

When the player steps on the footboard of the floor by foot according to the display content of the monitor, it is detected by a cable switch and provided to the stepping motion monitoring unit, the deviation amount detection / accumulation unit calculates a score according to the time difference. Based on this, the evaluation is performed in the rhythm setting unit. Then, the next brightness position indication data is set according to the result.

However, such a conventional dance game device is to step on the floor of the floor by looking at the display content displayed on the monitor, so that not only the joints such as the player's knees may be caused, but also the floor having the floor. The volume of the main body is large and the space is limited to install the dance game device.

In particular, the floor has a disadvantage that the overall unit price of the dance game device is increased because it must be equipped with a plurality of switches that withstand the foot and react sensitively. Most gamers are able to enjoy the floor, that is, the footboard. Hands rarely move and only the feet are moved to play the game.

These techniques use a mechanical method to recognize the user's motion, which includes sensor detection means, and also uses graphical elements that represent characters in the game or express the player's operation in the game. , Does not display the actual appearance of the flare.

In addition, there are games that display and synthesize the video of the player in the existing game on the screen through the camera, but this is a known configuration of the game does not have the meaning as an invention only with this design, until now The games adopting the game method were all PC games or home games using WEB cameras.

Therefore, the present invention has been made to solve the above-mentioned conventional problems, an object of the present invention is to show the actual image of the player on the game through a CCD camera on the game, and recognize the player's motion through a bitmap analysis algorithm The game proceeds, and the dance game device using the image recognition to experience the virtual reality grafted with the virtual space in the game by watching the composite image of the actual game and the game in progress. And to provide a dance game method.

Another object of the present invention is to allow the user to control the game through the operation of his actual appearance displayed on the screen without using a separate game control device, so the gameplay method is intuitive and requires an input unit other than the CCD camera. Therefore, the present invention provides a dance game device and dance game method for arcade using image recognition, which enables the construction of a game machine with a simple structure and easy installation.

Another object of the present invention, the arcade dance game device using the image recognition that can quickly and effectively detect the pattern of the user's movement through the image bitmap analysis method to speed up the image processing using a CCD camera and To provide a dance game method.

Still another object of the present invention is to maximize the movement of the hand while minimizing the impact on the joints of the game player during the game, and to double the motion effect, install a CCD camera and analyze the video of the game player playing the game By reducing the production cost of the device by providing an arcade dance game device and dance game method using the image recognition to minimize the space occupied by the device.

Arcade dance game apparatus using the image recognition according to the present invention to achieve the above object, CCD camera for recognizing the operation of the player; An illumination device that illuminates the CCD camera so as to recognize the movement of the player and determines the position of the player; A bitmap extraction program for converting the image signal recognized by the CCD camera into bitmap data through a call-back function; An image output unit for synthesizing the video signal converted into bitmap data and the game progress image through the bitmap extracting program; An audio output unit for producing music; Computer game board; Game software; And a fuselage recognition algorithm which compares and analyzes the image recognized by the CCD camera for each frame and compares the color data of the pixels to determine whether the player moves.

The front of the CCD camera is characterized in that the concave lens is provided to reduce the distance between the CCD camera and the player by reducing the image of the player recognized by the CCD camera.

In addition, the arcade dance game method using the image recognition according to the present invention, the game start step of starting the game when the coin; An image synthesis output step of synthesizing the video of the player and the game screen captured by the CCD camera and outputting them to the screen; A game difficulty determination step of determining a difficulty level of a game as a first step of the image synthesis output step; A game song determination step of determining a song to be played as a second step of the image synthesis output step; A game progress step of playing a game as a third step of the image synthesis output step; An instruction shape movement step of moving the instruction shape using both arms of the player toward a predetermined target position in five directions or more moving on the screen in accordance with the beat and speed of the music in the game progress step; A motion detection step of determining whether a motion of a player is detected in a region of a target point when the indication shape reaches a target point; A motion response step of differentiating image effects and sounds in the game and giving a game score according to whether motion detection is performed in the motion detection step; A final score indicating step of showing a final score after the music is finished as the fourth step of the image synthesis output step; A commemorative photographing step of notifying the player when the player has obtained a high score as the fifth step of the image synthesizing output step and taking a commemorative photograph; And a game waiting step showing an example of playing the game and a screen of the high scorer and the game.

Hereinafter, an embodiment of the present invention will be described in detail with reference to the accompanying drawings.

1 is a system configuration for realizing the present invention, the present invention is a CCD camera 10, lighting device 20 (light stage), image input unit 30, bitmap synthesis unit 40, computer game board ( 50), graphics card 60, video output unit 70, sound output unit 80, game software 90 and the like.

Referring to FIG. 1, the CCD camera 10 is an image input unit which is a small camera that accepts the hand motions of a player for use as an input means of a game, and an illumination device 20 (lighting stage) is used by the CCD camera 10. Illumination to determine the hand movements of the player and determine the position of the player, the front of the CCD camera 10 by reducing the hand movement of the player recognized by the CCD camera 10 CCD camera 10 ) And a concave lens 5 for narrowing the player's distance.

The image input unit 30 receives an image signal from the CCD camera 10 and outputs a real image to the bitmap synthesis unit 40, and the bitmap synthesis unit 40 receives an image input from the image input unit 30. Synthesize the signal and game progress video.

The computer game board 50 outputs a game progress graphic to be synthesized by the bitmap synthesis unit 40 to the bitmap synthesis unit 40, and the image output unit 70 receives an image input from the CCD camera 10. The signal is output by synthesizing the game image and the sound output unit 80 receives the sound signal output from the computer game board 50 to produce music.

<Fuzzy Recognition Algorithm for Determining User's Movement>

If the bitmap data is imported through the call-back function, the image obtained by the CCD camera 10 is as follows. In this way, the video signal obtained through the CCD camera 10 is taken as bitmap data of consecutive frames, as shown in Figs. 2A and 2B.

At this time, since the image signal obtained through the CCD camera 10 is so large that the player must be far from the CCD camera 10, the concave lens 5 is installed in front of the CCD camera 10 so that the CCD camera 10 and the player are provided. To narrow the distance.

The current bitmap data (Fig. 2A) and the bitmap (Fig. 2B) data of the next frame are compared for each pixel, and the pixel whose color value data of the corresponding pixel is changed within a predetermined range is black and exceeds a predetermined range. A largely changed pixel is shown in FIG. 3 when it is displayed in white.

The calculation formula for calculating the change amount of the color data of the pixel shown in Fig. 3 is as follows.

(P _n ) ² = (R _n ) ² + (G _n ) ² + (B _n ) ²

(P _{n + 1} ) ² = (R _{n + 1} ) ² + (G _{n + 1} ) ² + (B _{n + 1} ) ²

D = | (P _{n + 1} )-(P _n ) |

here,

n: frame number

P _n : Color position of the nth frame of the pixel

R _n : Red value of the nth frame of the pixel

G _n : Green value of the nth frame of the pixel

B _n : Blue value of the nth frame of the pixel

D: Color change decision coefficient of the pixel

Herein, when the value of D is equal to or greater than a predetermined value, the pixel is considered to have motion.

Another calculation is as follows.

D _R = | R _{n + 1} -R _n |

D _G = | G _{n + 1} -G _n |

D _B = | B _{n + 1} -B _n |

here,

n: frame number

D _R : Amount of change in red value of the pixel

D _G : The amount of change in the green value of the pixel

D _B : Variation amount of blue value of corresponding pixel

R _n : Red value of nth frame of corresponding pixel

G _n : Green value of nth frame of corresponding pixel

B _n : Blue value of the nth frame of the pixel

If any one of the values D _R , D _G , and D _B is greater than or equal to a predetermined threshold, the pixel is considered to have motion.

2A and 3B show two consecutive frames, the pixel value change amount calculated by the above formula is calculated in real time for each pixel, and the change amount changes by more than a predetermined value. If it is regarded that there is motion of the pixel and is processed as white, and if there is no other change amount or less than a predetermined value, it is regarded as no motion and processed as black so that a bitmap of black and white as shown in FIG. 3 can be derived.

Here, if the area of interest is inside a rectangle named A, it is regarded as detecting motion when white is distributed over a predetermined ratio within this area, and there is no movement when white is distributed below a predetermined ratio. Consider. In FIG. 2 and FIG. 3, it is possible to regard area A as motion detected and area B as no motion. In this way, it is determined whether there is a movement of the player in a predetermined area on the screen.

In the above description, a body recognition algorithm for determining whether a user moves is represented in a flowchart as shown in FIG. 4.

FIG. 4 is a flowchart implementing a fuselage recognition algorithm for determining whether a user moves according to the present invention. In FIG. 4, S denotes a step.

First, an image signal is received by the CCD camera 10, and the received image is converted into bitmap data. (S10, S20)

Temporarily stores the converted bitmap data and receives the next frame video signal (S30, S40).

If the color difference of the pixel is smaller than the threshold value by comparing the pixel of the previous frame and the current frame bitmap (YES), the corresponding pixel is regarded as no motion and it is determined whether the pixel is moved by the specific gravity of the moved pixel in the predetermined area. S80)

If the color difference of the pixel is not smaller than the threshold value by comparing the pixel of the previous frame and the current frame bitmap (NO), it is determined that there is motion in the corresponding pixel, and it is determined whether to move by the specific gravity of the moved pixel in the predetermined region. S50, S60, S90, S70)

<Rhythm beat dance game using fuselage recognition algorithm>

The figure of implementing the dance game using the fuselage recognition algorithm in FIG. 4 is as shown in FIG. 5.

5 is a screen of a game standby state. At this stage, a brief introduction to the game is shown along with pictures of the high scorers.

First, the first screen to start the game when the coin is put as shown in FIG. The difficulty level of the game is selected. In this step, if the user touches the cloud-shaped mode selection part twice in succession, the mode is determined and the process proceeds to the next step. The blue area on the screen is the area where the real picture of the player is synthesized.

Subsequently, after the mode is selected, the screen for selecting a song appears as shown in FIG. The user touches the apple-shaped picture at the bottom left and right by hand to select a song, and touches the selection at the top right to determine the song.

After the music is determined as described above, the screen in which the game is played appears as shown in FIGS. 8 and 9.

Referring to FIGS. 8 and 9, the game progress screen is described. An arrow of five or more directions flying outward from the center moves to a predetermined position in accordance with music. If a player's motion is detected in the area when the arrow reaches a predetermined position, a score is obtained. The smaller the difference between the timing of the movement of the user and the timing of the arrival of the arrow, the higher the score. The positioning, direction and shape of the starting and reaching points of the arrow are free.

When the game ends, the final score screen appears as shown in FIG.

In this case, when the high score is raised, a souvenir picture is taken as shown in FIG. 11 and displayed along with the ranking on the game standby screen shown in FIG. Alternatively, as shown in FIG. 12, a picture is transmitted online and introduced to an Internet site.

13 is a flowchart illustrating the game progress process up to now.

FIG. 13 is a flowchart illustrating a rhythm beat dance game progression process using a fuselage recognition algorithm according to the present invention. In FIG. 13, S denotes a step.

First, when selecting a pre-game mode (single player, double player, group mode, curved tack, difficulty selection), the arrow moves to the corresponding position (S110, S120).

When the arrow arrives at the end point, it checks whether the fuselage is recognized in the corresponding area, and if there is a fuselage recognition, (YES) to obtain a score by differentiating the degree of time discrimination scores. (S130 ~ S150)

If there is no fuselage recognition, (NO) score is not obtained or is deducted. (S140, S141)

Subsequently, if the accumulated score and the current score are displayed, and the current score is less than the falling score, the game is finished and ending while displaying the acquired score and displaying the ranking (S160 to S180).

If the current score is not below the fall score, the game continues (NO). (S170, S190)

In the present invention, there is a difference in the motion recognition algorithm for processing a bitmap image using the data obtained through the CCD camera 10, and directly from the hardware using a call-back function in a method of calling image data from the image receiving apparatus. There is a difference in calling, and there is a difference from the existing game method in the elements constituting the game and the game method itself.

As described above, according to the arcade dance game apparatus and the dance game method using the image recognition according to the present invention, the actual image of the player on the game by showing the CCD camera, the operation of the player bitmap analysis algorithm Through the game to recognize the progress through the actual video and the progress of the game is synthesized by watching the dance game has the effect that you can feel the virtual reality combined with the virtual space on the game.

In addition, since the user controls the game through the motion of his actual appearance displayed on the screen without using a separate game control device, the gameplay method is intuitive and the structure is simple because no input means other than the CCD camera is required. It is possible to configure a game machine that is easy to install, to quickly process images using a CCD camera, and to detect patterns of user movements quickly and effectively through image bitmap analysis.

In addition, while minimizing the impact on the player's joints during the game, the movement of the hand can be maximized by maximizing the movement of the hand.The production cost of the device can be increased by installing a CCD camera and analyzing the image of the game player being played. It can also reduce the amount of space the device occupies.

What has been described above is only one embodiment for implementing the arcade dance game apparatus and dance game method using the image recognition according to the present invention, the present invention is not limited to the above-described embodiment, the technical idea of the present invention Of course, various modifications are possible by those skilled in the art.

1 is a system configuration of the present invention,

2a and 2b is a view of converting the image signal obtained by the CCD camera of the present invention into bitmap data of a continuous frame,

FIG. 3 is a view illustrating pixel-by-pixel comparison of FIGS. 2A and 2B;

4 is a flowchart implementing a fuselage recognition algorithm for determining whether a user moves according to the present invention;

5 is a view showing a game standby state screen of the present invention,

6 is a view showing the first screen to start the game of the present invention,

7 is a view showing a song selection screen of the present invention,

8 and 9 are views showing the game progress screen of the present invention,

10 is a view showing a final score screen after the end of the game of the present invention,

11 is a view showing a screen for taking a high score commemorative photo,

12 is a diagram showing a screen to introduce the Internet by sending a picture online at high scores,

Figure 13 is a flow chart implementing a rhythm beat dance game progression using the fuselage recognition algorithm according to the present invention.

  * Description of the symbols for the main parts of the drawings *

 5: concave lens 10: CCD camera

20: lighting device 30: video input unit

40: bitmap synthesis unit 50: computer game board

60: graphics card 70: video output unit

80: sound output unit 90: game software

Claims (3)

A CCD camera recognizing a player's motion; An illumination device that illuminates the CCD camera so as to recognize the movement of the player and determines the position of the player; A bitmap extraction program for converting the image signal recognized by the CCD camera into bitmap data through a call-back function; An image output unit for synthesizing the video signal converted into bitmap data and the game progress image through the bitmap extracting program; An audio output unit for producing music; Computer game board; Game software; And Arcade dance game apparatus using the image recognition comprising a fuselage recognition algorithm for determining whether the movement of the player by comparing the color data of the pixels by comparing the image recognized by the CCD camera for each frame. The method of claim 1, Arcade dance game apparatus using the image recognition, characterized in that the front end of the CCD camera is provided with a concave lens for reducing the image recognized by the CCD camera. A game start step in which a game is started by putting a coin; An image synthesis output step of synthesizing the video of the player and the game screen captured by the CCD camera and outputting them to the screen; A game difficulty determination step of determining a difficulty level of a game as a first step of the image synthesis output step; A game song determination step of determining a song to be played as a second step of the image synthesis output step; A game progress step of playing a game as a third step of the image synthesis output step; An instruction shape movement step of moving the instruction shape using both arms of the player toward a predetermined target position in five directions or more moving on the screen in accordance with the beat and speed of the music in the game progress step; A motion detection step of determining whether a motion of a player is detected in a region of a target point when the indication shape reaches a target point; A motion response step of differentiating image effects and sounds in the game and giving a game score according to whether motion detection is performed in the motion detection step; A final score indicating step of showing a final score after the music is finished as the fourth step of the image synthesis output step; A commemorative photographing step of notifying the player when the player has obtained a high score as the fifth step of the image synthesizing output step and taking a commemorative photograph; And Dance game method for the arcade using the image recognition, characterized in that it comprises a game waiting step showing an example of playing the game and the screen of the high scorer and the game.