KR101966040B1 - Apparatus for dance game and method for dance game using thereof - Google Patents

Abstract

A dance game device, a shooting means for shooting an object to be recognized and tracked, a display for outputting a dance motion or a shot object, an image of an object input through the shooting means for each frame, And a game terminal for outputting the score and controlling the dance operation according to the music selected by the user to be outputted to the display. At this time, the game terminal is connected to the user terminal through wired / wireless lines, and is capable of controlling the streaming of the video in real time.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention [0001] The present invention relates to a dance game device,

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a dance game apparatus, and more particularly to an apparatus and a method capable of measuring a score even in a free dance, rather than simply following the dance game.

Recently, a variety of dance games have been released due to the development of the dance game market, but there are a lot of processes such as following the movements, typing the action, stepping on the staff, and following them all, And the user's response was not obtained.

At this time, the dance game is performed in such a manner that a score is charged according to the degree of similarity between the predetermined operation and the input operation. Related to this, Korean Patent Laid-Open Publication No. 2013-0089763 (published on Aug. 13, 2013) discloses a virtual game which is a dance game in which a virtual avatar in a screen is danced with a motion recognition sensor to analyze and compare dance patterns have.

However, comparing the avatars with their own dances can not lead to a user's response or increase the purchase rate if the user knows all the patterns in a general game pattern or does not like the pattern. In addition, buyers who are able to access contents of various dances relatively easily will be less interested in the game.

In an embodiment of the present invention, various dance data, facial expression elements, genre elements, bits, and momentum are assigned to evaluation elements of dances so as to score a free dance of a user, It is possible to provide a dance game providing method capable of evaluating dancing even if not followed and reflecting various tastes of various people, thereby providing contents that are not easily timeless. It should be understood, however, that the technical scope of the present invention is not limited to the above-described technical problems, and other technical problems may exist.

As a technical means for achieving the above technical object, an embodiment of the present invention is a photographing device for photographing an object to be photographed to recognize and track the object, a display for outputting a dance operation or a photographed object, And a game terminal for analyzing an image of the object frame by frame, outputting a score by comparing the image with an image of a pre-stored dance operation, and controlling the dance operation according to the music selected by the user to be displayed on the display. At this time, the game terminal is connected to the user terminal through wired / wireless lines, and is capable of controlling the streaming of the video in real time.

Another embodiment of the present invention is characterized in that, when a confrontation from the first dance game apparatus to the second dance game apparatus is requested, a step of connecting the first dance game apparatus and the second dance game apparatus, Controlling the second dance game device and the first dance game device to output a video image of each object taken in accordance with music selected commonly by the two dance game devices, and controlling the first dance game device and the second dance game device Comparing the photographed image with a video image of a predetermined dance operation to output a score, and determining a win or loss according to the result of the score, thereby providing a reward to the dance game device having a high score. At this time, the predetermined dance operation may include a plurality of versions in one music.

According to any one of the tasks of the present invention described above, various dancing data, facial expression elements, genre elements, bits, and momentum are also set as evaluation elements of dancing so that the user's free dancing can be scored, It is possible to evaluate the dance even when the same dance is not followed, and it is possible to reflect the taste of various people, thereby providing a content that is not tired easily.

1 is a block diagram illustrating a dance game providing system according to an embodiment of the present invention.
FIG. 2 is a diagram for explaining the dance game apparatus shown in FIG. 1. FIG.
FIG. 3 is a diagram showing an embodiment of a case where a battle is applied between the dance game apparatuses shown in FIG. 1. FIG.
FIG. 4 is a diagram illustrating a process in which data is transmitted and received between the respective components included in the dance game providing system of FIG. 1 according to an embodiment of the present invention.
5 is a flowchart illustrating a method of providing a dance game according to an embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings, which will be readily apparent to those skilled in the art. The present invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. In order to clearly illustrate the present invention, parts not related to the description are omitted, and similar parts are denoted by like reference characters throughout the specification.

Throughout the specification, when a part is referred to as being "connected" to another part, it includes not only "directly connected" but also "electrically connected" with another part in between . Also, when an element is referred to as "including" an element, it is to be understood that the element may include other elements as well as other elements, And does not preclude the presence or addition of one or more other features, integers, steps, operations, components, parts, or combinations thereof.

The terms "about "," substantially ", etc. used to the extent that they are used throughout the specification are used in their numerical value or in close proximity to their numerical values when the manufacturing and material tolerances inherent in the stated meanings are presented, Accurate or absolute numbers are used to help prevent unauthorized exploitation by unauthorized intruders of the referenced disclosure. The word " step (or step) "or" step "does not mean" step for. &Quot;

In this specification, the term " part " includes a unit realized by hardware, a unit realized by software, and a unit realized by using both. Further, one unit may be implemented using two or more hardware, or two or more units may be implemented by one hardware.

In this specification, some of the operations or functions described as being performed by a terminal, a device, or a device may be performed instead in a server connected to the terminal, device, or device. Likewise, some of the operations or functions described as being performed by the server may also be performed in a terminal, device or device connected to the server.

In this specification, some of the operations or functions described in the mapping or matching with the terminal are mapping or matching the unique number of the terminal, which is the identification data of the terminal, or the identification information of the individual . ≪ / RTI >

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, the present invention will be described in detail with reference to the accompanying drawings.

1 is a block diagram illustrating a dance game providing system according to an embodiment of the present invention. Referring to FIG. 1, the dance game providing system 1 may include a user terminal 100, a dance game providing server 300, and a dance game providing apparatus 400. However, since the dance game providing system 1 of FIG. 1 is only an embodiment of the present invention, the present invention is not limited to FIG.

At this time, the respective components of FIG. 1 are generally connected through a network 200. For example, as shown in FIG. 1, the user terminal 100 may be connected to the dance game providing server 300 through the network 200. The user terminal 100 may be connected to the dance game device 400 via the network 200. [ The dance game providing server 300 may be connected to the dance game device 400 via the network 200. When the plurality of dance game devices 400 are connected to each other, A connection channel can be created. In addition, the dance game device 400 can be connected to the user terminal 100 directly or via the network 200. [ If there are a plurality of dance game devices 400, they can be connected through the dance game providing server 300.

Here, the network 200 refers to a connection structure capable of exchanging information between nodes such as a plurality of terminals and servers. One example of such a network 200 is a 3rd Generation Partnership Project (3GPP) network, A 5th Generation Partnership Project (5GPP) network, a World Interoperability for Microwave Access (WIMAX) network, an Internet, a LAN (Local Area Network), a Wireless LAN (Local Area Network) But are not limited to, a wide area network (PAN), a personal area network (PAN), a Bluetooth network, a satellite broadcast network, an analog broadcast network, and a digital multimedia broadcasting network. The user terminal 100, the dance game providing server 300, and the dance game device 400 shown in FIG. 1 are not limited to those shown in FIG.

The user terminal 100 may be an affiliate store where the dance game device 400 is installed or a terminal of a user who wishes to use a dance game at a retail store. When the dance game is started in real time, the user terminal 100 may be a terminal that shoots a dance game and uploads it to an SNS or an upload server (not shown) of an account held by the user. Also, the user terminal 100 may be a terminal that is synchronized with the dance game device 400 and receives a mirror screen or a stream of a screen shot by the dance game device 400 on the N screen. The user terminal 100 may be a terminal for outputting, in a tutorial, an operation corresponding to a selected song when the dance game apparatus 400 performs selection. In addition, the user terminal 100 may be a terminal sharing a photographed image of a dance game through channel formation with another user terminal 100. [ At this time, the user terminal 100 may be implemented as a terminal capable of connecting to a remote server or a terminal through the network 200. The user terminal 100 may be, for example, a wireless communication device with guaranteed portability and mobility, such as a navigation system, a Personal Communication System (PCS), a Global System for Mobile communications (GSM), a Personal Digital Cellular (PDC) Handyphone System), PDA (Personal Digital Assistant), IMT (International Mobile Telecommunication) -2000, Code Division Multiple Access (CDMA) -2000, W-Code Division Multiple Access (W-CDMA), Wibro (Wireless Broadband Internet) A handheld based wireless communication device such as a smartphone, a smartpad, a tablet PC, and the like.

The dance game providing server 300 manages a plurality of dance game devices 400. When a dance battle occurs in the dance game device 400, the dance game providing server 300 searches and lists the dance battle partner, and when the matching is completed, It can be a server that starts and shares scores with each other. When the dance battle occurs, the dance game providing server 300 may transmit each shot image to another dance game device 400 so as to share the dance battle images with each other, and control the streaming. In addition, when it is difficult to drive an algorithm for assigning a score in the dance game device 400, for example, there is no program for performing an algorithm, or the network satisfies a preset reference value Or if the hardware does not satisfy the reference hardware specification, the server may be a server that receives the captured image in real time and assigns a score to the captured image. The dance game providing server 300 is a server for receiving an access signal of the user terminal 100 and controlling the output of the dance game device 400 to be streamed in real time or used as an input interface in response to an access signal It is possible.

The dance game providing server 300 may be implemented as a computer capable of connecting to a remote server or terminal through the network 200. [ Here, the computer may include, for example, a notebook, a desktop, a laptop, and the like on which a WEB browser is installed.

The dance game device 400 may be a device that shoots a user who is installed at each of the direct selling points such as a karaoke room or a dance room or a member shop, and gives a score to the taken image according to a predetermined score giving algorithm. At this time, the dance game device 400 may be a device for outputting various versions of the tutorial dance version on the screen according to the level of the beginner, the intermediate, or the high, for a general user who can not dance well. In addition, the dance game apparatus 400 can give a score not only to how well the user follows the dance to be output, but also to give a score even when the user wishes to exercise his or her own freedom dance (Freedance). For example, the dance game device 400 may include not only a comparison with pre-stored dances, but also how to perform the dance well, such as the accuracy of the beat, the dance, the line of dance, And the score may be given according to expressions such as expressions. This is because everyone can dance according to the tutorial, but there are people who want to dance their own. Also, since most people come to enjoy karaoke and other places, they can also include a program that allows them to score points by dancing the dance they want to sing. The dance game apparatus 400 is a device for enabling a dance battle by connecting two dance battles in real time when there is no subject even if a confrontation, that is, a dance battle occurs, It is possible. The dance game apparatus 400 may further include a camera or a tag for controlling the output of a dance tutorial or the like on the screen and inputting the movement of the user, do.

FIG. 2 is a view for explaining the dance game apparatus shown in FIG. 1, and FIG. 3 is a diagram showing an embodiment in which a battle is applied between the dance game apparatuses shown in FIG.

Referring to FIG. 2, the dance game apparatus 400 according to an embodiment of the present invention may include a photographing means 410, a display 420, a game terminal 430, and a marker 440.

The dance game providing server 300 according to the embodiment of the present invention or the other server (not shown) operating in conjunction with the dance game providing server 300 transmits the dance game to the user terminal 100 and the dance game device 400, When transmitting an application, a program, an application page, a web page, etc., the user terminal 100 and the dance game device 400 can install or open a dance game service application, a program, an app page, In addition, a service program may be executed in the user terminal 100 and the dance game apparatus 400 using a script executed in a web browser. Here, a web browser is a program that enables a WWW (World Wide Web) service, and is a program for receiving and displaying hypertext described in hypertext mark-up language (HTML), for example, Netscape (Netscape) An Explorer, chrome, and the like. Further, the application refers to an application on the terminal, for example, an app (app) running on a mobile terminal (smart phone).

At this time, the connection of the network 200 is performed by connecting the communication object to the communication terminal for communication with the terminal connected to the network 200, the user terminal 100, the dance game providing server 300 and the dance game device 400, ≪ / RTI > The dance game providing server 300 can exchange data with each other through the communication object.

The photographing means 410 may be means for photographing a subject who is to dance. At this time, for example, an RGB-D camera can be used for shooting in 3D. At this time, when a depth camera is used, the human body structure can be analyzed by using a depth camera such as a Kinect, so that the user can digitize the movement of a person without wearing the equipment. On the other hand, the photographing means 410 may use a reflection marker or a marker or tag that can be recognized by the photographing means 410, that is, a previously stored marker or a tag. Gesture or motion tracking may be possible even in a low-specification computing environment. At this time, the marker can be attached to each joint part of a person, and the (x, y, z) values of the marker can be converted into a hierarchical file format having skeleton information such as BVH (Biovision Hierarchy) . At this time, an acoustic system such as an ultrasonic generator, an acoustic system composed of a receiver, a mechanical system for obtaining human motion using a jointed mechanical device, a magnetic sensor attached to each joint, It is not clear to exclude self-contained systems.

The display 420 may be a device for outputting the tutorial contents of dancing when a user selects a dance to perform a song, or a device for outputting a screen on which a dancer is photographed. At this time, the type of the display 420 is not limited and can be variously implemented as an LCD, an LED, an OLED, a PDP, a projector, and the like.

The game terminal 430 may be a terminal that outputs a dance corresponding to a song to the display 420 when the song is selected and gives a score by a predetermined algorithm by photographing the user with the photographing means 410. At this time, the game terminal 430 can detect and analyze motion using a SVM (Support Vector Machine), and can recognize and track an object using a target recognition and analysis system. The game terminal 430 can categorize and analyze the joint elements of the object through PCA (Principle Component Analysis), and can compare the prototype motion feature data with the user's input captured image through the gesture recognition engine have. At this time, the prototype motion feature data may be categorized and stored for each joint, genre, and dance for gesture recognition. At this time, it may be stored by the song. If one dance is mapped to one song, only one dance should be performed in a one-to-one manner. Therefore, . Therefore, the game terminal 430 according to the embodiment of the present invention can be used to evaluate the accuracy of the beat, the dance, the dynamics of the line of dance, the intensity depending on the force and the momentum, etc. so that the user can evaluate the dance even if he freely dances As an evaluation factor, you can assign a score even if you dance freely. Even though dancing is similar, it is a field where the difference of the points given can be increased depending on the feeling and the intensity. Therefore, the three elements of the dance can be set (horizontal, vertical, and oblique), and the score can be given according to the atmosphere and intensity according to the music.

Accordingly, the game terminal 430 uses a method of extracting a step, a motion, and a facial expression according to a beat and assigning a score. However, even if the same dance is used, By collecting and databaseing various people's dances for the same dance, they recognize that there are deviations and recognize and analyze the images with error boundaries. The evaluation of the three elements of dance, vertical, horizontal and oblique, and the intensity of dance, that is, the velocity, the force, and the size of the movement of the coordinates of each marker. For this purpose, Legs, and waists, and the motion data can be used by combining the angular change amounts and the parts of each frame of the image. In addition, the game terminal 430 may categorize the tone color and genre of the selected piece of music, and may score a score depending on the expression and dance appropriate to the genre and tone color.

For example, even a sad genre might be a bit fast or suddenly a bright song (a genre or bit change), so you might want to divide the song into the same atmosphere, beat, and genre,

The marker 440 and the game terminal 430 may be connected to each other so that the game terminal 430 generates vibration or electric stimulation less than the reference value at a place where the user needs to move, So that you can know. In other words, the marker 440 and the game terminal 440 can be displayed on the screen of the game terminal 440 so that the user can know exactly which part he / she should move without a teacher or a leader, (430).

The game terminal 430 may use an algorithm for recognizing the face and then tracking the face to extract the change of the facial expression. At this time, when the marker is attached or recognized as a face located on the stage, it is possible to track the recognized face and distinguish the face even if another person dances together. Facial expression recognition can be achieved by analyzing facial images and photographed images categorized by anger, joy, sorrow, and the like. At this time, the categorized and stored images can be updated through learning.

In addition, the game terminal 430 may visualize the movement using a plug-in that leaves the curved surface-based traces, which can curve the user's dance. The data obtained through motion capture may be a contiguous set of 3D coordinates of the marker 440 that allows the successive 3D coordinates passed by one marker 440 to appear as a contiguous set of points And generate a spline curve that interpolates the points. At this time, if the trail method is applied to the spline curve, the shape passing the spline can be set together with the length of the trail. A curved surface is formed in the case of a line, and a trail in the form of a cylinder in the case of a circle. In this process, motion for one body part can be visualized, and scores for dance can be given by comparing the visualized image with previously stored visualized images.

At this time, the game terminal 430 may be connected to an HMD (Head Mount Display, not shown) to allow the user to follow the tutorial image. At this time, the tutorial image can be outputted through the HMD as a virtual reality or augmented reality. Likewise, the game terminal 430 may use a method of scoring a score using three elements of dancing and other elements, as well as a method of scoring how much is similar to a tutorial image.

In other words, the dance game device 400 includes shooting means 410 for shooting an object to be recognized and tracked, a display 420 for outputting a dance motion or a photographed object, And a game terminal (430) for analyzing the image of the object by frame, outputting a score by comparing the image of the object with the image of the pre-stored dance operation, and controlling the dance operation according to the music selected by the user to be displayed on the display, 430 may be connected to the user terminal 100 through wired or wireless lines to control the streaming of images in real time.

When a plurality of dance game devices 400 are provided, the plurality of dance game devices 400 may be connected through a dance game service providing server. When a confrontation from the first dance game device 400 to the second dance game device 400 is requested, the first dance game device 400 and the second dance game device 400 The input image is output to the second dance game device 400 and the first dance game device 400 respectively and the dance game service providing server outputs the match result to the first dance game device 400 and the second dance game device 400 400, respectively.

At this time, the game terminal 430 tracks the coordinate change of the marker 440 that divides the joint of the object input from the photographing means 410, and calculates the force And momentum can be calculated. In addition, the coordinates of the marker 440 may be arranged on one coordinate by time to generate a line of dance, and the force and momentum for each operation of the previously stored dance operation and the line arranged on one coordinate , The photographing means 410 compares the line with the force and momentum in the input image, and outputs the score based on the similarity according to the comparison result.

The dance game providing server connected to the dance game device 400 or the dance game device 400 collects a plurality of dance operations for the same music and converts them into big data and separates the partial operations in the plurality of dance operations into big data Direction, and speed of a motion of a plurality of dance motions according to a time interval in which the partial motion is started, and stores the generated distribution map so as to be compared with the image of the object input by the photographing means 410. [

When the karaoke service of the selected music is selected, the game terminal 430 can provide the karaoke service of the selected music along with the dance game of the game terminal 430. [ At this time, the game terminal 430 recognizes the face of the input object, analyzes the emotion of the recognized face by comparing the facial expression of the recognized face with the stored emotion image categorized, compares the analyzed emotion data, The degree of similarity of the emotion data mapped to the mapped image can be calculated and reflected on the score based on the calculated degree of similarity.

When a plurality of dance game devices 400 are provided and are connected through the dance game providing server 300, the dance game providing server 300 receives the first dance game device 400 from the second dance game device 400, the first dance game device 400 and the second dance game device 400 can be connected. The dance game providing server 300 transmits the image of each object photographed according to the music commonly selected by the first dance game device 400 and the second dance game device 400 to the second dance game device 400 ) And the first dance game device (400). In addition, the dance game providing server 300 compares the images photographed by the first dance game device 400 and the second dance game device 400 with images of a predetermined dance operation to output a score, The winner or the loser can be determined as a result and the reward can be provided to the dance game device 400 having a high score. At this time, the predetermined dance operation may include a plurality of versions in one music.

Referring to FIG. 3, when a dance battle occurs, the shot taken at A is displayed on the left side through the game terminal 430 where A is located, and the shot taken by B is displayed on the right side through the game terminal 430 where A is located can do. On the contrary, the shot taken at B may be located on the left side through the game terminal 430 where B is located, and the shot taken by A may be located on the right side through the game terminal 430 where B is located. So, you are on the left side and the other side is on the right side so that you can confront each other. Of course, it is not excluded that the position of each other is changed, and other users may be placed on the front side and the rear side of the other user may be selected by the user, and various implementations are possible.

The above-described dance game apparatus 400 may be variously modified in addition to the above-described apparatus or composition, and is not limited to the above-described embodiments.

2 and 3 can be easily deduced from the same or described contents of the dance game providing method described above with reference to FIG. 1, so that the description thereof will be omitted do.

FIG. 4 is a diagram illustrating a process in which data is transmitted and received between the respective components included in the dance game providing system of FIG. 1 according to an embodiment of the present invention. Hereinafter, an example of a process of transmitting and receiving a signal according to an embodiment of the present invention will be described with reference to FIG. 4. However, the present invention is not limited to this embodiment, It is apparent to those skilled in the art that the process of transmitting and receiving the shown data can be changed.

Referring to FIG. 4, the dance game apparatus 400 (1) displays an action on the screen (S400) when a song selection (S4100) is performed, and starts to recognize and track the shot (S4300). At this time, when a screen sharing or streaming request is generated in the user terminal 100, the dance game device 400 (1) shares the screen with the user terminal 100 (S4310) When uploading or broadcasting occurs (S4320), uploading is performed accordingly.

On the other hand, the dance game device 400 (1) evaluates the score (S4400), and when battle is started (S4500), the battle event is transmitted to the dance game providing server 300 (S4600) (S4700). ≪ / RTI >

When the connection is completed, the operation is displayed on the screen from the music selection step S4800 (S4810), the shooting and tracking are started (S4820), and the process of evaluating the score (S4830) is shared. (S4840).

The order between the above-described steps S4100 to S4840 is only an example, but is not limited thereto. That is, the order between the above-described steps S4100 to S4840 may be mutually varied, and some of the steps may be executed or deleted at the same time.

The dancing game providing method of FIG. 4, which is not described above, can be easily deduced from the same or described contents of the dance game providing method described above with reference to FIGS. 1 to 3, .

5 is a flowchart illustrating a method of providing a dance game according to an embodiment of the present invention. 5, when a confrontation from the first dance game device to the second dance game device is requested, the dance game providing server according to the embodiment of the present invention includes a first dance game device and a second dance game device The game device is connected (S5100), and a video image of each object photographed in accordance with the music commonly selected by the first dance game device and the second dance game device is output from the second dance game device and the first dance game device (S5200).

In addition, the dance game providing server compares the photographed images of the first dance game device and the second dance game device with images of a predetermined dance operation to output a score (S5300), and determines whether to win or lose according to the result of the score The reward can be provided to the dance game device having a high score (S5400).

The dancing game providing method of FIG. 5, which is not described above, can be easily deduced from the same or explained contents of the dance game providing method described above with reference to FIGS. 1 to 4, do.

A dance game providing method according to an embodiment of the present invention can be executed in a smart terminal and can be performed by an application installed in a smart terminal. A method of providing a dance game according to an embodiment of the present invention can be provided by using the application of the camera of the smart terminal and the application of the smart terminal. In addition, by connecting a display, for example, a TV and a smart terminal, photographing and outputting itself with a camera of a smart terminal, and outputting a partner and an avatar to a video, the dance choreography can be easily and pleasantly followed, A game application may be provided in which winners win more points with capture.

The dance game providing method according to the embodiment described with reference to FIG. 5 may also be implemented in the form of a recording medium including an application executed by a computer or a command executable by a computer such as a program module. Computer readable media can be any available media that can be accessed by a computer and includes both volatile and nonvolatile media, removable and non-removable media. In addition, the computer-readable medium may include both computer storage media and communication media. Computer storage media includes both volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data. Communication media typically includes any information delivery media, including computer readable instructions, data structures, program modules, or other data in a modulated data signal such as a carrier wave, or other transport mechanism.

The method of providing a dance game according to an embodiment of the present invention may be executed by an application installed in a terminal (which may include a program included in a platform or an operating system basically installed in the terminal) May be executed by an application (i.e., a program) directly installed on the master terminal through an application providing server such as an application store server, an application, or a web server associated with the service. In this sense, the method of providing a dance game according to an embodiment of the present invention may be implemented in an application installed in a terminal or directly installed by a user (i.e., a program) and stored in a computer-readable recording medium Lt; / RTI >

It will be understood by those skilled in the art that the foregoing description of the present invention is for illustrative purposes only and that those of ordinary skill in the art can readily understand that various changes and modifications may be made without departing from the spirit or essential characteristics of the present invention. will be. It is therefore to be understood that the above-described embodiments are illustrative in all aspects and not restrictive. For example, each component described as a single entity may be distributed and implemented, and components described as being distributed may also be implemented in a combined form.

The scope of the present invention is defined by the appended claims rather than the detailed description and all changes or modifications derived from the meaning and scope of the claims and their equivalents are to be construed as being included within the scope of the present invention do.

100: user terminal
200: Network
300: Dance game providing server
400: Dance game providing device

Claims (2)

In a dance game device,
Photographing means for photographing the object so as to recognize and track the object;
A display for outputting a dance action or for outputting a photographed object;
A game terminal for analyzing an image of an object input through the shooting means on a frame-by-frame basis, outputting a score by comparing with an image of a previously stored dance operation, and controlling the dance operation according to the music selected by the user to be output to the display;
/ RTI >
The game terminal is connected to a user terminal through wired / wireless lines to control the streaming of the video in real time,
The dance game apparatuses are provided in plural,
Wherein the plurality of dance game devices are connected through a dance game service providing server,
When a confrontation from the first dance game device to the second dance game device is requested, the image input in accordance with the music commonly selected by the first dance game device and the second dance game device is transmitted to the second dance game device and the first dance game device Dance game device, respectively,
The dance game service providing server transmits the confrontation result to the first dance game device and the second dance game device respectively,
Wherein the game terminal recognizes a face of the input object and analyzes emotion of the recognized face by comparing the facial expression of the recognized face with the stored emotion image categorized, And recognizes facial features of the face,
Calculating similarity between the analyzed emotion data and emotion data imaged in the selected music,
Based on the calculated similarity,
Wherein the game terminal tracks a coordinate change of a marker for identifying a joint of an object in the image input from the photographing means and calculates force and momentum for each motion based on the velocity,
The coordinates of the marker are arranged on one coordinate by time to generate a dance line,
A force and a momentum for each operation of the previously stored dance operation and a line arranged on one coordinate are compared with a force and a momentum in the input image by the photographing means,
Outputs a score based on the similarity according to the comparison result;
The dance game providing server or the dance game providing server connected to the dance game apparatus collects a plurality of dance actions for the same music and converts them into big data,
The time division is performed by separating the partial operations in the plurality of dance operations into the big data,
And generates a distribution map of the range, direction, and velocity of the motion of the plurality of dance actions for each time period in which the partial action starts, and stores the distribution map so as to be compared with the image of the object input by the shooting means.
The method according to claim 1,
Wherein the game terminal provides the karaoke service of the selected music together with the dance game of the game terminal when the karaoke service of the selected music is selected.

Images