KR20160037858A - A rhythm game device interworking user behavior - Google Patents

Abstract

The present invention is to disclose a rhythm game device linked with user motion. The device comprises: a first or a second wearable device which is worn on a first or a second body portion, detects motion of a user, and outputs each of first and second motion signals; and a mobile terminal which is carried on a third body portion, detects motion of the user, and generates a third motion signal, the mobile terminal includes a control unit and a rhythm application unit, the control unit receives the detected first and third motion signals or the second and third motion signals and generates motion data, and the rhythm game application unit receives the generated motion data, evaluates matching or rhythm sense for the motion of the user in accordance with a game mode, and outputs a game score. According to the present invention, a user can variously express and enjoy rhythm sensor and dance sense while seeing a screen on which the actual motion of the user is displayed without restriction of hands and feet, the device is minimized such that there is no limit in an installation space of the game device, and power consumption and manufacturing costs are reduced.

Description

[0001] The present invention relates to a rhythm game device,

The present invention relates to a rhythm game device, and more particularly, to a rhythm game device in which a user wears or holds various types of wearable devices having one or a plurality of sensors, a portable terminal, a karaoke microphone, a smart TV remote controller, And a rhythm game device in cooperation with a user action for calculating a game score by evaluating a rhythmic sense of user activity or a consistency with a reference dance motion.

As the entertainment market expands, a large number of game machines are on the market, and the demand of users for new and more healthy games is gradually increasing.

Nowadays, in the game market, the dance simulation game machine enjoying dancing together with light music is popular, and it is excellent as a diet game with relieving the stress due to the active dance with the light music compared to the conventional static entertainment game.

Many game makers are launching dance simulation gaming machines under the name Dance Dance Revolution (DDR), Pump, The Rhythm and Dance, Lulu Rural, Stepping Stage, which is very popular among young people and gamers.

However, such dance game machines are designed to step on the front / rear / left / right area of the foot plate according to the direction of the arrow displayed on the screen of the monitor.

Such a conventional dance game device is designed to step on the foot portion of the floor by looking at the contents displayed on the monitor, so that various joints such as the knee of the player may be uncomfortable, It is bulky and space-constrained to install the dance game device.

Particularly, since the floor main body is provided with a plurality of switches that are sensitive and responsive even if they are stepped on their feet, there is a disadvantage in that the overall unit price of the dance game device is increased. Since the floor game, The hand moves little and moves the position of the foot and enjoys the game.

These technologies include sensor sensing means using a mechanical method to recognize the user's actions, and also use graphic elements represented by characters representing him or displayed on the game in the game , But does not display the actual appearance of the player on the screen.

As described above, since almost all dance game devices are almost similar in operation method, the dance game devices released in the latter half of the past have a limit of being tired and interested in half because they can not give the user a fresh feeling as compared with the dance game devices released in the early stage .

On the other hand, smart devices such as smart phones and tablet PCs perform additional functions with various applications and internal attached sensors in addition to the functions of handset, MMS, and SMS.

For example, it has data transfer function and Internet search, the ability to shoot and play back pictures and videos, the playback of music and multimedia files, and various other applications.

It also has a variety of extended functionality including an accelerometer, a gyro sensor, a geomagnetic sensor, and a realistic rhythm game interlocked with a motion recognition sensor attached inside the smart device.

The development of wearable computing technology or human device interaction technology worn by the user due to the development of technologies of low power and miniaturization of various sensors or various sensors has been actively researched for various external device products.

Accordingly, the present inventor has found that an external device equipped with a miniaturized and low-powered sensor can be easily and safely used in the body by avoiding a foot pad, a motion recognition camera mechanism using a conventional pressure sensor, A rhythm game apparatus which can enjoy a rhythm feeling and a dance feeling while variously expressing the motion of a user without restraint of hands and feet.

SUMMARY OF THE INVENTION It is an object of the present invention to provide a wireless communication device and a method of controlling the same, in which a user wears or possesses various types of wearable devices having one or more sensors and a portable terminal, a karaoke microphone, a smart TV remote control, And to provide a rhythm game device in which the rhythm game device is interlocked with a user operation that can evaluate the rhythm feeling of a user's action and enjoy the rhythm game by evaluating the consistency or similarity with the reference dance motion.

According to another aspect of the present invention, there is provided a rhythm game device for synchronizing with a user's movement, the rhythm game device comprising: a first or second body part for sensing a motion of a user and outputting first and second motion signals, 2 wearable appliances; And a portable terminal which is carried in a third body part and detects a user's movement and generates a third motion signal, wherein the portable terminal has a control part and a rhythm game application part, The rhythm game application unit receives the generated motion data and evaluates the consistency or rhythm of the motion of the user according to the game mode, And outputs a score.

According to another aspect of the present invention, there is provided a rhythm game device, the rhythm game device comprising: a wearable device that is worn on a first body part and detects a motion of a user and outputs a first motion signal; A karaoke microphone that is carried in a second body part to sense a movement of a user and generate a second motion signal; And a karaoke device for receiving the rhythm game content from the self-installed rhythm game program and reproducing the video data and the sound data, and dividing the screen to display a moving picture of the user's operation, wherein the karaoke device comprises a controller and a rhythm Wherein the controller receives the first and second sensed motion signals to generate motion data, and the rhythm game program unit receives the generated motion data to receive motion data corresponding to the motion of the user according to the game mode, And the game score is outputted by evaluating the consistency or the rhythm feeling.

According to another aspect of the present invention, there is provided a rhythm game device, the rhythm game device comprising: a wearable device that is worn on a first body part and detects a motion of a user and outputs a first motion signal; A controller which is carried in a second body part to detect a motion of a user and generate a second motion signal; And a game main body for receiving rhythm game content from a self-contained rhythm game program to reproduce video data and sound data, and dividing the screen to display a moving picture of a user's operation, wherein the game main body includes a controller and a rhythm Wherein the controller receives the first and second sensed motion signals to generate motion data, and the rhythm game program unit receives the generated motion data to receive motion data corresponding to the motion of the user according to the game mode, And the game score is outputted by evaluating the consistency or the rhythm feeling.

According to the present invention, it is possible to enjoy a rhythm feeling and a dancing feeling by variously expressing while viewing the screen on which the actual operation of the user is displayed without restraint of the hands and feet.

In addition, the game apparatus can be downsized so that there is no restriction on the installation space of the game apparatus, and power consumption and production cost can be reduced.

1 is a block diagram of a rhythm game apparatus in association with a user operation according to the present invention.
2 is a detailed configuration diagram of the first and second sensor units 120 and 220 shown in FIG.
3 is a flowchart illustrating a method of recognizing an operation of a rhythm game apparatus in association with a user operation according to the first embodiment of the present invention.
FIG. 4 is a scoring table for evaluating a rhythm motion designation mode among the rhythm game methods linked to a user operation according to the first embodiment of the present invention.
FIG. 5 is a scoring table for evaluating the rhythm motion free mode among the rhythm game methods in accordance with the first embodiment of the present invention.
FIG. 6 is a block diagram of a rhythm game device in cooperation with a user operation according to a second embodiment of the present invention.
7 is a detailed configuration diagram of the wearable device side sensor unit 620 and the microphone side sensor unit 760 shown in FIG.
8 is a flowchart illustrating a method of recognizing an operation of a rhythm game apparatus in association with a user operation according to a second embodiment of the present invention.
FIG. 9 is a block diagram of a rhythm game device in association with a user operation according to a third embodiment of the present invention.
10 is a detailed configuration diagram of the wearable device side sensor portion 1120 and the controller side sensor portion 1220 shown in FIG.

Hereinafter, a rhythm game device in conjunction with a user operation according to the present invention will be described with reference to the accompanying drawings.

The portable terminal described below refers to a smart phone, a PDA (personal digital assistant), a portable multimedia player (PMP), a smart pad, etc., which can perform computer-assisted functions such as Internet communication, Refers to an Internet Protocol Television (IP-TV), a smart TV, a tablet PC, and the like, and the content refers to an application that is an application program used in the portable terminal.

FIG. 1 is a block diagram of a rhythm game apparatus in accordance with a first embodiment of the present invention. The rhythm game apparatus includes a first and a second wearable devices 100 and 200 each having a sensor unit, a portable terminal 300, And displays it on the display device 1400 using various contents provided by the server 500. [

2 is a detailed configuration diagram of the first and second sensor units 120 and 220 and the terminal side sensor unit 320 shown in FIG. 1 and includes acceleration sensors 122, 222 and 322, a gyro sensor 124, 224, and 324, geomagnetic sensors 126, 226, and 326, and a six- or nine-axis motion recognition complex sensor 128, 228, and 328 combining two or more of them. One or a plurality of sensors are provided.

The first wearable device 100 is in the form of an earphone or headphone having a first communication unit 110, a first sensor unit 120, a first power source unit 130, and a speaker 140, The wearable device 200 includes a second communication unit 210, a second sensor unit 220, and a second power source unit 230 and is of the clip type or band type which is worn on the head, hand or body of the user.

Hereinafter, the case where the user wears the first wearing-type apparatus 100 or the second wearing-type apparatus 200 is described as an example. However, the first wearing-type apparatus 100 and the second wearing- ) May be worn together.

The portable terminal 300 includes a terminal side communication unit 310, a terminal side sensor unit 320, a terminal side power source unit 330, an audio signal processing unit 340, a control unit 350, a rhythm game application unit 360, And a rhythm game application unit 360 includes a content unit 362, a game determination unit 364, and a game data storage unit 366. [

The display device 400 includes a camera 420, a display device side communication portion 440, a multimedia processing portion 460 and a display device side display portion 480. The server 500 includes a server side communication portion 520, And a database unit 560. The database unit 560 includes a user DB 562, a contents DB 564, a judgment DB 566, and a billing DB 568. [

The functions of the respective components of the rhythm game apparatus interlocked with the user's operation according to the first embodiment of the present invention will be described with reference to FIGS. 1 and 2. FIG.

The first and second wearable devices (100, 200)

The first sensor unit 120 includes an acceleration sensor 122, a gyro sensor 124, a geomagnetic sensor 126, and a six-axis or nine-axis motion recognition complex sensor 128 combining two or more of them Or a plurality of sensors senses first motion information such as an operation acceleration, a rotational angular velocity, a velocity, and an orientation on the motion axis of a user's head wearing the first wearable device 100, And outputs a first motion signal of the head portion for velocity, intensity, rotation, and jumping.

The second sensor unit 220 detects the movement of the second sensor unit 222 from the acceleration sensor 222, the gyro sensor 224, the geomagnetic sensor 226, and a 6-axis or 9- An angular velocity, an intensity on the motion axis, and the like, by sensing second motion information such as an operation acceleration on a motion axis of a wrist, an ankle or a head of a user wearing the wearable device 200, a rotational angular velocity, , And outputs a second motion signal of the wrist, ankle or head for rotation and jumping.

The first communication unit 110 is connected to the portable terminal 300 through a wireless communication technology such as WI-FI, Bluetooth, infrared communication, or Zigbee, or a wired communication technology such as a DSL Interfaces transmit and receive.

The second communication unit 210 interfaces the transmission and reception of the second motion signals of the wrist, ankle, or head with the portable terminal 300 through a wireless communication technology such as WI-FI, Bluetooth, infrared communication or ZigBee.

The first power source unit 130 and the second power source unit 230 have built-in batteries and are supplied with power by themselves.

The speaker 140 receives electrical voice and sound signals from the portable terminal 300 in a wireless manner via the communication unit 310 on the terminal side or in a wired manner through the audio signal processing unit 340 and processes the voice and sound Output.

In the portable terminal 300,

The terminal side communication unit 310 may be connected to the first or second wearable devices 100 and 200 through a wireless communication technology such as Bluetooth, RFID, Zigbee, 3G, 4G, or 5G or a wired communication technology such as DSL or optical transmission. An ankle or a head portion of the wrist, an ankle or a head.

It also interfaces with the display-device-side communication unit 440, which will be described later, to transmit and receive display data, and interfaces with the server-side communication unit 520 to transmit and receive contents and various database data.

The mobile terminal side sensor unit 320 receives signals from the acceleration sensor 322, the gyro sensor 324, the geomagnetic sensor 326 and a 6-axis or 9-axis motion recognition compound sensor 328, The angular velocity, and the angular velocity on the motion axis by detecting the third motion information such as the motion acceleration, the rotational angular velocity, the velocity, and the orientation on the motion axis of the body part (e.g., the hand, torso) , And the portable terminal 300 for intensity, rotation, and jumping outputs a third motion signal of the body part that is held.

The control unit 350 receives the first or second movement signals of the wrist, ankle or head and the ear from the terminal-side communication unit 310 and receives the first or second movement signals of the body part having the portable terminal 300 from the terminal- An ankle or head portion of the user wearing the first or second wearable device 100 or 200 wearing the portable terminal 300 and the hand of the user wearing the first or second wearable device 100 or 200, The motion data for the first, second, and third motion information such as the motion acceleration on the motion axis of the part, the rotational angular velocity, the velocity, and the azimuth are calculated.

The rhythm game application unit 360 compares the calculated operation data with the rhythm data of the reference dance motion data or the sound source stored in the content unit 362 at predetermined time intervals or periodically according to the game mode, The unit score is calculated and stored in the game data storage unit 366.

The audio signal processing unit 340 receives the rhythm game contents data downloaded in advance and stored in the contents unit 362 or reproduced in an online streaming manner, processes the processed rhythm game contents data into voice and sound data, and outputs the processed audio and audio signals.

The terminal side display unit 390 displays a moving image of the avatar or a real time shooting moving image selected by the user on the screen according to the movement of the user and displays information processed in the rhythm game application unit 360 and the audio signal processing unit 340, The score of the unit game, and the state of the multimedia sound source reproduction are displayed on the screen.

At this time, the screen may be divided so that the video of the avatar of the reference motion data may be displayed together. In the case of the competition mode or the cooperative mode, the video of the avatar selected by the competition user or the real time shooting video may be displayed together.

The display device 400 and the server 500,

The display device side communication unit 440 interfaces the transmission and reception of operation data calculated from the portable terminal 300 through wireless communication such as Bluetooth, RFID, Zigbee, 3G, 4G, and 5G.

The multimedia processing unit 460 receives the rhythm game contents that have been previously downloaded and stored or reproduced in an online streaming manner, and processes the processed rhythm game contents as video data, audio data, and sound data.

The camera 420 captures a real-time moving picture of the user's movement.

The display device side display unit 480 receives the image data processed by the multimedia processing unit 460 and displays the moving image data of the reference motion data avatar. The moving image data is divided into a video of the avatar selected by the user, And displays the moving picture together with the screen according to the movement of the user. If the game mode is the cooperative mode or the cooperative mode, the video of the avatar selected by the competition user or the real-time shot video may be displayed together.

The server side communication unit 520 transmits the rhythm game contents stored in the content processing unit 540 to the portable terminal 300 via radio communication such as Bluetooth, RFID, Zigbee, 3G, 4G, And interworking with the social network system 900 for transmission / reception of various DB data and games in the competition mode or cooperative mode.

The content processing unit 540 processes rhythm game contents.

The database unit 560 includes a user DB 562 for user information, a content DB 564 for multimedia sound sources and rhythm game contents, a determination DB 566 for unit score calculation, and a billing DB (568).

3 is a flowchart illustrating a method of recognizing an operation of a rhythm game apparatus in association with a user operation according to the first embodiment of the present invention.

FIG. 4 is a scoring table for evaluating a rhythm motion designation mode among the rhythm game methods linked to a user operation according to the first embodiment of the present invention.

FIG. 5 is a scoring table for evaluating the rhythm motion free mode among the rhythm game methods in accordance with the first embodiment of the present invention.

A method of recognizing an operation of a rhythm game apparatus in association with a user operation according to the first embodiment of the present invention will be described with reference to FIGS. 1 to 5 as follows.

First, a user wears the first wearable device 100 on his / her head or wears the second wearable device 200 on the wrists and ankles and holds the portable terminal 300 in his / her lower pocket. And assumes a rhythm game for a certain period of time.

When the avatar movie mode, the sound source, the game mode, and the game level are selected through the menu displayed on the portable terminal side display unit 390 (S101 and S102), the control unit 350 determines whether the mode is the social network system for the competition or cooperative (S103).

Here, in the case of the social network system for the cooperative use or the cooperative use, the motion of the competition or cooperative choreography of the other users of the social network group is displayed on the counterpart external device.

If the mode is not the social network system mode, the multimedia sound source is immediately executed (S108). If the mode is the social network system mode, it is determined whether the SNS friend is invited (S104) After executing the competition or cooperative mode (S107), the multimedia sound source is executed (S108).

The speaker 140 in the first wearable device 100 receives and reproduces the multimedia sound source from the portable terminal 300 and the display device side display unit 480 displays the moving image of the reference motion data avatar in 2D or 3D form do.

The user listens to the multimedia sound source reproduced through the speaker 140 in the first wearable device 100 and starts the dancing operation while watching the moving image of the reference motion data avatar displayed on the display device side display unit 480 (S109) .

The first or second sensor unit 120 or 220 or the terminal side sensor unit 320 may be a first or a second sensor such as an operating acceleration on a motion axis of a user's head or wrist, ankle or waist portion, a rotational angular velocity, Second, and third motion information (S110), and outputs the first, second, and third motion signals of the head, wrist, ankle, and waist (S111).

The controller 350 receives the first, second, and third motion signals of the head, the wrist, the ankle, and the waist to receive an operation acceleration, a rotational angular velocity, a velocity, and a bearing of the user's head, wrist, And calculates motion data for the first, second, and third motion information (S112).

The rhythm game application unit 360 determines whether the game mode selected in step S110 is the rhythm motion specifying mode (S113). If the game mode is the rhythm motion specifying mode, the rhythm game application unit 360 compares the calculated motion data with pre-stored reference dance motion data The consistency and similarity are evaluated for a predetermined time (S116), the unit score is calculated and stored in the game data storage unit 366 (S117).

4, the degree of consistency or similarity of motion is divided into "good", "normal" and "bad", and the scores of "10 points", "5 points", "2 points" Point "to calculate.

If the game mode selected in step S113 is a rhythm motion free mode other than the rhythm motion specifying mode, the rhythm game application unit 360 may beat the calculated motion data, (S114), the unit score is calculated and stored in the game data storage unit 366 (S115).

5, the degree of rhythm of the user's action is divided into "good", "normal", and "bad" (S117).

The control unit 350 calculates the game score by summing up all the unit scores calculated for the predetermined time in step S115 or S117 (S118).

The control unit 350 determines whether the user has posted the social network system (S119).

If it is determined that the user has not posted the social network system, it is immediately confirmed whether the game is to be continued through the display unit of the portable terminal 300 (S122). If it is determined that the user has posted the social network system, After selecting the group or friend (S120), game data such as a game score, a rating, and an equal number are transmitted to the selected SNS group or friend (S121), and the user is confirmed whether to continue the game (S122).

If it is confirmed that the user will continue the game, the process returns to step S102 to repeat the operation thereafter. If the user is determined not to continue the game, the game data is stored in the game data storage unit 366 (S123).

FIG. 6 is a block diagram of a rhythm game device in cooperation with a user operation according to a second embodiment of the present invention, which includes a wearable device 600 having a sensor unit, And displays it on the karaoke system 800 using various contents provided.

7 is a detailed configuration diagram of the wearable device side sensor unit 620 and the microphone side sensor unit 760 shown in Fig. 6 and includes acceleration sensors 622 and 762, gyro sensors 624 and 764, One or more geomagnetic sensors 626 and 766 and six or nine-axis motion recognition complex sensors 628 and 768 combining two or more of them are fixed.

In the following description, the server 500 is used as an on-line real-time system. However, in the case where the karaoke system 800 itself is equipped with the rhythm game software, (Off Line) method is also assumed.

The wearable device 600 includes an earphone equipped with a wearable device side communication part 610, a wearable device side sensor part 620 and a wearable device side power supply part 630 and worn on the head, , A clip type, and a band type. In the case of the earphone or headphone type, a speaker may be additionally provided as in the first embodiment shown in FIG.

The karaoke microphone 700 includes a microphone side communication unit 720, a sound source input unit 740, a microphone side sensor unit 760, and a microphone side power source unit 780.

The karaoke system 800 includes a karaoke system side communication unit 810, a speaker 820, a camera 830, an audio signal processing unit 840, a control unit 850, a rhythm game program unit 860, and a display unit 890 And the rhythm game program section 860 includes a content section 862, a game determination section 864, and a game data storage section 866. [

The server 500 includes a server DB 520, a contents processing unit 540 and a database unit 560. The DB unit 560 includes a user DB 562, a contents DB 564, a judgment DB 566, And a billing DB 568.

The functions of the respective components of the rhythm game apparatus in association with the user's operation according to the second embodiment of the present invention will be described with reference to FIGS. 6 and 7. FIG.

Wearable device (600)

The wearable device-side communication unit 610 interfaces transmission / reception of the first motion signal with the karaoke device 800 through a wireless communication technology such as WI-FI, Bluetooth, infrared communication, or Zigbee.

The wearable device side sensor unit 620 includes an acceleration sensor 622, a gyro sensor 624, a geomagnetic sensor 626, and a 6-axis or 9-axis motion recognition complex sensor 628 combining two or more of these sensors The first motion information such as the motion acceleration on the motion axis of the wrist, ankle or head of a wearer wearing the wearable device 600, the rotational angular velocity, the velocity and the orientation, and detects the movement direction, , And outputs a first motion signal of the wrist, ankle or head for rotation and jumping.

The wearable device-side power supply unit 630 is supplied with its own power source such as a battery.

The karaoke microphone 700

The microphone side sensor unit 760 is connected to a microphone (not shown) by an acceleration sensor 762, a gyro sensor 764, a geomagnetic sensor 766, and a 6-axis or 9- Speed, intensity, rotation, and jumping on the operation axis by sensing second motion information such as an operation acceleration, a rotational angular velocity, a velocity, and an orientation on the operation axis of the user's hand having the user's hand And outputs the second motion signal.

The microphone-side power supply 780 is supplied with its own power source, such as a battery.

The sound source input unit 740 receives the voice and sound of the user, converts the voice and sound signals, and transmits the voice and sound signals to the karaoke system 800 through the cable.

The microphone-side communication unit 720 interfaces transmission / reception of the second motion signal with the karaoke system 800 through a wireless communication technology such as WI-FI, Bluetooth, infrared communication, or Zigbee.

The karaoke machine (800)

The karaoke device side communication unit 810 transmits and receives the first and second motion signals to and from the wearable device 600 and the karaoke microphone 700 through a wireless communication technology such as Bluetooth, RFID, Zigbee, 3G, 4G, do.

It also interfaces with the server-side communication unit 520, which will be described later, to transmit and receive contents and various database data.

The control unit 850 receives the first and second motion signals from the karaoke device side communication unit 810 and receives the user's action, for example, the wearable device 600 and the karaoke microphone 700 Motion angles of the wrist, ankle or head and movement of the hand on the motion axis, rotational angular velocity, velocity and bearing, and the like.

The rhythm game program unit 860 compares the calculated operation data with the rhythm data of the reference dance motion data or the sound source stored in the contents unit 862 at predetermined time intervals or periodically according to the game mode, The unit score is calculated and stored in the game data storage unit 866. The game score data stored in the game data storage unit 866 is stored in the game data storage unit 866. [

The audio signal processor 840 receives voice and sound of the user from the sound source input unit 740 through wired or wireless communication, processes the voice and sound data, and outputs the audio signal.

The speaker 820 receives the rhythm game content data downloaded in advance and stored in the content unit 862 or reproduced in an online streaming manner, and processes the processed rhythm game content data as voice and sound.

The camera 830 captures a real-time moving picture of the movement of the user.

The display unit 890 displays a moving image of the avatar selected by the user or the moving image photographed by the camera 830 on the screen in accordance with the movement of the user and displays the processed moving image in the rhythm game program unit 860 and the audio signal processing unit 840 Information, that is, a calculated unit score, a game score obtained by adding the scores, and a multimedia sound source playback status on the screen.

At this time, the screen is divided so that the moving image of the reference motion data avatar can be displayed together.

In the server 500,

The server side communication unit 520 transmits the rhythm game contents stored in the contents processing unit 540 and the database unit 560 to the karaoke system 800 via wired communication or wireless communication such as Bluetooth, RFID, Zigbee, 3G, 4G, And transmits / receives various DB data stored in advance.

The content processing unit 540 processes rhythm game contents.

The database unit 560 includes a user DB 562 for user information, a content DB 564 for multimedia sound sources and rhythm game contents, a determination DB 566 for unit score calculation, and a billing DB (568).

8 is a flowchart illustrating a method of recognizing an operation of a rhythm game apparatus in association with a user operation according to a second embodiment of the present invention.

The score table to be evaluated in the case of the rhythm motion specifying mode among the rhythm game methods in the second embodiment of the present invention is shown in Fig. 4 as in the first embodiment, and the scoring table to be evaluated in the case of the rhythm motion free mode, 5 is the same.

4 to 8, a method of recognizing an operation of a rhythm game apparatus in association with a user operation according to a second embodiment of the present invention will be described with reference to specific embodiments.

First, the user wears the wearable device 600 on the wrist, ankle, and head, and assumes that the avatar movie mode is selected while holding the karaoke microphone 700 in hand and plays a rhythm game for a predetermined time.

When the avatar movie mode, the sound source, the game mode, and the game level are selected through the menu displayed on the display unit 890 of the karaoke system 800 (S201, S202), the controller 850 executes the multimedia sound source (S208).

The speaker 820 in the karaoke system 800 receives and reproduces the multimedia sound source from the content unit 862 of the rhythm game program unit 860 and the display unit 890 displays the moving picture of the reference motion data avatar in 2D or 3D form .

The user hears the multimedia sound source reproduced through the speaker 820 in the karaoke system 800 and starts the dancing operation while watching the moving image of the reference motion data avatar displayed on the display unit 890 (S209).

At this time, the camera 830 in the karaoke system 800 captures a real-time moving picture of the user's movement.

The wearable device side sensor part 620 and the microphone side sensor part 760 are respectively provided with first and second movements such as an operation acceleration, a rotational angular velocity, a velocity and an orientation on the operation axis of the head part, the hand part and the ankle part of the user, (S210), and outputs the first and second motion signals of the head part, the hand part, and the ankle part (S211).

The control unit 850 receives the first and second motion signals of the head, the hand, and the ankle to receive the first and second motion signals of the head, the hand, and the ankle, and determines the motion acceleration, the angular velocity, 1 and the second motion information (S212).

The rhythm game application unit 360 determines whether the game mode selected in step S202 is a rhythm motion designation mode (S213). If the game mode is the rhythm motion designation mode, the calculated motion data is compared with previously stored reference dance motion data The consistency and the similarity are evaluated for a predetermined time (S216), the unit score is calculated and stored in the game data storage unit 866 (S217).

4, the degree of consistency or similarity of motion is divided into "good", "normal" and "bad", and the scores of "10 points", "5 points", "2 points" Point "to calculate.

If the game mode selected in step S213 is a rhythm motion free mode other than the rhythm motion specifying mode, the rhythm game application unit 360 may beat the calculated motion data, (S214), the unit score is calculated and stored in the game data storage unit 866 (S215).

5, the degree of rhythm of the user's action is divided into "good", "normal", and "bad" (S217).

The control unit 850 calculates the game score by summing up all the unit scores calculated for the predetermined time in step S215 or S217 (S218).

The control unit 850 confirms whether to continue the game through the display unit 890 (S222).

If it is confirmed that the user will continue the game, the process returns to step S210 and the operation is repeated. If the user is determined not to continue the game, the game score is stored in the game data storage unit 866 (S223).

FIG. 9 is a block diagram of a rhythm game device in cooperation with a user operation according to a third embodiment of the present invention. The rhythm game device includes a wearable device 1100 having a sensor unit and a controller 1200 interlocked with the controller 1200, And displays it on the game machine 1300 and the display device 1400 using various contents.

Hereinafter, the controller 1200 and the game machine 1300 interlocked with the game machine controller 1200 as one embodiment of the game machine are set as an embodiment, but they are also used in a smart TV interlocked with a remote controller.

However, the rhythm game software may be installed in the game machine 1300 or the smart TV itself to perform the role of the server 500 in place of the server 500. [ (Off Line) method is also assumed.

10 is a detailed configuration diagram of the wearable device side sensor unit 1120 and the controller side sensor unit 1220 shown in Fig. 9, and includes acceleration sensors 1122 and 1222, gyro sensors 1124 and 1224, One or more of the geomagnetic sensors 1126 and 1226 and six-axis or nine-axis motion recognition complex sensors 1128 and 1228 combining two or more of them are fixed.

The wearable device 1100 includes a wearable device side communication portion 1110, a wearable device side sensor portion 1120, a wearable device side power supply portion 1130 and a wearable device side speaker 1140, An earphone, a headphone, a clip, and a band that are worn on a limb or body.

The game machine controller 1200 includes a controller-side communication unit 1210, a controller-side sensor unit 1220, and a controller-side power source unit 1280.

The game machine 1300 includes a game machine side communication section 1310, a camera 1320, an audio signal processing section 1340, a control section 1350, a rhythm game program section 1360 and a game machine side display section 1390, The program section 1360 includes a content section 1362, a game determination section 1364, and a game data storage section 1366. [

The display device 1400 includes a display device side speaker 1420, a display device side communication portion 1440, a multimedia processing portion 1460, and a display device side display portion 1480.

The server 500 includes a server DB 520, a contents processing unit 540 and a database unit 560. The DB unit 560 includes a user DB 562, a contents DB 564, a judgment DB 566, And a billing DB 568.

Referring to FIGS. 9 and 10, the functions of the respective components of the rhythm game apparatus in association with the user operation according to the third embodiment of the present invention will be described.

Wearable Equipment (1100)

The wearable device-side communication unit 1110 interfaces transmission / reception of the first motion signal with the game device 1300 via wireless communication technologies such as WI-FI, Bluetooth, infrared communication, and Zigbee.

The wearable device side sensor unit 1120 includes an acceleration sensor 1122, a gyro sensor 1124, a geomagnetic sensor 1126, and a 6-axis or 9-axis motion recognition complex sensor 1128 combining two or more of them The first motion information such as the motion acceleration, the rotational angular velocity, the velocity, and the azimuth on the motion axis of the head, the hand, or the body of the wearer wearing the wearable device 1100 is sensed and the motion direction, angle, , And outputs a first motion signal of the head, limb, or trunk for rotation and jumping.

The wearable device-side power source unit 1130 is supplied with its own power source, such as a battery.

The wearable device side speaker 1140 receives electrical voice and sound signals from the game device side communication unit 1310 in the game device 1300 via a wireless communication method, processes the data, and outputs voice and sound.

The game machine controller (1200)

The controller side sensor unit 1220 is connected to the game machine controller 1220 by an acceleration sensor 1262, a gyro sensor 1264, a geomagnetic sensor 1266 and a 6-axis or 9- Speed, intensity, rotation, and jumping on the motion axis by detecting second motion information such as the motion acceleration, the rotational angular velocity, the velocity, and the orientation on the motion axis of the user's hand having the motion controller 1200 And outputs the second motion signal.

The controller-side power supply unit 1280 is supplied with power by itself such as a battery.

The controller-side communication unit 1210 interfaces transmission / reception of the second motion signal with the game machine 1300 through a wireless communication technology such as WI-FI, Bluetooth, infrared communication, or ZigBee.

The game machine (1300)

The game device side communication unit 1310 interfaces transmission and reception of the first and second motion signals with the wearable device 1100 and the game device controller 1200 through wireless communication technologies such as Bluetooth, RFID, Zigbee, 3G, 4G, and 5G .

It also interfaces with the server-side communication unit 520, which will be described later, to transmit and receive contents and various database data.

The control unit 1350 receives the first and second motion signals from the game device side communication unit 1310 and displays the motion of the user wearing the wearable device 1100, , The motion data on the first and second motion information such as the motion acceleration on the motion axis of the hand or foot portion and the hand portion, the rotational angular velocity, the velocity, and the azimuth are calculated.

The rhythm game program unit 1360 compares the calculated operation data with the rhythm data of the reference dance motion data or sound source stored in the content unit 1362 at predetermined time intervals or at regular intervals according to the game mode, And stores the calculated unit score in the game data storage unit 1366.

The audio signal processing unit 1340 receives the rhythm game content data downloaded in advance and stored in the content unit 1362 or reproduced in an online streaming manner, processes the processed rhythm game content data into voice and sound data, and outputs the processed voice and sound.

The camera 1320 captures a real-time moving picture of the user's motion.

The game machine side display unit 1390 displays a moving image of the avatar selected by the user or the camera 1320 in real time on the screen according to the movement of the user and controls the rhythm game program unit 1360 and the audio signal processing unit 1340 The information to be processed, that is, the calculated unit score, the game score obtained by adding the scores, and the multimedia sound source reproduction status are displayed on the screen.

At this time, the screen is divided and the video of the reference motion data avatar is also displayed together.

In the server 500,

The server side communication unit 520 transmits the rhythm game contents stored in the content processing unit 540 to the game machine 1300 via the wired communication or wireless communication such as Bluetooth, RFID, Zigbee, 3G, 4G, Interfaces the transmission and reception of various stored DB data.

The content processing unit 540 processes rhythm game contents.

The database unit 560 includes a user DB 562 for user information, a content DB 564 for multimedia sound sources and rhythm game contents, a determination DB 566 for unit score calculation, and a billing DB (568).

Display device (1400)

The display device side communication unit 1440 is connected to the avatar video selected by the user from the game device 1300 via the wired communication or the video data captured in real time from the camera 1320 and the video data from the rhythm game program 1360 and the audio signal processing unit 1340 It interfaces the sending and receiving of information to be processed.

The multimedia processing unit 1460 receives the rhythm game contents that have been downloaded in advance and stored or reproduced in an online streaming manner, and processes the processed rhythm game contents as video data, audio data, and sound data.

The display device side display section 1390 displays the video data processed by the multimedia processing section 1460, the avatar video selected by the user or the video shot in real time from the camera 1320 on the screen in accordance with the movement of the user, The calculated unit score, the game score obtained by adding the score, and the reproduction status of the multimedia sound source are displayed on the screen.

The display device side speaker 1420 receives the voice and sound data processed by the multimedia processing unit 1460, processes the data, and outputs voice and sound.

8 is a flowchart showing a method of recognizing an operation of a rhythm game apparatus in association with a user operation according to the third embodiment of the present invention, as in the second embodiment.

In the rhythm game designating method of the third embodiment of the present invention, the score table to be evaluated in the case of the rhythm motion designating mode is the same as in the first and second embodiments, 5 as in the first and second embodiments.

Referring to FIGS. 4, 5, and 8 to 10, a method of recognizing an operation of a rhythm game apparatus in association with a user operation according to a third embodiment of the present invention will be described with reference to specific examples.

First, it is assumed that the wearer wears the wearable device 1100 on the head, the limbs or the body part, selects the avatar movie mode with the game controller 1200 in his / her hand, and plays the rhythm game for a predetermined time.

When the avatar movie mode, the sound source, the game mode, and the game level are selected through the menu displayed on the game device display unit 1390 in the game device (S201, S202), the control unit 1350 executes the multimedia sound source (S208).

The audio signal processing unit 1340 in the game device receives and reproduces the multimedia sound source from the content unit 1362 of the rhythm game program unit 1360 and the game device display unit 1390 displays the moving image of the reference motion data avatar in the 2D or 3D form .

The user hears a multimedia sound source reproduced through the wearable device-side speaker 1140 in the wearable device and starts a dancing operation while watching a moving image of the reference motion data avatar displayed on the game device display unit 1390 (S209).

At this time, the camera 1320 in the game machine captures a real-time moving picture of the movement of the user.

The wearable device-side sensor portion 1120 and the controller-side sensor portion 1220 are respectively disposed on the first and second sides of the user's head, hand or foot portion and the hand portion such as the operation acceleration, the rotational angular velocity, The motion information is sensed (S210) and the first and second motion signals of the head, hand or foot and trunk are output (S211).

The control unit 1350 receives the first and second motion signals of the head, the hand or foot and the hand and receives the motion signals of the head, The motion data for the first and second motion information are calculated (S212).

The rhythm game program unit 1360 determines whether the game mode selected in step S202 is the rhythm motion specifying mode (S213). If the game mode is the rhythm motion specifying mode, the calculated rhythm game program unit 1360 compares the calculated motion data with the previously stored reference dance motion data The consistency and similarity are evaluated for a predetermined time (S216), the unit score is calculated and stored in the game data storage unit 1366 (S217).

4, the degree of consistency or similarity of motion is divided into "good", "normal" and "bad", and the scores of "10 points", "5 points", "2 points" Point "to calculate.

If the game mode selected in step S213 is a rhythm motion free mode other than the rhythm motion specifying mode, the rhythm game program unit 1360 stores beat data, meter data, melody data, (S214), the unit score is calculated and stored in the game data storage unit 1366 (S215).

5, the degree of rhythm of the user's action is divided into "good", "normal", and "bad" (S217).

The control unit 1350 calculates the game score by summing up the unit scores calculated for the predetermined time in step S215 or S217 (S218).

The control unit 1350 confirms whether to continue the game through the game device display unit 1390 (S222).

If it is confirmed that the user will continue the game, the process returns to step S210 and the operation is repeated. If the user is determined not to continue the game, the game score is stored in the game data storage unit 1366 (S223).

As described above, the rhythm game device linked to the user's operation of the present invention can be realized by wearing or holding various types of wearable devices having one or a plurality of sensors, a portable terminal, a karaoke microphone, a game machine controller or a smart TV remote controller Provided is a rhythm game device in which sensor data is fused to evaluate a rhythm feeling of a user's action to evaluate consistency or similarity with a reference dance motion based on a user's action, and to enjoy a rhythm game.

Thus, it is possible to enjoy the rhythm feeling and the dance feeling by variously expressing while viewing the screen on which the user's actual operation is displayed without restraint of the hands and feet, to miniaturize the installation space of the game apparatus, and to reduce power consumption and production cost.

Although the preferred embodiments of the present invention have been described above, the present invention is not limited to the specific embodiments described above. It will be apparent to those skilled in the art that various modifications and variations can be made in the present invention without departing from the spirit or scope of the invention as defined in the following claims And equivalents of such modifications and variations are to be considered within the scope of the present invention.

100: First wearing device
200: second wearing device
300: portable terminal
400: Display device
500: Server
900: Social network system

Claims (22)

A gyro sensor 124 or 224, a geomagnetic sensor 126 or 226, and a 6-axis or 9-axis sensor that is a combination of two or more of these sensors. A first sensor unit 120 and a second sensor unit 220 each having one or a plurality of sensors of the motion recognizing composite sensors 128 and 228 and the first and second body parts Velocity, intensity, rotation, and jumping on the motion axis by detecting first and second motion information, respectively, including motion acceleration, angular velocity, velocity, and azimuth on the motion axis of the motion axis And first and second wearable devices (100, 200) for outputting a first motion and a second motion signal of a body part, respectively, and
A terminal side communication unit (310) for interfacing transmission and reception of the first and second motion signals of the hand, foot or head of the first or second wearer (100, 200) through wired or wireless communication;
Velocity, direction, and velocity of the third body part with respect to the movement direction, angle, velocity, intensity, rotation, and jumping on the operation axis by sensing third motion information that is an operation acceleration, a rotational angular velocity, A terminal side sensor 320 for outputting a third motion signal;
And receives the first and second motion signals from the terminal-side communication unit 310 and receives the third motion signals from the terminal-side sensor unit 320 to perform operations for the first, second, and third motion information, A control unit 350 for calculating data;
The calculated operation data is compared with the reference dance motion data or the rhythm data of the sound source stored in the content unit 362 for a predetermined period of time or a predetermined period according to the selected game mode, and the game determination unit 364 evaluates the consistency and similarity A rhythm game application unit 360 for calculating a unit score and storing the unit score in a game data storage unit 366;
The rhythm game contents data downloaded in advance in the content unit 362 or reproduced in an online streaming manner is received from the rhythm game application unit 360 and processed as voice and sound data to output as an audio signal, (340); And
A video of the avatar selected in the game mode or a real time photographed moving picture of the user is displayed on the screen in accordance with the operation data of the user and the calculated unit of the unit processed by the rhythm game application unit 360 and the audio signal processing unit 340 And a terminal display unit 390 for displaying the score, the game score obtained by summing up the scores, and the reproduction state of the sound source on the screen, and
A display device side communication section (440) for interfacing with the terminal side communication section (310) for transmission and reception of the operation data calculated from the control section (350) of the portable terminal (300) via wired or wireless communication;
A multimedia processor 460 for accepting rhythm game contents that are downloaded in advance and stored or reproduced in an online streaming manner, processing the processed rhythm game contents as video data, voice and sound data, and outputting the processed video data;
The video data processed by the multimedia processing unit 460 is received, the moving image of the reference dance motion data avatar is displayed according to the selected game mode, the screen is divided and the moving image of the avatar selected by the user, And a display device side display part (480) for displaying the display device side display device (480) according to the operation data or according to the movement of the competitive user on the screen, and
A content processing unit 540 for processing the rhythm game contents;
A user DB 562 for user information, a database 560 for storing the multimedia sound source and the content DB 564 for rhythm game contents, And
A server side communication unit 520 for interfacing the transmission and reception of the rhythm game contents previously stored in the contents processing unit 540 and the data stored in the database unit 560 to the portable terminal 300 via wired or wireless communication Further comprising: a server (500)
A rhythm game device linked to a user's action.
The method according to claim 1,
The rhythm game application unit 360,
When the game mode is the rhythm motion specifying mode, comparing the calculated operation data with the previously stored reference dance motion data, and evaluating the consistency for a predetermined period of time.
A rhythm game device linked to a user's action.
The method according to claim 1,
The rhythm game application unit 360,
If the game mode is the rhythm motion free mode, the rhythm feeling is evaluated for a predetermined time according to at least one of a beat, a meter, a melody, and a tempo in the calculated operation data ≪ / RTI >
A rhythm game device linked to a user's action.
The method according to claim 1,
The portable terminal 300 is configured to detect the movement of the portable terminal 300 from the acceleration sensor 322, the gyro sensor 324, the geomagnetic sensor 326 and a 6-axis or 9- The third motion information on the motion axis of the third body part of the user holding the terminal 300, which is the motion acceleration, the rotational angular velocity, the velocity, and the orientation, and detects the third motion information on the movement axis, Further comprising a terminal side sensor unit (320) for outputting a third motion signal of a body part having the portable terminal (300)
A rhythm game device linked to a user's action.
The method according to claim 1,
The display device (400) further includes a camera (420) for photographing the real-time moving picture with respect to the movement of the user,
The display unit 480 further displays a moving image photographed by the camera 420 in real time,
A rhythm game device linked to a user's action.
The method according to claim 1,
The first wearable device is in the form of an earphone or headphone,
Characterized in that the second wearable device is in the form of a clip or a band,
A rhythm game device linked to a user's action.
The method according to claim 1,
The rhythm game application unit 360,
Receives the rhythm game contents, directly processes the voice and sound data when the mode is not the social network system mode,
If the user is in the social network system mode, judges whether the SNS friend is invited, and if the user is invited, selects the SNS friend and accepts the invitation, and then processes the voice and sound data.
A rhythm game device linked to a user's action.
The method according to claim 1,
The terminal side display unit 390 displays,
And when the selected game mode is the competition mode or the cooperative mode, the video of the competition or cooperative user is displayed together.
A rhythm game device linked to a user's action.
A rhythm game method using a rhythm game device in association with a user operation according to claim 1,
(a) selecting (S101, S102) an avatar movie mode, a sound source, a game mode, and a game level through a menu displayed on the terminal side display unit 390;
(b) determining whether the game mode selected by the controller 350 is a social network system mode for a personal use, a charging mode, or a cooperative mode (S103);
(c) If the selected game mode is not for a match or is not a social network system mode, the multimedia sound source is immediately executed (S108). If the selected game mode is the social network system mode, (S105), accepting the invitation and executing the match or cooperative mode (S107), and executing the multimedia sound source (S108);
(d) a speaker 140 in the first wearable device 100 receives and reproduces a multimedia sound source from the portable terminal 300, and the display device-side display unit 480 displays an avatar video of the reference motion data Displaying in 2D or 3D form;
(e) The first or second sensor unit 120, 220, and the terminal-side sensor unit 320 detect the movement acceleration, the angular velocity, the velocity, and the angular velocity on the motion axes of the first, (S111) of outputting first, second, and third motion signals for the first, second, and third body parts by sensing first, second, and third motion information (S110);
(f) The controller 350 receives the first, second, and third motion signals to calculate the motion acceleration, the rotational angular velocity, the velocity, and the azimuth of the user on the operation axis of the first, second, and third body parts (S112) the motion data for the first, second, and third motion information;
(g) The rhythm game application unit 360 determines whether the game mode selected in the step (a) is the rhythm motion specifying mode (S113). If the rhythm motion specifying mode is selected, the calculated operation data is stored (S116), the unit score is calculated according to a preset reference and stored in the game data storage unit 366 (S117). If the selected game mode is rhythm In the case of the rhythm motion free mode other than the motion specifying mode, the rhythm sensation of the user's action is evaluated for a predetermined time according to a predetermined reference different from the predetermined reference (S114) (S115) of storing it in the storage unit 366;
(h) a step S118 in which the controller 350 calculates a game score by summing up all the unit scores calculated for a predetermined time in the step (g);
(i) The controller 350 determines whether the user has posted the social network system (S119). If it is determined that the user has not posted the social network system, the controller 350 determines whether the user has posted the social network system (S122). If it is determined that the user has posted the social network system, the SNS group or friend is selected (S120) and the selected SNS group or friend is allowed to play a game After transmitting the data (S121), it is confirmed whether or not the game is to be continued to the user (S122). If it is confirmed that the user continues the game, the operation is returned to the step (a) And storing the game data in the game data storage unit 366 (S123) if it is confirmed that the game data is not to be continued ,
A rhythm game method linked with user action.
(640) of the acceleration sensor 622, the gyro sensor 624, the geomagnetic sensor 626, and a 6-axis or 9-axis motion recognition compound sensor 628 combining two or more of them Type device side sensor 620 and detects first motion information including an operation acceleration, a rotational angular velocity, a velocity, and a bearing on the motion axis of the first body part of the wearer wearing the same, A wearable device (600) for outputting a first motion signal of the first body part for velocity, intensity, rotation and jumping; And
Velocity, intensity, rotation, and jumping on the motion axis by detecting the second motion information including the motion acceleration, the rotational angular velocity, the velocity, and the orientation on the motion axis of the user's second body part, And a sound source input unit 740 for outputting the second motion signals of the body part and converting the sound and sound of the user into voice and sound signals, respectively, and a karaoke microphone 700,
A karaoke device side communication unit 810 for interfacing the transmission and reception of the first and second motion signals of the wearable device 600 and the karaoke microphone 700 via wired or wireless communication technology;
A control unit 850 receiving the first and second motion signals from the karaoke device side communication unit 810 and calculating operation data for the first and second motion signals;
The calculated operation data is compared with the reference dance motion data or the rhythm data of the sound source stored in the contents unit 862 at predetermined time intervals or periodically in accordance with the selected game mode, and the game determination unit 864 evaluates the consistency and similarity A rhythm game program unit 860 for calculating a unit score and storing the score in a game data storage unit 866;
An audio signal processor 840 for receiving voice and sound of a user from the sound source input unit 740 through wired or wireless communication and processing the processed voice and sound data to output an audio signal;
A speaker 820 for receiving the rhythm game contents downloaded in advance and stored in the contents unit 862 or reproduced in an online streaming manner, processing the processed rhythm game contents as sound and sound, and outputting the processed rhythm game contents; And
The video of the avatar selected in the game mode or the real time photographed video of the user is displayed on the screen in accordance with the movement of the user and the calculated unit score processed by the rhythm game program unit 860 and the audio signal processor 840, And a display unit 890 for displaying a game score obtained by adding the game score and a reproduction state of the sound source on the screen,
A content processing unit 540 for processing the rhythm game contents;
A user DB 562 for user information, a content DB 564 for the sound source and the rhythm game contents, a determination DB 566 for unit score calculation, and a billing DB 568 for usage fees according to usage time A database unit 560; And
A server side communication unit 520 for interfacing the transmission and reception of the rhythm game contents previously stored in the contents processing unit 540 and the data stored in the database unit 560 to the karaoke system 800 through wired or wireless communication; And a server (500)
A rhythm game device linked to a user's action.
11. The method of claim 10,
The rhythm game program unit 860,
When the game mode is the rhythm motion specifying mode, compares the calculated motion data with previously stored reference dance motion data, and evaluates the consistency for a predetermined period of time.
A rhythm game device linked to a user's action.
11. The method of claim 10,
The rhythm game program unit 860,
If the game mode is the rhythm motion free mode, the rhythm feeling is evaluated for a predetermined time according to at least one of a beat, a meter, a melody, and a tempo in the calculated operation data ≪ / RTI >
A rhythm game device linked to a user's action.
11. The method of claim 10,
The karaoke device 800 further includes a camera 830 for photographing the real-time photographic moving picture with respect to the movement of the user,
The display unit 890 displays the moving image photographed in real time,
A rhythm game device linked to a user's action.
14. The method of claim 13,
The karaoke microphone 700 includes:
And one or a plurality of sensors of an acceleration sensor 762, a gyro sensor 764, a geomagnetic sensor 766 and a 6-axis or 9-axis motion recognition combined sensor 768 combining two or more of them,
Speed, strength, rotation on the operation axis, and the like, by sensing the second motion information, which is the operation acceleration, the rotational angular velocity, the velocity, and the orientation on the operation axis of the second body part of the user having the karaoke microphone 700, And a microphone side sensor unit (760) for outputting a second motion signal of the second body part having the karaoke microphone (700) for jumping,
A rhythm game device linked to a user's action.
11. The method of claim 10,
The wearable device (600)
An earphone, a headphone, a clip, and a band.
A rhythm game device linked to a user's action.
11. The method of claim 10,
The user's video
A video of the avatar selected by the user, or the video of the avatar selected by the user.
A rhythm game device linked to a user's action.
A rhythm game method using a rhythm game apparatus in association with a user operation according to claim 14,
(a) selecting (S201, S202) an avatar movie mode, a sound source, a game mode, and a game level through the menu displayed on the display unit 890;
(b) executing the multimedia sound source by the controller 850 (S208);
(c) the speaker 820 receives and reproduces the sound source from the contents unit 862, and the display unit 890 displays the moving picture of the reference motion data avatar in 2D or 3D form;
(d) capturing a real-time moving picture of the user's movement by the camera 830;
(e) the wearable device-side sensor portion 620 and the microphone-side sensor portion 760 are disposed on the first and second body portions, respectively, of the first and second body portions, Detecting the second motion information (S210) and outputting first and second motion signals of the first and second body parts (S211);
(f) The controller 850 receives the first and second motion signals of the first and second body parts and receives the first and second motion signals of the first and second body parts, respectively, based on the motion acceleration, the rotational angular velocity, Calculating operation data for the first and second motion information (S212);
(g) The rhythm game program unit 860 determines whether the game mode selected in the step (a) is a rhythm motion specifying mode (S213). If the rhythm motion specifying mode is selected, the rhythm game program unit 860 stores the calculated motion data (S216), the unit score is calculated in accordance with a preset reference, and stored in the game data storage unit 866 (S217). If the selected game mode is the rhythm motion If the rhythm motion free mode is not the designated mode, the rhythm game program unit 860 evaluates the rhythm of the user's operation for a predetermined period of time according to a predetermined reference, which is different from the predetermined reference, at step S214, Calculating a unit score and storing it in the game data storage unit 866 (S215);
(h) the control unit 850 calculates a game score by summing up all the unit scores calculated for a predetermined time in the step (g) (S218); And
(i) The control unit 850 confirms whether or not to continue the game through the display unit 890 (S222). If the user is determined to continue the game, the control unit 850 feeds back to the step (e) And storing the game score in the game data storage unit 866 (S223) if it is determined that the user does not continue the game.
A rhythm game method linked with user action.
A sensor for detecting one or more of a six-axis or nine-axis motion recognition complex sensor 1128 combining two or more of these sensors, an acceleration sensor 1122, a gyro sensor 1124, a geomagnetic sensor 1126, And a wearable device side sensor unit 1120. The wearable device side sensor unit 1120 senses the first motion information including the motion acceleration, the rotational angular velocity, the velocity, and the bearing on the motion axis of the first body part of the wearer, A wearable device (1100) for outputting a first motion signal of the first body part for direction, angle, velocity, intensity, rotation and jumping, respectively; And
A sensor for detecting a motion of the vehicle, and a sensor for detecting a motion of the vehicle, including one or more sensors of an acceleration sensor 1262, a gyro sensor 1264, a geomagnetic sensor 1266 and a 6-axis or 9- The controller side sensor unit 1220 detects the second motion information including the motion acceleration, the rotational angular velocity, the velocity, and the orientation on the motion axis of the user's second body part wearing the controller side motion sensor 1220, And a game machine controller 1200 for outputting a second motion signal of the second body part with respect to angle, velocity, intensity, rotation, and jumping, respectively,
A game machine side communication unit (1310) for interfacing transmission and reception of the first and second motion signals of the wearable device (1100) and the game machine controller (1200) through wired or wireless communication technology;
A control unit 1350 receiving the first and second motion signals from the game device side communication unit 1310 and calculating operation data for the first and second motion signals;
The calculated operation data is compared with the reference dance motion data or the rhythm data of the sound source stored in the content unit 1362 at predetermined time intervals or at regular intervals according to the selected game mode, and the game determination unit 1364 evaluates the consistency and similarity A rhythm game program unit 1360 for calculating a unit score and storing the unit score in a game data storage unit 1366;
An audio signal processing unit 1340 for receiving rhythm game content data downloaded in advance in the content unit 1362 or being reproduced in an online streaming manner and processing the processed rhythm game content data as voice and sound data and outputting the processed data as an audio signal, ;
A camera 1320 for capturing a real-time moving picture of the movement of the user;
The video of the avatar selected in the game mode or the real time photographed moving image photographed by the camera 1320 is displayed on the screen according to the movement of the user and the rhythm game program 1360 and the audio signal processor 1340 process A game main body 1300 including a game machine side display unit 1390 for displaying the calculated unit scores, the game score obtained by adding up the score, and the reproduction status of the sound source on the screen, and
A multimedia processing unit 1460 for accepting rhythm game contents previously downloaded and stored in advance or being reproduced in an online streaming manner, processing the processed rhythm game contents as video data, voice and sound data, and outputting the processed video data;
The video data of the selected avatar or the video data photographed in real time from the camera 1320 and the video data of the selected rhythm game program 1360 and the audio signal processor 1340 are transmitted from the control unit 1350 of the game main body 1300 via wired or wireless communication, A display device side communication section 1440 for interfacing transmission and reception of information processed in the display device side communication section 1440;
The video data of the reference motion data avatar is displayed according to the selected game mode, and the video of the avatar selected by the user or the opponent user, And displays the calculated unit scores processed by the rhythm game program unit 1360 and the audio signal processor 1340, a game score obtained by summing the calculated score points, and a score of the sound source And a display device side display part (1480) for displaying the status of the display device (1400) on the screen.
A content processing unit 540 for processing the rhythm game contents;
A user DB 562 for user information, a content DB 564 for the sound source and the rhythm game contents, a determination DB 566 for unit score calculation, and a billing DB 568 for usage fees according to usage time A database unit 560;
A server-side communication unit 520 for interfacing the transmission / reception of data previously stored in the database unit 560 and the rhythm game contents previously stored in the content processing unit 540 to the game main body 1300 through wired or wireless communication; And a server (500)
A rhythm game device linked to a user's action.
19. The method of claim 18,
The rhythm game program unit 1360,
When the game mode is the rhythm motion specifying mode, compares the calculated motion data with previously stored reference dance motion data, and evaluates the consistency for a predetermined period of time.
A rhythm game device linked to a user's action.
19. The method of claim 18,
The rhythm game program unit 1360,
If the game mode is the rhythm motion free mode, the rhythm feeling is evaluated for a predetermined time according to at least one of a beat, a meter, a melody, and a tempo in the calculated operation data ≪ / RTI >
A rhythm game device linked to a user's action.
19. The method of claim 18,
The wearable device (1100)
A clip type, and a band type.
A rhythm game device linked to a user's action.
19. The method of claim 18,
The game main body 1300 is a game machine or a smart TV,
Wherein the controller (1200) is a game machine controller when the game main body (1300) is a game machine and is a remote controller when the game main body (1300) is a smart TV.
A rhythm game device linked to a user's action.

Images