CN105813702A - Rhythm game device linked with user movements - Google Patents

Rhythm game device linked with user movements Download PDF

Info

Publication number
CN105813702A
CN105813702A CN201480067745.8A CN201480067745A CN105813702A CN 105813702 A CN105813702 A CN 105813702A CN 201480067745 A CN201480067745 A CN 201480067745A CN 105813702 A CN105813702 A CN 105813702A
Authority
CN
China
Prior art keywords
action
unit
game
rhythmic
rhythmic game
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201480067745.8A
Other languages
Chinese (zh)
Inventor
徐仁儿
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Individual
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Publication of CN105813702A publication Critical patent/CN105813702A/en
Pending legal-status Critical Current

Links

Classifications

    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/20Input arrangements for video game devices
    • A63F13/21Input arrangements for video game devices characterised by their sensors, purposes or types
    • A63F13/212Input arrangements for video game devices characterised by their sensors, purposes or types using sensors worn by the player, e.g. for measuring heart beat or leg activity
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/80Special adaptations for executing a specific game genre or game mode
    • A63F13/814Musical performances, e.g. by evaluating the player's ability to follow a notation

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Human Computer Interaction (AREA)
  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Biophysics (AREA)
  • Cardiology (AREA)
  • General Health & Medical Sciences (AREA)
  • Heart & Thoracic Surgery (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The present invention discloses a rhythm game device linked with a user's movements. The device comprises: a first and second wearable device worn on a first and second body part, detecting a user's movements, and outputting a first and second movement signal, respectively; and a portable terminal carried on a third body part, detecting the movements of the user, and generating a third movement signal. The portable terminal includes a control unit and a rhythm game application unit. The control unit receives the detected first and third movement signals or the second and third movement signals and generates movement data. The rhythm game application unit receives the generated movement data, evaluates the suitability or sense of rhythm of the user's movements according to the game mode, and outputs a game score. Thus, according to the present invention, a user can view his/her actual movements displayed on a screen and enjoy a sense of rhythm and dance through a diverse range of expression without having his/her hands and feet constrained. The rhythm game device is miniaturized so as not to put restrictions on where the game device can be installed, and has reduced power consumption and manufacturing cost.

Description

Rhythmic game device with user action linkage
Technical field
The present invention relates to a kind of Rhythmic game device, and particularly to a kind of and user action linkage Rhythmic game device, wherein, when user wears or carries at least one in various types of wearable devices and portable terminal, microphone of carok, Intelligent TV remote controller and gaming devices controller with one or more sensor and carry out dance movement, described Rhythmic game device calculates game point by assessing user action with the matching degree of benchmark dance movement or the sense of rhythm of user action.
Background technology
Along with the expansion of casino market, existing various game machines list in a large number, and therefore, the demand of more novel and sound game is gradually increased by user.
In recent years on the market, the popularity of the dancing simulation game device that can simultaneously enjoy brisk music and dancing rises, compared with conventional static amusement game, because of brisk music and great-hearted dancing, it is rather excellent as the game station being used for reducing pressure and losing weight.
A lot of game station manufacturers are issuing the dancing simulation game devices such as DANCE DANCE REVOLUTION (DDR), Pump, rhythm & dancing, Rulurala and dance step machine (SteppingStage), and the popularity of teenager and player is increased severely by these.
But, described dance game equipment is configured to need user to set foot on forward and backward, the region, left and right of pedal according to the direction of the arrow shown on the screen of a display.
These tradition dance game equipment are configured to the pedal needing user to set foot on base surface by display while the display content that viewing is exported, therefore each joint (knee of such as player) may be caused overload, and the volume owing to having the base plate body of pedal makes relatively greatly the installation of dance game equipment be subject to space restriction.
Especially, owing to base plate body needs configuration can the stand foot multiple switches marked time while can responding sensitively to need to be arranged on base plate body, there is the shortcoming causing the holistic cost of described dance game equipment to increase, and can play owing to being configured to centered by basal surface (i.e. described pedal), so almost all of player only moves the position of both feet to this game of playing, and almost without the movement of hands.
These technology include making sensor detection unit mechanically to identify the action of user, and use and show the role representing user in gaming or present the graphic element of operation of player, but the true appearance of player will not be shown on screen.
As mentioned above, almost all of tradition dance game equipment is so similar, so that compared with the traditional dance game equipment relatively early gone public, the dance game equipment listed later cannot give user's feeling of freshness, user is made quickly to arrive in the limitation be weary of and dislike thus existing.
Meanwhile, except voice call function, MMS function, SMS function, the such as smart machine such as smart mobile phone and panel computer also performs additional function by using various application and internal sensor.
Such as, the function of data sending function, Internal retrieval function, shooting playing pictures or video, the function playing music and multimedia file and other various application programs can be performed.
Additionally, it is provided that various expanded functions, including the actual Rhythmic game linked with the acceleration transducer being attached in intelligent apparatus, gyro sensor, geomagnetic sensor and action recognition sensor.
Along with the low-power of these multiple sensors and the combination technique of miniaturization technology or various sensor development, for equipment being worn the progress of wearable computer technology on user's body or human-computer interaction technology, carry out about the research of multiple external equipment product is active.
Therefore, the present inventor designs a kind of Rhythmic game device, described Rhythmic game device has been broken away from and has been used traditional foot pedal pad of pressure transducer, action recognition image mechanism, has been fixedly installed the input of mode or utilizes the game input method of touch manner of simple screen so that user can pass through the external equipment of the sensor by including miniaturization and low-power consumption wear or carry on health, in the free situation of trick, show different actions while enjoy sense of rhythm and dance is felt.
Summary of the invention
Technical problem
Present invention aim at providing a kind of and user action linkage Rhythmic game device, wherein, after user wears or carries at least one in all kinds wearable device and portable terminal, microphone of carok, Intelligent TV remote controller and gaming devices controller that are provided with one or more sensor, described Rhythmic game device assesses the matching degree between user action and benchmark dance movement or similarity degree and the sense of rhythm of assessment user action by integrating sensing data, enables a user to enjoy Rhythmic game.
Technical scheme
In view of above-mentioned purpose, including according to the Rhythmic game device that a kind of of the present invention and user action link: the first wearable device or the second wearable device, it detects the action of described user by being worn on first body part of described user or the second body part and exports the first actuating signal and the second actuating signal respectively;And portable terminal, it detects the action of described user by being carried by the 3rd body part of described user and generates the 3rd actuating signal, wherein, described portable terminal includes control unit and Rhythmic game application program unit, described control unit is by receiving the first detected actuating signal and the 3rd actuating signal, or generate action data by receiving the second detected actuating signal and the 3rd actuating signal, and described Rhythmic game application program unit is by receiving the action data generated and assessing the matching degree of action of described user according to game mode or sense of rhythm exports game point.
In view of above-mentioned purpose, include according to the Rhythmic game device that a kind of of the present invention and user action link: wearable device, it is by being worn on the action detecting described user on first body part of described user and exporting the first actuating signal;Microphone of carok, it is by being carried, by second body part of described user, the action detecting described user and exporting the second actuating signal;And karaoke equipment, it comes playing image data and voice data by receiving Rhythmic game content from the Rhythmic game program being installed on himself, and by dividing the screen action display video for described user, wherein said karaoke equipment includes control unit and Rhythmic game program unit, described control unit generates action data by receiving the first detected actuating signal and the second actuating signal, and described Rhythmic game program unit is by receiving the action data generated and assessing the matching degree of action of described user according to game mode or sense of rhythm exports game point.
In view of above-mentioned purpose, according to the Rhythmic game device that a kind of of the present invention links with user action, described Rhythmic game device includes: wearable device, and it detects the action of described user by being worn on and export the first actuating signal on first body part of described user;Controller, it detects the action of described user by being carried by second body part of described user and exports the second actuating signal;With game body, it comes playing image data and voice data by receiving Rhythmic game content from the Rhythmic game program being installed on himself, and by dividing the screen action display video for described user, wherein said game body includes control unit and Rhythmic game program unit, described control unit generates action data by receiving the first detected actuating signal and the second actuating signal, and described Rhythmic game program unit is by receiving the action data generated and assessing the matching degree of action of described user according to game mode or sense of rhythm exports game point.
Beneficial effect
According to the present invention, user can show the free different actions of trick while watching the screen of the actual act showing user and enjoy sense of rhythm and dance feeling.
And, described Rhythmic game device is miniaturized with the installing space without limitation on game device, and reduces power consumption and manufacturing cost.
Accompanying drawing explanation
Fig. 1 is the block diagram of the Rhythmic game device with user action linkage according to the present invention;
Fig. 2 is the detailed structure view of first sensor unit 120 as shown in Figure 1 and the second sensor unit 220;
Fig. 3 shows the flow chart of the action identification method of the Rhythmic game device with user action linkage according to first embodiment of the invention;
Fig. 4 be according to first embodiment of the invention with the score graph that is estimated under rhythm action designated mode in the Rhythmic game method of user action linkage;
Fig. 5 be according to first embodiment of the invention with the score graph that is estimated under rhythm action free schema in the Rhythmic game method of user action linkage;
Fig. 6 is the block diagram of the Rhythmic game device with user action linkage second embodiment of the invention;
Fig. 7 is the detailed structure view of wearable device side senser unit 620 as shown in Figure 6 and microphone side sensor unit 760;
Fig. 8 shows the flow chart of the action identification method of the Rhythmic game device with user action linkage according to second embodiment of the invention;
Fig. 9 is the block diagram of the Rhythmic game device with user action linkage of the 3rd embodiment according to the present invention;
Figure 10 is the detailed structure view of wearable device side senser unit 1120 as shown in Figure 9 and controller side senser unit 1220.
Detailed description of the invention
Below in conjunction with accompanying drawing, the Rhythmic game device with user action linkage according to the present invention is described.
Hereinafter, portable terminal refers to have the smart mobile phone of computer supported function (such as internet communication), personal digital assistant (PDA), portable media player (PMP) or Intelligent flat, display device refers to IPTV (IP-TV), intelligent television or panel computer, and content refers to the application program being used in portable terminal.
Fig. 1 is the block diagram of the Rhythmic game device with user action linkage according to first embodiment of the invention, it links with first carried device the 100, second wearable device 200 and portable terminal 300 that include sensor unit respectively, and shows the content provided by server 500 on display device 1400.
Fig. 2 is the detailed structure view of first sensor unit the 120, second sensor unit 220 as shown in Figure 1 and end side sensor unit 320, it includes selecting free acceleration transducer 122,222 and 322 respectively, gyro sensor 124,224 and 324, geomagnetic sensor 126,226 and 326, and it is combined with the one or more sensors in the group of plural six axles in the sensor or nine axle action recognition compound sensors 128,228 and 328 composition.
First wearable device 100 includes the first communication unit 110, first sensor unit the 120, first power subsystem 130 and speaker 140, and its form is have earphone or the head load telephone receiver of sound source transfer function, and second wearable device 200 include second communication unit the 210, second sensor unit 220 and second source unit 230, and its form is have the clip or band worn on the head of user, hands, foot or health.
Although will be described below user to wear the embodiment of the first wearable device 100 or the second wearable device 200, but also can speculate the situation that the first wearable device 100 is worn together with the second wearable device 200.
Portable terminal 300 includes end side communication unit 310, end side sensor unit 320, end side power subsystem 330, audio signal processing unit 340, control unit 350, Rhythmic game application program unit 360 and end side display unit 390, and described Rhythmic game application program unit 360 includes content element 362, game identifying unit 364 and game data memory element 366.
Display device 400 includes video camera 420, display device side communication unit 440, multi-media processing unit 460 and display device side display unit 480, server 500 includes Server-side communities unit 520, content processing unit 540 and Database Unit 560, and described Database Unit 560 includes customer data base 562, content data base 564, judges data base 566, and billing databases 568.
Reference Fig. 1 and Fig. 2 is described the function of each configuration with the Rhythmic game device of user action linkage according to first embodiment of the invention.
First wearable device 100 and the second wearable device 200
First sensor unit 120 is arranged so that acceleration transducer 122, gyro sensor 124, first action messages such as the head of the user of the first wearable device 100 acceleration on action axle, angular velocity of rotation, speed and orientation (bearing) are such as worn in one or more sensors detection in geomagnetic sensor 126 and plural six axles being combined with in the sensor or nine axle action recognition compound sensors 128, and for the first actuating signal of the moving direction on action axle, angle, speed, intensity, rotation and jump out-feed head.
Second sensor unit 220 is arranged so that acceleration transducer 222, gyro sensor 224, geomagnetic sensor 226 and plural six axles being combined with in the sensor or nine axle action recognition compound sensors 228 detect second action messages such as the head of the user such as wearing the second wearable device 200 acceleration on action axle, angular velocity of rotation, speed and orientation, and for the second actuating signal of the moving direction on action axle, angle, speed, intensity, rotation and jump out-feed head.
First communication unit 110 can pass through wireless communication technology (such as Wi-Fi, bluetooth, infrared communication or unlimited territory net (ZigBee)) or cable communicating technology (such as DSL mode or optical transport mode) joins the transmission/reception of the first actuating signal of head with portable terminal 300.
Second communication unit 210 can pass through transmission/reception that wireless communication technology (such as Wi-Fi, bluetooth, infrared communication or ZigBee) joins the second actuating signal of the wrist of user, ankle or head with portable terminal 300.
First power subsystem 130 and second source unit 230 use battery received by itself electric power.
Speaker 140 receives electronic speech/acoustical signal from portable terminal 300 by end side communication unit 310 in a wired fashion wirelessly or through audio signal processing unit 340, received electronic speech/acoustical signal is carried out data process, and exports voice or sound.
Portable terminal 300
End side communication unit 310 is by wireless communication technology (such as bluetooth, radio frequency identification (RFID), ZigBee, G mobile communication (3G), forth generation mobile communication technology (4G), or the 5th third-generation mobile communication technology (5G)) or cable communicating technology (such as digital subscriber line (DSL) or optical transport mode) join the hands wrist of the first wearable device 100 or the second wearable device 200, foot wrist, or the transmission/reception of the first actuating signal of head or the second actuating signal.
Additionally, end side communication unit 310 and display device side described later communication unit 440 join the transmission/reception of video data, and join the transmission/reception of content and each database data with Server-side communities unit 520.
End side sensor unit 320 is arranged so that acceleration transducer 322, gyro sensor 324, geomagnetic sensor 326 and plural six axles or the nine axle action recognition compound sensors 328 that are combined with in the sensor detect the part (such as hand or body) for the such as health of the user of taking portable terminal 300 acceleration on action axle, angular velocity of rotation, 3rd action message such as speed and orientation, and for the moving direction on action axle, angle, speed, intensity, 3rd actuating signal of the body part of rotation and the output taking portable terminal 300 that jumps.
Control unit 350 receives the hands wrist of user from end side communication unit 310, foot wrist, first actuating signal of head or ear or the second actuating signal, the 3rd actuating signal of the body part of the user of taking portable terminal 300 is received from end side sensor unit 320, and calculate the action behavior for user (such as, wear the hands wrist of the user of the first wearable device 100 or the second wearable device 200 taking portable terminal 300, foot wrist, or head and hand acceleration on action axle, angular velocity of rotation, first action message or the second action message and the 3rd action message such as speed and orientation) action data.
The cadence information of the above-mentioned action data and the benchmark dance movement data being stored in content element 362 or sound source that calculate is compared with regular hour section or with some cycles by Rhythmic game application program unit 360 according to game mode, and assess matching degree and similarity degree by identifying unit 364 of playing, thus unit of account mark, and unit fraction is stored in game data memory element 366.
Audio signal processing unit 340 receives the Rhythmic game content-data being downloaded and stored in content element 362 in advance or playing with online stream media mode, and described Rhythmic game content-data is processed into voice or voice data described voice or voice data to be exported as audio signal.
End side display unit 390 shows the video of the incarnation (avata) selected by user or the video of captured in real-time according to the action of user on screen, and on screen, show the information processed by Rhythmic game application program unit 360 and audio signal processing unit 340, namely, computed unit fraction, the game point by the addition of described unit fraction is obtained, and multimedia sound source broadcast state.
Then, screen is divided into the video so that showing reference actions data incarnation simultaneously, and is fighting to the finish or under collaboration mode, can show the video of the incarnation selected by the other user or the video of captured in real-time simultaneously.
Display device 400 and server 500
Transmission/the reception of the action data that display device side communication unit 440 is calculated by portable terminal 300 by radio communication (such as bluetooth, RFID, ZigBee, 3G, 4G or 5G) handing-over.
Multi-media processing unit 460 receives Rhythmic game content that is that download in advance or store or that play with online stream media mode, and described Rhythmic game contents processing becomes view data and speech data to export described view data and voice/sound data.
Video camera 420 shoots the real-time video of user action.
Display device side display unit 480 receives the view data by multi-media processing cell processing to show the video of reference actions data incarnation, and the action according to user shows the video of the incarnation selected by user in the screen divided or shows by the video of video camera 420 captured in real-time.In the pattern of fighting to the finish or collaboration mode, the other user the video of the incarnation selected or the video of captured in real-time can show simultaneously.
Server-side communities unit 520 is stored in advance in the Rhythmic game content in content processing unit 540 and the transmission/reception of various database datas being stored in advance in Database Unit 560 and the linkage with the social networking system 900 for the game under the pattern of fighting to the finish or collaboration mode by radio communication (such as bluetooth, RFID, ZigBee, 3G, 4G or 5G) and portable terminal 300 handing-over.
Content processing unit 540 processes Rhythmic game content.
Database Unit stores the customer data base 562 for user profile, the content data base 564 for multimedia sound source and Rhythmic game content, judges data base 566 and the billing databases 568 for the expense corresponding to the use time for what unit fraction calculated.
Fig. 3 illustrates the flow chart of the action identification method of the Rhythmic game device with user action linkage according to first embodiment of the invention.
Fig. 4 be according to first embodiment of the invention with the score graph that is estimated under rhythm action designated mode in the Rhythmic game method of user action linkage.
Fig. 5 be according to first embodiment of the invention with the score graph that is estimated under rhythm action free schema in the Rhythmic game method of user action linkage.
The action identification method with the Rhythmic game device of user action linkage according to first embodiment of the invention is described by specific embodiment below with reference to Fig. 1 and Fig. 5.
First, assume that user selects incarnation video mode and wears on user's head by the first wearable device 100 or the second wearable device 200 is worn on user's wrist and ankle, and when being carried in bottom pockets by portable terminal 300, carry out the Rhythmic game of predetermined amount of time.
If by the menu setecting incarnation video mode of display, sound source, game mode and game ratings (S101 and S102) on portable side display unit 390, control unit 350 determines whether this pattern is social networking system pattern (S103) of fighting to the finish or cooperate.
Wherein, under social networking system pattern of fighting to the finish or cooperate, another user of social networks group fight to the finish or cooperative action shows on the external device (ED) of the other side.
When this pattern is not social networking system pattern, directly perform multimedia sound source (S108), and when this pattern is social networking system pattern, determine whether to have invited SNS (social networking service) friend (S104), and when having invited friend SNS, select friend SNS (S105), perform to fight to the finish or collaboration mode (S107) after invitation is accepted, and perform multimedia sound source (S108).
Speaker 140 in first wearable device 100 receives multimedia sound source from portable terminal 300 and plays received multimedia sound source, and display device side display unit 480 shows the video of reference actions data incarnation with 2D or 3D form.
User listens to the multimedia sound source play by the speaker 140 in the first wearable device 100, and viewing on display device side display unit 480 video of the reference actions data incarnation of display start simultaneously at dancing action (S109).
First sensor unit 120 or the second sensor unit 220 and end side sensor unit 320 detect first action message in the head of such as user or wrist and ankle and the waist acceleration on action axle, angular velocity of rotation, speed and orientation or the second action message and the 3rd action message (S110) respectively, and export the first actuating signal of described head or wrist and ankle and waist or the second actuating signal and the 3rd actuating signal (S111).
Controller 350 receives the first actuating signal of described head or wrist and ankle and waist or the second actuating signal and the 3rd actuating signal and calculates action data (S112) for first action messages such as action acceleration on action axle of the head of such as user or wrist and ankle and waist, angular velocity of rotation, speed and orientation or the second action message and the 3rd action message.
Rhythmic game application program unit 360 determines whether game mode selected in step s 110 is rhythm action designated mode (S113), by computed action data being assessed compared with the benchmark dance movement data prestored under rhythm action designated mode matching degree and the similarity degree (S116) of predetermined amount of time, and unit of account mark, and computed unit fraction is stored in game data memory element 366 (S117).
Wherein, the calculating of unit fraction as shown in Figure 4, by matching degree and similarity degree being categorized as " very good ", " normally " or " poor " and being respectively allocated the unit fraction of " 10 point " " 5 point " " 2 point " and carry out unit of account mark.
If the game mode selected in step S113 is not rhythm action designated mode but rhythm action free schema, Rhythmic game application program unit 360 is by carrying out unit of account mark based on the sense of rhythm (S114) of the action data of described calculating the user action of assessing predetermined amount of time according to bat (beat), beat (meter), melody (melody) and speed (tempo), and is stored in game data memory element 366 (S115) by computed unit fraction.
Wherein, the calculating of unit fraction is as it is shown in figure 5, carry out unit of account mark (S117) by the sense of rhythm of user action is categorized as " very good ", " normally " or " poor " distribution with the unit fraction of " 10 point " " 5 point " " 2 point ".
Unit fraction computed within a predetermined period of time in step S115 or step S117 is added to calculate game point (S118) by control unit 350.
Control unit 350 determines whether user starts social networking system (S119).
When determining the not actuated social networking system of user, control unit 350 is directly confirmed whether to continue game (S122) by portable terminal 300 side display unit, and when determining that user starts social networking system, control unit 350 is selecting SNS group or friend (S120) and is sending such as game data (S121) rear line such as game point, rank and ranking be confirmed whether to continue game (S122) to SNS group or the friend of selection.
If it is confirmed that user to continue game, step is back to step S102 to repeat ensuing operation, and if it is confirmed that user will not continue game, is stored in by game data in game data memory element 366 (S123).
Fig. 6 is the block diagram of the Rhythmic game device with user action linkage second embodiment of the invention, this device links with the wearable device 600 and microphone of carok 700 that include sensor unit respectively, and utilizes the various contents provided by server 500 to display on karaoke equipment 800.
Fig. 7 is the detailed structure view of wearable device side senser unit 620 as shown in Figure 6 and microphone side sensor unit 760, the free acceleration transducer 662,762 of choosing is wherein installed, gyro sensor 624,764, geomagnetic sensor 626,766, and one or more in the group that constitutes of plural six axles being combined with in the sensor or nine axle action recognition compound sensors 628 and 768.
Although hereinafter by utilize the online real-time mode of server 500 to illustrate as an embodiment, but can also speculate that Rhythmic game software is arranged on karaoke equipment 800 using the offline mode as server 500.
Wearable device 600 includes wearable device side communication unit 610, wearable device side senser unit 620 and wearable device side power subsystem 630, and be the earphone worn on the head of user, hand, foot or body, head load telephone receiver, clamp type and any in band type.If wearable device 600 is earphone or head load telephone receiver, the first embodiment as shown in Figure 1, speaker can be additionally provided.
Microphone of carok 700 includes microphone side communication unit 720, sound source input block 740, microphone side sensor unit 760 and microphone side power subsystem 780.
Karaoke equipment 800 includes karaoke equipment side communication unit 810, speaker 820, video camera 830, audio signal processing unit 840, control unit 850, Rhythmic game program unit 860 and display unit 890, and described Rhythmic game program unit 860 includes content element 862, game identifying unit 864 and game data memory element 866.
Server 500 includes Server-side communities unit 520, content processing unit 540 and Database Unit 560, and described Database Unit 560 includes customer data base 562, content data base 564, judges data base 566 and billing databases 568.
The function of each configuration with the Rhythmic game device of user action linkage according to second embodiment of the invention is described below with reference to Fig. 6 and Fig. 7.
Wearable device 600
Wearable device side communication unit 610 can pass through wireless communication technology (such as Wi-Fi, bluetooth, infrared communication or ZigBee) and karaoke equipment 800 and join the transmission/reception of the first actuating signal.
Wearable device sensor unit 620 is arranged so that acceleration transducer 622, gyro sensor 624, geomagnetic sensor 626 and plural six axles being combined with in the sensor or nine axle action recognition compound sensors 628 detect the first action message such as wearing the wrist of user of wearable device 600, ankle or the head acceleration on action axle, angular velocity of rotation, speed and orientation, and exports the first actuating signal of wrist, ankle or head for the moving direction on action axle, angle, speed, intensity, rotation and jump.
Wearable device side power subsystem 630 uses battery received by itself electric power.
Microphone of carok 700
Microphone side sensor unit 760 is arranged so that acceleration transducer 762, gyro sensor 764, geomagnetic sensor 766 and plural six axles being combined with in the sensor or nine axle action recognition compound sensors 768 detect second action messages such as the hand of the user such as carrying mike 700 acceleration on action axle, angular velocity of rotation, speed and orientation, and export the second actuating signal of hand for the moving direction on action axle, angle, speed, intensity, rotation and jump.
Microphone side power subsystem 780 uses battery received by itself electric power.
Sound source input block 740 receives the voice/sound of user, the voice/sound of described user converts to voice/sound signal and sends described voice/sound signal to karaoke equipment 800.
Microphone side communication unit 720 can pass through wireless communication technology (such as Wi-Fi, bluetooth, infrared communication or ZigBee) and karaoke equipment 800 and join the transmission/reception of the second actuating signal.
Karaoke equipment 800
Karaoke equipment side communication unit 810 joins the transmission/reception of the first actuating signal and the second actuating signal by wireless communication technology (such as bluetooth, RFID, ZigBee, 3G, 4G or 5G) and wearable device 600 and microphone of carok 700.
Additionally, karaoke equipment side communication unit 810 and Server-side communities unit 520 described later join the transmission/reception of content and each database data.
Control unit 850 receives the first actuating signal and the second actuating signal from karaoke equipment side communication unit 810, and calculate for action behavior (such as, wear wearable device 600 and the wrist of user of microphone of carok 700, ankle or head, and hand be in the first action message and the second action messages such as the acceleration of action axle, angular velocity of rotation, speed and orientation) action data.
The cadence information of the action data of calculating with the benchmark dance movement data being stored in content element 862 or sound source is compared with predetermined amount of time or predetermined period by Rhythmic game program unit 860 according to game mode, and assess matching degree and similarity degree by identifying unit 864 of playing, thus unit of account mark, and unit fraction is stored in game data memory element 866.
The voice/sound of described user, by the wired or wireless voice/sound receiving user from sound source input block 740, is processed into voice/sound data and described voice/sound data is exported as audio signal by audio signal processing unit 840.
Speaker 820 receives the Rhythmic game content-data downloading to be stored in content element 862 or play with online stream media mode in advance, and described Rhythmic game content-data is processed into voice and voice data to export described voice and voice data.
Video camera 830 shoots the real-time video of user action.
Display unit 890 according to the action of user show on screen the incarnation selected by user video or or by the video of video camera 830 captured in real-time, and on screen, show the information processed by Rhythmic game program unit 860 and audio signal processing unit 840, that is, computed unit fraction, by unit fraction being added game point and the multimedia sound source broadcast state of gained.
Wherein, divide screen makes the video of reference actions data incarnation to show simultaneously.
Server 500
Server-side communities unit 520 is stored in advance in the Rhythmic game content in content processing unit 540 and the various database datas being stored in advance in Database Unit 560 by wire communication or wireless communication technology (such as bluetooth, RFID, ZigBee, 3G, 4G or 5G) with karaoke equipment 800 handing-over.
Rhythmic game content is processed by content processing unit 540.
Database Unit 560 stores the customer data base 562 for user profile, for the content data base 564 of multimedia sound source and Rhythmic game content, judge data base 566 and the billing databases 568 for the expense corresponding to the use time for what unit fraction calculated.
Fig. 8 shows the flow chart of the action identification method of the Rhythmic game device with user action linkage according to second embodiment of the invention.
According in the Rhythmic game method inventing the second embodiment, under rhythm action designated mode, the score graph of assessment is such as Fig. 4 of the first embodiment, and the score graph of assessment is such as Fig. 5 of the first embodiment under rhythm action free schema.
Describe below with reference to Fig. 4 and Fig. 8 and by specific embodiment, the action identification method with the Rhythmic game device of user action linkage according to second embodiment of the invention is described.
First, it is assumed that user selects incarnation video mode and wearable device 600 worn on user's wrist, ankle or head and when holding microphone of carok 700 on hand, carry out the Rhythmic game of predetermined amount of time.
If by the menu setecting incarnation video mode of display, sound source, game mode and game ratings (S201 and S202) on the display unit 890 of karaoke equipment, control unit 850 performs multimedia sound source (S208).
Speaker 820 in karaoke equipment 800 receives multimedia sound source from the content element 862 of Rhythmic game program unit 860 and plays received multimedia sound source, and display unit 890 shows the video of reference actions data incarnation with 2D or 3D form.
User listen to the multimedia sound source play by the speaker 820 in karaoke equipment 800 and watch on display unit 890 video of the reference actions data incarnation of display start simultaneously at dancing action (S209).
Wherein, the video camera 830 in karaoke equipment 800 shoots real-time video for the action of user.
Wearable device side senser unit 620 and microphone side sensor unit 760 detect the head of such as user, hand and the ankle acceleration on action axle, angular velocity of rotation, speed and orientation (S210), and export the first actuating signal and second (S211) of described head, hand and ankle.
Controller 850 receives the first actuating signal of described head, hand and ankle and the second actuating signal and calculates action data (S212) for first action messages such as action acceleration on action axle of the head of user, hand and ankle, angular velocity of rotation, speed and orientation and the second action message.
Rhythmic game application program unit 860 is determined whether the game mode selected in step S202 is rhythm action designated mode (S213), by the matching degree that computed action data is calculated in predetermined amount of time compared with the benchmark dance movement data prestored under rhythm action designated mode and similarity degree (S216), and unit of account mark and computed unit fraction is stored in game data memory element 866 (S217).
Wherein, the calculating of unit fraction as shown in Figure 4, carrys out unit of account mark by matching degree and similarity degree are categorized as " very good ", " normally " or " poor " distribution with the unit fraction of " 10 point " " 5 point " " 2 point ".
If the game mode selected in step S213 is not rhythm action designated mode but rhythm action free schema, Rhythmic game application program unit 860 carrys out unit of account mark by the sense of rhythm (S214) of the action data based on described calculating the user action according to bat, beat, melody and evaluation of speed predetermined amount of time, and is stored in game data memory element 866 (S215) by computed unit fraction.
Wherein, the calculating of unit fraction is as it is shown in figure 5, carry out unit of account mark (S217) by the sense of rhythm of user action is categorized as " very good ", " normally " or " poor " distribution with the unit fraction of " 10 point " " 5 point " " 2 point ".
Unit fraction computed within a predetermined period of time in step S215 or step S217 is added to calculate game point (S218) by control unit 850.
Control unit 850 is confirmed whether to continue game (S222) by display unit 890.
If it is confirmed that continuation is played by user, step is back to step S210 to repeat ensuing operation, and if it is confirmed that user will not continue game, game point is stored in game data memory element 866 (S223).
Fig. 9 is the block diagram of the Rhythmic game device with user action linkage of the 3rd embodiment according to the present invention, it links with the wearable device 1100 and controller 1200 that include sensor unit respectively, and utilizes the content provided by server 500 to display on game station 1300 and display device 1400.
Although will be set to controller 1200 and the embodiment of game body hereinafter with the game station 1300 of gaming devices controller 1200 linkage, but it can be used in the intelligent television linked with remote controller.
Although additionally, have described that use server 500 online real-time mode exemplarily, but can also speculate that Rhythmic game software is arranged on game station 1300 self or intelligent television from it to replace the offline mode of the effect of server 500.
Figure 10 is the detailed structure view of wearable device side senser unit 1120 as shown in Figure 9 and controller side senser unit and 1220, the free acceleration transducer 1122,1222 of choosing is wherein installed, gyro sensor 1124,1124, geomagnetic sensor 1126,1266, and one or more in the group that constitutes of plural six axles being combined with in the sensor or nine axle action recognition compound sensors 1128 and 1228.
Wearable device 1100 includes wearable device side communication unit 1110, wearable device side senser unit 1120, wearable device side power subsystem 1130 and wearable device side speaker 1140, and be wear earphone on the head of user, hand, foot or body or head load telephone receiver, clamp type or any in band type.
Gaming devices controller 1200 includes controller side communication unit 1210, controller side senser unit 1220 and controller side power subsystem 1280.
Game station 1300 includes game station side communication unit 1310, video camera 1320, audio signal processing unit 1340, control unit 1350, Rhythmic game program unit 1360 and game station side display unit 1390, and described Rhythmic game program unit 1360 includes content element 1362, game identifying unit 1364 and game data memory element 1366.
Display device 1400 includes display device side speaker 1420, display device side communication unit 1440, multi-media processing unit 1460 and display device side display unit 1480
Server 500 includes Server-side communities unit 520, content processing unit 540 and Database Unit 560, and described Database Unit 560 includes customer data base 562, content data base 564, judges data base 566, and billing databases 568.
The function of each configuration with the rhythm game device of user action linkage according to third embodiment of the invention is described below with reference to Fig. 9 and Figure 10.
Wearable device 1100
Wearable device side communication unit 1110 joins the transmission/reception of the first actuating signal by wireless communication technology (such as Wi-Fi, bluetooth, infrared communication or ZigBee) and game station 1300.
Wearable device side senser unit 1120 is arranged so that acceleration transducer 1122, gyro sensor 1124, geomagnetic sensor 1126 and plural six axles being combined with in the sensor or nine axle action recognition compound sensors 1128 detect the head of the user such as wearing wearable device 1100, hands portion, foot portion, or the acceleration of body, angular velocity of rotation, first action message such as speed and orientation, and for the moving direction on action axle, angle, speed, intensity, rotate and jump out-feed head, hands portion, foot portion, or the first actuating signal of body.
Wearable device side power subsystem 1130 uses battery received by itself electric power.
Wearable device side speaker 1140 receives electronic speech/acoustical signal by communication game station side communication unit 1310 from game station, received electronic speech/acoustical signal is carried out data process, and exports voice or sound.
Gaming devices controller 1200
Controller side senser unit 1220 is arranged so that second action messages such as the acceleration of hand of user of gaming devices controller 1200, angular velocity of rotation, speed and orientation are carried in acceleration transducer 1222, gyro sensor 1264, geomagnetic sensor 1266 and plural six axles being combined with in the sensor or the detection of nine axle action recognition compound sensors 1268, and exports the second actuating signal of hand for the moving direction on action axle, angle, speed, intensity, rotation and jump.
Controller side power subsystem 1280 uses battery received by itself electric power.
Controller side communication unit 1210 can pass through wireless communication technology (such as Wi-Fi, bluetooth, infrared communication or ZigBee) and game station 1300 and join the transmission/reception of the second actuating signal.
Game station 1300
Game station side communication unit 1310 joins the transmission/reception of the first actuating signal or the second actuating signal by wireless communication technology (such as bluetooth, RFID, ZigBee, 3G, 4G or 5G) and wearable device 1100 and game console 1200.
Additionally, game station side communication unit 1310 and Server-side communities unit 520 described later join the transmission/reception of content and various data base.
Control unit 1350 receives the first actuating signal or the second actuating signal from game station side communication unit 1310, and calculate the action behavior for user (such as, wear wearable device 1100 and the head of user of gaming devices controller 1200, wrist, ankle or body, and the first action message and second action message such as hand acceleration on action axle, angular velocity of rotation, speed and azimuth) action data.
The cadence information of the above-mentioned action data calculated with the benchmark dance movement data being stored in content element 1362 or sound source is compared with predetermined amount of time or predetermined period by Rhythmic game program unit 1360 according to game mode, and assess matching degree and similarity degree by identifying unit 1364 of playing, thus unit of account mark, and unit fraction is stored in game data memory element 1366.
Audio signal processing unit 1340 receives Rhythmic game content-data that is that be downloaded and stored in advance in content element 1362 or that play with online stream media mode, and described Rhythmic game content-data is processed into voice and voice data, and with voice and voice output.
Video camera 1320 shoots the real-time video of user action.
Game station side display unit 1390 shows the video of the incarnation selected by user or by the video of video camera 1320 captured in real-time according to the action of user on screen, and on screen, show the information processed by Rhythmic game program unit 1360 and audio signal processing unit 1340, that is, computed unit fraction, by unit fraction being added game point and the multimedia sound source broadcast state of gained.
Wherein, can divide screen makes the video of reference actions data incarnation show simultaneously.
Server 500
Server-side communities unit 520 is stored in advance in the Rhythmic game content in content processing unit 540 and the various database datas being stored in advance in Database Unit 560 by wire communication or wireless communication technology (such as bluetooth, RFID, ZigBee, 3G, 4G or 5G) with game station 1300 handing-over.
Rhythmic game content is processed by content processing unit 540.
Database Unit 560 stores the customer data base 562 for user profile, for the content data base 564 of multimedia sound source and Rhythmic game content, judge data base 566 and the billing databases 568 for the expense corresponding to the use time for what unit fraction calculated.
Display device 1400
Display device side communication unit 1440 joins the video data of the incarnation selected by user or by the video data of video camera 1320 captured in real-time and the transmission/reception of information that processed by Rhythmic game program unit 1360 and audio signal processing unit 1340 by radio communication and game station 1300.
Multi-media processing unit 1460 receives Rhythmic game content that is that download in advance or store or that play with online stream media mode, and described Rhythmic game contents processing becomes view data and voice/sound data to export described view data and voice/sound data.
Display device side display unit 1390 shows the view data processed by multi-media processing unit 1460 and the video of incarnation selected by user or by the video of video camera 1320 captured in real-time according to the action of user on screen, and show on screen by the information of game device process, namely computed unit fraction, the game point by the addition of described unit fraction is obtained, and multimedia sound source broadcast state.
Display device side speaker 1420 receives handled voice/sound data from multi-media processing unit 1460, described voice/sound data is carried out data process, and exports voice or sound.
The flow chart with the action identification method of the rhythm game device of user action linkage illustrating the 3rd embodiment according to the present invention is such as Fig. 8 of the second embodiment.
Additionally, in the Rhythmic game method according to invention the 3rd embodiment, under rhythm action designated mode, the score graph of assessment is such as Fig. 4 of the first embodiment, and the score graph of assessment is such as Fig. 5 of the first embodiment under rhythm action free schema.
Below with reference to Fig. 4, Fig. 5 and Fig. 8 to Figure 10 and by specific embodiment, the action identification method with the rhythm game device of user action linkage according to third embodiment of the invention is described.
First, it is assumed that user selects incarnation video mode and wears on user's head, hand, foot or body by wearable device 600 and gaming devices controller 1200 is held the Rhythmic game carrying out predetermined amount of time while on hand.
If by the menu setecting incarnation video mode of display, sound source, game mode and game ratings (S201 and S202) on the game station side display unit 1390 in game station, control unit 1350 performs multimedia sound source (S208).
Audio signal processing unit 1340 in game station receives multimedia sound source from the content element 1362 of Rhythmic game program unit 1360 and plays described multimedia sound source, and game station side display unit 1390 shows the video of reference actions data incarnation with 2D or 3D form.
User listens to the multimedia sound source play by the wearable device side speaker 1140 in wearable device, and viewing on wearable device side display unit 1390 video of the reference actions data incarnation of display start simultaneously at dancing action (S209).
Wherein, the video camera 1320 in game station shoots real-time video for the action of user.
Wearable device side senser unit 1120 and controller side senser unit 1220 detect the first action message and second action messages (S210) such as the head of such as user, hand, foot or the body acceleration on action axle, angular velocity of rotation, speed and orientation respectively, and export the first actuating signal and second actuating signal (S211) of described head, hand, foot or body.
Control unit 1350 receives the first actuating signal of described head, hand, foot or body and the second actuating signal and calculates action data (S212) for first action messages such as action acceleration on action axle of the head of user, hand, foot or body, angular velocity of rotation, speed and orientation and the second action message.
Rhythmic game program unit 1360 is determined whether the game mode selected in step S202 is rhythm action designated mode (S213), if rhythm action designated mode, by matching degree and similarity degree being carried out by computed action data compared with the benchmark dance movement data prestored the assessment (S216) of predetermined amount of time, and unit of account mark computed unit fraction is stored in game data memory element 1366 (S217).
Wherein, the calculating of unit fraction as shown in Figure 4, by matching degree and similarity degree being categorized as " very good ", " normally " or " poor " and being respectively allocated the unit fraction of " 10 point " " 5 point " " 2 point " and carry out unit of account mark.
If the game mode selected in step S213 is not rhythm action designated mode but rhythm action free schema, action data based on described calculating, the sense of rhythm of user action is carried out the assessment (S214) of predetermined amount of time by Rhythmic game application program unit 1360 according to bat, beat, melody and speed, and unit of account mark, and computed unit fraction is stored in game data memory element 1366 (S215).
Wherein, unit fraction calculate as it is shown in figure 5, by the sense of rhythm of user action being categorized as " very good ", " normally " or " poor " and being respectively allocated the unit fraction of " 10 point " " 5 point " " 2 point " and carry out unit of account mark (S217).
Unit fraction computed in predetermined amount of time in step S215 or step S217 is added to calculate game point (S218) by control unit 1350.
Control unit 1350 is confirmed whether to continue game (S222) by game station side display unit 1390.
If it is confirmed that user to continue game, step is back to step S210 to repeat ensuing operation, and if it is confirmed that user will not continue game, game point is stored in game data memory element 1366 (S223).
By this way, the invention provides a kind of and user action linkage rhythm game device, it is when user wears or carries various types of wearable device being provided with one or more sensor, during with at least one in portable terminal, microphone of carok, gaming devices controller or Intelligent TV remote controller, by integrating sensing data, the matching degree of assessment user action and benchmark dance movement or similarity degree, and assess the sense of rhythm of user action, enable a user to enjoy Rhythmic game.
By this, user can show different actions in the free situation of trick and enjoy sense of rhythm and dance feeling while viewing shows the screen of user's realistic operation, described Rhythmic game device is miniaturized so that the installing space of game device is unrestricted, and decreases power consumption and manufacturing cost.
Although having described that the preferred embodiment of the present invention, but the present invention is not limited to above-mentioned particular implementation.That is, the present invention can be carried out various changes and modifications in without departing substantially from the spirit of the present invention and the scope in field by those of ordinary skill in the art, and the equivalents of all suitable changes and amendment also should be regarded as falling within the scope of the present invention.

Claims (45)

1., with a Rhythmic game device for user action linkage, described Rhythmic game device includes:
First wearable device or the second wearable device, it detects the action of described user by being worn on first body part of user or the second body part and exports the first actuating signal or the second actuating signal respectively;With
Portable terminal, it is by being carried the action detecting described user by the 3rd body part of described user and generated the 3rd actuating signal,
Wherein, described portable terminal includes control unit and Rhythmic game application program unit, described control unit is by receiving the first detected actuating signal and the 3rd actuating signal or generating action data by receiving the second actuating signal monitored and the 3rd actuating signal, and described Rhythmic game application program unit is by receiving the action data generated the assessment that the action of described user carries out matching degree or sense of rhythm according to game mode, exports game point.
2. Rhythmic game device according to claim 1, also includes display device, and it comes playing image data and voice data by receiving Rhythmic game content from server, and by integrating or divide the screen action display real-time video for described user.
3. Rhythmic game device according to claim 2, wherein, when described game mode is rhythm action designated mode, described Rhythmic game application program unit by being compared to described matching degree is carried out the assessment of predetermined amount of time by the action data generated and the benchmark dance movement data prestored.
4. Rhythmic game device according to claim 3, wherein, when described game mode is rhythm action free schema, described Rhythmic game application program unit is based on the action data generated and according at least one assessment that described matching degree carries out predetermined amount of time in bat, beat, melody and speed.
5. Rhythmic game device according to claim 2, wherein, described server stores Rhythmic game content and data base, and joins the linkage with social networking system to carry out the game of pattern of fighting to the finish or collaboration mode.
6. Rhythmic game device according to claim 5, wherein, described first wearable device includes:
First sensor unit, it generates described first actuating signal by detecting described first body part the first action message on action axle;
First power subsystem, its received by itself electric power;
First communication unit, described first actuating signal is sent to described portable terminal by it by wirelessly or non-wirelessly communication;With
Speaker, it receives electronic speech and acoustical signal by wirelessly or non-wirelessly communicating from described portable terminal, described electronic speech and acoustical signal is carried out data process, and exports voice or sound.
7. Rhythmic game device according to claim 6, wherein, described second wearable device includes:
Second sensor unit, it generates described second actuating signal by detecting described second body part the second action message on action axle;
Second source unit, its received by itself electric power;With
Second communication unit, described second actuating signal is sent to described portable terminal by it by wirelessly or non-wirelessly communication.
8. Rhythmic game device according to claim 7, wherein, described portable terminal also includes:
End side sensor unit, it generates described 3rd actuating signal by detecting described 3rd body part the 3rd action message on action axle;
End side communication unit, it receives described first actuating signal or the second actuating signal and described 3rd actuating signal, and joins and is play and the transmission/reception of shown data, described Rhythmic game content and described database data;With
End side display unit, it will be play with shown data playback on the screen according to the action of described user, and shows described game point.
9. Rhythmic game device according to claim 8, wherein, described first action message is at least one in action acceleration, angular velocity of rotation, speed and orientation to the 3rd action message.
10. Rhythmic game device according to claim 1, wherein, the form of described first wearable device is earphone or head load telephone receiver, and the form of described second wearable device is clamp type or band type.
11. Rhythmic game device according to claim 8, wherein, described portable terminal also includes:
Audio signal processing unit, it receives described Rhythmic game content, is voice and voice data by described Rhythmic game contents processing, and exports audio signal;With
End side power supply, it provides electric power to described portable terminal.
12. Rhythmic game device according to claim 11, wherein, after described Rhythmic game application program unit receives described Rhythmic game content, when the pattern of described Rhythmic game device is not social networking system pattern, directly described voice and voice data are processed, and when the pattern of described Rhythmic game device is social networking system pattern, described Rhythmic game application program unit determines whether to have invited friend SNS, and when having invited described friend SNS, select described friend SNS, after invitation is accepted, process described voice and voice data.
13. Rhythmic game device according to claim 2, wherein, described display device includes:
Display device side communication unit, it is by the transmission/reception of radio communication with described portable terminal handing-over data;
Multi-media processing unit, it receives described Rhythmic game content from described display device side communication unit, described Rhythmic game contents processing becomes described view data and described voice data, and exports described view data and described voice data;
Video camera, it shoots real-time video for the action of described user;With
End side display unit, it plays described view data and described voice data, and shows the video of described user and described game point on the screen.
14. Rhythmic game device according to claim 13, wherein, when the pattern of described Rhythmic game device is to fight to the finish or during collaboration mode, described end side display unit shows simultaneously fights to the finish or the video of collaboration user.
15. Rhythmic game device according to claim 14, wherein, the described video of described user or the described video of the other user are the video of the incarnation selected by described user or described the other user or described real-time video.
16. Rhythmic game device according to claim 2, wherein, described Rhythmic game content is play in the way of being downloaded in advance and prestoring or with online stream media mode.
17. Rhythmic game device according to claim 5, wherein, described server includes:
Content processing unit, described Rhythmic game content is processed by it;
Database Unit, it stores the customer data base for user profile, the content data base for multimedia sound source and described Rhythmic game content, judges data base and the billing databases for the expense corresponding to the use time for what unit fraction calculated;With
Server-side communities unit, Rhythmic game content and the database data being stored in described Database Unit are sent to described portable terminal by it by radio communication, and the linkage of handing-over and described social networking system.
18. Rhythmic game device according to claim 8, wherein, what described first sensor unit, the second sensor unit and described end side sensor unit included selecting in the group that free acceleration transducer, gyro sensor, geomagnetic sensor and plural six axles being combined with in described acceleration transducer, described gyro sensor, described geomagnetic sensor or nine axle action recognition compound sensors are constituted respectively is one or more.
19. with a Rhythmic game device for user action linkage, described Rhythmic game device includes:
Wearable device, it is by being worn on the action detecting described user on first body part of user and exporting the first actuating signal;
Microphone of carok, it is by being carried, by second body part of described user, the action detecting described user and exporting the second actuating signal;With
Karaoke equipment, it comes playing image data and voice data by receiving Rhythmic game content from the Rhythmic game program being installed on himself, and by dividing the screen action display real-time video for described user,
Wherein, described karaoke equipment includes control unit and Rhythmic game program unit, described control unit is by receiving the first detected actuating signal and the second actuating signal generates action data, and described Rhythmic game program unit is by receiving the action data generated and according to game mode the action of described user being assessed matching degree or sense of rhythm exports game point.
20. Rhythmic game device according to claim 19, wherein, when described game mode is rhythm action designated mode, described rhythm program unit by being compared to described matching degree is carried out the assessment of predetermined amount of time by the action data generated and the benchmark dance movement data prestored.
21. Rhythmic game device according to claim 20, wherein, when described game mode is rhythm action free schema, described Rhythmic game program unit is based on the action data generated and according at least one assessment that described matching degree carries out predetermined amount of time in bat, beat, melody and speed.
22. Rhythmic game device according to claim 19, wherein, described wearable device includes:
Wearable device side senser unit, it generates described first actuating signal by detecting described first body part the first action message on action axle;
Wearable device side power subsystem, its received by itself electric power;With
Wearable device side communication unit, described first actuating signal is sent to described karaoke equipment by it by radio communication.
23. Rhythmic game device according to claim 22, wherein, described microphone of carok includes:
Microphone side sensor unit, it generates described second actuating signal by detecting described second body part the second action message on action axle;
Microphone side power subsystem, its received by itself electric power;
Sound source input block, its voice receiving described user and sound, convert described voice and sound voice and acoustical signal to, and send described voice and acoustical signal to described karaoke equipment by wirelessly or non-wirelessly communicating;With
Microphone side communication unit, described second actuating signal is sent to described karaoke equipment by it by radio communication.
24. Rhythmic game device according to claim 23, wherein, described first actuating signal and the second action message are action acceleration, angular velocity of rotation, speed and at least one in orientation.
25. Rhythmic game device according to claim 19, wherein, described wearable device is earphone or head load telephone receiver, clamp type or any in band type.
26. Rhythmic game device according to claim 23, wherein, described karaoke equipment also includes:
Karaoke equipment side communication unit, it passes through wireless communication receiver the first actuating signal and the second actuating signal, and joins the transmission/reception of described Rhythmic game content;
Video camera, it shoots real-time video for the action of described user;
Display unit, it receives described Rhythmic game content, is processed into described view data and described voice data to play out, and shows the video of described user and described game point on the screen;With
Speaker, it receives described voice and acoustical signal from described karaoke equipment, received voice and acoustical signal carries out data process, and exports described voice and described sound.
27. Rhythmic game device according to claim 26, wherein, the described video of described user is the video of the incarnation selected by described user or described real-time video.
28. Rhythmic game device according to claim 19, wherein, described karaoke equipment can receive described Rhythmic game content with online mode from server.
29. Rhythmic game device according to claim 28, wherein, described Rhythmic game content plays out in the way of being downloaded in advance and prestoring or with online stream media mode.
30. Rhythmic game device according to claim 28, wherein, described server includes:
Content processing unit, described Rhythmic game content is processed by it;
Database Unit, it stores the customer data base for user profile, the content data base for multimedia sound source and described Rhythmic game content, judges data base and the billing databases for the expense corresponding to the use time for what unit fraction calculated;With
Server-side communities unit, described Rhythmic game content and the database data being stored in described Database Unit are sent to described karaoke equipment by it by wire communication or radio communication.
31. Rhythmic game device according to claim 23, wherein, what described wearable device side senser unit and described microphone sensor unit included selecting in the group that free acceleration transducer, gyro sensor, geomagnetic sensor and plural six axles being combined with in described acceleration transducer, described gyro sensor, described geomagnetic sensor or nine axle action recognition compound sensors are constituted respectively is one or more.
32. with a Rhythmic game device for user action linkage, described Rhythmic game device includes:
Wearable device, it is by being worn on the action detecting described user on first body part of user and exporting the first actuating signal;
Controller, it is by being carried, by second body part of described user, the action detecting described user and exporting the second actuating signal;With
Game body, it comes playing image data and voice data by receiving Rhythmic game content from the Rhythmic game program being installed on himself, and by dividing the screen action display real-time video for described user,
Wherein, described game body includes control unit and Rhythmic game program unit, described control unit generates action data by receiving the first detected actuating signal and the second actuating signal, and described Rhythmic game program unit is by receiving the action data generated the assessment that the action of described user carries out matching degree or sense of rhythm according to game mode, exports game point.
33. Rhythmic game device according to claim 32, wherein, when described game mode is rhythm action designated mode, described rhythm program unit by being compared to described matching degree is carried out the assessment of predetermined amount of time by the action data generated and the benchmark dance movement data prestored.
34. Rhythmic game device according to claim 33, wherein, when described game mode is rhythm action free schema, described Rhythmic game program unit is based on the action data generated and according at least one assessment that described matching degree carries out predetermined amount of time in bat, beat, melody and speed.
35. Rhythmic game device according to claim 32, wherein, described wearable device includes:
Wearable device side senser unit, it generates described first actuating signal by detecting described first body part the first action message on action axle;
Wearable device side power subsystem, its received by itself electric power;
Wearable device side communication unit, described first actuating signal is sent to described game body by it by radio communication;With
Wearable device side speaker, it receives audio signal by radio communication from described game body, the audio signal received carries out data process, and exports voice and sound.
36. Rhythmic game device according to claim 35, wherein, described controller includes:
Controller side senser unit, it generates described second actuating signal by detecting described second body part the second action message on action axle;
Controller side power subsystem, its received by itself electric power;With
Controller side communication unit, described second actuating signal is sent to described game body by it by radio communication.
37. Rhythmic game device according to claim 36, wherein, described first action message and the second action message are at least one in action acceleration, angular velocity of rotation, speed and orientation.
38. Rhythmic game device according to claim 32, wherein, the form of described wearable device be earphone, head load telephone receiver, clamp type, band type in any.
39. Rhythmic game device according to claim 35, wherein, described game body also includes:
Game base side communication unit, it is by the first actuating signal and described second actuating signal described in wireless communication receiver, and joins the transmission/reception of described Rhythmic game content;
Video camera, it shoots real-time video for the action of described user;
Game base side display unit, it receives described Rhythmic game content, is processed into described view data and described voice data to play out, and shows the video of described user and described game point on the screen;With
Audio signal processing unit, it receives described Rhythmic game content, is voice and voice data by described Rhythmic game contents processing, and exports audio signal.
40. the Rhythmic game device according to claim 39, wherein, the described video of described user is the video of the incarnation selected by described user or described real-time video.
41. Rhythmic game device according to claim 32, wherein, described game body can receive described Rhythmic game content with online mode from server.
42. Rhythmic game device according to claim 41, wherein, described Rhythmic game content plays out in the way of being downloaded in advance and prestoring or with online stream media mode.
43. Rhythmic game device according to claim 41, wherein, described server includes:
Content processing unit, described Rhythmic game content is processed by it;
Database Unit, it stores the customer data base for user profile, the content data base for multimedia sound source and described Rhythmic game content, judges data base and the billing databases for the expense corresponding to the use time for what unit fraction calculated;With
Server-side communities unit, described Rhythmic game content and the database data being stored in described Database Unit are sent to described game body by it by wire communication or radio communication.
44. Rhythmic game device according to claim 36, wherein, what described wearable device side senser unit and described controller side senser unit included selecting in the group that free acceleration transducer, gyro sensor, geomagnetic sensor and plural six axles being combined with in described acceleration transducer, described gyro sensor, described geomagnetic sensor or nine axle action recognition compound sensors are constituted respectively is one or more.
45. Rhythmic game device according to claim 32, wherein, described game body is game station or intelligent television, and when described game body is game station, described controller is gaming devices controller, and when described game body is intelligent television, described controller is remote controller.
CN201480067745.8A 2013-12-10 2014-10-13 Rhythm game device linked with user movements Pending CN105813702A (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
KR1020130153439A KR20150067922A (en) 2013-12-10 2013-12-10 A rhythm game device interworking user behavior
KR10-2013-0153439 2013-12-10
PCT/KR2014/009570 WO2015088132A1 (en) 2013-12-10 2014-10-13 Rhythm game device linked with user movements

Publications (1)

Publication Number Publication Date
CN105813702A true CN105813702A (en) 2016-07-27

Family

ID=53371404

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201480067745.8A Pending CN105813702A (en) 2013-12-10 2014-10-13 Rhythm game device linked with user movements

Country Status (3)

Country Link
KR (1) KR20150067922A (en)
CN (1) CN105813702A (en)
WO (1) WO2015088132A1 (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2019100753A1 (en) * 2017-11-23 2019-05-31 乐蜜有限公司 Video generation method and apparatus, and electronic device
CN112092704A (en) * 2019-05-31 2020-12-18 现代自动车株式会社 Amusement device for autonomous vehicle
CN112735472A (en) * 2020-12-25 2021-04-30 航天科工深圳(集团)有限公司 Self-generating method and device for audio and video melody action
CN117149321A (en) * 2023-01-18 2023-12-01 荣耀终端有限公司 Game interaction method and device based on multi-device cooperation and storage medium

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2017115887A1 (en) * 2015-12-29 2017-07-06 경일대학교 산학협력단 Device for providing motion recognition-based game, method for same, and computer-readable recording medium on which said method is recorded
KR20180073795A (en) * 2016-12-22 2018-07-03 주식회사 큐비앤맘 Electronic device interworking with smart clothes, operating method thereof and system
CN112860071A (en) * 2021-03-14 2021-05-28 王赓 Smart mobile phone and computer game interaction system

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101367011A (en) * 2007-08-17 2009-02-18 阿迪达斯国际经营管理有限公司 Sports electronic training system with electronic game characteristics and use thereof
CN101564594A (en) * 2008-04-25 2009-10-28 财团法人工业技术研究院 Interactive type limb action recovery method and system
KR20100010472A (en) * 2008-07-22 2010-02-01 최신규 System and method for network-based of sinning room service
CN102594799A (en) * 2011-01-11 2012-07-18 恩希软件株式会社 Method for inviting users to game through chatting in mobile platform

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3718626B2 (en) * 2000-09-20 2005-11-24 コナミ株式会社 Exercise game management system, exercise game data management device, and computer-readable recording medium recording an exercise game data management program
JP5410710B2 (en) * 2007-09-12 2014-02-05 株式会社バンダイナムコゲームス Program, information storage medium, game system

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101367011A (en) * 2007-08-17 2009-02-18 阿迪达斯国际经营管理有限公司 Sports electronic training system with electronic game characteristics and use thereof
CN101564594A (en) * 2008-04-25 2009-10-28 财团法人工业技术研究院 Interactive type limb action recovery method and system
KR20100010472A (en) * 2008-07-22 2010-02-01 최신규 System and method for network-based of sinning room service
CN102594799A (en) * 2011-01-11 2012-07-18 恩希软件株式会社 Method for inviting users to game through chatting in mobile platform

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2019100753A1 (en) * 2017-11-23 2019-05-31 乐蜜有限公司 Video generation method and apparatus, and electronic device
CN112092704A (en) * 2019-05-31 2020-12-18 现代自动车株式会社 Amusement device for autonomous vehicle
CN112092704B (en) * 2019-05-31 2023-07-04 现代自动车株式会社 Amusement device for automatically driving vehicle
CN112735472A (en) * 2020-12-25 2021-04-30 航天科工深圳(集团)有限公司 Self-generating method and device for audio and video melody action
CN112735472B (en) * 2020-12-25 2024-04-09 航天科工深圳(集团)有限公司 Audio and video melody action self-generating method and device
CN117149321A (en) * 2023-01-18 2023-12-01 荣耀终端有限公司 Game interaction method and device based on multi-device cooperation and storage medium

Also Published As

Publication number Publication date
KR20150067922A (en) 2015-06-19
WO2015088132A1 (en) 2015-06-18

Similar Documents

Publication Publication Date Title
CN105813702A (en) Rhythm game device linked with user movements
US11756664B2 (en) Mobile and adaptable fitness system
KR101736003B1 (en) A rhythm game device interworking user behavior
US11724177B2 (en) Controller having lights disposed along a loop of the controller
KR101686576B1 (en) Virtual reality system and audition game system using the same
CN107534824B (en) Information processing equipment, information processing method and program
TWI230086B (en) Game machine, game device control method, information storage medium, game distribution device, and game distribution method
JP5786361B2 (en) Notification signal control device
CN202355828U (en) Game system and operating device
JP2018129043A (en) Game machine equipped with volumetric sensing
US20120229372A1 (en) Storage medium having information processing program stored thereon, information processing apparatus, information processing system, and information processing method
CN108579060B (en) Exercise system and application method thereof
US20080318679A1 (en) Foot game controller with motion detection and/or position detection
CN105493477A (en) Wristband-type information processing device, information processing system, information processing method, and program
CN114205324B (en) Message display method, device, terminal, server and storage medium
CN110267067A (en) Method, apparatus, equipment and the storage medium that direct broadcasting room is recommended
CN104684621A (en) Merchandizing, socializing, and/or gaming via a personal wellness device and/or a personal wellness platform
CN108683927A (en) Main broadcaster recommends method, apparatus and storage medium
US10441847B2 (en) Framework, devices, and methodologies configured to enable gamification via sensor-based monitoring of physically performed skills, including location-specific gamification
KR20140033388A (en) A proximity sensor mesh for motion capture
WO2017049952A1 (en) Method, device and system for recommending music
CN112511850A (en) Wheat connecting method, live broadcast display method, device, equipment and storage medium
CN114125483B (en) Event popup display method, device, equipment and medium
CN105304101A (en) Method for realizing matching music playing by detecting motion frequency of human body
CN107948702A (en) Synchronous method, device, terminal and the storage medium of Application Status

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
WD01 Invention patent application deemed withdrawn after publication
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20160727