CN104808798B - A kind of multi-screen interactive traditional dance entertainment systems based on Kinect - Google Patents
A kind of multi-screen interactive traditional dance entertainment systems based on Kinect Download PDFInfo
- Publication number
- CN104808798B CN104808798B CN201510244720.7A CN201510244720A CN104808798B CN 104808798 B CN104808798 B CN 104808798B CN 201510244720 A CN201510244720 A CN 201510244720A CN 104808798 B CN104808798 B CN 104808798B
- Authority
- CN
- China
- Prior art keywords
- projecting apparatus
- cloth
- act
- curtain
- player
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Landscapes
- Toys (AREA)
- Processing Or Creating Images (AREA)
Abstract
A kind of multi-screen interactive traditional dance entertainment systems based on Kinect, the present invention is the technical field of the body-sensing traditional dance dance game system based on Kinect device.It is to lack the property immersed in order to solve existing dance game and lack the problem of being played on traditional dance.Its first projecting apparatus, the second projecting apparatus, the 3rd projecting apparatus and the 4th projecting apparatus are all disposed within the center in the square surrounded in order by the first curtain, the second curtain, act 3 cloth and act 4 cloth, Kinect device is arranged on the lower section before the first curtain, first audio amplifier and the second audio amplifier are separately positioned at act 3 cloth two ends, and the data output end of Kinect device and the data input pin of main frame are connected.Body-sensing Kinect device and China merging for traditional dance of classics of the present invention is studied and innovated, enable users to access accurately action by the correlation technique of action recognition and judgement to feed back, user is obtained whole-heartedly immersion experience by multi-screen projection.
Description
Technical field
The present invention is the technical field of the body-sensing traditional dance dance game system based on Kinect device.
Background technology
The spiritual entertainment life of people is enriched constantly in recent years, and dance activities obtain fast development.Whether computer dancing
Game or DDR game, these dance games can enrich the cultural life of people, be that people bring timing, the rhythm
Sense and the exercise and moulding of aesthetic feeling.Each existing platform includes DDR, computer game, mobile phone games on the game of dancing
Deng.These equipment are merely able to receive hand motion or footwork, and the natural form gap with dancing is larger, is being played
Shi Wufa is realized and whole-heartedly participated in.Meanwhile, contained content is based on the dancing of modern western in these game, China's culture bottom
Accumulate deep traditional dance seldom to occur.On the one hand it is due to that its interests is pursued, being on the other hand also due to the traditional dance of China needs
Corresponding clothes and atmosphere are wanted, mobile phone, flat board, DDR game are difficult to accomplish immersing for traditional dance atmosphere.The system is in body-sensing
Equipment and China classical merging for traditional dance studys and innovated, and are used by the correlation technique of action recognition and judgement
Family can obtain accurately action feedback, user is obtained whole-heartedly immersion by multi-screen projection and experience.
The content of the invention
It is existing in order to solve it is an object of the invention to provide a kind of multi-screen interactive traditional dance entertainment systems based on Kinect
There is dance game to lack the property immersed and lack the problem of being played on traditional dance.
Described purpose is realized by following scheme：A kind of described multi-screen interactive traditional dance joy based on Kinect
Music system, it includes main frame 1, Kinect device 2, the first curtain 3, the second curtain 4, act 3 cloth 5, act 4 cloth 6, first and thrown
Shadow instrument 7, the second projecting apparatus 8, the 3rd projecting apparatus 9, the 4th projecting apparatus 10, stereo set 11, the first audio amplifier 12, the second audio amplifier 13；
First projecting apparatus 7, the second projecting apparatus 8, the 3rd projecting apparatus 9 and the 4th projecting apparatus 10 are all disposed within by the first act
The center in a square that cloth 3, the second curtain 4, act 3 cloth 5 and act 4 cloth 6 are surrounded in order, and make the first projection
The projected image of instrument 7 is incident upon on the first curtain 3, and the projected image of the second projecting apparatus 8 is incident upon on the second curtain 4, and the 3rd throws
The projected image of shadow instrument 9 is incident upon on act 3 cloth 5, and the projected image of the 4th projecting apparatus 10 is incident upon on act 4 cloth 6,
Kinect device 2 is arranged on the lower section before the first curtain 3, and the first audio amplifier 12 and the second audio amplifier 13 are separately positioned on act 3 cloth
At 5 two side ends, the drive of the driving input of the first audio amplifier 12 and the driving input of the second audio amplifier 13 all with stereo set 11
Dynamic output end connection, the data output end of Kinect device 2 is connected with the data input pin of main frame 1, the numeral of the first projecting apparatus 7
Video signal input terminal, the digital video signal input of the second projecting apparatus 8, the digital video signal input of the 3rd projecting apparatus 9
The digital video signal input of end and the 4th projecting apparatus 10 is all connected with the multipath digital video output end of main frame 1 respectively, sound
The multi-path digital audio input end for ringing equipment 11 is all connected with the multi-path digital timbre output end of main frame 1 respectively；Startup main frame 1,
Kinect device 2, the first projecting apparatus 7, the second projecting apparatus 8, the 3rd projecting apparatus 9, the 4th projecting apparatus 10 and stereo set 11, initially
Change Kinect device 2, Kinect device 2 obtains view data, including color stream ColorImageSteam, deep stream
Iplmage images in DepthImageSteam, skeleton stream SkeletonStream, generation OpenCV；Main frame 1 passes through
Kinect device 2 judges participation player's number, and selected depth value minimum is that the player nearest apart from the equipment visibility visual field is carried out
Bone is tracked；Player's bone node and model bone node are bound and OpenCV drawing coordinates system is mapped coordinates to
System；The facial key point 121 of player is obtained, player's face-image is isolated, and scheme player's face by the matching of key point
As assigning model；Main frame 1 carries out player actions judgement by Kinect device 2, and next close can be carried out after action matching and is played；Carry
The preceding substantial amounts of dance movement data that are stored with maneuver library, are represented with the relative position between artis；Player sets out
After work, the relative position to player's bone node is matched with the relative position in maneuver library, when judging whether to meet specific
Matching of the interior action in certain threshold value on locus.
Classical the merging for traditional dance of body-sensing Kinect device and China of the present invention is studied and innovated, by moving
Recognize that enabling users to access accurately action with the correlation technique judged feeds back, and makes user obtain entirely by multi-screen projection
Body and mind immersion experience.
Brief description of the drawings
Fig. 1 is the overall structure diagram of the present invention.
Embodiment
Embodiment one：With reference to shown in Fig. 1, it includes main frame 1, Kinect device 2, the first curtain 3, the second curtain
4th, act 3 cloth 5, act 4 cloth 6, the first projecting apparatus 7, the second projecting apparatus 8, the 3rd projecting apparatus 9, the 4th projecting apparatus 10, sound equipment are set
Standby 11, first audio amplifier 12, the second audio amplifier 13；
First projecting apparatus 7, the second projecting apparatus 8, the 3rd projecting apparatus 9 and the 4th projecting apparatus 10 are all disposed within by the first act
The center in a square that cloth 3, the second curtain 4, act 3 cloth 5 and act 4 cloth 6 are surrounded in order, and make the first projection
The projected image of instrument 7 is incident upon on the first curtain 3, and the projected image of the second projecting apparatus 8 is incident upon on the second curtain 4, and the 3rd throws
The projected image of shadow instrument 9 is incident upon on act 3 cloth 5, and the projected image of the 4th projecting apparatus 10 is incident upon on act 4 cloth 6,
Kinect device 2 is arranged on the lower section before the first curtain 3, and the first audio amplifier 12 and the second audio amplifier 13 are separately positioned on act 3 cloth
At 5 two side ends, the drive of the driving input of the first audio amplifier 12 and the driving input of the second audio amplifier 13 all with stereo set 11
Dynamic output end connection, the data output end of Kinect device 2 is connected with the data input pin of main frame 1, the numeral of the first projecting apparatus 7
Video signal input terminal, the digital video signal input of the second projecting apparatus 8, the digital video signal input of the 3rd projecting apparatus 9
The digital video signal input of end and the 4th projecting apparatus 10 is all connected with the multipath digital video output end of main frame 1 respectively, sound
The multi-path digital audio input end for ringing equipment 11 is all connected with the multi-path digital timbre output end of main frame 1 respectively；Startup main frame 1,
Kinect device 2, the first projecting apparatus 7, the second projecting apparatus 8, the 3rd projecting apparatus 9, the 4th projecting apparatus 10 and stereo set 11, initially
Change Kinect device 2, Kinect device 2 obtains view data, including color stream ColorImageSteam, deep stream
Iplmage images in DepthImageSteam, skeleton stream SkeletonStream, generation OpenCV；Main frame 1 passes through
Kinect device 2 judges participation player's number, and selected depth value minimum is that the player nearest apart from the equipment visibility visual field is carried out
Bone is tracked；Player's bone node and model bone node are bound and OpenCV drawing coordinates system is mapped coordinates to
System；The facial key point 121 of player is obtained, player's face-image is isolated, and scheme player's face by the matching of key point
As assigning model；Main frame 1 carries out player actions judgement by Kinect device 2, and next close can be carried out after action matching and is played；Carry
The preceding substantial amounts of dance movement data that are stored with maneuver library, are represented with the relative position between artis；Player sets out
After work, the relative position to player's bone node is matched with the relative position in maneuver library, when judging whether to meet specific
Matching of the interior action in certain threshold value on locus.
Operation principle：Principle is freely waved to obtain user's skeleton point information and assign model.Teaching dance operation principle includes
Two parts a, part is that the data of carry out standard dance movement quantify storage, and a part is for user action data and standard
The comparison of action data.Find that traditional dance action makes each using elbow joint, knee joint and carpal change more by investigating
Plant the dancing posture of form.Therefore, first the elbow joint in standard dance movement, knee joint are quantified to deposit with carpal action data
Storage.Judged in action judges first against elbow joint knee joint with carpal action, then carry out other positions
Action judges.Decision method is as follows：Initially set up 3 d space coordinate system xyz coordinate systems, the space bit of player's bone node
Put and represented by the point (x, y, z) in 3 d space coordinate system, most closed when measuring operating angle error range by experiment for value α
Reason, α is π/36., can be in sky using the position of 3 points of wrist node, toggle point and shoulder node by taking the judgement of elbow joint form as an example
Between in construct three straight lines.By taking right arm as an example, shoulder middle position is that (x0, y0, z0) right shoulder position is (x1, y1, z1), right
Elbow position is (x2, y2, z2), and right wrist position is (x3, y3, z3).The straight line of 2 points of compositions of right shoulder and right finesse is L13, right shoulder
Straight line with right elbow composition is L12, and right elbow is L23 with the straight line that right finesse is constituted, and the central straight line with right shoulder composition of shoulder is
L01. the form of arm dance movement is related to the rotation situation of shoulder and ancon, thus by joint at shoulder, ancon, wrist it
Between relative position as criterion, and do not consider user arm length but using its joint rotation angle be used as judge mark
It is accurate.First, it is determined that whether the angle between L13 and L01 is met at interval [K013- α, K013+ α], K013 is storage in maneuver library
Standard dance movement in right finesse relative to right shoulder angle.Angle between L13 and L01 can utilize space vector angle formulae
Draw, angle calculation formula is：
Similarly, the angle calcu-lation formula between straight line L12 and straight line L23 is：
Judge whether the angle meets the standard angle scope [K123- α, K123+ α] stored in maneuver library.
When the angle of all artis is with the angle automatching in maneuver library, then the match is successful for the action.Can carry out
The study of next dance movement.
Claims (1)
1. a kind of multi-screen interactive traditional dance entertainment systems based on Kinect, it is characterised in that it includes main frame（1）, Kinect sets
It is standby（2）, the first curtain（3）, the second curtain（4）, act 3 cloth（5）, act 4 cloth（6）, the first projecting apparatus（7）, second projection
Instrument（8）, the 3rd projecting apparatus（9）, the 4th projecting apparatus（10）, stereo set（11）, the first audio amplifier（12）, the second audio amplifier（13）；
First projecting apparatus（7）, the second projecting apparatus（8）, the 3rd projecting apparatus（9）With the 4th projecting apparatus（10）It is all disposed within by
One curtain（3）, the second curtain（4）, act 3 cloth（5）With act 4 cloth（6）The center in a square surrounded in order,
And make the first projecting apparatus（7）Projected image be incident upon the first curtain（3）On, the second projecting apparatus（8）Projected image be incident upon
Second curtain（4）On, the 3rd projecting apparatus（9）Projected image be incident upon act 3 cloth（5）On, the 4th projecting apparatus（10）Projection
Video is incident upon act 4 cloth（6）On, Kinect device（2）It is arranged on the first curtain（3）Lower section above, the first audio amplifier（12）
With the second audio amplifier（13）It is separately positioned on act 3 cloth（5）Two side ends at, the first audio amplifier（12）Driving input and second
Audio amplifier（13）Driving input all with stereo set（11）Drive output connection, Kinect device（2）Data output
End and main frame（1）Data input pin connection, the first projecting apparatus（7）Digital video signal input, the second projecting apparatus（8）'s
Digital video signal input, the 3rd projecting apparatus（9）Digital video signal input and the 4th projecting apparatus（10）Numeral regard
Frequency signal input part all respectively with main frame（1）Multipath digital video output end connection, stereo set（11）Multi-path digital sound
Frequency input terminal all respectively with main frame（1）Multi-path digital timbre output end connection；Start main frame（1）, Kinect device（2）,
One projecting apparatus（7）, the second projecting apparatus（8）, the 3rd projecting apparatus（9）, the 4th projecting apparatus（10）And stereo set（11）, initialization
Kinect device（2）, Kinect device（2）Obtain view data, including color stream ColorImageSteam, deep stream
Iplmage images in DepthImageSteam, skeleton stream SkeletonStream, generation OpenCV；Main frame（1）Pass through
Kinect device（2）Judge to participate in player's number, selected depth value minimum is that the player nearest apart from the equipment visibility visual field enters
Row bone is tracked；Player's bone node and model bone node are bound and OpenCV drawing coordinates system is mapped coordinates to
System；The facial key point 121 of player is obtained, player's face-image is isolated, and scheme player's face by the matching of key point
As assigning model；Main frame（1）Pass through Kinect device（2）Player actions judgement is carried out, next close can be carried out after action matching and is swum
Play；Be stored with substantial amounts of dance movement data in maneuver library in advance, is represented with the relative position between artis；Player does
Go out after action, the relative position to player's bone node is matched with the relative position in maneuver library, judge whether to meet special
The matching fixed time in the interior certain threshold value acted on locus.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510244720.7A CN104808798B (en) | 2015-05-14 | 2015-05-14 | A kind of multi-screen interactive traditional dance entertainment systems based on Kinect |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510244720.7A CN104808798B (en) | 2015-05-14 | 2015-05-14 | A kind of multi-screen interactive traditional dance entertainment systems based on Kinect |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104808798A CN104808798A (en) | 2015-07-29 |
| CN104808798B true CN104808798B (en) | 2017-09-19 |
Family
ID=53693702
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510244720.7A Expired - Fee Related CN104808798B (en) | 2015-05-14 | 2015-05-14 | A kind of multi-screen interactive traditional dance entertainment systems based on Kinect |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104808798B (en) |
Families Citing this family (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107115675B (en) * | 2017-05-26 | 2021-04-20 | 合肥酷卓数码科技有限公司 | Kinect-based sports fitness game system and implementation method |
| CN107293162A (en) * | 2017-07-31 | 2017-10-24 | 广东欧珀移动通信有限公司 | Move teaching auxiliary and device, terminal device |
| CN107968921B (en) * | 2017-11-23 | 2020-02-28 | 香港乐蜜有限公司 | Video generation method and device and electronic equipment |
| CN108428424A (en) * | 2018-06-12 | 2018-08-21 | 孟天奇 | For the audio-visual devices of autism children rehabilitation training |
| CN109011557A (en) * | 2018-10-10 | 2018-12-18 | 重庆第二师范学院 | A kind of game processing method and device |
| CN111047925B (en) * | 2019-12-06 | 2021-06-25 | 山东大学 | Action learning system and method based on room type interactive projection |
| CN115002428A (en) * | 2022-04-28 | 2022-09-02 | 北京连屏科技有限公司 | Immersive space system |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN202649924U (en) * | 2012-07-24 | 2013-01-02 | 哈尔滨金融学院 | Hip-hop image interaction device |
| CN103399637A (en) * | 2013-07-31 | 2013-11-20 | 西北师范大学 | Man-computer interaction method for intelligent human skeleton tracking control robot on basis of kinect |
| CN104200379A (en) * | 2014-09-03 | 2014-12-10 | 北京智海金帆科技有限公司 | Kinect based novel media interaction display system |
| CN104623910A (en) * | 2015-01-15 | 2015-05-20 | 西安电子科技大学 | Dance auxiliary special-effect partner system and achieving method |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2004055776A1 (en) * | 2002-12-13 | 2004-07-01 | Reactrix Systems | Interactive directed light/sound system |
-
2015
- 2015-05-14 CN CN201510244720.7A patent/CN104808798B/en not_active Expired - Fee Related
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN202649924U (en) * | 2012-07-24 | 2013-01-02 | 哈尔滨金融学院 | Hip-hop image interaction device |
| CN103399637A (en) * | 2013-07-31 | 2013-11-20 | 西北师范大学 | Man-computer interaction method for intelligent human skeleton tracking control robot on basis of kinect |
| CN104200379A (en) * | 2014-09-03 | 2014-12-10 | 北京智海金帆科技有限公司 | Kinect based novel media interaction display system |
| CN104623910A (en) * | 2015-01-15 | 2015-05-20 | 西安电子科技大学 | Dance auxiliary special-effect partner system and achieving method |
Non-Patent Citations (2)
| Title |
|---|
| 多模态三维运动恢复及相似性评估方法;刘彬;《中国硕士学位论文全文数据库信息科技辑》;20140131;全文 * |
| 民俗舞蹈类非物质文化遗产数字化技术研究;孙传明;《中国博士学位论文全文数据库哲学与人文科学辑》;20140731;全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104808798A (en) | 2015-07-29 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104808798B (en) | A kind of multi-screen interactive traditional dance entertainment systems based on Kinect | |
| Ishii et al. | PingPongPlus: design of an athletic-tangible interface for computer-supported cooperative play | |
| Jordà et al. | The reactable | |
| US7053915B1 (en) | Method and system for enhancing virtual stage experience | |
| Kaltenbrunner et al. | The reactable*: A collaborative musical instrument | |
| US8017851B2 (en) | System and method for physically interactive music games | |
| CN106601043A (en) | Multimedia interaction education device and multimedia interaction education method based on augmented reality | |
| Berry et al. | The augmented composer project: The music table | |
| CN109120990A (en) | Live broadcasting method, device and storage medium | |
| Nakatsu et al. | Entertainment Computing: Technologies and Application | |
| Lin et al. | Combining leap motion with unity for virtual glove puppets | |
| Cheok et al. | Social and physical interactive paradigms for mixed-reality entertainment | |
| Yang et al. | Humanoid robot magic show performance | |
| Casas et al. | Multi-reality games: An experience across the entire reality-virtuality continuum | |
| Rinman et al. | Ghost in the cave–An interactive collaborative game using non-verbal communication | |
| Santini | Linear (live-generated interface and notation environment in augmented reality) | |
| Freeman et al. | Technology, real-time notation, and audience participation in flock | |
| Kanawong et al. | Human Motion Matching for Assisting Standard Thai Folk Dance Learning. | |
| Alber et al. | The Reactable: a collaborative musical instrument for playing and understanding music. | |
| Petersen et al. | Toward enabling a natural interaction between human musicians and musical performance robots: Implementation of a real-time gestural interface | |
| US20180293414A1 (en) | System and method determining spatial relationships of physical objects | |
| Hakim et al. | Virtual guitar: Using real-time finger tracking for musical instruments | |
| Bevacqua et al. | Real and virtual body percussionists interaction | |
| Lee et al. | Enhancing interface design using attentive interaction design toolkit | |
| Antoshchuk et al. | Creating an interactive musical experience for a concert hall |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| EXSB | Decision made by sipo to initiate substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20170919 Termination date: 20180514 |
|
| CF01 | Termination of patent right due to non-payment of annual fee |