CN108376487A - Based on the limbs training system and method in virtual reality - Google Patents
Based on the limbs training system and method in virtual reality Download PDFInfo
- Publication number
- CN108376487A CN108376487A CN201810136939.9A CN201810136939A CN108376487A CN 108376487 A CN108376487 A CN 108376487A CN 201810136939 A CN201810136939 A CN 201810136939A CN 108376487 A CN108376487 A CN 108376487A
- Authority
- CN
- China
- Prior art keywords
- student
- virtual reality
- action
- limbs
- teacher
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B5/00—Electrically-operated educational appliances
- G09B5/06—Electrically-operated educational appliances with both visual and audible presentation of the material to be studied
- G09B5/065—Combinations of audio and video presentations, e.g. videotapes, videodiscs, television systems
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Business, Economics & Management (AREA)
- Physics & Mathematics (AREA)
- Educational Administration (AREA)
- Educational Technology (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Processing Or Creating Images (AREA)
Abstract
The invention discloses a kind of limbs training systems and method based in virtual reality, including：Motion capture module, including it is respectively arranged on the locator at each position of teacher's limbs, to capture and record the position and rotation angle that each position of teacher's limbs acts in three dimensions；Replay mode is acted, replays the action of teacher, student's these actions from the first person by way of translucent ghost image in virtual reality, and carry out learning by imitation；Evaluation module is acted, by comparing the action difference of student and teacher, proposes to feed back to student in time in virtual reality, helps student's execution.The present invention can overcome previous video, and can only be recorded in two dimensional surface and play back the defect of action realizes the record acted in three dimensions and playback by the way that motion capture is carried out virtual reality combination.Meanwhile by showing ghost image in the first person, helping people, intuitively understanding acts so that learns by oneself dancing in virtual reality, Tai Ji is possibly realized.
Description
Technical field
The invention belongs to field of virtual reality, more particularly to a kind of limbs training system based in virtual reality and side
Method.
Background technology
People often rely on instructing in words and by deeds for teacher, or carry out certainly in face of video when learning Tai Ji, dancing etc.
It learns.It imparts knowledge to students by teacher, can obtain relatively good effect, but somewhat expensive, and a teacher can instruct simultaneously
Student's limited amount even more limits further popularizing for the democratic arts such as dancing.It is learnt by oneself by video, it is cheap, and
It can carry out whenever and wherever possible, but the action that learner completes, if accurately in place, it is unable to get timely feeds back always.Separately
Outside, since the plane of video limits, some actions possibly can not gain the essentials it is clear that affecting learner, learning training effect
It is bad.
Invention content
Technical problem to be solved by the invention is to provide a kind of limbs training system and method based in virtual reality,
Using the motion capture system of low price, three-dimensional record simultaneously preserves a series of limb actions, and by virtual reality, from
First person angle is replayed in the form of ghost image, and a kind of completely new to provide, observation, the mode for imitating limb action make
People can box in virtual reality, the limbs training such as dancing.
In order to solve the above-mentioned technical problem, the present invention adopts the following technical scheme that：
On the one hand, a kind of limbs training system and method based in virtual reality, including：
Motion capture module, including it is respectively arranged on the locator at each position of teacher's limbs, to capture and record teacher's limb
The position and rotation angle that each position of body acts in three dimensions；
Replay mode is acted, replays the action of teacher by way of translucent ghost image in virtual reality, student is from the
One person observes these actions, and carries out learning by imitation；
Evaluation module is acted, by comparing the action difference of student and teacher, is proposed in time to student in virtual reality
Feedback helps student's execution.
The locator is at least set to head, both hands, waist, double-legged six positions.
The locator is also set at duplex.
The locator set on head tracks camera using facial expression, and the locator set on both hands is chased after using gesture
Track gloves.
The action replay mode uses the virtual implementing helmet worn for student, by virtual implementing helmet by teacher's
Action is Chong Die with student's entity action in a manner of translucent to play.
The motion capture module further includes being respectively arranged on the locator at each position of student's limbs, to capture and record
The position and rotation angle that raw each position of limbs acts in three dimensions, for the action replay mode in virtual reality into
The row overlapping plays.
On the other hand, a kind of training method based on the limb-training device in virtual reality, includes the following steps：
A. the locator of motion capture module is arranged at each position of teacher's limbs, it is each to capture and record teacher's limbs
The position and rotation angle that position acts in three dimensions；
B. using action replay mode in virtual reality by translucent ghost image by the way of replay the action of teacher, student
These actions from the first person, and carry out learning by imitation；
C. using action evaluation module by comparing the action difference of student and teacher, in time to student in virtual reality
It proposes feedback, helps student's execution.
The frequency of the record is not less than 60 times per second.
In stepb, further include that locator is set at each position of student's limbs, to capture and record each portion of student's limbs
The position and rotation angle that position acts in three dimensions, and it is described heavy to supply the action replay mode to be carried out in virtual reality
It is folded to play.
Before the overlapping plays, the body index of student is measured by locator, and according to acquirement
Data, the action of teacher is corrected, to ensure that each major joint point of academics and students can essentially coincide.
Limbs training system and method using the present invention based in virtual reality, can overcome previous video, only
Can be recorded in two dimensional surface and play back the defect of action realizes three-dimensional by the way that motion capture is carried out virtual reality combination
The record acted in space and playback.Meanwhile by showing ghost image in the first person, helping people, intuitively understanding acts, and makes
It obtains and learns by oneself dancing in virtual reality, Tai Ji is possibly realized.The present invention can also deduce other style necks based on limb action
Domain, such as fencing, boxing etc..
Description of the drawings
The present invention is described in detail with reference to the accompanying drawings and detailed description：
Fig. 1 is the schematic diagram based on the limbs training system in virtual reality of the present invention.
Specific implementation mode
The present invention based on the limbs training system in virtual reality as shown in Figure 1, including：
Motion capture module, including be respectively arranged on teacher (or referred to as instructor, demonstrator etc.) each position of limbs and determine
Position device, to capture and record the position and rotation angle that each position of teacher's limbs acts in three dimensions, such as in teacher
Locator is worn in each key position of body, actions, the actuating signals of teacher such as Tai Ji, dancing are completed in place and passes through positioning
Device passes to computer, is recorded by computer.Locator can provide each body part position in space and rotation
Angle, but go out the action of human body according to these inferred from input data, still rely on software IK Solvers solution.Due to existing
In main IK Solvers scheme, minimum requirements is positioning head, both hands, waist, double-legged main points position, so at this
In invention, it is desirable that dancing teacher at least wears locator above six positions.If, can be each in order to pursue precision
Major joint wears more locators, such as also wears locator in duplex, and wear gesture and track gloves, wears facial table
Feelings track camera etc..The scheme for being suitble to demand can be chosen according to actual demand.
Replay mode is acted, replays the action of teacher by way of translucent ghost image in virtual reality, student (or
For learner, imitator etc.) these actions from the first person, and carry out learning by imitation；Evaluation module is acted, is passed through
The action difference for comparing student and teacher proposes to feed back, helps student's execution to student in time in virtual reality.As
One embodiment, the action replay mode use the virtual implementing helmet worn for student, will be old by virtual implementing helmet
The action of teacher is Chong Die with student's entity action in a manner of translucent to play.According to the locator that teacher wears, can be obtained with high frequency
To during whole section of dancing, the position of each key position of teacher and angle.Using these data, in conjunction with Inverse kinematics
The dancing posture of teacher can be extrapolated, to carry out three-dimensional record to the action of teacher.Traditional move may be used in record
Frame formula, in order to be segmented in the animation softwares such as common MAYA, change the editings such as playback rate.Student wears
After the helmet, software reads these animation files, you can the dance movement of teacher is played in Virtual Space.What it is due to storage is similar
The three-dimensional dancing posture of bone so that we can be superimposed various human 3d models on it so that learn the experience of dancing
It is more abundant.
As one embodiment, the motion capture module further includes being respectively arranged on the locator at each position of student's limbs,
To capture and record the position and rotation angle that each position of student's limbs acts in three dimensions, mould is replayed for the action
Block carries out the overlapping in virtual reality and plays.The action data of student is acquired, but the data are only used in virtual reality
In display, and with teacher action comparison.By in material time point, the action of the teacher recorded more in advance in real time
Difference between the action of the student of acquisition, we just can know that the performance of student's action.Data packet needed for comparison
It includes, each major joint angle in three dimensions and position.Student will observe the action of teacher from the first person, and
And carry out learning by imitation.In addition, in this step, micromotion, slow motion, the multiple means such as repetitive operation, side can be used
Help the students essential of exercise.The speech explanation recorded in advance can be coordinated simultaneously, help student's understanding action.
In addition, due to the various aspects difference such as personal height, brachium, before playing teacher's action, need through locator pair
The body index of student measures, and according to the data of acquirement, is corrected to the action of teacher, to ensure teacher student
Each major joint point can overlap.Specially：When measurement, it is desirable that after student wears locator, eye to the front, both hands hang down naturally
Directly in body both sides, the brachium of student can be extrapolated to the distance of both hands by measurement head at this time, measure head to waist
Distance obtain student's upper body length, it is long that student's leg can be obtained at a distance from foot by waist.According to these information, and
In the relevant information for recording the teacher obtained when teacher's action, the action of teacher is zoomed to the Body proportion of student so that old
The action animation of teacher can be essentially coincided with the action of student.
Evaluation module is acted, by comparing the action difference of student and teacher, is proposed in time to student in virtual reality
Feedback helps student's execution.When student follows the action of teacher to imitate, action evaluation module is responsible for obtaining in real time
The position of each artis of student, the difference with the position of teacher, and vision, the feedback of the sense of hearing are given in virtual reality.It should
Module can also record the action of student, so that the later stage carries out the analysis of student's action and commenting for student's completeness
Estimate, helps student's more fully mastery learning situation.
Since the training method of the present invention is identical as above-mentioned training system principle, details are not described herein.
In conclusion limbs training system using the present invention and method, three-dimensional using the motion capture system of low price
A series of limb actions are recorded and preserve, and by virtual reality, being replayed in the form of ghost image from first person angle,
A kind of completely new, observation, the mode for imitating limb action so that people can carry out fist in virtual reality to provide
It hits, the training such as dancing, excellent.
But those of ordinary skill in the art it should be appreciated that more than embodiment be intended merely to illustrate this
Invention, and be not used as limitation of the invention, as long as in the spirit of the present invention, to embodiment described above
Variation, modification will all fall within the scope of claims of the present invention.
Claims (10)
1. a kind of limbs training system based in virtual reality, which is characterized in that including：
Motion capture module, including it is respectively arranged on the locator at each position of teacher's limbs, it is each to capture and record teacher's limbs
The position and rotation angle that position acts in three dimensions；
Replay mode is acted, replays the action of teacher by way of translucent ghost image in virtual reality, student is from the first
Claim observation these actions, and carries out learning by imitation；
Evaluation module is acted, by comparing the action difference of student and teacher, proposes to feed back to student in time in virtual reality,
Help student's execution.
2. the limbs training system according to claim 1 based in virtual reality, it is characterised in that：The locator is extremely
It is set to head, both hands, waist, double-legged six positions less.
3. limbs training system and method according to claim 2 based in virtual reality, it is characterised in that：It is described fixed
Position device is also set at duplex.
4. the limbs training system according to claim 2 based in virtual reality, it is characterised in that：It is described to be set to head
Locator using facial expression track camera, be set to both hands locator using gesture track gloves.
5. the limbs training system according to claim 4 based in virtual reality, it is characterised in that：The action replay
Module uses the virtual implementing helmet worn for student, by virtual implementing helmet by the action of teacher in a manner of translucent and
The overlapping of student's entity action plays.
6. the limbs training system according to claim 5 based in virtual reality, it is characterised in that：The motion capture
Module further includes being respectively arranged on the locator at each position of student's limbs, to capture and record each position of student's limbs in three-dimensional space
Between middle action position and rotation angle, carry out the overlapping in virtual reality for the action replay mode and play.
7. according to the training method according to any one of claims 1 to 6 based on the limb-training device in virtual reality,
It is characterized in that, includes the following steps：
A. the locator of motion capture module is arranged at each position of teacher's limbs, to capture and record each position of teacher's limbs
The position acted in three dimensions and rotation angle；
B. using action replay mode in virtual reality by translucent ghost image by the way of replay the action of teacher, student is from the
One person observes these actions, and carries out learning by imitation；
C. it using action evaluation module by comparing the action difference of student and teacher, is proposed in time to student in virtual reality
Feedback helps student's execution.
8. the limbs training method according to claim 7 based in virtual reality, it is characterised in that：The frequency of the record
Rate is not less than 60 times per second.
9. the limbs training method according to claim 7 based in virtual reality, it is characterised in that：In stepb, also
It is included in each position of student's limbs setting locator, is acted in three dimensions capturing and record each position of student's limbs
Position and rotation angle, and carry out the overlapping in virtual reality for the action replay mode and play.
10. the limbs training method according to claim 7 based in virtual reality, it is characterised in that：In the weight
Before folded broadcasting, the body index of student is measured by locator, and according to the data of acquirement, the action to teacher
It is corrected, to ensure that each major joint point of academics and students can essentially coincide.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810136939.9A CN108376487A (en) | 2018-02-09 | 2018-02-09 | Based on the limbs training system and method in virtual reality |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810136939.9A CN108376487A (en) | 2018-02-09 | 2018-02-09 | Based on the limbs training system and method in virtual reality |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108376487A true CN108376487A (en) | 2018-08-07 |
Family
ID=63017600
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810136939.9A Pending CN108376487A (en) | 2018-02-09 | 2018-02-09 | Based on the limbs training system and method in virtual reality |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108376487A (en) |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109447020A (en) * | 2018-11-08 | 2019-03-08 | 郭娜 | Exchange method and system based on panorama limb action |
| CN109529277A (en) * | 2018-11-27 | 2019-03-29 | 北京唐冠天朗科技开发有限公司 | A kind of trained remote guide system and method |
| CN111047925A (en) * | 2019-12-06 | 2020-04-21 | 山东大学 | Action learning system and method based on room type interactive projection |
| CN112882575A (en) * | 2021-02-24 | 2021-06-01 | 宜春职业技术学院（宜春市技术工人学校） | Panoramic dance action modeling method and dance teaching auxiliary system |
| CN113012504A (en) * | 2021-02-24 | 2021-06-22 | 宜春职业技术学院（宜春市技术工人学校） | Multi-person dance teaching interactive projection method, device and equipment |
| CN113012505A (en) * | 2021-02-24 | 2021-06-22 | 宜春职业技术学院（宜春市技术工人学校） | Interactive dance teaching practice platform and method based on Internet |
| CN115619912A (en) * | 2022-10-27 | 2023-01-17 | 深圳市诸葛瓜科技有限公司 | Cartoon character display system and method based on virtual reality technology |
| WO2023077660A1 (en) * | 2021-11-04 | 2023-05-11 | 福建中医药大学附属康复医院 | Tai chi training method and system based on mixed reality, device, and storage medium |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103488291A (en) * | 2013-09-09 | 2014-01-01 | 北京诺亦腾科技有限公司 | Immersion virtual reality system based on motion capture |
| JP2016511445A (en) * | 2013-03-11 | 2016-04-14 | リンカーン グローバル，インコーポレイテッド | System and method for providing extended education and training in a virtual reality environment |
| CN106097787A (en) * | 2016-08-18 | 2016-11-09 | 四川以太原力科技有限公司 | Limbs teaching method based on virtual reality and teaching system |
| CN106128174A (en) * | 2016-08-18 | 2016-11-16 | 四川以太原力科技有限公司 | Limbs teaching method based on virtual reality and teaching system |
| CN106548675A (en) * | 2016-11-08 | 2017-03-29 | 湖南拓视觉信息技术有限公司 | Virtual military training method and device |
| CN107273806A (en) * | 2017-05-18 | 2017-10-20 | 上海斐讯数据通信技术有限公司 | A kind of painting and calligraphy exercising method and system based on virtual reality |
-
2018
- 2018-02-09 CN CN201810136939.9A patent/CN108376487A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2016511445A (en) * | 2013-03-11 | 2016-04-14 | リンカーン グローバル，インコーポレイテッド | System and method for providing extended education and training in a virtual reality environment |
| CN103488291A (en) * | 2013-09-09 | 2014-01-01 | 北京诺亦腾科技有限公司 | Immersion virtual reality system based on motion capture |
| CN106097787A (en) * | 2016-08-18 | 2016-11-09 | 四川以太原力科技有限公司 | Limbs teaching method based on virtual reality and teaching system |
| CN106128174A (en) * | 2016-08-18 | 2016-11-16 | 四川以太原力科技有限公司 | Limbs teaching method based on virtual reality and teaching system |
| CN106548675A (en) * | 2016-11-08 | 2017-03-29 | 湖南拓视觉信息技术有限公司 | Virtual military training method and device |
| CN107273806A (en) * | 2017-05-18 | 2017-10-20 | 上海斐讯数据通信技术有限公司 | A kind of painting and calligraphy exercising method and system based on virtual reality |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109447020A (en) * | 2018-11-08 | 2019-03-08 | 郭娜 | Exchange method and system based on panorama limb action |
| CN109529277A (en) * | 2018-11-27 | 2019-03-29 | 北京唐冠天朗科技开发有限公司 | A kind of trained remote guide system and method |
| CN111047925A (en) * | 2019-12-06 | 2020-04-21 | 山东大学 | Action learning system and method based on room type interactive projection |
| CN111047925B (en) * | 2019-12-06 | 2021-06-25 | 山东大学 | Action learning system and method based on room type interactive projection |
| CN112882575A (en) * | 2021-02-24 | 2021-06-01 | 宜春职业技术学院（宜春市技术工人学校） | Panoramic dance action modeling method and dance teaching auxiliary system |
| CN113012504A (en) * | 2021-02-24 | 2021-06-22 | 宜春职业技术学院（宜春市技术工人学校） | Multi-person dance teaching interactive projection method, device and equipment |
| CN113012505A (en) * | 2021-02-24 | 2021-06-22 | 宜春职业技术学院（宜春市技术工人学校） | Interactive dance teaching practice platform and method based on Internet |
| WO2023077660A1 (en) * | 2021-11-04 | 2023-05-11 | 福建中医药大学附属康复医院 | Tai chi training method and system based on mixed reality, device, and storage medium |
| CN115619912A (en) * | 2022-10-27 | 2023-01-17 | 深圳市诸葛瓜科技有限公司 | Cartoon character display system and method based on virtual reality technology |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108376487A (en) | Based on the limbs training system and method in virtual reality | |
| KR102529604B1 (en) | Augmented Cognitive Methods and Apparatus for Simultaneous Feedback of Psychomotor Learning | |
| Chan et al. | A virtual reality dance training system using motion capture technology | |
| US11132533B2 (en) | Systems and methods for creating target motion, capturing motion, analyzing motion, and improving motion | |
| JP6162259B2 (en) | Motion learning support device and motion learning support method | |
| Kwon et al. | Combining body sensors and visual sensors for motion training | |
| JP2852925B2 (en) | Physical exercise proficiency education system | |
| US20100167248A1 (en) | Tracking and training system for medical procedures | |
| US5184295A (en) | System and method for teaching physical skills | |
| CN110674794B (en) | Panoramic dance action modeling method and dance teaching auxiliary system | |
| KR101936692B1 (en) | Dance training apparatus and method using automatic generation of dance key motion | |
| US20120206577A1 (en) | System, method, and computer software code for mimic training | |
| CN107833611A (en) | A kind of self-closing disease recovery training method based on virtual reality | |
| CN107122048A (en) | One kind action assessment system | |
| Noiumkar et al. | Use of optical motion capture in sports science: A case study of golf swing | |
| JP2005525598A (en) | Surgical training simulator | |
| CN107240049A (en) | The automatic evaluation method and system of a kind of immersive environment medium-long range action quality of instruction | |
| CN107670272A (en) | Intelligent body-sensing based on VR technologies, sense of touch interactive scene analogy method | |
| CN106166376A (en) | Simplify taijiquan in 24 forms comprehensive training system | |
| WO2012021582A1 (en) | Motion training schematic and method of instruction | |
| CN102663197A (en) | Virtual hand grasp simulating method based on motion capture | |
| Yang | The innovation of college physical training based on computer virtual reality technology | |
| CN109815930A (en) | A kind of action imitation degree of fitting evaluation method | |
| JP2011503685A (en) | Method and system for selecting display settings for rendered images | |
| CN108109440A (en) | A kind of more people's Dancing Teaching interaction method and devices |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20180807 |
|
| RJ01 | Rejection of invention patent application after publication |