CN108762498A - The virtual reality system of human body walking gesture stability - Google Patents
The virtual reality system of human body walking gesture stability Download PDFInfo
- Publication number
- CN108762498A CN108762498A CN201810492928.4A CN201810492928A CN108762498A CN 108762498 A CN108762498 A CN 108762498A CN 201810492928 A CN201810492928 A CN 201810492928A CN 108762498 A CN108762498 A CN 108762498A
- Authority
- CN
- China
- Prior art keywords
- action recognition
- module
- recognition module
- virtual reality
- footwork
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
Abstract
The invention discloses a kind of virtual reality systems of human body walking gesture stability, belong to virtual reality device technical field, including wearable device, and Instep portion is integrated with footwork acquisition module and action recognition module in the wearable device；The footwork acquisition module is connect with action recognition module, and the action recognition module is connect with communication module, and the communication module is connect with client；The present invention can distinguish whether user is carrying out walking motion by detecting the action of user leg, and video playing or the pause in virtual reality applications are controlled with this, its interaction effect is natural, reinforce the realism and feeling of immersion of virtual system, user experience is improved, while greatly reducing vertigo symptoms.
Description
Technical field
The invention belongs to technical field of virtual reality, more particularly to a kind of virtual reality system of human body walking gesture stability
System.
Background technology
Field of virtual reality wearable device brings prodigious transformation to people's lives, perception.At present mainstream can
It is the watch kind product supported, the footwear supported with foot position that Wearable, which includes with wrist, is the eye supported with head
Mirror class product etc., however in the special occasion such as some simulation games or virtual instruction, need working as user in real
Preceding posture improves the validity of teaching and the experience sense of user, and makes feedback according to the rule of teaching or game, it is clear that
Existing wearable device cannot be satisfied the requirement of appeal.
VR videos are a kind of entertainment way that technology newly rises in recent years, and the VR nearest from user experience modes simultaneously.
It can be used for VR and visit room, VR tourisms etc..But in the interaction to VR mostly using head move perceptive mode and
Handle mode；The state control of VR videos, people can not move in the scene at present, and the information that visually user obtains is
" I am in movement ", the middle ear vestibular organ for being responsible for perception physical condition but send out the signal of " I am not dynamic ", this contradiction to brain
Signal brain can be allowed to think that " oneself " is in an abnormal and dangerous state.At this moment brain can be at once with strong dizziness
Feel to alert user, needs to be detached from current state as early as possible.Worse, this spinning sensation can constantly accumulate reinforcement, after
And cause fatigue, the symptoms such as vomiting.Symptom will not stop as user stops experience, and this dizzy, nausea symptom can root
Continue dozens of minutes or even a few hours according to the different constitution of user, and the unnatural head of people is dynamic, easily causes mistake manually
Operation reduces experience sense.
The interaction generally use head of current panorama player moves perceptive mode and handle control mode, and head moves perceptive mode and adopts
Perceptive mode is moved come lock onto target with the head based on gyroscope, and head is dynamic to be operated, and this mode is easy to increase user not
Natural head is dynamic, also makes the process of target lock-on elongated, both unnatural, efficiency is relatively low；Handle control mode is connected by bluetooth
It connects, the state of realization control VR videos, but such method needs to lift and set about, poor user experience, feeling of immersion is not strong.
Invention content
In view of the drawbacks described above of the prior art, technical problem to be solved by the invention is to provide a kind of human body walking appearances
The virtual reality system of state control, VR video playings control interactive system according to a kind of wearable human body attitude in this system,
It realizes the real-time capture to user's posture, calculates the operational motion of user, such as such as stand, walk, running, regarded to control
The state of frequency, reaches the experience that room etc. is seen in VR tourisms, VR, and real-time and interactivity are improved for user, reinforces virtual system
The realism and feeling of immersion of system improve user experience.Compared with other modes, limb control mode is a kind of operation of simplicity
Mode, easily controls the state of video, while playing the role of taking exercises and improving the feeling of immersion of VR and reducing cinetosis
Symptom.
To achieve the above object, the present invention provides a kind of virtual reality systems of human body walking gesture stability, including can
Wearable, Instep portion is integrated with footwork acquisition module and action recognition module in the wearable device；
The footwork acquisition module is connect with action recognition module, and the action recognition module connects with communication module
It connects, the communication module is connect with client；
The footwork acquisition module acquires for action data and transfers data to action recognition module；
The action recognition module is used to judge the athletic posture of user's both feet, and sends relevant control instruction to communication
Module；
The communication module is used to that action recognition module treated data and instruction to be sent to client and be regarded to control
The pause and broadcasting of frequency；
The client is for playing video.
Preferably, the footwork acquisition module includes multiple nine axis attitude transducers；
The nine axis attitude transducer includes 3-axis acceleration sensor, three axis angular rate sensors and three axis magnetic force
Meter.
Preferably, the action recognition algorithm in the action recognition module includes the following steps：
S1：Acquire 3-axis acceleration sensor X-axis acceleration value a and by acceleration value a be depicted as abscissa be when
Between t, ordinate be acceleration value a curve；
S2：It acquires the crest value in curve in several periods and takes its average value
S3：Take acceleration threshold valuesWherein b is threshold coefficient；
S4：Acquisition acceleration value a judges to take a step, works as a as a >=a' in real time<When a', judgement is not taken a step；
S5：Acquire effective acceleration wave crest amax, wherein amax>=a' is calculated between two neighboring effective acceleration wave crest
Time interval Δ t；
S6：It determines cadence f=1/ Δ t, cadence f and video playout speed positive correlation is contacted.
The beneficial effects of the invention are as follows：
The present invention can distinguish whether user is carrying out walking motion by detecting the action of user leg, and be controlled with this
Video playing in virtual reality applications processed or pause；It is shot in playing video and especially playing photographer's continuous moving complete
It when scape video, can realize " user feels that oneself is really walked about in the scene of panoramic video " this experience effect, interact
Effect improves user experience, while greatly reducing vertigo symptoms naturally, reinforce the realism and feeling of immersion of virtual system.
Mode of operation of the present invention is simple simultaneously, can easily control the state of video, also function to the effect taken exercises.
Description of the drawings
Fig. 1 is the structure diagram of the present invention；
Fig. 2 is the speed time curve figure of the present invention；
Specific implementation mode
With reference to embodiment, the invention will be further described：
Wearable device system include the helmet, left arm wearing, right arm wearing, vest, left leg wearing, right leg dress this five
A part；
In conjunction with shown in Fig. 1, the Instep portion that the left leg wearing, right leg are dressed is integrated with footwork acquisition module and moves
Make identification module；
The footwork acquisition module is connect with action recognition module, and the action recognition module connects with communication module
It connects, the communication module is connect with client；
The footwork acquisition module acquires for action data and transfers data to action recognition module；The foot
It includes multiple nine axis attitude transducers that step, which acts acquisition module,；The nine axis attitude transducer include 3-axis acceleration sensor,
Three axis angular rate sensors and three axle magnetometer.
The action recognition module is used to judge the athletic posture of user's both feet, and sends relevant control instruction to communication
Module；
The communication module is used to that action recognition module treated data and instruction to be sent to client and be regarded to control
The pause and broadcasting of frequency；When user goes ahead, virtual video normal play, when user velocity changes, virtual video plays speed
Degree, which synchronizes, to change, and user stops, and virtual video stops playing；
The client is for playing video.
Action recognition algorithm in the action recognition module includes the following steps：
S1：Acquire 3-axis acceleration sensor X-axis acceleration value a and by acceleration value a be depicted as abscissa be when
Between t, ordinate be acceleration value a curve, curve approximation as shown in Figure 2 is in sine wave；
S2：It acquires the crest value in curve in several periods and takes its average value
S3：Take acceleration threshold valuesWherein b is threshold coefficient, and threshold coefficient b values are 2/ in the present embodiment
3；
S4：Acquisition acceleration value a in real time, as a >=a', judgement steps forward a step, works as a<When a', judgement is not taken a step；
S5：Acquire effective acceleration wave crest amax, wherein amax>=a' is calculated between two neighboring effective acceleration wave crest
Time interval Δ t, as shown in Fig. 2, Δ t=t2-t1；
S6：It determines cadence f=1/ Δ t, cadence f and video playout speed positive correlation is contacted, such as Δ t=1s, f
=1Hz is judged as being careful, video playout speed v, as Δ t=0.2s, f=5Hz, is judged as hurrying up, then video playout speed
For 4.8-5v, video playout speed contacts with f positive correlations and sends dependent instruction to communication module.
User has dressed wearable device so that footwork acquisition module is located at instep, and user is in universal running
It is moved on machine, when user's normal operation, client VR videos then normal play, when user stops, video then stops
It plays, when user's speed of service changes, client VR video playout speeds equally change, in the mistake of user's walking
VR videos are played in journey can effectively reduce spinning sensation；It can reach the effect taken exercises simultaneously；It is carried significantly in terms of virtual application
High user experience feeling of immersion.
The preferred embodiment of the present invention has been described in detail above.It should be appreciated that those skilled in the art without
It needs creative work according to the present invention can conceive and makes many modifications and variations.Therefore, all technologies in the art
Personnel are available by logical analysis, reasoning, or a limited experiment on the basis of existing technology under this invention's idea
Technical solution, all should be in the protection domain being defined in the patent claims.
Claims (3)
1. a kind of virtual reality system of human body walking gesture stability, including wearable device, it is characterised in that：
Instep portion is integrated with footwork acquisition module and action recognition module in the wearable device；
The footwork acquisition module is connect with action recognition module, and the action recognition module is connect with communication module, institute
Communication module is stated to connect with client；
The footwork acquisition module acquires for action data and transfers data to action recognition module；
The action recognition module is used to judge the athletic posture of user's both feet, and sends relevant control instruction to communication mould
Block；
The communication module is used to send action recognition module treated data and instruction to client to control video
Pause and broadcasting；
The client is for playing video.
2. based on a kind of virtual reality system of human body walking gesture stability described in claim 1, it is characterised in that：
The footwork acquisition module includes multiple nine axis attitude transducers；
The nine axis attitude transducer includes 3-axis acceleration sensor, three axis angular rate sensors and three axle magnetometer.
3. the virtual reality system based on a kind of human body walking gesture stability described in claim 2, it is characterised in that：
Action recognition algorithm in the action recognition module includes the following steps：
S1：It is time t to acquire the acceleration value a of the X-axis of 3-axis acceleration sensor and acceleration value a is depicted as abscissa,
Ordinate is the curve of acceleration value a；
S2：It acquires the crest value in curve in several periods and takes its average value
S3：Take acceleration threshold valuesWherein b is threshold coefficient；
S4：Acquisition acceleration value a judges to take a step, works as a as a >=a' in real time<When a', judgement is not taken a step；
S5：Acquire effective acceleration wave crest amax, wherein amax>=a' calculates the time between two neighboring effective acceleration wave crest
Interval of delta t；
S6：It determines cadence f=1/ Δ t, cadence f and video playout speed positive correlation is contacted.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810492928.4A CN108762498A (en) | 2018-05-22 | 2018-05-22 | The virtual reality system of human body walking gesture stability |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810492928.4A CN108762498A (en) | 2018-05-22 | 2018-05-22 | The virtual reality system of human body walking gesture stability |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108762498A true CN108762498A (en) | 2018-11-06 |
Family
ID=64008469
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810492928.4A Pending CN108762498A (en) | 2018-05-22 | 2018-05-22 | The virtual reality system of human body walking gesture stability |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108762498A (en) |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111093036A (en) * | 2020-01-17 | 2020-05-01 | 福州大学 | VR panoramic video interactive playing method based on limb recognition |
| CN111131916A (en) * | 2020-01-17 | 2020-05-08 | 福州大学 | Panoramic video interactive playing method based on treadmill |
| CN111131915A (en) * | 2020-01-17 | 2020-05-08 | 福州大学 | Panoramic video interactive playing method based on laser radar |
| CN111643886A (en) * | 2019-04-18 | 2020-09-11 | 成都奇天幻影数字娱乐有限公司 | Virtual reality walking control method based on IMU |
| CN112764545A (en) * | 2021-01-29 | 2021-05-07 | 重庆子元科技有限公司 | Virtual character motion synchronization method and terminal equipment |
| CN114176534A (en) * | 2021-11-25 | 2022-03-15 | 爱其服(杭州)科技有限公司 | Intelligent wearing system for metacarpal space |
| CN114724429A (en) * | 2022-03-10 | 2022-07-08 | 上海犀客信息科技有限公司 | Intelligent step pedal device for training child to return home independently |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103839564A (en) * | 2012-11-27 | 2014-06-04 | 西安嘉乐世纪机电科技有限公司 | Novel video player controlled through movement speed |
| CN105872698A (en) * | 2016-03-31 | 2016-08-17 | 宇龙计算机通信科技(深圳)有限公司 | Playing method, playing system and virtual reality terminal |
| CN106095136A (en) * | 2016-06-10 | 2016-11-09 | 北京行云时空科技有限公司 | A kind of wearable device controls the method for intelligent terminal |
| CN106200899A (en) * | 2016-06-24 | 2016-12-07 | 北京奇思信息技术有限公司 | The method and system that virtual reality is mutual are controlled according to user's headwork |
| CN106774881A (en) * | 2016-12-13 | 2017-05-31 | 歌尔科技有限公司 | A kind of instruction delivery method for wearable device, device and wearable device |
| US20170189815A1 (en) * | 2016-01-05 | 2017-07-06 | Acshun, Inc. | Wearable activity tracking systems and technology |
-
2018
- 2018-05-22 CN CN201810492928.4A patent/CN108762498A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103839564A (en) * | 2012-11-27 | 2014-06-04 | 西安嘉乐世纪机电科技有限公司 | Novel video player controlled through movement speed |
| US20170189815A1 (en) * | 2016-01-05 | 2017-07-06 | Acshun, Inc. | Wearable activity tracking systems and technology |
| CN105872698A (en) * | 2016-03-31 | 2016-08-17 | 宇龙计算机通信科技(深圳)有限公司 | Playing method, playing system and virtual reality terminal |
| CN106095136A (en) * | 2016-06-10 | 2016-11-09 | 北京行云时空科技有限公司 | A kind of wearable device controls the method for intelligent terminal |
| CN106200899A (en) * | 2016-06-24 | 2016-12-07 | 北京奇思信息技术有限公司 | The method and system that virtual reality is mutual are controlled according to user's headwork |
| CN106774881A (en) * | 2016-12-13 | 2017-05-31 | 歌尔科技有限公司 | A kind of instruction delivery method for wearable device, device and wearable device |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111643886A (en) * | 2019-04-18 | 2020-09-11 | 成都奇天幻影数字娱乐有限公司 | Virtual reality walking control method based on IMU |
| CN111093036A (en) * | 2020-01-17 | 2020-05-01 | 福州大学 | VR panoramic video interactive playing method based on limb recognition |
| CN111131916A (en) * | 2020-01-17 | 2020-05-08 | 福州大学 | Panoramic video interactive playing method based on treadmill |
| CN111131915A (en) * | 2020-01-17 | 2020-05-08 | 福州大学 | Panoramic video interactive playing method based on laser radar |
| CN112764545A (en) * | 2021-01-29 | 2021-05-07 | 重庆子元科技有限公司 | Virtual character motion synchronization method and terminal equipment |
| CN112764545B (en) * | 2021-01-29 | 2023-01-24 | 重庆子元科技有限公司 | Virtual character motion synchronization method and terminal equipment |
| CN114176534A (en) * | 2021-11-25 | 2022-03-15 | 爱其服(杭州)科技有限公司 | Intelligent wearing system for metacarpal space |
| CN114724429A (en) * | 2022-03-10 | 2022-07-08 | 上海犀客信息科技有限公司 | Intelligent step pedal device for training child to return home independently |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108762498A (en) | The virtual reality system of human body walking gesture stability | |
| US11748959B2 (en) | Device for simulating a virtual fitness partner and methods for use therewith | |
| JP6302088B2 (en) | Gaming device with camera installed in a freely rotatable manner | |
| JP6658545B2 (en) | Information processing apparatus, information processing method, and program | |
| US20170308166A1 (en) | Signal generation and detector systems and methods for determining positions of fingers of a user | |
| US9459454B1 (en) | Interactive social games on head-mountable devices | |
| US8979710B2 (en) | Adaptable exercise system and method | |
| US20170216675A1 (en) | Fitness-based game mechanics | |
| EP2922299A1 (en) | Systems and methods for converting sensory data to haptic effects | |
| CN106664401A (en) | Systems and methods for providing feedback to a user while interacting with content | |
| CN104759095A (en) | Virtual reality head wearing display system | |
| JP6814089B2 (en) | Object control system and object control method | |
| JP2011154565A (en) | Information processing program, information processing device, information processing method and information processing system | |
| US20200388190A1 (en) | Information processing apparatus, information processing method, and program | |
| JP7363804B2 (en) | Information processing device, information processing method, and recording medium | |
| WO2020012727A1 (en) | Information processing device, information processing method, and program | |
| Park et al. | Investigation of visual self-representation for a walking-in-place navigation system in virtual reality | |
| CN110989839B (en) | System and method for man-machine fight | |
| JP7441442B2 (en) | VR device, method, program and storage medium | |
| KR102433084B1 (en) | Player emotion analysis method for virtual reality game, player emotion-based virtual reality service management method and virtual reality system | |
| US20210402281A1 (en) | Adaptable exercise system and method | |
| WO2022252150A1 (en) | Virtual reality control method for avoiding motion sickness | |
| WO2020213301A1 (en) | Information processing device and information processing system | |
| TW202247870A (en) | Exercise method using virtual reality assistive technology and computer product as well as storage medium storing the same | |
| CN117752998A (en) | Data processing method, device, equipment and medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20181106 |