CN109284006A - A kind of human motion capture device and method - Google Patents
A kind of human motion capture device and method Download PDFInfo
- Publication number
- CN109284006A CN109284006A CN201811334444.3A CN201811334444A CN109284006A CN 109284006 A CN109284006 A CN 109284006A CN 201811334444 A CN201811334444 A CN 201811334444A CN 109284006 A CN109284006 A CN 109284006A
- Authority
- CN
- China
- Prior art keywords
- human body
- unit
- data
- limbs
- human
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 37
- 210000003414 extremity Anatomy 0.000 claims abstract description 105
- 230000005021 gait Effects 0.000 claims abstract description 56
- 238000001514 detection method Methods 0.000 claims abstract description 43
- 230000007613 environmental effect Effects 0.000 claims abstract description 35
- 230000009471 action Effects 0.000 claims abstract description 31
- 238000006073 displacement reaction Methods 0.000 claims abstract description 30
- 210000003141 lower extremity Anatomy 0.000 claims abstract description 17
- 238000004422 calculation algorithm Methods 0.000 claims description 18
- 230000000295 complement effect Effects 0.000 claims description 17
- 238000001914 filtration Methods 0.000 claims description 16
- 238000005070 sampling Methods 0.000 claims description 5
- 238000004364 calculation method Methods 0.000 claims description 4
- 230000001186 cumulative effect Effects 0.000 claims description 4
- 238000005259 measurement Methods 0.000 description 37
- 230000001133 acceleration Effects 0.000 description 22
- 238000005516 engineering process Methods 0.000 description 12
- 238000004458 analytical method Methods 0.000 description 7
- 230000005291 magnetic effect Effects 0.000 description 7
- 210000000689 upper leg Anatomy 0.000 description 7
- 238000010586 diagram Methods 0.000 description 5
- 210000002414 leg Anatomy 0.000 description 5
- 238000009825 accumulation Methods 0.000 description 4
- 230000008569 process Effects 0.000 description 4
- 238000012360 testing method Methods 0.000 description 4
- 230000008859 change Effects 0.000 description 3
- 239000000284 extract Substances 0.000 description 3
- 230000004927 fusion Effects 0.000 description 3
- 230000005484 gravity Effects 0.000 description 3
- 210000001624 hip Anatomy 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 238000012545 processing Methods 0.000 description 3
- 230000009885 systemic effect Effects 0.000 description 3
- 238000012549 training Methods 0.000 description 3
- 230000003044 adaptive effect Effects 0.000 description 2
- 238000009795 derivation Methods 0.000 description 2
- 238000009826 distribution Methods 0.000 description 2
- 238000005265 energy consumption Methods 0.000 description 2
- 210000000245 forearm Anatomy 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 230000009191 jumping Effects 0.000 description 2
- 239000000203 mixture Substances 0.000 description 2
- 210000004197 pelvis Anatomy 0.000 description 2
- 230000008447 perception Effects 0.000 description 2
- 238000011897 real-time detection Methods 0.000 description 2
- 230000003068 static effect Effects 0.000 description 2
- 241000208340 Araliaceae Species 0.000 description 1
- 206010017577 Gait disturbance Diseases 0.000 description 1
- 235000005035 Panax pseudoginseng ssp. pseudoginseng Nutrition 0.000 description 1
- 235000003140 Panax quinquefolius Nutrition 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 210000000988 bone and bone Anatomy 0.000 description 1
- QBWCMBCROVPCKQ-UHFFFAOYSA-N chlorous acid Chemical compound OCl=O QBWCMBCROVPCKQ-UHFFFAOYSA-N 0.000 description 1
- 230000019771 cognition Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000004590 computer program Methods 0.000 description 1
- 238000013144 data compression Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 201000010099 disease Diseases 0.000 description 1
- 208000037265 diseases, disorders, signs and symptoms Diseases 0.000 description 1
- 238000005183 dynamical system Methods 0.000 description 1
- 239000004744 fabric Substances 0.000 description 1
- 230000008713 feedback mechanism Effects 0.000 description 1
- 239000003302 ferromagnetic material Substances 0.000 description 1
- 235000008434 ginseng Nutrition 0.000 description 1
- 230000036541 health Effects 0.000 description 1
- 210000001699 lower leg Anatomy 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 239000003550 marker Substances 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 239000011159 matrix material Substances 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 230000035772 mutation Effects 0.000 description 1
- 238000007500 overflow downdraw method Methods 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 230000002035 prolonged effect Effects 0.000 description 1
- 210000002303 tibia Anatomy 0.000 description 1
- 238000002604 ultrasonography Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
Abstract
The invention discloses a kind of human motion capture device and corresponding methods, described device includes movement measuring unit, action reference variable unit, initialization unit, gait detection unit, displacement integrated unit, and movement measuring unit measures human body limb movement data and environmental data;Action reference variable unit merges human body limb movement data and environmental data, derives the kinematic parameter and environmental parameter of limbs;Initialization unit by between human body limb mutual restrictive condition and kinematical boundary condition be integrated into come, derive the initial operational parameter of human motion capture device;Gait detection unit detects the state of contacting to earth of current time human body lower limbs, obtains gait detection information;Displacement integrated unit is derived and exports the posture and location information of mass motion of the human body relative to the earth.The present invention has the characteristics that portability and practicability, is very suitable to be made into wearable capturing movement and analytical equipment, has in numerous areas and is widely applied.
Description
Technical field
This application involves human motion cognition technology fields, and in particular to a kind of sensor-based human motion capture dress
It sets and relevant human motion capture method.
Background technique
It now, can be according to each limbs of sportsman by perceiving and obtaining accurate human body attitude and position motion information
Motion trail analysis there are the problem of and improve training, can infer disease that may be present according to the variation of body gait,
High-caliber 3D game can be established according to the tracking of body motion information, can be tracked as counting according to human motion posture
Word film, virtual world construct lifelike role.But the randomness of human motion and complexity, human peripheral place
The diversity of environment, all to accurately human motion perception and acquisition bring huge challenge in real time.Therefore, it is badly in need of at present
It is a kind of not limited and be overcome human motion perception and the acquiring technology of external environmental interference by space-time, realize human body attitude and
The acquisition and reproduction of position motion information are health monitoring, rehabilitation training, dance training, sports analysis, film number
The application in the fields such as stunt, virtual reality, game and human-computer interaction provides key technology.
Currently, common capturing movement technology can be roughly divided into two types.
It is a kind of mainly to use high-precision video camera array.This kind of system is caught using the camera of multiple high-precision high sampling rates
The reflective marker on sporter joint is caught, product Vicon such as in the market.The patented technology of this respect has: application No. is
20080192116 United States Patent (USP) Real-time objects tracking and motion capture in sports
Event is a real-time moving target tracking system, it carrys out detection and tracking moving target using multiple video cameras, but does not relate to
And the movement details of target itself;The United States Patent (USP) System and method for motion of Patent No. 7457439
Capture is restored using the location information and sporter's three-dimensional motion model indicated with video camera sporter obtained
The three-dimensional motion information of body out, and three-dimensional motion model is utilized, compare motion state;Chinese patent " is obtained based on movement
Colored tight ", application number 00264404, devise it is a kind of human body is encoded with color lump movement obtain clothing;China
Patent " methods that processing passive optical movement obtains data ", application number 03120688 are that a kind of processing passive optical is moved and obtained
The method for evidence of fetching, comprising: the synchronization multiple-camera image for obtaining the subject with passive optical label, from the number of acquisition
According to one group of three-dimensional coordinate for obtaining label, correspondence in time between respectively marking in continuously acquiring is determined, so that it is determined that having
The position of the body part of the subject of label determines the fortune that subject motion projection arrives based on marking made by one group
The angle of each connection of movable model, and calculate the posture of subject;Chinese patent " the calibration of a kind of pair of multicamera system
Method and device ", application number 200710062825 are that a kind of multiple-camera is rebuild based on the three-dimensional motion information of index point
New method.The defect of this kind of system is that they need fixed laboratory, there are light and occlusion issue, when use by
The limitation in place and application scenarios;This kind of system uses the camera of multiple high-precision high sampling rates, and not only cost is extremely high
It is expensive, and structure is extremely complex, uses inconvenience;Also, the data volume of this kind of system processing is huge, cannot be in real time
Capture body motion information.
It is another kind of to use microsensor, it is attached on human body limb, measures and the three-dimensional position angle for estimating each limbs etc.
Motion information.This kind of microsensor is small in size, low energy consumption, measurement is direct, easy to wear, while not being limited by space-time, very
It is suitble to be made into the motion analyzing apparatus of wearing.The patented technology of this respect has: United States Patent (USP) System and Method for
Motion Capture in Natural Environments, IPC8 class: AGO1C2300FI, using being placed on parts of body
Ultrasound emission source and receiver, measure the position of corresponding site, then the corner gone out with inertia sensor measurement is come calibrating position
Measurement, to obtain the kinematic parameter of body.But due to having used ultrasonic sensor and inertial sensor (acceleration sensing
Device and gyroscope), making entirely to move acquisition system becomes complicated.200920108961.9 human motion capture three of Chinese patent
Dimension playback system proposes that a kind of only use or the main movement using microsensor obtain system, and whole system is with human motion
It include that sensor places wearing, the estimation of kinematic parameter, the constraint between kinematic parameter, human body three-dimensional based on model
The motion reappearance of image.This kind of system presently, there are technological challenge include that microsensor has its intrinsic problem, such as measure
Noise is big, and there are systemic bias;Inertial sensor can only measure change rate, and what it is such as accelerometer measures is acceleration, gyroscope
Measurement is angular speed, directly carries out integral estimated location and angular movement information to it, can generate the inclined of amount of exercise valuation
It moves;It is distributed measurement that microsensor, which carries out human motion estimation, i.e., sensor unit is respectively attached to each of human body
On limbs, whole posture and the position of human body can not be directly obtained.201110060074.0 human motion capture of Chinese patent dress
It sets and a kind of portable body motion capture devices is provided, joined using the estimation human motion of self-adapted sensor Data fusion technique
Number is merged and is estimated human body entirety using the initialization technique and Displacement Estimation technology of human motion capture device
The posture and location information of movement, this kind of system presently, there are technological challenge include that microsensor has its intrinsic problem,
Such as measure that noise is big, and there are systemic bias;Using complementary kalman filter method to each limb motion data and environmental data into
Row fusion, for larger interference or prolonged interference there are still very big error, four kinds of measurement models dynamic select at any time,
Increase calculation amount, reduces iterative rate;The algorithm is based on heterogeneous linear Filtering Model, improves the complexity of whole system;Noise
Quickly accumulative at any time with drift, cumulative errors are significant in the short time;Displacement algorithm is just for single and relatively simple movement
Gait.
Summary of the invention
Dedicated laboratory is needed, using by place to solve to have the capturing movement technology based on video camera array
Limitation, there are light and occlusion issue, and cost is extremely expensive, and data volume is huge, is difficult to handle in real time;And have based on miniature
The capturing movement technology measurement noise of sensor is big, and there are systemic bias, complementary Kalman filtering algorithm can not be eliminated for a long time
With larger interference to the error of the Attitude estimation of human body, location estimation is more single and simple, therefore asks using limited technology
Topic and technological challenge are transported the purpose of the present invention is estimating human body sport parameter using Data Fusion of Sensor technology using human body
The initialization technique and Displacement Estimation technology of dynamic acquisition equipment are merged and are estimated posture and the position of human body mass motion
Confidence breath, provides a kind of portable motion capture device thus.
In order to achieve the object of the present invention, one aspect of the present invention proposes that a kind of human motion capture device, including movement are surveyed
Measure unit, action reference variable unit, initialization unit, gait detection unit, displacement integrated unit, wherein motion measurement list
Member is for measuring human body limb movement data and environmental data;Action reference variable unit, for the human body limb movement
Data and environmental data are merged, and derive the kinematic parameter and environmental parameter of limbs;Initialization unit is used for human body
Mutual restrictive condition and kinematical boundary condition between limbs, which are integrated into, to be come, and derives the initial fortune of human motion capture device
Row parameter;Gait detection unit obtains gait detection information for detecting the state of contacting to earth of current time human body lower limbs;Displacement
Integrated unit, for receiving and to the initial operational parameter of the kinematic parameter of each limbs of human body, human motion capture device, each
Mutual restrictive condition and gait detection information between the length of limbs, each limbs are merged, and are derived and are exported human body phase
For the posture and location information of the mass motion of the earth.
According to the preferred embodiment of the present invention, the movement measuring unit includes multiple microsensor nodes and at least
One control unit, wherein the microsensor node is for sampling and measuring each limb motion data and environmental data;
Described control unit obtains the data of each microsensor node, and is sent to the action reference variable unit.
According to the preferred embodiment of the present invention, the action reference variable unit is using complementary Kalman filtering system pair
Each limb motion data and environmental data are merged, and derive the three-dimensional perspective valuation in each limb motion parameter.
According to the preferred embodiment of the present invention, it states gait detection unit and is also used to update complementary Kalman filtering system shape
State is to eliminate the liftoff rear cumulative errors generated of human body.
According to the preferred embodiment of the present invention, the gait detection unit includes support phase detection module, the module base
In azimuth of the sensor coordinate system of original I MU sensing data and current predictive relative to global coordinate system, and based on sensing
Device signal characteristic judges which gait phase foot's node is in.
According to the preferred embodiment of the present invention, gait detection unit executes the gait detection algorithm based on signal characteristic,
Posture of original sensor data, lower limb each sensor coordinate system of the algorithm based on each lower limb node with respect to global coordinate system
And the state compensation error of complementary Kalman filtering system output.
According to the preferred embodiment of the present invention, gait detection unit will support on the basis of gait phase detection algorithm
The rate integrating mean value in window is fixed during phase as drift caused by integral in window time equivalent, in swing phase product
It is removed when dividing estimating speed displacement.
According to the preferred embodiment of the present invention, the displacement integrated unit utilizes the initial fortune of human motion capture device
The kinematic parameter of each limbs of human body is transformed under body coordinate system by row parameter from sensor coordinate system, obtains body coordinate system
Under each limb motion parameter, and with human body generate and export the appearance of the mass motion of human body together relative to the displacement of the earth
State and location information.
Another aspect of the present invention proposes a kind of human motion capture method, comprising: measurement human body limb movement data and ring
Border data;The human body limb movement data and environmental data are merged, derive the kinematic parameter and environment ginseng of limbs
Number;By between human body limb mutual restrictive condition and kinematical boundary condition be integrated into come, derive human motion capture device
Initial operational parameter;The state of contacting to earth for detecting current time human body lower limbs, obtains gait detection information;It receives and to human body
The kinematic parameter of each limbs, the initial operational parameter of human motion capture device, the length of each limbs, the phase between each limbs
Mutual restrictive condition and gait detection information are merged, and the posture of mass motion of the human body relative to the earth is derived and export
And location information.
Beneficial effects of the present invention: the present invention is divided using the multiple microsensor nodes being attached on each limbs of human body
The exercise data and environmental data of each limbs are not measured.This microsensor, it is small in size, low energy consumption, measurement directly, cost
It is economical;It is easy to use, it is not controlled by space-time;Data volume is small, is able to carry out generating date and analysis;And light is not present
Line and occlusion issue, have the characteristics that portability and practicability, are very suitable to be made into wearable capturing movement and analysis dress
It sets, has in numerous areas and be widely applied, there is stronger practical value and application prospect.
Detailed description of the invention
Fig. 1 is the overall logic structural block diagram of the human motion capture device of one embodiment of the invention;
Fig. 2 is the structural block diagram of the movement measuring unit of one embodiment of the invention;
Fig. 3 is each important multiple microsensor node distribution maps of limbs of the human body of one embodiment of the invention;
Fig. 4 is structural block diagram of the action reference variable unit to action reference variable of one embodiment of the invention;
Fig. 5 is three coordinate systems in the human motion capture device of one embodiment of the invention and the pass between them
System;
Fig. 6 is the flow chart of the displacement integrated unit of one embodiment of the invention;
Fig. 7 is lower limb structure figure used in gait detection unit of the invention.
Specific embodiment
Specific embodiments of the present invention are described more fully below, it should be noted that the embodiments described herein is served only for illustrating
Illustrate, is not intended to restrict the invention.In the following description, in order to provide a thorough understanding of the present invention, a large amount of spies are elaborated
Determine details.It will be apparent, however, to one skilled in the art that: this need not be carried out using these specific details
Invention.In other instances, in order to avoid obscuring the present invention, well known structure, material or method are not specifically described.Entire
In specification, " one embodiment ", " embodiment ", " example " or " example " is referred to means that: in conjunction with the embodiment
Or a particular feature, structure, or characteristic of example description is comprised at least one embodiment of the invention.Therefore, it is entirely saying
Bright book it is each place occur the phrase " in one embodiment ", " in embodiment ", " example " or " example " it is different
It establishes a capital and refers to the same embodiment or example.Furthermore, it is possible in any suitable combination and/or sub-portfolio is by specific feature, structure
Or property combination is in one or more embodiment or examples.In addition, it should be understood by one skilled in the art that making here
Term "and/or" includes any and all combinations for the project that one or more correlations are listed.
Fig. 1 is the overall logic structural block diagram of motion capture devices of the present invention, and as shown in fig. 1, the present invention is by moving
Measuring unit 100, action reference variable unit 200, initialization unit 300, gait detection unit 400 and displacement integrated unit
500 compositions, in which:
Multiple microsensor nodes in movement measuring unit 100 are attached on each limbs of human body, for measuring and obtaining
To each limb motion data and environmental data;
The structure of movement measuring unit 100 includes: multiple microsensor nodes and one or several control units,
Each microsensor node has a unique address, by data/address bus by all microsensor nodes and control unit
It connects together, control unit selects different microsensor nodes by address bus, sends out to each microsensor node
Cloth control command obtains each road measurement data of each microsensor node, and hereafter control unit passes through wirelessly or non-wirelessly side
Formula is connect with action reference variable unit 200, and fetched data is uniformly sent to action reference variable unit 200.
Microsensor node includes microsensor and microcontroller, in which: microsensor is that miniature three-dimensional accelerates
It is a kind of or more to spend meter, miniature three-dimensional gyroscope, miniature three-dimensional magnetometer, miniature ultrasonic rangefinder or miniature ultra wide band rangefinder
Kind combination, for sampling and measuring each limb motion data and environmental data;Exercise data includes three-dimensional acceleration measurement data
With three-dimensional angular velocity measurement data, environmental data is three-dimensional magnetic field intensity measurement data;Microcontroller controls microsensor
Each limb motion data and environmental data are sampled and measured, and the exercise data of measurement and environmental data are packaged by wireless
The mode of connection is sent to control unit.
Action reference variable unit 200 is merged to the exercise data and environmental data of movement measuring unit 100,
It derives the kinematic parameter and environmental parameter of each limbs, also uses complementary kalman filter method to each limb motion in derivation
Data and environmental data are merged, and derive the three-dimensional perspective valuation in each limb motion parameter;The kinematic parameter of each limbs
Including three-dimensional acceleration valuation, three-dimensional velocity valuation, three-D displacement valuation, three-dimensional angular velocity valuation and three-dimensional perspective valuation, ring
Border parameter includes three-dimensional magnetic field intensity valuation.
Complementary Kalman filtering algorithm establishes error model, inclined with attitude error, displacement error, velocity error, gyroscope
Setting with the error of magnetic disturbance is state variable, and feedback mechanism is used in inertial navigation system, utilizes accelerometer observational variable
Error of tilt in gyroscope integral is compensated, using the compensation of magnetometer observation and gyroscope integral field component error, in conjunction with people
Body forward motion theory, merge gait detection information, after detecting support phase, can be performed ZUPT (zero velocity update) and
ZARU (zero angular velocity update), modifies the covariance matrix of algorithm, to be modified to system estimation state.In entire mistake
Cheng Zhong, two bias terms (the acceleration biasing and offset of gyroscope) moment in filtering algorithm keep updating, posture, speed and
Meeting zero setting after each iteration of position estimation error quantity of state updates, so that the drift of state estimation caused by integral be inhibited to miss
Difference.Algorithm makes full use of the output data of accelerometer and magnetometer, and drift caused by compensation gyroscope integral and interference fringe come
Angle estimation error, have significant correcting action to the real-time tracking of human body attitude.
Initialization unit 300, for receiving the kinematic parameter and environmental parameter of each limbs, and by the length of each limbs, each
Mutual restrictive condition and kinematical boundary condition between limbs, which are integrated into, to be come, and derives the initial fortune of human motion capture device
Row parameter.
The step of derivation human motion capture device initial operational parameter of initialization unit 300 is: human body is according to movement side
Boundary's condition makes initialization posture, at the same initialization unit 300 receive action reference variable unit 100 send in real time it is initial
The kinematic parameter and environmental parameter of each limbs under the conditions of change posture;According to the mutual restrictive condition between each limbs, attachment is established
Between multiple microsensor nodes on each limbs of human body topological relation mapping, then by kinematical boundary condition, initialization
The kinematic parameter of each limbs of human body and environmental parameter, which are integrated into, under the conditions of posture comes, and uses Bayesian network dynamical system again
It is filtered, derives the initial operational parameter of human motion capture device.
The initial operational parameter includes: the sensor coordinates of each microsensor node of movement measuring unit 100
It is the 210 three-dimensional perspective deviation and three-dimensional position deviation relative to the body coordinate system 220 of each limbs;220 phase of body coordinate system
For the initial three-dimensional perspective and initial three-dimensional position of global coordinate system 230;Wherein: the sensor coordinate system 210 is movement
The coordinate system of each of measuring unit 100 microsensor node itself;The body coordinate system 220 is each limb of human body
The coordinate system of body;The global coordinate system 230 is earth coordinates.
The kinematical boundary condition includes: human body when moving on level ground, the position of limbs landing part it is vertical
Component is zero;Human body done on level ground on foot, side step, sliding steps, mark time, run and when jumping, limbs landing part
Three-dimensional velocity and three-dimensional angular velocity be zero;Human body is stood naturally on level ground, and two are eyed to the front, then human body back
Place plane and level ground near normal and with human body direction of visual lines near normal;After human body is put one's palms together devoutly, if two when movement
The centre of the palm is opposite always, and ten fingers are opposite always, then two hand positions are approximately equal.
Gait detection unit 400 for detecting the state of contacting to earth of current time lower limb, while updating complementary Kalman's filter
Wave system mode is to eliminate the liftoff rear cumulative errors generated of human body, wherein including support phase detection module, which is to be based on
Azimuth of the sensor coordinate system of original I MU sensing data and current predictive relative to global coordinate system, and it is based on sensor
Signal characteristic judges which gait phase foot's node is in.To overcome motion complexity and signal noise to movement abnormal gait
The erroneous judgement of situation, gait detection unit 400 realizes a kind of gait simultaneously and mutually detects the mechanism that erroneous judgement is eliminated, after the two combines
The state of movement gait can be accurately detected for the gait motion of the overwhelming majority.
Original sensor data (mainly acceleration of the gait detection algorithm based on signal characteristic based on each lower limb node
And angular velocity data), each sensor coordinate system of lower limb it is defeated with respect to the posture of global coordinate system (quaternary number) and complementary filter algorithm
State compensation error out, support phase detection module is to motion state and gait phase real-time detection.Specifically by sensor coordinates
Initial data under system is transformed into global coordinate system, while isolating acceleration of motion.Herein on basis, extract useful
One of sensor signal (acceleration and gyroscope, or both) gait is mutually carried out roughly using the method for threshold test
Detection, the selection of threshold value largely using offline selection, can also be used adaptive threshold and choose mode (need to complete offline).
Judge the basic thought eliminated by accident are as follows: in the gait motion of short time (in such as of short duration several movement gait cycles),
The gait phase testing result at neighbouring sample moment can not generate mutation, and the data of IMU sensing unit are because by more in environment
There may be errors for kind interference, and then the testing result based on signal characteristic is caused to there is erroneous judgement.
It will on the basis of gait phase detection algorithm to reduce the speed estimation error generated by score accumulation drift
The rate integrating mean value in window is fixed during support phase as drift caused by integral in window time equivalent, is being swung
(speed displacement calibration) is removed when phase integral estimating speed is displaced, substantially thinking is as follows: in a gait cycle, support
During phase, each set time window updates integrating rate mean value, using this mean value as drift error.During swing phase, integral
Speed subtracts the drift error of final updating.
Be displaced integrated unit 500, for receive and to the kinematic parameter of each limbs, human motion capture device it is initial
Operating parameter and human body are merged relative to the displacement of the earth, derive and export posture and the position of the mass motion of human body
Confidence breath.Step is: using the initial operational parameter of human motion capture device by the kinematic parameter of each limbs of human body from sensing
Device coordinate system 210 is transformed under body coordinate system 220, obtains each limb motion parameter under body coordinate system 220, and and people
Body generates together and exports the posture and location information of the mass motion of human body relative to the displacement of the earth.
Here, we are formed miniature with three-dimensional micro accelerometer, three-dimensional micro gyroscope and three-dimensional micro magnetometer
Sensor node as an example, introduces the workflow and system structure of motion capture devices of the present invention.
Fig. 2 is the detailed composition figure of human motion capture device movement measuring unit 100, it gives signal simultaneously and adopts
Collection, process flow.Movement measuring unit 100 is made of multiple microsensor nodes and one or several control units.It is miniature
Sensor node can be connected with the wired mode of data/address bus with control unit, and control unit is in turn with side wirelessly or non-wirelessly
Formula is connected with master computer, and master computer is desk-top or portable.Action reference variable unit 200 is in a software form in analytic accounting
It is realized on calculation machine.One complete DATA REASONING s process is: assuming that sample rate was fs hertz, in each 1/fs seconds time slot
Interior, movement measuring unit 100 can be completed to act as follows, send a data acquisition instructions, micro sensing by control unit first
Microcontroller on device node starts to acquire data after receiving instruction;After the completion of acquisition, control unit by data-interface according to
The secondary data for receiving each microsensor node;After the data for having collected all microsensor nodes, control unit by this
A little data compressions are packaged, and are sent to communication interface.
In the above-mentioned methods, three-dimensional micro magnetometer, three dimension acceleration sensor and three-dimensional gyroscope are all optional.
According to the difference of the application, it can choose one such or two kinds, or even do not select any one therein, delete corresponding
Hardware constitutes new implementation method.
Human motion capture device of the present invention, as Fig. 3 shows each important multiple microsensor Node distributions of limbs of human body
Figure, limbs include: head, upper waist, middle waist, lower waist, left upper arm, left forearm, left hand, right upper arm, right forearm, the right hand, left thigh,
Left leg, left foot, right thigh and right crus of diaphragm need 16-20 microsensor node.The number of microsensor node, can be with
Increased or deleted according to application;The placement location of each microsensor node and direction, which are also not, to be fixed not
Become, can be adjusted according to using needs.In this example, each microsensor node includes microcontroller, three
Tie up accelerometer, three-dimensional gyroscope and three dimensional magnetometer.
If each limbs of human body wear movement measuring unit 100, each limb motion parameter of human body is ok
It measures and estimates.If we have been set up human skeleton model, the real-time capture and reproduction of human motion are exactly
It is possible.However, movement measuring unit 100 is worn on each limbs, if not doing the initial of human motion capture device
Change, then, the difference for dressing position each time can all influence measurement and estimated result, meanwhile, distributed measurement also can not be direct
Obtain whole posture and the position of human body.
For the human motion capture device for using high-precision video camera, all are carried out under earth coordinates.
As Fig. 5 shows three coordinate systems in human motion capture device and the relationship between them, comprising: sensor coordinate system
210, body coordinate system 220 and global coordinate system 230.Sensor coordinate system 210 is each of movement measuring unit 100
The coordinate system of microsensor node itself, each of movement measuring unit 100 microsensor node, there is one
With the mutually independent coordinate system of other nodes, the measurement data of each node is obtained under the sensor coordinate system of its own
, the kinematic parameter for each limbs that action reference variable unit 200 estimates is also relative to miniature biography accompanying on each limbs
The coordinate system of sensor node;Body coordinate system 220 is the coordinate system of each limbs of human body;Global coordinate system 230 is that the earth is sat
Mark system.In order to which each of distributed measurement, under respective sensor coordinate system, movement measuring unit 100 is miniature
Exercise data measured by sensor node and environmental data are united, and the kinematic parameter of all limbs is unified to one
Under coordinates frame, to obtain the mass motion of human body, and removes 100 wearing position difference of movement measuring unit and movement is caught
Obtain the influence with valuation, the mutual restrictive condition and moving boundaries item of initialization unit 300 of the invention according to each limbs of human body
Part sets the initial value and initial parameter of human motion capture device.Mutual restrictive condition between each limbs of human body, is each
Interconnection and interaction relation between limbs, if left thigh is connected to left leg, left leg is connected to left foot, left thigh fortune
The dynamic movement for being able to drive left leg and left foot, but together with left thigh is not directly coupled with left foot, the movement of left thigh
Foot can only be driven to move together by left leg.In addition, the movement of people is present in earth coordinates, human motion includes
Two parts, first is that in body coordinate system 220 each limbs movement, second is that three-dimensional position of the human body in global coordinate system 230
It moves, that is, movement of the body coordinate system 220 relative to global coordinate system 230.The present invention derives human body using gait as clue
Three-D displacement relative to earth coordinates.
Action reference variable unit 200, initialization unit 300, gait detection unit 400 and displacement is described in detail below
Integrated unit 500;When introducing action reference variable unit 200, the present invention is only estimated with the three-dimensional perspective of complementary Kalman filtering
It is illustrated for meter method:
As above, each microsensor node includes microcontroller and three-dimensional accelerometer, three-dimensional gyroscope and three-dimensional
These three microsensors of magnetometer.It, can be with using the three-dimensional perspective estimation method of complementary Kalman filtering provided by the invention
Estimate accurate three-dimensional angle of each surveyed limbs of microsensor node under sensor coordinate system 210.
The measurement of three-dimensional micro accelerometer is three-dimensional acceleration measurement data, and what measurement obtained in a stationary situation is gravity
Acceleration analysis data, be capable of providing the rotation angle of microsensor node with respect to the horizontal plane be inclination angle (Pitch) and
Roll angle (Roll);
Three dimensional magnetometer measurement is three-dimensional magnetic field intensity measurement data, is capable of providing microsensor node around vertical side
It is yaw angle (Yaw) to the angle of rotation, principle is similar to compass;
Three-dimensional gyroscope measurement is three-dimensional angular velocity measurement data, can be obtained to three-dimensional angular velocity measurement data integral
Three-dimensional rotation angle.
Influence of the accuracy for three kinds of microsensor data that microsensor node measurement obtains by many aspects,
It is the measurement accuracy and error of three kinds of microsensors first, physical message is being converted to digital signal by microsensor
Inevitably there is error in the process.Secondly as the data of microsensor measurement will receive interference, such as three-dimensional micro-
What type accelerometer measurement obtained is three-dimensional acceleration measurement data, and what is measured in static or quasi-static situation is gravity
Acceleration analysis data, but biggish human motion acceleration can be introduced when human body quickly moves;Three-dimensional micro magnetometer
Measurement is three-dimensional earth magnetic field intensity measurement data, but the data that actual measurement obtains will receive ferromagnetic material around
Magnetic interference.In addition, when carrying out integral to three-dimensional angular velocity measurement data and seeking angle, digital signal error it is tired
Product can generate the drift error built up with the time.So merging to obtain angle carrying out information to these three data
Spend information during, it is necessary first to these microsensor data are denoised, calibrate and temperature-compensating pretreatment, then
It needs to consider various possible disturbed conditions, extracts available information therein as far as possible.On the other hand, the requirement of real-time of system
Our fusion method can have low computation complexity in the case where guaranteeing the accuracy of estimation as far as possible.
Based on above analysis, the angle for the complementary Kalman filtering that action reference variable unit 200 of the present invention provides is estimated
Meter method, flow chart as shown in figure 4,
Obtained original observed data is measured movement measuring unit 100 first and carries out pretreatment operation, and pretreatment includes
Denoising, calibration and temperature-compensating.After pretreatment, the method for other kinematic parameters of the estimation of action reference variable unit 200
In the same way, details are not described herein again.The kinematic parameter that note action reference variable unit 200 is estimated is that it represents microsensor
Kinematic parameter and environmental parameter of the surveyed limbs of node in moment t under sensor coordinate system 210, it may include three dimensional angular
Degree, i.e., the accurate three-dimensional angle estimated by the three-dimensional perspective estimation method of above-mentioned complementary Kalman filtering can also include three
Tie up location estimate, three-dimensional velocity valuation, three-dimensional acceleration valuation, three-dimensional perspective valuation and three-dimensional magnetic field intensity valuation.If people
Each limbs of body wear n microsensor node in movement measuring unit 100, then, the three-dimensional position angle of each limbs
Degree can be obtained using the three-dimensional perspective estimation method of complementary Kalman filtering.However, action reference variable unit 200 is estimated
The three-dimensional position angle for each limbs counted out is the sensor coordinate system relative to microsensor node accompanying on each limbs
Under, it is necessary to by under the orientation angles unification a to coordinates frame of all limbs, the mass motion appearance of human body could be obtained
State and location information.In addition, motion measurement 110 is worn on each limbs, the difference for dressing position each time can all influence to survey
Amount and estimated result,
Thus initial operational parameter of the initialization unit estimation in addition to human motion capture device.It is opposite in order to obtain human body
In the movement of the earth, need to estimate three-D displacement of the human body under earth coordinates.Displacement can be by each limbs of human body three
The dual-integration of acceleration of motion is tieed up to obtain.But since the three-dimensional acceleration that action reference variable unit estimation goes out measures
Data are the vector sum of acceleration of gravity and human motion acceleration under sensor coordinate system 210, thus need first to separate
Human motion component of acceleration, and the three-dimensional perspective obtained using action reference variable unit 200 by it from sensor coordinate system
Be transformed under 210 under global coordinate system 230, then to quadratic integral can just obtain human body each limbs during the motion
Displacement.But since the unknown of integral constant, action reference variable unit 200 estimate obtained three-dimensional perspective information error
In the presence of the presence drifted about with three-dimensional micro accelerometer itself, the error that integral obtains position can be flat with growing into for time
The accumulation of square coefficient, the position obtained later is quite unreliable within several seconds.
Unlimitedly increase to constrain to drift about in integral process, need to introduce kinematical boundary condition, as zero velocity updates
Algorithm.The present invention provides a kind of gait detection algorithm based on signal characteristic, i.e. gait detection unit 400 moves to detect
State.The basic skills of zero velocity more new algorithm be done on level ground using human body on foot, side step, sliding steps, mark time, run
Step and when jumping, lower margin three-dimensional velocity and three-dimensional angular velocity be zero this kinematical boundary condition, this section that foot lands
Time is referred to as support phase;During valuation, the foot in support phase remains static, and the foot in this period is arranged
Speed is zero, to reduce the accumulation of error among each for being limited on foot by the accumulation of error strides.The unit
To motion state and gait phase real-time detection, the initial data under sensor coordinate system is specifically transformed into global coordinate system,
Acceleration of motion is isolated simultaneously.Herein basis on, extract useful sensor signal (acceleration and gyroscope, or both
One of) gait is mutually detected roughly using the method for threshold test, the selection of threshold value is largely using offline choosing
It selects, adaptive threshold can also be used and choose mode (need to complete offline).
The present invention is displaced integrated unit method flow diagram as shown in fig. 6, gait detection unit 400 detects what human body landed
Limbs, determine human body lower margin;According to kinematical boundary condition, gait time parameter is detected;And to action reference variable unit
The 200 each limb motion parameters of human body and environmental parameter for capturing and deriving, 300 initial operational parameter institute of initialization unit
The initial operational parameter for the human motion capture device derived, the mutual limitation item between the length of each limbs, each limbs
Part is further merged, and by the above parameter, the data of kinematical boundary condition are transmitted to human body using human cinology
Each limbs, to acquire displacement of the human body relative to the earth.This example remembers that pelvis is root node, illustrates by taking root node as an example
The basic skills of human cinology's transmitting, associated is each limbs of human body lower limbs.Each limbs of human body lower limbs are mainly by seven pieces
Bone forms, and lower limb structure figure used in Displacement Estimation unit as shown in Figure 7 includes pelvis, left and right femur, left and right shin bone
With left and right foot, the present invention transmits displacement information between each limbs of lower limb using human cinology, to obtain root node
Displacement.
It should be appreciated that in order to simplify the present invention and help it will be understood by those skilled in the art that various aspects of the invention,
Above in the description of exemplary embodiment of the present invention, each feature of the invention is retouched in a single embodiment sometimes
It states, or is described referring to single figure.But the feature that should not be construed to include in exemplary embodiment by the present invention is equal
For the essential features of patent claims.
It should be appreciated that can be carried out to module, unit, component for including in the equipment of one embodiment of the present of invention etc.
It is adaptively changed so that they are arranged in equipment unlike this embodiment.Can include the equipment of embodiment
Disparate modules, unit or assembly are combined into module, a unit or assembly, and also they can be divided into multiple submodule, son are single
Member or sub-component.
Module, unit or assembly in the embodiment of the present invention can realize in hardware, can also with one or
The software mode run on multiple processors is realized, or is implemented in a combination thereof.Those skilled in the art should manage
Microprocessor or digital signal processor (DSP) can be used in practice to realize according to embodiments of the present invention in solution.This
Invention be also implemented as some or all computer program product by executing method as described herein or based on
On calculation machine readable medium.
Claims (10)
1. a kind of human motion capture device, including movement measuring unit, action reference variable unit, initialization unit, gait
Detection unit, displacement integrated unit, wherein
Movement measuring unit is for measuring human body limb movement data and environmental data;
Action reference variable unit derives limbs for merging to the human body limb movement data and environmental data
Kinematic parameter and environmental parameter;
Initialization unit, for by between human body limb mutual restrictive condition and kinematical boundary condition be integrated into come, derive
The initial operational parameter of human motion capture device;
Gait detection unit obtains gait detection information for detecting the state of contacting to earth of current time human body lower limbs;
It is displaced integrated unit, the initial launch of kinematic parameter, human motion capture device for receiving and to each limbs of human body
Parameter, the length of each limbs, the mutual restrictive condition between each limbs and gait detection information are merged, and are derived and are exported
Posture and location information of the human body relative to the mass motion of the earth.
2. human motion capture device as described in claim 1, which is characterized in that the movement measuring unit includes multiple micro-
Type sensor node and at least one control unit, wherein
The microsensor node is for sampling and measuring each limb motion data and environmental data;
Described control unit obtains the data of each microsensor node, and is sent to the action reference variable unit.
3. human motion capture device as described in claim 1, which is characterized in that the action reference variable unit is using mutual
It mends Kalman filtering system to merge each limb motion data and environmental data, derives three in each limb motion parameter
Tie up angle valuation.
4. human motion capture device as claimed in claim 3, which is characterized in that the gait detection unit is also used to update
Complementary Kalman filtering system state is to eliminate the liftoff rear cumulative errors generated of human body.
5. human motion capture device as claimed in claim 3, which is characterized in that the gait detection unit includes support phase
Detection module, sensor coordinate system of the module based on original I MU sensing data and current predictive is relative to global coordinate system
Azimuth, and judge which gait phase foot's node is in based on sensor signal features.
6. human motion capture device as claimed in claim 5, which is characterized in that gait detection unit executes special based on signal
The gait detection algorithm of sign, original sensor data, lower limb each sensor coordinate system of the algorithm based on each lower limb node are opposite
The posture of global coordinate system and the state compensation error of complementary Kalman filtering system output.
7. human motion capture device as claimed in claim 6, which is characterized in that gait detection unit mutually detects calculation in gait
On the basis of method, using the rate integrating mean value fixed during support phase in window as caused by integral in window time equivalent
Drift is removed when swinging the displacement of phase integral estimating speed.
8. human motion capture device as claimed in claim 6, which is characterized in that the displacement integrated unit is transported using human body
The kinematic parameter of each limbs of human body is transformed into body from sensor coordinate system (210) and sat by the initial operational parameter of dynamic acquisition equipment
Under mark system (220), each limb motion parameter under body coordinate system (220) is obtained, and and displacement one of the human body relative to the earth
Act the posture and location information for generating and exporting the mass motion of human body.
9. a kind of human motion capture method, comprising:
Measure human body limb movement data and environmental data;
The human body limb movement data and environmental data are merged, derive the kinematic parameter and environmental parameter of limbs;
By between human body limb mutual restrictive condition and kinematical boundary condition be integrated into come, derive human motion capture device
Initial operational parameter;
The state of contacting to earth for detecting current time human body lower limbs, obtains gait detection information;
Receive and to the length of the initial operational parameter of the kinematic parameter of each limbs of human body, human motion capture device, each limbs,
Mutual restrictive condition and gait detection information between each limbs are merged, and are derived and are exported human body relative to the whole of the earth
The posture and location information of body movement.
10. human motion capture method as claimed in claim 9, which is characterized in that the action reference variable unit uses
Complementary Kalman filtering system merges each limb motion data and environmental data, derives in each limb motion parameter
Three-dimensional perspective valuation.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201811334444.3A CN109284006B (en) | 2018-11-09 | 2018-11-09 | Human motion capturing device and method |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201811334444.3A CN109284006B (en) | 2018-11-09 | 2018-11-09 | Human motion capturing device and method |
Publications (2)
Publication Number | Publication Date |
---|---|
CN109284006A true CN109284006A (en) | 2019-01-29 |
CN109284006B CN109284006B (en) | 2024-01-16 |
Family
ID=65175274
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201811334444.3A Active CN109284006B (en) | 2018-11-09 | 2018-11-09 | Human motion capturing device and method |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN109284006B (en) |
Cited By (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN109781104A (en) * | 2019-01-31 | 2019-05-21 | 深圳创维数字技术有限公司 | Athletic posture determination and localization method, device, computer equipment and medium |
CN111298289A (en) * | 2020-03-05 | 2020-06-19 | 中国科学院苏州生物医学工程技术研究所 | Immersive multi-person multi-sensing monitoring virtual reality device |
CN111353543A (en) * | 2020-03-04 | 2020-06-30 | 镇江傲游网络科技有限公司 | Motion capture data similarity measurement method, device and system |
CN112562068A (en) * | 2020-12-24 | 2021-03-26 | 北京百度网讯科技有限公司 | Human body posture generation method and device, electronic equipment and storage medium |
CN116019442A (en) * | 2022-12-12 | 2023-04-28 | 天津大学 | Motion posture assessment system based on UWB/IMU fusion |
WO2023221524A1 (en) * | 2022-05-20 | 2023-11-23 | 北京航天时代光电科技有限公司 | Human movement intelligent measurement and digital training system |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101579238A (en) * | 2009-06-15 | 2009-11-18 | 吴健康 | Human motion capture three dimensional playback system and method thereof |
CN102323854A (en) * | 2011-03-11 | 2012-01-18 | 中国科学院研究生院 | Human motion capture device |
CN104613964A (en) * | 2015-01-30 | 2015-05-13 | 中国科学院上海高等研究院 | Pedestrian positioning method and system for tracking foot motion features |
CN105043385A (en) * | 2015-06-05 | 2015-11-11 | 北京信息科技大学 | Self-adaption Kalman filtering method for autonomous navigation positioning of pedestrians |
-
2018
- 2018-11-09 CN CN201811334444.3A patent/CN109284006B/en active Active
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101579238A (en) * | 2009-06-15 | 2009-11-18 | 吴健康 | Human motion capture three dimensional playback system and method thereof |
CN102323854A (en) * | 2011-03-11 | 2012-01-18 | 中国科学院研究生院 | Human motion capture device |
CN104613964A (en) * | 2015-01-30 | 2015-05-13 | 中国科学院上海高等研究院 | Pedestrian positioning method and system for tracking foot motion features |
CN105043385A (en) * | 2015-06-05 | 2015-11-11 | 北京信息科技大学 | Self-adaption Kalman filtering method for autonomous navigation positioning of pedestrians |
Cited By (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN109781104A (en) * | 2019-01-31 | 2019-05-21 | 深圳创维数字技术有限公司 | Athletic posture determination and localization method, device, computer equipment and medium |
CN111353543A (en) * | 2020-03-04 | 2020-06-30 | 镇江傲游网络科技有限公司 | Motion capture data similarity measurement method, device and system |
CN111298289A (en) * | 2020-03-05 | 2020-06-19 | 中国科学院苏州生物医学工程技术研究所 | Immersive multi-person multi-sensing monitoring virtual reality device |
CN112562068A (en) * | 2020-12-24 | 2021-03-26 | 北京百度网讯科技有限公司 | Human body posture generation method and device, electronic equipment and storage medium |
CN112562068B (en) * | 2020-12-24 | 2023-07-14 | 北京百度网讯科技有限公司 | Human body posture generation method and device, electronic equipment and storage medium |
WO2023221524A1 (en) * | 2022-05-20 | 2023-11-23 | 北京航天时代光电科技有限公司 | Human movement intelligent measurement and digital training system |
CN116019442A (en) * | 2022-12-12 | 2023-04-28 | 天津大学 | Motion posture assessment system based on UWB/IMU fusion |
CN116019442B (en) * | 2022-12-12 | 2024-05-14 | 天津大学 | Motion posture assessment system based on UWB/IMU fusion |
Also Published As
Publication number | Publication date |
---|---|
CN109284006B (en) | 2024-01-16 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN102323854B (en) | Human motion capture device | |
CN109284006A (en) | A kind of human motion capture device and method | |
US9401025B2 (en) | Visual and physical motion sensing for three-dimensional motion capture | |
CN101579238B (en) | Human motion capture three dimensional playback system and method thereof | |
KR101751760B1 (en) | Method for estimating gait parameter form low limb joint angles | |
US20100194879A1 (en) | Object motion capturing system and method | |
Destelle et al. | Low-cost accurate skeleton tracking based on fusion of kinect and wearable inertial sensors | |
CN106153077B (en) | A kind of initialization of calibration method for M-IMU human motion capture system | |
Ahmadi et al. | 3D human gait reconstruction and monitoring using body-worn inertial sensors and kinematic modeling | |
Peppoloni et al. | A novel 7 degrees of freedom model for upper limb kinematic reconstruction based on wearable sensors | |
CN201431466Y (en) | Human motion capture and thee-dimensional representation system | |
KR101214227B1 (en) | method of motion tracking. | |
CN110609621B (en) | Gesture calibration method and human motion capture system based on microsensor | |
Zheng et al. | Pedalvatar: An IMU-based real-time body motion capture system using foot rooted kinematic model | |
Salehi et al. | Body-IMU autocalibration for inertial hip and knee joint tracking | |
CN109242887A (en) | A kind of real-time body's upper limks movements method for catching based on multiple-camera and IMU | |
CN113793360A (en) | Three-dimensional human body reconstruction method based on inertial sensing technology | |
JP2016006415A (en) | Method and apparatus for estimating position of optical marker in optical motion capture | |
US20180216959A1 (en) | A Combined Motion Capture System | |
GB2466714A (en) | Hybrid visual and physical object tracking for virtual (VR) system | |
Li et al. | Visual–inertial fusion-based human pose estimation: A review | |
Ahmadi et al. | Human gait monitoring using body-worn inertial sensors and kinematic modelling | |
CN109453505A (en) | A kind of multi-joint method for tracing based on wearable device | |
Lin et al. | Using hybrid sensoring method for motion capture in volleyball techniques training | |
CN108874146A (en) | A kind of movement human mass center displacement calculation method applied in virtual reality system |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |