CN106251387A - A kind of imaging system based on motion capture - Google Patents
A kind of imaging system based on motion capture Download PDFInfo
- Publication number
- CN106251387A CN106251387A CN201610614295.0A CN201610614295A CN106251387A CN 106251387 A CN106251387 A CN 106251387A CN 201610614295 A CN201610614295 A CN 201610614295A CN 106251387 A CN106251387 A CN 106251387A
- Authority
- CN
- China
- Prior art keywords
- unit
- processing unit
- detection
- joints
- human
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T13/00—Animation
- G06T13/20—3D [Three Dimensional] animation
- G06T13/40—3D [Three Dimensional] animation of characters, e.g. humans, animals or virtual beings
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2200/00—Indexing scheme for image data processing or generation, in general
- G06T2200/08—Indexing scheme for image data processing or generation, in general involving all processing steps from image acquisition to 3D model generation
Abstract
The present invention relates to a kind of imaging system based on motion capture, including: detection of joints unit, multiple optical detection unit, processing unit and display unit, wherein, detection of joints unit, being used for detecting the active situation of each joint of human body, concurrent electric signals is to processing unit, optical detection unit, being used for gathering the limb activity situation of human body, concurrent electric signals is to processing unit；Described processing unit, accepts detection of joints unit and optical detection unit transmits the signal of telecommunication of coming, and is analyzed processing generation 3D rendering, and starts display unit, described display unit, the 3D rendering that playback process unit generates.The present invention is by joint when detection of joints unit and optical detection unit detection human motion and the movement locus of limbs, and be converted into the signal of telecommunication and be sent to processing unit, processing unit goes out to be transferred to three-dimensional rendering module after processing by analysis, drive the virtual human model in three-dimensional rendering module to represent the real-time action of human body.
Description
Technical field
The present invention relates to motion capture field, a kind of imaging system based on motion capture.
Background technology
Along with developing rapidly of motion capture technology, its field used is more and more wide, particularly in terms of video display
There is prominent performance.During production of film and TV, it usually needs motion capture technology realizes task action and captures, the now
Motion capture mode mainly include sense articulare catch and the big class of optics motion capture two, the former pass through in the joint of human body
Induction apparatus is installed, sets up coordinate points by computer and carry out action simulation；The latter mainly utilizes optical lens to enter the action of human body
The omnibearing seizure of row, such as, the Vicon MX optics motion capture system of its existing multiple optical lens composition, also there is one side
The body-sensing optics motion capture system caught.
In work, it is sometimes desirable to represent content by human action, it typically can be drilled by the way of animation
Show, but cartoon making difficulty is high and the cycle is long, be difficult to meet the most allegro working method, it is therefore desirable to a kind of low cost
Fast imaging system for particular time.
Summary of the invention
For the above, the invention provides a kind of imaging system based on motion capture, efficiently solve above-mentioned
At least one aspect in problem.
A kind of imaging system based on motion capture is employed technical scheme comprise that, bag in order to realize the purpose of the present invention
Include: detection of joints unit, multiple optical detection unit, processing unit and display unit, wherein,
Detection of joints unit, is used for detecting the active situation of each joint of human body, concurrent electric signals to processing unit,
Optical detection unit, is used for gathering the limb activity situation of human body, and concurrent electric signals is to processing unit；
Described processing unit, accept detection of joints unit and optical detection unit transmission come the signal of telecommunication, be analyzed
Process and generate 3D rendering, and start display unit,
Described display unit, the 3D rendering that playback process unit generates.
Further, described detection of joints unit is inertial sensor, and described inertial sensor is positioned at each joint of human body
Place, described inertial sensor is connected to processing unit by wireless device, thus, during human motion, inertia sensing
Movement locus at human synovial can be converted into the signal of telecommunication and be sent to processing unit by device.
Further, described optical detection unit is video camera, and described video camera faces human body, and described video camera is connected to
Processing unit, thus, during human motion, is converted into the signal of telecommunication by the movement locus of camera acquisition human body limb
It is sent to processing unit.
Further, described processing unit also includes three-dimensional rendering module, described three-dimensional rendering module built-in virtual human body mould
Type, thus, after the movement locus of processing module transmission human synovial and limbs is to three-dimensional rendering module, three-dimensional rendering module controls
Action is restored by virtual human model.
Further, described display module is LED display, and described LED display is connected to the outfan of processing unit, by
This, it is possible to the action of virtual portrait model is shown.
The present invention is by joint when detection of joints unit and optical detection unit detection human motion and the motion rail of limbs
Mark, and be converted into the signal of telecommunication and be sent to processing unit, processing unit goes out to be transferred to three-dimensional rendering module after processing by analysis, drives
Virtual human model in dynamic three-dimensional rendering module represents the real-time action of human body, and the action of virtual human model is passed through
Display unit shows, saves the time of cartoon making.
Meanwhile, the motion capture pattern single relative to tradition, the present invention uses detection of joints unit and optical detection list
The double check mode of unit, its precision is higher, and identification is higher.
Accompanying drawing explanation
Fig. 1 is the system structure schematic diagram of the present invention.
Fig. 2 is workflow diagram of the present invention.
Detailed description of the invention
The present invention is described in detail with specific embodiment below in conjunction with the accompanying drawings.
As shown in Figure 1 and Figure 2, a kind of imaging system based on motion capture, including: detection of joints unit, multiple optics are examined
Survey unit, processing unit and display unit.
Described detection of joints unit is inertial sensor, and it is provided with 17, and described inertial sensor is positioned at each of human body
Joint, such as rumpbone, left thigh, right thigh, left leg, right leg, left foot, right crus of diaphragm, left shoulder, right shoulder, vest, upper left
Arm, right upper arm, left forearm, right forearm, the left hand palm, the right hand palm and the back side of head, each inertial sensor is respectively connected with power supply, at this
In embodiment, inertial sensor built-in lithium battery, in other embodiments, inertial sensor can also external power supply.Human body will
After this complete equipment is dressed by tram, power supply opening, inertial sensor is made to gather the joint trajectories of human body, described used
Property sensor is connected to processing unit by wireless device, and thus, during human motion, inertial sensor can be by people
The movement locus of body joint is converted into the signal of telecommunication and is sent to processing unit.
Described optical detection unit is video camera, and described video camera is provided with 4, before described video camera faces human body
Face, below, the left side and the right side, described video camera is connected to processing unit by data wire, thus, in the process of human motion
In, limbs track during human motion can be recorded by video camera by camera lens, is similar to present body-sensing technology,
The movement locus gathering human body limb is converted into the signal of telecommunication and is sent to processing unit by rear video camera again.
Described processing unit includes three-dimensional rendering module, and described processing unit is accepting detection of joints unit and optical detection
After the signal of telecommunication that unit transmission comes, it it is analyzed and processes, and being transferred to three-dimensional rendering module, described three-dimensional rendering module
It is carried out distinguishing validity, crosses the border, automatically revise.
Detailed process is as follows:
1. select the position of joint and limbs, try to achieve the anglec of rotation of joint and limbs.
2. judge whether this Xuan Zhuanjiaodushi exceeds the range of activity in joint.Without the movable model beyond this joint
Enclose, then take.Otherwise, take no.
In the action reconstruction processes of virtual human model, first with 17 joints, and the motion of human body is regarded as these
The motion of articulare, the limbs track of comparison video camera shooting, rotates skeleton key point, displacement the most again, and scaling is inserted
The operations such as value.It is assured that the motion of skeleton.By the setting of skeleton is improved, reduce hardware captured information speed
The requirement of degree, improves the anti-interference of captured information, and ensure that the precision of captured information and data turn to a certain extent
Throw-over degree, improves reconstruction quality, and meets the requirement of real-time.
Three-dimensional rendering module includes: skeleton constraint and key frame difference, and described skeleton retrains: model inner skeleton is necessarily
Rigid structure, respective length is strictly fixed, and is to be linked by joint between skeleton, and joint is divided into two parts, below waist totally seven
A node part, head and neck and seven, an arm portion node part.Two parts the most independently calculate motion conditions.
Present invention employs Hierarchical Approach to mate, process is as follows: 1 sets waist joint as root node, this node
Adhere to a fixed coordinate system, only allow translational motion.Other joints set up kinetic coordinate system.As saved with waist joint for father
Point, the right lower limb linked therewith is with joint, and left lower limb is considered sub-joint with adjacent segments such as joints；2 calculate movement angle, root again
According to the joint rotation angle calculated, then three-dimensional animation model is mated, calculate animation according to the skeleton of animation model
The coordinate in each joint of model, in order to directly to drive virtual human model motion.
Key frame difference: general in computer animation have three kinds of interpolation algorithms.That is: linear interpolation algorithm, transfer point is about
Bundle condition interpolation algorithm and skeleton interpolation；Linear interpolation algorithm: choosing two secondary key frames, then computer calculates two secondary passes
The air line distance between corresponding point on key frame, thus calculate the interpolation point of centre, generate and draw in the middle of interpolation, i.e. intermediate frame；Move
A dynamic some constraints interpolation algorithm: one is put with animation physically some with the curve of spatial variations in time and is associated；
Framing structure interpolation: by the motion simulation to three dimensional skeletal structure, generates intermediate frame.
Described display module is LED display, and described LED display is connected to the outfan of processing unit, at three-dimensional wash with watercolours
After human action is reduced by dye module by virtual portrait model, the action that virtual portrait model reduces is shown by described display screen
Out view and admire for people.
Above the specific embodiment of the present invention is described.It is to be appreciated that the invention is not limited in above-mentioned
Particular implementation, those skilled in the art can make other deformation within the scope of the claims and improve, and these all belong to
In scope.
Claims (5)
1. an imaging system based on motion capture, including: detection of joints unit, multiple optical detection unit, processing unit
And display unit, wherein,
Detection of joints unit, is used for detecting the active situation of each joint of human body, concurrent electric signals to processing unit,
Optical detection unit, is used for gathering the limb activity situation of human body, and concurrent electric signals is to processing unit；
Described processing unit, accept detection of joints unit and optical detection unit transmission come the signal of telecommunication, be analyzed process
Generate 3D rendering, and start display unit,
Described display unit, the 3D rendering that playback process unit generates.
A kind of imaging system based on motion capture the most according to claim 1, it is characterised in that: described detection of joints list
Unit is inertial sensor, and described inertial sensor is positioned at each joint of human body, and described inertial sensor passes through wireless device
Being connected to processing unit, during human motion, the movement locus at human synovial can be converted into by inertial sensor
The signal of telecommunication is sent to processing unit.
A kind of imaging system based on motion capture the most according to claim 1, it is characterised in that: described optical detection list
Unit is video camera, and described video camera faces human body, and described video camera is connected to processing unit, during human motion,
It is converted into the signal of telecommunication by the movement locus of camera acquisition human body limb and is sent to processing unit.
A kind of imaging system based on motion capture the most according to claim 1, it is characterised in that: described processing unit is also
Including three-dimensional rendering module, the described built-in virtual human model of three-dimensional rendering module, processing module transmission human synovial and limbs
Movement locus to three-dimensional rendering module after, three-dimensional rendering module control virtual human model action is restored.
A kind of imaging system based on motion capture the most according to claim 1, it is characterised in that: described display module is
LED display, described LED display is connected to the outfan of processing unit, it is possible to the action of virtual portrait model demonstrated
Come.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610614295.0A CN106251387A (en) | 2016-07-29 | 2016-07-29 | A kind of imaging system based on motion capture |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610614295.0A CN106251387A (en) | 2016-07-29 | 2016-07-29 | A kind of imaging system based on motion capture |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106251387A true CN106251387A (en) | 2016-12-21 |
Family
ID=57605539
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610614295.0A Withdrawn CN106251387A (en) | 2016-07-29 | 2016-07-29 | A kind of imaging system based on motion capture |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106251387A (en) |
Cited By (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107422861A (en) * | 2017-07-31 | 2017-12-01 | 成都沃赢创投科技有限公司 | A kind of VR motion capture systems for individual military training |
| CN107485091A (en) * | 2017-04-17 | 2017-12-19 | 河南工程学院 | A kind of system and method that dress designing is carried out with body-sensing |
| CN107613223A (en) * | 2017-09-11 | 2018-01-19 | 广东欧珀移动通信有限公司 | Image processing method and device, electronic installation and computer-readable recording medium |
| CN107734265A (en) * | 2017-09-11 | 2018-02-23 | 广东欧珀移动通信有限公司 | Image processing method and device, electronic installation and computer-readable recording medium |
| CN108304064A (en) * | 2018-01-09 | 2018-07-20 | 上海大学 | More people based on passive optical motion capture virtually preview system |
| CN108537867A (en) * | 2018-04-12 | 2018-09-14 | 北京微播视界科技有限公司 | According to the Video Rendering method and apparatus of user's limb motion |
| WO2018177075A1 (en) * | 2017-03-31 | 2018-10-04 | 腾讯科技（深圳）有限公司 | Method and apparatus for simulating human body in virtual reality, storage medium, and electronic apparatus |
| CN109407840A (en) * | 2018-10-18 | 2019-03-01 | 看见故事（苏州）影视文化发展有限公司 | A kind of visual angle effect method of motion capture technology |
| CN110035236A (en) * | 2019-03-26 | 2019-07-19 | 北京字节跳动网络技术有限公司 | Image processing method, device and electronic equipment |
| CN110826422A (en) * | 2019-10-18 | 2020-02-21 | 北京量健智能科技有限公司 | System and method for obtaining motion parameter information |
| CN111097142A (en) * | 2019-12-19 | 2020-05-05 | 武汉西山艺创文化有限公司 | Motion capture motion training method and system based on 5G communication |
| CN111402290A (en) * | 2020-02-29 | 2020-07-10 | 华为技术有限公司 | Action restoration method and device based on skeleton key points |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20080285805A1 (en) * | 2007-03-15 | 2008-11-20 | Xsens Technologies B.V. | Motion Tracking System |
| CN101579238A (en) * | 2009-06-15 | 2009-11-18 | 吴健康 | Human motion capture three dimensional playback system and method thereof |
| CN102221887A (en) * | 2011-06-23 | 2011-10-19 | 康佳集团股份有限公司 | Interactive projection system and method |
| CN103279186A (en) * | 2013-05-07 | 2013-09-04 | 兰州交通大学 | Multiple-target motion capturing system integrating optical localization and inertia sensing |
| CN103488291A (en) * | 2013-09-09 | 2014-01-01 | 北京诺亦腾科技有限公司 | Immersion virtual reality system based on motion capture |
| CN104700433A (en) * | 2015-03-24 | 2015-06-10 | 中国人民解放军国防科学技术大学 | Vision-based real-time general movement capturing method and system for human body |
| CN104771892A (en) * | 2015-04-02 | 2015-07-15 | 深圳市虚拟现实科技有限公司 | Synchronous display method and system based on virtual reality |
-
2016
- 2016-07-29 CN CN201610614295.0A patent/CN106251387A/en not_active Withdrawn
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20080285805A1 (en) * | 2007-03-15 | 2008-11-20 | Xsens Technologies B.V. | Motion Tracking System |
| CN101579238A (en) * | 2009-06-15 | 2009-11-18 | 吴健康 | Human motion capture three dimensional playback system and method thereof |
| CN102221887A (en) * | 2011-06-23 | 2011-10-19 | 康佳集团股份有限公司 | Interactive projection system and method |
| CN103279186A (en) * | 2013-05-07 | 2013-09-04 | 兰州交通大学 | Multiple-target motion capturing system integrating optical localization and inertia sensing |
| CN103488291A (en) * | 2013-09-09 | 2014-01-01 | 北京诺亦腾科技有限公司 | Immersion virtual reality system based on motion capture |
| CN104700433A (en) * | 2015-03-24 | 2015-06-10 | 中国人民解放军国防科学技术大学 | Vision-based real-time general movement capturing method and system for human body |
| CN104771892A (en) * | 2015-04-02 | 2015-07-15 | 深圳市虚拟现实科技有限公司 | Synchronous display method and system based on virtual reality |
Cited By (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2018177075A1 (en) * | 2017-03-31 | 2018-10-04 | 腾讯科技（深圳）有限公司 | Method and apparatus for simulating human body in virtual reality, storage medium, and electronic apparatus |
| CN107485091A (en) * | 2017-04-17 | 2017-12-19 | 河南工程学院 | A kind of system and method that dress designing is carried out with body-sensing |
| CN107422861B (en) * | 2017-07-31 | 2020-02-07 | 成都沃赢创投科技有限公司 | VR (virtual reality) action capturing system for military training of individual soldiers |
| CN107422861A (en) * | 2017-07-31 | 2017-12-01 | 成都沃赢创投科技有限公司 | A kind of VR motion capture systems for individual military training |
| CN107734265A (en) * | 2017-09-11 | 2018-02-23 | 广东欧珀移动通信有限公司 | Image processing method and device, electronic installation and computer-readable recording medium |
| CN107613223A (en) * | 2017-09-11 | 2018-01-19 | 广东欧珀移动通信有限公司 | Image processing method and device, electronic installation and computer-readable recording medium |
| CN108304064A (en) * | 2018-01-09 | 2018-07-20 | 上海大学 | More people based on passive optical motion capture virtually preview system |
| CN108537867A (en) * | 2018-04-12 | 2018-09-14 | 北京微播视界科技有限公司 | According to the Video Rendering method and apparatus of user's limb motion |
| CN108537867B (en) * | 2018-04-12 | 2020-01-10 | 北京微播视界科技有限公司 | Video rendering method and device according to user limb movement |
| CN109407840A (en) * | 2018-10-18 | 2019-03-01 | 看见故事（苏州）影视文化发展有限公司 | A kind of visual angle effect method of motion capture technology |
| CN110035236A (en) * | 2019-03-26 | 2019-07-19 | 北京字节跳动网络技术有限公司 | Image processing method, device and electronic equipment |
| CN110826422A (en) * | 2019-10-18 | 2020-02-21 | 北京量健智能科技有限公司 | System and method for obtaining motion parameter information |
| CN111097142A (en) * | 2019-12-19 | 2020-05-05 | 武汉西山艺创文化有限公司 | Motion capture motion training method and system based on 5G communication |
| CN111402290A (en) * | 2020-02-29 | 2020-07-10 | 华为技术有限公司 | Action restoration method and device based on skeleton key points |
| CN111402290B (en) * | 2020-02-29 | 2023-09-12 | 华为技术有限公司 | Action restoration method and device based on skeleton key points |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106251387A (en) | A kind of imaging system based on motion capture | |
| CN103399637B (en) | Based on the intelligent robot man-machine interaction method of kinect skeleton tracing control | |
| CN107833271B (en) | Skeleton redirection method and device based on Kinect | |
| CN102221887B (en) | Interactive projection system and method | |
| AU2006282764B2 (en) | Capturing and processing facial motion data | |
| CN106426200B (en) | A kind of ping-pong robot and its control method | |
| CN108154550A (en) | Face real-time three-dimensional method for reconstructing based on RGBD cameras | |
| CN107742097B (en) | Human behavior recognition method based on depth camera | |
| CN104461013A (en) | Human body movement reconstruction and analysis system and method based on inertial sensing units | |
| CN104731342B (en) | It is a kind of to gather the inertia action seizure system and its operation method for catching subjects face expression at the same time | |
| CN108127669A (en) | A kind of robot teaching system and implementation based on action fusion | |
| EP1335322A3 (en) | Method of determining body motion from captured image data | |
| CN108379818A (en) | A kind of technology analysis system and method for swimming exercise | |
| CN104424650B (en) | A kind of arm information compensation method in optical profile type human body motion capture | |
| CN104766345B (en) | Body scan data and motion capture method based on garment features point | |
| CN108171728A (en) | Unmarked moving object pose recovery method and device based on Hybrid camera system | |
| WO2017118284A1 (en) | Passive optical motion capture device, and application thereof | |
| CN109411268A (en) | A kind of rail traction substation control cabinet button vision positioning method | |
| CN111383348A (en) | Method for remotely and synchronously controlling robot through virtual reality | |
| CN108434698B (en) | Sports ball game teaching system | |
| CN215264708U (en) | Interactive wearable multimedia device | |
| CN209231437U (en) | A kind of sliding detection device of urban track traffic heat | |
| CN207888651U (en) | A kind of robot teaching system based on action fusion | |
| CN115482320A (en) | Equipment and method for capturing human motion posture | |
| CN205598601U (en) | Portable motion data trapping apparatus |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WW01 | Invention patent application withdrawn after publication |
Application publication date: 20161221 |
|
| WW01 | Invention patent application withdrawn after publication |