CN107016711A - A kind of human body intelligent detecting and tracking physical simulation system - Google Patents
A kind of human body intelligent detecting and tracking physical simulation system Download PDFInfo
- Publication number
- CN107016711A CN107016711A CN201710106375.XA CN201710106375A CN107016711A CN 107016711 A CN107016711 A CN 107016711A CN 201710106375 A CN201710106375 A CN 201710106375A CN 107016711 A CN107016711 A CN 107016711A
- Authority
- CN
- China
- Prior art keywords
- data
- artis
- physical
- simulation system
- physical simulation
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T11/00—2D [Two Dimensional] image generation
- G06T11/20—Drawing from basic elements, e.g. lines or circles
- G06T11/203—Drawing of straight lines or curves
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T1/00—General purpose image data processing
- G06T1/20—Processor architectures; Processor configuration, e.g. pipelining
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- Processing Or Creating Images (AREA)
Abstract
A kind of human body intelligent detecting and tracking physical simulation system, whole system is made up of image capturing system, three parts of physical simulation system and image drawing system, and image capturing system is responsible for Intelligent Dynamic and caught and bone binding；Physical simulation system by based on Box2D physical engines analog module with being constituted based on GPU physical data real-time processing modules；Image drawing system is constituted by based on Bezier real-time rendering module.The present invention realizes real-time, the instantaneity of human-computer interaction of physical simulation, two kinds of new and high technologies is organically combined to reach interactive resonating effect between experiencer based on being gathered to camera review and using GPU high-speed parallel treatment characteristics.
Description
Technical field
The present invention relates to human body intelligent detecting and tracking physical simulation techniques field, and in particular to dynamic bone seizure immediately,
Image identification, physical simulation techniques.
Background technology
It is main imitative with Microsoft's body-sensing and various physical engines in human body intelligent detecting and tracking technology physicses simulation field
True technology, various new and high technology rows instantly, but all Human Detection is not entered with physical simulation technology all the time
Row is preferably combined, so that showing effect typically, not only can not fully be showed the glamour of new and high technology, can not be given experiencer
Bring the pleasant sensation of new and high technology.
The content of the invention
It is an object of the invention to provide a kind of science popularization display systems based on virtual reality technology and vivid platform technology,
To solve the problems mentioned in the above background technology.
To achieve the above object, the present invention provides following technical scheme：
A kind of human body intelligent detecting and tracking physical simulation system, it is characterised in that：Whole system is by image capturing system, thing
Manage three parts of simulation system and image drawing system to constitute, image capturing system is responsible for Intelligent Dynamic seizure and bound with bone；
Physical simulation system by based on Box2D physical engines analog module with being constituted based on GPU physical data real-time processing modules；Image
Drawing system is constituted by based on Bezier real-time rendering module；
The body-sensing camera used is the Kinect bis- generations somatosensory devices of Microsoft, and the official storehouse issued using Microsoft is called
Body-sensing bone binds interface, obtains the data of participant's 25 artis of whole body, while on the basis of original official storehouse, removing
The larger data of error.In two-dimentional engine, the skeleton data obtained, by three-dimensional position and direction data conversion
For 2-D data, a set of participant each skeleton point is now just obtained in the data for projection of two dimensional surface, is used between skeleton point
There is the artis of physical attribute to connect for several, remove gravitational effects, participant is in mobile four limbs and body, bone
The position and direction of point can change, and now artis can follow skeleton point to move due to the effect of two sections of skeleton point pulling force
Dynamic, artis has physical attribute, due to effect of inertia, and the mobile of artis position can lag behind the movement of skeleton point, more lean on
Paracentral artis is delayed more obvious, thus just forms the effect with flexibility and draftability, finally, utilizes two-dimentional engine
Drawing function, artis is depicted as to being shown to the curve at interface in order, for smooth effect, bezier curve is used
Mode is drawn.
The data of described acquisition participant's 25 artis of whole body include the position and direction of three dimensions, specially head
Portion, four limbs, shoulder, the skeleton data of vertebra complete set.
Described somatosensory device can recognize 6 sets of complete skeleton data simultaneously, so many people can be supported to participate in behaviour
Make.
The present invention realizes physical simulation based on being gathered to camera review and using GPU high-speed parallel treatment characteristics
Real-time, the instantaneity of human-computer interaction, two kinds of new and high technologies are organically combined interactive between experiencer to reach
Resonating effect.
The beneficial effects of the invention are as follows：
1) GPU parallel processing techniques are used, by the extension to GPU, the concurrent computing of many GPU architectures is realized, solves fortune
The problem of calculating not instant, can reach physical analogy of completion in 30ms substantially.
2) it is taken based on quaternion algebra to bind according to the bone of progress, very big breakthrough has conveniently been obtained in real-time interactive.
3) Bezier rendering technique is used, makes the lines of picture more smooth.
4) exploitation based on body-sensing two generations equipment, substantially increases the stability of view data.
5)
Brief description of the drawings
Fig. 1 is present invention generation system module pie graph.
Embodiment
Below in conjunction with accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is carried out clear, complete
Ground is described, it is clear that described embodiment is only a part of embodiment of the invention, rather than whole embodiments.Based on this
Embodiment in invention, the every other reality that those of ordinary skill in the art are obtained under the premise of creative work is not made
Example is applied, the scope of protection of the invention is belonged to.
A kind of embodiment provided with reference to Fig. 1, the present invention：A kind of human body intelligent detecting and tracking physical simulation system, it is special
Levy and be：Whole system is made up of image capturing system, three parts of physical simulation system and image drawing system, IMAQ
System is responsible for Intelligent Dynamic and caught and bone binding；Physical simulation system has based on Box2D physical engine analog modules with being based on
GPU physical datas real-time processing module is constituted；Image drawing system is constituted by based on Bezier real-time rendering module；
The body-sensing camera used is the Kinect bis- generations somatosensory devices of Microsoft, and the official storehouse issued using Microsoft is called
Body-sensing bone binds interface, obtains the data of participant's 25 artis of whole body, while on the basis of original official storehouse, removing
The larger data of error.In two-dimentional engine, the skeleton data obtained, by three-dimensional position and direction data conversion
For 2-D data, a set of participant each skeleton point is now just obtained in the data for projection of two dimensional surface, is used between skeleton point
There is the artis of physical attribute to connect for several, remove gravitational effects, participant is in mobile four limbs and body, bone
The position and direction of point can change, and now artis can follow skeleton point to move due to the effect of two sections of skeleton point pulling force
Dynamic, artis has physical attribute, due to effect of inertia, and the mobile of artis position can lag behind the movement of skeleton point, more lean on
Paracentral artis is delayed more obvious, thus just forms the effect with flexibility and draftability, finally, utilizes two-dimentional engine
Drawing function, artis is depicted as to being shown to the curve at interface in order, for smooth effect, bezier curve is used
Mode is drawn.
The data of described acquisition participant's 25 artis of whole body include the position and direction of three dimensions, specially head
Portion, four limbs, shoulder, the skeleton data of vertebra complete set.
Described somatosensory device can recognize 6 sets of complete skeleton data simultaneously, so many people can be supported to participate in behaviour
Make.
Although an embodiment of the present invention has been shown and described, for the ordinary skill in the art, can be with
A variety of changes, modification can be carried out to these embodiments, replace without departing from the principles and spirit of the present invention by understanding
And modification, the scope of the present invention is defined by the appended.
Claims (3)
1. a kind of human body intelligent detecting and tracking physical simulation system, it is characterised in that：Whole system is by image capturing system, physics
Three parts of simulation system and image drawing system are constituted, and image capturing system is responsible for Intelligent Dynamic seizure and bound with bone；Thing
Manage simulation system by based on Box2D physical engines analog module with being constituted based on GPU physical data real-time processing modules；Image is painted
System processed is constituted by based on Bezier real-time rendering module；
The body-sensing camera used is the Kinect bis- generations somatosensory devices of Microsoft, and body-sensing is called in the official storehouse issued using Microsoft
Bone binds interface, obtains the data of participant's 25 artis of whole body, while on the basis of original official storehouse, removing error
Larger data.In two-dimentional engine, three-dimensional position and direction data are converted to two by the skeleton data obtained
Dimension data, now just obtains data for projection of each skeleton point of a set of participant in two dimensional surface, with some between skeleton point
The individual artis with physical attribute is connected, and removes gravitational effects, participant in mobile four limbs and body, skeleton point
Position and direction can change, and now artis can follow skeleton point to move due to the effect of two sections of skeleton point pulling force, close
Node has physical attribute, due to effect of inertia, and the mobile of artis position can lag behind the movement of skeleton point, closer to center
Artis it is delayed more obvious, thus just form the effect with flexibility and draftability, finally, utilize the drawing of two-dimentional engine
Function, artis is depicted as in order to be shown to the curve at interface, for smooth effect, painted using the mode of bezier curve
System.
2. a kind of human body intelligent detecting and tracking physical simulation system according to claim 1, it is characterised in that：Described obtains
Taking the data of 25 artis of participant's whole body includes the position and direction of three dimensions, specially head, four limbs, shoulder, ridge
The skeleton data of vertebra complete set.
3. a kind of human body intelligent detecting and tracking physical simulation system according to claim 1, it is characterised in that：Described body
Sense equipment can recognize 6 sets of complete skeleton data simultaneously, so many people's Attended Operations can be supported.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710106375.XA CN107016711A (en) | 2017-02-27 | 2017-02-27 | A kind of human body intelligent detecting and tracking physical simulation system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710106375.XA CN107016711A (en) | 2017-02-27 | 2017-02-27 | A kind of human body intelligent detecting and tracking physical simulation system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107016711A true CN107016711A (en) | 2017-08-04 |
Family
ID=59440526
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710106375.XA Pending CN107016711A (en) | 2017-02-27 | 2017-02-27 | A kind of human body intelligent detecting and tracking physical simulation system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107016711A (en) |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103440677A (en) * | 2013-07-30 | 2013-12-11 | 四川大学 | Multi-view free stereoscopic interactive system based on Kinect somatosensory device |
| CN104038738A (en) * | 2014-06-04 | 2014-09-10 | 东北大学 | Intelligent monitoring system and intelligent monitoring method for extracting coordinates of human body joint |
| CN104750397A (en) * | 2015-04-09 | 2015-07-01 | 重庆邮电大学 | Somatosensory-based natural interaction method for virtual mine |
-
2017
- 2017-02-27 CN CN201710106375.XA patent/CN107016711A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103440677A (en) * | 2013-07-30 | 2013-12-11 | 四川大学 | Multi-view free stereoscopic interactive system based on Kinect somatosensory device |
| CN104038738A (en) * | 2014-06-04 | 2014-09-10 | 东北大学 | Intelligent monitoring system and intelligent monitoring method for extracting coordinates of human body joint |
| CN104750397A (en) * | 2015-04-09 | 2015-07-01 | 重庆邮电大学 | Somatosensory-based natural interaction method for virtual mine |
Non-Patent Citations (2)
| Title |
|---|
| 李昕迪等: "基于 Kinect的人体姿势识别算法与实现", 《模式识别与仿真》 * |
| 陈寅: "三维人体模型的生成技术研究", 《中国博士学位论文全文数据库 信息科技辑》 * |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2022183775A1 (en) | Method for fusing multiple locomotion mechanisms in hybrid reinforcement teaching scene | |
| CN103529944B (en) | A kind of human motion recognition method based on Kinect | |
| CN109885163A (en) | A kind of more people's interactive cooperation method and systems of virtual reality | |
| CN104200516A (en) | Method and system for showing three dimension model of plant | |
| CN105107200A (en) | Face change system and method based on real-time deep somatosensory interaction and augmented reality technology | |
| CN106030491A (en) | Hover interactions across interconnected devices | |
| CN109732593B (en) | Remote control method and device for robot and terminal equipment | |
| CN103207667A (en) | Man-machine interaction control method and application thereof | |
| CN102306386A (en) | Method for quickly constructing third dimension tree model from single tree image | |
| CN203630822U (en) | Virtual image and real scene combined stage interaction integrating system | |
| CN113221726A (en) | Hand posture estimation method and system based on visual and inertial information fusion | |
| CN102254346A (en) | Method for detecting augmented reality virtual-real collision based on cloud computing | |
| CN103745218A (en) | Gesture identification method and device in depth image | |
| CN108628455B (en) | Virtual sand painting drawing method based on touch screen gesture recognition | |
| CN110503707A (en) | A kind of true man's motion capture real-time animation system and method | |
| CN102467749A (en) | Three-dimensional virtual human body movement generation method based on key frames and spatiotemporal restrictions | |
| Zheng et al. | Seam the real with the virtual: a review of augmented reality | |
| CN202487010U (en) | Military boxing on-line teaching system based on internet platform | |
| CN107016711A (en) | A kind of human body intelligent detecting and tracking physical simulation system | |
| Mariappan et al. | Picolife: A computer vision-based gesture recognition and 3D gaming system for android mobile devices | |
| CN110490165A (en) | A kind of dynamic hand tracking method based on convolutional neural networks | |
| CN205460934U (en) | Augmented reality game station based on motion capture | |
| CN205721737U (en) | A kind of ancient painting stereoscopic experience device | |
| CN106267817A (en) | Virtual reality system for game | |
| CN106021750A (en) | Generation method and generation system for simulation scene and reconstruction unit thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20170804 |