CN107961531A - A kind of virtual social system and its method of work based on motion capture dress ornament - Google Patents
A kind of virtual social system and its method of work based on motion capture dress ornament Download PDFInfo
- Publication number
- CN107961531A CN107961531A CN201711259238.6A CN201711259238A CN107961531A CN 107961531 A CN107961531 A CN 107961531A CN 201711259238 A CN201711259238 A CN 201711259238A CN 107961531 A CN107961531 A CN 107961531A
- Authority
- CN
- China
- Prior art keywords
- electromagnetic field
- field radiation
- user
- dress ornament
- radiation device
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/20—Input arrangements for video game devices
- A63F13/21—Input arrangements for video game devices characterised by their sensors, purposes or types
- A63F13/212—Input arrangements for video game devices characterised by their sensors, purposes or types using sensors worn by the player, e.g. for measuring heart beat or leg activity
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/20—Input arrangements for video game devices
- A63F13/22—Setup operations, e.g. calibration, key configuration or button assignment
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/40—Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment
- A63F13/42—Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle
- A63F13/428—Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle involving motion or position input signals, e.g. signals representing the rotation of an input controller or a player's arm motions sensed by accelerometers or gyroscopes
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/50—Controlling the output signals based on the game progress
- A63F13/52—Controlling the output signals based on the game progress involving aspects of the displayed game scene
- A63F13/525—Changing parameters of virtual cameras
- A63F13/5255—Changing parameters of virtual cameras according to dedicated instructions from a player, e.g. using a secondary joystick to rotate the camera around a player's character
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
- A63F2300/80—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game specially adapted for executing a specific type of game
- A63F2300/8082—Virtual reality
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Human Computer Interaction (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Health & Medical Sciences (AREA)
- Cardiology (AREA)
- General Health & Medical Sciences (AREA)
- Heart & Thoracic Surgery (AREA)
- Biophysics (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Life Sciences & Earth Sciences (AREA)
- Processing Or Creating Images (AREA)
Abstract
The invention discloses a kind of social intercourse system and its method of work based on motion capture dress ornament, the present invention can connect any user on network, each other by wearing motion capture dress ornament extraction real-time action information, user action is projected in virtual set scene, face (body) model that user can use third party's smart mobile phone to extract enters virtual scene, the animation model that software can also be used to provide enters virtual scene, user can carry out real-time language and limb action with other users in virtual scene, reach close to real social effect；The present invention extracts human body real-time action information using electromagnetic field measurements mode, solves the problems, such as that whole virtual communication system architecture is simple, uses low in hardware cost using conventional inertia technology and optical technology low-response；In use without calibrating again, use is extremely convenient.
Description
Technical field
The present invention relates to virtual interaction system field, and in particular to a kind of virtual social system based on motion capture dress ornament
And its method of work.
Background technology
For current social intercourse system based on the instant message applications such as QQ, miniature, footpath between fields footpath between fields, user passes through the electricity such as computer or mobile phone
Sub- equipment logs in software, searches addition good person, is equal to other online user's instant characters or language using keyboard, headset, camera
Sound or video interactive.
Although this social software communication way can provide voice and video communication, video mode is due to the system of network speed
About, it is it is difficult to ensure that unobstructed at any time, especially when in outdoor non-wifi environment；In addition such social software can not provide face-to-face
Real-time, interactive, participant can only typewrite and speak, and at most see expression and place environment, can not provide deeper into interaction.
In addition, with the development of science and technology, also there are some to use human action extractive technique and virtual reality skill at present
Art improves real-time, interactive.However, when carrying out human action extraction using traditional inertia sensing technology in the prior art, lead to
The relative position for the acceleration of human action be calculated each joint is crossed, can only obtain the position of opposite front position
Information, and cost is higher, while timing alignment is also needed to, it is extremely inconvenient to use, and is only suitable for the industry of film making etc
Using the dynamic benefit equipment chain of actual product such as NOITOM；When carrying out human action extraction using optical sensing technology, pass through
Image recognition and tracking are carried out to the beacon at human synovial position using visible ray or infrared ray, carried so as to fulfill human action
Take, beacon easily occur and be blocked, generation action gaps and omissions, in addition image processing speed is slower, of high cost, and actual product is for example micro-
Soft Xbox somatic sensation television games, HTCVIVE etc..
The content of the invention
Therefore, in order to solve that user cannot be made to immerse, deeply interact completely in the prior art, and inconvenient for use, response speed
The technical problem of slow, cost height etc. is spent, the present invention provides a kind of virtual social system based on wearable motion capture dress ornament
System and its method of work.
The virtual social system includes wearable motion capture dress ornament, display device and main control device, described
Display device is connected with main control device communication；The motion capture dress ornament includes human action and catches system, it includes multiple cloth
I class electromagnetic field radiation device, the multiple II class electromagnetic field radiation devices and processor being laid on dress ornament being located on dress ornament；Processor
Reception voltage signal changes in amplitude size of the I class electromagnetic field radiation device to electromagnetic field radiation device at reference coordinate origin is measured, is counted
Calculate coordinate information of the I class electromagnetic field radiation device relative to origin；Processor is based on II class electromagnetic field radiation device and I class electromagnetic field
The distance and angular relationship of radiator, are obtained the movement locus of II class electromagnetic field radiation device, are passed based on movement locus by coordinate
Calculating is passed, obtains coordinate information of the II class electromagnetic field radiation device relative to coordinate origin；Processor is based on II class electromagnetic field radiation
Device and I class electromagnetic field radiation device obtain the human action real time information of user relative to the real-time coordinates information of coordinate origin, and
By the human action real-time information transmission of acquisition to main control device；The main control device includes controller, and controller is by acquisition
User's real-time action is projected in default virtual scene, realizes that user is exchanged in real time with other users in virtual scene.
Further, electromagnetic field radiation device is not only used as to launch but also receive, and measured position electromagnetic field radiation device utilizes transmitted wave
The transmitting signal of shape generation circuit generation is radiated surrounding and forms a local field distribution, and measurement position electromagnetic field radiation device receives
The analog signal, after amplifying circuit amplifies, digital signal is converted to after being gathered by data collecting card, by process circuit numeral
Filtering process, calculating processing is carried out into processor.
Further, reception voltage signal of the I class electromagnetic field radiation device to electromagnetic field radiation device at reference coordinate origin is measured
Changes in amplitude size, the correspondence based on voltage amplitude and coordinate, calculates seat of the I class electromagnetic field radiation device relative to origin
Mark information.
Further, the main control device is computer, and the display device is VR/AR head-mounted displays.
Further, a kind of method of work based on above-mentioned virtual social system, including step are as follows：
1) user dresses motion capture dress ornament first, by the software interface on main control device, selects communication object and void
Intend scene, initiate communication connection and invite；
2) communicate successful connection to establish, program initialization, start to calibrate the motion capture dress ornament that user is dressed, calibrated
Cheng Hou, the real-time action information of user is extracted by motion capture dress ornament；
3) user's real-time action information of wearable motion capture dress ornament extraction is read in real time, and is updated in virtual scene
Animating image acts, and the action being allowed to user is fully synchronized；
4) user dresses display device, and into virtual scene, action, language comprehensively interact in real time between beginning user.
Further, motion capture dress ornament calibration steps is as follows：Pass through 20~50 electromagnetic field radiations being laid on dress ornament
Device, is calculated and is communicated one by one, determines physical location of all radiators relative to back reference point, and cloth is expected with radiator
If position compares, if error exceedes predetermined threshold value, main control device is sent a signal to by the controller being arranged on dress ornament
User is reminded to be modified；After the completion of calibration, user need not carry out again in whole communication process before not taking off seizure dress ornament
Secondary calibration.
Further, in action process, the radiator of corresponding human body different motion position setting, its radiation being correspondingly arranged
Device updating location information rate is different, and is set according to the frequent degree dynamic of current active.
Further, the radiator that corresponding frequent activities position is set, its updating location information rate are set as 100 frames/second.
Further, the radiator that corresponding non-frequent activities position is set, its updating location information rate are set as 30 frames/second.
Further, user selects the animating image by the animation model that third party's smart machine or software provide.
Compared with prior art, the present invention have the following advantages and advantages：
1st, the present invention is moved by laying electromagnetic field radiation device on human body is tracked independently of the tracking human body of environment
Make, electromagnetic field radiation device is provided entirely on the dress ornament that human body is dressed, it is not necessary to which exterior spanning equipment, greatly improves what is used
Convenience.
2nd, the present invention extracts human body real-time action information using electromagnetic field measurements mode, solves using conventional inertia skill
The problem of art and optical technology low-response, whole virtual communication system architecture is simple, uses low in hardware cost.
3rd, the seizure of the invention based on back fixation point absolute coordinate position is as a result, avoid error accumulation, so as to solve
The prior art needs the defects of timing alignment；Only need primary calibration during wearing in unlimited time can use in use, make
With extremely convenient.
4th, in the present invention high speed motion data update can be realized according to the software design patterns of different acquisition process components
Rate, meets the action refresh rate requirement that preferable VR is shown and 3D plays.
Brief description of the drawings
Attached drawing described herein is used for providing further understanding the embodiment of the present invention, forms one of the application
Point, do not form the restriction to the embodiment of the present invention.In the accompanying drawings：
Fig. 1 is the system architecture diagram of the present invention.
The human action that Fig. 2 is the present invention catches System Working Principle block diagram.
The system method of work that Fig. 3 is the present invention realizes flow chart.
Embodiment
For the purpose, technical scheme and advantage of invention are more clearly understood, with reference to embodiment and attached drawing, to this hair
Bright to be described in further detail, exemplary embodiment and its explanation of the invention is only used for explaining the present invention, is not intended as
Limitation of the invention.
Embodiment
As depicted in figs. 1 and 2, the virtual social system includes wearable motion capture dress ornament, display device
And main control device, the display device are connected with main control device communication；The motion capture dress ornament includes human action and catches system
System, it includes multiple I class electromagnetic field radiation devices being laid on dress ornament, multiple II class electromagnetic field radiation devices being laid on dress ornament
And processor；Processor measures reception voltage signal of the I class electromagnetic field radiation device to electromagnetic field radiation device at reference coordinate origin
Changes in amplitude size, calculates coordinate information of the I class electromagnetic field radiation device relative to origin；Processor is based on II class electromagnetic field spoke
Emitter and the distance and angular relationship of I class electromagnetic field radiation device, obtain the movement locus of II class electromagnetic field radiation device, based on movement
Track is calculated by coordinate transmission, obtains coordinate information of the II class electromagnetic field radiation device relative to coordinate origin；Processor is based on
II class electromagnetic field radiation device and I class electromagnetic field radiation device obtain the human body of user relative to the real-time coordinates information of coordinate origin
Real time information is acted, and by the human action real-time information transmission of acquisition to main control device；The main control device includes controller,
Controller projects to user's real-time action of acquisition in default virtual scene, realizes user and other users in virtual scene
Exchanged in real time.
Radiator is distributed in user and dresses dress ornament everywhere, is connected by cable with processor, wherein radiator is both sent out
Penetrate and be used as to receive, measured position launches radiator and the signal of transmitted waveform generation circuit is radiated surrounding one part of formation
Field distribution, measurement position receives radiator and receives the analog signal, after amplifying circuit amplifies, turns after being gathered by data collecting card
Digital signal is changed to, is handled by digital filtering, entering signal process circuit carries out algorithm process calculating.
Processor unit is connected by cable with each electromagnetic field radiation device, and processor unit is by calculating each tracking
Launch and receive the amplitude and phase of signal to each other with electromagnetic field radiation device, calculate between electromagnetic field radiation device away from walk-off angle
Degree, after all electromagnetic field radiation device spacing walk-off angle degree relations determine, the operating state of human body also determines therewith.
The specific algorithm for obtaining human action real time information is as follows：
Most of electromagnetic field radiation device (I class electromagnetic field radiation device) of back chest is arranged at all using center back as ginseng
Coordinate origin is examined, when human body is in upright nature, each electromagnetic field radiation device distributing position is known initial position, in human body
In motion process, since the range of relative motion of torso portion is limited, the relative position of these electromagnetic field radiation devices changes one
Dimension is moved on direction, therefore is believed by measuring reception of these electromagnetic field radiation devices to electromagnetic field radiation device at reference coordinate origin
Number voltage amplitude variation size, can directly extrapolate and be tested location variation of the electromagnetic field radiation device relative to origin at this time.
Electromagnetic field radiation device (II class electromagnetic field radiation device) on a small number of the electromagnetic field radiation devices and four limbs of torso portion, its
Movement locus is calculated according to the distance and angular relationship of itself and I class electromagnetic field radiation device to determine, then by coordinate transmission, you can
Obtain coordinate information of the II class electromagnetic field radiation device relative to coordinate origin.
The relative position computational methods of II class electromagnetic field radiation device and I class electromagnetic field radiation device are as follows：
According to electromagnetic field inducing voltage computing formula：
DB is magnetic flux density member in formula, and unit is tesla (T) (Tesla), and a tesla is equal to one every square metre
Weber (Weber) (Wb/m2)；D1 is the conducting wire line element of current direction；aRTo be directed toward the unit vector of point P by d1；R is from electric current
Distances of first dl to point P；K is proportionality constant.
Spatially magnetic field calculation formula Biot Sa farr's law, the magnetic flux density that any current elements are formed in space point,
It is inversely proportional with this 2 points square distance, while directlys proportional to this point to the angle cross product in current elements direction.
When an electromagnetic field radiation device launches signal, another electromagnetic field radiation device receives, according to Maxwell equation
The integrated form of middle Faraday's law, under same frequency, in the signal strength (voltage that reception electromagnetic field radiation device receives
Size) it is that the flux density magnitude produced by transmitting electromagnetic field radiation device on electromagnetic field radiation device coil is received determines, two
Person is linear.On the other hand, all it is fixed based on our electromagnetic field radiation device antenna pattern and coil turn, so
In the coil totality magnetic flux density integrated by Biot's Sa farr's law, the contribution of antenna pattern and coil turn is all fixed
, thus the size of the magnetic flux density is only determined by the distance and angle of two electromagnetic field radiation devices.
Exemplified by following the trail of the radiator of thigh domain number 2H, H (II class electromagnetic field radiations device) launches signal at this time, uses 2G
The signal is received with 2F (I class electromagnetic field radiations device).
Due to the limitation of human synovial and muscle movement, scope that 2H electromagnetic field radiations device can be moved relative to 2G and 2F
It is limited.2H for 2G, can only with 2G distances for 4-8CM (lift leg with thigh and laterally turn up motion change) and
Moved in the range of certain angle (0-130 degree or so), similarly, 2H can only be 6-10CM with 2F distances for 2F
Moved in the range of (with thigh lift leg and lateral motion change of turning up) and certain angle (0-130 degree or so)
Therefore herein within the scope of, when 2H launches signal, and 2G and 2F receive signal, the signal strength Vout2g that measures
And Vout2f, the distance r and angle theta relation of 2H and 2G are also corresponded to, i.e.,
Vout2g=f (r1, θ 1)
4<r1<8；
0<θ1<130；
Vout2f=f (r2, θ 2)
6<r2<10；
0<θ2<130；
Wherein, r1 is the distance of 2G and 2H, and θ 1 is the angle of 2G and 2H；R2 is the distance of 2F and 2H；θ 2 is 2F's and 2H
Angle.The calculation formula of wherein function f (r, θ) is as follows：
Wherein A is voltage conversion coefficient, is a constant related with electromagnetic field radiation device circuit structure；μ is air magnetic
Conductance；N2, N1To send and receive the electromagnetic field radiation device coil turn at end；c1, c2It is along the product sent on receiving coil loop
Point；θ is the angle for sending and receiving coil；R is the distance for sending and receiving coil current member.
The reception electromagnetic field radiation device voltage in known location and angle can be calculated by formula by this formula
Numerical value.Test has obtained receiving the voltage value of electromagnetic field radiation device, then according to the value of the Vout2g that measures and Vout2f with
And the constraints of r and θ, the position/angle-voltage matrix being calculated according to formula, with root-mean-square error minimum criterion ox
Pause optimization method (such problem of similar solution also has many ripe algorithms, such as runge kutta method), calculates the test
Voltage corresponds to that position/angle point of root-mean-square error minimum therewith in matrix, you can corresponding to calculate 2H at this time
R1, θ 1 and r2, θ 2, thus by coordinate transformation, you can obtain at this time 2H for the coordinate of coordinate origin.
When computational efficiency is inadequate, we can increase reception with the number of electromagnetic field radiation device to position a quilt
Survey electromagnetic field radiation device.
The localization method of other electromagnetic field radiation devices similarly, in the position location computation of other electromagnetic field radiation devices, r and
The restriction relation of θ is determined by the scope of activities in joint at this, can be analyzed to obtain by athletic physiology.Processor is by determining
The relative position relation of all electromagnetic field radiation devices obtain each mark point of human action (electromagnetic field radiation device point) relative to
The global absolute coordinate of some fixing point (coordinate origin) of back.In actual use, user is since a standard operation, system
Complete to calibrate with this standard operation, afterwards user can random movement, system need not calibrate again.
Wherein electromagnetic radiator is miniature position sensor, sealant which includes stacking gradually from top to bottom,
Layer printed circuit board and support cushion and adhesive linkage, are connected with coupling cable on layer printed circuit board.On layer printed circuit board
Equipped with radiator circuit, radiator circuit includes access interface, grounding ports, capacitance, coil, oscillator, access interface be used for
Cable connection, to access signal；Grounding ports are used to be connected to the ground；Grounding ports, access interface are connected on coupling cable, real
Now with the connection of external equipment；Capacitance connection is between access interface and grounding ports；Coils from parallel connection of coils is on capacitance, and signal is through electricity
After cable access, the signal of rather low-frequency rate radiates the field distribution to be formed closely from coil in electromagnetic wave；Oscillator is connected to access
On port, signal is after cable accesses, and the signal of relative high frequency radiates the field distribution to be formed closely from oscillator in electromagnetic wave.
Based on foregoing circuit structure, sensor position in itself and angle can be solved come counter based on the change of measurement electromagnetic field, obtained
It is going out the result is that relative to signal source point absolute location coordinates and angle, simultaneously because the wave frequency used well below
Visible ray or infrared ray, so with quite good diffraction and diffracting effect, the general object in sensor operating distance
Occlusion effect including metal can almost be ignored.Communicated by electromagnetic field to each other to calculate mutual position relationship and speed
Degree relation, so as to reflect the movement locus of fixed body joints.Pass through the mutual alignment relation and speed of one group of sensor
Degree relation calculates, with regard to that can solve absolute position of all the sensors relative to coordinate reference source point.
The hydrid integrated circuit that amplifying circuit is built using company of Infineon simulation BJT triodes；Data collecting card uses
The low-cost and high-precision A/D chips of TI companies；Filtering process uses the digital filter software of processor resource structure, by software
Processing；Process circuit is using ARM7 or ARM9 family chips or the low-cost FPGA family chip of altera companies；Transmitted waveform
Produce and produced using processor chips and peripheral amplifier and crystal-oscillator circuit collaboration.
As shown in figure 3, communication system the specific implementation process is as follows：
1st, user dresses motion capture dress ornament first, then by software interface, select stranger that oneself is interested or
Person acquaintance is exchanged, and the virtual scene for selecting an exchange to occur, the process are completed by traditional computer software interface,
Operation and qq are very close, similar to initiate a video calling application；Both sides' program sets up TCP/IP by internet at this time
Connection, is ready for data transfer.
2nd, after other side agrees to that carrying out VR with oneself exchanges, invitee, which each clicks on, to be determined, and calibrates the dynamic of oneself wearing
Make seizure dress ornament.
The computer of both sides runs same virtual scene VR subprograms at this time, according to established connection, two computers
On virtual scene program initialized by same step, rendering animation scene, set animated character's coordinate system, by animation
The appearance background set of personage sets respective animation in adjacent virtual spatial location, and according to the prior selection of both sides
Image, the image can be user oneself true face 3D models (by sony mobile phone app self manufactures) or user from
The animating image selected in program image storehouse.
For motion capture dress ornament after aligning key is pressed, user shows standard operation, 20-50 radiator (root on dress ornament
It is different according to version complexity) communicated and calculated one by one, determine position of all radiators relative to back reference point, such as
Fruit error is excessive, and the controller on dress ornament reminds user suitably to correct that (this error is due to that dress ornament is each by computer program
Caused by radiator caused by wearing is offset with the estimated installation position of body).After the completion of calibration, user is not taking off seizure clothes
It need not be calibrated again in whole game process before decorations, computer reads in user action by game console after the completion of calibration,
The action of animated character, the action being allowed to user are fully synchronized in real-time update VR programs.Game console reads in user and moves
It is as follows to make process：Game console and dress ornament controller communication, after calibration is completed, dress ornament controller is according to company standard
Communications protocol, the radiator position that 2500 frame to 6000 frames per second (different according to configuring) is sent to game console are believed
The radiator location updating speed of breath, wherein human body diverse location is different, for example, elbow joint is because actuating range compares
Greatly, corresponding radiator updating location information rate is set as 100 frames/second, and waist is corresponding because actuating range is generally smaller
Radiator updating location information rate is set as 30 frames/second, in addition in action process, the location updating rate of each radiator of dress ornament
It is that dynamic is set, to the frequent radiator of current active, dress ornament controller can improve its turnover rate, and vice versa.Game control
After device processed reads in radiator positional information, then by USB3.0 or HDMI interface and dataphone, send positional information to electricity
The VR episode sequences run on brain, the program carry out the action of refreshing animation personage, based on radiator by these positional informations
The speed that refresh rate and existing hardware 3D are calculated, the action refresh rate of animated character can reach 60 frames and (once refresh and include
The action of all positions of human body, plus the resultant effect of Transmission system delay box 3D computing relays) more than, whole system delay can
To reach below 7mS, (7mS is that the prior art is horizontal using the attainable picture delay of traditional game joystick, due to action
It is suitable with game paddle speed to catch the delay of dress ornament, therefore system delay is as existing handle control technology) fully meet use
The game experiencing of family subjective sensation smoothness.
Both sides wear VR and show the helmet, into virtual scene, carry out communication by microphone, are taken by motion capture
Decorations carry out body language exchange, and the both sides visual field is immersed in setting virtual environment completely, realize complete face-to-face exchange experience.
The present invention provides one can make participant immerse, exchange comprehensively completely, the exchange way as being in a Room.Remove
Outside game and social activity, company's teleconference, telecommuting can also easily be realized by the system and its method of work.
Above-described embodiment, has carried out the purpose of the present invention, technical solution and beneficial effect further
Describe in detail, it should be understood that the foregoing is merely the embodiment of the present invention, be not intended to limit the present invention
Protection domain, within the spirit and principles of the invention, any modification, equivalent substitution, improvement and etc. done, should all include
Within protection scope of the present invention.
Claims (10)
1. a kind of virtual social system based on motion capture dress ornament, including wearable motion capture dress ornament, display device
And main control device, the display device are connected with main control device communication；It is characterized in that, the motion capture dress ornament includes human body
Motion capture system, it includes multiple I class electromagnetic field radiation devices being laid on dress ornament, multiple II class electricity being laid on dress ornament
Magnetic field radiation device and processor；Processor measures I class electromagnetic field radiation device and electromagnetic field radiation device at reference coordinate origin is connect
Collection of letters voltage amplitude variation size, calculates coordinate information of the I class electromagnetic field radiation device relative to origin；Processor is based on II
The distance and angular relationship of class electromagnetic field radiation device and I class electromagnetic field radiation device, obtain the movement rail of II class electromagnetic field radiation device
Mark, is calculated based on movement locus by coordinate transmission, obtains coordinate information of the II class electromagnetic field radiation device relative to coordinate origin；
Processor, relative to the real-time coordinates information of coordinate origin, is obtained based on II class electromagnetic field radiation device and I class electromagnetic field radiation device
The human action real time information of user, and by the human action real-time information transmission of acquisition to main control device；The main control device
Including controller, controller projects to user's real-time action of acquisition in default virtual scene, realizes and is used in virtual scene
Family is exchanged in real time with other users.
2. virtual social system according to claim 1, it is characterised in that electromagnetic field radiation device is not only made to launch but also receive
With the transmitting signal that measured position electromagnetic field radiation device is generated using transmitted waveform generation circuit is radiated surrounding and forms an office
Portion's field distribution, measurement position electromagnetic field radiation device receive the analog signal, after amplifying circuit amplifies, are gathered by data collecting card
After be converted to digital signal, by process circuit digital filtering handle, carry out calculating processing into processor.
3. virtual social system according to claim 1, it is characterised in that I class electromagnetic field radiation device of measurement is to reference to seat
The reception voltage signal changes in amplitude size of electromagnetic field radiation device at mark origin, the correspondence based on voltage amplitude and coordinate,
Calculate coordinate information of the I class electromagnetic field radiation device relative to origin.
4. virtual social system according to claim 1, it is characterised in that the main control device is computer, described aobvious
It is VR/AR head-mounted displays to show equipment.
A kind of 5. method of work applied to claim 1-4 any one of them virtual social systems, it is characterised in that：Including
Step is as follows：
1) user dresses motion capture dress ornament first, by the software interface on main control device, selects communication object and virtual field
Scape, initiates communication connection and invites；
2) communicate successful connection to establish, program initialization, start to calibrate the motion capture dress ornament that user is dressed, calibration is completed
Afterwards, the real-time action information of user is extracted by motion capture dress ornament；
3) user's real-time action information of wearable motion capture dress ornament extraction is read in real time, and updates the animation in virtual scene
Image action, the action being allowed to user are fully synchronized；
4) user dresses display device, and into virtual scene, action, language comprehensively interact in real time between beginning user.
6. the method for work of virtual social system according to claim 5, it is characterised in that wearable motion capture dress ornament
Calibration the specific implementation process is as follows：By 20~50 electromagnetic field radiation devices being laid on dress ornament, calculated and led to one by one
News, determine physical location of all radiators relative to back reference point, compared with radiator expection installation position, if by mistake
Difference exceedes predetermined threshold value, and sending a signal to main control device by the controller being arranged on dress ornament reminds user to be modified；School
After the completion of standard, user need not be calibrated again in whole communication process before not taking off seizure dress ornament.
7. the method for work of virtual social system according to claim 5, it is characterised in that corresponding in action process
The radiator that human body different motion position is set, its radiator updating location information rate being correspondingly arranged is different, and is that basis is worked as
Preceding movable frequent degree dynamic setting.
8. the method for work of virtual social system according to claim 7, it is characterised in that corresponding frequent activities position is set
The radiator put, its updating location information rate are set as 100 frames/second.
9. the method for work of virtual social system according to claim 7, it is characterised in that corresponding non-frequent activities position
The radiator of setting, its updating location information rate are set as 30 frames/second.
10. the method for work of virtual social system according to claim 5, it is characterised in that user passes through third party's intelligence
The animating image described in animation model selection that energy equipment or software provide.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711259238.6A CN107961531B (en) | 2017-12-04 | 2017-12-04 | Virtual social contact system based on motion capture clothing and working method thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711259238.6A CN107961531B (en) | 2017-12-04 | 2017-12-04 | Virtual social contact system based on motion capture clothing and working method thereof |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107961531A true CN107961531A (en) | 2018-04-27 |
| CN107961531B CN107961531B (en) | 2020-08-11 |
Family
ID=61999361
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711259238.6A Active CN107961531B (en) | 2017-12-04 | 2017-12-04 | Virtual social contact system based on motion capture clothing and working method thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107961531B (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109157827A (en) * | 2018-10-18 | 2019-01-08 | 看见故事（苏州）影视文化发展有限公司 | A kind of motion assistant system of motion capture technology |
| CN110728739A (en) * | 2019-09-30 | 2020-01-24 | 杭州师范大学 | Virtual human control and interaction method based on video stream |
| WO2022127747A1 (en) * | 2020-12-14 | 2022-06-23 | 郑州大学综合设计研究院有限公司 | Method and system for real social using virtual scene |
| CN117180720A (en) * | 2023-11-07 | 2023-12-08 | 成都孚谦科技有限公司 | Virtual action game interaction system and method based on somatosensory tracker technology |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20150075303A1 (en) * | 2013-09-17 | 2015-03-19 | Medibotics Llc | Motion Recognition Clothing (TM) with Two Different Sets of Tubes Spanning a Body Joint |
| CN104503582A (en) * | 2014-12-29 | 2015-04-08 | 北京智谷睿拓技术服务有限公司 | Wearable-equipment-based interaction method and interaction device, and wearable equipment |
| CN204347840U (en) * | 2014-12-04 | 2015-05-20 | 安徽工程大学 | A kind of wearable human body attitude pen recorder |
| CN106371584A (en) * | 2016-08-19 | 2017-02-01 | 联想(北京)有限公司 | Information processing method, electronic device and information processing system |
| CN107037886A (en) * | 2017-05-27 | 2017-08-11 | 成都索微通讯技术有限公司 | A kind of system and its method of work extracted for human action |
-
2017
- 2017-12-04 CN CN201711259238.6A patent/CN107961531B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20150075303A1 (en) * | 2013-09-17 | 2015-03-19 | Medibotics Llc | Motion Recognition Clothing (TM) with Two Different Sets of Tubes Spanning a Body Joint |
| CN204347840U (en) * | 2014-12-04 | 2015-05-20 | 安徽工程大学 | A kind of wearable human body attitude pen recorder |
| CN104503582A (en) * | 2014-12-29 | 2015-04-08 | 北京智谷睿拓技术服务有限公司 | Wearable-equipment-based interaction method and interaction device, and wearable equipment |
| CN106371584A (en) * | 2016-08-19 | 2017-02-01 | 联想(北京)有限公司 | Information processing method, electronic device and information processing system |
| CN107037886A (en) * | 2017-05-27 | 2017-08-11 | 成都索微通讯技术有限公司 | A kind of system and its method of work extracted for human action |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109157827A (en) * | 2018-10-18 | 2019-01-08 | 看见故事（苏州）影视文化发展有限公司 | A kind of motion assistant system of motion capture technology |
| CN110728739A (en) * | 2019-09-30 | 2020-01-24 | 杭州师范大学 | Virtual human control and interaction method based on video stream |
| CN110728739B (en) * | 2019-09-30 | 2023-04-14 | 杭州师范大学 | Virtual human control and interaction method based on video stream |
| WO2022127747A1 (en) * | 2020-12-14 | 2022-06-23 | 郑州大学综合设计研究院有限公司 | Method and system for real social using virtual scene |
| CN117180720A (en) * | 2023-11-07 | 2023-12-08 | 成都孚谦科技有限公司 | Virtual action game interaction system and method based on somatosensory tracker technology |
| CN117180720B (en) * | 2023-11-07 | 2024-01-05 | 成都孚谦科技有限公司 | Virtual action game interaction system and method based on somatosensory tracker technology |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107961531B (en) | 2020-08-11 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP7061694B2 (en) | Image processing methods and equipment, imaging equipment, and storage media | |
| US11262841B2 (en) | Wireless wrist computing and control device and method for 3D imaging, mapping, networking and interfacing | |
| CN107961531A (en) | A kind of virtual social system and its method of work based on motion capture dress ornament | |
| US11790554B2 (en) | Systems and methods for augmented reality | |
| US10444502B1 (en) | Method and apparatus for multiple user self-relative tracking for augmented reality systems using magnetic tracking | |
| CN106980385B (en) | A kind of Virtual assemble device, system and method | |
| CN108986023A (en) | Method and apparatus for handling image | |
| CN105608746A (en) | Method for virtual realizing of reality | |
| CN107274469A (en) | The coordinative render method of Virtual reality | |
| CN107340871A (en) | The devices and methods therefor and purposes of integrated gesture identification and ultrasonic wave touch feedback | |
| CN106952334B (en) | The creation method and three-dimensional fitting system of the net model of human body | |
| CN102945564A (en) | True 3D modeling system and method based on video perspective type augmented reality | |
| CN106095094B (en) | The method and apparatus that augmented reality projection is interacted with reality | |
| CN109982024A (en) | Video pictures share labeling system and shared mask method in a kind of remote assistance | |
| CN113129450A (en) | Virtual fitting method, device, electronic equipment and medium | |
| CN105824417B (en) | human-object combination method adopting virtual reality technology | |
| CN204406327U (en) | Based on the limb rehabilitating analog simulation training system of said three-dimensional body sense video camera | |
| CN109683706A (en) | A kind of method and system of the more people's interactions of virtual reality | |
| CN108734762A (en) | Movement locus emulation mode and system | |
| CN206819290U (en) | A kind of system of virtual reality multi-person interactive | |
| Schönauer et al. | Wide area motion tracking using consumer hardware | |
| CN109426336A (en) | A kind of virtual reality auxiliary type selecting equipment | |
| CN108459716B (en) | Method for realizing multi-person cooperation to complete task in VR | |
| CN203825856U (en) | Power distribution simulation training system | |
| CN206270483U (en) | A kind of VR gloves space positioning apparatus |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |