CN107818595A - Wearable Instant Interaction System - Google Patents

Wearable Instant Interaction System Download PDF

Info

Publication number
CN107818595A
CN107818595A CN201710908255.1A CN201710908255A CN107818595A CN 107818595 A CN107818595 A CN 107818595A CN 201710908255 A CN201710908255 A CN 201710908255A CN 107818595 A CN107818595 A CN 107818595A
Authority
CN
China
Prior art keywords
action
wearable
rtt
module
detection means
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201710908255.1A
Other languages
Chinese (zh)
Inventor
蔡子傑
李建谊
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Ational Chengchi University
Original Assignee
Ational Chengchi University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Ational Chengchi University filed Critical Ational Chengchi University
Publication of CN107818595A publication Critical patent/CN107818595A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00Manipulating 3D models or images for computer graphics
    • G06T19/006Mixed reality
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Computer Graphics (AREA)
  • Computer Hardware Design (AREA)
  • Software Systems (AREA)
  • User Interface Of Digital Computer (AREA)
  • Processing Or Creating Images (AREA)

Abstract

The invention discloses a wearable real-time interactive system, which comprises at least one body sensing detection device, an action processing device and at least one image display device, wherein the at least one body sensing detection device comprises a plurality of wearable detection units, and the at least one body sensing detection device senses the action of a user and generates at least one group of action information; the motion processing device is connected with the at least one motion sensing detection device, receives the at least one group of motion information, and processes and calculates the at least one group of motion information to generate complete image information; the at least one image display device is connected with the action processing device and receives and displays the complete image information. Thus, a new type of real-time interactive application is achieved.

Description

Wearable immediate interactive system
Technical field
A kind of relevant immediate interactive system of the present invention, espespecially a kind of immediate interactive system using wearable body-sensing detection means System.
Background technology
Wearable subject under discussion is very popular in recent years, and many esbablished corporations all release oneself wearable device, such as U.S. paddy Google Glasses of song company, Apple Watch of American apple company etc..Wearable device is different from general electronics Device, its characteristic be that by personal wearing various data, information with wearer can be obtained exactly, subsequently through searching Collection and data processing, just can provide more accurate service, and allowing wearer's generation to be different from general electronic installation in the past is not had Particular experience.
Excessively complicated function can not be but provided separately through wearable device at this stage, so most of wearable dresses The application for the sensing for being still confined to wearer's body situation is put, is considered as the extension function of mobile phone.
There is good developmental achievement in current each manufacturer in terms of wearable device, forms the state that each family contends, In respective closed system, the wearable device objectionable intermingling of different system, this can only be just confined to after selecting certain board product The support that manufacturer is provided, it is difficult to other compatible devices.Therefore, user is difficult to carry out mutually by different wearable devices in itself It is dynamic, and the lonely people of user situation movable on computer is caused, lack the application of community interactive so that wearable science and technology Development with promote progress stagnate, hardly possible have the technological break-through more innovated.
By taking interactive performance as an example, existing interactive performance can make image and the limb of performing artist by image projecting technology Body action produces interactive, the first recording image before performance, and the action for coordinating performing artist to prearrange produces nestable effect (over-layering).But this method effectively can not carry out interaction and empathize during performance with spectators, and easily Exposed the false when performing artist accidentally drops, the side effect for the image covering that performing artist is projected out more occurs.
With the development of science and technology gradually developing the detection technique that can sense limb action, this technology can be categorized as Augmented reality (augmented reality, AR) and virtual reality (virtual reality, VR).Augmented reality allows real field There is virtual article in Jing Zhongneng, reaches actual situation unification.For the Kinect of augmented reality Zhong You Microsofts exploitation as representing, use is infrared Line sensor detects depth image, coordinates colour camera section to take image, then analyze user's limb action from image. But the shortcomings that such a technology, is needed in large-scale performance, has been measured performance venue in advance and has been carried out large-scale sensing device further frame If to can completely cover whole place.In addition infrared sensing technology is easily disturbed by light of stage and environment light source, with And the delay caused by substantial amounts of image analysing computer on performance picture, Good Interaction quality can not be presented.
Virtual reality then creates entirely virtual environment.There are Oculus, Sony Playstation VR in virtual reality It is used in solitaire game's experience true to nature, but virtual reality still has to take image by colour camera section, then from image In analyze user's limb action, it is also desirable to high-quality image data carry out HPC, can also draw high network bandwidth Demand, thus the interaction of the instantaneity between more people even strange land is reduced, cause can not broadly be applied.
The content of the invention
It is an object of the invention to provide a kind of wearable immediate interactive system, can solve existing augmented reality and virtual reality Border because need carry out high-quality image data computing derive can not extensively using the problem of.
To take off purpose before reaching, the wearable immediate interactive system proposed by the invention, it is included:
An at least body-sensing detection means, it includes multiple wearable inspection units, and those wearable inspection units are for sensing The action of one user, the user that an at least body-sensing detection means is sensed according to those wearable inspection units act production Raw at least one set of action message;
One action processing unit, connects an at least body-sensing detection means, to receive and handle and the computing at least one set Action message, and user's image information is produced according at least one set of action message, but the action processing unit produce to Few environmental images information, and be a complete image information by user's image information and the environmental images information integration;And
An at least image display, the action processing unit is connected, to receive and show the complete image information.
Another object of the present invention is to provide a kind of wearable immediate interactive system, more people can be reached in above-mentioned framework The instantaneity in strange land is interactive to be used.
To take off purpose before reaching, the wearable immediate interactive system proposed by the invention, it is included:
Multiple body-sensing detection means groups, each body-sensing detection means group include an at least body-sensing detection means, each body-sensing inspection Survey device includes multiple wearable inspection units again, and those wearable inspection units are for the action of one user of sensing, and this is at least The user that one body-sensing detection means is sensed according to those wearable inspection units, which acts, produces at least one set of action message;
Multiple transmission processing devices, it is corresponding respectively with the plurality of body-sensing detection means group, the connection of each transmission processing device with An at least body-sensing detection means corresponding to it;
Multiple action processing units, corresponding respectively with the plurality of transmission processing device, each action processing unit connection is corresponding Transmission processing device;
An at least high in the clouds exchanger, is connected between the plurality of transmission processing device, each transmission processing device by its from At least one set of action message that a corresponding at least body-sensing detection means receives, by this, at least a high in the clouds exchanger is sent to it His transmission processing device, and then other action processing units are sent to, each processing unit that acts receives all action messages, And user's image information is produced according to those action messages, but the action processing unit produces an at least environmental images information, And by user's image information and the environmental images information integration it is a complete image information;And
An at least image display, those transmission processing devices are connected, to receive and show the complete image information.
Because the present invention uses wearable body-sensing detection means, as the source of detection user's action, therefore have no Existing augmented reality and virtual reality need to carry out high-quality image data computing derive can not extensively using the problem of, also because And more have an opportunity may achieve more people with the interactive utilization of the instantaneity in ground or more people strange lands.
In order to be further understood that the present invention to reach technology, means and effect that predetermined purpose is taken, refers to Below in connection with detailed description of the invention and schema, it is believed that the purpose of the present invention, feature and effect, when can thus one deeply and It is specific to understand, but institute's accompanying drawings are only provided and used with reference to explanation, are not used for the present invention person of being any limitation as.
Brief description of the drawings
Fig. 1 is the framework block diagram of the wearable immediate interactive system of the present invention.
Fig. 2 is the specific framework block schematic diagram of the wearable immediate interactive system of the present invention.
Fig. 3 is the block schematic diagram of the wearable immediate interactive system single player mode operation of the present invention.
Fig. 4 is the specific framework block diagram of the more people's topotype operations of the wearable immediate interactive system of the present invention.
Fig. 5 is the specific framework block diagram of the more people's different area pattern operations of the wearable immediate interactive system of the present invention.
Fig. 6 is the system architecture schematic diagram that the wearable immediate interactive system strange land of the present invention is performed.
Fig. 7 provides the signal of the data exchange between different zones for wearable immediate interactive system high in the clouds of the invention exchanger Figure.
Embodiment
Hereby the technical content and a detailed description for the present invention, schema is coordinated to be described as follows.
Wearable or device are in recent years emerging technologies, using still few in current performance field, rarely table Drill group energy and interactive perform is carried out by Wearable.Generally multidigit performance be present simultaneously in being performed in art in its reason Person, when these performing artists, which coordinate, performs various complicated action each other, uncertainty is filled with everywhere, except can not be accurately pre- Future phase performance action is outer, and the instantaneity of attitude detection is also quite important.
Wearable with performing artist plays the part of very important role, in order to effectively reach " face between sensing performing artist To, back to, it is close, remote, raise one's hand, turn to " etc. a large amount of limb actions, the number of pictures per second that sensing acts is drawn high by timesharing detection (frame per second, FPS), it is ensured that detection data are possessed in each time timesharing section, and it is instant to reflect performing artists Action.
The present invention sensing continuous action, the arithmetic system for distal end of arranging in pairs or groups immediately emphatically, may achieve interaction and perform application.More may be used Further with network transmission action data, it is aided with time stab and completes strange land and perform interaction, even if allowing performing artist office differently Side, also can " while strange land carry out interactive ".
Although Wearable plays the part of very important role, when the integration between Wearable needs to spend a large amount of Between, (common name WISE) provides one and is easy to integrate the platform with performing so technology provided by the invention, can allow wearable set The standby arithmetic expression system for integrating distal end, reach the arrangement under different performance situations.
WISE platforms are mainly that body-sensing Attitute detecting device carries Radio Transmission Technology, and it is immediately synchronous to combine strange land data Stereopsis or virtual reality (virtual reality, VR)/augmented reality (augmented reality, AR) of integration/ Mix the display performance application of the situations such as real border (mixed reality, MR).
WISE platforms can detect object wearing device sensing actor poses action from body-sensing, and sensing is drawn high with decentralized detection technology Data frequency by the action instant recording of performing artist into electronic signal, carried out via Back end data processing system is wirelessly transmitted to Synchronization process, Analysis and Screening data, 3D is integrated into being combined differently by data transmission system again after shadow or VR/AR/MR systems The virtual actor being pre-designed between area's servo and performance environment, adjust the transmission delay caused by network factors, build at any time Interactive performance between strange land can be carried out immediately;In addition also provide by event judge based on feedback transmitter, can two-way triggering table Reaction member on the person's of drilling object wearing device, build the body-sensings such as vibration, flash of light, sound feedback.
WISE platforms effectively reduce the complexity of the traditional performance stage construction of line and break through the region thing of on-the-spot demonstration Reason limitation, allow stage and performance to pass through WISE platforms and there can be the presentation of more polynary more wide regional coverage, enrich effect and the sight of performance Many quantity, and be easy to adjustment and be applied to different situations.
It is embodiments of the invention below, is the first embodiment of the wearable immediate interactive system of the present invention shown in Fig. 1 Framework block diagram.In interactive digital is performed, the Wearable with performing artists carries out transmission information by WISE platforms With computing, it is divided into three big devices, including a body-sensing detection means 10, the one action shadow of processing unit 20 and one according to major function As display device 30, subelement and multiple module are subdivided into according to function between each device, is completed by the combination of different subelements The exploitation of technology and platform are easy to integration, compatible, execution.WISE platforms are used in during interactive digital performs, with possess high efficiency, The transmission of information between object wearing device is managed to low latency, and the wearable device of high extendibility and service management, to simplify wearing The application development that formula interaction is performed.
In WISE platform applications on interactive digital is performed, the body-sensing detection means 10 is to be worn on the sense with performing artist Survey device, including multiple wearable inspection units 11 (claiming WISE Item), the plurality of wearable (WISE of inspection unit 11 Item) the several positions that can be worn by a user, user's actions taken afterwards all can be by respectively this be wearable Inspection unit 11 (WISE Item) senses, and an at least body-sensing detection means 10 can be according to those wearable inspection units 11 The user that (WISE Item) is sensed, which acts, produces at least one set of action message.
The core of the wearable inspection unit 11 (WISE Item) as the body-sensing detection means 10, each wearable inspection Know that unit 11 (WISE Item) is all independent node, be independent of each other each other, it is indivedual to be responsible for reading data and receiving ordering Function.Each wearable inspection unit 11 (WISE Item) is independent, and caused data only represent it by user The case of motion at the position of wearing, so whole body could be produced by subsequently also needing to connect these nodes by Image model Animation, this behavior referred to as " interlocks ".Each group joint is connected by interlocking, actual response user could be allowed each The action of kind of posture, during as raising one's hand, the lifting from last arm, forearm to wrist is that linkage function generates;During implementation, often A MPU6050 (posture sensing device) can be set on individual wearable inspection unit 11 (WISE Item), each wearable inspection unit 11 (WISE Item) are used as an isolated node, and actively set from it MPU6050 reads Yaw, Pitch, Roll tri- Axle attitude data.
It is shown in Figure 2, for the specific framework block schematic diagram of the wearable immediate interactive system of the present invention.In this implementation In example, the wearable inspection unit 11 includes an attitude detection module 111, a distance sensing module 112 and timesharing detection mould Block 113.
Human action is reached by the rotation in joint with it, and the change that learn human body attitude is by sensing with it Device obtains data, generally coordinates accelerometer (accelerometer) to take with gyroscope (gyroscope) on the market at present Data are obtained, therefore in embodiments of the invention with six axle posture sensing devices or nine axle postures with built-in accelerometer and gyroscope Sensor is used as the attitude detection module 111, and attitude data can be freely defined by open source (open source) Form, not only function meet design requirement, commercially available price is also quite cheap, it therefore meets need each joint dress sensor Use demand reach low cost advantage.
In addition, the distance sensing module 112 is used as ranging sensing, implementation still uses to be referred to by received signal strength Show the sensor of (received signal strength indicator, RSSI) signal of change distance for it.The timesharing is examined Survey module 113 and each sensor acquisition sensing signal, the time stab of data are provided.
Because in the design of implementation, those wearable inspection units 11 (WISE Item) generally do not possess and can directly connected The function of world-wide web is connect, in general more be able to can be placed on using a convenience serves as bluetooth and/or Wireless/wired network with it The multi-party mediating device for turning to pass function is assisted, therefore as shown in Fig. 2 when it is implemented, the body-sensing detection means 10 is further wrapped An intermediary sevices unit 12 (WISE Middleware) is included, the intermediary sevices unit 12 (WISE Middleware) receives those The initial data that wearable inspection unit 11 (WISE Item) senses, and those original data processings are dynamic at least one set Sent out after making information.Because easily shakiness is presented because of the remote situation of user in the connection of existing Bluetooth transmission mode Determine state, along with the intermediary sevices unit 12 (WISE Middleware) is collectively formed by software and hardware, and it is wearable with those Connected between inspection unit 11 (WISE Item) by wired or wireless transmission means, transmission that can also be wired or wireless Mode sends out at least one set of action message, the wireless transmission method supported can be WiFi, bluetooth, 3G, 4G, 5G or Other applicable wireless communication protocols.More specifically, the original transmitted by those wearable inspection units 11 (WISE Item) Beginning data do not have fixed order and frequency, therefore the intermediary sevices unit 12 (WISE Middleware) further comprises One data filtering module 121 and a data analysis module 122, wherein the data filtering module 121 are from those wearable detection lists Non-default data format is filtered out in the initial data that 11 (WISE Item) of member are sensed, to ensure received action Information is correct, effective, and it is invalid or not that filtered initial data can be screened and filtered out again by the data analysis module 122 After the data needed, just sent out after changing at least one set of action message.
In addition, the action processing unit 20 (WISE Display) connects an at least body-sensing detection means 10, to receive And processing and computing at least one set of action message, and user's image information is produced according at least one set of action message, Again the action processing unit 20 (WISE Display) produce an at least environmental images information, and by user's image information with The environmental images information integration is a complete image information.
In the present embodiment, as shown in Fig. 2 the action processing unit 20 (WISE Display) includes a performer Cheng Yingmo Block 21, an environmental modeling module 22 and an event judge setting module 23.
The performer Cheng Ying modules 21 receive and handle at least one set of action message with computing, and dynamic according at least one set Make information and produce user's image information, to provide the image information of the personage of virtual role, animal ... etc.;The environmental modeling Module 22 is responsible for producing an at least environmental images information, there is provided scene, background, the environmental images information of arena environment, and should User's image information and the environmental images information integration are a complete image information, the role module of design is incorporated immediately In environmental images;The event judges that setting module 23 is then responsible for judging moving for user's image information in the complete image information Make, differentiate how the environmental images information adjusts or change according to this, and then notify the environmental modeling module 22 to produce new ring Border image information, and be a new complete image information by user's image information and new environmental images information integration.
In the implementation of the present invention, it is related to data instantaneity, renewal rate and low latency demand, so in data processing Above, it is necessary to be walked toward the direction of reduction data volume, shortening data processing time, Protocol Buffers' (abbreviation protobuf) Design characteristics just focus on data volume is smaller, processing speed faster, and crucial compatibility is high, therefore the implementation of the present invention Example is used using protobuf as data transfer.
The image display 30 connects the action processing unit 20, to receive and show the complete image information;Implementation On, the image display 30 can be a screen display, a head mounted display, a projector or other shadows available for display As the equipment of picture.
From the foregoing, when user wears the wearable body-sensing detection means of the present invention, as long as body has action, this is dynamic Dealing with device 20 (WISE Display) by the body-sensing detection means 10, can learn that the action of user changes, and according to To be converted into user's image information and user's image information get integrated into environment image information, and then in the image display Show on 30, therefore the present invention has no existing augmented reality and virtual reality and needs progress high-quality image data computing to be derived Can not extensively using the problem of.
The application of the present invention passes through the picture of the image display 30 display except entity body to be turned to virtual body again Face and just as joining in Virtual Space outside, still further derivative allow user to produce vision, tactile in Virtual Space, listen The sense feedbacks such as feel, make experience truer, therefore refer to shown in Fig. 3, are the implementation that the present invention possesses sense feedback function The single player mode operational block figure of example, in the present embodiment, the present invention further comprises a transmission processing device 40, and the wearing Formula inspection unit 11 further comprises a sense feedback module 114, and the action processing unit 20 (WISE Display) is then entered One step includes a feedback trigger module 24.
The transmission processing device 40 (WISE Platform) be connected to the action processing unit 20 (WISE Display) with Between an at least body-sensing detection means 10 and the action processing unit 20 (WISE Display) and the image display Between 30, connection and data processing between collaboration, and the transmission processing device 40 (WISE Platform) includes one Regional coordination device 41 (WISE local coordinator) and a general register 42 (WISE local broker).
Due to the intermediary sevices unit 12 (WISE Middleware) Core Feature software section data processing and Monitoring nodes, therefore during implementation, the intermediary sevices unit 12 (WISE Middleware) can be received to come from by blue tooth connection and is somebody's turn to do The initial data that a little wearable inspection units 11 (WISE Item) are read, and those initial data are changed into the good lattice of specification Formula, after producing at least one set of action message, transmitting at least one set of action message then through wirelessly or non-wirelessly network should Transmission processing device 40 (WISE Platform), or it is each by noting down by the transmission processing device 40 (WISE Platform) The MAC Address of intermediary sevices unit 12 (WISE Middleware) transmit the sense feedback information to corresponding in turn Wearable inspection unit 11 (WISE Item), that is, the intermediary sevices unit 12 (WISE Middleware) is responsible for and is somebody's turn to do The connection of a little wearable inspection units 11 (WISE Item), then passes through with the transmission processing device 40 (WISE Platform) Agreement is managed communication and data transfer.
As shown in figure 3, the regional coordination device 41 (WISE local coordinator) includes a Data Integration module 411 And a device management module 412, wherein the Data Integration module 411 integrates at least one set of action message received, and is somebody's turn to do Those wearable inspection units 11 (WISE Item) that device management module 412 then stores the body-sensing detection means 10 are related Information, make those wearable (WISE of inspection unit 11 that the Data Integration module 411 can smoothly with the body-sensing detection means 10 Item) line.During implementation, by intermediary sevices unit 12 (WISE Middleware) company of foundation in a manner of IP based network Line, and the friendship that the regional coordination device 41 (WISE local coordinator) is reached an agreement on are held, and are started with the agreement appointed Data communication, completion acquisition setting shelves and the body-sensing detection means 10 (WISE Item) are wired to transmission attitude data, and this is complete Action;And shelves are set using the Json of human readable, to set the body-sensing detection means 10 of increase and decrease bottom, set in shelves most Outer layer carries out multigroup setting with array, and by pre-set each channel, the data separation of different kenels is come, Respective data are allowed to have exclusive channel to complete high-performance instantaneous transmission.Further, since Json setting shelves can not be taken by intermediary Business unit 12 (WISE Middleware) is directly read, therefore the regional coordination device 41 (WISE local coordinator) Can also as transfer interpreter, by the data that intermediary sevices unit 12 (WISE Middleware) is sent translate to Json setting shelves, or It is that Json setting shelves are translated into the data that intermediary sevices unit 12 (WISE Middleware) can be read.
The general register 42 (WISE local broker) connects the regional coordination device 22 (WISE local Coordinator), it is responsible for temporary, filtering, is handled with transmitting through the regional coordination device 41 (WISE local coordinator) RabbitMQ or MQTT can be used in the action message crossed, the specific implementation of the general register 42 (WISE local broker) Software is reached, and repeats to receive with issue (publisher) reduction time delay and subscriber by subscribing to (subscriber) The problem of information;The general register 42 (WISE local broker) is in the nature a kind of information intermediary (message Broker), what is done is exactly receive information, and then message transport is gone out again, by its information queue system, can be easy to Scattered Data Integration is got up, then cooperative system operates together.Therefore, by the general register 42 (WISE local Broker sensing data and issue feedback signal) are subscribed to, completes two-way data flow, instant acquirement sensing data allows animation streams Do not stop freely.The general register 42 (WISE local broker) may include a data storage module 421, be handed over as information Core is changed, the transmission can store, managed data and ensure the term of validity and data.
The sense feedback module 114 provides body-sensing feedback effects, and the body-sensing feedback effects can be tactile (such as by vibrator Vibration reach), vision (such as being reached by the luminous of flasher), the sense of hearing (such as sound is sent by buzzer and reached), smell (such as spray essence by essence eruption device and reach) etc. appoints one or more human perception effects.
The feedback trigger module 24 judges that setting module 23 is connected with the event, judges that setting module 23 judges by the event The action of user's image information in the complete image information, differentiates how the feedback trigger module 24 acts according to this, and then The feedback trigger module 24 is notified to send the sense feedback of the sense feedback module 114 of a corresponding specific wearable inspection unit 11 Information, the sense feedback signal is sent to by corresponding wearable inspection by the transmission processing device 40 (WISE Platform) Know the sense feedback module 114 of unit 11, body-sensing feedback effects are produced by the sense feedback module 114, provided so as to reach In virtual tactile, acoustically, in smell, visual body-sensing feedback, make the experience of user truer.
The present invention is equally applicable for more people and carries out interaction together in addition to above-mentioned application, as shown in figure 4, being the more of the present invention The operational block figure of people's topotype embodiment, a body-sensing detection means is dressed respectively by two users for being in same environment 10 wearable inspection unit 11 (WISE Item), respectively the body-sensing detection means 10 is not by its wearable institute of inspection unit 11 The user's action sensed, produces individually action message, and via individual other (WISE of intermediary sevices unit 12 Middleware) connect and action message is sent at the action by the transmission processing device 40 (WISE Platform) Device 20 (WISE Display) is managed, it is more by this is integrated after the action processing unit 20 (WISE Display) processing, computing The complete image information of the action message that individual body-sensing detection means 10 is detected and an at least environmental images information passes through the transmission Processing unit 40 (WISE Platform) is sent to the image display 30.Specifically, if two users are complete at this In the virtual environment of image information, have and contact with each other or interactive situation, the action processing unit 20 (WISE Display) can The complete image information or sense feedback information for including different environmental images information are produced accordingly, and by this comprising different The complete image information of environmental images information is sent to the image by the transmission processing device 40 (WISE Platform) and shown Device 30, or the sense feedback information is sent to the body-sensing by the transmission processing device 40 (WISE Platform) and examined Device 10 is surveyed, thus reaches user to see that other side contacts in virtual environment or interaction with oneself mutually, even with Person the sense feedback module 114 of wearable inspection unit 11 (WISE Item) can also do from the body-sensing detection means 10, Such as vibration, flash of light, the feedback of sound, feel just as really in interactive or contact, making experience truer.
As shown in figure 5, being the block schematic diagram of the more people's different area pattern operations of the wearable immediate interactive system of the present invention, and it is Reach the interactive effect of the user of different places, the system of the invention set in each place forms mutual disjunct independence Topology network (topology), to allow interaction to each other just to carry out interregional data exchange, also begin to involve Internet The configuration of network, the general common practice are as follows:
It can directly allow set DEU data exchange unit 40 (WISE Platform) in each place that there is a network position individually Location, to carry out interaction by the mutual connection of the DEU data exchange unit 40 in each place (WISE Platform);It is only each field DEU data exchange unit 40 (WISE Platform) individual networks address management and control and operating cost it is higher.
Also host node can be used as by one of DEU data exchange unit 40 in each place (WISE Platform), other The DEU data exchange unit 40 (WISE Platform) in place is all used as the (WISE of DEU data exchange unit 40 of host node by this Platform) line, only this way is except DEU data exchange unit 40 (WISE Platform) heavy load that can be allowed as host node Outside, once breaking down, the line in more people strange lands will be affected.
For these reasons, the present invention further comprises that a high in the clouds is handed in the preferred embodiment of more people's different area patterns operation Parallel operation 50 (WISE cloud exchanger).For example, three users are allowed each to install a body-sensing detection means 10 and a shadow As display device 30, wherein, with being located at first, two users with being located at second, are distinctly all set to first a user with second There are an action processing unit 20 (WISE Display) and a transmission processing device 40 (WISE Platform), the body-sensing on first ground Detection means 10 by first transmission processing device 40 (WISE Platform) connection and transfer operation information to first ground action Processing unit 20, then by second transmission processing device 40 (WISE Platform) connects simultaneously the body-sensing detection means 10 on second ground Transfer operation information to second ground action processing unit 20, and the high in the clouds exchanger 50 (WISE cloud exchanger) connect In the transmission processing device 40 (WISE Platform) on first ground regional coordination device 41 (WISE local coordinator) and The regional coordination device 41 (WISE local coordinator) of the transmission processing device 40 (WISE Platform) on second ground it Between.
During running, the regional coordination device 41 (WISE local coordinator) on first ground can be from the regional coordination device on second ground 41 (WISE local coordinator) receive the action message that two body-sensing detection means 10 from second ground are transmitted, (the WISE of action processing unit 20 on first ground is sent to by the general register 42 (WISE local broker) on first ground Display), by the action processing unit 20 (WISE Display) on first ground according to from first the body-sensing detection means with second ground 10 action message, a complete image information is produced according to this, or produce the complete image information and sense feedback information simultaneously, The regional coordination device 41 (WISE local coordinator) on second ground can be from (the WISE local of regional coordination device 41 on first ground Coordinator the action message that the body-sensing detection means 10 from first ground is transmitted) is received, passes through the local register on second ground Device 42 (WISE local broker) sends the action processing unit 20 (WISE Display) on second ground to, by the action on second ground Processing unit 20 (WISE Display) produces according to this according to from first the action message with the body-sensing detection means 10 on second ground Complete image information, or the complete image information and sense feedback information are produced simultaneously;Then, the action processing unit on first ground 20 (WISE Display) are again by the transmission processing device 40 (WISE Platform) on first ground by the complete image information transmission Show on to the image display 30 on first ground and by the body-sensing detection means 10 of the sense feedback information transmission to first ground with Body-sensing feedback effects are produced by its sense feedback module 114, the action processing unit 20 (WISE Display) on second ground passes through again Image display 30 of the transmission processing device 40 (WISE Platform) on second ground by the complete image information transmission to second ground On show and produce the body-sensing detection means 10 of the sense feedback information transmission to second ground by its sense feedback module 114 Raw body sense feedback effects, even consequently, it is possible to be in respectively in the user of the first and second two places, it can all pass through the fortune of the present embodiment Make, reach the interactive utilization of instantaneity in more people strange lands, make the experience of user truer.
Specifically, first with the strange land data on second ground and information transfer, exchange, pass through (the WISE of high in the clouds exchanger 50 Cloud exchanger) it is performed, the high in the clouds exchanger 50 (WISE cloud exchanger) provides different transmission process Data exchange between device 40 (WISE Platform).In this preferred embodiment, the high in the clouds exchanger 50 (WISE Cloud exchanger) include a data simultaneous module 51, a data storage module 52 and a data forwarding module 53.Should Data simultaneous module 51 is played when multidigit user, that is, when there are the wearable immediate interactive system more body-sensings to detect When device 10 to sense the action of multidigit user respectively, the data simultaneous module 51 data analysis module 122 that can align sieves Time shaft caused by whole body data after selecting and filtering out, reach the purpose of data syn-chronization, after the completion of provide data to the data Storage module 52 and the data forwarding module 53.The data storage module 52 is configured to temporarily store data.The data forwarding module 53 is used Linked up in other action processing units 20 (WISE Display).
In addition, the image instantaneity of all nodes declines caused by order to avoid blocking because of single cloud service network, such as Fig. 6 Shown, another preferred embodiment of the invention can build multiple (WISE cloud of high in the clouds exchanger 50 by cloth beyond the clouds Exchanger), each high in the clouds exchanger 50 (WISE cloud exchanger) is in addition to carrying out region swapping data, Also have the detection function of line quality concurrently simultaneously, in the present embodiment, so-called line quality is with the network package turnaround time (round trip time, RTT) as the foundation judged, it is better that lower person represents line quality, is brought by network transmission Delay it is fewer, it is more high then on the contrary;Then the regional coordination device 41 (WISE local coordinator) can heuristically direction Each high in the clouds exchanger 50 (WISE cloud exchanger) sends network package, and according to network package turnaround time RTT The most short high in the clouds exchanger 50 (WISE cloud exchanger) of required time is selected to carry out data transmission.Specific implementation When, meeting is in each regional coordination device 41 (WISE local coordinator) according to setting shelves with each high in the clouds exchanger 50 (WISE cloud exchanger) leading line, can be periodically by each (WISE cloud of high in the clouds exchanger 50 after stable connection Exchanger the package of detection RTT values) is sent to each regional coordination device 41 (WISE local coordinator), according to The data format of definition, with get/RTT behavior, each high in the clouds exchanger 50 (WISE cloud exchanger) is calculated from sending Package to from each regional coordination device 41 (WISE local coordinator) recovery package time assisted as each region Adjust the Initial R TT values of device 41 (WISE local coordinator), e.g. RTT1、RTT2、…RTTN, but each regional coordination The RTT values of device 41 (WISE local coordinator), which need to pass through following amendment computing, to be obtained, and its step is as follows:
Step 1:First calculate total value RTTtotal=RTT1+RTT2+…+RTTN
Step 2:The RTT of each regional coordination device 41 (WISE local coordinator) after amendment computingNValue
RTT1=(RTTtotal-RTT1)/(N-1)+RTT1
RTT2=(RTTtotal-RTT2)/(N-1)+RTT2
RTTN=(RTTtotal-RTTN)/(N-1)+RTTN
Each high in the clouds exchanger 50 (WISE cloud exchanger) is by each (WISE of regional coordination device 41 of institute's computing Local coordinator) RTTNValue sends corresponding regional coordination device 41 (WISE local coordinator) to, such as This each regional coordination device 41 (WISE local coordinator) can obtain corresponding different high in the clouds exchangers 50 The RTT of (WISE cloud exchanger)NValue.
Via aforesaid way, it is not necessary to which complicated calculating just can allow each (WISE local of regional coordination device 41 Coordinator its RTT value between each high in the clouds exchanger 50 (WISE cloud exchanger)) is known.Afterwards, often (the WISE of high in the clouds exchanger 50 of line performance optimal just may be selected in individual regional coordination device 41 (WISE local coordinator) Cloud exchanger) carry out data transmission.
It is preferred that each high in the clouds exchanger 50 (WISE cloud exchanger) can only receive assisted from a region every time The data of device 41 (WISE local coordinator) are adjusted, and turn to be transmitted to other regional coordination devices 41 (WISE local Coordinator), it so can ensure that each line can keep lowest latency.
If the wearable immediate interactive system of the present invention is applied when being performed in more people strange lands, its Organization Chart is as shown in Figure 7.By Existing art is limited in geographic distance to perform, has allowed performing artist's interaction scope must be limited on same stage.So And utilize the technology of the present invention, just can area for penetration limitation, when being in two places or even more than the performing artist of two places is carried out each other When the action such as moving, turn round, the body-sensing detection means 10 will obtain the action message of user, pass through Miniature programmable electricity Brain receives the whole action message and plus after time stab, and the action message can pass through the high in the clouds exchanger 50 (WISE cloud again Exchanger) carry out data transmission, though there is Duo Tai high in the clouds exchanger 50 (WISE cloud exchanger) as shown in the figure, The present invention can automatic screening most preferably transmit the high in the clouds exchanger 50 (WISE cloud exchanger) of quality and carry out data transmission, Action message is sent in the action processing unit 20 (WISE Display) in each place with Radio Transmission Technology and united Integration, judgement and the Analysis and Screening of one efficient computing, huge and scattered action message is effectively converted into complete image letter Breath and sense feedback information, consequently, it is possible to be in numerous performing artists in strange land, except it can be seen by the image display 30 His performing artist is before eyes, and being even between the performing artist in strange land can also produce just as really in interactive or contact, so The stage performed can be extended to the whole world, break the estrangement of geographical space.
From the foregoing, virtual reality and wearable system by immersion, allow performing artist to be carried out in Virtual Space Interaction, and play substantive sense feedback.In experience, multidigit performing artist is respectively at strange land, passes through virtual reality glasses (virtual reality, VR) and the body-sensing detection means 10, entity body is turned to virtual body, join in void immediately Intend space and carry out interaction.All touching in Virtual Space, vision, tactile, the sense of hearing can be also produced so as to sensigenous anti- Feedback, makes experience truer.
By using body as sound and the generator of visual effect, with reference to VR, limbs detector and tactile inductor etc., The body of entity is converted into virtual body.By network by the body of different location, it is transferred on high in the clouds, forms a void Intend the virtual social field domain of body.Other side's virtual body can be touched each other and trigger sound, entity body also has true touch The sensation of feel.Set out with brand-new body intuition, start brand-new scientific and technological media.
Only, described above, the detailed description of preferred embodiment only of the present invention and schema, only feature of the invention is simultaneously This is not limited to, and is not used to the limitation present invention, all scopes of the invention should be defined by following claims, all conjunctions In the embodiment of spirit change similar with its of scope of the present invention patent, should all be contained in scope of the invention, it is any Be familiar with this those skilled in the art in the field of the invention, can think easily and change or modification can all cover patent in following this case Scope.

Claims (13)

1. a kind of wearable immediate interactive system, it is characterised in that include:
An at least body-sensing detection means, it includes multiple wearable inspection units, and those wearable inspection units make for sensing one The action of user, the user that an at least body-sensing detection means is sensed according to those wearable inspection units, which acts, to be produced extremely Few set information;
One action processing unit, connects an at least body-sensing detection means, is acted with receiving and handling at least one set with computing Information, and user's image information is produced according at least one set of action message, and the action processing unit produces at least one Environmental images information, and be a complete image information by user's image information and the environmental images information integration;And
An at least image display, the action processing unit is connected, to receive and show the complete image information.
2. wearable immediate interactive system as claimed in claim 1, it is characterised in that:
Each wearable inspection unit includes a sense feedback module, and the sense feedback module provides body-sensing feedback effects;
The action processing unit includes a feedback trigger module, judges to make in the complete image information by the action processing unit The action of user's image information, so by the feedback trigger module according in the complete image information user's image information it is dynamic Make, send the sense feedback information of the sense feedback module of a corresponding at least one wearable inspection unit, the action processing unit Sense feedback module by the sense feedback information transmission to the corresponding at least one wearable inspection unit, it is corresponding extremely by this A few sense feedback module produces body-sensing feedback effects.
3. wearable immediate interactive system as claimed in claim 2, it is characterised in that an at least body-sensing detection means is worn Body-sensing caused by wearing formula inspection unit be fed back to visual feedback, touch feedback, audio feedback, smell feedback any one or wantonly two It is more than person.
4. wearable immediate interactive system as claimed any one in claims 1 to 3, it is characterised in that action processing dress Put and include:
One performer's Cheng Ying modules, receive and handle at least one set of action message with computing, and acted and believed according at least one set Breath produces user's image information;
One environmental modeling module, an at least environmental images information is produced, and user's image information and the environmental images are believed Breath is integrated into a complete image information;And
One event judges setting module, judges the action of user's image information in the complete image information.
5. wearable immediate interactive system as claimed any one in claims 1 to 3, it is characterised in that further comprising one Transmission processing device, wherein:
An at least body-sensing detection means further includes an intermediary sevices unit, wherein respectively the wearable inspection unit sensing should The action of user, and an initial data is produced respectively, and an at least body-sensing detection means, and the intermediary sevices unit connects To those wearable inspection units, and after receiving those initial data, at least one set action is produced according to those initial data Information;
The transmission processing device is connected between the action processing unit and an at least body-sensing detection means and at the action Manage between device and the image display, connection and data processing between collaboration.
6. wearable immediate interactive system as claimed in claim 5, it is characterised in that the transmission processing device includes:
One regional coordination device, comprising:
One Data Integration module, integrate at least one set of action message received;And
One device management module, store those wearable inspection unit relevant informations of the body-sensing detection means;And
One general register, the regional coordination device is connected, and keep in, filter, being moved with transmitting through what the regional coordination device treated Make information.
7. wearable immediate interactive system as claimed in claim 6, it is characterised in that comprising multiple body-sensing detection means, its In user that respectively the body-sensing detection means is individually sensed its wearable inspection unit act, indivedual generations action letters Breath, and connect via the intermediary sevices unit of the respectively body-sensing detection means and transmitted action message by the transmission processing device To the action processing unit, after action processing unit processing, computing, it will integrate what the plurality of body-sensing detection means was detected The complete image information of action message and an at least environmental images information is sent to the image by the transmission processing device and shown Device.
8. wearable immediate interactive system as claimed any one in claims 1 to 3, it is characterised in that each wearable detection Unit includes respectively:
One attitude detection module, detect the posture action of the user;
One distance sensing module, sense the range information of the user;And
One timesharing detection module, there is provided the posture action and the time stab of the range information.
9. a kind of wearable immediate interactive system, it is characterised in that include:
Multiple body-sensing detection means groups, each body-sensing detection means group include an at least body-sensing detection means, each body-sensing detection dress Put and including multiple wearable inspection units, for those wearable inspection units for the action of one user of sensing, this is at least integral The user that sense detection means is sensed according to those wearable inspection units, which acts, produces at least one set of action message;
Multiple transmission processing devices, corresponding respectively with the plurality of body-sensing detection means group, each transmission processing device connection is right with it At least body-sensing detection means answered;
Multiple action processing units, corresponding respectively with the plurality of transmission processing device, each act passes corresponding to processing unit connection Transportation processing equipment;
An at least high in the clouds exchanger, is connected between the plurality of transmission processing device, and each transmission processing device is certainly corresponding by it An at least body-sensing detection means receive at least one set of action message, by this, at least a high in the clouds exchanger is sent to other biographies Transportation processing equipment, and then other action processing units are sent to, each processing unit that acts receives all action messages, and root User's image information is produced according to those action messages, but the action processing unit produces an at least environmental images information, and will User's image information and the environmental images information integration are a complete image information;And
Multiple image displays, respectively the image display connect those transmission processing devices respectively, to receive and show this Complete image information.
10. wearable immediate interactive system as claimed in claim 9, it is characterised in that:
Each wearable inspection unit includes a sense feedback module, and the sense feedback module provides body-sensing feedback effects;
Each action processing unit includes a feedback trigger module, judges to make in the complete image information by each action processing unit The action of user's image information, so by the feedback trigger module according in the complete image information user's image information it is dynamic Make, send the sense feedback information of the sense feedback module of a corresponding at least one wearable inspection unit, respectively act processing unit Sense by corresponding data transmission module by the sense feedback information transmission to the corresponding at least one wearable inspection unit Feel feedback module, body-sensing feedback effects are produced by a corresponding at least sense feedback module.
11. wearable immediate interactive system as claimed in claim 10, it is characterised in that an at least body-sensing detection means Body-sensing caused by wearable inspection unit is fed back to any one of visual feedback, touch feedback, audio feedback, smell feedback or appointed More than both.
12. the wearable immediate interactive system as any one of claim 9 to 11, it is characterised in that include multiple clouds Exchanger is held, each high in the clouds exchanger is connected between the plurality of transmission processing device, wherein those transmission processing devices selection one High in the clouds exchanger line.
13. wearable immediate interactive system as claimed in claim 12, it is characterised in that each transmission processing device is according to an envelope The foundation of turnaround time alternatively high in the clouds exchanger is wrapped, detection is sent to each data transmission module by each high in the clouds exchanger The package of RTT values, each high in the clouds exchanger are calculated from package is sent to the time conduct from each data transmission module recovery package The initial package turnaround time of each data transmission module, include RTT1、RTT2、…RTTN, and the RTT of each data transmission moduleN Value, which need to pass through following amendment computing, to be obtained, and its step is as follows:
First calculate the total value package turnaround time:RTTtotal=RTT1+RTT2+…+RTTN
The RTT of each data transmission module after amendment computingNValue:
RTT1=(RTTtotal-RTT1)/(N-1)+RTT1
RTT2=(RTTtotal-RTT2)/(N-1)+RTT2
RTTN=(RTTtotal-RTTN)/(N-1)+RTTN
Each high in the clouds exchanger is by the RTT of each data transmission module of institute's computingNValue sends corresponding data transmission module to, makes Each data transmission module obtains the RTT of corresponding different high in the clouds exchangersNValue, wherein the selection of each data transmission module has most Low RTTNThe high in the clouds exchanger of value carries out line.
CN201710908255.1A 2017-04-13 2017-09-29 Wearable Instant Interaction System Pending CN107818595A (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
TW106112349A TWI644235B (en) 2017-04-13 2017-04-13 Wearable instant interaction system
TW106112349 2017-04-13

Publications (1)

Publication Number Publication Date
CN107818595A true CN107818595A (en) 2018-03-20

Family

ID=61607077

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710908255.1A Pending CN107818595A (en) 2017-04-13 2017-09-29 Wearable Instant Interaction System

Country Status (2)

Country Link
CN (1) CN107818595A (en)
TW (1) TWI644235B (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI679557B (en) * 2018-05-14 2019-12-11 國立臺灣師範大學 Adaptive sport posture sensing system and method
CN111385619A (en) * 2018-12-28 2020-07-07 宏正自动科技股份有限公司 Video interaction system

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI737068B (en) * 2019-12-06 2021-08-21 未來市股份有限公司 Motion tracking system and method
CN113029190A (en) * 2019-12-09 2021-06-25 未来市股份有限公司 Motion tracking system and method
TWI725803B (en) * 2020-03-31 2021-04-21 林閔瑩 System for recognizing abnormal activity of human body using wearable electronic device and mixed reality technology
US11983321B1 (en) 2023-04-10 2024-05-14 Htc Corporation Hand-free haptic feedback system and method

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103188727A (en) * 2011-12-30 2013-07-03 财团法人工业技术研究院 Communication system and method for assisting transmission of TCP packets
CN203070360U (en) * 2012-10-22 2013-07-17 广州新节奏数码科技有限公司 Virtual dressing equipment
CN104104647A (en) * 2013-04-02 2014-10-15 宏碁股份有限公司 Connection keeping method
US20150091711A1 (en) * 2013-09-27 2015-04-02 Nokia Corporation Wearable electronic device
CN104516496A (en) * 2013-10-04 2015-04-15 财团法人工业技术研究院 Multi-person guidance system and method capable of adjusting motion sensing range
CN104717212A (en) * 2014-10-21 2015-06-17 中华电信股份有限公司 Protection method and system for cloud virtual network security
CN106155198A (en) * 2015-05-15 2016-11-23 博能电子公司 Wearable electronic equipment, non-transitory computer readable storage medium and method

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7085818B2 (en) * 2001-09-27 2006-08-01 International Business Machines Corporation Method, system, and program for providing information on proximate events based on current location and user availability
IN2013CH05466A (en) * 2013-11-27 2015-05-29 Ineda Systems Pvt Ltd
CN105279354B (en) * 2014-06-27 2018-03-27 冠捷投资有限公司 User can incorporate the situation construct system of the story of a play or opera
US9904255B2 (en) * 2014-09-19 2018-02-27 Htc Corporation Wearable electronic device and event-intimating method of the same

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103188727A (en) * 2011-12-30 2013-07-03 财团法人工业技术研究院 Communication system and method for assisting transmission of TCP packets
CN203070360U (en) * 2012-10-22 2013-07-17 广州新节奏数码科技有限公司 Virtual dressing equipment
CN104104647A (en) * 2013-04-02 2014-10-15 宏碁股份有限公司 Connection keeping method
US20150091711A1 (en) * 2013-09-27 2015-04-02 Nokia Corporation Wearable electronic device
CN104516496A (en) * 2013-10-04 2015-04-15 财团法人工业技术研究院 Multi-person guidance system and method capable of adjusting motion sensing range
CN104717212A (en) * 2014-10-21 2015-06-17 中华电信股份有限公司 Protection method and system for cloud virtual network security
CN106155198A (en) * 2015-05-15 2016-11-23 博能电子公司 Wearable electronic equipment, non-transitory computer readable storage medium and method

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI679557B (en) * 2018-05-14 2019-12-11 國立臺灣師範大學 Adaptive sport posture sensing system and method
CN111385619A (en) * 2018-12-28 2020-07-07 宏正自动科技股份有限公司 Video interaction system
CN111385619B (en) * 2018-12-28 2022-02-25 宏正自动科技股份有限公司 Video interaction system

Also Published As

Publication number Publication date
TW201837660A (en) 2018-10-16
TWI644235B (en) 2018-12-11

Similar Documents

Publication Publication Date Title
CN107818595A (en) Wearable Instant Interaction System
CN109976690B (en) AR glasses remote interaction method and device and computer readable medium
RU2621644C2 (en) World of mass simultaneous remote digital presence
Broll et al. Meeting technology challenges of pervasive augmented reality games
CN109426333A (en) A kind of information interacting method and device based on Virtual Space Scene
CN109671141B (en) Image rendering method and device, storage medium and electronic device
CN105955463A (en) BIM (Building Information Modeling)-based VR (Virtual Reality) virtual feeling system
US11769306B2 (en) User-exhibit distance based collaborative interaction method and system for augmented reality museum
CN107533230A (en) Head mounted display tracing system
US10661148B2 (en) Dual motion sensor bands for real time gesture tracking and interactive gaming
CN108064364A (en) It is used to implement the method and system of multi-user virtual environment
CN106095094B (en) The method and apparatus that augmented reality projection is interacted with reality
US8724849B2 (en) Information processing device, information processing method, program, and information storage medium
CN106170094A (en) The live broadcasting method of panoramic video and device
CN105894584A (en) Method and device used for interaction with real environment in three-dimensional immersion type environment
CN109358754A (en) A kind of mixed reality wears display system
WO2021246183A1 (en) Information processing device, information processing method, and program
CN106774820A (en) The methods, devices and systems that human body attitude is superimposed with virtual scene
CN108280851A (en) Depth map generation device
CN114510150A (en) Experience system of virtual digital world
CN107945270A (en) A kind of 3-dimensional digital sand table system
CN109529350A (en) A kind of action data processing method and its device applied in game
CN207051853U (en) A kind of immersive VR experiencing system
CN109478343A (en) Capture and rendering are related to the information of virtual environment
CN108399008A (en) A kind of synchronous method of virtual scene and sports equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
WD01 Invention patent application deemed withdrawn after publication
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20180320