CN107818595A - Wearable Instant Interaction System - Google Patents
Wearable Instant Interaction System Download PDFInfo
- Publication number
- CN107818595A CN107818595A CN201710908255.1A CN201710908255A CN107818595A CN 107818595 A CN107818595 A CN 107818595A CN 201710908255 A CN201710908255 A CN 201710908255A CN 107818595 A CN107818595 A CN 107818595A
- Authority
- CN
- China
- Prior art keywords
- action
- wearable
- rtt
- module
- detection means
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000003993 interaction Effects 0.000 title description 14
- 230000009471 action Effects 0.000 claims abstract description 124
- 238000012545 processing Methods 0.000 claims abstract description 104
- 238000001514 detection method Methods 0.000 claims abstract description 82
- 230000002452 interceptive effect Effects 0.000 claims abstract description 51
- 230000005540 biological transmission Effects 0.000 claims description 76
- 238000007689 inspection Methods 0.000 claims description 49
- 230000007613 environmental effect Effects 0.000 claims description 22
- 230000010354 integration Effects 0.000 claims description 16
- 230000000694 effects Effects 0.000 claims description 15
- 238000004387 environmental modeling Methods 0.000 claims description 4
- 230000000007 visual effect Effects 0.000 claims description 4
- 238000011084 recovery Methods 0.000 claims description 2
- 238000000034 method Methods 0.000 abstract description 4
- 230000008569 process Effects 0.000 abstract description 2
- 238000005516 engineering process Methods 0.000 description 15
- 230000006870 function Effects 0.000 description 11
- 230000003190 augmentative effect Effects 0.000 description 9
- 238000010586 diagram Methods 0.000 description 9
- 210000003414 extremity Anatomy 0.000 description 6
- 238000012546 transfer Methods 0.000 description 6
- 230000008859 change Effects 0.000 description 5
- 238000013500 data storage Methods 0.000 description 4
- 238000013461 design Methods 0.000 description 4
- 238000001914 filtration Methods 0.000 description 4
- 238000007726 management method Methods 0.000 description 4
- 230000036544 posture Effects 0.000 description 4
- 238000004891 communication Methods 0.000 description 3
- 238000007405 data analysis Methods 0.000 description 3
- 238000011161 development Methods 0.000 description 3
- 238000012216 screening Methods 0.000 description 3
- 238000004458 analytical method Methods 0.000 description 2
- 239000011521 glass Substances 0.000 description 2
- 230000009467 reduction Effects 0.000 description 2
- 239000011800 void material Substances 0.000 description 2
- 241001465754 Metazoa Species 0.000 description 1
- 241000549343 Myadestes Species 0.000 description 1
- 206010044565 Tremor Diseases 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 230000000903 blocking effect Effects 0.000 description 1
- 210000004556 brain Anatomy 0.000 description 1
- 239000000872 buffer Substances 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 238000005553 drilling Methods 0.000 description 1
- 230000005611 electricity Effects 0.000 description 1
- 239000004744 fabric Substances 0.000 description 1
- 210000000245 forearm Anatomy 0.000 description 1
- 238000007654 immersion Methods 0.000 description 1
- 238000009434 installation Methods 0.000 description 1
- 238000005304 joining Methods 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 239000000203 mixture Substances 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 230000008520 organization Effects 0.000 description 1
- 230000035515 penetration Effects 0.000 description 1
- 230000008447 perception Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 230000035807 sensation Effects 0.000 description 1
- 238000000926 separation method Methods 0.000 description 1
- 238000004904 shortening Methods 0.000 description 1
- 239000007921 spray Substances 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
- 210000000707 wrist Anatomy 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/006—Mixed reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Computer Graphics (AREA)
- Computer Hardware Design (AREA)
- Software Systems (AREA)
- User Interface Of Digital Computer (AREA)
- Processing Or Creating Images (AREA)
Abstract
The invention discloses a wearable real-time interactive system, which comprises at least one body sensing detection device, an action processing device and at least one image display device, wherein the at least one body sensing detection device comprises a plurality of wearable detection units, and the at least one body sensing detection device senses the action of a user and generates at least one group of action information; the motion processing device is connected with the at least one motion sensing detection device, receives the at least one group of motion information, and processes and calculates the at least one group of motion information to generate complete image information; the at least one image display device is connected with the action processing device and receives and displays the complete image information. Thus, a new type of real-time interactive application is achieved.
Description
Technical field
A kind of relevant immediate interactive system of the present invention, espespecially a kind of immediate interactive system using wearable body-sensing detection means
System.
Background technology
Wearable subject under discussion is very popular in recent years, and many esbablished corporations all release oneself wearable device, such as U.S. paddy
Google Glasses of song company, Apple Watch of American apple company etc..Wearable device is different from general electronics
Device, its characteristic be that by personal wearing various data, information with wearer can be obtained exactly, subsequently through searching
Collection and data processing, just can provide more accurate service, and allowing wearer's generation to be different from general electronic installation in the past is not had
Particular experience.
Excessively complicated function can not be but provided separately through wearable device at this stage, so most of wearable dresses
The application for the sensing for being still confined to wearer's body situation is put, is considered as the extension function of mobile phone.
There is good developmental achievement in current each manufacturer in terms of wearable device, forms the state that each family contends,
In respective closed system, the wearable device objectionable intermingling of different system, this can only be just confined to after selecting certain board product
The support that manufacturer is provided, it is difficult to other compatible devices.Therefore, user is difficult to carry out mutually by different wearable devices in itself
It is dynamic, and the lonely people of user situation movable on computer is caused, lack the application of community interactive so that wearable science and technology
Development with promote progress stagnate, hardly possible have the technological break-through more innovated.
By taking interactive performance as an example, existing interactive performance can make image and the limb of performing artist by image projecting technology
Body action produces interactive, the first recording image before performance, and the action for coordinating performing artist to prearrange produces nestable effect
(over-layering).But this method effectively can not carry out interaction and empathize during performance with spectators, and easily
Exposed the false when performing artist accidentally drops, the side effect for the image covering that performing artist is projected out more occurs.
With the development of science and technology gradually developing the detection technique that can sense limb action, this technology can be categorized as
Augmented reality (augmented reality, AR) and virtual reality (virtual reality, VR).Augmented reality allows real field
There is virtual article in Jing Zhongneng, reaches actual situation unification.For the Kinect of augmented reality Zhong You Microsofts exploitation as representing, use is infrared
Line sensor detects depth image, coordinates colour camera section to take image, then analyze user's limb action from image.
But the shortcomings that such a technology, is needed in large-scale performance, has been measured performance venue in advance and has been carried out large-scale sensing device further frame
If to can completely cover whole place.In addition infrared sensing technology is easily disturbed by light of stage and environment light source, with
And the delay caused by substantial amounts of image analysing computer on performance picture, Good Interaction quality can not be presented.
Virtual reality then creates entirely virtual environment.There are Oculus, Sony Playstation VR in virtual reality
It is used in solitaire game's experience true to nature, but virtual reality still has to take image by colour camera section, then from image
In analyze user's limb action, it is also desirable to high-quality image data carry out HPC, can also draw high network bandwidth
Demand, thus the interaction of the instantaneity between more people even strange land is reduced, cause can not broadly be applied.
The content of the invention
It is an object of the invention to provide a kind of wearable immediate interactive system, can solve existing augmented reality and virtual reality
Border because need carry out high-quality image data computing derive can not extensively using the problem of.
To take off purpose before reaching, the wearable immediate interactive system proposed by the invention, it is included:
An at least body-sensing detection means, it includes multiple wearable inspection units, and those wearable inspection units are for sensing
The action of one user, the user that an at least body-sensing detection means is sensed according to those wearable inspection units act production
Raw at least one set of action message;
One action processing unit, connects an at least body-sensing detection means, to receive and handle and the computing at least one set
Action message, and user's image information is produced according at least one set of action message, but the action processing unit produce to
Few environmental images information, and be a complete image information by user's image information and the environmental images information integration;And
An at least image display, the action processing unit is connected, to receive and show the complete image information.
Another object of the present invention is to provide a kind of wearable immediate interactive system, more people can be reached in above-mentioned framework
The instantaneity in strange land is interactive to be used.
To take off purpose before reaching, the wearable immediate interactive system proposed by the invention, it is included:
Multiple body-sensing detection means groups, each body-sensing detection means group include an at least body-sensing detection means, each body-sensing inspection
Survey device includes multiple wearable inspection units again, and those wearable inspection units are for the action of one user of sensing, and this is at least
The user that one body-sensing detection means is sensed according to those wearable inspection units, which acts, produces at least one set of action message;
Multiple transmission processing devices, it is corresponding respectively with the plurality of body-sensing detection means group, the connection of each transmission processing device with
An at least body-sensing detection means corresponding to it;
Multiple action processing units, corresponding respectively with the plurality of transmission processing device, each action processing unit connection is corresponding
Transmission processing device;
An at least high in the clouds exchanger, is connected between the plurality of transmission processing device, each transmission processing device by its from
At least one set of action message that a corresponding at least body-sensing detection means receives, by this, at least a high in the clouds exchanger is sent to it
His transmission processing device, and then other action processing units are sent to, each processing unit that acts receives all action messages,
And user's image information is produced according to those action messages, but the action processing unit produces an at least environmental images information,
And by user's image information and the environmental images information integration it is a complete image information;And
An at least image display, those transmission processing devices are connected, to receive and show the complete image information.
Because the present invention uses wearable body-sensing detection means, as the source of detection user's action, therefore have no
Existing augmented reality and virtual reality need to carry out high-quality image data computing derive can not extensively using the problem of, also because
And more have an opportunity may achieve more people with the interactive utilization of the instantaneity in ground or more people strange lands.
In order to be further understood that the present invention to reach technology, means and effect that predetermined purpose is taken, refers to
Below in connection with detailed description of the invention and schema, it is believed that the purpose of the present invention, feature and effect, when can thus one deeply and
It is specific to understand, but institute's accompanying drawings are only provided and used with reference to explanation, are not used for the present invention person of being any limitation as.
Brief description of the drawings
Fig. 1 is the framework block diagram of the wearable immediate interactive system of the present invention.
Fig. 2 is the specific framework block schematic diagram of the wearable immediate interactive system of the present invention.
Fig. 3 is the block schematic diagram of the wearable immediate interactive system single player mode operation of the present invention.
Fig. 4 is the specific framework block diagram of the more people's topotype operations of the wearable immediate interactive system of the present invention.
Fig. 5 is the specific framework block diagram of the more people's different area pattern operations of the wearable immediate interactive system of the present invention.
Fig. 6 is the system architecture schematic diagram that the wearable immediate interactive system strange land of the present invention is performed.
Fig. 7 provides the signal of the data exchange between different zones for wearable immediate interactive system high in the clouds of the invention exchanger
Figure.
Embodiment
Hereby the technical content and a detailed description for the present invention, schema is coordinated to be described as follows.
Wearable or device are in recent years emerging technologies, using still few in current performance field, rarely table
Drill group energy and interactive perform is carried out by Wearable.Generally multidigit performance be present simultaneously in being performed in art in its reason
Person, when these performing artists, which coordinate, performs various complicated action each other, uncertainty is filled with everywhere, except can not be accurately pre-
Future phase performance action is outer, and the instantaneity of attitude detection is also quite important.
Wearable with performing artist plays the part of very important role, in order to effectively reach " face between sensing performing artist
To, back to, it is close, remote, raise one's hand, turn to " etc. a large amount of limb actions, the number of pictures per second that sensing acts is drawn high by timesharing detection
(frame per second, FPS), it is ensured that detection data are possessed in each time timesharing section, and it is instant to reflect performing artists
Action.
The present invention sensing continuous action, the arithmetic system for distal end of arranging in pairs or groups immediately emphatically, may achieve interaction and perform application.More may be used
Further with network transmission action data, it is aided with time stab and completes strange land and perform interaction, even if allowing performing artist office differently
Side, also can " while strange land carry out interactive ".
Although Wearable plays the part of very important role, when the integration between Wearable needs to spend a large amount of
Between, (common name WISE) provides one and is easy to integrate the platform with performing so technology provided by the invention, can allow wearable set
The standby arithmetic expression system for integrating distal end, reach the arrangement under different performance situations.
WISE platforms are mainly that body-sensing Attitute detecting device carries Radio Transmission Technology, and it is immediately synchronous to combine strange land data
Stereopsis or virtual reality (virtual reality, VR)/augmented reality (augmented reality, AR) of integration/
Mix the display performance application of the situations such as real border (mixed reality, MR).
WISE platforms can detect object wearing device sensing actor poses action from body-sensing, and sensing is drawn high with decentralized detection technology
Data frequency by the action instant recording of performing artist into electronic signal, carried out via Back end data processing system is wirelessly transmitted to
Synchronization process, Analysis and Screening data, 3D is integrated into being combined differently by data transmission system again after shadow or VR/AR/MR systems
The virtual actor being pre-designed between area's servo and performance environment, adjust the transmission delay caused by network factors, build at any time
Interactive performance between strange land can be carried out immediately;In addition also provide by event judge based on feedback transmitter, can two-way triggering table
Reaction member on the person's of drilling object wearing device, build the body-sensings such as vibration, flash of light, sound feedback.
WISE platforms effectively reduce the complexity of the traditional performance stage construction of line and break through the region thing of on-the-spot demonstration
Reason limitation, allow stage and performance to pass through WISE platforms and there can be the presentation of more polynary more wide regional coverage, enrich effect and the sight of performance
Many quantity, and be easy to adjustment and be applied to different situations.
It is embodiments of the invention below, is the first embodiment of the wearable immediate interactive system of the present invention shown in Fig. 1
Framework block diagram.In interactive digital is performed, the Wearable with performing artists carries out transmission information by WISE platforms
With computing, it is divided into three big devices, including a body-sensing detection means 10, the one action shadow of processing unit 20 and one according to major function
As display device 30, subelement and multiple module are subdivided into according to function between each device, is completed by the combination of different subelements
The exploitation of technology and platform are easy to integration, compatible, execution.WISE platforms are used in during interactive digital performs, with possess high efficiency,
The transmission of information between object wearing device is managed to low latency, and the wearable device of high extendibility and service management, to simplify wearing
The application development that formula interaction is performed.
In WISE platform applications on interactive digital is performed, the body-sensing detection means 10 is to be worn on the sense with performing artist
Survey device, including multiple wearable inspection units 11 (claiming WISE Item), the plurality of wearable (WISE of inspection unit 11
Item) the several positions that can be worn by a user, user's actions taken afterwards all can be by respectively this be wearable
Inspection unit 11 (WISE Item) senses, and an at least body-sensing detection means 10 can be according to those wearable inspection units 11
The user that (WISE Item) is sensed, which acts, produces at least one set of action message.
The core of the wearable inspection unit 11 (WISE Item) as the body-sensing detection means 10, each wearable inspection
Know that unit 11 (WISE Item) is all independent node, be independent of each other each other, it is indivedual to be responsible for reading data and receiving ordering
Function.Each wearable inspection unit 11 (WISE Item) is independent, and caused data only represent it by user
The case of motion at the position of wearing, so whole body could be produced by subsequently also needing to connect these nodes by Image model
Animation, this behavior referred to as " interlocks ".Each group joint is connected by interlocking, actual response user could be allowed each
The action of kind of posture, during as raising one's hand, the lifting from last arm, forearm to wrist is that linkage function generates;During implementation, often
A MPU6050 (posture sensing device) can be set on individual wearable inspection unit 11 (WISE Item), each wearable inspection unit
11 (WISE Item) are used as an isolated node, and actively set from it MPU6050 reads Yaw, Pitch, Roll tri-
Axle attitude data.
It is shown in Figure 2, for the specific framework block schematic diagram of the wearable immediate interactive system of the present invention.In this implementation
In example, the wearable inspection unit 11 includes an attitude detection module 111, a distance sensing module 112 and timesharing detection mould
Block 113.
Human action is reached by the rotation in joint with it, and the change that learn human body attitude is by sensing with it
Device obtains data, generally coordinates accelerometer (accelerometer) to take with gyroscope (gyroscope) on the market at present
Data are obtained, therefore in embodiments of the invention with six axle posture sensing devices or nine axle postures with built-in accelerometer and gyroscope
Sensor is used as the attitude detection module 111, and attitude data can be freely defined by open source (open source)
Form, not only function meet design requirement, commercially available price is also quite cheap, it therefore meets need each joint dress sensor
Use demand reach low cost advantage.
In addition, the distance sensing module 112 is used as ranging sensing, implementation still uses to be referred to by received signal strength
Show the sensor of (received signal strength indicator, RSSI) signal of change distance for it.The timesharing is examined
Survey module 113 and each sensor acquisition sensing signal, the time stab of data are provided.
Because in the design of implementation, those wearable inspection units 11 (WISE Item) generally do not possess and can directly connected
The function of world-wide web is connect, in general more be able to can be placed on using a convenience serves as bluetooth and/or Wireless/wired network with it
The multi-party mediating device for turning to pass function is assisted, therefore as shown in Fig. 2 when it is implemented, the body-sensing detection means 10 is further wrapped
An intermediary sevices unit 12 (WISE Middleware) is included, the intermediary sevices unit 12 (WISE Middleware) receives those
The initial data that wearable inspection unit 11 (WISE Item) senses, and those original data processings are dynamic at least one set
Sent out after making information.Because easily shakiness is presented because of the remote situation of user in the connection of existing Bluetooth transmission mode
Determine state, along with the intermediary sevices unit 12 (WISE Middleware) is collectively formed by software and hardware, and it is wearable with those
Connected between inspection unit 11 (WISE Item) by wired or wireless transmission means, transmission that can also be wired or wireless
Mode sends out at least one set of action message, the wireless transmission method supported can be WiFi, bluetooth, 3G, 4G, 5G or
Other applicable wireless communication protocols.More specifically, the original transmitted by those wearable inspection units 11 (WISE Item)
Beginning data do not have fixed order and frequency, therefore the intermediary sevices unit 12 (WISE Middleware) further comprises
One data filtering module 121 and a data analysis module 122, wherein the data filtering module 121 are from those wearable detection lists
Non-default data format is filtered out in the initial data that 11 (WISE Item) of member are sensed, to ensure received action
Information is correct, effective, and it is invalid or not that filtered initial data can be screened and filtered out again by the data analysis module 122
After the data needed, just sent out after changing at least one set of action message.
In addition, the action processing unit 20 (WISE Display) connects an at least body-sensing detection means 10, to receive
And processing and computing at least one set of action message, and user's image information is produced according at least one set of action message,
Again the action processing unit 20 (WISE Display) produce an at least environmental images information, and by user's image information with
The environmental images information integration is a complete image information.
In the present embodiment, as shown in Fig. 2 the action processing unit 20 (WISE Display) includes a performer Cheng Yingmo
Block 21, an environmental modeling module 22 and an event judge setting module 23.
The performer Cheng Ying modules 21 receive and handle at least one set of action message with computing, and dynamic according at least one set
Make information and produce user's image information, to provide the image information of the personage of virtual role, animal ... etc.;The environmental modeling
Module 22 is responsible for producing an at least environmental images information, there is provided scene, background, the environmental images information of arena environment, and should
User's image information and the environmental images information integration are a complete image information, the role module of design is incorporated immediately
In environmental images;The event judges that setting module 23 is then responsible for judging moving for user's image information in the complete image information
Make, differentiate how the environmental images information adjusts or change according to this, and then notify the environmental modeling module 22 to produce new ring
Border image information, and be a new complete image information by user's image information and new environmental images information integration.
In the implementation of the present invention, it is related to data instantaneity, renewal rate and low latency demand, so in data processing
Above, it is necessary to be walked toward the direction of reduction data volume, shortening data processing time, Protocol Buffers' (abbreviation protobuf)
Design characteristics just focus on data volume is smaller, processing speed faster, and crucial compatibility is high, therefore the implementation of the present invention
Example is used using protobuf as data transfer.
The image display 30 connects the action processing unit 20, to receive and show the complete image information;Implementation
On, the image display 30 can be a screen display, a head mounted display, a projector or other shadows available for display
As the equipment of picture.
From the foregoing, when user wears the wearable body-sensing detection means of the present invention, as long as body has action, this is dynamic
Dealing with device 20 (WISE Display) by the body-sensing detection means 10, can learn that the action of user changes, and according to
To be converted into user's image information and user's image information get integrated into environment image information, and then in the image display
Show on 30, therefore the present invention has no existing augmented reality and virtual reality and needs progress high-quality image data computing to be derived
Can not extensively using the problem of.
The application of the present invention passes through the picture of the image display 30 display except entity body to be turned to virtual body again
Face and just as joining in Virtual Space outside, still further derivative allow user to produce vision, tactile in Virtual Space, listen
The sense feedbacks such as feel, make experience truer, therefore refer to shown in Fig. 3, are the implementation that the present invention possesses sense feedback function
The single player mode operational block figure of example, in the present embodiment, the present invention further comprises a transmission processing device 40, and the wearing
Formula inspection unit 11 further comprises a sense feedback module 114, and the action processing unit 20 (WISE Display) is then entered
One step includes a feedback trigger module 24.
The transmission processing device 40 (WISE Platform) be connected to the action processing unit 20 (WISE Display) with
Between an at least body-sensing detection means 10 and the action processing unit 20 (WISE Display) and the image display
Between 30, connection and data processing between collaboration, and the transmission processing device 40 (WISE Platform) includes one
Regional coordination device 41 (WISE local coordinator) and a general register 42 (WISE local broker).
Due to the intermediary sevices unit 12 (WISE Middleware) Core Feature software section data processing and
Monitoring nodes, therefore during implementation, the intermediary sevices unit 12 (WISE Middleware) can be received to come from by blue tooth connection and is somebody's turn to do
The initial data that a little wearable inspection units 11 (WISE Item) are read, and those initial data are changed into the good lattice of specification
Formula, after producing at least one set of action message, transmitting at least one set of action message then through wirelessly or non-wirelessly network should
Transmission processing device 40 (WISE Platform), or it is each by noting down by the transmission processing device 40 (WISE Platform)
The MAC Address of intermediary sevices unit 12 (WISE Middleware) transmit the sense feedback information to corresponding in turn
Wearable inspection unit 11 (WISE Item), that is, the intermediary sevices unit 12 (WISE Middleware) is responsible for and is somebody's turn to do
The connection of a little wearable inspection units 11 (WISE Item), then passes through with the transmission processing device 40 (WISE Platform)
Agreement is managed communication and data transfer.
As shown in figure 3, the regional coordination device 41 (WISE local coordinator) includes a Data Integration module 411
And a device management module 412, wherein the Data Integration module 411 integrates at least one set of action message received, and is somebody's turn to do
Those wearable inspection units 11 (WISE Item) that device management module 412 then stores the body-sensing detection means 10 are related
Information, make those wearable (WISE of inspection unit 11 that the Data Integration module 411 can smoothly with the body-sensing detection means 10
Item) line.During implementation, by intermediary sevices unit 12 (WISE Middleware) company of foundation in a manner of IP based network
Line, and the friendship that the regional coordination device 41 (WISE local coordinator) is reached an agreement on are held, and are started with the agreement appointed
Data communication, completion acquisition setting shelves and the body-sensing detection means 10 (WISE Item) are wired to transmission attitude data, and this is complete
Action;And shelves are set using the Json of human readable, to set the body-sensing detection means 10 of increase and decrease bottom, set in shelves most
Outer layer carries out multigroup setting with array, and by pre-set each channel, the data separation of different kenels is come,
Respective data are allowed to have exclusive channel to complete high-performance instantaneous transmission.Further, since Json setting shelves can not be taken by intermediary
Business unit 12 (WISE Middleware) is directly read, therefore the regional coordination device 41 (WISE local coordinator)
Can also as transfer interpreter, by the data that intermediary sevices unit 12 (WISE Middleware) is sent translate to Json setting shelves, or
It is that Json setting shelves are translated into the data that intermediary sevices unit 12 (WISE Middleware) can be read.
The general register 42 (WISE local broker) connects the regional coordination device 22 (WISE local
Coordinator), it is responsible for temporary, filtering, is handled with transmitting through the regional coordination device 41 (WISE local coordinator)
RabbitMQ or MQTT can be used in the action message crossed, the specific implementation of the general register 42 (WISE local broker)
Software is reached, and repeats to receive with issue (publisher) reduction time delay and subscriber by subscribing to (subscriber)
The problem of information;The general register 42 (WISE local broker) is in the nature a kind of information intermediary (message
Broker), what is done is exactly receive information, and then message transport is gone out again, by its information queue system, can be easy to
Scattered Data Integration is got up, then cooperative system operates together.Therefore, by the general register 42 (WISE local
Broker sensing data and issue feedback signal) are subscribed to, completes two-way data flow, instant acquirement sensing data allows animation streams
Do not stop freely.The general register 42 (WISE local broker) may include a data storage module 421, be handed over as information
Core is changed, the transmission can store, managed data and ensure the term of validity and data.
The sense feedback module 114 provides body-sensing feedback effects, and the body-sensing feedback effects can be tactile (such as by vibrator
Vibration reach), vision (such as being reached by the luminous of flasher), the sense of hearing (such as sound is sent by buzzer and reached), smell
(such as spray essence by essence eruption device and reach) etc. appoints one or more human perception effects.
The feedback trigger module 24 judges that setting module 23 is connected with the event, judges that setting module 23 judges by the event
The action of user's image information in the complete image information, differentiates how the feedback trigger module 24 acts according to this, and then
The feedback trigger module 24 is notified to send the sense feedback of the sense feedback module 114 of a corresponding specific wearable inspection unit 11
Information, the sense feedback signal is sent to by corresponding wearable inspection by the transmission processing device 40 (WISE Platform)
Know the sense feedback module 114 of unit 11, body-sensing feedback effects are produced by the sense feedback module 114, provided so as to reach
In virtual tactile, acoustically, in smell, visual body-sensing feedback, make the experience of user truer.
The present invention is equally applicable for more people and carries out interaction together in addition to above-mentioned application, as shown in figure 4, being the more of the present invention
The operational block figure of people's topotype embodiment, a body-sensing detection means is dressed respectively by two users for being in same environment
10 wearable inspection unit 11 (WISE Item), respectively the body-sensing detection means 10 is not by its wearable institute of inspection unit 11
The user's action sensed, produces individually action message, and via individual other (WISE of intermediary sevices unit 12
Middleware) connect and action message is sent at the action by the transmission processing device 40 (WISE Platform)
Device 20 (WISE Display) is managed, it is more by this is integrated after the action processing unit 20 (WISE Display) processing, computing
The complete image information of the action message that individual body-sensing detection means 10 is detected and an at least environmental images information passes through the transmission
Processing unit 40 (WISE Platform) is sent to the image display 30.Specifically, if two users are complete at this
In the virtual environment of image information, have and contact with each other or interactive situation, the action processing unit 20 (WISE Display) can
The complete image information or sense feedback information for including different environmental images information are produced accordingly, and by this comprising different
The complete image information of environmental images information is sent to the image by the transmission processing device 40 (WISE Platform) and shown
Device 30, or the sense feedback information is sent to the body-sensing by the transmission processing device 40 (WISE Platform) and examined
Device 10 is surveyed, thus reaches user to see that other side contacts in virtual environment or interaction with oneself mutually, even with
Person the sense feedback module 114 of wearable inspection unit 11 (WISE Item) can also do from the body-sensing detection means 10,
Such as vibration, flash of light, the feedback of sound, feel just as really in interactive or contact, making experience truer.
As shown in figure 5, being the block schematic diagram of the more people's different area pattern operations of the wearable immediate interactive system of the present invention, and it is
Reach the interactive effect of the user of different places, the system of the invention set in each place forms mutual disjunct independence
Topology network (topology), to allow interaction to each other just to carry out interregional data exchange, also begin to involve Internet
The configuration of network, the general common practice are as follows:
It can directly allow set DEU data exchange unit 40 (WISE Platform) in each place that there is a network position individually
Location, to carry out interaction by the mutual connection of the DEU data exchange unit 40 in each place (WISE Platform);It is only each field
DEU data exchange unit 40 (WISE Platform) individual networks address management and control and operating cost it is higher.
Also host node can be used as by one of DEU data exchange unit 40 in each place (WISE Platform), other
The DEU data exchange unit 40 (WISE Platform) in place is all used as the (WISE of DEU data exchange unit 40 of host node by this
Platform) line, only this way is except DEU data exchange unit 40 (WISE Platform) heavy load that can be allowed as host node
Outside, once breaking down, the line in more people strange lands will be affected.
For these reasons, the present invention further comprises that a high in the clouds is handed in the preferred embodiment of more people's different area patterns operation
Parallel operation 50 (WISE cloud exchanger).For example, three users are allowed each to install a body-sensing detection means 10 and a shadow
As display device 30, wherein, with being located at first, two users with being located at second, are distinctly all set to first a user with second
There are an action processing unit 20 (WISE Display) and a transmission processing device 40 (WISE Platform), the body-sensing on first ground
Detection means 10 by first transmission processing device 40 (WISE Platform) connection and transfer operation information to first ground action
Processing unit 20, then by second transmission processing device 40 (WISE Platform) connects simultaneously the body-sensing detection means 10 on second ground
Transfer operation information to second ground action processing unit 20, and the high in the clouds exchanger 50 (WISE cloud exchanger) connect
In the transmission processing device 40 (WISE Platform) on first ground regional coordination device 41 (WISE local coordinator) and
The regional coordination device 41 (WISE local coordinator) of the transmission processing device 40 (WISE Platform) on second ground it
Between.
During running, the regional coordination device 41 (WISE local coordinator) on first ground can be from the regional coordination device on second ground
41 (WISE local coordinator) receive the action message that two body-sensing detection means 10 from second ground are transmitted,
(the WISE of action processing unit 20 on first ground is sent to by the general register 42 (WISE local broker) on first ground
Display), by the action processing unit 20 (WISE Display) on first ground according to from first the body-sensing detection means with second ground
10 action message, a complete image information is produced according to this, or produce the complete image information and sense feedback information simultaneously,
The regional coordination device 41 (WISE local coordinator) on second ground can be from (the WISE local of regional coordination device 41 on first ground
Coordinator the action message that the body-sensing detection means 10 from first ground is transmitted) is received, passes through the local register on second ground
Device 42 (WISE local broker) sends the action processing unit 20 (WISE Display) on second ground to, by the action on second ground
Processing unit 20 (WISE Display) produces according to this according to from first the action message with the body-sensing detection means 10 on second ground
Complete image information, or the complete image information and sense feedback information are produced simultaneously;Then, the action processing unit on first ground
20 (WISE Display) are again by the transmission processing device 40 (WISE Platform) on first ground by the complete image information transmission
Show on to the image display 30 on first ground and by the body-sensing detection means 10 of the sense feedback information transmission to first ground with
Body-sensing feedback effects are produced by its sense feedback module 114, the action processing unit 20 (WISE Display) on second ground passes through again
Image display 30 of the transmission processing device 40 (WISE Platform) on second ground by the complete image information transmission to second ground
On show and produce the body-sensing detection means 10 of the sense feedback information transmission to second ground by its sense feedback module 114
Raw body sense feedback effects, even consequently, it is possible to be in respectively in the user of the first and second two places, it can all pass through the fortune of the present embodiment
Make, reach the interactive utilization of instantaneity in more people strange lands, make the experience of user truer.
Specifically, first with the strange land data on second ground and information transfer, exchange, pass through (the WISE of high in the clouds exchanger 50
Cloud exchanger) it is performed, the high in the clouds exchanger 50 (WISE cloud exchanger) provides different transmission process
Data exchange between device 40 (WISE Platform).In this preferred embodiment, the high in the clouds exchanger 50 (WISE
Cloud exchanger) include a data simultaneous module 51, a data storage module 52 and a data forwarding module 53.Should
Data simultaneous module 51 is played when multidigit user, that is, when there are the wearable immediate interactive system more body-sensings to detect
When device 10 to sense the action of multidigit user respectively, the data simultaneous module 51 data analysis module 122 that can align sieves
Time shaft caused by whole body data after selecting and filtering out, reach the purpose of data syn-chronization, after the completion of provide data to the data
Storage module 52 and the data forwarding module 53.The data storage module 52 is configured to temporarily store data.The data forwarding module 53 is used
Linked up in other action processing units 20 (WISE Display).
In addition, the image instantaneity of all nodes declines caused by order to avoid blocking because of single cloud service network, such as Fig. 6
Shown, another preferred embodiment of the invention can build multiple (WISE cloud of high in the clouds exchanger 50 by cloth beyond the clouds
Exchanger), each high in the clouds exchanger 50 (WISE cloud exchanger) is in addition to carrying out region swapping data,
Also have the detection function of line quality concurrently simultaneously, in the present embodiment, so-called line quality is with the network package turnaround time
(round trip time, RTT) as the foundation judged, it is better that lower person represents line quality, is brought by network transmission
Delay it is fewer, it is more high then on the contrary;Then the regional coordination device 41 (WISE local coordinator) can heuristically direction
Each high in the clouds exchanger 50 (WISE cloud exchanger) sends network package, and according to network package turnaround time RTT
The most short high in the clouds exchanger 50 (WISE cloud exchanger) of required time is selected to carry out data transmission.Specific implementation
When, meeting is in each regional coordination device 41 (WISE local coordinator) according to setting shelves with each high in the clouds exchanger 50
(WISE cloud exchanger) leading line, can be periodically by each (WISE cloud of high in the clouds exchanger 50 after stable connection
Exchanger the package of detection RTT values) is sent to each regional coordination device 41 (WISE local coordinator), according to
The data format of definition, with get/RTT behavior, each high in the clouds exchanger 50 (WISE cloud exchanger) is calculated from sending
Package to from each regional coordination device 41 (WISE local coordinator) recovery package time assisted as each region
Adjust the Initial R TT values of device 41 (WISE local coordinator), e.g. RTT1、RTT2、…RTTN, but each regional coordination
The RTT values of device 41 (WISE local coordinator), which need to pass through following amendment computing, to be obtained, and its step is as follows:
Step 1:First calculate total value RTTtotal=RTT1+RTT2+…+RTTN
Step 2:The RTT of each regional coordination device 41 (WISE local coordinator) after amendment computingNValue
RTT1=(RTTtotal-RTT1)/(N-1)+RTT1
RTT2=(RTTtotal-RTT2)/(N-1)+RTT2
…
RTTN=(RTTtotal-RTTN)/(N-1)+RTTN
Each high in the clouds exchanger 50 (WISE cloud exchanger) is by each (WISE of regional coordination device 41 of institute's computing
Local coordinator) RTTNValue sends corresponding regional coordination device 41 (WISE local coordinator) to, such as
This each regional coordination device 41 (WISE local coordinator) can obtain corresponding different high in the clouds exchangers 50
The RTT of (WISE cloud exchanger)NValue.
Via aforesaid way, it is not necessary to which complicated calculating just can allow each (WISE local of regional coordination device 41
Coordinator its RTT value between each high in the clouds exchanger 50 (WISE cloud exchanger)) is known.Afterwards, often
(the WISE of high in the clouds exchanger 50 of line performance optimal just may be selected in individual regional coordination device 41 (WISE local coordinator)
Cloud exchanger) carry out data transmission.
It is preferred that each high in the clouds exchanger 50 (WISE cloud exchanger) can only receive assisted from a region every time
The data of device 41 (WISE local coordinator) are adjusted, and turn to be transmitted to other regional coordination devices 41 (WISE local
Coordinator), it so can ensure that each line can keep lowest latency.
If the wearable immediate interactive system of the present invention is applied when being performed in more people strange lands, its Organization Chart is as shown in Figure 7.By
Existing art is limited in geographic distance to perform, has allowed performing artist's interaction scope must be limited on same stage.So
And utilize the technology of the present invention, just can area for penetration limitation, when being in two places or even more than the performing artist of two places is carried out each other
When the action such as moving, turn round, the body-sensing detection means 10 will obtain the action message of user, pass through Miniature programmable electricity
Brain receives the whole action message and plus after time stab, and the action message can pass through the high in the clouds exchanger 50 (WISE cloud again
Exchanger) carry out data transmission, though there is Duo Tai high in the clouds exchanger 50 (WISE cloud exchanger) as shown in the figure,
The present invention can automatic screening most preferably transmit the high in the clouds exchanger 50 (WISE cloud exchanger) of quality and carry out data transmission,
Action message is sent in the action processing unit 20 (WISE Display) in each place with Radio Transmission Technology and united
Integration, judgement and the Analysis and Screening of one efficient computing, huge and scattered action message is effectively converted into complete image letter
Breath and sense feedback information, consequently, it is possible to be in numerous performing artists in strange land, except it can be seen by the image display 30
His performing artist is before eyes, and being even between the performing artist in strange land can also produce just as really in interactive or contact, so
The stage performed can be extended to the whole world, break the estrangement of geographical space.
From the foregoing, virtual reality and wearable system by immersion, allow performing artist to be carried out in Virtual Space
Interaction, and play substantive sense feedback.In experience, multidigit performing artist is respectively at strange land, passes through virtual reality glasses
(virtual reality, VR) and the body-sensing detection means 10, entity body is turned to virtual body, join in void immediately
Intend space and carry out interaction.All touching in Virtual Space, vision, tactile, the sense of hearing can be also produced so as to sensigenous anti-
Feedback, makes experience truer.
By using body as sound and the generator of visual effect, with reference to VR, limbs detector and tactile inductor etc.,
The body of entity is converted into virtual body.By network by the body of different location, it is transferred on high in the clouds, forms a void
Intend the virtual social field domain of body.Other side's virtual body can be touched each other and trigger sound, entity body also has true touch
The sensation of feel.Set out with brand-new body intuition, start brand-new scientific and technological media.
Only, described above, the detailed description of preferred embodiment only of the present invention and schema, only feature of the invention is simultaneously
This is not limited to, and is not used to the limitation present invention, all scopes of the invention should be defined by following claims, all conjunctions
In the embodiment of spirit change similar with its of scope of the present invention patent, should all be contained in scope of the invention, it is any
Be familiar with this those skilled in the art in the field of the invention, can think easily and change or modification can all cover patent in following this case
Scope.
Claims (13)
1. a kind of wearable immediate interactive system, it is characterised in that include:
An at least body-sensing detection means, it includes multiple wearable inspection units, and those wearable inspection units make for sensing one
The action of user, the user that an at least body-sensing detection means is sensed according to those wearable inspection units, which acts, to be produced extremely
Few set information;
One action processing unit, connects an at least body-sensing detection means, is acted with receiving and handling at least one set with computing
Information, and user's image information is produced according at least one set of action message, and the action processing unit produces at least one
Environmental images information, and be a complete image information by user's image information and the environmental images information integration;And
An at least image display, the action processing unit is connected, to receive and show the complete image information.
2. wearable immediate interactive system as claimed in claim 1, it is characterised in that:
Each wearable inspection unit includes a sense feedback module, and the sense feedback module provides body-sensing feedback effects;
The action processing unit includes a feedback trigger module, judges to make in the complete image information by the action processing unit
The action of user's image information, so by the feedback trigger module according in the complete image information user's image information it is dynamic
Make, send the sense feedback information of the sense feedback module of a corresponding at least one wearable inspection unit, the action processing unit
Sense feedback module by the sense feedback information transmission to the corresponding at least one wearable inspection unit, it is corresponding extremely by this
A few sense feedback module produces body-sensing feedback effects.
3. wearable immediate interactive system as claimed in claim 2, it is characterised in that an at least body-sensing detection means is worn
Body-sensing caused by wearing formula inspection unit be fed back to visual feedback, touch feedback, audio feedback, smell feedback any one or wantonly two
It is more than person.
4. wearable immediate interactive system as claimed any one in claims 1 to 3, it is characterised in that action processing dress
Put and include:
One performer's Cheng Ying modules, receive and handle at least one set of action message with computing, and acted and believed according at least one set
Breath produces user's image information;
One environmental modeling module, an at least environmental images information is produced, and user's image information and the environmental images are believed
Breath is integrated into a complete image information;And
One event judges setting module, judges the action of user's image information in the complete image information.
5. wearable immediate interactive system as claimed any one in claims 1 to 3, it is characterised in that further comprising one
Transmission processing device, wherein:
An at least body-sensing detection means further includes an intermediary sevices unit, wherein respectively the wearable inspection unit sensing should
The action of user, and an initial data is produced respectively, and an at least body-sensing detection means, and the intermediary sevices unit connects
To those wearable inspection units, and after receiving those initial data, at least one set action is produced according to those initial data
Information;
The transmission processing device is connected between the action processing unit and an at least body-sensing detection means and at the action
Manage between device and the image display, connection and data processing between collaboration.
6. wearable immediate interactive system as claimed in claim 5, it is characterised in that the transmission processing device includes:
One regional coordination device, comprising:
One Data Integration module, integrate at least one set of action message received;And
One device management module, store those wearable inspection unit relevant informations of the body-sensing detection means;And
One general register, the regional coordination device is connected, and keep in, filter, being moved with transmitting through what the regional coordination device treated
Make information.
7. wearable immediate interactive system as claimed in claim 6, it is characterised in that comprising multiple body-sensing detection means, its
In user that respectively the body-sensing detection means is individually sensed its wearable inspection unit act, indivedual generations action letters
Breath, and connect via the intermediary sevices unit of the respectively body-sensing detection means and transmitted action message by the transmission processing device
To the action processing unit, after action processing unit processing, computing, it will integrate what the plurality of body-sensing detection means was detected
The complete image information of action message and an at least environmental images information is sent to the image by the transmission processing device and shown
Device.
8. wearable immediate interactive system as claimed any one in claims 1 to 3, it is characterised in that each wearable detection
Unit includes respectively:
One attitude detection module, detect the posture action of the user;
One distance sensing module, sense the range information of the user;And
One timesharing detection module, there is provided the posture action and the time stab of the range information.
9. a kind of wearable immediate interactive system, it is characterised in that include:
Multiple body-sensing detection means groups, each body-sensing detection means group include an at least body-sensing detection means, each body-sensing detection dress
Put and including multiple wearable inspection units, for those wearable inspection units for the action of one user of sensing, this is at least integral
The user that sense detection means is sensed according to those wearable inspection units, which acts, produces at least one set of action message;
Multiple transmission processing devices, corresponding respectively with the plurality of body-sensing detection means group, each transmission processing device connection is right with it
At least body-sensing detection means answered;
Multiple action processing units, corresponding respectively with the plurality of transmission processing device, each act passes corresponding to processing unit connection
Transportation processing equipment;
An at least high in the clouds exchanger, is connected between the plurality of transmission processing device, and each transmission processing device is certainly corresponding by it
An at least body-sensing detection means receive at least one set of action message, by this, at least a high in the clouds exchanger is sent to other biographies
Transportation processing equipment, and then other action processing units are sent to, each processing unit that acts receives all action messages, and root
User's image information is produced according to those action messages, but the action processing unit produces an at least environmental images information, and will
User's image information and the environmental images information integration are a complete image information;And
Multiple image displays, respectively the image display connect those transmission processing devices respectively, to receive and show this
Complete image information.
10. wearable immediate interactive system as claimed in claim 9, it is characterised in that:
Each wearable inspection unit includes a sense feedback module, and the sense feedback module provides body-sensing feedback effects;
Each action processing unit includes a feedback trigger module, judges to make in the complete image information by each action processing unit
The action of user's image information, so by the feedback trigger module according in the complete image information user's image information it is dynamic
Make, send the sense feedback information of the sense feedback module of a corresponding at least one wearable inspection unit, respectively act processing unit
Sense by corresponding data transmission module by the sense feedback information transmission to the corresponding at least one wearable inspection unit
Feel feedback module, body-sensing feedback effects are produced by a corresponding at least sense feedback module.
11. wearable immediate interactive system as claimed in claim 10, it is characterised in that an at least body-sensing detection means
Body-sensing caused by wearable inspection unit is fed back to any one of visual feedback, touch feedback, audio feedback, smell feedback or appointed
More than both.
12. the wearable immediate interactive system as any one of claim 9 to 11, it is characterised in that include multiple clouds
Exchanger is held, each high in the clouds exchanger is connected between the plurality of transmission processing device, wherein those transmission processing devices selection one
High in the clouds exchanger line.
13. wearable immediate interactive system as claimed in claim 12, it is characterised in that each transmission processing device is according to an envelope
The foundation of turnaround time alternatively high in the clouds exchanger is wrapped, detection is sent to each data transmission module by each high in the clouds exchanger
The package of RTT values, each high in the clouds exchanger are calculated from package is sent to the time conduct from each data transmission module recovery package
The initial package turnaround time of each data transmission module, include RTT1、RTT2、…RTTN, and the RTT of each data transmission moduleN
Value, which need to pass through following amendment computing, to be obtained, and its step is as follows:
First calculate the total value package turnaround time:RTTtotal=RTT1+RTT2+…+RTTN;
The RTT of each data transmission module after amendment computingNValue:
RTT1=(RTTtotal-RTT1)/(N-1)+RTT1;
RTT2=(RTTtotal-RTT2)/(N-1)+RTT2;
…
RTTN=(RTTtotal-RTTN)/(N-1)+RTTN;
Each high in the clouds exchanger is by the RTT of each data transmission module of institute's computingNValue sends corresponding data transmission module to, makes
Each data transmission module obtains the RTT of corresponding different high in the clouds exchangersNValue, wherein the selection of each data transmission module has most
Low RTTNThe high in the clouds exchanger of value carries out line.
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
TW106112349A TWI644235B (en) | 2017-04-13 | 2017-04-13 | Wearable instant interaction system |
TW106112349 | 2017-04-13 |
Publications (1)
Publication Number | Publication Date |
---|---|
CN107818595A true CN107818595A (en) | 2018-03-20 |
Family
ID=61607077
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201710908255.1A Pending CN107818595A (en) | 2017-04-13 | 2017-09-29 | Wearable Instant Interaction System |
Country Status (2)
Country | Link |
---|---|
CN (1) | CN107818595A (en) |
TW (1) | TWI644235B (en) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
TWI679557B (en) * | 2018-05-14 | 2019-12-11 | 國立臺灣師範大學 | Adaptive sport posture sensing system and method |
CN111385619A (en) * | 2018-12-28 | 2020-07-07 | 宏正自动科技股份有限公司 | Video interaction system |
Families Citing this family (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
TWI737068B (en) * | 2019-12-06 | 2021-08-21 | 未來市股份有限公司 | Motion tracking system and method |
CN113029190A (en) * | 2019-12-09 | 2021-06-25 | 未来市股份有限公司 | Motion tracking system and method |
TWI725803B (en) * | 2020-03-31 | 2021-04-21 | 林閔瑩 | System for recognizing abnormal activity of human body using wearable electronic device and mixed reality technology |
US11983321B1 (en) | 2023-04-10 | 2024-05-14 | Htc Corporation | Hand-free haptic feedback system and method |
Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103188727A (en) * | 2011-12-30 | 2013-07-03 | 财团法人工业技术研究院 | Communication system and method for assisting transmission of TCP packets |
CN203070360U (en) * | 2012-10-22 | 2013-07-17 | 广州新节奏数码科技有限公司 | Virtual dressing equipment |
CN104104647A (en) * | 2013-04-02 | 2014-10-15 | 宏碁股份有限公司 | Connection keeping method |
US20150091711A1 (en) * | 2013-09-27 | 2015-04-02 | Nokia Corporation | Wearable electronic device |
CN104516496A (en) * | 2013-10-04 | 2015-04-15 | 财团法人工业技术研究院 | Multi-person guidance system and method capable of adjusting motion sensing range |
CN104717212A (en) * | 2014-10-21 | 2015-06-17 | 中华电信股份有限公司 | Protection method and system for cloud virtual network security |
CN106155198A (en) * | 2015-05-15 | 2016-11-23 | 博能电子公司 | Wearable electronic equipment, non-transitory computer readable storage medium and method |
Family Cites Families (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7085818B2 (en) * | 2001-09-27 | 2006-08-01 | International Business Machines Corporation | Method, system, and program for providing information on proximate events based on current location and user availability |
IN2013CH05466A (en) * | 2013-11-27 | 2015-05-29 | Ineda Systems Pvt Ltd | |
CN105279354B (en) * | 2014-06-27 | 2018-03-27 | 冠捷投资有限公司 | User can incorporate the situation construct system of the story of a play or opera |
US9904255B2 (en) * | 2014-09-19 | 2018-02-27 | Htc Corporation | Wearable electronic device and event-intimating method of the same |
-
2017
- 2017-04-13 TW TW106112349A patent/TWI644235B/en active
- 2017-09-29 CN CN201710908255.1A patent/CN107818595A/en active Pending
Patent Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103188727A (en) * | 2011-12-30 | 2013-07-03 | 财团法人工业技术研究院 | Communication system and method for assisting transmission of TCP packets |
CN203070360U (en) * | 2012-10-22 | 2013-07-17 | 广州新节奏数码科技有限公司 | Virtual dressing equipment |
CN104104647A (en) * | 2013-04-02 | 2014-10-15 | 宏碁股份有限公司 | Connection keeping method |
US20150091711A1 (en) * | 2013-09-27 | 2015-04-02 | Nokia Corporation | Wearable electronic device |
CN104516496A (en) * | 2013-10-04 | 2015-04-15 | 财团法人工业技术研究院 | Multi-person guidance system and method capable of adjusting motion sensing range |
CN104717212A (en) * | 2014-10-21 | 2015-06-17 | 中华电信股份有限公司 | Protection method and system for cloud virtual network security |
CN106155198A (en) * | 2015-05-15 | 2016-11-23 | 博能电子公司 | Wearable electronic equipment, non-transitory computer readable storage medium and method |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
TWI679557B (en) * | 2018-05-14 | 2019-12-11 | 國立臺灣師範大學 | Adaptive sport posture sensing system and method |
CN111385619A (en) * | 2018-12-28 | 2020-07-07 | 宏正自动科技股份有限公司 | Video interaction system |
CN111385619B (en) * | 2018-12-28 | 2022-02-25 | 宏正自动科技股份有限公司 | Video interaction system |
Also Published As
Publication number | Publication date |
---|---|
TW201837660A (en) | 2018-10-16 |
TWI644235B (en) | 2018-12-11 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN107818595A (en) | Wearable Instant Interaction System | |
CN109976690B (en) | AR glasses remote interaction method and device and computer readable medium | |
RU2621644C2 (en) | World of mass simultaneous remote digital presence | |
Broll et al. | Meeting technology challenges of pervasive augmented reality games | |
CN109426333A (en) | A kind of information interacting method and device based on Virtual Space Scene | |
CN109671141B (en) | Image rendering method and device, storage medium and electronic device | |
CN105955463A (en) | BIM (Building Information Modeling)-based VR (Virtual Reality) virtual feeling system | |
US11769306B2 (en) | User-exhibit distance based collaborative interaction method and system for augmented reality museum | |
CN107533230A (en) | Head mounted display tracing system | |
US10661148B2 (en) | Dual motion sensor bands for real time gesture tracking and interactive gaming | |
CN108064364A (en) | It is used to implement the method and system of multi-user virtual environment | |
CN106095094B (en) | The method and apparatus that augmented reality projection is interacted with reality | |
US8724849B2 (en) | Information processing device, information processing method, program, and information storage medium | |
CN106170094A (en) | The live broadcasting method of panoramic video and device | |
CN105894584A (en) | Method and device used for interaction with real environment in three-dimensional immersion type environment | |
CN109358754A (en) | A kind of mixed reality wears display system | |
WO2021246183A1 (en) | Information processing device, information processing method, and program | |
CN106774820A (en) | The methods, devices and systems that human body attitude is superimposed with virtual scene | |
CN108280851A (en) | Depth map generation device | |
CN114510150A (en) | Experience system of virtual digital world | |
CN107945270A (en) | A kind of 3-dimensional digital sand table system | |
CN109529350A (en) | A kind of action data processing method and its device applied in game | |
CN207051853U (en) | A kind of immersive VR experiencing system | |
CN109478343A (en) | Capture and rendering are related to the information of virtual environment | |
CN108399008A (en) | A kind of synchronous method of virtual scene and sports equipment |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
WD01 | Invention patent application deemed withdrawn after publication | ||
WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20180320 |