CN102571764B - Real-time media optimization on remote session - Google Patents
Real-time media optimization on remote session Download PDFInfo
- Publication number
- CN102571764B CN102571764B CN201110436692.0A CN201110436692A CN102571764B CN 102571764 B CN102571764 B CN 102571764B CN 201110436692 A CN201110436692 A CN 201110436692A CN 102571764 B CN102571764 B CN 102571764B
- Authority
- CN
- China
- Prior art keywords
- path
- server
- real time
- computing device
- media data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000005457 optimization Methods 0.000 title abstract description 6
- 230000000875 corresponding Effects 0.000 claims description 5
- 230000005540 biological transmission Effects 0.000 claims description 3
- 238000000034 method Methods 0.000 description 11
- 238000010586 diagram Methods 0.000 description 8
- 238000004891 communication Methods 0.000 description 7
- 238000004590 computer program Methods 0.000 description 6
- 239000000203 mixture Substances 0.000 description 6
- 239000000969 carrier Substances 0.000 description 3
- 230000005611 electricity Effects 0.000 description 3
- 238000004364 calculation method Methods 0.000 description 2
- 239000003795 chemical substances by application Substances 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 235000009808 lpulo Nutrition 0.000 description 2
- 230000005291 magnetic Effects 0.000 description 2
- 230000014759 maintenance of location Effects 0.000 description 2
- 230000000051 modifying Effects 0.000 description 2
- 230000003287 optical Effects 0.000 description 2
- 241001465382 Physalis alkekengi Species 0.000 description 1
- 230000006399 behavior Effects 0.000 description 1
- 238000006073 displacement reaction Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000005538 encapsulation Methods 0.000 description 1
- 239000012530 fluid Substances 0.000 description 1
- 239000003365 glass fiber Substances 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 230000005055 memory storage Effects 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000006011 modification reaction Methods 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 230000000576 supplementary Effects 0.000 description 1
- 238000010408 sweeping Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Abstract
The invention discloses the real-time media optimization on remote session.Real-time media optimization can be provided.It is possible, firstly, to set up remote session with remote computing device.Then, during this remote session, non-real time media data can be exchanged by server path with remote computing device.Furthermore, it is possible to exchange real time media data by media path with remote computing device during this remote session.
Description
Technical field
The present invention relates to real-time media optimization.
Background technology
Video conference uses the long distance communication of Voice & Video the people in different location to be taken to and has a meeting together.This can be with individual
Two person-to-person dialogues in office's (point-to-point) are the simplest, or relate to having in each big room of different location
Some places (multiple spot) of more than one people.In addition to the audio frequency and visual transmission of meetings and activities, video conference can be additionally used in
Shared document, the information of Computer display and blank.
Summary of the invention
There is provided present invention to introduce some concepts further described in the following specific embodiments in simplified form.This
Summary of the invention is not intended as key feature or the essential feature of the claimed theme of mark.Present invention is also not intended to for limiting
Make the scope of theme required for protection.
Real-time media optimization can be provided.It is possible, firstly, to set up remote session with remote computing device.Then, at this remote session
Period, non-real time media data can be exchanged by server path with remote computing device.Furthermore, it is possible in this remote session phase
Between exchange real time media data by media path and remote computing device.
Foregoing general describes both to be provided example with described in detail below and be all merely exemplary.Therefore, foregoing general describes
With described in detail below be not considered as restrictive.Additionally, it is special to may also provide other in addition to those set forth herein
Levy or modification.Such as, each embodiment can relate to describe in detail described in various features combination and sub-portfolio.
Accompanying drawing explanation
Merge in the present invention and constitute part thereof of accompanying drawing and the various embodiments of the present invention are shown.In the accompanying drawings:
Fig. 1 is the block diagram of virtualized environment；
Fig. 2 is the block diagram of real-time media system；
Fig. 3 is the flow chart for the method providing real-time media to optimize；
Fig. 4 is the block diagram of real-time media system；And
Fig. 5 is the block diagram of the system including calculating equipment.
Detailed description of the invention
Detailed description below is with reference to each accompanying drawing.As possible, identical accompanying drawing mark is used the most in the accompanying drawings and the description below
Note indicates same or similar key element.Although may describing the embodiments of the present invention, but amendment, reorganization and other realities
The most also it is possible.For example, it is possible to the key element shown in accompanying drawing is replaced, adds or is revised, and can be by right
Disclosed method displacement, rearrangement or interpolation stage revise method described herein.Therefore, implement in detail below
Mode is not limiting as the present invention.On the contrary, the correct scope of the present invention is defined by the appended claims.
There is sensitive data and application program and (such as, security reason) sensitive data cannot be born or application program resides in visitor
The enterprise of family pusher side machine can use desktop virtual.Therefore, having had desktop virtual, thin client can be at client-side machine
Run on device, and sensitive data and application program run on the server controlled by enterprise.In this case, this application journey
The user interface (UI) on only client-side machine that sequence is run the most on the server and all users see.Therefore,
System manager's renewable server side reflection of enterprise.Then, when user logs on server, this user obtains system pipes
Reason person wants the recent software pushed.
Fig. 1 is the block diagram of virtualized environment 100.As it is shown in figure 1, there has been desktop virtual, actual treatment can be at server
105 rather than client-side machine 110 on complete.(that is, the application run in virtualized environment 100 of these application programs
Program) it is referred to alternatively as " virtualization applications program ".Such as, the first application program 115 and the second application program 120 actually may be used
To run on server 105.Client-side machine 110 can present and display corresponds respectively to the first application program 115 and
The first user interface 125 of two application programs 120 and the second user interface 130.For non real-time application program (such as, literary composition
Word processing, electrical form etc.) virtualization applications program can be acceptable, wherein initial data (such as, key input etc.)
Can be sent to server from client-side machine, the virtualization applications program run on that server obtains user and inputs and locate
Reason data.
Real time audio frequency/videofrequency conference applications program can be run in above-mentioned virtualized environment as virtualization applications program.Real-time audio
/ videoconference application can obtain the original audio/video data captured from client-side machine, encodes data, and
And transmit coded data by such as wire.Compile it addition, real time audio frequency/videofrequency conference applications program can receive from network
Code data stream, is decoded coded stream, and in having decoded data stream on client-side machine.But, have
Virtualization real time audio frequency/videofrequency conference applications program, real-time with " non-virtualized " locally run on client-side machine
Application program is compared, and " virtualization " real-time application needs the journey that jumps (hop) more (such as, passing through server) of traversal.
When sending and receive real time audio frequency/videofrequency in non-virtualized real-time application, all process are at client-side machine
Non-complete on the server.Such as, client-side application captures audio/video from equipment, coding, and by wire from visitor
Family pusher side machine sends them.Contrary with non-virtualized, there is virtualization real-time application, such as, caught equipment by remote control
Or by server will be sent to from the original data stream of the equipment of seizure by remote desktop passage, the original audio captured/regard
Frequency is according to may be sent to that server.Additionally, the server in virtualized environment sends encoded stream.Therefore, at virtualization ring
In border, the path of audio/video exists the additional journey (such as, from client-side machine to server) that jumps.These add and jump
Journey can increase the delay/waiting time in real time audio frequency/videofrequency data stream.
Fig. 2 shows the real-time media system 200 according to the embodiments of the present invention.Real-time media system 200 can include
One client-side machine 205 (such as, local computing device), the second client-side machine 210 (such as, remote computing device),
Server 215 and network 220.According to the embodiments of the present invention, non-virtualized, real time audio frequency/videofrequency meeting can be passed through
Network 220 performs between the first client-side machine 205 and the second client-side machine 210.
If embodiments of the present invention use server path (that is, first jump journey 225 and second jump journey 230), then first
By additional for the existence journey that jumps in the path of the audio/video data between client-side machine 205 and the second client-side machine 210
(such as, from the first client-side machine 205 to server 215 and from server the 215 to the second client-side machine 210).
These additional journeys that jump can increase the real-time audio between the such as first client-side machine 205 and the second client-side machine 210/regard
Delay/waiting time in frequency data stream.
According to the embodiments of the present invention, between above-mentioned first client-side machine 205 and the second client-side machine 210
Delay/waiting time in real time audio frequency/videofrequency data stream can be by being not related to server 215 in real time audio frequency/videofrequency data stream
Avoid.Such as, audio/video data can be by being not related to the media path 235 of server 215 at the first client-side machine
205 and second transmit between client-side machine 210.But, if if not setting up media path 235 or this path exists
Lost efficacy after foundation, then audio/video data can be by server path at the first client-side machine 205 and the second client-side
Transmit between machine 210.
Any one in first client-side machine the 205, second client-side machine 210 and server 215 can include but not limit
In such as desk computer, notebook, mobile device, smart phone or personal digital assistant.Network 220 can wrap
Include the Internet or first client-side machine the 205, second client-side machine 210 can communicate thereon with server 215 appoints
The network of what type.Any one in first client-side machine the 205, second client-side machine 210 and server 215 can
Use such as calculates equipment 500 in greater detail and realizes hereinafter with reference to Fig. 5.
Fig. 3 is illustrate according to an embodiment of the present invention involved each in the method 300 providing real-time media to optimize
The flow chart in summary stage.Method 300 can use real-time media system 200 as above to realize.Below will in more detail
The mode in each stage of implementation method 300 is described.
Method 300 can begin at initial block 305 and proceeds to the stage 310, and the first client-side machine 205 can be with there
Remote computing device (such as, the second client-side machine 210) sets up remote session.Such as, as shown in Figure 4, application journey
Sequence 405 can be run on server 215.Application program 405 can include videoconference application.According to remote session,
The thin client run on the first client-side machine 205 can present and show the application corresponding to running on server 215
The user interface 415 of program 405.Application program 405 can complete the first client-side machine 205 and the second client-side machine
Remote session between 210.
The stage 310 of remote session set up by first client-side machine 205 from which, and method 300 may proceed to the stage 320,
First client-side machine 205 can during remote session by server path with remote computing device (such as, there
Second client-side machine 210) exchange non-real time media data.Such as, the non-real time media data exchanged can include such as
Corresponding to the videoconference session between the first client-side machine 205 and the second client-side machine 210 any non-audio or
Non-video data.Such as, non-real time media data can include the position corresponding to the first client-side machine 205, such as use
Data in urgent 911 callings.Non-real time media data may include but be not limited to client-server ability.These abilities can
For affecting the direct communication between two client computer.
Once the first client-side machine 205 exchanges non-real time media data in the stage 320, and method 300 just can proceed to
In the stage 330, the first client-side machine 205 can pass through media path 235 and remote computation during remote session there
Devices exchange real time media data.Real time media data can include audio or video data.If embodiments of the present invention are to reality
Time media data use server path (that is, first jump journey 225 and second jump journey 230), then at the first client-side machine 205
And the path of the audio/video data that second between client-side machine 210 jumps journey (such as, from the first client by additional for existence
Pusher side machine 205 is to server 215 and from server the 215 to the second client-side machine 210).These additional Cheng Kezeng that jump
Add the delay in the real time audio frequency/videofrequency data stream between the such as first client-side machine 205 and the second client-side machine 210
/ the waiting time.
The embodiments of the present invention can be by having remote media manager (RMM) on the first client-side machine 205
(such as, remote media manager application 410) avoids above-mentioned delay/waiting time, and this RMM can catch real-time matchmaker
Volume data (such as, addible audio/video and other mode), encodes real time media data and by it from the first visitor
Family pusher side machine 205 is transferred directly to the second client-side machine 210, and is not related to server 215 in media path 235.
Additionally, RMM can from network 220 receive encoded real time media data (such as, by media path 235 directly from
Send at second client-side machine 210), the encoded real time media data received is decoded, and by it from second
The decoded real time media data that client-side machine 210 receives directly is presented in user interface 415.RMM can tie
Application program 405 on hop server 215 works.Such as, application program 405 can use input equipment (such as, camera
420 and microphone 425) and be connected to the outut device (such as, speaker 430) of the first client-side machine 205 send and
Receive data.RMM is possible with identical input and output device.Therefore, RMM can be in conjunction with the application on server 215
Program 405 works with shared input and output device.In other words, input and output device can be by media path 235
Between data and the data received and dispatched by server path of transmitting-receiving shared.
RMM can be to synchronize from media path 235 in conjunction with the another kind of situation that the application program 405 on server 215 works
Data and from the data of server path.One example can include trace geometry.Trace geometry can allow (to work as video data
Directly come the first client-side machine 205, by media path 235 directly transmit from the second client-side machine 210 and around
When crossing server path) should show that the local of video places video on display 415.Such as, application program 405 can
To send position and the shape of video area on server path to the first client-side machine 205.First client-side machine
205 then can follow the tracks of on the Agents Window of information (such as, position and shape) sent by application program 405 in
Existing video (from media path 235).Contingent any to video location and shape of the sustainable supervision of application program 405
Change, and can keep updating the first client-side machine 205 by this information.First client-side machine 205 and then can protect
Hold and update Agents Window by the information of application program 405.In this way, can synchronize on the first client-side machine 205
Video show.
Additionally, the first client-side machine 205 is real with remote computing device exchange by media path 235 during remote session
Time media data can include performing from the network address translation (NAT) of the first client-side machine 205 to remote computing device.?
In computer network, network address translation (NAT) can include procedure below: is remapped to for by an IP address space
The purpose of another IP address space is at the network address letter revised when communications routing device transmits in datagram (IP) packet header
Breath.After the first client-side machine 205 exchanges real time media data in the stage 330, method 300 then can be in the stage
Terminate at 340.
The system for providing real-time media to optimize can be included according to an embodiment of the present invention.This system can include that memorizer is deposited
Store up and be coupled to the processing unit of this memorizer storage.This processing unit can be used for setting up remote session with remote computing device.This
Outward, this processing unit can be used for exchanging non-real time media data by server path with remote computing device during remote session,
And during remote session, exchange real time media data by media path with remote computing device.
The system for providing real-time media to optimize can be included according to another embodiment of the present invention.This system can include memorizer
Store and be coupled to the processing unit of this memorizer storage.This processing unit can be used in local computing device and remote computing device
Between set up remote session.It addition, this processing unit can be used for during remote session by including the server path of server
Non-real time media data are exchanged between local computing device and remote computing device.Additionally, this processing unit can be used for remotely
Exchanged between local computing device and remote computing device by media path during session and include the real-time of Voice & Video data
Media data.Server is not in media path.
The system for providing real-time media to optimize can be included according to another embodiment of the invention.This system can include memorizer
Store and be coupled to the processing unit of this memorizer storage.This processing unit can be used for setting up remote session with remote computing device.
This processing unit can be used for setting up remote session can include that this processing unit can be used for setting up server path and setting up media road
Footpath, wherein relates to server in this server path, and is not related to server in this media path and this media path is direct
With remote computing device foundation.Additionally, this processing unit can be used for during remote session by server path and remotely meter
Calculate devices exchange non-real time media data, and exchange real-time matchmaker by media path with remote computing device during remote session
Volume data.
Fig. 5 is the block diagram of the system including calculating equipment 500.According to an embodiment of the present invention, above-mentioned memorizer storage and
Processing unit can realize in the calculating equipment 500 calculating equipment such as grade of such as Fig. 5.Hardware, software or firmware can be used
Any suitable combination realizes the storage of this memorizer and processing unit.Can run in virtual machine additionally, calculate equipment 500
Or run on physical machine.Such as, memorizer storage and processing unit can be with calculating equipment 500 or combine calculating equipment
Any one in other calculating equipment 518 of 500 realizes.According to the embodiments of the present invention, said system, equipment
It is example with processor, and other system, equipment and processor can include the storage of above-mentioned memorizer and processing unit.Additionally,
Calculating equipment 500 can include for the first client-side machine 205 or operation of the second client-side machine 210 as above
Environment.First client-side machine 205 or the second client-side machine 210 can operate and be not limited to meter in other environments
Calculation equipment 500.
With reference to Fig. 5, system according to an embodiment of the present invention can include calculating equipment, such as calculates equipment 500.One
In basic configuration, calculating equipment 500 can include at least one processing unit 502 and system storage 504.Depend on calculating
The configuration of equipment and type, system storage 504 can include, but not limited to volatile memory (such as, random access memory
Memorizer (RAM)), nonvolatile memory (such as, read only memory (ROM)), flash memory or any combination.System is deposited
Reservoir 504 can include operating system 505, one or more programming module 506, it is possible to includes routine data 507.Such as,
Operating system 505 is applicable to control the operation of calculating equipment 500.In one embodiment, programming module 506 can include
Such as, remote media manager application 410.Additionally, the embodiments of the present invention can be in conjunction with shape library, other behaviour
Make system or any other application program is put into practice, and be not limited to any application-specific or system.This basic configuration is at figure
Illustrated by the assembly in dotted line 508 in 5.
Calculating equipment 500 can have supplementary features or function.Such as, calculating equipment 500 may also include additional data storage and sets
Standby (removable and/or irremovable), the most such as disk, CD or tape.These additional storages are in Figure 5 by may move
Storage 509 and irremovable storage 510 illustrate.Calculating equipment 500 also can comprise and can allow equipment 500 such as by such as
Network in networking or the Internet distributed computing environment carrys out the communication connection 516 communicated with other calculating equipment 518.
Communication connection 516 is an example of communication media.
Term used herein computer-readable medium can include computer-readable storage medium.Computer-readable storage medium can include with
Real in any method or technology storing the information such as such as computer-readable instruction, data structure, program module or other data
Existing volatibility and medium non-volatile, removable and irremovable.System storage 504, removable storage 509 and can not
Mobile storage 510 is all the example of computer-readable storage medium (that is, memorizer storage).Computer-readable storage medium can include,
But be not limited to, RAM, ROM, electricallyerasable ROM (EEROM) (EEPROM), flash memory or other memory technologies, CD-ROM,
Digital versatile disc (DVD) or other optical storages, cartridge, tape, disk storage or other magnetic storage apparatus or can
For storing information and any other medium that can be accessed by calculating equipment 500.Any such computer-readable storage medium is permissible
It it is a part for equipment 500.Calculating equipment 500 can also have input equipment 512, as defeated in keyboard, mouse, pen, sound
Enter equipment, touch input device etc..May also include the outut devices 514 such as such as display, speaker, printer.Above-mentioned set
For being example and other equipment can be used.
Term used herein computer-readable medium may also include telecommunication media.Telecommunication media can be by such as carrier wave or other biographies
Computer-readable instruction, data structure, program module or other data in the modulated message signal of defeated mechanism embody,
And including any information transmitting medium.Term " modulated message signal " can describe to compile the information in this signal
The mode of code sets or changes the signal of one or more feature.Unrestricted as example, communication media include all if any
The wire mediums such as gauze network or directly line connection, and the nothing such as such as acoustics, radio frequency (RF), infrared ray and other wireless mediums
Line medium.
As set forth above, it is possible to store the multiple program modules including operating system 505 and data in system storage 504
File.When performing on processing unit 502, programming module 506 (such as, remote media manager application 410) can
Perform each process, including such as, each stage of one or more methods 300 as above.Aforementioned process is example, and place
Reason unit 502 can perform other processes.Electricity can be included according to other programming modules that the embodiments of the present invention can use
Sub-mail and contact application, word-processing application, spreadsheet applications, database application, magic lantern
Sheet demonstration applications, drawing or computer-assisted application program etc..
It is said that in general, according to the embodiments of the present invention, program module can include that can perform particular task maybe can realize
The routine of particular abstract data type, program, assembly, data structure and other kinds of structure.Additionally, each reality of the present invention
The mode of executing can be put into practice by other computer system configurations, including portable equipment, multicomputer system, based on microprocessor
System or programmable consumer electronics, minicomputer, mainframe computer etc..The embodiments of the present invention can also be appointed wherein
It is engaged in being realized by the distributed computing environment performed by the remote processing devices of communication network links.In a distributed computing environment,
Program module can be located in local and remote both memory storage device.
Additionally, the embodiments of the present invention can include the circuit of discrete electronic component, the encapsulation comprising gate or integrated electricity
Sub-chip, the circuit utilizing microprocessor or realization on the one single chip comprising electronic component or microprocessor.The present invention's
Each embodiment can also use and be able to carry out such as, such as, AND (with), OR (or) and the logic such as NOT (non-) fortune
The other technologies calculated are put into practice, and include but not limited to, machinery, optics, fluid and quantum techniques.It addition, each reality of the present invention
The mode of executing can realize in general purpose computer or any other circuit or system.
Such as, the embodiments of the present invention can be implemented as computer processes (method), calculate system or such as computer journey
The goods such as sequence product or computer-readable medium.Computer program can be computer system-readable and encode for performing
The computer-readable storage medium of the computer program of the instruction of computer processes.Computer program can also is that calculating system is readable
And the transmitting signal on the carrier of the computer program encoding instruction for performing computer procedures.Therefore, the present invention can be with
Hardware and/or software (including firmware, resident software, microcode etc.) embody.In other words, the embodiments of the present invention can
Can use or computer readable program code for instruction execution system or the computer that is used in combination with to use to include on it
Computer can use or the form of computer program on computer-readable recording medium.Computer can use or computer
Computer-readable recording medium can be can to comprise, store, communicate, propagate or transmission procedure makes for instruction execution system, device or equipment
With or any medium of being used in combination with.
Computer can use or computer-readable medium it may be that such as, but not limited to, electricity, magnetic, optical, electromagnetic, infrared,
Or semiconductor system, device, equipment or propagation medium.More specifically computer-readable medium examples (non-exhaustive list), calculates
Machine computer-readable recording medium can include following: has the electrical connection of one or more wire, portable computer diskette, random access memory
Device (RAM), read only memory (ROM), Erasable Programmable Read Only Memory EPROM (EPROM or flash memory), optical fiber and
Portable compressed dish read only memory (CD-ROM).Noting, computer can use or computer-readable medium can even is that it
On be printed with paper or another suitable medium of program, because program can be via such as sweeping the optics of paper or other media
Retouch and capture electronically, be compiled the most if necessary, explain, or be otherwise processed in a suitable manner, and be subsequently stored in meter
In calculation machine memorizer.
Above with reference to such as according to block diagram and/or the operation of method, system and the computer program of the embodiments of the present invention
Diagram describes the embodiments of the present invention.Each function/the action indicated in frame can be as being different from shown in any flow chart
Order occurs.Such as, depending on involved function/action, two frames illustrated continuously can essentially substantially simultaneously perform,
Or these frames can perform sometimes in the reverse order.
Although it have been described that some embodiment of the present invention, it is also possible to there is other embodiments.Although additionally, this
Bright each embodiment is described as being associated with the data being stored in memorizer and other storage mediums, but data can also quilt
It is stored in or reads from other kinds of computer-readable medium, such as auxiliary storage device, as hard disk, floppy disk or CD-ROM；
Carrier wave from the Internet；Or RAM or ROM of other forms.Additionally, each stage of disclosed each method can by appoint
Where formula is revised, including by resequencing each stage and/or inserting or the deletion stage, without departing from the present invention.
The all authority including copyright in code included herein all belongs to applicant and is the wealth of the applicant
Produce.Applicant keeps and retains all authority in code included herein, and authorizes the reproduction only about the patent authorized
And reproduce the license of this material for no other purpose.
Although this specification includes each example, but the scope of the present invention is indicated by appended claims.Although additionally, with right
Architectural feature and/or the special language of method action describe this specification, but claims are not limited to spy as described above
Levy or action.On the contrary, above-mentioned specific features and action are disclosed in the example as the embodiments of the present invention is come.
Claims (13)
1., for the method providing real-time media to optimize, described method includes:
Remote session is set up with remote computing device；
Between local computing device and described remote computing device, media path is set up during described remote session, wherein said
Media path is set up in the case of being not related to server；
During described remote session, exchange non-real time media number by server path with described remote computing device
According to；
During described remote session, by described media path (235) with the exchange of described remote computing device in real time
Media data, wherein exchange described real time media data include directly described local computing device and described remote computing device it
Between exchange described real time media data, and described media path (235) is not related to described server (105)；And
Synchronize the described real time media data from described media path (235) and the institute from described server path
State non-real time media data.
2. the method for claim 1, it is characterised in that set up described remote session and include setting up at described
The client computer run on ground calculating equipment and the journey that jumps between the upper application program (405) run of server (105),
That is set up jumps journey in described server path.
3. the method for claim 1, it is characterised in that by described server path and described remote computation
Non real-time letter is transmitted to server (105) during non-real time media data are included in described server path described in devices exchange
Breath.
4. the method for claim 1, it is characterised in that by described server path and described remote computation
Non real-time letter is transmitted to server (105) during non-real time media data are included in described server path described in devices exchange
Breath, described non-real-time information includes the information of the position corresponding to described local computing device.
5. the method for claim 1, it is characterised in that by described media path (235) with described far
Journey calculates real time media data described in devices exchange and includes described real time media data is caught, encodes and transmitted.
6. the method for claim 1, it is characterised in that by described media path (235) with described far
Journey calculates real time media data described in devices exchange and includes by described media path (235) from described remote computing device
Receive described real time media data, described real time media data is decoded, and present decoded real-time media
Data.
7. the method for claim 1, it is characterised in that by described media path (235) with described far
Journey calculates real time media data described in devices exchange and includes for an address space is remapped to another address empty
Between purpose amendment network address information.
8., for the method providing real-time media to optimize, described method includes:
Remote session is set up between local computing device and remote computing device；
Between described local computing device and described remote computing device, media path is set up, wherein during described remote session
Described media path is set up in the case of being not related to server；
By server path in described local computing device and described remote computing device during described remote session
Between exchange non-real time media data, wherein exchange described non-real time media data and include by described server path
Server (105) transmit non-real-time information；
By media path (235) in described local computing device and described remote computation during described remote session
Exchanged between equipment includes the real time media data of Voice & Video data, wherein exchanges described real time media data and includes
Between described local computing device and described remote computing device, directly exchange described real time media data, and described matchmaker
Body path (235) is not related to described server (105)；
Synchronize the described real time media data from described media path (235) and the institute from described server path
State non-real time media data.
9. method as claimed in claim 8, it is characterised in that set up described remote session and include setting up at described
Between the client computer and the application program (405) run on described server (105) that run on ground calculating equipment
Jump journey, and that is set up jumps journey in described server path.
10. method as claimed in claim 8, it is characterised in that set up described remote session and include setting up in fortune
Remote media manager (410) and described remote computation that row runs in the client computer on described local computing device set
Described media path (235) between Bei.
11. methods as claimed in claim 8, it is characterised in that by described server path with described remotely
Calculate non-real time media data described in devices exchange and be included in described server path to server (105) transmission described
Non-real-time information, described non-real-time information includes the information of the position corresponding to described local computing device.
12. methods as claimed in claim 8, it is characterised in that by described media path (235) with described
Remote computing device is exchanged described real time media data and includes being set from described remote computation by described media path (235)
The described real time media data of standby reception, is decoded described real time media data, and presents decoded real-time matchmaker
Volume data.
13. 1 kinds are used for the system providing real-time media to optimize, and described system includes:
Memorizer stores；And
Being coupled to the processing unit of described memorizer storage, wherein said processing unit is used for:
Remote session is set up with remote computing device, including:
Set up server path, wherein said server path relates to server (105)；And
Set up media path (235), wherein said media path is not related to described server (105)
And described media path (235) is direct and described remote computing device is set up；
During described remote session, non real-time with the exchange of described remote computing device by described server path
Media data；
During described remote session, exchanged with described remote computing device by described media path (235)
Real time media data, wherein exchanges described real time media data and includes directly in local computing device and described remote computation
Real time media data described in exchanged between equipment, and described media path (235) is not related to described server (105)；
And
Synchronize from the described real time media data of described media path (235) with from described server path
Described non-real time media data.
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US12/967,100 | 2010-12-14 | ||
| US12/967,100 US9276972B2 (en) | 2010-12-14 | 2010-12-14 | Real-time media optimization over remoted sessions |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102571764A CN102571764A (en) | 2012-07-11 |
| CN102571764B true CN102571764B (en) | 2016-12-14 |
Family
ID=
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1694527A (en) * | 2004-04-30 | 2005-11-09 | 微软公司 | Systems and methods for novel real-time audio-visual communication and data collaboration |
| CN101420375A (en) * | 2007-10-25 | 2009-04-29 | 阿尔卡特朗讯公司 | Distribution of shared content streams in communications networks |
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1694527A (en) * | 2004-04-30 | 2005-11-09 | 微软公司 | Systems and methods for novel real-time audio-visual communication and data collaboration |
| CN101420375A (en) * | 2007-10-25 | 2009-04-29 | 阿尔卡特朗讯公司 | Distribution of shared content streams in communications networks |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Fu et al. | A survey of blockchain and intelligent networking for the metaverse | |
| Sundmaeker et al. | Vision and challenges for realising the Internet of Things | |
| CN102999559B (en) | Document sharing is carried out by browser | |
| CN103366135B (en) | The security system driven by tenant in storage cloud and method | |
| TW201738749A (en) | Distributed computation system incorporating agent network, paths and associated probes | |
| US20090132309A1 (en) | Generation of a three-dimensional virtual reality environment from a business process model | |
| CN108197329A (en) | It is synchronized by the Real-time document demonstration data of generic service | |
| CN104081384B (en) | For providing the system and method for calculating web services for online document | |
| TW201003412A (en) | Using multiple servers to divide a virtual world | |
| Kuru | MetaOmniCity: Towards immersive urban metaverse cyberspaces using smart city digital twins | |
| CN107533693A (en) | Abundant annex regenerates | |
| CN106161424A (en) | For determining method and the computer system of the reliability rating between communication equipment | |
| Jagatheesaperumal et al. | Semantic-aware digital twin for metaverse: A comprehensive review | |
| CN102571764B (en) | Real-time media optimization on remote session | |
| US20100250316A1 (en) | Developing a service oriented architecture shared services portfolio | |
| RU2595548C2 (en) | Optimising multimedia in real time in remote sessions | |
| Bogdanovych et al. | A methodology for developing multiagent systems as 3d electronic institutions | |
| CN112383737B (en) | Video processing verification method and device for multi-user online content on same screen and electronic equipment | |
| Ismail et al. | Metaverse: A Vision, Architectural Elements, and Future Directions for Scalable and Realtime Virtual Worlds | |
| CN111327510B (en) | Communication system for nuclear power calculation analysis service | |
| Salimian | Exploring group awareness in a mixed reality collaborative environment | |
| Streitz | Empowering Citizen-Environment Interaction vs. Importunate Computer-Dominated Interaction: Let’s Reset the Priorities! | |
| CN110314374A (en) | A kind of game processing method, device, electronic equipment and medium | |
| Tomer et al. | Blockchain IoT: Challenges and Solutions for Building Management System Check for updates | |
| KR20090065867A (en) | Integrated development environment system using avatar |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20150728 Address after: Washington State Applicant after: Micro soft technique license Co., Ltd Address before: Washington State Applicant before: Microsoft Corp. |
|
| GR01 | Patent grant |