CN103974027B - Real-time communication method and system of the multiterminal to multiterminal - Google Patents

Real-time communication method and system of the multiterminal to multiterminal Download PDF

Info

Publication number
CN103974027B
CN103974027B CN201410225302.9A CN201410225302A CN103974027B CN 103974027 B CN103974027 B CN 103974027B CN 201410225302 A CN201410225302 A CN 201410225302A CN 103974027 B CN103974027 B CN 103974027B
Authority
CN
China
Prior art keywords
real time
time information
multiterminal
network
time communication
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN201410225302.9A
Other languages
Chinese (zh)
Other versions
CN103974027A (en
Inventor
李彦超
王宇
张立军
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shanghai Advanced Research Institute of CAS
Original Assignee
Shanghai Advanced Research Institute of CAS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shanghai Advanced Research Institute of CAS filed Critical Shanghai Advanced Research Institute of CAS
Priority to CN201410225302.9A priority Critical patent/CN103974027B/en
Publication of CN103974027A publication Critical patent/CN103974027A/en
Application granted granted Critical
Publication of CN103974027B publication Critical patent/CN103974027B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Abstract

The present invention provides real-time communication method and system of a kind of multiterminal to multiterminal.The method according to the invention, after control device is encoded based on network code to the real time information from multiple real time communication devices, then the real time information after coding sent;Each real time communication device each carries out network decoding to the real time information by network code each received, and respective real time information is sent to obtain other each real time communication devices;Preferably, each real time communication device is multicast group member;Thus, network total bitrate and network traffics can effectively be reduced;Present invention can apply to the occasions such as video conference, video monitoring, tele-medicine or remote teaching.

Description

Real-time communication method and system of the multiterminal to multiterminal
Technical field
The present invention relates to real-time Communication for Power field, more particularly to the real-time communication method and system of a kind of multiterminal to multiterminal.
Background technology
With the continuous development of Computer Multimedia Technology and telecommunication technique, the network teleconference is Stream Media Application One of major domain, including various video systems such as video conference, tele-medicine, long-distance education, video monitoring.Traditional H.323 RTSP@UDP and in recent years are applied widely in such systems.So-called IP network video conferencing system, Refer to a kind of means of communication being had a meeting using multimedia terminal by network in two places or multiple places, it utilizes multimedia Terminal by the meeting in local meeting-place it is humanoid as and his opinion for being delivered or report content be sent to other place meeting-place, The participant for being in strange land is participated in discussion with regard to same subject under discussion, can not only hear the sound of spokesman between each other, And it can see the image of spokesman.This while transmission image, voice can substitute on-the-spot meeting completely in effect.
Before the nineties, though video conference business is suggested as a Novel multimedia means of communication, It is not widely used.In the nineties, the video gateway series standard such as based on image encoding standards h.261 and h.320 Formulation, provide reliable foundation for the practical of video conference.After nineteen ninety-five, with low bit rate video coding standard H.263 formulation, ITU-T further through suitable low-speed communication network h.324 and the series standard such as h323.Hereafter, due to The commercialized immense successes of Internet, the application system with multimedia communication function based on IP agreement become master Flow development trend.Therefore the master of industry is turned into video conference industrial circle, the IP network video conferencing system based on h.323 standard Stream.
Typical video conferencing system is made up of video conference terminal, multipoint controller, network and control management software. The major function of video conference terminal is to complete audio, the collection of vision signal, editing and processing and display and output, to video Audio digital signals are compressed coding and decoding.In addition, terminal will also form various control information of communication etc..Multiparty control Unit MCU is the important control unit in IP network video conferencing system, and its major function is to video, voice and data Signal is mixed and switched, but must not deteriorate the quality of audio-video signal.Such as it can make a speech certain meeting-place for being sent to MCU The picture signal of person is switched to all meeting-place.For voice signal, if there are several speeches simultaneously, they can be carried out at mixing Reason.MCU chief component is:At NIU, Call Control Unit, multiplexing and demultiplexing unit, audio Manage device, video processor, data processor, control processor, key handling distributor and call control processor.
Although video conference etc. can bring great advantage to the user, its caused transinformation can be with participant The increase of member and sharply increase, for example, as shown in figure 1, the video conferencing system shares N number of video conference terminal 1 ... N, and One MCU, each video conference terminal send video flowing S1, S2 ... SN to MCU all the way, it is assumed that per the code check of video flowing all the way It is 1Mbps.Assuming that each video conference terminal is while data are sent, it is desirable to receives other all video conference terminals Data, then MCU the N number of video flowing received is sent to N number of video conference terminal respectively, it is so, whole in any one video conference At end, the total bitrate for receiving video flowing is (N-1) * 1Mbps, and overall network throughput is N* (N-1) * 1Mbps.Undoubtedly, with regarding The increase increased with video stream bit rate of frequency conference terminal quantity, this network throughput are huge.
Network code is that the most important theories in information theory field break through, and is to work as the important branch of network information opinion The emphasis and focus of preceding research, great and far-reaching influence will be produced to the framework of future network and development.What network code referred to It is the node participation coding and decoding in network, this is the qualitative difference of network code and traditional IP.When permission network middle node After point participates in coding and decoding, network throughput can be lifted effectively.The epoch-making significance of network code is:Break through classical letter The conclusion that Commodity Flow can not be compressed again in breath opinion, it is indicated that network information flow can be processed and compress, so as to further Lift network throughput.Therefore network code theory is referred to as network information flow theory.
Traditional IP by the way of the Store and forword based on router, and network code then using storage-coding- The mode of forwarding, by taking butterfly network as an example, the multicast capacity of network can be reached after nodes allow network code, But differed using route and surely reached.Wherein multicast is a kind of routing mode, refers to an information source node and sends messages to multiple letters Destination node.Capacity refers to the maximum of handling capacity.
Therefore, how the network information handling capacity of video conferencing system reduced based on network code, it has also become this area Technical staff needs the technical task solved.
The content of the invention
In view of the above the shortcomings that prior art, it is an object of the invention to provide a kind of the logical in real time of multiterminal to multiterminal Method and system are believed, to reduce network traffics.
In order to achieve the above objects and other related objects, the present invention provides a kind of real time information sender of multiterminal to multiterminal Method, it is comprised at least:Sent after being encoded based on network code to multiple real time information, wherein, it is the multiple real-time Information is that the real time information of other real time communication devices is each sent to by multiple real time communication devices.
Preferably, the multiple real time communication device is multicast member, by the real time information after coding with multicast side Formula is sent to each real time communication device.
Preferably, the real time information sending method of the multiterminal to multiterminal also includes:By the real time information from next stage Sent again after carrying out network code, wherein, the real time information of next stage includes the real time information by network code.
Preferably, the network code includes random network code.
The present invention also provides a kind of real time information method of reseptance of multiterminal to multiterminal, and it is comprised at least:Upper level will be come from By network code real time information carry out network decoding after be handed down to next stage.
Preferably, the coding information after coding information is using random network code, the then real time information connect Receiving method also includes:Before the real time information by network code of upper level is received, preservation is sent to the real-time of upper level Information, and network decoding is carried out come the real time information by network code to upper level based on the real time information preserved.
Preferably, the real time information method of reseptance of the multiterminal to multiterminal also includes:After network decoding, by what is preserved The real time information for being sent to upper level is deleted.
The present invention also provides a kind of control multiterminal to the control system of the real-time information transmission of multiterminal, and it is comprised at least:Net Network coding module, for being encoded based on network code to multiple real time information;Sending module, for will be real-time after coding Information is sent;Wherein, the multiple real time information is each to be sent to other real-time Communication for Power by multiple real time communication devices The real time information of equipment.
Preferably, the control system is built in multipoint control unit.
Preferably, the control system is built in a real time communication device, and the real time communication device is by multiple real-time The member for the communication group that communication equipment is formed;It is further preferable that the control system includes network decoding module, in the future Next stage, phase are handed down to by the sending module again from upper level and after the real time information of network code carries out network decoding Ying Di, the network code module be used for by from next stage real time information carry out network code after again by the sending module It is uploaded to upper level.
The present invention also provides a kind of real time information reception system of multiterminal to multiterminal, and it is comprised at least:Network decoding module, For to reception and real time information by network code carry out network decoding, sent with obtaining other each real time communication devices Real time information to itself corresponding device.
Preferably, the coding information after coding information is using random network code, the real time information receive System also includes:Preserving module, for before the real time information by network code is received, it is logical in real time that preservation is sent to other Believe the real time information of equipment;Correspondingly, the network decoding module based on the real time information preserved come to reception and pass through The real time information of network code carries out network decoding, to obtain the reality that other each real time communication devices are sent to itself corresponding device When information.
Preferably, the real time information reception system also includes:Removing module, for after network decoding, will be preserved Be sent to other real time communication devices real time information delete.
The present invention also provides a kind of real-time communication system of multiterminal to multiterminal, and it is comprised at least:Control device, before being built-in with The control system stated, for being sent after being encoded based on network code to multiple real time information;Multiple real-time Communication for Power are set It is standby, foregoing real time information reception system is built-in with respectively, for real time information each receiving and by network code Network decoding is carried out, respective real time information is sent to obtain other each real time communication devices.
Preferably, the multiple real time communication device is multicast member, then correspondingly, the control device will encode Real time information afterwards is sent to the multiple real time communication device with multicast mode.
Preferably, the real-time communication system is the reality for video conference, video monitoring, tele-medicine or remote teaching When communication system.
As described above, the multiterminal of the present invention have the advantages that to the real-time communication method and system of multiterminal:Can have Effect reduces network total bitrate, reduces network traffics.
Brief description of the drawings
Fig. 1 is shown as the multiterminal of the present invention to a kind of preferred flow charts of the real-time communication method of multiterminal.
Fig. 2 is shown as the real-time Communication for Power flow chart of the real time communication device of the present invention.
Fig. 3 is shown as the multiterminal of the present invention to another preferred flow charts of the real-time communication method of multiterminal.
Fig. 4 is shown as the multiterminal of the present invention to a kind of preferred schematic diagram of the real-time communication system of multiterminal.
Fig. 5 is shown as the multiterminal of the present invention to another preferred schematic diagram of the real-time communication system of multiterminal.
Component label instructions
Embodiment
Embodiments of the present invention are illustrated by particular specific embodiment below, those skilled in the art can be by this explanation Content disclosed by book understands other advantages and effect of the present invention easily.
Fig. 1 is referred to Fig. 4.It should be clear that structure, ratio, size depicted in this specification institute accompanying drawings etc., only to Coordinate the content disclosed in specification, so that those skilled in the art understands and reads, being not limited to the present invention can be real The qualifications applied, therefore do not have technical essential meaning, the tune of the modification of any structure, the change of proportionate relationship or size It is whole, in the case where not influenceing the effect of present invention can be generated and the purpose that can reach, all should still fall in disclosed skill Art content is obtained in the range of covering.Meanwhile in this specification it is cited as " on ", " under ", "left", "right", " centre " and The term of " one " etc., understanding for narration is merely convenient to, and is not used to limit the enforceable scope of the present invention, its relativeness It is altered or modified, in the case where changing technology contents without essence, when being also considered as the enforceable category of the present invention.
As shown in figure 1, the present invention provides a kind of real-time communication method of multiterminal to multiterminal.Wherein, according to the side of the present invention Method is mainly completed by real-time communication system, and the real-time communication system comprises at least:Control multiterminal are built-in with to the reality of multiterminal When information transfer control system control device and multiple multiterminal that are built-in with respectively to the real time information reception system of multiterminal Real time communication device.
Wherein, the real-time communication system can be applied to video conference, video monitoring, tele-medicine or remote teaching etc.; The control device is preferably multipoint control unit (MCU);Real time communication device includes but is not limited to:Mobile phone, personal computer, Tablet personal computer, PDA etc..
Preferably, each real time communication device is multicast group member.
In step s 11, each real time communication device will each be sent to the real time information of other real time communication devices respectively Send to the control device.
Wherein, the real time information includes the information of any required real-time tranception, it is preferable that includes but is not limited to:Sound regards Frequency information etc..
Specifically, the audio/video information that each real time communication device is respectively gathered the collecting devices such as each free video camera passes through Sent after crossing the processing such as audio/video coding and system layer multiplexing to MCU, as shown in Figure 2.
For example, real time communication device 1 will be sent to real time communication device 2 with 1Mbps code checks ... N video flowing s1Send Real time communication device 1,3 ... N video flowing s will be sent to 1Mbps code checks to MCU, real time communication device 22To transmission MCU ... real time communication device N will be sent to real time communication device 1,2 ... N-1 video flowing s with 1Mbps code checksNSend To MCU.
It should be noted that it should be appreciated by those skilled in the art that described above is only merely to list, rather than to the present invention Limitation, in fact, it to other real time communication devices is the selection based on actual user that each real time communication device, which sends video flowing, To determine.
Preferably, the real time information for being each sent to other real time communication devices is given this by each real time communication device respectively Ground preserves, so that subsequent decoding is used, as shown in Figure 2.
For example, real time communication device 1 is by the video flowing s of transmission1Give it is local preserve, real time communication device 2 is by transmission Video flowing s2Give it is local preserve ... real time communication device N is by the video flowing s of transmissionNGive local preservation.
Then, in step s 12, the control device based on network code to from the real-time of multiple real time communication devices Information is encoded.
Wherein, network code can use any algorithm that can carry out network code, it is preferable that include but is not limited to:At random Network code, nonlinear network coding, linear network encoding etc..
For example, video flowing ss of the MCU to reception1、s2…sNRandom network code is carried out, i.e.,:
Wherein, (N-1) * N-dimensional coefficient matrices As are random network code matrixes.The control device is to video flowing s1、s2… sNAfter carrying out aforesaid operations, (N-1) * 1 conversion code stream X is transformed to.
Then, in step s 13, the real time information after coding is sent to each real time communication device by the control device.
Preferably, the real time information after coding is sent to each real-time Communication for Power by the control device using multicast transmission mode Equipment.
For example, MCU sends above-mentioned conversion code stream X to multicast address, so as to real time communication device 1, each freedom of 2 ... N The multicast address obtains conversion code stream X.
Then, in step S14, each real time communication device is each carried out the real time information by network code of reception Network decoding, the real time information of itself is sent to obtain other each real time communication devices.
Wherein, each real time communication device carry out the mode of network decoding based on the network code mode of the control device come It is determined that if for example, the control device uses random network code, each real time communication device uses and random network code The network decoding mode matched somebody with somebody decodes.
Specifically, each real time communication device obtains the real time information after network code by multicast address, and this is passed through Cross the real time information after network code carry out network decoding after, then carry out system layer multiplexing and audio/video decoding etc. processing after, obtain Other each real time communication devices are sent to the real time information of itself, for example, stream 1, stream 2 ... stream N, it is then those information are defeated Go out to respective display and shown, as shown in Figure 2.
For example, real time communication device 1,2 ... N are each decoded the conversion code stream X obtained by multicast address, but by Above formula (1) understands that it is a underdetermined equation, therefore real time communication device 1,2 ... N can not be directly from the conversion code stream X of reception Recover s1、s2…sN, it is contemplated that i-th of real time communication device can be to the data s of oneself transmissioniLocal preservation is carried out, because And siIt is known to i-th of real time communication device, so as to which formula (1) is transformed to:
X-ai=A ' S ' (2)
Wherein ai=[a1,i a2,i … aN-1,i]T, T representing matrix transposition.A ' presentation code matrix As remove column vector aiAfterwards (N-1) * (N-1) matrix formed, S ' expressions S remove siThe vector formed after element.It can be seen that the as long as suitable random volume of selection Code matrix generating algorithm, formula (2) must be positive definite, so as to which S ' can be solved.That is, i-th real time communication device can be with Obtain other all N-1 video flowings completely from multicast traffic stream X.
Preferably, each real time communication device is after network decoding, each by each preserved to be sent to other logical in real time Believe that the real time information of equipment is deleted.
For example, real time communication device 1 is after network decoding X, by video flowing s1Deleted, real time communication device 2 is in net After network decoding X, by video flowing s2Real time communication device N is deleted ... ... after network decoding X, by video flowing sNDeleted Remove.
As shown in figure 3, its another preferred embodiment flow chart for multiterminal of the invention to the real-time communication method of multiterminal.
In the step s 21, each real time communication device gives the real time information for being each sent to other real time communication devices Send.
For example, other real time communication devices will be each sent to by belonging to the real time communication device 31,32 and 33 of communication group Real time information be sent to administer the MCU1 of itself, it will be each sent to by belonging to the real time communication device 34 and 35 of communication group The real time information of his real time communication device, which is sent to, administers the MCU2 of itself, is not belonging to the real time communication device 36 of communication group then The real time information for being sent to other real time communication devices is directly uploaded to MCU3, is not belonging to the real-time Communication for Power of communication group The real time information for being sent to other real time communication devices is then directly uploaded to MCU5 by equipment 37.
Preferably, each real time communication device is preserved the real time information for being each sent to other real time communication devices, In case subsequent decoding is used.
Then, in step S22, each control device is by the real time communication device from the communication group each administered Real time information give network code obtain it is respective it is encoded after real time information.
For example, the real time information from real time communication device 31,32 and 33 is carried out network code by MCU1, MCU2 will come from The real time information of real time communication device 34 and 35 carries out network code.
Then, in step S23, control devices at different levels are uploaded respective by the real time information of network code.
Specifically, each control device of next stage is uploaded to upper level by respective by the real time information of network code Control device, by upper level control device by real time information of the reception by network code with from next stage it is each in real time After the real time information of communication equipment carries out network code in the lump, then uploaded ... so constantly upload, until most upper level Control device.
For example, the real time information after respective network code is each uploaded to MCU3 by MCU1 and MCU2, MCU3 will come from MCU1 and MCU2 by network code real time information and real time communication device 36 real time information in the lump after network code on It is transmitted to MCU5.
Preferably, each control device at different levels will be uploaded to being protected by the real time information of network code for upper level Deposit, real time communication device at different levels is each preserved the real time information for being each uploaded to upper level, in case subsequent decoding it With.
For example, the real time information after respective network code is each given local preservation by MCU1, MCU2 and MCU3.
Then, in step s 24, the control device of most upper level by the real time information of network code and comes reception Network code is carried out in the lump from the real time information of each real time communication device of next stage.
For example, MCU5 by from MCU3 and MCU4 by the real time information of network code and the reality of real time communication device 37 When information carry out network code in the lump.
Then, in step s 25, the control device of most upper level is issued the real time information after network code.
For example, the real time information after network code is handed down to MCU3 and MCU4 and real time communication device 37 by MCU5.
Then, in step S26, the real time information by network code of reception is carried out network by each control device of subordinate Issued again after decoding.
Specifically, each control device of subordinate issues after the real time information by network code of reception is carried out into network decoding To each real time communication device in respective next stage control device and the communication group itself administered, so constantly issue, Until the control device of afterbody, the control device of the afterbody carries out the real time information by network code of reception Each real time communication device being handed down to after network decoding in the communication group itself administered.
For example, MCU3 and MCU4 gives again after the real time information by network code from MCU5 is carried out into network decoding Issue, MCU1 is issued to real-time Communication for Power again after the real time information by network code from MCU3 is carried out into network decoding Equipment 31,32 and 33, MCU2 are issued again after the real time information by network code from MCU3 is carried out into network decoding To real time communication device 34 and 35.Then, in step s 27, reception is each passed through network code by each real time communication device Real time information carry out network decoding, to obtain the real time information that other real time communication devices are sent to itself.
For example, real time communication device 31,32 and 33 is each carried out the real time information by network code from MCU1 Other real time communication devices are obtained after network decoding and are sent to the real time information of itself, real time communication device 34 and 35 is respective in the future Other real time communication devices, which are obtained, after carrying out network decoding from the MCU2 real time information by network code is sent to itself Real time information, real time communication device 36 obtain it after the real time information by network code from MCU3 is carried out into network decoding His real time communication device is sent to the real time information of itself, and real time communication device 37 is by the reality by network code from MCU5 When information carry out network decoding after obtain other real time communication devices and be sent to the real time information of itself.
It should be noted that network code mode is in the implementation shown in earlier figures 1 used by control device at different levels It is described in detail in the step S12 of example, network decoding mode is also in the reality shown in earlier figures 1 used by control device at different levels Apply and be described in detail in the step S14 of example, and be incorporated herein by reference, no longer repeat.
As shown in figure 4, the present invention provides a kind of real-time communication system of multiterminal to multiterminal.The real-time communication system 1 to Include less:Control device 11 and multiple real time communication devices 12;Wherein, the control device 11 is built-in with control system, institute Control system is stated to comprise at least:Network code module 111 and sending module 112;Each real time communication device 12 is built-in with real time Information receiving system, the real time information reception system comprise at least:Network decoding module 121.
First, each real time communication device 12 respectively by the real time information for being each sent to other real time communication devices send to The control device 11.
Wherein, the real time information includes the information of any required real-time tranception, it is preferable that includes but is not limited to:Sound regards Frequency information etc..
For example, real time communication device U1 will be sent to real time communication device U2 ... UN video flowing s1Send to the control Control equipment 11, real time communication device U2 will be sent to real time communication device U1, U3 ... UN video flowing s2To the transmission control Control equipment 11 ... real time communication device UN will be sent to real time communication device U1, U2 ... U (N-1) video flowing sNSend To the control device 11.
It should be noted that it should be appreciated by those skilled in the art that described above is only merely to list, rather than to the present invention Limitation, in fact, it to other real time communication devices is the selection based on actual user that each real time communication device, which sends video flowing, To determine.
Preferably, each real time communication device 12 also includes:Preserving module.The preserving module is used to receive the volume Before code information, the real time information that itself corresponding device is sent to other real time communication devices is preserved, so that subsequent decoding is used.
For example, real time communication device U1 preserving module is by the video flowing s of transmission1Preserved, real time communication device U2 Preserving module by the video flowing s of transmission2Preserved ... real time communication device UN preserving module is by the video flowing of transmission sNPreserved.
Then, the network code module 111 based on network code to the real-time letter from multiple real time communication devices 12 Breath is encoded.
Wherein, network code can use any algorithm that can carry out network code, it is preferable that include but is not limited to:At random Network code, nonlinear network coding, linear network encoding etc..
For example, video flowing s of the network code module 111 to reception1、s2…sNRandom network code is carried out, i.e.,:
Wherein, (N-1) * N-dimensional coefficient matrices As are random network code matrixes.The network code module 111 is to video flowing s1、s2…sNAfter carrying out aforesaid operations, (N-1) * 1 conversion code stream X is transformed to.
Then, the real time information after coding is sent to each real time communication device 12 by the sending module 112.
Preferably, the real time information after coding is sent to each real-time by the sending module 112 using multicast transmission mode Communication equipment.
For example, the sending module 112 by above-mentioned conversion code stream X with multicast mode be sent to real time communication device U1, U2……UN。
Then, the respective network decoding module 121 of each real time communication device 12 passes through network code by what is each received Real time information carry out network decoding, be sent to the real time information of itself to obtain other each real time communication devices 12.
Wherein, each real time communication device carries out network volume of the mode of network decoding based on the network code module 111 Code mode determines that, if for example, the network code module 111 uses random network code, each network decoding module 121 is adopted Decoded with the network decoding mode matched with random network code.
For example, each network decoding module 121 is each decoded the conversion code stream X of reception, but from above formula (3), It is a underdetermined equation, therefore each network decoding module 121 each directly can not recover s from the conversion code stream X of reception1、s2… sN, it is contemplated that i-th of real time communication device 12 can be to the data s of oneself transmissioniCarry out local preservation, thus siTo i-th The network decoding module 121 of individual real time communication device 12 is known, so as to which formula (3) is transformed to:
X-ai=A ' S ' (4)
Wherein ai=[a1,i a2,i … aN-1,i]T, T representing matrix transposition.A ' presentation code matrix As remove column vector aiAfterwards (N-1) * (N-1) matrix formed, S ' expressions S remove siThe vector formed after element.It can be seen that the as long as suitable random volume of selection Code matrix generating algorithm, formula (4) must be positive definite, so as to which S ' can be solved.That is, i-th real time communication device 12 Network decoding module 121 can obtain other all N-1 video flowings completely from multicast traffic stream X.
Preferably, each real time communication device 12 also includes:Removing module.Each removing module is after network decoding, each The real time information for being sent to other real time communication devices that respective corresponding device is preserved is deleted.
For example, real time communication device U1 is after network decoding X, its removing module is by video flowing s1Deleted, it is logical in real time Equipment U2 is believed after network decoding X, and its removing module is by video flowing s2Real time communication device UN is deleted ... ... in network solution After code X, its removing module is by video flowing sNDeleted.
As shown in figure 5, its another preferred schematic diagram for multiterminal of the invention to the real-time communication system of multiterminal.This is real-time Communication system 1 ' comprises at least:Multistage Control equipment 11 ' and multiple real time communication devices 12 '.Wherein, control device 11 ' Structure and the structure of the control device 11 shown in Fig. 4 are same or similar, the reality shown in the structure and Fig. 4 of real time communication device 12 ' When communication equipment structure it is same or similar, and be incorporated herein, no longer repeat herein by reference;In addition, if control is set Standby 11 ' use real time communication device, then the real time communication device 12 ' as control device both includes network decoding module, simultaneously Network code module and sending module are included again.
First, each real time communication device 12 ' each gives the real time information for being each sent to other real time communication devices Send.
For example, respective real time information is sent to and administers the control of itself by each real time communication device for belonging to communication group Respective real time information is then transmitted directly to the control of upper level and set by equipment, each real time communication device for being not belonging to communication group It is standby, wherein, communication group generally comprises multiple real time communication devices for being compared to each other and closing on geographical position, administration communication The control device of group is preferably using the real time communication device in communication group.
Preferably, each real time communication device 12 ' each gives the real time information for being each sent to other real time communication devices To preserve, in case subsequent network decoding is used.
Then, control device 11 ' is by the real time information of each real time communication device 12 ' from respective administered communication group Give the real time information after network code is encoded.
Then, control devices 11 ' at different levels are uploaded the real time information after each own coding, are not belonging to each of communication group Level real time communication device 12 ' is uploaded the real time information for being each sent to other real time communication devices.
For example, the real time information after each own coding is uploaded to upper level control device by each control device 11 ' of next stage 11 ', by the control device 11 ' of upper level by the real time information after the coding of reception and each real time communication device from next stage After 12 ' real time information carries out network code in the lump, then uploaded ... so constantly upload, until the control of most upper level Control equipment 11 '.
Preferably, control devices at different levels each will each be uploaded to the encoded real time information of upper level control device Being preserved, real time communication devices at different levels are each preserved the real time information for being each sent to other real time communication devices, In case subsequent network decoding is used.
Then, the control device 11 ' of most upper level by reception by the real time information of network code and from next stage The real time information of each real time communication device 12 ' carry out network code in the lump.
Then, the control device 11 ' of most upper level is issued the real time information after network code.
For example, the control device of most upper level by the real time information after network code be handed down to next stage control device and Each real time communication device of next stage.
Then, control devices 11 ' at different levels carry out real time information of the reception after network code after network decoding again Issued.
For example, upper level control device issues after the real time information after network code of reception is carried out into network decoding To next stage control device and each real time communication device of next stage, so constantly issue, until the control device of afterbody, The afterbody control device is handed down to itself institute after the real time information after network code of reception is carried out into network decoding Each real time communication device in the communication group of administration.
Then, the coding information of reception is each carried out network decoding by each real time communication device 12 ', real-time to obtain other Communication equipment is sent to the real time information of itself.
It should be noted that decoded used by each control device used by network code mode and control device at different levels Mode is described in detail in the embodiment shown in earlier figures 4, and is incorporated herein by reference, is no longer repeated.
In summary, multiterminal of the invention are located at high in the clouds to the real-time communication method of multiterminal and the control system of system, adopt With high-performance, the cloud computing server framework of high-throughput, real-time network code is carried out, it is total real-time so as to effectively reduce The code check of information, and then each real time communication device is able to the real time information that relatively low time delay obtains transmission over networks;It is for example, right In the real-time communication system comprising N number of real time communication device, 1 control device, network total flow can be at most reduced to originally 'sBut may be distant in view of the network site of each real time communication device, and can be brought after adding multicast Network overhead, the actual amount that can be reduced will be less thanMoreover, in Traditional IP V4 networks, network multicast is only used for office Domain net, but in IPV6 networks, multicast can be used for Internet.So the present invention effectively overcome it is of the prior art Various shortcoming and have high industrial utilization.
The above-described embodiments merely illustrate the principles and effects of the present invention, not for the limitation present invention.It is any ripe Know the personage of this technology all can carry out modifications and changes under the spirit and scope without prejudice to the present invention to above-described embodiment.Cause This, those of ordinary skill in the art is complete without departing from disclosed spirit and institute under technological thought such as Into all equivalent modifications or change, should by the present invention claim be covered.

Claims (16)

1. a kind of multiterminal are to the real time information sending method of multiterminal, it is characterised in that the real time information hair of the multiterminal to multiterminal Delivery method comprises at least:
Sent after being encoded based on network code to multiple real time information, wherein, the multiple real time information is by more Individual real time communication device is each sent to the real time information of other real time communication devices;
It is described multiple real time information are encoded based on network code after sent, including:By from the real-time of next stage Information is sent to upper level again after carrying out network code, wherein, connected between equipment at different levels with bus mode;It is described next The real time information of level includes:Each real time communication device in communication group will each be sent to the reality of other real time communication devices When information by network code real time information and be not belonging to the real time communication device of the communication group and be sent to other realities When communication equipment real time information.
2. multiterminal according to claim 1 are to the real time information sending method of multiterminal, it is characterised in that it is the multiple in real time Communication equipment is multicast member, then the real time information after coding is sent into each real time communication device with multicast mode.
3. multiterminal according to any one of claim 1 to 2 are to the real time information sending method of multiterminal, it is characterised in that:Institute Stating network code includes random network code.
4. a kind of multiterminal are to the real time information method of reseptance of multiterminal, it is characterised in that the real time information of the multiterminal to multiterminal connects Receiving method comprises at least:
The communication group of next stage will be handed down to from upper level and after the real time information of network code carries out network decoding Interior at least one real time communication device and the real time communication device for being not belonging to the communication group;Wherein, between equipment at different levels Connected with bus mode.
5. multiterminal according to claim 4 are to the real time information method of reseptance of multiterminal, it is characterised in that:When the network is compiled The coded system of code is random network code, and the real time information method of reseptance also includes:
Before the real time information by network code of the upper level is received, the real time information for being sent to upper level is preserved;
Network decoding is carried out come the real time information by network code to upper level based on the real time information preserved.
6. multiterminal according to claim 5 are to the real time information method of reseptance of multiterminal, it is characterised in that also include:In network After decoding, the real time information for being sent to upper level preserved is deleted.
7. a kind of control system for controlling multiterminal to arrive the real-time information transmission of multiterminal, it is characterised in that described to control multiterminal to more The control system of the real-time information transmission at end comprises at least:
Network code module, for being encoded based on network code to multiple real time information, including:By the reality from next stage When information carry out network code, wherein, connected between equipment at different levels with bus mode;The real time information of the next stage includes: Each real time communication device in communication group compiles the real time information for being each sent to other real time communication devices by network The real time information of code and it is not belonging to the real time communication device of the communication group and is sent to the real-time of other real time communication devices Information;Wherein, the multiple real time information is that the reality of other real time communication devices is each sent to by multiple real time communication devices When information;
Sending module, for by the real time information after the coding of the group of communication and being not belonging to the real-time Communication for Power of the communication group The real time information of equipment is sent.
8. the control system according to claim 7 for controlling multiterminal to the real-time information transmission of multiterminal, it is characterised in that:Institute Control system is stated to be built in multipoint control unit.
9. the control system according to claim 7 for controlling multiterminal to the real-time information transmission of multiterminal, it is characterised in that:Institute State control system to be built in a real time communication device, the real time communication device is the communication being made up of multiple real time communication devices The member of group.
10. the control system according to claim 9 for controlling multiterminal to the real-time information transmission of multiterminal, it is characterised in that also Including:Network decoding module, for by from upper level and by network code real time information carry out network decoding after again by The sending module is handed down to next stage, and correspondingly, the network code module is used to enter the real time information from next stage Upper level is uploaded to by the sending module again after row network code.
11. a kind of multiterminal are to the real time information reception system of multiterminal, it is characterised in that the real time information of the multiterminal to multiterminal connects Receipts system comprises at least:
Network decoding module, for carrying out network decoding to reception from upper level and by the real time information of network code, The real time information of itself corresponding device is sent to obtain other each real time communication devices, and the communication for being issued next stage is small At least one real time communication device in group and the real time communication device for being not belonging to the communication group;Wherein, equipment at different levels it Between connected with bus mode.
12. multiterminal according to claim 11 are to the real time information reception system of multiterminal, it is characterised in that when the coding Information is also to be included using the coding information after random network code, the real time information reception system:
Preserving module, for before the real time information by network code is received, preservation to be sent to other real time communication devices Real time information;
The network decoding module is based on the real time information preserved come to real time information receiving and by network code Network decoding is carried out, to obtain the real time information that other each real time communication devices are sent to itself corresponding device.
13. multiterminal according to claim 12 are to the real time information reception system of multiterminal, it is characterised in that also include:Delete Module, for after network decoding, the real time information for being sent to other real time communication devices preserved to be deleted.
14. a kind of multiterminal are to the real-time communication system of multiterminal, it is characterised in that the real-time communication system of the multiterminal to multiterminal is extremely Include less:
Control device, be built-in with the control system described in any one of claim 7 to 10, for based on network code to multiple realities When information encoded after sent;
Multiple real time communication devices, the real time information reception system described in any one of claim 11 to 13 is built-in with, is used respectively In carrying out network decoding to real time information each receive and by network code, sent out with obtaining other each real time communication devices Give respective real time information.
15. multiterminal according to claim 14 are to the real-time communication system of multiterminal, it is characterised in that:It is the multiple logical in real time Believe that equipment is multicast member;The control device will be sent to described by the real time information of network code with multicast mode Multiple real time communication devices.
16. multiterminal according to claim 14 are to the real-time communication system of multiterminal, it is characterised in that:The real-time Communication for Power system Unite as the real-time communication system for video conference, video monitoring, tele-medicine or remote teaching.
CN201410225302.9A 2014-05-26 2014-05-26 Real-time communication method and system of the multiterminal to multiterminal Expired - Fee Related CN103974027B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201410225302.9A CN103974027B (en) 2014-05-26 2014-05-26 Real-time communication method and system of the multiterminal to multiterminal

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201410225302.9A CN103974027B (en) 2014-05-26 2014-05-26 Real-time communication method and system of the multiterminal to multiterminal

Publications (2)

Publication Number Publication Date
CN103974027A CN103974027A (en) 2014-08-06
CN103974027B true CN103974027B (en) 2018-03-02

Family

ID=51243006

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201410225302.9A Expired - Fee Related CN103974027B (en) 2014-05-26 2014-05-26 Real-time communication method and system of the multiterminal to multiterminal

Country Status (1)

Country Link
CN (1) CN103974027B (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107786560A (en) * 2017-10-31 2018-03-09 南京邮电大学盐城大数据研究院有限公司 Multicast mobile device video conferencing system based on network code
CN115277292A (en) * 2022-07-22 2022-11-01 四川灵通电讯有限公司 Two-wire system inter-device communication method based on network coding

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1474540A (en) * 2003-05-08 2004-02-11 上海交通大学 Multiple mode real-time multimedia interaction system for long distance teaching
CN101262587A (en) * 2008-03-31 2008-09-10 杭州华三通信技术有限公司 A method and multi-point control units for realizing multi-image video conference
CN101404748A (en) * 2008-10-31 2009-04-08 广东威创视讯科技股份有限公司 Video data transmission system and method used for large-scale high-definition network video conference
CN102970235A (en) * 2012-12-06 2013-03-13 南京邮电大学 Multicast routing method based on intra-flow and inter-flow network encoding in wireless mesh network
CN103248882A (en) * 2012-02-02 2013-08-14 腾讯科技(深圳)有限公司 Method, device and system for transmitting multimedia data

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101355682B (en) * 2007-07-23 2011-03-16 中兴通讯股份有限公司 Method for automatically regulating speed of whole network of wideband private wire conference television system
US8228363B2 (en) * 2009-01-30 2012-07-24 Polycom, Inc. Method and system for conducting continuous presence conferences
CN103109528A (en) * 2010-09-20 2013-05-15 维德约股份有限公司 System and method for the control and management of multipoint conferences

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1474540A (en) * 2003-05-08 2004-02-11 上海交通大学 Multiple mode real-time multimedia interaction system for long distance teaching
CN101262587A (en) * 2008-03-31 2008-09-10 杭州华三通信技术有限公司 A method and multi-point control units for realizing multi-image video conference
CN101404748A (en) * 2008-10-31 2009-04-08 广东威创视讯科技股份有限公司 Video data transmission system and method used for large-scale high-definition network video conference
CN103248882A (en) * 2012-02-02 2013-08-14 腾讯科技(深圳)有限公司 Method, device and system for transmitting multimedia data
CN102970235A (en) * 2012-12-06 2013-03-13 南京邮电大学 Multicast routing method based on intra-flow and inter-flow network encoding in wireless mesh network

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
基于网络编码的视频组播研究与实现;许跃飞;《中硕士学位论文全文数据库信息科技辑》;20101215;摘要、正文5-6页、10-14页、16-23页 *

Also Published As

Publication number Publication date
CN103974027A (en) 2014-08-06

Similar Documents

Publication Publication Date Title
CN102892032B (en) Real-time interactive high definition network video communication system
CN108881797B (en) Data processing method and device for video network
EP2693747A2 (en) Method and system for conducting video conferences of diverse participating devices
CN110460877A (en) A kind of video living transmission system and live broadcasting method of team's employment
CN101198008A (en) Method and system for implementing multi-screen and multi-picture
CN108462851A (en) The method and mobile terminal of data processing, server, the second mobile terminal
CN104469261A (en) Video conference system and method based on CDN
CN101778181A (en) Method and system for mobile terminal to achieve three-part call of videophone
CN101360214A (en) System and method implementing remote meeting command
CN103051864A (en) Mobile video conference method and system thereof
CN101931783A (en) Double-flow transmitting system and method for video session
CN101242513A (en) Dual-stream transmission method in video conference and video conference system
CN106973253A (en) A kind of method and device for adjusting media flow transmission
CN103957391A (en) Method and system for displaying videos of all parties at same time during multi-party call in video intercom
CN103974027B (en) Real-time communication method and system of the multiterminal to multiterminal
CN203015009U (en) Real-time interactive high-definition network video communication system
CN103248862A (en) Video conference system for long distance pipeline coal transportation and preparation method of system equipment
US11800017B1 (en) Encoding a subset of audio input for broadcasting conferenced communications
CN104168440A (en) Touchable type integrated video conference terminal and calling method
CN105516641A (en) Mobile conference system based on cloud technology and mobile Internet technology
CN203984568U (en) A kind ofly can be turned by point to point call the video conferencing system of tripartite talks
US20080181303A1 (en) System and method for video compression
CN203120045U (en) Mobile video conference system
US9912910B2 (en) Media content updating method, apparatus, and system
CN203984567U (en) A kind ofly can carry out in terminal home court commander's video conferencing system

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
CB03 Change of inventor or designer information

Inventor after: Li Yanchao

Inventor after: Wang Yu

Inventor after: Zhang Lijun

Inventor before: Zhang Lijun

CB03 Change of inventor or designer information
GR01 Patent grant
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20180302

CF01 Termination of patent right due to non-payment of annual fee