CN101094382B - Video terminal, user interface, and method for playing back accessorial stream - Google Patents
Video terminal, user interface, and method for playing back accessorial stream Download PDFInfo
- Publication number
- CN101094382B CN101094382B CN 200710118722 CN200710118722A CN101094382B CN 101094382 B CN101094382 B CN 101094382B CN 200710118722 CN200710118722 CN 200710118722 CN 200710118722 A CN200710118722 A CN 200710118722A CN 101094382 B CN101094382 B CN 101094382B
- Authority
- CN
- China
- Prior art keywords
- auxilliary
- control
- order
- stream
- auxilliary stream
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Landscapes
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Telephonic Communication Services (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The video terminal comprises: a codec and a supplementary stream player. Said codec is used for coding and decoding the video stream in the video conference; said supplementary stream player is connected to the local-end display and said codec, and is used for reading out the supplementary stream and outputting the supplementary stream to the local-end display, and sending the supplementary stream to the codec in order to send it to far end. The invention also provides a video conference users' interface and a method for playing supplementary stream.
Description
Technical field
The present invention relates to video conferencing technology, relate in particular to a kind of video terminal and corresponding method of in video conference, playing auxilliary stream of supporting double-current parallel schema video conference.
Background technology
Video conferencing system realizes virtual meeting by the network communications technology, and the user who disperses on the geography is accumulated in a place, by multiple mode exchange of information such as image, sound, carries out collaborative work.Space length has been shortened in video conference to the full extent, has made things convenient between the cooperation member in real time, has exchanged intuitively.
Present video conference, image also is sent to far-end as a circuit-switched data in progressively having realized in transmission meeting field picture computer, makes remote site can see speaker's image and speaker's film content in speaker meeting-place simultaneously in video conference.As shown in Figure 1, terminal 110 supports to obtain simultaneously the two-path video input, and one the tunnel is the video that camera 120 and microphone 130 are gathered, and is shown by television set 150 by analog port input back; Another road is speaker's film content of playing on the computer 140, is shown by display (or projecting apparatus) 160 by XGA (Extended Graphic Array, XGA (Extended Graphics Array)) interface input back.In this two-way image, speaker's image is called as main flow, and speaker's film content is called as auxilliary stream.
The parallel video conference mode of this double fluid has obtained extensive use in fields such as remote teaching, scheme discuss, and adopts networking structure shown in Figure 2 usually.As shown in Figure 2, MCU (MultipointControl Unit, multipoint controller) 300 convenes video conference, terminal 110#A is to passing through camera 120#A, after encoding, the two-path video that microphone 130#A and computer 140#A collect sends to MCU 300, this two-path video is transmitted to meeting-place such as the terminal 110#B of conference participation and terminal 110#C by MCU 300, terminal 110#B (110#C) shows the meeting-place picture material that camera 120#A and microphone 130#A collect to this two-path video back of decoding by television set 150#B (150#C), and speaker's film content of coming display terminal 110#A by display (or projecting apparatus) 160#B (160#C).
There is following shortcoming in the parallel video conferencing technology scheme of above-mentioned double fluid: at first, control operation to speaker's film content need be finished on computers, thereby makes other terminal (such as terminal 110#B and 110#C) of conference participation to control film; Secondly, when the scope of the video card output resolution ratio of playing the used computer of speaker's film content and speaker's terminal (such as terminal 110#A) support does not match, can't realize obtaining of speaker's film content.
Summary of the invention
In view of this, the object of the invention is to provide a kind of video terminal, when being applied to the video conference of double-current parallel schema, it can put according to self supporting form to assist to spread, and output resolution ratio (refreshing frequency) restriction of no longer being play the used computer of auxilliary stream.
Simultaneously, another purpose of the present invention is to provide a kind of method of playing auxilliary stream in video conference, it puts control by auxilliary the spreading of transfer between auxilliary stream sender and each auxilliary stream recipient, allow described auxilliary stream sender can put order and assist to spread and put, only have auxilliary stream sender to control to assist the limitation of spreading and putting thereby break away from according to spreading from local terminal or far-end auxilliary.
Still a further object of the present invention is to provide a kind of video conference user interface, and it cooperates the enforcement that can effectively support the auxilliary stream method of above-mentioned broadcast with above-mentioned video terminal.
In order to achieve the above object, the invention discloses a kind of video terminal, it comprises codec unit and assists to spread puts the unit.Wherein, described codec unit is used for encoding and decoding processing video conference video data stream; Described auxilliary spreading put the unit and linked to each other with described codec unit with the local terminal display, is used to read auxilliaryly flow and described auxilliary stream is exported to the local terminal display to play, and also described auxilliary stream exported to described codec unit to be sent to far-end simultaneously.
For above-mentioned video terminal, preferably, it also comprises with described auxilliary spreading puts the auxilliary stream control unit that the unit links to each other; Auxilliary the spreading that described auxilliary stream control unit is used to receive and resolve from local terminal or far-end put order, and puts described auxilliary the spreading of order control and put the operation of unit according to described auxilliary spreading.
For above-mentioned video terminal, preferably, described auxilliary stream control unit also is used to receive and resolve the auxilliary current control order from local terminal or far-end, and transfers between local terminal and far-end according to described auxilliary current control order described auxilliary spreading put the control that unit operations is controlled.
For above-mentioned video terminal, preferably, described auxilliary spread put order comprise advance, retreat, to starting point or wait to terminal.
For above-mentioned video terminal, preferably, described auxilliary current control order comprises control right request, authorizes control, deprives control, discharges control or the request of refusal control etc.
For above-mentioned video terminal, preferably, described auxilliary stream is that document is read, picture browsing or threedimensional model browses etc. under the file for PPT (PowerPoint demonstration document) film projection, Word (word processor that Microsoft produces).
In order to reach above-mentioned another purpose, the invention discloses a kind of method of in video conference, playing auxilliary stream, it is embodied in: after video conference is set up, put control as auxilliary stream sender's video terminal and as transferring auxilliary spreading mutually by auxilliary current control order between auxilliary stream recipient's the video terminal; When described control belonged to described auxilliary stream sender, described auxilliary stream sender was put order according to spreading from local terminal auxilliary and is read corresponding auxilliary stream, and described auxilliary stream outputed on the local terminal display play, and will be sent to far-end after the described auxilliary stream encryption simultaneously; Perhaps, when described control belongs to described auxilliary stream recipient, described auxilliary stream sender is put order according to spreading from described auxilliary stream recipient auxilliary and is read corresponding auxilliary stream, and described auxilliary stream outputed on the local terminal display plays, and will be sent to far-end after the described auxilliary stream encryption simultaneously.
Method for the auxilliary stream of above-mentioned broadcast, preferably, from described auxilliary stream recipient auxilliary spread put order be included in based on TCP (Transfer Control Protocol, transmission control protocol) or H.245 auxilliary the spreading of (medium control protocol) structure put in the signaling.When described auxilliary stream recipient receive spread from local terminal auxilliary put order after, will based on TCP or H.245 corresponding auxilliary the spreading of structure put signaling, and will describedly assist to spread and put signaling and be sent to described auxilliary stream sender; And described auxilliary stream sender receive described auxilliary spread put signaling after, then put order from described auxilliary stream recipient's auxilliary spreading by it being resolved acquisition.
For the method for the auxilliary stream of above-mentioned broadcast, preferably, in the auxilliary current control signaling that described auxilliary current control order is included in based on TCP or H.245 (medium control protocol) constructs.After described video terminal (comprising described auxilliary stream sender and described auxilliary stream recipient) is received the auxilliary current control order from local terminal, will be based on TCP or the corresponding auxilliary current control signaling of structure H.245, and will described auxilliary current control signaling be sent to the video terminal of correspondence; And after corresponding video terminal receives described auxilliary current control signaling, then by it being resolved the auxilliary current control order that obtains wherein.
For the method for the auxilliary stream of above-mentioned broadcast, preferably, described auxilliary current control order comprises the control right request order, authorizes control order and refusal control request command, and the transfer of described control specifically includes the following step:
Step C1, described auxilliary stream recipient receives from after the described auxilliary order of putting of spreading of the request control of local terminal, sends a control right request order to described auxilliary stream sender;
Step C2 after described auxilliary stream sender receives the order of described request control, replys a response to described auxilliary stream recipient, provides described auxilliary stream recipient by the local terminal display simultaneously and is applying for the interface prompt of control;
Step C3, described auxilliary stream sender receives that sending one to described auxilliary stream recipient after the order from the described auxilliary stream recipient of the agreement of local terminal request authorizes the control order, and perhaps described auxilliary stream sender receives that sending one to described auxilliary stream recipient after the order from the described auxilliary stream recipient of the refusal of local terminal request refuses the control request command;
Step C4, described auxilliary stream recipient receives and describedly replys a response to described auxilliary stream sender after authorizing the control order, provide the interface prompt that has obtained control by the local terminal display simultaneously, and will spread from local terminal auxilliary subsequently and put order and send to described auxilliary stream sender.
For the method for the auxilliary stream of above-mentioned broadcast, preferably, described auxilliary current control order also comprises the order of release control, and the transfer of described control specifically also includes the following step:
Step C5, described auxilliary stream recipient receive from local terminal stop to control the described auxilliary order of putting of spreading after, send the order of a release control to described auxilliary stream sender;
Step C6 after described auxilliary stream sender receives the order of described release control, replys a response to described auxilliary stream recipient, provides the interface prompt that described auxilliary stream recipient has discharged control by the local terminal display simultaneously;
Step C7 after described auxilliary stream recipient receives the response of described auxilliary stream sender answer, provides the interface prompt that has lost control by the local terminal display.
For the method for the auxilliary stream of above-mentioned broadcast, preferably, described auxilliary current control order also comprises deprives the control order, and the transfer of described control specifically also includes the following step:
Step C8, described auxilliary stream sender send one to described auxilliary stream recipient and deprive the control order after receiving order from the described auxilliary stream recipient's of depriving of local terminal control;
Step C9, described auxilliary stream recipient receive described deprive the control order after, reply a response to described auxilliary stream sender, provide the interface prompt that has lost control by the local terminal display simultaneously;
Step C10 after described auxilliary stream sender receives the response of described auxilliary stream recipient answer, provides the interface prompt that has obtained control by the local terminal display.
In order to reach an above-mentioned purpose again, the invention discloses a kind of video conference user interface, it is provided with and is used to import auxilliary spreading and puts interface or the button of order to the corresponding video terminal, and described auxilliary spread put order include advance, retreat, to starting point or wait to terminal.
For above-mentioned video conference user interface, preferably, also be provided with on it to be used to import and assist interface or the button of current control order, and described auxilliary current control order includes control right request, authorizes control, deprives control, discharges control or the request of refusal control etc. to the corresponding video terminal.
The present invention has following beneficial effect: at first, by putting the unit toward integrated auxilliary the spreading of video terminal with the auxilliary playing function that spreads, the invention enables auxilliary in the video conference to spread to put no longer be subject to play the used computer of auxilliary stream go out resolution (refreshing frequency); Secondly, by set up a kind of between auxilliary stream sender and auxilliary stream recipient auxilliary the spreading of transfer put the mechanism of control, the invention enables auxilliary stream sender in the video conference not only can put order, can also put order according to spreading simultaneously and carry out assisting to spread accordingly putting from far-end auxilliary according to spreading from local terminal auxilliary.
Description of drawings
Fig. 1 is the connection diagram of video conference terminal in the prior art;
Fig. 2 is the networking schematic diagram of video conference in the prior art;
Fig. 3 is the structural representation of video terminal preferred embodiment of the present invention;
Fig. 4 is the auxilliary state conversion figure that spreads and put control among the present invention;
Fig. 5 plays the transfer flow chart of control among method first embodiment that assists stream for the present invention;
Fig. 6 plays the transfer flow chart of control among method second embodiment that assists stream for the present invention;
Fig. 7 plays the transfer flow chart of control among method the 3rd embodiment that assists stream for the present invention.
Embodiment
Above-mentioned and other technical characterictic and beneficial effect of the present invention will be set forth more fully by the preferred embodiment introduction of carrying out with reference to the accompanying drawings.At first, the invention discloses a kind of video terminal, and Fig. 3 shows the structural representation of a preferred embodiment of this video terminal.
As shown in Figure 3, video terminal 200 provided by the present invention comprises codec unit 210, assists to spread to put unit 220 and assist to spread and put control unit 230.Wherein:
Wherein, 1. representing the main video data flow in the video conference, also is main flow; 2. represent the auxiliary video data flow in the video conference, also promptly auxilliary stream; #L is used to identify local terminal (Local), and #R is used to identify far-end (Remote).In addition, remote equipment may be embodied as another video terminal 200#R as shown in Figure 3, also may specifically be considered as being used to video conference that protocol analysis is provided and create the virtual conference room, carry out conference management and between the video terminal of conference participation, transmit the MCU (Multipoint Control Unit, multipoint control unit) of data.
Auxilliary spread put unit 220#L and codec unit 210#L, auxilliary spread put control unit 230#L, video output 420#L, and auxilliary stream memory 430#L link to each other, be used for reading the auxilliary 2. #L that flows of local terminal such as PPT (PowerPoint demonstration document) film, Word (word processor that Microsoft produces) document, picture, threedimensional model that auxilliary stream memory 430#L deposits, and flow 2. that #L exports to video output 420#L and codec unit 210#L with local terminal is auxilliary.Like this, for the auxilliary 2. #L that flows of local terminal that is stored among the auxilliary stream memory 430#L, XGA (ExtendedGraphic Array, the expansion pattern matrix) interface of leading up to outputs on the video output 420#L, sends to far-end after another route codec unit 210#L encodes according to predetermined format.
Like this, the present invention is by putting unit 220 toward video terminal 200 integrated auxilliary spreading, put unit 220 and play auxilliary stream with auxilliary spreading, make auxilliary in the video conference spread to put and no longer be subject to the output resolution ratio (refreshing frequency) of playing the used computer of auxilliary stream without peripheral computer.
Need to prove that the integrated auxilliary playing function that spreads is only emphasis of the present invention in the video terminal, put unit 220#L and how to read that auxilliary flow data then can use any known technology in the prior art among the auxilliary stream memory 430#L as for auxilliary spreading.Such as, when auxilliary stream memory 430#L is USB (Universal Serial Bus, USB) during equipment, auxilliary spreading put unit 220#L and then connected this USB device by USB interface, and by content is wherein detected the auxilliary flow data of finding out required broadcast.For another example, when auxilliary stream memory 430#L was the webserver, auxilliary spreading put unit 220#L and then connected this webserver by network, and by content is wherein detected the auxilliary flow data of finding out required broadcast.
Auxilliary spreading put control unit 230#L and put unit 220#L, user interface 440#L and remote equipment 200#R links to each other with auxilliary spreading, be mainly used in control auxilliary spread the operation of putting unit 220#L and between each video terminal (comprising 200#L and 200#R) transfer put the control of unit 220#L to assisting to spread.Particularly:
On the one hand, auxilliary spreading put control unit 230#L and received by auxilliary the spreading of the local terminal of user interface 440#L input and put 3. #L and put 3. #R of order by auxilliary the spreading of the far-end of remote equipment 200#R input of order, and puts the order control that 3. (comprises 3. #L and 3. #R) and assisting to spread and put the operation of unit 220#L according to these auxilliary spreading.
And these auxilliary spreading are put order and are 3. included but not limited to " advancing ", " retreating ", " to starting point " and " to terminal " etc.With auxilliary stream is that PPT (PowerPoint demonstration document) film projection is that example makes an explanation:
1), when video terminal 200#L or 200#R wish to check the prevpage content of current PPT film, it can read and play the content of prevpage by " preceding page turning (advancing) " order indication as auxilliary stream sender's video terminal 200#L;
2), when video terminal 200#L or 200#R wish to check the next page content of current PPT film, it can read and play the content of the next page by " back page turning (retreating) " order indication as auxilliary stream sender's video terminal 200#L;
3), when video terminal 200#L or 200#R wish to check first page of content of the PPT film of playing, it can read and play first page content as auxilliary stream sender's video terminal 200#L by " page or leaf (to a starting point) of turning one's head " order indication;
4), when video terminal 200#L or 200#R wish to check the last page content of the PPT film of playing, it can read and play the content of last page by " to endpage (to terminal) " order indication as auxilliary stream sender's video terminal 200#L.
On the other hand, auxilliary spreading put control unit 230#L and also received by 4. #L and by 4. #R of the auxilliary current control order of the far-end of remote equipment 200#R input of the auxilliary current control order of the local terminal of user interface 440#L input, and transfer is put the control of unit 220#L to assisting to spread 4. (to comprise 4. #L and 4. #R) between the video terminal (comprising 200#L and 200#R) of local terminal and far-end according to these auxilliary current control orders.
And 4. these auxilliary current control orders include but not limited to " control right request ", " authorizing control ", " depriving control ", " release control " and " request of refusal control " etc.Be that the PPT film projection is that example makes an explanation with auxilliary stream equally:
1), when auxilliary stream recipient video terminal 200#R wishes to control the PPT projection, it can file an application to control the request that PPT shows to auxilliary stream sender video terminal 200#L by " control right request ";
2), when auxilliary stream sender video terminal 200#L agrees the request of the application control PPT projection that auxilliary stream recipient video terminal 200#R proposes, it can be agreed by " authorizing control ", thereby control is transferred to video terminal 200#R;
3), when auxilliary stream sender video terminal 200#L disagrees with the request of the application control PPT projection that auxilliary stream recipient video terminal 200#R proposes, it can be by " request of refusal control " expression refusal, thereby does not change the home state of current control;
4), when the auxilliary stream recipient video terminal 200#R that has control does not want to continue control PPT projection, it can be abandoned controlling PPT by " release control " expression and show, thereby control is transferred back video terminal 200#L;
5), when the auxilliary stream sender video terminal 200#L that does not have control does not want to allow the auxilliary stream recipient video terminal 200#R that has control continue control PPT to show, it can be regained control by " depriving control ", also is about to control and transfers back video terminal 200#L.
By above-mentioned introduction as can be known, in video conference, video terminal 200 or be auxilliary stream sender or be auxilliary stream recipient; Simultaneously, video terminal 200 or have auxilliary spreading and put control or not auxilliary spreading put control.That is to say video terminal 200 total " the auxilliary stream sender that control is arranged ", " the auxilliary stream sender of no control ", " the auxilliary stream recipient of no control " and " the auxilliary stream recipient that control is arranged " the four kinds of states in the video conference.Fig. 4 has provided the mutual transformational relation signal of these four kinds of states:
After a, video conference were set up, all video terminals all were " the auxilliary stream recipients of no control ";
B, when certain video terminal begins to send auxilliary stream, its state transfers " the auxilliary stream sender that control is arranged " to;
C, after certain " auxilliary stream recipient of no control " application control success (or being awarded control), its state transfers " the auxilliary stream recipient that control is arranged " to; Simultaneously, " the auxilliary stream sender that control is arranged " state transfers " the auxilliary stream sender of no control " to;
D, after " the auxilliary stream recipient that control is arranged " discharges control (or by deprived control), its state transfers " the auxilliary stream recipient of no control " to; Simultaneously, " the auxilliary stream sender of no control " state transfers " the auxilliary stream sender that control is arranged " to;
E, when the auxilliary stream sender in the meeting changes, the state of all video terminals all will be reset, current auxilliary stream sender's state is " the auxilliary stream sender that control is arranged ", and other auxilliary stream recipients' state is " the auxilliary stream recipient of no control ";
F, when " the auxilliary stream sender that control is arranged " stops to send auxilliary stream, its state becomes " the auxilliary stream recipient of no control ".
Like this, 4. the present invention carries out the control transfer by utilizing auxilliary current control order, make in the video conference as auxilliary stream sender's video terminal 200#L both can according to local terminal auxilliary spread put order 3. #L assist to spread and put, also can according to far-end assist spread put order 3. #R assist to spread and put.In other words, the disclosed video terminal of the invention described above provides the foundation for realizing the auxilliary Long-distance Control of putting of spreading.
In order to support the auxilliary playing function that spreads integrated in the video terminal 200 shown in Figure 3, the invention also discloses a kind of video conference user interface, also be user interface shown in Fig. 3 440.Compare with existing known video conference user interface, user interface (remote controller/WEB interface/control desk) 440 mainly is added with auxilliary spreading and puts relevant interface or button, make the user can by these interfaces or button will assist accordingly spread put order 3. and/or auxilliary current control order 4. be input in the video terminal 200 (Fig. 3 be specially assisting spreads puts control unit 230).
Wherein, put the 3. relevant interface of order or button includes but not limited to " advance (preceding page turning) ", " retreating (back page turning) ", " to starting point (page or leaf of turning one's head) " and " (to endpage) to terminal " etc. with auxilliary spreading, video conference participants (comprising auxilliary stream recipient and the auxilliary sender of stream) can be imported with assisting to spread by these interfaces or button put relevant operational order; And interface or the button 4. relevant with auxilliary current control order include but not limited to " control right request ", " authorizing control ", " depriving control ", " release control " or " request of refusal control " etc. allow video conference participants (comprising auxilliary stream recipient and auxilliary stream sender) put the relevant operational order of control with auxilliary spreading by these interfaces or button input.
In general, each auxilliary spread put order 3. with each auxilliary current control order 4. have respectively one with its interface or button one to one.But preferably, wherein " control is authorized " and " control application " can a shared interface or buttons, and " control is deprived " also can a shared interface or button with " control release ".
In addition, the present invention also provides a kind of method of playing auxilliary stream in video conference.This method is mainly used in shown in Figure 3 stating on the video terminal 200, and purpose is to realize auxilliary stream Long-distance Control in video conference.Therefore will continue below it to be described in detail with reference to Fig. 3.
After video conference is set up, can 4. transfer mutually by auxilliary current control order between each video terminal of conference participation (comprising 200#L and 200#R) and put the control of unit 220#L playing used auxilliary the spreading of auxilliary stream.When this control belongs to the auxilliary stream of conduct sender's video terminal 200#L, then auxilliary spread put unit 220#L will according to by the local terminal of user interface 440#L input auxilliary spread put order 3. #L assist to spread and put, comprise according to local terminal auxilliary spread put order 3. #L read the corresponding auxilliary 2. #L data that flow among the auxilliary stream memory 430#L, and this auxilliary #L that flows 2. outputed on the video output 420#L and show, simultaneously 2. this auxilliaryly flowed that #L outputs to codec unit 210#L to be sent to far-end 200#R after encoding.Yet, when this control belongs to the auxilliary stream of conduct recipient's video terminal 200#R, then auxilliary spread put unit 220#L will according to by the far-end of video terminal 200#R input auxilliary spread put order 3. #R assist to spread and put, comprise according to far-end auxilliary spread put order 3. #R read the corresponding auxilliary 2. #L data that flow among the auxilliary stream memory 430#L, and this auxilliary #L that flows 2. outputed on the video output 420#L and show, simultaneously 2. this auxilliaryly flowed that #L outputs to codec unit 210#L to be sent to far-end 200#R after encoding.
Wherein, as previously mentioned, auxilliary spreading put order and 3. included but not limited to " advancing ", " retreating ", " to starting point " and " to terminal " etc.; And 4. auxilliary current control order includes but not limited to " control right request ", " authorizing control ", " depriving control ", " release control " and " request of refusal control " etc.Since explanation describe in detail during video terminal 200 these auxilliary spread put order 3. with auxilliary current control order 4., so no longer repeat at this.
Play the method for auxilliary stream for the invention described above, in order to ensure between each video terminal (comprising 200#L and 200#R) auxilliary spread put order 3. with auxilliary current control order transmission safety 4., the present invention preferably with these auxilliary spread put order 3. with auxilliary current control order 4. be included in respectively based on TCP (Transfer Control Protocol, transmission control protocol) or H.245 auxilliary the spreading of (medium control protocol) structure put in signaling and the auxilliary current control signaling.Particularly:
When receiving to spread from local terminal auxilliary, auxilliary stream recipient video terminal 200#R puts order 3. behind the #R, its will based on TCP or H.245 corresponding auxilliary the spreading of structure put signaling, and this auxilliary spreading is put signaling and is sent to auxilliary stream sender video terminal 200#L (be specially auxilliary spreading among Fig. 3 and put control unit 230#L).And video terminal 200#L receive this auxilliary spread put signaling after, then extract and be contained in auxilliary the spreading of wherein sending and put 3. #R of order by video terminal 200#R by it being carried out packet parsing.
With last similar, when auxilliary stream recipient video terminal 200#R receives from the auxilliary current control order of local terminal 4. behind the #R (such as the application control or discharge control), it will be based on TCP or the corresponding auxilliary current control signaling of structure H.245, and this auxilliary current control signaling is sent to auxilliary stream sender video terminal 200#L (be specially auxilliary spreading among Fig. 3 and put control unit 230#L).And after video terminal 200#L receives this auxilliary current control signaling, then extract and be contained in wherein 4. #R of the auxilliary current control order of sending by video terminal 200#R by it being carried out packet parsing.
It should be noted that auxilliary stream recipient based on TCP or when H.245 structure comprises the auxilliary current control signaling of auxilliary current control order " application control " and " release control ", all needs to comprise himself and identifies in message body.
Yet, when auxilliary stream sender video terminal 200#L receives from local terminal, the auxilliary current control order 4. behind the #L (such as authorizing control, depriving control or the request of refusal control) that need send to auxilliary stream recipient video terminal 200#R, it will be based on TCP or H.245 constructs corresponding auxilliary current control signaling, and this auxilliary current control signaling is sent to video terminal 200#R.And after video terminal 200#R receives this auxilliary current control signaling, then extract and be contained in wherein 4. #L of the auxilliary current control order of sending by video terminal 200#L by it being carried out packet parsing.
It should be noted that auxilliary stream sender based on TCP or H.245 structure comprise that auxilliary current control order " is authorized control ", during the auxilliary current control signaling of " depriving control " and " request of refusal control ", in message body, all need to comprise purpose person's sign.
By above-mentioned introduction as can be known, in the method for the auxilliary stream of the disclosed broadcast of the present invention, auxilliary stream sender video terminal 200#L is put order and is 3. assisted the flow process of putting of spreading and be according to auxilliary spreading:
Step D1,3. reception puts order by auxilliary the spreading that the video terminal that has control sends, and this auxilliary spreading is put order and 3. is embodied in auxilliary the spreading of local terminal puts 3. #L and be embodied in auxilliary the spreading of far-end put 3. #R of order when this video terminal is auxilliary stream recipient of order when this video terminal is auxilliary stream sender;
Step D2 is put order and is 3. read the auxilliary 2. #L data that flow of corresponding local terminal according to above-mentioned auxilliary spreading, such as reading the prevpage content when putting order 3. for " advancing ", read the next page content etc. when putting order 3. for " retreating " auxilliary spreading auxilliary spreading;
Step D3 outputs to the auxilliary #L data that flow 2. of the local terminal that reads on the video output 420#L and plays, and also it is outputed to simultaneously and encodes on the codec unit 210#L to be sent to the auxilliary stream recipient of far-end.
Introduce the auxilliary transfer flow process of spreading and putting control in the auxilliary stream method of the disclosed broadcast of the present invention with reference to Fig. 5,6 and 7 below.Need to prove that in Fig. 5,6 and 7, video terminal 200#A is auxilliary stream sender, user interface 440#A is the user interface that links to each other with video terminal 200#A, also is that user interface 440#A is the local terminal user interface of video 200#A; Video terminal 200#B and 200#C are auxilliary stream recipient, and wherein user interface 440#B is the local terminal user interface of video terminal 200#B; MCU 300 is the multipoint control unit in the video conference of video terminal 200#A, 200#B and 200#C fellowship.
As shown in Figure 5, after video conference is set up, determine that video terminal 200#A is auxilliary stream sender and video terminal 200#B is auxilliary stream recipient, the auxilliary stream recipient video terminal 200#B that does not then have control assists the flow process of putting control of spreading from the auxilliary stream sender video terminal 200#A acquisition that control is arranged and is:
After step C1, video terminal 200#B receive the auxilliary order of putting of spreading of request control that user interface 440#B sends, based on TCP or H.245 construct corresponding control right request signaling, and this control right request signaling is sent to video terminal 200#A;
After step C2, video terminal 200#A receive this control right request signaling, reply a response, provide the interface prompt that video terminal 200#B is applying for control by the local terminal display simultaneously to video terminal 200#B;
After step C3, video terminal 200#A receive the order of the agreement video terminal 200#B request that user interface 440#A makes, based on TCP or H.245 structure authorize the control signaling accordingly; Perhaps, after video terminal 200#A receives the order of the refusal video terminal 200#B request that user interface 440#A makes, based on TCP or the corresponding refusal of structure control demand signalling (not shown among Fig. 5) H.245;
After step C4, video terminal 200#B receive that this authorizes the control signaling, reply a response, provide the interface prompt that has obtained control by the local terminal display simultaneously to video terminal 200#A.
Finish after above-mentioned steps C1～C4, video terminal 200#B has just obtained auxilliary spreading and has put control, video terminal 200#B can be put auxilliary the spreading that user interface 440#B sends order and sends to video terminal 200#A subsequently, make video terminal 200#A to spread from far-end auxilliary and put order and assist to spread and put, also promptly realized the auxilliary Long-distance Control of spreading and putting according to this.
Do not want to continue that control is auxilliary spreads when putting as the auxilliary stream recipient video terminal 200#B of control, then it will be assisted to spread and put the flow process that control transfers to the auxilliary sender of stream video terminal 200#A of no control and be:
Step C5, video terminal 200#B receive that user interface 440#B sends stop to control the auxilliary order of putting of spreading after, based on TCP or the corresponding control signaling that discharges of structure H.245, and this discharged control signaling send to video terminal 200#A;
Step C6, video terminal 200#A reply a response to video terminal 200#B after receiving this release control signaling, provide the interface prompt that video terminal 200#B has discharged control by the local terminal display simultaneously;
Step C7, video terminal 200#B provide the interface prompt that has lost control after receiving the response of this video terminal 200#A answer by the local terminal display.
Finish after above-mentioned steps C5～C7, the auxilliary stream sender video terminal 200#A of no control has regained auxilliary spreading from the auxilliary stream recipient video terminal B that control is arranged passively and has put control, and it will be according to putting order and assist to spread and put from auxilliary the spreading of the local terminal of user interface 440#A subsequently.
Yet video terminal 200#A also can will return auxilliary spreading from video terminal 200#B by " depriving control " mode puts control, and the concrete operations flow process is:
After step C8, video terminal 200#A receive the order of depriving video terminal 200#B control that user interface 440#A sends, based on TCP or H.245 structure deprive the control signaling accordingly, and this deprived the control signaling send to video terminal 200#B;
After step C9, video terminal 200#B receive that this deprives the control signaling, reply a response, provide the interface prompt that has lost control by the local terminal display simultaneously to video terminal 200#A;
Step C10, video terminal 200#A provide the interface prompt that has obtained control after receiving the response of video terminal 200#B answer by the local terminal display.
Finish after above-mentioned steps C8～C10, the auxilliary stream sender video terminal 200#A of no control has regained auxilliary spreading from the auxilliary stream recipient video terminal B that control is arranged on one's own initiative and has put control, and it will be according to putting order and assist to spread and put from auxilliary the spreading of the local terminal of user interface 440#A subsequently.
Transfer flow process for the control that the invention described above is play in the auxilliary stream method, receive that assisting current control signaling rear video terminal all preferably replys response of the other side.This response message can be used for confirming that signaling sends to, and also is used for the overtime use of signaling.
In a sense, Fig. 5 can regard the auxilliary transfer flow chart that spreads and put control in the point-to-point conversation as.For the multipoint videoconference of being convened by MCU, the present invention requires MCU that all are comprised the auxilliary signaling of putting order and/or auxilliary current control order of spreading and only does to transmit and do not carry out any response processing.Thereby make aforementioned the present invention play each handling process in the auxilliary stream method and be equally applicable to the multipoint videoconference of convening by MCU.
But, comparing with point-to-point situation, a plurality of auxilliary stream recipient who exists in the multipoint videoconference will make that the transfer that assisting spreads puts control is complicated a little.And complexity mainly occurs in both cases: when 1, auxilliary stream sender had transferred control to an auxilliary stream recipient, another auxilliary stream recipient still filed an application the request of control; 2, a plurality of auxilliary stream recipients carry out the control application simultaneously.Respectively both of these case is described in detail below.
At first, as shown in Figure 6, in the multipoint videoconference of convening by MCU 300, video terminal 200#A is auxilliary stream sender, has had control and do not had control with the video terminal 200#B as the auxilliary recipient of stream as the video terminal 200#C that assists the stream recipient, this moment, video terminal 200#B will apply for control, and the control transfer flow process that then causes thus is:
After M1-1, video terminal 200#A receive the control right request signaling of the video terminal 200#B proposition of being transmitted by MCU 300, reply a response and this response is transmitted to video terminal 200#B by MCU 300;
M1-2, if video terminal 200#A agrees the control application of video terminal 200#B, then video terminal 200#A will at first produce one and deprive the control signaling and by MCU 300 this is deprived the control signaling and be transmitted to video terminal 200#C, and produce one again authorize the control signaling and authorize the control signaling by MCU 300 with this and be transmitted to video terminal 200#B after receiving the response that the video terminal 200#C that transmitted by MCU 300 replys;
M1-3, if video terminal 200#A disagrees with the control application of video terminal 200#B, then video terminal 200#A directly produces a refusal control demand signalling and by MCU 300 this refusal control demand signalling is transmitted to video terminal 200#B.
Then, as shown in Figure 7, in the multipoint videoconference of being convened by MCU 300, video terminal 200#A is auxilliary stream sender, applies for control simultaneously as the video terminal 200#B and the 200#C that assist the stream recipient that the control transfer flow process that then causes thus is:
M2-1, video terminal 200#A receive the control right request signaling of the video terminal 200#B proposition of being transmitted by MCU 300;
M2-2, video terminal 200#A is before carrying out agreement or refusal video terminal 200#B requested operation, and it receives the control right request signaling of the video terminal 200#C proposition of being transmitted by MCU 300 again;
M2-3, so, when authorizing the control operation, video terminal 200#A execution will eject applicant's tabulation, comprise video terminal 200#B and 200#C in this tabulation, allow video terminal 200#A select to be awarded the video terminal (being illustrated as video terminal 200#B among Fig. 7) of control according to this tabulation;
M2-4, video terminal 200#A produce one and authorize the control signaling, and authorize the control signaling by MCU 300 with this and be transmitted to video terminal 200#B, and video terminal 200#B has obtained control thus;
M2-5, video terminal 200#A produce a refusal control demand signalling, and by MCU 300 this refusal control demand signalling are transmitted to other applicant (being illustrated as video terminal 200#C among Fig. 7).
What need statement is that foregoing invention content and embodiment are intended to prove the practical application of technical scheme provided by the present invention, should not be construed as the qualification to protection range of the present invention.Those skilled in the art are in spirit of the present invention and principle, when doing various modifications, being equal to and replacing or improve.Protection scope of the present invention is as the criterion with appended claims.
Claims (12)
1. a video terminal comprises being used for the codec unit that the video conference video data stream is handled in encoding and decoding; It is characterized in that, also comprise with auxilliary the spreading that the local terminal display links to each other with described codec unit and put the unit and put the auxilliary stream control unit that the unit links to each other with described auxilliary spreading;
Described auxilliary spreading put the unit and is used to read auxilliary stream, and described auxilliary stream is exported to the local terminal display to play, and also described auxilliary stream exported to described codec unit to be sent to far-end simultaneously;
Auxilliary the spreading that described auxilliary stream control unit is used to receive and resolve from local terminal or far-end put order and auxilliary current control order, and put described auxilliary the spreading of order control and put the operation of unit according to described auxilliary spreading, and according to described auxilliary current control order between local terminal and far-end, transfer to described assist to spread put the control that unit operations is controlled.
2. video terminal as claimed in claim 1 is characterized in that, described auxilliary spreading put order and comprised and advance, retreat, to starting point or to terminal.
3. video terminal as claimed in claim 1 is characterized in that, described auxilliary current control order comprises control right request, authorizes control, deprives control, discharges control or the request of refusal control.
4. as the arbitrary described video terminal of claim 1 to 3, it is characterized in that described auxilliary stream is that PPT film projection, Word document are read or file is browsed.
5. a method of playing auxilliary stream in video conference is characterized in that, after video conference is set up, puts control as auxilliary stream sender's video terminal and as transferring auxilliary spreading mutually by auxilliary current control order between auxilliary stream recipient's the video terminal:
When described control belonged to described auxilliary stream sender, described auxilliary stream sender was put order according to spreading from local terminal auxilliary and is read corresponding auxilliary stream, and described auxilliary stream outputed on the local terminal display play, and will be sent to far-end after the described auxilliary stream encryption simultaneously; Perhaps,
When described control belongs to described auxilliary stream recipient, described auxilliary stream sender is put order according to spreading from described auxilliary stream recipient auxilliary and is read corresponding auxilliary stream, and described auxilliary stream outputed on the local terminal display play, will be sent to far-end after the described auxilliary stream encryption simultaneously.
6. as the method for the auxilliary stream of broadcast as described in the claim 5, it is characterized in that, when described auxilliary stream recipient receive spread from local terminal auxilliary put order after, will based on TCP or H.245 corresponding auxilliary the spreading of structure put signaling, and will describedly assist to spread and put signaling and be sent to described auxilliary stream sender; And described auxilliary stream sender receive described auxilliary spread put signaling after, then put order from described auxilliary stream recipient's auxilliary spreading by it being resolved acquisition.
7. as the method for the auxilliary stream of broadcast as described in claim 5 or 6, it is characterized in that, after described video terminal is received auxilliary current control order from local terminal, will be based on TCP or the corresponding auxilliary current control signaling of structure H.245, and will described auxilliary current control signaling be sent to the video terminal of correspondence; And after corresponding video terminal receives described auxilliary current control signaling, then by it being resolved the auxilliary current control order that obtains wherein.
8. as the method for the auxilliary stream of broadcast as described in the claim 7, it is characterized in that described auxilliary current control order comprises the control right request order, authorizes control order and refusal control request command, and the transfer of described control specifically includes the following step:
Step C1, described auxilliary stream recipient receives from after the described auxilliary order of putting of spreading of the request control of local terminal, sends a control right request order to described auxilliary stream sender;
Step C2 after described auxilliary stream sender receives the order of described request control, replys a response to described auxilliary stream recipient, provides described auxilliary stream recipient by the local terminal display simultaneously and is applying for the interface prompt of control;
Step C3, described auxilliary stream sender receives that sending one to described auxilliary stream recipient after the order from the described auxilliary stream recipient of the agreement of local terminal request authorizes the control order, and perhaps described auxilliary stream sender receives that sending one to described auxilliary stream recipient after the order from the described auxilliary stream recipient of the refusal of local terminal request refuses the control request command;
Step C4, described auxilliary stream recipient receives and describedly replys a response to described auxilliary stream sender after authorizing the control order, provide the interface prompt that has obtained control by the local terminal display simultaneously, and will spread from local terminal auxilliary subsequently and put order and send to described auxilliary stream sender.
9. as the method for the auxilliary stream of broadcast as described in the claim 8, it is characterized in that described auxilliary current control order also comprises and discharges the control order, and the transfer of described control specifically also includes the following step:
Step C5, described auxilliary stream recipient receive from local terminal stop to control the described auxilliary order of putting of spreading after, send the order of a release control to described auxilliary stream sender;
Step C6 after described auxilliary stream sender receives the order of described release control, replys a response to described auxilliary stream recipient, provides the interface prompt that described auxilliary stream recipient has discharged control by the local terminal display simultaneously;
Step C7 after described auxilliary stream recipient receives the response of described auxilliary stream sender answer, provides the interface prompt that has lost control by the local terminal display.
10. as the method for the auxilliary stream of broadcast as described in the claim 9, it is characterized in that described auxilliary current control order also comprises deprives the control order, and the transfer of described control specifically also includes the following step:
Step C8, described auxilliary stream sender send one to described auxilliary stream recipient and deprive the control order after receiving order from the described auxilliary stream recipient's of depriving of local terminal control;
Step C9, described auxilliary stream recipient receive described deprive the control order after, reply a response to described auxilliary stream sender, provide the interface prompt that has lost control by the local terminal display simultaneously;
Step C10 after described auxilliary stream sender receives the response of described auxilliary stream recipient answer, provides the interface prompt that has obtained control by the local terminal display.
11. a video conference user interface is characterized in that, is provided with to be used to import auxilliary spreading and to put order and auxilliary current control order interface or the button to the corresponding video terminal;
Described auxilliary spreading put order and included and advance, retreat, to starting point or to terminal;
Described auxilliary current control order is used to be implemented in as auxilliary stream sender's video terminal with as assisting to spread between the video terminal of assisting the stream recipient puts the mutual transfer of control.
12. video conference user interface as claimed in claim 11, it is characterized in that, also be provided with to be used to import and assist interface or the button of current control order, and described auxilliary current control order comprises control right request, authorizes control, deprives control, discharges control or the request of refusal control to the corresponding video terminal.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 200710118722 CN101094382B (en) | 2007-07-12 | 2007-07-12 | Video terminal, user interface, and method for playing back accessorial stream |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 200710118722 CN101094382B (en) | 2007-07-12 | 2007-07-12 | Video terminal, user interface, and method for playing back accessorial stream |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN101094382A CN101094382A (en) | 2007-12-26 |
| CN101094382B true CN101094382B (en) | 2010-11-03 |
Family
ID=38992362
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN 200710118722 Active CN101094382B (en) | 2007-07-12 | 2007-07-12 | Video terminal, user interface, and method for playing back accessorial stream |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101094382B (en) |
Families Citing this family (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101635822B (en) * | 2008-07-26 | 2012-03-07 | 中兴通讯股份有限公司 | Method for realizing double stream automatic transmission of conference television terminal |
| CN101741587B (en) * | 2008-11-18 | 2012-05-23 | 中兴通讯股份有限公司 | Multimedia terminal playing PPT and method for playing PPT thereon |
| CN101931783A (en) * | 2010-09-21 | 2010-12-29 | 天地阳光通信科技（北京）有限公司 | Double-flow transmitting system and method for video session |
| CN102572367B (en) | 2010-12-07 | 2014-09-03 | 华为终端有限公司 | Multiple auxiliary stream control method, device and network system |
| WO2014036683A1 (en) * | 2012-09-04 | 2014-03-13 | 华为终端有限公司 | Media playback method, control point and terminal |
| CN108055497B (en) | 2013-05-23 | 2020-08-14 | 华为技术有限公司 | Conference signal playing method and device, video conference terminal and mobile device |
| CN104185034A (en) * | 2013-05-27 | 2014-12-03 | 宋晓娜 | Apparatus having functions of multi-screen interaction management, network communication, and video output |
| CN104301657B (en) | 2013-07-19 | 2019-01-01 | 中兴通讯股份有限公司 | A kind of video conference terminal and its secondary flow data cut-in method |
| CN103561343B (en) * | 2013-10-30 | 2017-12-29 | 乐视致新电子科技（天津）有限公司 | A kind of video transmission method and device |
| CN103747199B (en) * | 2013-12-09 | 2019-06-14 | 三亚中兴软件有限责任公司 | The cut-in method and system in video conference television terminal video source |
| CN105472306A (en) * | 2014-08-19 | 2016-04-06 | 中兴通讯股份有限公司 | Video conference data sharing method and related device |
| CN107277425A (en) * | 2016-04-08 | 2017-10-20 | 中兴通讯股份有限公司 | A kind of server, meeting-place terminal and cloud meeting processing method |
| CN108322693B (en) * | 2018-03-01 | 2021-03-02 | 上海创视通软件技术有限公司 | Method and system for controlling auxiliary stream of third-party terminal by MCU (microprogrammed control Unit) terminal |
| CN110798457A (en) * | 2019-10-22 | 2020-02-14 | 厦门亿联网络技术股份有限公司 | Auxiliary flow control method based on SIP and conference system |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1561637A (en) * | 2001-10-01 | 2005-01-05 | 意大利电信股份公司 | System and method for transmitting multimedia information streams, for instance for remote teaching |
| CN1567202A (en) * | 2003-07-08 | 2005-01-19 | 皇家飞利浦电子股份有限公司 | Method and system for playing and registering course content in virtual classroom |
-
2007
- 2007-07-12 CN CN 200710118722 patent/CN101094382B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1561637A (en) * | 2001-10-01 | 2005-01-05 | 意大利电信股份公司 | System and method for transmitting multimedia information streams, for instance for remote teaching |
| CN1567202A (en) * | 2003-07-08 | 2005-01-19 | 皇家飞利浦电子股份有限公司 | Method and system for playing and registering course content in virtual classroom |
Non-Patent Citations (1)
| Title |
|---|
| CN 1561637 A,说明书第3页倒数第1行至第8页第16行、图1. |
Also Published As
| Publication number | Publication date |
|---|---|
| CN101094382A (en) | 2007-12-26 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101094382B (en) | Video terminal, user interface, and method for playing back accessorial stream | |
| CN101572794B (en) | Conference terminal, conference server, conference system and data processing method | |
| CN101286865B (en) | Electronic white board realizing method, device and system in audio and video meeting | |
| CN104038722B (en) | The content interaction method and system of a kind of video conference | |
| US11137969B2 (en) | Information interaction method, information interaction system, and application thereof | |
| CN102460487B (en) | The system and method for mixing course teaching | |
| CN104333574B (en) | Electric white board synchronous method and system | |
| CN101198008A (en) | Method and system for implementing multi-screen and multi-picture | |
| CN106162043A (en) | Multimedia file demenstration method in a kind of video conferencing system | |
| CN112543297A (en) | Video conference live broadcasting method, device and system | |
| CN103080914B (en) | For the system of multi-user communication, method and device | |
| CN105575203A (en) | Cloud teaching realization method and system and cloud server | |
| WO2019010827A1 (en) | Video acquisition method and apparatus, video device and storage medium | |
| CN105553978A (en) | Belt conveyor visualization auxiliary maintenance system and interaction process of streaming media | |
| CN110619770A (en) | Draw live interactive teaching system of this courseware | |
| CN102123267A (en) | Method, device and system for interactively modifying auxiliary stream of video conference | |
| CN103369010A (en) | Shared broadcasting method and shared broadcasting system | |
| CN203984563U (en) | A kind of electronic whiteboard and video conference integrated system of realizing many picture compositions demonstrations | |
| CN203813877U (en) | Extensible dual-stream video sharing system | |
| CN203136049U (en) | Interactive data sharing and displaying system used for remote video system | |
| CN203984565U (en) | A kind of video conferencing system of integrated management | |
| CN101520719A (en) | System and method for sharing display information | |
| WO2011010563A1 (en) | Video call system, master-side terminal, slave-side terminal, and program | |
| CN203071964U (en) | Extended multi-screen display system used in video conference | |
| CN203984567U (en) | A kind ofly can carry out in terminal home court commander's video conferencing system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CP03 | Change of name, title or address | ||
| CP03 | Change of name, title or address |
Address after: 310052 Binjiang District Changhe Road, Zhejiang, China, No. 466, No. Patentee after: NEW H3C TECHNOLOGIES Co.,Ltd. Address before: 310053 Hangzhou hi tech Industrial Development Zone, Zhejiang province science and Technology Industrial Park, No. 310 and No. six road, HUAWEI, Hangzhou production base Patentee before: HANGZHOU H3C TECHNOLOGIES Co.,Ltd. |
|
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20230609 Address after: 310052 11th Floor, 466 Changhe Road, Binjiang District, Hangzhou City, Zhejiang Province Patentee after: H3C INFORMATION TECHNOLOGY Co.,Ltd. Address before: 310052 Changhe Road, Binjiang District, Hangzhou, Zhejiang Province, No. 466 Patentee before: NEW H3C TECHNOLOGIES Co.,Ltd. |