WO2012075930A1 - 多路辅流控制方法、装置及网络系统 - Google Patents

多路辅流控制方法、装置及网络系统 Download PDF

Info

Publication number
WO2012075930A1
WO2012075930A1 PCT/CN2011/083542 CN2011083542W WO2012075930A1 WO 2012075930 A1 WO2012075930 A1 WO 2012075930A1 CN 2011083542 W CN2011083542 W CN 2011083542W WO 2012075930 A1 WO2012075930 A1 WO 2012075930A1
Authority
WO
WIPO (PCT)
Prior art keywords
terminal
auxiliary
site
channel
auxiliary stream
Prior art date
Application number
PCT/CN2011/083542
Other languages
English (en)
French (fr)
Inventor
吴姣黎
廖述钊
Original Assignee
华为终端有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为终端有限公司 filed Critical 华为终端有限公司
Priority to EP11846405.6A priority Critical patent/EP2637404B1/en
Publication of WO2012075930A1 publication Critical patent/WO2012075930A1/zh
Priority to US13/910,341 priority patent/US9013537B2/en

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/14—Systems for two-way working
    • H04N7/15—Conference systems
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00—Data switching networks
    • H04L12/02—Details
    • H04L12/16—Arrangements for providing special services to substations
    • H04L12/18—Arrangements for providing special services to substations for broadcast or conference, e.g. multicast
    • H04L12/1813—Arrangements for providing special services to substations for broadcast or conference, e.g. multicast for computer conferences, e.g. chat rooms
    • H04L12/1827—Network arrangements for conference optimisation or adaptation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00—Data switching networks
    • H04L12/02—Details
    • H04L12/16—Arrangements for providing special services to substations
    • H04L12/18—Arrangements for providing special services to substations for broadcast or conference, e.g. multicast
    • H04L12/1813—Arrangements for providing special services to substations for broadcast or conference, e.g. multicast for computer conferences, e.g. chat rooms
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/1066—Session management
    • H04L65/1069—Session establishment or de-establishment
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/40—Support for services or applications
    • H04L65/401—Support for services or applications wherein the services involve a main real-time session and one or more additional parallel real-time or time sensitive sessions, e.g. white board sharing or spawning of a subconference
    • H04L65/4015—Support for services or applications wherein the services involve a main real-time session and one or more additional parallel real-time or time sensitive sessions, e.g. white board sharing or spawning of a subconference where at least one of the additional parallel sessions is real time or time sensitive, e.g. white board sharing, collaboration or spawning of a subconference
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/40—Support for services or applications
    • H04L65/403—Arrangements for multi-party communication, e.g. for conferences
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/40—Support for services or applications
    • H04L65/403—Arrangements for multi-party communication, e.g. for conferences
    • H04L65/4038—Arrangements for multi-party communication, e.g. for conferences with floor control
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/40—Support for services or applications
    • H04L65/403—Arrangements for multi-party communication, e.g. for conferences
    • H04L65/4053—Arrangements for multi-party communication, e.g. for conferences without floor control
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00—Data switching networks
    • H04L12/02—Details
    • H04L12/16—Arrangements for providing special services to substations
    • H04L12/18—Arrangements for providing special services to substations for broadcast or conference, e.g. multicast
    • H04L12/1813—Arrangements for providing special services to substations for broadcast or conference, e.g. multicast for computer conferences, e.g. chat rooms
    • H04L12/1822—Conducting the conference, e.g. admission, detection, selection or grouping of participants, correlating users to one or more conference sessions, prioritising transmission

Definitions

  • Multi-flow control method, device and network system The present application claims to be Chinese patent application filed on December 7, 2010, the Chinese Patent Office, the application number is 201010577099.3, and the invention name is "multi-channel auxiliary flow control method, device and network system" Priority is hereby incorporated by reference in its entirety.
  • the present invention relates to the field of communications technologies, and in particular, to a multi-channel auxiliary stream control method, apparatus, and network system. Background technique
  • the video conferencing service is a multimedia communication service, which uses a video terminal and a communication network to hold a conference, and can simultaneously realize image, voice, and data interaction between two or more locations.
  • the terminal in the conference site compresses and encodes the image signal captured by the local camera and the voice signal of the participant picked up by the microphone in the participant area, and transmits it to the remote conference site through the transmission network.
  • the digital signal transmitted from the remote conference site is received through the transmission network, and the digital signal is decoded to obtain images and signals of the remote conference participants.
  • video conferencing the venue has been developed from a previous camera, a monitor, and a participant area to multiple cameras, multiple displays, multiple participant areas, multiple cameras, multiple displays in the same venue. Multiple participant areas are associated by physical or logical relationships.
  • the conference site A sends the conference content image to the remote conference site B through the auxiliary stream channel.
  • the local content display shows the content of the conference content.
  • the prior art provides a method for sending a secondary stream based on a token. Specifically, a conference has only one secondary stream token, and the conference site of the token is sent to the secondary stream. The participants of each site view the site of the token. Streaming images.
  • the user may ask to see the physical projection while watching the conference content image.
  • two auxiliary streams are needed, one for transmitting the physical projection image and the other for transmitting the conference content image.
  • there is only one auxiliary stream token in a conference and the auxiliary stream token can only be bound to one auxiliary stream, so that the participants in the site cannot simultaneously see the physical projection and the conference content image.
  • the embodiment of the invention provides a multi-channel auxiliary stream control method, device and network system, which enables an attendee in a conference to simultaneously view images of multiple auxiliary streams.
  • a multi-channel auxiliary flow control method includes:
  • the terminal of the first site After applying for the PRE token, the terminal of the first site sends a secondary stream to the terminal of the second site by using the PRE auxiliary channel corresponding to the PRE token, and uses the auxiliary stream channel bound to the PRE auxiliary channel. Sending another auxiliary stream to the terminal of the second site.
  • a multi-channel auxiliary flow control method includes:
  • the terminal uses the secondary channel to send the secondary stream, so that the terminal in the other site of the conference that is paired with the terminal that sends the secondary stream receives the secondary stream.
  • a terminal, located in the first venue, includes:
  • a token application unit for applying for a PRE token
  • the auxiliary stream sending unit is configured to send, by using the PRE auxiliary stream channel corresponding to the PRE token, a secondary auxiliary stream to the terminal of the second site after the application for obtaining the PRE token, and use the auxiliary channel bound to the PRE auxiliary channel
  • the flow channel sends other auxiliary streams to the terminal of the second site.
  • a network system including: a first terminal and a second terminal, where the first terminal and the second terminal are located in a first conference site,
  • the first terminal is configured to send a secondary stream by using the first auxiliary stream channel after the first site is used to obtain the PRE token, so that the terminal paired with the first terminal in the second site receives the one auxiliary stream;
  • the second terminal is configured to send another auxiliary stream by using the second auxiliary stream channel after the first site applies for the PRE token, so that the terminal paired with the second terminal in the second site receives the another auxiliary device. flow.
  • the multiple auxiliary stream can be sent by using the PRE auxiliary stream channel corresponding to the PRE token and the auxiliary stream channel bound to the PRE auxiliary stream channel.
  • the participant in the site receiving the multiple auxiliary streams can simultaneously view the image of the multiple auxiliary stream; or, after acquiring the PRE token, multiple terminals of the site respectively send the auxiliary stream, which enables other sites to be sent and sent.
  • the terminal paired terminals of the auxiliary stream receive their respective auxiliary streams, so that the participants of other sites can see the images of the multiple auxiliary streams.
  • FIG. 1 is a schematic diagram of a multi-site display conference content image provided by the prior art
  • FIG. 2 is a flowchart of a multi-channel auxiliary flow control method according to an embodiment of the present invention
  • FIG. 3 is a flowchart of a method for transmitting multiple auxiliary streams by the same terminal according to an embodiment of the present invention
  • FIG. 4 is a flowchart of another method for sending multiple auxiliary streams by the same terminal according to an embodiment of the present invention
  • FIG. 6 is a flowchart of a method for transmitting multiple auxiliary streams by multiple terminals according to an embodiment of the present invention
  • FIG. 7 is a flowchart of another method for sending multiple auxiliary streams by multiple terminals according to an embodiment of the present invention
  • FIG. 7B is a flowchart of still another method for sending multiple auxiliary streams by multiple terminals according to an embodiment of the present invention.
  • FIG. 8 is a structural diagram of a terminal according to an embodiment of the present invention.
  • FIG. 9 is a network structure diagram provided by an embodiment of the present invention. detailed description
  • an embodiment of the present invention provides a multi-channel auxiliary flow control method, including:
  • the terminal application content (presentation, PRE) token of the first conference site 201.
  • the terminal of the first site uses the PRE auxiliary channel corresponding to the applied PRE token to the second
  • the terminal of the site sends a secondary stream, and uses the auxiliary stream channel bound to the PRE auxiliary channel to send other auxiliary streams to the terminal of the second site.
  • the auxiliary stream channel bound to the PRE auxiliary stream channel is the PREAnnex auxiliary stream channel extended by the application, or the auxiliary stream channel bound to the PRE auxiliary stream channel is the LIVE auxiliary stream channel.
  • the PRE auxiliary stream channel is a commonly used channel for transmitting the auxiliary stream, and the terminal applying for the PRE token can transmit the auxiliary stream by using the PRE auxiliary stream channel.
  • the PREAnnex auxiliary stream channel is an extended auxiliary stream channel of the present application, and the PREAnnex auxiliary stream channel follows the PRE auxiliary stream channel to transmit the auxiliary stream.
  • the PREAnnex auxiliary stream channel follows the PRE auxiliary stream channel to transmit the auxiliary stream.
  • the LIVE auxiliary stream channel in the prior art is used in the mainstream, and the mainstream may be the image of the participant in the conference. If the B site sends the mainstream to the site A, the site B will also send the LIVE auxiliary channel to the site A.
  • the LIVE auxiliary stream channel is bound to the PRE auxiliary stream channel corresponding to the PRE token, that is, the LIVE auxiliary stream channel is followed by the PRE auxiliary.
  • the secondary auxiliary stream channel is used to send the auxiliary stream to the terminal, and the secondary stream is sent to the terminal by using the LIVE auxiliary stream channel, that is, the same is sent to the same terminal of the same site by using the PRE auxiliary stream channel and the LIVE auxiliary stream channel.
  • Road auxiliary stream is used to send the auxiliary stream to the terminal, and the secondary stream is sent to the terminal by using the LIVE auxiliary stream channel, that is, the same is sent to the same terminal of the same site by using the PRE auxiliary stream channel and the LIVE auxiliary stream channel.
  • the terminal of the first site and the terminal of the second site support the use of the PRE auxiliary channel and the auxiliary stream channel bound to the PRE auxiliary channel, and the secondary circulation bound to the PRE auxiliary channel
  • the terminal of the first site sends a secondary stream to the terminal of the second site by using the PRE auxiliary channel, and sends the other channel to the terminal of the second site by using the auxiliary channel bound to the PRE auxiliary channel.
  • the terminal of the first site and the terminal of the second site support the use of the PRE auxiliary channel and the auxiliary content PRENnnex auxiliary channel bound to the PRE auxiliary channel, the PRE is used for circulation.
  • the channel sends a secondary stream to the terminal of the second site, and sends the other auxiliary stream to the terminal of the second site by using the PRENnnex auxiliary channel bound to the PRE auxiliary channel; or, when the terminal of the first site and the second site
  • the terminal supports the use of the PRE auxiliary stream channel and the active LIVE auxiliary stream channel bound to the PRE auxiliary stream channel, and uses the PRE auxiliary stream channel to send the auxiliary device to the terminal of the second site. And sending, by using the LIVE auxiliary stream channel bound to the PRE auxiliary stream channel, another auxiliary stream to the terminal of the second site.
  • the terminal of the first site may determine that the terminal of the first site and the terminal of the second site also support the use of the PRE according to a predetermined rule.
  • a PREONnex auxiliary stream channel bound to the auxiliary stream channel using the PRE auxiliary stream channel to send a secondary stream to the terminal of the second site, and using the PRENnnex auxiliary stream channel bound to the PRE auxiliary channel to the terminal of the second site
  • the other auxiliary stream is sent, where the predetermined rule may be that the terminal supports the PRE auxiliary stream channel, and the terminal supports the PRENnnex auxiliary stream channel.
  • the binding relationship between the PRE auxiliary stream channel and the LIVE auxiliary stream channel may be preset on the terminal of the site; or, by default, the PRE auxiliary stream channel corresponding to the PRE token and the multiple LIVE auxiliary stream channels have default Binding relationship, that is, as long as the PRE auxiliary stream channel corresponding to the PRE token is opened and used to transmit the auxiliary stream, each LIVE auxiliary stream channel is also used to transmit the auxiliary stream, and each LIVE auxiliary stream channel follows the PRE auxiliary stream channel.
  • the destination site of the PRE auxiliary channel is the same, or the binding relationship indication information is sent to the target site, and the binding relationship indication information indicates the LIVE auxiliary stream channel bound to the PRE auxiliary channel.
  • the binding relationship indication information indicates the LIVE auxiliary stream channel bound to the PRE auxiliary stream channel, so that the conference server receives the multiple auxiliary stream sent by the terminal. Then, the secondary auxiliary stream is sent to the other site except the first site by using the SELECT auxiliary stream channel and the LIVE auxiliary stream channel bound to the PRE auxiliary channel.
  • the terminal of the first site directly sends a secondary stream to the terminal of the second site by using the PRE auxiliary channel corresponding to the PRE token, and uses the secondary channel bound to the PRE auxiliary channel.
  • the channel directly sends the other auxiliary stream to the terminal of the second site; in the multi-point conference, the terminal of the first site sends a secondary stream to the conference server by using the PRE auxiliary channel corresponding to the PRE token,
  • the auxiliary stream channel bound to the PRE auxiliary channel sends the other auxiliary stream to the conference server, so that the conference server sends the auxiliary stream and other auxiliary streams to the terminals of the conference site other than the first site.
  • the conference server may be a multipoint control unit (MCU) integrated with signaling and media processing, and may also include two devices separated by control signaling and media processing.
  • MCU multipoint control unit
  • FIG. 3 is a schematic diagram of a secondary stream control method according to an embodiment of the present invention, in which a new auxiliary stream PREAnnex is extended, and a plurality of auxiliary streams are transmitted by using an extended auxiliary stream channel and a PRE auxiliary stream channel, which specifically includes :
  • Terminal A sends the capability set of terminal A to terminal B
  • terminal B sends the capability set of terminal B to terminal A.
  • the terminal A and the terminal B are respectively located in different conference sites, and the capability concentration carries the auxiliary channel type supported by the terminal, that is, the PRE (presentation) auxiliary stream channel and/or the PREAnnex auxiliary stream channel.
  • Terminal A applies for a PRE token.
  • the terminal A may send a token acquisition request to the terminal holding the token in the current conference, and obtain the token from the terminal holding the token in the current conference.
  • the terminal A opens the PRE auxiliary stream channel between the terminal A and the terminal B when it is determined that both the terminal A and the terminal B can transmit the auxiliary stream by using the PRE auxiliary stream channel.
  • Terminal A sends a secondary stream to terminal B by using the PRE channel.
  • the terminal A determines, according to the capability set of the terminal B and the capability set of the terminal A, that the terminal A and the terminal B can use the PRENnnex auxiliary bound to the PRE auxiliary channel.
  • the stream channel transmits the auxiliary stream, and opens the PRENnnex auxiliary stream channel between terminal A and terminal B.
  • Terminal A sends another auxiliary stream to terminal B by using the PREAnnex auxiliary stream channel.
  • the PREAnnex auxiliary stream channel can be closed.
  • the embodiment is described by taking a point-to-point conference as an example.
  • each terminal directly exchanges capability with the conference server, and the terminal A applies for a PRE token and opens the terminal.
  • a to the PRE auxiliary channel between the conference server and PRENAnnex After the auxiliary stream channel, the conference server determines the terminal that supports the PRE auxiliary stream channel and the PREAnnex auxiliary stream channel according to the capability set of the terminal of the other site, the conference server opens the conference server to the PRE auxiliary stream channel of the terminal in the other site, and the PRENAnn auxiliary circulation Then, the conference auxiliary server and the PREONex auxiliary stream channel between the terminals of the other sites are used to broadcast the two secondary streams received from the terminal A to the terminals of other conference sites in the conference.
  • the capability negotiation of the PREAnnex auxiliary stream channel may not be performed between the terminals, that is, the capability set in step 301 does not involve the PRENnnex auxiliary stream channel information, but the predetermined rule is used to determine whether the PREAnnex auxiliary stream channel can be opened.
  • the rule stipulates that the terminal supports the PRE auxiliary stream channel to support the PRENnnex auxiliary stream channel. As long as the peer end supports the use of the PRE auxiliary stream channel, the PREAnnex auxiliary stream channel can be opened.
  • the predetermined rule can also specify the use of the PREAnnex auxiliary stream channel. The format of the secondary stream, the protocol to be followed, and the port number of the PRENnnex secondary stream channel on the secondary stream receiving end.
  • the terminal A can send multiple auxiliary streams to the terminal B by using the PRE auxiliary channel corresponding to the PRE token and the PRENnnex auxiliary stream channel bound to the PRE auxiliary channel.
  • the participant at the site where the B terminal is located sees the image of the multiple auxiliary stream.
  • FIG. 4 is a schematic diagram of a secondary stream control method according to an embodiment of the present invention.
  • the method uses a PRE auxiliary stream channel and a LIVE auxiliary stream channel to send multiple auxiliary streams, which specifically includes:
  • Terminal A sends the capability set of terminal A to terminal B
  • terminal B sends the capability set of terminal B to terminal A.
  • the terminal A and the terminal B are respectively located in different conference sites, and the capability concentration carries the auxiliary stream channel type supported by the terminal, that is, the PRE auxiliary stream channel and/or the LIVE auxiliary stream channel.
  • Terminal A applies for a PRE token.
  • the terminal A opens the PRE auxiliary channel between the terminal A and the terminal B when it is determined that both the terminal B and the terminal A can utilize the PRE auxiliary stream channel.
  • Terminal A sends a secondary auxiliary stream to terminal B by using a PRE auxiliary stream channel.
  • terminal A needs to send another auxiliary stream, terminal A according to the capability set of terminal B and the capability set of terminal A, when it is determined that both terminal B and terminal A can use the LIVE auxiliary stream channel, Open one or more LIVE auxiliary stream channels between terminal A and terminal B.
  • the LIVE auxiliary stream channel in step 405 may be opened before the PRE auxiliary stream channel is opened, or may be opened after the PRE auxiliary stream channel is turned on, without affecting the implementation of the present invention.
  • the terminal A sends the binding relationship indication information to the terminal B, where the binding relationship indication information indicates the LIVE auxiliary stream channel bound to the PRE auxiliary stream channel, that is, which LIVE auxiliary stream channel and the PRE auxiliary circulation are indicated. Road binding.
  • the binding relationship indication information may be sent by using private signaling.
  • the step may be that the binding relationship indication information is sent when another or several auxiliary streams need to be sent by using the opened auxiliary stream channel.
  • the terminal A sends another auxiliary stream to the terminal B by using the LIVE auxiliary stream channel bound to the PRE auxiliary stream channel.
  • Step 406 is an optional step, that is, the binding relationship indication information may not be sent to the terminal B, and all the LIVE auxiliary stream channels may be considered to be bound to the PRE auxiliary stream channel.
  • the embodiment is described by taking a point-to-point conference as an example.
  • the difference between the foregoing is that each terminal directly exchanges capability with the conference server, and the terminal A applies to the PRE token to open the terminal A.
  • the conference server determines the terminals supporting the PRE auxiliary stream channel and the LIVE auxiliary stream channel according to the capability set of the terminal of the other site, and then opens the conference server to the other site terminal.
  • the PRE auxiliary stream channel and the LIVE auxiliary stream channel and then use the PRE auxiliary stream channel and the LIVE auxiliary stream channel between the conference server and the other site terminal to broadcast the two auxiliary streams received from the terminal A to the terminal in the conference.
  • the terminal A can send multiple auxiliary streams to the terminal B by using the PRE auxiliary channel corresponding to the PRE token and the LIVE auxiliary stream channel bound to the PRE auxiliary channel.
  • the participant at the site where the terminal B is located sees the image of the multiple auxiliary stream.
  • an embodiment of the present invention provides a multi-channel auxiliary flow control method, in which a secondary stream is sent by different terminals in the same site, and the method specifically includes:
  • the terminal that is paired with the terminal that sends the auxiliary stream in the other site of the conference receives the respective auxiliary. Stream.
  • the first terminal in the first site in step 501 sends a secondary stream through the first auxiliary channel after acquiring the PRE token in the first site.
  • the terminal that is paired with the first terminal in the other site receives the one-way auxiliary stream, where the first auxiliary stream channel is the PRE auxiliary stream channel, and the second terminal in the first site acquires the PRE token in the first site.
  • the second auxiliary stream is used to send another auxiliary stream, so that the terminal paired with the second terminal in the other site receives the other auxiliary stream, where the second auxiliary stream channel is a PRE auxiliary stream channel, and LIVE
  • the second auxiliary flow channel is followed by the first auxiliary flow channel, and FIG. 2, FIG. 3,
  • the first auxiliary stream channel is used to send the auxiliary stream
  • the second auxiliary is utilized. Which site does the stream channel send to? Sending another auxiliary stream, that is, using the first auxiliary stream channel and the second auxiliary stream channel to send multiple auxiliary streams to the same site.
  • the pairing relationship of the terminals in different sites may be pre-defined. For example, a three-screen site and a single-screen site are involved in the conference, and one terminal in the three-screen site is paired with the terminal in the single-screen site. In this case, Only send a secondary stream to a single-screen site.
  • the method may further include: after acquiring the PRE token, the first terminal sends a notification message to the second terminal, where the notification message indicates that the auxiliary stream is sent by using the auxiliary stream channel. After receiving the notification message, the second terminal sends a second auxiliary stream by using the second auxiliary stream channel.
  • multiple terminals in the same site send the secondary stream by using the respective auxiliary stream channels after each application obtains the PRE token, and the PRE tokens that each terminal applies for are applicable to the terminal and other sites.
  • the other site is a site other than the site where the terminal is located.
  • the first terminal sends a secondary stream by using the first auxiliary stream channel, where the first PRE token is applicable to the first terminal and other sites.
  • the second terminal sends another secondary stream by using the second auxiliary stream channel after applying for the second PRE token; wherein the second PRE token is applicable to the first The PRE token of the terminal that is paired with the second terminal in the second terminal and other sites.
  • the method further includes: applying, by the plurality of terminals, a PRE token to the conference server, respectively, where the conference server determines that multiple terminals applying for the PRE token belong to the same venue, A PRE token corresponding to the terminal paired with the corresponding terminal in the corresponding terminal and other sites is separately sent to each terminal applying for the PRE token.
  • multiple terminals in the same site respectively send the secondary stream, so that the terminals in the other site that are paired with the terminal that sends the auxiliary stream can receive the auxiliary stream, so that other sites can be used. Participants can see images of multiple auxiliary streams.
  • FIG. 6 is a schematic diagram of a multi-channel auxiliary flow control method according to an embodiment of the present invention.
  • the method is applicable to a multi-terminal conference.
  • the terminal of each site and the corresponding terminal of the opposite site are paired with each other.
  • the call between the terminals is independent, and the PRE token is also independent. Therefore, different terminals of one site apply for the PRE tokens to the corresponding terminals of the peer site, and do not affect each other.
  • the respective auxiliary channel is opened.
  • the method specifically includes:
  • the terminal in the site A sends the capability set of the terminal in the site A to the terminal in the site B and the terminal in the site A.
  • the terminal in the site B sends the terminal in the site B to the terminal in the site A and the terminal in the site B.
  • Ability set
  • the terminal A1 in the site A is paired with the terminal B1 in the site B, and the terminal A2 in the site A is paired with the terminal B2 in the site B.
  • the terminal A1 in the site A requests the first PRE token from the terminal B1 in the site B.
  • the terminal A1 synchronizes the capability set of the terminal B1 with the capability set of the terminal A1.
  • the PRE auxiliary stream channel between the terminal A1 and the terminal B1 is opened.
  • the terminal A1 sends an auxiliary stream to the terminal B1 by using the opened auxiliary stream channel.
  • the terminal A2 in the site A requests the second PRE token from the terminal B2 in the site B.
  • the terminal A2 synchronizes the capability set of the terminal B2 with the capability set of the terminal A2.
  • the PRE auxiliary stream channel between the terminal A2 and the terminal B2 is opened.
  • the terminal A2 sends another auxiliary stream to the terminal B2 by using the opened auxiliary stream channel.
  • the terminal A1 can release the PRE token applied by the terminal A1. If the terminal A2 does not need to send the auxiliary stream, the terminal A2 can apply for the terminal A2. The PRE token to.
  • each terminal directly exchanges capability with the conference server, the terminal A1 applies for a token, the terminal A2 applies for a token, and the conference server determines the application token. If the terminal belongs to the same site, if yes, the terminal A1 is granted the first PRE token, and the terminal A2 is granted the second PRE token. After the terminal A1 obtains the first PRE token, the terminal A1 opens the PRE between the conference server and the conference server.
  • the conference server After the conference server determines the terminal that supports the PRE auxiliary stream channel and is paired with the terminal A1 according to the capability set of the terminal of the other site, the conference server opens the conference server to the determined pairing with the terminal A1 and supports the PRE auxiliary stream channel.
  • the PRE auxiliary channel between the terminals, and then the received secondary stream from the terminal A1 is sent to the corresponding terminal of the other site (that is, the terminal supporting the PRE auxiliary stream channel and paired with the terminal A1); the terminal A2 obtains the second PRE After the token, open the PRE auxiliary channel between the terminal A2 and the conference server, and the conference service
  • the conference server After determining the terminal supporting the PRE auxiliary stream channel and pairing with the terminal A2 according to the capability set of the terminal of the other site, the conference server opens the conference server to the determined PRE supplement between the terminal paired with the terminal A2 and supporting the PRE auxiliary stream channel.
  • the stream channel which subsequently sends the received secondary stream from the terminal A2 to the corresponding terminal of the other site (that is
  • the terminal of each site in the terminal is paired with the corresponding terminal of the peer site, and the call between the different terminals is independent, and the PRE token is also independent.
  • the different terminals of one site apply to the corresponding terminals of the peer site.
  • the respective auxiliary stream channels are opened, and the auxiliary stream is transmitted, so that the participants in other sites can see the images of the multiple auxiliary streams.
  • FIG. 7A shows a multi-channel auxiliary flow control method according to an embodiment of the present invention.
  • a terminal of a multi-screen site acquires a PRE token, and multiple terminals controlling the site send multiple auxiliary streams.
  • the method specifically includes:
  • the terminal in the site A sends the capability set of the terminal in the site A to the terminal in the site B and the terminal in the site A.
  • the terminal in the site B sends the terminal in the site B to the terminal in the site A and the terminal in the site B.
  • Ability set
  • the terminal A1 in the site A is paired with the terminal B1 in the site B, and the terminal A2 in the site A is paired with the terminal B2 in the site B. 702 A.
  • the terminal A1 in the site A applies for the PRE token from the terminal B1 in the site B. 703A.
  • the terminal A1 sends a notification message to the terminal A2, where the notification message is used to instruct the terminal A2 to send the auxiliary stream by using the auxiliary stream channel.
  • terminal A1 is based on the capability set of terminal B1 and the capability set of terminal A1. When it is determined that both terminal B1 and terminal A1 support the use of PRE secondary circulation, terminal A1 opens the PRE auxiliary stream channel between terminal A1 and terminal B1.
  • terminal A2 is based on the capability set of the terminal B2 and the capability set of the terminal A2.
  • the terminal A2 receives the notification message sent by the terminal A1. Open the PRE auxiliary stream channel or the LIVE auxiliary stream channel between the terminal A2 and the terminal B2.
  • the terminal A1 sends an auxiliary stream to the terminal B1 by using the opened auxiliary stream channel.
  • Terminal A2 sends another auxiliary stream to terminal B2 by using the opened auxiliary stream channel.
  • steps 703A and 704A are not in the order of execution, and steps 706A and 707A are not in the order of execution.
  • each terminal directly exchanges capability with the conference server.
  • the terminal A1 After the terminal A1 obtains the PRE token, the terminal A1 requests to open the terminal A1 to the conference server.
  • a PRE auxiliary channel the terminal A2 requests to open the PRE auxiliary channel or the LIVE auxiliary stream channel between the terminal A2 and the conference server, and the conference server determines whether the terminal requesting to open the auxiliary stream channel belongs to the same site, and if so, allows the terminal A1.
  • Terminal A2 opens the corresponding auxiliary stream channel.
  • the conference server After the conference server determines the terminal that supports the PRE auxiliary stream channel and is paired with the terminal A1 according to the capability set of the terminal of the other site, the conference server opens the conference server to the determined terminal that is paired with the terminal A1 and supports the PRE auxiliary stream channel.
  • the PRE auxiliary stream channel which subsequently sends the received secondary stream from the terminal A1 to the corresponding terminal of the other site (that is, the terminal supporting the PRE auxiliary stream channel and paired with the terminal A1); the conference server is in the capability set of the terminal according to other sites.
  • the conference server After determining the terminal that supports the PRE auxiliary stream channel or a LIVE auxiliary stream channel and is paired with the terminal A2, the conference server opens the conference auxiliary server to the determined PRE auxiliary stream channel or a LIVE auxiliary stream channel between the terminal paired with the terminal A2. Subsequently receiving the auxiliary stream from the terminal A2 to the corresponding terminal of the other site (that is, supporting the PRE auxiliary stream channel and pairing with the terminal A2) Terminal) send.
  • the terminal that obtains the PRE token in the site A can be regarded as the primary terminal in the site A.
  • the primary terminal in the site refers to being able to notify other terminals (such as the terminal A2) to use the secondary channel to send the secondary device.
  • the terminal of the flow optionally, in the multi-point conference scenario, the conference server determines whether to allow the terminal A2 to open the auxiliary stream channel, and can perform the capability set exchange between the terminal A2 and the conference server in advance, that is, the capability is performed on the terminal A2 and the conference server. When the set exchange is performed, the capability set sent by the conference server to the terminal does not carry the auxiliary stream channel type, so that the terminal A2 does not open the auxiliary stream channel.
  • the terminal A1 after applying for the PRE token, opens the auxiliary stream channel of the terminal A1, and notifies the terminal A2 to open the auxiliary stream to transmit the auxiliary stream, so that both the terminal A1 and the terminal A2 in the same site can send the auxiliary stream.
  • the terminal that is paired with the terminal A1 in the other site can receive the auxiliary stream sent by the terminal A1.
  • the terminal that is paired with the terminal A2 in the other site can receive the auxiliary stream sent by the terminal A2, so that the participants in other sites can see more.
  • FIG. 7B shows another method for controlling the multiple-channel auxiliary stream according to the embodiment of the present invention.
  • the difference between the method and the embodiment shown in FIG. 7A is as follows: the master terminal in the local site and the master terminal in the peer site.
  • the capacity set is exchanged.
  • the capability set carries the capability of multiple terminals in the site.
  • the multiple terminals in the local site send the auxiliary stream to multiple terminals in the peer site.
  • the method includes:
  • the terminal A1 in the site A sends the capability set of the site A to the terminal B1 in the site B.
  • the terminal B1 in the site B sends the capability set of the site B to the terminal A1 in the site A.
  • the terminal A1 and the terminal A2 are bound, and it is assumed that the terminal A1 is the master terminal in the site A; the terminal B1 is bound to the terminal B2, and the terminal B1 is the master terminal in the site B.
  • the main terminal of the site in the embodiment is a terminal that performs capability negotiation on the site and the other sites in the conference, and can open multiple auxiliary channel, and the master terminal knows the type of the auxiliary channel supported by each terminal of the local site.
  • the capability set of the site in this step indicates which auxiliary channel types are supported by the site, such as the PRE auxiliary channel, the LIVE auxiliary channel, and/or the PREAnnex auxiliary channel.
  • Terminal A1 in the conference site A1 applies for the PRE token from the terminal B1 in the conference site B.
  • the terminal A1 in the conference site A is based on the capabilities of the terminal A1 and the terminal B1, when determining the terminal When both the Al and the terminal B1 support the use of the PRE auxiliary stream channel, the terminal A1 opens the PRE auxiliary stream channel.
  • the terminal A1 in the site A is based on the auxiliary channel type supported by the terminal A2 and the capability set of the site B.
  • the terminals of the terminal A2 and the site B are determined to support the use of the PRENnnex auxiliary channel or the terminals of the terminal A2 and the site B, the LIVE is supported.
  • the auxiliary stream channel the auxiliary channel of the terminal A2 and the site B that is determined to be supported is opened, that is, the PREAnnex auxiliary stream channel or the LIVE auxiliary stream channel.
  • the terminal A2 supports the use of the LIVE auxiliary stream channel
  • the capability of the site B includes the LIVE auxiliary stream channel type.
  • the terminal A1 sends a request for opening the LIVE auxiliary stream channel to the terminal B1, assuming the terminal B2 supports the use of the LIVE auxiliary stream channel, and the terminal B1 sends a response message to the terminal A1.
  • the message carries the address of the auxiliary stream corresponding to the LIVE auxiliary stream channel as the address of the terminal B2, and opens the auxiliary stream channel between the terminal A2 and the terminal B2.
  • the terminal A1 in the site A sends a notification message to the terminal A2, informing the terminal A2 to send another auxiliary stream to the terminal B2 by using the opened PREAnnex auxiliary stream channel or the LIVE auxiliary stream channel.
  • Terminal A1 in site A sends a secondary stream to terminal B1 in site B.
  • Terminal A2 in site A sends another auxiliary stream to terminal B2 in site B.
  • This embodiment is described by taking a point-to-point conference as an example.
  • each terminal directly exchanges capability with the conference server.
  • the terminal A1 applies for the PRE token
  • the terminal A1 opens the two auxiliary stream channels.
  • the terminal A1 and the terminal A2 respectively send the auxiliary stream, and after receiving the auxiliary stream sent by the terminal A1, the conference server sends the auxiliary stream to the terminal paired with the terminal A1 in the other site by using the corresponding auxiliary stream channel;
  • the auxiliary stream the auxiliary stream is sent to the terminal paired with the terminal A2 in the other site by using the corresponding auxiliary stream channel.
  • the terminal A1 after applying for the PRE token, opens a plurality of auxiliary stream channels, and notifies the terminal A2 to transmit the auxiliary stream, so that both the terminal A1 and the terminal A2 in the same site can send the auxiliary stream, so that the other sites can
  • the terminal paired with the terminal A1 can receive the auxiliary stream sent by the terminal A1, and the terminal paired with the terminal A2 in the other site can receive the auxiliary stream sent by the terminal A2, so that the participants in other sites can see the image of the multiple auxiliary stream. It is.
  • the foregoing embodiments are described by using H.323 as an example.
  • the technical solutions provided by the embodiments of the present invention are also applicable to the SIP protocol, and the difference from the H.323 protocol is: using the SIP protocol.
  • the terminals of different sites do not transmit their own capability sets, that is, there is no transmission process of a separate capability set.
  • the corresponding auxiliary stream channel may be requested to be opened in the call flow initiated by the terminal, specifically using the SIP protocol.
  • the sent call message includes the following:
  • m video 52886 RTP/AVP 31 (Definition of auxiliary stream channel 1)
  • m video 53334 RTP/AVP 31 (Definition of auxiliary stream channel 2)
  • m video 54132 RTP/AVP 31 (Definition of Mainstream Channels)
  • a content : main (type definition of the main channel)
  • the call message sent by using the SIP protocol may also include an alt stream channel, which is equivalent to the LIVE auxiliary stream channel in H.239.
  • an embodiment of the present invention provides a terminal, which is located in a first conference site, and includes: a token application unit 801, configured to apply for a PRE token;
  • the auxiliary stream sending unit 802 is configured to send, by using the PRE auxiliary stream channel corresponding to the PRE token, a secondary auxiliary stream to the terminal of the second site after the application for obtaining the PRE token, by using the secondary auxiliary stream channel.
  • the auxiliary stream channel sends other auxiliary streams to the terminal of the second site.
  • the terminal is a terminal in the first site; the auxiliary stream channel bound to the PRE auxiliary channel is: an extended PRENexex auxiliary stream channel, or a LIVE auxiliary stream channel.
  • the auxiliary stream is sent
  • the sending unit 802 is specifically configured to send, by using the PRE auxiliary stream channel corresponding to the PRE token, a secondary auxiliary stream to the terminal of the second site, and directly use the auxiliary stream channel bound to the PRE auxiliary channel in the point-to-point conference.
  • Sending another auxiliary stream to the terminal of the second site; or, the auxiliary stream sending unit is configured to send a secondary stream to the conference server by using the PRE auxiliary channel corresponding to the PRE token in the multipoint conference.
  • the auxiliary stream sending unit 802 is specifically configured to: when the application for the PRE token is applied, the terminal of the first site and the terminal of the second site support the use of the PRE auxiliary channel and the secondary channel bound to the PRE auxiliary channel. And transmitting, by the PRE auxiliary channel, a secondary stream to the terminal of the second site, and using the auxiliary channel bound to the PRE auxiliary channel to send another auxiliary stream to the terminal of the second site; or When both the terminal of the conference site and the terminal of the second site support the use of the PRE auxiliary channel, the terminal of the first site and the terminal of the second site are also determined to support the use of the PRENnnex auxiliary channel bound to the PRE auxiliary channel according to a predetermined rule. And using the PRE auxiliary channel to send a secondary stream to the terminal of the second site, and sending the other auxiliary stream to the terminal of the second site by using the PRENnnex auxiliary channel bound to the PRE auxiliary channel.
  • the terminal further includes: a binding relationship sending unit 803, configured to send binding relationship indication information to the terminal of the second site, where the binding relationship indication information Instructing the LIVE auxiliary stream channel to be bound to the PRE auxiliary stream channel; or sending binding relationship indication information to the conference server, where the binding relationship indication information indicates the LIVE auxiliary stream channel bound to the PRE auxiliary stream channel
  • the conference server is configured to notify the LIVE auxiliary stream channel bound to the PRE auxiliary stream channel by the terminal of the conference site other than the first site in the conference.
  • the terminal can use the PRE auxiliary channel corresponding to the PRE token and the PREANNEx or LIVE auxiliary stream channel bound to the PRE auxiliary channel to send multiple auxiliary streams, which can enable receiving.
  • the participants in the conference site of the multi-channel auxiliary stream simultaneously see the images of the multiple auxiliary streams.
  • the embodiment of the invention provides a network system, which includes: a first terminal 901 and a second terminal 902, where the first terminal and the second terminal are located in the first conference site,
  • the first terminal is configured to send a secondary stream by using the first auxiliary stream channel after the first site is used to obtain the PRE token, so that the terminal paired with the first terminal in the second site receives the one auxiliary stream;
  • the second terminal is configured to send another auxiliary stream by using the second auxiliary stream channel after the first site applies for the PRE token, so that the terminal paired with the second terminal in the second site receives the another auxiliary device. flow.
  • the first terminal is further configured to send a notification message to the second terminal after the application obtains the PRE token, where the notification message indicates that the auxiliary stream is sent by using the auxiliary stream channel; After receiving the notification message, the second auxiliary stream is used to send another auxiliary stream.
  • the terminal A1 notifies the terminal A2 to open the auxiliary stream to transmit the auxiliary stream, so that both the terminal A1 and the terminal A2 in the same site can send the auxiliary stream, so that the terminal in the other site that is paired with the terminal A1 can receive the terminal A1.
  • the auxiliary stream, the terminal paired with the terminal A2 in the other site can receive the auxiliary stream sent by the terminal A2, so that the participants in the other site can see the image of the multiple auxiliary stream.
  • the first terminal is specifically configured to send, by using the first auxiliary stream channel, a secondary stream after the application obtains the first PRE token, where the first PRE token is applicable to the a first terminal and a PRE token of a terminal that is paired with the first terminal in the other site;
  • the second terminal is specifically configured to send another auxiliary stream by using the second auxiliary stream channel after applying for the second PRE token;
  • the second PRE token is a PRE token applicable to the terminal that is paired with the second terminal in the second terminal and other sites.
  • the network system further includes: a conference server 903, configured to determine whether the terminal that applies for the PRE token belongs to the same site, and if yes, agrees to grant the first terminal the first PRE token, the second terminal, and the second PRE token.
  • a conference server 903 configured to determine whether the terminal that applies for the PRE token belongs to the same site, and if yes, agrees to grant the first terminal the first PRE token, the second terminal, and the second PRE token.
  • the terminal A1 applies for the first PRE token and uses the PRE auxiliary stream to send the auxiliary stream, so that the terminal paired with the terminal A1 in the other site receives the auxiliary stream; the terminal A2 applies for the second PRE token and uses the PRE.
  • the auxiliary stream transmits the auxiliary stream, so that the terminal that is paired with the terminal A2 in the other site receives the auxiliary stream, so that the participants in other sites can see the image of the multiple auxiliary stream.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • General Engineering & Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • General Business, Economics & Management (AREA)
  • Telephonic Communication Services (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Data Exchanges In Wide-Area Networks (AREA)

Description

多 流控制方法、 装置及网络系统 本申请要求于 2010 年 12 月 7 日提交中国专利局、 申请号为 201010577099.3、 发明名称为"多路辅流控制方法、 装置及网络系统"的中国 专利申请的优先权， 其全部内容通过引用结合在本申请中。 技术领域
本发明涉及通信技术领域， 特别涉及一种多路辅流控制方法、 装置及网 络系统。 背景技术
视讯会议业务是一种多媒体通信业务， 其利用视讯终端和通信网络召开 会议， 可以同时实现两地或多个地点之间的图像、 语音、 数据的交互。 会场 中的终端将本地摄像机拍摄的图像信号、 与会者区域中的麦克风拾取的与会 者的声音信号进行压缩编码， 经过传输网络传至远方会场。 同时， 通过传输 网络接收远方会场传来的数字信号， 对数字信号进行解码得到远方会场与会 者的图像和信号。 随着视频会议的发展， 会场已经由以前的一个摄像机、 一 个显示器、 一个与会者区域发展到多个摄像机、 多个显示器、 多个与会者区 域， 这些在同一会场的多个摄像机、 多个显示器、 多个与会者区域通过物理 的或者逻辑的关系进行关联。
在视频会议中， 因为有时候需要针对会议内容进行讨论， 所以需要在会 场的显示器上显示会议内容图像， 如图 1所示， 会场 A将会议内容图像通过 辅流通道发送给远端会场 B和 C的终端， 会场 B和会场 C的终端收到后， 在 本地的显示器显示该会议内容图像。 现有技术提供一种基于令牌的辅流发送 方式， 具体的， 一个会议只有一个辅流令牌， 得到令牌的会场发送辅流， 各 个会场的与会者都观看有令牌的会场的辅流图像。
现有技术具有如下缺点：
一些视频会议中， 用户可能要求一边看实物投影、 一边看会议内容图像， 这样， 就需要两路辅流， 一路传输实物投影图像、 另一路传输会议内容图像， 但是现有技术中一个会议中只有一个辅流令牌， 而且该辅流令牌只能和一路 辅流进行绑定， 所以无法使会场中的与会者同时看到实物投影和会议内容图 像。 发明内容
本发明实施例提供一种多路辅流控制方法、 装置及网络系统， 能够使会 场中的与会者同时看到多路辅流的图像。
有鉴于此， 本发明实施例提供：
一种多路辅流控制方法， 包括：
第一会场的终端申请内容 PRE令牌；
在申请得到 PRE令牌后， 第一会场的终端利用所述 PRE令牌对应的 PRE辅 流通道向第二会场的终端发送一路辅流，利用与所述 PRE辅流通道绑定的辅流 通道向所述第二会场的终端发送其他辅流。
一种多路辅流控制方法， 包括：
同一会场的多个终端在所述会场申请得到 PRE令牌之后，利用各自的辅流 通道发送辅流， 使会议的其他会场中与发送辅流的终端配对的终端接收到各 自的辅流。
一种终端， 位于第一会场中， 包括：
令牌申请单元， 用于申请 PRE令牌；
辅流发送单元， 用于在申请得到 PRE令牌后， 利用所述 PRE令牌对应的 PRE辅流通道向第二会场的终端发送一路辅流 ,利用与所述 PRE辅流通道绑定 的辅流通道向所述第二会场的终端发送其他辅流。
一种网络系统， 包括： 第一终端和第二终端， 所述第一终端和第二终端 位于第一会场中，
第一终端，用于在第一会场申请得到 PRE令牌后， 利用第一辅流通道发送 一路辅流， 使第二会场中与所述第一终端配对的终端接收到所述一路辅流； 第二终端，用于在第一会场申请得到 PRE令牌后， 利用第二辅流通道发送 另一路辅流， 使第二会场中与所述第二终端配对的终端接收到所述另一路辅 流。 本发明实施例中第一会场获取内容（ presentation , PRE )令牌后， 能够利 用 PRE令牌对应的 PRE辅流通道和与所述 PRE辅流通道绑定的辅流通道发 送多路辅流， 能够使接收多路辅流的会场中的与会者同时看到多路辅流的图 像； 或者， 获取到 PRE令牌后， 该会场的多个终端分别发送辅流， 能够使其 他会场中与发送辅流的终端配对的终端接收到各自的辅流， 以便其他会场的 与会者能看到多路辅流的图像。 附图说明
为了更清楚地说明本发明实施例的技术方案， 下面将对实施例中所需要 使用的附图作筒单地介绍， 显而易见地， 下面描述中的附图仅仅是本发明的 一些实施例， 对于本领域普通技术人员来讲， 在不付出创造性劳动的前提下， 还可以根据这些附图获得其他的附图。
图 1是现有技术提供的多会场显示会议内容图像的示意图；
图 2是本发明实施例提供的一种多路辅流控制方法流程图；
图 3是本发明实施例提供的一种同一终端发送多路辅流的方法流程图； 图 4是本发明实施例提供的另一种同一终端发送多路辅流的方法流程图； 图 5是本发明实施例提供的另一种多路辅流控制方法流程图；
图 6是本发明实施例提供的一种多个终端发送多路辅流的方法流程图； 图 7 A是本发明实施例提供的另一种多个终端发送多路辅流的方法流程 图；
图 7B是本发明实施例提供的又一种多个终端发送多路辅流的方法流程 图；
图 8是本发明实施例提供的终端结构图；
图 9是本发明实施例提供的网络结构图。 具体实施方式
参阅图 2, 本发明实施例提供一种多路辅流控制方法， 其包括：
201、 第一会场的终端申请内容 ( presentation, PRE )令牌。
202、 第一会场的终端利用申请到的 PRE令牌对应的 PRE辅流通道向第二 会场的终端发送一路辅流，利用与所述 PRE辅流通道绑定的辅流通道向第二会 场的终端发送其他辅流。
其中， 与所述 PRE辅流通道绑定的辅流通道为本申请扩展的 PREAnnex辅 流通道， 或者， 与所述 PRE辅流通道绑定的辅流通道为 LIVE辅流通道。
其中， PRE辅流通道是一种常用的传输辅流的通道， 申请到 PRE令牌的终 端就可以利用 PRE辅流通道传输辅流。
其中， PREAnnex辅流通道是本申请扩展的辅流通道， PREAnnex辅流通 道跟随 PRE辅流通道传输辅流， 在本发明实施例中和图 3、 4所示实施例中， 利 用 PRE辅流通道向哪个终端发送辅流， 就利用 PREAnnex辅流通道向哪个终端 发送辅流， 即利用 PRE辅流通道和 PREAnnex辅流通道向同一个终端发送多路 辅流
其中， 现有技术中的 LIVE辅流通道是跟随主流使用的， 主流可以是会议 中与会者的图像， 假定 B会场向 A会场发送主流， 则 B会场也会利用 LIVE辅流 通道向 A会场发送辅流； 而在本发明实施例中和图 3、 4所示实施例中， LIVE 辅流通道是与 PRE令牌对应的 PRE辅流通道绑定的， 即该 LIVE辅流通道是跟 随 PRE辅流通道的， 利用 PRE辅流通道向哪个终端发送辅流， 就利用该 LIVE 辅流通道向哪个终端发送辅流， 即利用 PRE辅流通道和 LIVE辅流通道向同一 个会场的同一终端发送多路辅流。
具体的，当第一会场的终端和第二会场的终端都支持使用 PRE辅流通道和 与所述 PRE辅流通道绑定的辅流通道，且与所述 PRE辅流通道绑定的辅流通道 类型相同时，第一会场的终端利用所述 PRE辅流通道向第二会场的终端发送一 路辅流，利用与所述 PRE辅流通道绑定的辅流通道向第二会场的终端发送其他 辅流； 具体的， 当第一会场的终端和第二会场的终端都支持使用 PRE辅流通道 和与所述 PRE辅流通道绑定的辅助内容 PREAnnex辅流通道时， 利用所述 PRE 辅流通道向第二会场的终端发送一路辅流， 利用与所述 PRE辅流通道绑定的 PREAnnex辅流通道向第二会场的终端发送其他辅流； 或者， 当第一会场的终 端和第二会场的终端都支持使用 PRE辅流通道和与所述 PRE辅流通道绑定的 活动 LIVE辅流通道时， 利用所述 PRE辅流通道向第二会场的终端发送一路辅 流， 利用与所述 PRE辅流通道绑定的 LIVE辅流通道向第二会场的终端发送其 他辅流。
或者， 当第一会场的终端和第二会场的终端都支持使用 PRE辅流通道时， 第一会场的终端可以根据预定的规则确定第一会场的终端和第二会场的终端 也支持使用与 PRE辅流通道绑定的 PREAnnex辅流通道， 利用所述 PRE辅流通 道向第二会场的终端发送一路辅流， 利用与所述 PRE辅流通道绑定的 PREAnnex辅流通道向第二会场的终端发送其他辅流， 其中， 预定的规则可以 是规定终端支持 PRE辅流通道则该终端支持 PREAnnex辅流通道。
其中， 还可以在会场的终端上预置 PRE辅流通道与 LIVE辅流通道的绑定 关系； 或者， 默认所述 PRE令牌对应的 PRE辅流通道与多条 LIVE辅流通道具 有缺省的绑定关系， 即只要所述 PRE令牌对应的 PRE辅流通道被打开且用于传 送辅流， 则各 LIVE辅流通道也用于传送辅流， 且各 LIVE辅流通道跟随 PRE辅 流通道， 与 PRE辅流通道的目的会场一致， 或者， 在该步骤之前， 向目标会场 发送绑定关系指示信息，所述绑定关系指示信息指示与所述 PRE辅流通道绑定 的 LIVE辅流通道； 或者， 向会议服务器发送绑定关系指示信息， 所述绑定关 系指示信息指示与所述 PRE辅流通道绑定的 LIVE辅流通道， 使会议服务器接 收到所述终端发送的多路辅流之后，利用所述 PRE辅流通道和与所述 PRE辅流 通道绑定的 LIVE辅流通道向除第一会场以外的其他会场发送多路辅流。
具体的，在点对点会议中，第一会场的终端利用所述 PRE令牌对应的 PRE 辅流通道直接向第二会场的终端发送一路辅流， 利用与所述 PRE辅流通道绑 定的辅流通道直接向所述第二会场的终端发送其他辅流； 在多点会议中， 第 一会场的终端利用所述 PRE令牌对应的 PRE辅流通道向会议服务器发送一路 辅流， 利用与所述 PRE辅流通道绑定的辅流通道向所述会议服务器发送其他 辅流， 使所述会议服务器分别向会议中除第一会场以外的其他会场的终端发 送所述一路辅流和其他辅流。 其中， 会议服务器可以是信令和媒体处理集成 一体的多点控制单元（ Multipoint Control Unit, MCU ), 也可以包括控制信令 和媒体处理分开的两个设备。
本发明实施例中第一会场获取 PRE令牌后， 能够利用 PRE令牌对应的 PRE辅流通道和与所述 PRE辅流通道绑定的辅流通道向第二会场的终端发送 多路辅流， 能够使第二会场的与会者同时看到多路辅流的图像。 图 3 示出了本发明实施例提供的一种辅流控制方法， 该方法中扩展了一 个新的辅流 PREAnnex, 利用扩展的辅流通道和 PRE辅流通道发送多路辅流， 其具体包括：
301、 终端 A向终端 B发送终端 A的能力集， 终端 B向终端 A发送终端 B的能力集。
其中， 终端 A和终端 B分别位于不同的会场中， 所述能力集中携带终端 支持使用的辅流通道类型， 即 PRE ( presentation )辅流通道和 /或 PREAnnex 辅流通道。
302、 终端 A申请到 PRE令牌。
具体的， 终端 A可以向当前会议中持有令牌的终端发送令牌获取请求， 从当前会议中持有令牌的终端获取到令牌。
303、 终端 A根据终端 B的能力集和终端 A的能力集， 当确定终端 A和 终端 B都能够使用 PRE辅流通道传输辅流时， 打开终端 A与终端 B之间的 PRE辅流通道。
304、 终端 A利用 PRE通道向终端 B发送一路辅流。
305、 如果终端 A需要发送另一路辅流， 则终端 A根据终端 B的能力集 和终端 A的能力集， 当确定终端 A和终端 B能够使用与所述 PRE辅流通道 所绑定的 PREAnnex 辅流通道传输辅流， 打开终端 A 与终端 B 之间的 PREAnnex辅流通道。
306、 终端 A利用 PREAnnex辅流通道向终端 B发送另一路辅流。
后续， 如果终端 A不需要发送另一路辅流了， 则可以关闭 PREAnnex辅 流通道。
需要说明的是， 该实施例以点对点会议为例进行描述的， 对于多点会议， 与上述不同之处在于， 各个终端直接和会议服务器进行能力集交换， 终端 A 申请到 PRE令牌，打开终端 A到会议服务器之间的 PRE辅流通道和 PREAnnex 辅流通道之后， 会议服务器在根据其他会场的终端的能力集确定支持 PRE辅 流通道和 PREAnnex辅流通道的终端后， 会议服务器打开会议服务器到其他 会场中终端的 PRE辅流通道和 PREAnnex辅流通道， 然后利用会议服务器到 其他会场各终端间的 PRE辅流通道和 PREAnnex辅流通道将从终端 A接收的 两路辅流广播给会议中其他会场的终端。
需要说明的是， 终端间可以不进行是否支持 PREAnnex辅流通道的能力 协商， 即在步骤 301的能力集中不涉及 PREAnnex辅流通道信息， 而是按照 预定的规则确定是否能打开 PREAnnex辅流通道，比如规则规定终端支持 PRE 辅流通道则表示支持 PREAnnex辅流通道， 则只要对端支持使用 PRE辅流通 道就可以打开 PREAnnex辅流通道了， 具体的， 预定的规则还可以规定利用 PREAnnex辅流通道发送辅流的格式、所遵从的协议、辅流接收端上 PREAnnex 辅流通道的端口号等信息。
本发明实施例中终端 A获取 PRE令牌后，能够利用 PRE令牌对应的 PRE 辅流通道和与所述 PRE辅流通道绑定的 PREAnnex辅流通道向终端 B发送多 路辅流， 能够使 B终端所在会场的与会者看到多路辅流的图像。
图 4示出了本发明实施例提供的一种辅流控制方法， 该方法利用 PRE辅 流通道和 LIVE辅流通道发送多路辅流， 其具体包括：
401、 终端 A向终端 B发送终端 A的能力集， 终端 B向终端 A发送终端 B的能力集。
其中， 终端 A和终端 B分别位于不同的会场中， 所述能力集中携带终端 支持使用的辅流通道类型， 即 PRE辅流通道和 /或 LIVE辅流通道。
402、 终端 A申请到 PRE令牌。
403、 终端 A根据终端 B的能力集和终端 A的能力集， 当确定终端 B和 终端 A都能利用 PRE辅流通道时， 打开终端 A与终端 B之间的 PRE辅流通 道。
404、 终端 A利用 PRE辅流通道向终端 B发送一路辅流。
405、 如果终端 A需要发送另一路辅流， 则终端 A根据终端 B的能力集 和终端 A的能力集， 当确定终端 B和终端 A都能使用 LIVE辅流通道时， 打 开终端 A与终端 B之间的一条或者多条 LIVE辅流通道。
需要说明的是， 步骤 405中的 LIVE辅流通道可以在打开 PRE辅流通道 之前打开， 也可以在打开 PRE辅流通道之后打开， 不影响本发明的实现。
406、终端 A向终端 B发送绑定关系指示信息，所述绑定关系指示信息指 示与所述 PRE辅流通道绑定的 LIVE辅流通道，即指示了哪条 LIVE辅流通道 与 PRE辅流通道绑定。
具体的， 可以通过私有信令发送绑定关系指示信息。
该步骤可以是在需要利用打开的辅流通道发送另一条或者若干条辅流 时， 发送绑定关系指示信息。
407、终端 A利用与所述 PRE辅流通道所绑定的 LIVE辅流通道向终端 B 发送另一路辅流。
其中， 步骤 406是可选步骤， 即也可以不向终端 B发送绑定关系指示信 息， 可以认为所有的 LIVE辅流通道都是和 PRE辅流通道绑定的。
需要说明的， 该实施例以点对点会议为例进行描述的， 对于多点会议， 与上述不同之处在于， 各个终端直接和会议服务器进行能力集交换， 终端 A 申请到 PRE令牌打开终端 A到会议服务器之间的 PRE辅流通道和 LIVE辅流 通道之后， 会议服务器在根据其他会场的终端的能力集确定支持 PRE辅流通 道和 LIVE辅流通道的终端后， 打开会议服务器到其他会场终端间的 PRE辅 流通道和 LIVE辅流通道， 然后利用会议服务器到其他会场终端间的 PRE辅 流通道和 LIVE辅流通道将从终端 A接收的两路辅流广播给会议中的终端。
本发明实施例中终端 A获取 PRE令牌后，能够利用 PRE令牌对应的 PRE 辅流通道和与所述 PRE辅流通道绑定的 LIVE辅流通道向终端 B发送多路辅 流， 能够使终端 B所在会场的与会者看到多路辅流的图像。
参阅图 5 , 本发明实施例提供一种多路辅流控制方法， 该方法中由同一会 场的不同终端发送辅流， 该方法具体包括：
501、 同一会场的多个终端在所述会场申请得到 PRE令牌之后， 利用各自 的辅流通道发送辅流；
502、 会议的其他会场中与发送辅流的终端配对的终端接收到各自的辅 流。
具体的， 假定第一终端和第二终端位于第一会场中， 则步骤 501中第一会 场中的第一终端在第一会场获取 PRE令牌后， 利用第一辅流通道发送一路辅 流， 使其他会场中与所述第一终端配对的终端接收到所述一路辅流； 其中， 第一辅流通道为 PRE辅流通道，第一会场中的第二终端在第一会场获取 PRE令 牌后， 利用第二辅流通道发送另一路辅流， 使其他会场中与所述第二终端配 对的终端接收到所述另一路辅流，其中，第二辅流通道为 PRE辅流通道、 LIVE 辅流通道或者 PREAnnex辅流通道， 本实施例及后续图 6和图 7 A和图 7B所示实 施例中， 第二辅流通道根据跟随第一辅流通道， 其与图 2、 图 3、 图 4所示实施 例的 "跟随" 不同， 本实施例及后续图 6和图 7A和图 7B所示实施例中， 利用第 一辅流通道向哪个会场发送辅流， 就利用该第二辅流通道向哪个会场发送另 一路辅流， 即利用第一辅流通道和第二辅流通道向同一个会场发送多路辅流。
其中， 不同会场中终端的配对关系可以是预先定义的， 比如参与会议的 是一个三屏会场和一个单屏会场， 则三屏会场中的一个终端和单屏会场的终 端配对， 这种情况下只给单屏会场发送一路辅流。
可选的， 还可以包括： 第一终端获取 PRE令牌后， 向所述第二终端发送 通知消息， 所述通知消息指示利用辅流通道发送辅流。 步骤 502 中第二终端 接收到所述通知消息之后， 利用第二辅流通道发送另一路辅流。
或者， 同一会场的多个终端在各自申请得到 PRE令牌之后， 利用各自的辅 流通道发送辅流， 其中，每一个终端各自申请得到的 PRE令牌是适用于所述终 端和其他会场中与所述终端配对的终端的 PRE令牌 ,所述其他会场是会议中除 了所述终端所在会场以外的会场。具体的， 第一终端在申请得到第一 PRE令牌 后， 利用第一辅流通道发送一路辅流； 其中， 所述第一 PRE令牌是适用于所述 第一终端和其他会场中与第一终端配对的终端的 PRE令牌；第二终端在申请得 到第二 PRE令牌后， 利用第二辅流通道发送另一路辅流； 其中， 所述第二 PRE 令牌是适用于所述第二终端和其他会场中与第二终端配对的终端的 PRE令牌。
为了申请到 PRE令牌， 该方法还包括： 多个终端分别向会议服务器申请 PRE令牌； 所述会议服务器确定申请 PRE令牌的多个终端是属于同一会场后， 分别向申请 PRE令牌的各终端分别发送适用于相应终端和其他会场中与所述 相应终端配对的终端的 PRE令牌。
本发明实施例中在本会场获取到 PRE令牌后， 同一会场的多个终端分别 发送辅流， 能够使其他会场中与发送辅流的终端配对的终端接收到各自的辅 流， 以便其他会场的与会者能看到多路辅流的图像。
如下两个实施例将对图 5所示实施例进行详细描述：
图 6示出了本发明实施例提供的一种多路辅流控制方法， 该方法可适用 于点对点会议中， 在多终端会场， 每个会场的终端和对端会场的相应终端配 对， 不同对终端之间的呼叫独立， PRE令牌也独立， 因此一个会场的不同终 端向对端会场的相应终端各自申请 PRE令牌， 互不影响， 得到 PRE令牌后分 别打开各自的辅流通道， 该方法具体包括：
601、 会场 A中的终端向会场 B中与会场 A中终端配对的终端发送会场 A中终端的能力集； 会场 B中的终端向会场 A中与会场 B中终端配对的终端 发送会场 B中终端的能力集。
本实施例假定会场 A中的终端 A1与会场 B中的终端 B1配对， 会场 A 中的终端 A2与会场 B中的终端 B2配对。
602、 会场 A中的终端 A1从会场 B中的终端 B1申请到第一 PRE令牌。
603、 终端 A1才艮据终端 B1 的能力集和终端 A1 的能力集， 当确定终端 B1和终端 A1都能使用 PRE辅流通道时，打开终端 A1与终端 B1之间的 PRE 辅流通道。
604、 终端 A1利用打开的辅流通道向终端 B1发送一路辅流。
605、 会场 A中的终端 A2从会场 B中的终端 B2申请到第二 PRE令牌。
606、 终端 A2才艮据终端 B2的能力集和终端 A2的能力集， 当确定终端 B2和终端 A2都能使用 PRE辅流通道时，打开终端 A2与终端 B2之间的 PRE 辅流通道。
607、 终端 A2利用打开的辅流通道向终端 B2发送另一路辅流。
后续， 如果终端 A1不需要发送辅流时， 则可以释放掉终端 A1所申请到 的 PRE令牌； 如果终端 A2不需要发送辅流时， 则可以释放掉终端 A2所申请 到的 PRE令牌。
上述实施例是以点对点会议为例进行描述的， 在多点会议场景下， 各个 终端直接和会议服务器进行能力集交换， 终端 A1申请令牌， 终端 A2申请令 牌， 会议服务器判断申请令牌的终端是否属于同一会场， 如果是， 同意授予 终端 A1第一 PRE令牌， 授予终端 A2第二 PRE令牌， 这样， 终端 A1获取到 第一 PRE令牌之后， 打开终端 A1到会议服务器间的 PRE辅流通道， 会议服 务器在根据其他会场的终端的能力集确定支持 PRE辅流通道、 且与终端 A1 配对的终端后，会议服务器打开会议服务器到所确定的与终端 A1配对且支持 PRE辅流通道的终端间的 PRE辅流通道， 后续将所接收的来自终端 A1的辅 流向其他会场的相应终端（即支持 PRE辅流通道、 且与终端 A1配对的终端 ) 发送； 终端 A2获取到第二 PRE令牌之后， 打开终端 A2到会议服务器间的 PRE辅流通道， 会议服务器在根据其他会场的终端的能力集确定支持 PRE辅 流通道、 且与终端 A2配对的终端后， 会议服务器打开会议服务器到所确定的 与终端 A2配对且支持 PRE辅流通道的终端间的 PRE辅流通道， 后续将所接 收的来自终端 A2的辅流向其他会场的相应终端 （即支持 PRE辅流通道、 且 与终端 A2配对的终端 )发送。
本发明实施例终端中每个会场的终端和对端会场的相应终端配对， 不同 对终端之间的呼叫独立， PRE令牌也独立， 一个会场的不同终端向对端会场 的相应终端各自申请得到 PRE令牌后， 分别打开各自的辅流通道，传输辅流， 使其他会场中的与会者能够看到多路辅流的图像。
图 7A示出了本发明实施例提供的一种多路辅流控制方法， 该方法中， 多 屏会场的一个终端获取到 PRE令牌， 控制该会场的多个终端发送多个辅流， 该方法具体包括：
701A、会场 A中的终端向会场 B中与会场 A中终端配对的终端发送会场 A中终端的能力集； 会场 B中的终端向会场 A中与会场 B中终端配对的终端 发送会场 B中终端的能力集。
本实施例假定会场 A中的终端 A1与会场 B中的终端 B1配对， 会场 A 中的终端 A2与会场 B中的终端 B2配对。 702 A、 会场 A中的终端 Al从会场 B中的终端 Bl申请到 PRE令牌。 703A、 终端 Al向终端 A2发送通知消息， 该通知消息用于指示终端 A2 利用辅流通道发送辅流。
704A、 终端 A1才艮据终端 B1的能力集和终端 A1的能力集， 当确定终端 B1和终端 A1都支持使用 PRE辅流通时， 终端 A1打开终端 A1与终端 B1之 间的 PRE辅流通道。
705A、 终端 A2才艮据终端 B2的能力集和终端 A2的能力集， 当确定终端 B2和终端 A2都支持使用 PRE辅流通或者 LIVE辅流通道时， 终端 A2接收 到终端 A1发送的通知消息之后， 打开终端 A2与终端 B2之间的 PRE辅流通 道或者 LIVE辅流通道。
706A、 终端 A1利用打开的辅流通道向终端 B1发送一路辅流。
707A、 终端 A2利用打开的辅流通道向终端 B2发送另一路辅流。
需要说明的是， 步骤 703A和 704A没有执行上的先后顺序， 步骤 706A、 707A没有执行上的先后顺序。
上述实施例是以点对点会议为例进行描述的， 在多点会议场景下， 各个 终端直接和会议服务器进行能力集交换， 终端 A1获取到 PRE令牌之后， 终 端 A1请求打开终端 A1到会议服务器间的一条 PRE辅流通道， 终端 A2请求 打开终端 A2到会议服务器间的 PRE辅流通道或者 LIVE辅流通道，会议服务 器判断请求打开辅流通道的终端是否属于同一会场，如果是，则允许终端 Al、 终端 A2打开相应的辅流通道。会议服务器在根据其他会场的终端的能力集确 定支持 PRE辅流通道、 且与终端 A1配对的终端后， 会议服务器打开会议服 务器到所确定的与终端 A1配对且支持 PRE辅流通道的终端间的 PRE辅流通 道，后续将所接收的来自终端 A1的辅流向其他会场的相应终端（即支持 PRE 辅流通道、 且与终端 A1配对的终端）发送； 会议服务器在根据其他会场的终 端的能力集确定支持 PRE辅流通道或者一条 LIVE辅流通道、 且与终端 A2 配对的终端后，会议服务器打开会议服务器到所确定的与终端 A2配对的终端 间的 PRE辅流通道或者一条 LIVE辅流通道， 后续将所接收的来自终端 A2 的辅流向其他会场的相应终端 （即支持 PRE辅流通道、 且与终端 A2配对的 终端）发送。
需要说明的是，会场 A中获取 PRE令牌的终端可以认为是会场 A中的主 终端， 本实施例中会场中的主终端是指能够通知其他终端 （比如终端 A2 )利 用辅流通道发送辅流的终端， 可选的， 在多点会议场景下， 会议服务器判断 是否允许终端 A2打开辅流通道可以提前到终端 A2和会议服务器进行能力集 交换时进行， 即在终端 A2与会议服务器进行能力集交换时， 会议服务器向终 端发送的能力集中不携带辅流通道类型， 这样终端 A2 就不会打开辅流通道 了。
本发明实施例终端 A1在申请到 PRE令牌之后，打开终端 A1的辅流通道， 并通知终端 A2打开辅流通道传输辅流， 这样位于同一会场的终端 A1和终端 A2都能发送辅流， 使其他会场中与终端 A1 配对的终端能够接收到终端 A1 发送的辅流， 其他会场中与终端 A2配对的终端能够接收到终端 A2发送的辅 流， 这样其他会场中与会者就可以看到多路辅流的图像了。
图 7B示出了本发明实施例提供的又一种多路辅流控制方法，该方法与图 7A所示实施例的区别主要在于： 由本端会场中的主终端与对端会场的主终端 进行能力集交换（本实施例中能力集携带会场中多个终端的能力）， 本端会场 中的多个终端向对端会场的多个终端发送辅流， 该方法具体包括：
701B、会场 A中的终端 A1向会场 B中的终端 B1发送会场 A的能力集，； 会场 B中的终端 B1向会场 A中的终端 A1发送会场 B的能力集。
本发明实施例中终端 A1和终端 A2绑定， 假定两者中终端 A1作为会场 A中的主终端； 终端 B1和终端 B2绑定， 4叚定两者中终端 B1作为会场 B中 的主终端。 其中， 本实施例中会场的主终端是代表本会场与会议中其他会场 进行能力协商、 且能够打开多条辅流通道的终端， 且主终端知道本地会场的 各终端支持的辅流通道类型。
其中， 该步骤中会场的能力集是表示该会场支持哪些辅流通道类型， 比 如 PRE辅流通道、 LIVE辅流通道和 /或 PREAnnex辅流通道。
702B、 会场 A中的终端 A1从会场 B中的终端 B1申请到 PRE令牌。
703B、 会场 A中的终端 A1才艮据终端 A1和终端 B1的能力， 当确定终端 Al和终端 Bl都支持使用 PRE辅流通道时， 终端 A1打开 PRE辅流通道。
704B、 会场 A中的终端 A1根据终端 A2支持的辅流通道类型和会场 B 的能力集，当确定终端 A2和会场 B的终端支持使用 PREAnnex辅流通道或者 终端 A2和会场 B的终端支持使用 LIVE辅流通道时， 打开所确定的终端 A2 和会场 B的终端支持使用的辅流通道， 即 PREAnnex辅流通道或者 LIVE辅 流通道。
假定终端 A2支持使用 LIVE辅流通道， 且会场 B的能力集中包括 LIVE 辅流通道类型时，当需要传输多路辅流时，终端 A1会向终端 B1发送打开 LIVE 辅流通道的请求， 假定终端 B2支持使用 LIVE辅流通道， 终端 B1向终端 A1 发送响应消息， 消息中携带 LIVE辅流通道对应的辅流的接收地址为终端 B2 的地址， 打开终端 A2到终端 B2间的辅流通道。
705B、 会场 A中的终端 A1向终端 A2发送通知消息， 通知终端 A2利用 已打开的 PREAnnex辅流通道或者 LIVE辅流通道向终端 B2发送另一路辅流。
706B、 会场 A中的终端 A1向会场 B中的终端 B1发送一路辅流。
707B、 会场 A中的终端 A2向会场 B中的终端 B2发送另一路辅流。 本实施例是以点对点会议为例进行描述的， 在多点会议场景下， 各个终 端直接和会议服务器进行能力集交换， 终端 A1 申请到 PRE令牌之后， 终端 A1打开上述两条辅流通道， 终端 Al、 终端 A2分别发送辅流， 会议服务器在 接收到终端 A1发送的辅流后， 利用相应的辅流通道向其他会场中与终端 A1 配对的终端发送该辅流； 在接收到终端 A2发送的辅流后， 利用相应的辅流通 道向其他会场中与终端 A2配对的终端发送该辅流。
本发明实施例终端 A1在申请到 PRE令牌之后， 打开多条辅流通道， 并 通知终端 A2传输辅流， 这样位于同一会场的终端 A1和终端 A2都能发送辅 流， 使其他会场中与终端 A1配对的终端能够接收到终端 A1发送的辅流， 其 他会场中与终端 A2配对的终端能够接收到终端 A2发送的辅流， 这样其他会 场中与会者就可以看到多路辅流的图像了。
上述各实施例是以 H.323 为例进行描述的， 本发明各实施例提供的技术 方案也可以适用于 SIP协议，与利用 H.323协议不同之处在于： 利用 SIP协议 时， 不同会场的终端不会彼此传输自己的能力集， 即没有单独的能力集的传 输过程， 利用 SIP协议时， 可以在终端发起的呼叫流程中请求打开相应的辅 流通道， 具体利用 SIP协议发送的呼叫消息包括如下内容：
v=0
o=Al ice 292742730 29277831 IN IP4 131. 163. 72. 4
s=Second lecture from information technology
c=IN IP4 131. 164. 74. 2
t=0 0
m=video 52886 RTP/AVP 31 (辅流通道 1的定义）
a=rtpmap : 31 H261/9000
a=content : sl ides (辅流通道 1的角色定义 )
m=video 53334 RTP/AVP 31 (辅流通道 2的定义）
a=rtpmap : 31 H261/9000
a=content : PREAnnex (辅流通道 2的角色定义 )
m=video 54132 RTP/AVP 31 (主流通道的定义）
a=rtpmap : 31 H261/9000
a=content : main (主流通道的类型定义)
其中， a=content : sl ides 表示终端能使用 s l ides 辅流通道， 其相当于 H. 323协议中的 PRE辅流通道， a=content : PREAnnex表示终端能使用 PREAnnex 辅流通道。 其中， 利用 SIP协议发送的呼叫消息中也可以包括 alt辅流通道， 其相当于 H.239中的 LIVE辅流通道。
参阅图 8, 本发明实施例提供一种终端， 位于第一会场中， 其主要包括： 令牌申请单元 801 , 用于申请 PRE令牌；
辅流发送单元 802, 用于在申请得到 PRE令牌后， 利用所述 PRE令牌对应 的 PRE辅流通道向第二会场的终端发送一路辅流，利用与所述 PRE辅流通道绑 定的辅流通道向第二会场的终端发送其他辅流。
其中，该终端是第一会场中的终端； 与所述 PRE辅流通道绑定的辅流通道 是： 扩展的 PREAnnex辅流通道， 或者， LIVE辅流通道。 具体的， 所述辅流发 送单元 802具体用于在点对点会议中， 利用所述 PRE令牌对应的 PRE辅流通道 直接向第二会场的终端发送一路辅流，利用与所述 PRE辅流通道绑定的辅流通 道直接向所述第二会场的终端发送其他辅流； 或者， 所述辅流发送单元具体 用于在多点会议中，利用所述 PRE令牌对应的 PRE辅流通道向会议服务器发送 一路辅流，利用与所述 PRE辅流通道绑定的辅流通道向所述会议服务器发送其 他辅流， 使所述会议服务器分别向会议中除第一会场以外的其他会场的终端 发送所述一路辅流和其他辅流。
其中， 辅流发送单元 802具体用于在申请到 PRE令牌后， 当第一会场的终 端和第二会场的终端都支持使用 PRE辅流通道和与所述 PRE辅流通道绑定的 辅流通道时， 利用所述 PRE辅流通道向第二会场的终端发送一路辅流 , 利用与 所述 PRE辅流通道绑定的辅流通道向第二会场的终端发送其他辅流； 或者， 当 第一会场的终端和第二会场的终端都支持使用 PRE辅流通道时，根据预定的规 则确定第一会场的终端和第二会场的终端也支持使用与 PRE辅流通道绑定的 PREAnnex辅流通道，利用所述 PRE辅流通道向第二会场的终端发送一路辅流， 利用与所述 PRE辅流通道绑定的 PREAnnex辅流通道向第二会场的终端发送其 他辅流。
可选的， 为了通知对端使用哪条 LIVE辅流通道， 该终端还包括： 绑定关 系发送单元 803 , 用于向第二会场的终端发送绑定关系指示信息， 所述绑定关 系指示信息指示与所述 PRE辅流通道绑定的 LIVE辅流通道； 或者， 向会议服 务器发送绑定关系指示信息，所述绑定关系指示信息指示与所述 PRE辅流通道 绑定的 LIVE辅流通道， 使会议服务器通知会议中除第一会场以外的其他会场 的终端所述与 PRE辅流通道绑定的 LIVE辅流通道。
本发明实施例中终端申请得到 PRE令牌后， 能够利用 PRE令牌对应的 PRE辅流通道和与所述 PRE辅流通道绑定的 PREAnnex或者 LIVE辅流通道 发送多路辅流， 能够使接收多路辅流的会场中的与会者同时看到多路辅流的 图像。
本发明实施例提供一种网络系统， 其包括： 第一终端 901和第二终端 902, 所述第一终端和第二终端位于第一会场中， 第一终端，用于在第一会场申请得到 PRE令牌后， 利用第一辅流通道发送 一路辅流， 使第二会场中与所述第一终端配对的终端接收到所述一路辅流； 第二终端，用于在第一会场申请得到 PRE令牌后， 利用第二辅流通道发送 另一路辅流， 使第二会场中与所述第二终端配对的终端接收到所述另一路辅 流。
在一种具体实现方式中， 该第一终端还用于在申请得到 PRE令牌后， 向 第二终端发送通知消息， 所述通知消息指示利用辅流通道发送辅流； 所述第 二终端具体用于接收到所述通知消息之后， 利用第二辅流通道发送另一路辅 流。
这样， 通过终端 A1通知终端 A2打开辅流通道传输辅流， 可以使位于同 一会场的终端 A1和终端 A2都能发送辅流， 使其他会场中与终端 A1配对的 终端能够接收到终端 A1发送的辅流， 其他会场中与终端 A2配对的终端能够 接收到终端 A2发送的辅流，这样其他会场中与会者就可以看到多路辅流的图 像了。
在另一种具体实现方式中，该第一终端具体用于在申请得到第一 PRE令牌 后， 利用第一辅流通道发送一路辅流； 其中， 所述第一 PRE令牌是适用于所述 第一终端和其他会场中与第一终端配对的终端的 PRE令牌；第二终端具体用于 在申请得到第二 PRE令牌后， 利用第二辅流通道发送另一路辅流； 其中， 所述 第二 PRE令牌是适用于所述第二终端和其他会场中与第二终端配对的终端的 PRE令牌。此时， 可选的， 该网络系统还包括： 会议服务器 903 , 用于确定申 请 PRE令牌的终端是否属于同一会场， 如果是， 同意授予第一终端第一 PRE令 牌、 第二终端第二 PRE令牌。
这样通过终端 A1申请得到第一 PRE令牌并利用 PRE辅流通道发送辅流， 使其他会场中与终端 A1配对的终端接收到该辅流； 通过终端 A2申请得到第 二 PRE令牌并利用 PRE辅流通道发送辅流， 使其他会场中与终端 A2配对的 终端接收到该辅流， 使其他会场中的与会者能够看到多路辅流的图像。
本领域普通技术人员可以理解实现上述实施例方法中的全部或部分步骤 是可以通过程序来指令相关的硬件完成， 所述的程序可以存储于一种计算机 可读存储介质中， 例如只读存储器， 磁盘或光盘等。
以上对本发明实施例所提供的多路辅流控制方法、 装置及网络系统进行 以上实施例的说明只是用于帮助理解本发明的方法及其核心思想； 同时， 对 于本领域的一般技术人员， 依据本发明的思想， 在具体实施方式及应用范围 上均会有改变之处， 综上所述， 本说明书内容不应理解为对本发明的限制。

Claims

权利要求 书
1、 一种多路辅流控制方法， 其特征在于， 包括：
第一会场的终端申请内容 PRE令牌；
在申请得到 PRE令牌后， 第一会场的终端利用所述 PRE令牌对应的 PRE辅流 通道向第二会场的终端发送一路辅流，利用与所述 PRE辅流通道绑定的辅流通道 向所述第二会场的终端发送其他辅流。
2、 根据权利要求 1所述的方法， 其特征在于，
第一会场的终端利用所述 PRE令牌对应的 PRE辅流通道向第二会场的终端 发送一路辅流，利用与所述 PRE辅流通道绑定的辅流通道向所述第二会场的终端 发送其他辅流包括：
当第一会场的终端和第二会场的终端都支持使用 PRE辅流通道和与所述 PRE辅流通道绑定的辅助内容 PREAnnex辅流通道时， 利用所述 PRE辅流通道向 第二会场的终端发送一路辅流， 利用与所述 PRE辅流通道绑定的 PREAnnex辅流 通道向第二会场的终端发送其他辅流；
或者，
当第一会场的终端和第二会场的终端都支持使用 PRE辅流通道和与所述 PRE辅流通道绑定的活动 LIVE辅流通道时， 利用所述 PRE辅流通道向第二会场 的终端发送一路辅流， 利用与所述 PRE辅流通道绑定的 LIVE辅流通道向第二会 场的终端发送其他辅流。
3、 根据权利要求 1所述的方法， 其特征在于，
与所述 PRE辅流通道绑定的辅流通道是： 扩展的辅助内容 PREAnnex辅流通 道， 或者活动 LIVE辅流通道。
4、 根据权利要求 3所述的方法， 其特征在于，
第一会场的终端利用所述 PRE令牌对应的 PRE辅流通道向第二会场的终端 发送一路辅流，利用与所述 PRE辅流通道绑定的辅流通道向所述第二会场的终端 发送其他辅流包括：
当第一会场的终端和第二会场的终端都支持使用 PRE辅流通道时，根据预定 的规则确定第一会场的终端和第二会场的终端也支持使用与 PRE辅流通道绑定 的 PREAnnex辅流通道，利用所述 PRE辅流通道向第二会场的终端发送一路辅流， 利用与所述 PRE辅流通道绑定的 PREAnnex辅流通道向第二会场的终端发送其他 辅流， 其中， 预定的规则规定了支持 PRE辅流通道的终端也支持 PREAnnex辅流 通道。
5、 根据权利要求 1所述的方法， 其特征在于，
第一会场的终端利用所述 PRE令牌对应的 PRE辅流通道向第二会场的终端 发送一路辅流，利用与所述 PRE辅流通道绑定的辅流通道向所述第二会场的终端 发送其他辅流具体为：
在点对点会议中，第一会场的终端利用所述 PRE令牌对应的 PRE辅流通道直 接向第二会场的终端发送一路辅流，利用与所述 PRE辅流通道绑定的辅流通道直 接向所述第二会场的终端发送其他辅流；
或者，
在多点会议中，第一会场的终端利用所述 PRE令牌对应的 PRE辅流通道向会 议服务器发送一路辅流，利用与所述 PRE辅流通道绑定的辅流通道向所述会议服 务器发送其他辅流， 使所述会议服务器分别向会议中除第一会场以外的其他会 场的终端发送所述一路辅流和其他辅流。
6、 根据权利要求 1所述的方法， 其特征在于，
在利用与所述 PRE辅流通道绑定的辅流通道向所述第二会场的终端发送其 他辅流之前， 该方法还包括：
向第二会场的终端发送绑定关系指示信息， 所述绑定关系指示信息指示与 所述 PRE辅流通道绑定的 LIVE辅流通道；
或者，
向会议服务器发送绑定关系指示信息， 所述绑定关系指示信息指示与所述 PRE辅流通道绑定的 LIVE辅流通道， 使会议服务器接收到所述第一会场的终端 发送的多路辅流之后， 利用所述 PRE辅流通道和与所述 PRE辅流通道绑定的 LIVE辅流通道向会议中除第一会场以外的其他会场的终端发送多路辅流。
7、 一种多路辅流控制方法， 其特征在于， 包括：
同一会场的多个终端在所述会场申请得到 PRE令牌之后，利用各自的辅流通 道发送辅流， 使会议的其他会场中与发送辅流的终端配对的终端接收到各自的 辅流。
8、 根据权利要求 7所述的方法， 其特征在于，
所述多个终端包括第一终端和第二终端；
该方法还包括：
所述第一终端申请得到 PRE令牌后， 向所述第二终端发送通知消息，所述通 知消息指示利用辅流通道发送辅流；
利用各自的辅流通道发送辅流包括：
第一终端申请得到 PRE令牌后， 利用第一辅流通道发送一路辅流；
第二终端接收到所述通知消息之后， 利用第二辅流通道发送另一路辅流。
9、 根据权利要求 7所述的方法， 其特征在于，
同一会场的多个终端在所述会场申请得到 PRE令牌之后，利用各自的辅流通 道发送辅流包括：
同一会场的多个终端在各自申请得到 PRE令牌之后，利用各自的辅流通道发 送辅流， 其中，每一个终端各自申请得到的 PRE令牌是适用于所述终端和其他会 场中与所述终端配对的终端的 PRE令牌。
10、 根据权利要求 9所述的方法， 其特征在于， 该方法还包括：
多个终端分别向会议服务器申请 PRE令牌；
所述会议服务器确定申请 PRE令牌的多个终端是属于同一会场后，分别向申 请 PRE令牌的各终端分别发送适用于相应终端和其他会场中与所述相应配对的 终端的 PRE令牌。
11、 一种终端， 位于第一会场中， 其特征在于， 包括：
令牌申请单元， 用于申请 PRE令牌；
辅流发送单元， 用于在申请得到 PRE令牌后， 利用所述 PRE令牌对应的 PRE 辅流通道向第二会场的终端发送一路辅流，利用与所述 PRE辅流通道绑定的辅流 通道向所述第二会场的终端发送其他辅流。
12、 根据权利要求 11所述终端， 其特征在于，
与所述 PRE辅流通道绑定的辅流通道是： 扩展的 PREAnnex辅流通道，或者， LIVE辅流通道。
13、 根据权利要求 11所述终端， 其特征在于，
所述辅流发送单元， 具体用于在点对点会议中， 利用所述 PRE令牌对应的 PRE辅流通道直接向第二会场的终端发送一路辅流，利用与所述 PRE辅流通道绑 定的辅流通道直接向所述第二会场的终端发送其他辅流；
或者，
所述辅流发送单元， 具体用于在多点会议中， 利用所述 PRE令牌对应的 PRE 辅流通道向会议服务器发送一路辅流，利用与所述 PRE辅流通道绑定的辅流通道 向所述会议服务器发送其他辅流， 使所述会议服务器分别向会议中除第一会场 以外的其他会场的终端发送所述一路辅流和其他辅流。
14、 根据权利要求 12所述终端， 其特征在于， 还包括：
绑定关系发送单元， 用于向第二会场的终端发送绑定关系指示信息， 所述 绑定关系指示信息指示与所述 PRE辅流通道绑定的 LIVE辅流通道； 或者， 向会 议服务器发送绑定关系指示信息，所述绑定关系指示信息指示与所述 PRE辅流通 道绑定的 LIVE辅流通道， 使会议服务器接收到所述第一会场的终端发送的多路 辅流之后， 利用所述 PRE辅流通道和与所述 PRE辅流通道绑定的 LIVE辅流通道 向会议中除第一会场以外的其他会场的终端发送多路辅流。
15、 一种网络系统， 其特征在于， 包括： 第一终端和第二终端， 所述第一 终端和第二终端位于第一会场中，
第一终端， 用于在第一会场申请得到 PRE令牌后， 利用第一辅流通道发送一 路辅流， 使第二会场中与所述第一终端配对的终端接收到所述一路辅流；
第二终端， 用于在第一会场申请得到 PRE令牌后， 利用第二辅流通道发送另 一路辅流， 使第二会场中与所述第二终端配对的终端接收到所述另一路辅流。
16、 根据权利要求 15所述的网络系统， 其特征在于，
所述第一终端，还用于在第一终端申请得到 PRE令牌后， 向第二终端发送通 知消息， 所述通知消息指示利用辅流通道发送辅流；
所述第二终端， 具体用于接收到所述通知消息之后， 利用第二辅流通道发 送另一路辅流。
17、 根据权利要求 15所述的网络系统， 其特征在于，
所述第一终端，具体用于在第一终端申请得到第一 PRE令牌后， 利用第一辅 流通道发送一路辅流； 其中，所述第一 PRE令牌是适用于所述第一终端和会议中 除第一会场以外的其他会场中与第一终端配对的终端的 PRE令牌；
所述第二终端， 具体用于在第二终端申请得到第二 PRE令牌后， 利用第二 辅流通道发送另一路辅流； 其中， 所述第二 PRE令牌是适用于所述第二终端和 会议中除第一会场以外的其他会场中与第二终端配对的终端的 PRE令牌。
18、 根据权利要求 17所述的网络系统， 其特征在于， 还包括：
会议服务器， 用于确定申请 PRE令牌的终端是否属于同一会场， 如果是， 同意授予第一终端第一 PRE令牌、 第二终端第二 PRE令牌。
PCT/CN2011/083542 2010-12-07 2011-12-06 多路辅流控制方法、装置及网络系统 WO2012075930A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
EP11846405.6A EP2637404B1 (en) 2010-12-07 2011-12-06 Method and device for controlling multiple auxiliary streams, and network system
US13/910,341 US9013537B2 (en) 2010-12-07 2013-06-05 Method, device, and network systems for controlling multiple auxiliary streams

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201010577099.3 2010-12-07
CN201010577099.3A CN102572367B (zh) 2010-12-07 2010-12-07 多路辅流控制方法、装置及网络系统

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US13/910,341 Continuation US9013537B2 (en) 2010-12-07 2013-06-05 Method, device, and network systems for controlling multiple auxiliary streams

Publications (1)

Publication Number Publication Date
WO2012075930A1 true WO2012075930A1 (zh) 2012-06-14

Family

ID=46206623

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2011/083542 WO2012075930A1 (zh) 2010-12-07 2011-12-06 多路辅流控制方法、装置及网络系统

Country Status (4)

Country Link
US (1) US9013537B2 (zh)
EP (1) EP2637404B1 (zh)
CN (1) CN102572367B (zh)
WO (1) WO2012075930A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110784452A (zh) * 2019-09-26 2020-02-11 视联动力信息技术股份有限公司 一种视频数据推送方法及装置

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103327287B (zh) * 2013-05-23 2018-01-02 华为技术有限公司 一种会议信号播放方法和装置、视频会议终端、移动设备
CN103765859B (zh) * 2013-10-25 2017-04-12 华为技术有限公司 一种多路辅流控制的方法、控制设备、节点和系统
CN109348167B (zh) * 2018-12-17 2020-09-22 厦门亿联网络技术股份有限公司 基于视频会议系统的无线辅流数据传输方法及系统
CN111866580B (zh) * 2020-06-09 2022-12-20 厦门亿联网络技术股份有限公司 一种基于h.239的辅流协商方法及终端设备

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101115183A (zh) * 2007-09-06 2008-01-30 杭州华三通信技术有限公司 辅流发送的控制方法、mcu、主席终端及视频终端
CN101459816A (zh) * 2007-12-14 2009-06-17 深圳华为通信技术有限公司 一种多点双流会议中控制辅流令牌的方法、系统及设备
CN101635822A (zh) * 2008-07-26 2010-01-27 中兴通讯股份有限公司 一种会议电视终端双流自动发送的实现方法
CN101753329A (zh) * 2009-12-25 2010-06-23 深圳华为通信技术有限公司 呼叫建立的方法、装置和系统

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8990305B2 (en) * 2006-10-18 2015-03-24 Microsoft Corporation Techniques for virtual conferencing servers
CN101094382B (zh) * 2007-07-12 2010-11-03 杭州华三通信技术有限公司 视频终端、用户接口及辅流播放方法
CN101242513A (zh) * 2008-03-10 2008-08-13 杭州华三通信技术有限公司 一种视频会议中的双流传送方法和一种视频会议系统
US20110099227A1 (en) 2009-10-27 2011-04-28 Walls Jeffrey J Communication application with steady-state conferencing
US9538299B2 (en) 2009-08-31 2017-01-03 Hewlett-Packard Development Company, L.P. Acoustic echo cancellation (AEC) with conferencing environment templates (CETs)
US20110096699A1 (en) 2009-10-27 2011-04-28 Sakhamuri Srinivasa Media pipeline for a conferencing session
US20110055893A1 (en) 2009-08-31 2011-03-03 Walls Jeffrey J Communication application
WO2011087515A1 (en) 2010-01-18 2011-07-21 Hewlett-Packard Development Company, L.P. Virtual meeting savings

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101115183A (zh) * 2007-09-06 2008-01-30 杭州华三通信技术有限公司 辅流发送的控制方法、mcu、主席终端及视频终端
CN101459816A (zh) * 2007-12-14 2009-06-17 深圳华为通信技术有限公司 一种多点双流会议中控制辅流令牌的方法、系统及设备
CN101635822A (zh) * 2008-07-26 2010-01-27 中兴通讯股份有限公司 一种会议电视终端双流自动发送的实现方法
CN101753329A (zh) * 2009-12-25 2010-06-23 深圳华为通信技术有限公司 呼叫建立的方法、装置和系统

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
"ITU-T telecommunication standardization sector of ITU. Role management and additional media channels for H.300-series terminals", ITU-T RECOMMENDATION H.239, 30 September 2005 (2005-09-30) *
See also references of EP2637404A4 *

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110784452A (zh) * 2019-09-26 2020-02-11 视联动力信息技术股份有限公司 一种视频数据推送方法及装置
CN110784452B (zh) * 2019-09-26 2022-07-12 视联动力信息技术股份有限公司 一种视频数据推送方法及装置

Also Published As

Publication number Publication date
CN102572367A (zh) 2012-07-11
US20130265380A1 (en) 2013-10-10
EP2637404A4 (en) 2013-11-27
US9013537B2 (en) 2015-04-21
EP2637404B1 (en) 2018-02-14
EP2637404A1 (en) 2013-09-11
CN102572367B (zh) 2014-09-03

Similar Documents

Publication Publication Date Title
RU2533304C2 (ru) Способ управления конференц-связью и относящиеся к нему устройство и система
WO2010034254A1 (zh) 视频及音频处理方法、多点控制单元和视频会议系统
US20140118471A1 (en) Video Conferencing Method and Device Thereof
US20140118468A1 (en) Method and system for adapting a television for multimedia conferencing
WO2014036851A1 (zh) 多流会议的媒体协商方法、设备和系统
WO2013163951A1 (zh) 多人会话时数据呈现的方法、服务器、用户端及系统
WO2011026382A1 (zh) 视频会议虚拟会场的呈现方法、设备及系统
JP2008022552A (ja) 会議方法および会議システム
CN105763832A (zh) 一种视频互动、控制方法及装置
WO2011050690A1 (zh) 用于录制和回播多媒体会议的方法和系統
WO2012155659A1 (zh) 一种基于远程呈现的媒体传输方法及系统
WO2012075930A1 (zh) 多路辅流控制方法、装置及网络系统
WO2012000373A1 (zh) 会议切换的方法、系统及设备
WO2010097044A1 (zh) 识别远程用户信号方法、远程会议处理方法、装置及系统
WO2015127799A1 (zh) 协商媒体能力的方法和设备
WO2012175025A1 (zh) 远程呈现会议系统、远程呈现会议的录制与回放方法
WO2015003532A1 (zh) 多媒体会议的建立方法、装置及系统
WO2014161403A1 (zh) 视频会议电视终端视频源的接入方法和系统
WO2014187062A1 (zh) 一种会议信号播放方法和装置、视频会议终端、移动设备
WO2014047935A1 (zh) 一种多媒体会议实现方法、相关设备及系统
WO2016206471A1 (zh) 多媒体业务处理方法、系统及装置
WO2012062153A1 (zh) 在级联会议中实现多画面的方法、系统及mcu
JP2005311670A (ja) テレビ会議端末、テレビ会議システム、テレビ会議方法並びにそのプログラム
WO2016045496A1 (zh) 一种媒体控制方法和设备
WO2014101471A1 (zh) 会议记录获取方法、提供方法、设备及系统

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 11846405

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 2011846405

Country of ref document: EP

NENP Non-entry into the national phase

Ref country code: DE