WO2015032277A1 - 视频会议中媒体流的传输方法与装置 - Google Patents

视频会议中媒体流的传输方法与装置 Download PDF

Info

Publication number
WO2015032277A1
WO2015032277A1 PCT/CN2014/084777 CN2014084777W WO2015032277A1 WO 2015032277 A1 WO2015032277 A1 WO 2015032277A1 CN 2014084777 W CN2014084777 W CN 2014084777W WO 2015032277 A1 WO2015032277 A1 WO 2015032277A1
Authority
WO
WIPO (PCT)
Prior art keywords
video
browser
media stream
information
request message
Prior art date
Application number
PCT/CN2014/084777
Other languages
English (en)
French (fr)
Inventor
井皓
郜文美
范姝男
吕小强
王雅辉
Original Assignee
华为终端有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为终端有限公司 filed Critical 华为终端有限公司
Priority to EP14842852.7A priority Critical patent/EP3021556B1/en
Priority to US14/915,469 priority patent/US9467650B2/en
Publication of WO2015032277A1 publication Critical patent/WO2015032277A1/zh

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/14Systems for two-way working
    • H04N7/141Systems for two-way working between two video terminals, e.g. videophone
    • H04N7/147Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00Data switching networks
    • H04L12/02Details
    • H04L12/16Arrangements for providing special services to substations
    • H04L12/18Arrangements for providing special services to substations for broadcast or conference, e.g. multicast
    • H04L12/1813Arrangements for providing special services to substations for broadcast or conference, e.g. multicast for computer conferences, e.g. chat rooms
    • H04L12/1822Conducting the conference, e.g. admission, detection, selection or grouping of participants, correlating users to one or more conference sessions, prioritising transmission
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04842Selection of displayed objects or displayed text elements
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/10Architectures or entities
    • H04L65/1046Call controllers; Call servers
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/1066Session management
    • H04L65/1083In-session procedures
    • H04L65/1093In-session procedures by adding participants; by removing participants
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/40Support for services or applications
    • H04L65/403Arrangements for multi-party communication, e.g. for conferences
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/40Support for services or applications
    • H04L65/403Arrangements for multi-party communication, e.g. for conferences
    • H04L65/4038Arrangements for multi-party communication, e.g. for conferences with floor control
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60Network streaming of media packets
    • H04L65/75Media network packet handling
    • H04L65/765Media network packet handling intermediate
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/14Systems for two-way working
    • H04N7/15Conference systems

Definitions

  • the present invention relates to the field of communications technologies, and in particular, to a method and apparatus for transmitting media streams in a video conference.
  • Web Real Time Communication (WebRTC) technology can realize video and audio communication and multi-party conference between different browsers and browsers, or between browsers and terminals. As shown in Figure 1.
  • WebRTC Web Real Time Communication
  • the user 1 accesses the MTC application website to open the WebRTC application webpage, and establishes a communication connection with the MTC application website through the JavaScript code in the webpage; on the right side of FIG. 1, the user 2 also accesses the MTC application website to open the WebRTC application webpage. , establish a communication connection with the MTC application website through the JavaScript code in the webpage.
  • User 1 and User 2 establish a connection with the other party through the user information provided by the WeRTC application website, and call the functions in their respective browsers for media streaming through the JavaScript Application Programming Interface (API).
  • API JavaScript Application Programming Interface
  • the conference server mixes/mixes the video/audio of all the participants in the video conference, and then sends the video/audio.
  • the terminal 1 for example, a mobile phone
  • the conference server mixes/mixes the video/audio of all the participants in the video conference, and then sends the video/audio.
  • the terminal 1 or the user 1 uploads the video and audio information in the terminal 1 to the conference server through the terminal 1;
  • the following problems are also exposed in the prior art: 1) the conference server only The video/audio of all participants in the video conference can be mixed/mixed and distributed to individual users, and the video and audio of specific participants cannot be collected and combined to reduce the user experience, and the user experience is also increased.
  • the embodiment of the invention provides a method and a device for transmitting a media stream in a video conference, and the conference server can send the video and audio information of the specific participant to the terminal according to the user's selection.
  • an embodiment of the present invention provides a method for transmitting a media stream in a video conference, where the method includes:
  • the selection instruction is specifically selecting a participant corresponding to the desired video and audio information from the video and audio information of all the participants
  • the conference server And receiving, by the conference server, the second media stream that is sent according to the identifier information, where the second media stream includes the selected video and audio information of the participant.
  • the sending, by the WebRTC application, the sending the request message to the conference server according to the selecting instruction further includes:
  • the transmission request message is sent to the conference server by the WebRTC application.
  • the parsing the participant attribute of the constraint object in the extended WebRTC interface includes:
  • the identification information of the selected participant is stored in the participant attribute.
  • the receiving, by the conference server, before the second media stream sent according to the identifier information also includes:
  • the receiving, by the conference server, the sending according to the identifier information After the second media stream it also includes:
  • an embodiment of the present invention provides a method for transmitting a media stream in a video conference, where the method includes:
  • the method further includes:
  • the extracting, according to the identifier information, the view of the participant corresponding to the identifier information specifically includes:
  • the sending, by the transmitting browser, the second media stream, where the second media stream includes selecting The video and audio information of the participants includes:
  • the media tracking object is carried in the second media stream, so that the second media stream includes the selected participant's video and audio information.
  • an embodiment of the present invention provides a method for transmitting a media stream in a video conference, where the method includes:
  • the second browser receives the first selection instruction, where the first selection instruction is specifically selecting the video and audio information to be sent from the second terminal;
  • the method before the second browser receives the first selection instruction input by the user, the method further includes:
  • the second selection instruction is specifically selecting a participant corresponding to the desired video and audio information from the video and audio information of all the participants
  • the second transmission response message is configured to enable the second browser to determine not to send the second terminal to the conference server when the first browser sends the first media stream to the conference server Video and audio information;
  • the conference server And receiving, by the conference server, a fourth media stream that is sent according to the identifier information, where the fourth media stream includes video and audio information of the participant selected by the user.
  • the first WebRTC application is used by the second terminal according to the first selection instruction Before the conference server sends the first transmission request message, the method further includes:
  • the first video port attribute of the received video information is set to receive only the video port, and the second video port attribute of the unreceived video information is set to only send the video port;
  • the first transmission request message is sent to the conference server by the first WebRTC application of the second terminal.
  • an embodiment of the present invention provides a method for transmitting a media stream in a video conference, where the method includes:
  • the conference server When the conference server accepts the first browser of the first terminal and the second browser of the second terminal accesses the conference server by using the same user login information, and the first browser does not send the first media to the conference server
  • the conference server receives the second browser through the second terminal a first transmission request message sent by the first WebRTC application, where the first transmission request message includes port attribute information in the second browser;
  • the method before the receiving, by the conference server, the first transmission request message sent by the second browser by using the first WebRTC application of the second terminal, the method further includes:
  • the fourth media stream includes a selected participant Video and audio information.
  • the receiving, by the second browser, the second sending according to the port attribute information After the media stream it also includes:
  • the video port attribute of the received video information is set to only send the video port
  • the audio port attribute of the received audio information is set to transmit only the audio port
  • an embodiment of the present invention provides a device for transmitting a media stream in a video conference, where the device is in a terminal, and the device includes:
  • a receiving unit configured to receive a first media stream sent by the conference server, where the first media stream includes video and audio information of all participants in the video conference;
  • the receiving unit is further configured to receive a selection instruction, where the selection instruction is specifically selecting a participant corresponding to the required video and audio information from the video and audio information of all the participants;
  • a sending unit configured to send to the conference server by using a WebRTC application according to the selection instruction Sending a transmission request message, where the transmission request message includes the selected identifier information of the participant;
  • the receiving unit is further configured to receive the second media stream that is sent by the conference server according to the identifier information, the second The media stream includes the selected video and audio information of the participants.
  • the receiving unit is further configured to: according to the selection instruction, receive a creation instruction sent by the WebRTC application;
  • the transmitting device further includes: a calling unit, configured to invoke the extended WebRTC interface according to the creating instruction, and parse the participant attribute of the constraint object in the extended WebRTC interface; Extracting the identification information of the selected participants in the participant attribute, and storing the identification information of each participant in the participant list;
  • the calling unit is further configured to: invoke a content attribute in the extended SDP protocol;
  • the transmitting device further includes: a loading unit, configured to load the participant list into a media source identifier med iacnt-s rc interval of the content attribute in the extended SDP protocol;
  • the unit is configured to carry the med iacnt-s rc interval in the transmission request message, so that the transmission request message includes the selected identifier information of the participant;
  • the sending unit is further configured to send the transmission request message to the conference server by using the WebRTC application.
  • the device further includes: a storage unit, configured to store the identifier information of the selected participant in the In the participant attribute.
  • the receiving unit is further configured to:
  • the transmitting device further includes:
  • a transmitting unit configured to transmit the second media stream to the WebRTC application, so that the WebRTC application plays the second media stream.
  • an embodiment of the present invention provides a device for transmitting a media stream in a video conference, where the device includes:
  • a sending unit configured to: when sending a first media stream to a browser, where the first media stream includes video and audio information of all participants in the video conference;
  • a receiving unit configured to receive a transmission request message sent by the browser through a WebRTC application, where the transmission request message includes a participant corresponding to the required video and audio information selected from the video and audio information of all the participants Identification information;
  • An extracting unit configured to extract, according to the identifier information, video and audio information of the participant corresponding to the identifier information
  • the sending unit is further configured to send a second media stream to the browser, where the second media stream includes the selected video and audio information of the participant.
  • the transmitting device further includes:
  • the extracting unit is further configured to: extract the selected identifier information of the participant from the transmission request message according to the extended WebRTC interface that is invoked;
  • the device further includes: a storage unit, configured to store the selected identification information of the participant in the participant list;
  • the sending unit is further configured to send, by using the established connection between the extended WebRTC interface and the WebRTC application, a transmission response message to the browser, to enable the browser to determine that the conference server has been Establish a transport connection.
  • the extracting unit is specifically configured to: And identifying the media tracking object of the corresponding participant from the extended WebRTC interface, where the media tracking object includes video and audio information of the participant.
  • the media tracking object is carried in the second media stream, such that the second media stream includes the selected participant's video and audio information.
  • an embodiment of the present invention provides a device for transmitting a media stream in a video conference, where each site in the video conference includes a first terminal and a second terminal, and the transmission device is in the second terminal.
  • the device includes:
  • a receiving unit configured to: when the browser of the first terminal accesses the conference server by using the same user login information, and the browser does not send the first media stream to the conference server, receive the first selection instruction
  • the first selection instruction is specifically selecting video and audio information to be sent from the second terminal
  • a sending unit configured to send, by the first WebRTC application of the second terminal, a first transmission request message to the conference server according to the first selection instruction, where the first transmission request message includes a port in the transmission device Attribute information
  • the sending unit is further configured to: when receiving the first transmission response message sent by the conference server according to the first transmission request message, send, according to the port attribute information, the corresponding port to the conference server a second media stream, where the second media stream includes the video and audio information to be sent.
  • the receiving unit is further configured to receive a third media stream that is sent by the conference server, where the third media stream includes video and audio information of all participants in the video conference;
  • the receiving unit is further configured to receive a second selection instruction, where the second selection instruction is specifically Selecting a participant corresponding to the video and audio information in the audio and video information of all the participants;
  • the sending unit is further configured to: according to the second selection instruction, to the first WebRTC application
  • the conference server sends the second transmission request message, where the second transmission request message includes the selected identifier information of the participant;
  • the receiving unit is further configured to receive, by using the first WebRTC application, a second transmission response message sent by the conference server, where the second transmission response message is used to enable the transmitting device to determine when the browsing exists When the first media stream is sent to the conference server, the video and audio information in the second terminal is not sent to the conference server;
  • the receiving unit is further configured to receive a fourth media stream that is sent by the conference server according to the identifier information, where the fourth media stream includes video and audio information of the selected participant.
  • the receiving unit is further configured to receive the first WebRTC application according to the first selection instruction The creation instruction sent;
  • the transmitting device further includes: a calling unit, configured to invoke the extended WebRTC interface according to the creating instruction, and determine a sending video attribute value and a sending audio attribute value of the constraint object in the extended WebRTC interface;
  • a setting unit configured to: when the sent video attribute value is true, set a first video port attribute of the received video information to only receive the video port, and set a second video port attribute of the unreceived video information to only send Video port
  • the setting unit is further configured to: when the sent audio attribute value is true, set an attribute of the audio port as a sending and receiving port;
  • the transmission device further includes: a loading unit, configured to carry the set port attribute information in the first transmission request message, so that the first transmission request message includes port attribute information in the transmission device;
  • the sending unit is further configured to send the first transmission request message to the conference server by using a first WebRTC application of the second terminal.
  • an embodiment of the present invention provides a device for transmitting a media stream in a video conference, where the device includes:
  • a receiving unit configured to: when the transmitting device accepts the first browser of the first terminal, and the second browser of the second terminal accesses the transmitting device by using the same user login information, and the first browser is not Receiving, by the transmission device, the first transmission request message sent by the second browser by using the first WebRTC application of the second terminal, where the first transmission request message includes the second browser Medium port attribute information;
  • a sending unit configured to send, according to the first transmission request message, a first transmission response message to the second browser, to enable the second browser to determine that a transmission connection has been established with the transmission device;
  • the receiving unit is further configured to receive a second media stream that is sent by the second browser according to the port attribute information, where the second media stream includes video and audio information to be sent that is selected from the second terminal.
  • the sending unit is further configured to: send, to the second browser, a third media stream, where the third media stream includes video and audio information of all participants in the video conference;
  • the receiving unit is further configured to receive a second transmission request message sent by the second browser by using the first WebRTC application, where the second transmission request message is included in video and audio information of all participants Selecting the identification information of the participant corresponding to the desired video and audio information;
  • the transmitting device further includes: a determining unit, configured to invoke the extended WebRTC interface according to the second transmission request message, and determine whether the first browser is sending a media stream;
  • a setting unit configured to set a port attribute of the transmission device to a sending only port if the first browser is transmitting a media stream
  • the sending unit is further configured to: carry the set port attribute information in the second transmission response message. And sending, by the first WebRTC application, the second transmission response message to the second browser, where the second transmission response message is used to cause the second browser to determine when the first browsing exists When the media stream is sent to the transmitting device, the video and audio information in the second terminal is not sent to the transmitting device;
  • the transmitting device further includes: an extracting unit, configured to extract, according to the identifier information, video and audio information of the participant corresponding to the identifier information;
  • the sending unit is further configured to send a fourth media stream to the second browser, where the fourth media stream includes video and audio information of the selected participant.
  • the sending unit is further configured to: according to the port attribute information, to the second browser The corresponding port sends a fifth media stream.
  • the determining unit is further configured to: call the extended WebRTC interface, and determine the The received video attribute value of the constraint object and the received audio attribute value in the extended WebRTC interface; the setting unit is further configured to: when the judgment result of the determining unit is that the received video attribute value is true, The video port attribute of the video information is set to only send the video port;
  • the setting unit is further configured to: when the judgment result of the determining unit is that when the received audio attribute value is true, set an audio port attribute of the received audio information to only transmit an audio port;
  • the unit is further configured to: carry the set port attribute information in the third transmission request message, and send the third transmission request message to the first browser, where the third transmission request message is used to enable the The first browser determines not to transmit the video and audio information in the first terminal to the transmitting device.
  • the browser of the terminal performs an instruction according to the video and audio information of all participants in the video conference, Sending a transmission request message to the conference server, and then receiving the selected video and audio information of the participant, and playing the received video and audio information through the WebRTC application, thereby solving the problems in the prior art, and the browser receiving the specific participation.
  • the video and audio of the user shields the video and audio of the participants who are not interested in the user, enhances the function of the WebRTC video conference, improves the user experience, and saves network bandwidth and local resource consumption of the terminal.
  • FIG. 1 is a schematic diagram of a prior art WebRTC technology system
  • FIG. 2 is a flowchart of a method for transmitting a media stream in a video conference according to Embodiment 1 of the present invention
  • FIG. 3 is a flowchart of a method for transmitting a media stream in a video conference according to Embodiment 2 of the present invention
  • FIG. 5 is a flowchart of a method for transmitting a media stream in a video conference according to Embodiment 3 of the present invention
  • FIG. 6 is a flowchart of a video conference in a video conference according to Embodiment 3 of the present invention
  • FIG. 7 is a signaling diagram of a method for transmitting a media stream in a video conference according to an embodiment of the present invention
  • FIG. 8 is a schematic diagram of a structure of a media stream transmission device in a video conference according to Embodiment 5 of the present invention
  • FIG. 9 is a structural diagram of a media stream transmission apparatus in a video conference according to Embodiment 6 of the present invention
  • FIG. 10 is a structural diagram of a media stream transmission apparatus in a video conference according to Embodiment 7 of the present invention
  • FIG. 12 is a hardware connection of the media stream transmission device in the video conference provided in the ninth embodiment of the present invention
  • Figure 13 the device hardware configuration diagram of the transmission of video conference Embodiment 10 of the media stream provided by the embodiment of the invention
  • FIG. 14 transmitting apparatus videoconferencing hardware structure provided according to the eleventh embodiment of the present invention, a media stream;
  • FIG. 15 is a hardware structural diagram of a media stream transmission apparatus in a video conference according to Embodiment 12 of the present invention. detailed description
  • FIG. 2 is a flowchart of a method for transmitting a media stream in a video conference according to Embodiment 1 of the present invention.
  • the terminal specifically refers to a mobile terminal such as a smart phone or a tablet computer, or a fixed terminal such as a personal computer or a smart TV.
  • the embodiment specifically includes the following steps:
  • Step 21 Receive a first media stream sent by the conference server, where the first media stream includes video and audio information of all participants in the video conference.
  • the browser of the terminal accesses the conference server, that is, when the browser establishes a connection with the conference server, the browser receives the first media stream sent by the conference server, where the first media The stream includes video and audio information of all participants in the video conference.
  • the browser logs in to the web server to obtain the WebRTC video conference application webpage; the browser receives the login information (user name and password) input by the user, and sends the authentication information to the network server, the authentication information includes the user name and the password; the web server sends the authentication information to the database. ; Database for data validation Afterwards, the conference information is sent to the network server, the conference information includes the IP address of the video conference, the port number, and the like; the network server sends the obtained conference information to the WebRTC application of the terminal; the WebRTC application sends a creation instruction to the browser according to the received conference information.
  • the browser creates a connection object, and adds video and audio information stored by the terminal in the connection object; the browser creates a connection request message by creating the connection object, and carries the connection object in the connection request message, and the browser Receiving a save instruction sent by the WebRTC application, and carrying the media attribute information of the terminal in the connection request message, the browser sends a connection request message to the WebRTC application, and the WebRTC application sends the connection request message to the conference server, and the conference server according to the connection request message.
  • connection object save the media attribute information of the terminal, and create a connection response message according to the connection request message, and carry the media attribute information of the conference server in the connection response message; the conference server uses the WebRTC application to the browser The connection response message is sent.
  • the browser accesses the conference server, that is, the browser establishes a connection with the conference server.
  • Step 220 Receive a selection instruction, where the selection instruction is specifically selecting a participant corresponding to the desired video and audio information from the video and audio information of all the participants.
  • the browser parses the first media stream and extracts video and audio information of each participant, and displays the video and audio information of each participant in the On the user interface, the browser receives the selection instruction, and the selection instruction is input by the user, and the selection instruction is specifically that the user selects the desired video and audio information from the video and audio information of all the participants displayed on the user interface.
  • the participant that is, the user selects the desired participant according to the video and audio information of all the participants displayed on the user interface.
  • the selected participant is the video and audio information that only receives the selected participant.
  • Step 230 Send, according to the selection instruction, a transmission request message to the conference server by using a WebRTC application, where the transmission request message includes the identifier information of the selected participant.
  • the browser sends a transmission request message to the conference server through the WebRTC application, where the transmission request message includes the identifier information of the selected participant. This identification information is used to determine the participants required by the user.
  • the WebRTC application is a WebRTC application inside the terminal.
  • the browser receives the selection instruction, and extracts the identification information of the selected participant according to the selection instruction, and carries the identification information in the transmission request message.
  • Step 240 Receive a second media stream that is sent by the conference server according to the identifier information, where the second media stream includes video and audio information of the selected participant.
  • the browser after sending the transmission request message to the conference server, the browser receives the second media stream that is sent by the conference server according to the identifier information included in the transmission request message, where the second media stream includes the selected video and audio information of the participant. Further, according to the user's selection, the conference server sends the video and audio information of the specific participant to the terminal, thereby improving the user experience, and also saving network bandwidth and local resource consumption of the terminal.
  • the method further includes the step of the browser generating the transmission request message according to the selection instruction.
  • Specific steps are as follows:
  • the transmission request message is generated according to the selection instruction.
  • the browser receives the creation instruction sent by the WebRTC application; according to the creation instruction, the browser invokes the extended WebRTC interface, and parses the participant attribute of the constraint object in the extended WebRTC interface; the browser slave parameter Extracting the identification information of the selected participants in the attribute of the participant; and storing the identification information of each participant in the participant list; the browser invokes the content attribute in the extended SDP protocol; the browser will participate
  • the list is loaded into the media source identifier med i acnt-s rc of the content attribute in the extended SDP protocol; the browser carries the med iacnt-s rc interval in the transmission request message, so that the transmission request message includes the selected The identification information of the participant, and the transmission request message is sent to the conference server through the WebRTC application of the terminal.
  • the browser also includes the step of storing the selected identifier information of the participant in the participant attribute.
  • the participant attribute may be extended to save other related information about the participant. In the embodiment of the present invention, only the saving identification information is taken as an example. Note that in the actual application, other relevant information about the participants can also be saved.
  • the administrator expands and adds functions to the browser in advance, that is, the WebRTC interface of the extended browser, and the SDP protocol of the browser at runtime, and expands the browser. After that, the browser function is added, so that the browser can run the extended interface and protocol.
  • the administrator extends the constraint object in the WebRTC interface of the browser, and adds a participant attribute to the constraint object, the participant attribute is used to save the identification information of the selected participant; the administrator generates a transmission request in the browser.
  • a function is added to the method of the message, so that the browser extracts the value of the participant attribute and stores the extracted value in the participant list; the manager extends the content attribute of the SDP protocol, and increases the med iacnt-s rc interval to store the parameter.
  • the identifier of the participant the browser then loads the participant ⁇ 'J table into the med iacnt- s rc interval, and carries the med iacnt_s rc interval in the transmission request message, so that the transmission request message includes the selected parameter Identification information of the participants.
  • the method further includes: the browser receiving, by using the WebRTC application, the transmission response message sent by the conference server according to the transmission request message.
  • the browser can determine that a transmission connection has been established with the conference server, and the conference server is ready to send a second media stream to the browser.
  • the browser receives the transmission response message sent by the conference server according to the transmission request message through the WebRTC application, so that the browser determines that the transmission connection has been established with the conference server, and the conference server is ready to send the second media stream to the browser.
  • the method further includes the step of the browser transmitting the second media stream to the WebRTC application, so that the WebRTC application plays the second media stream, by using the The step can play the second media stream to the user.
  • the browser transmits the second media stream to the WebRTC application, so that the WebRTC application plays the second media stream to the user, or the WebRTC application transmits the second media stream to other applications, and the other application processes the second media stream. , for example, storage, etc.
  • the browser of the terminal sends a transmission request message to the conference server according to an instruction for selecting video and audio information of all participants in the video conference, and further Receiving the video and audio information of the selected participant and playing the received video and audio information through the WebRTC application, thereby solving the problems in the prior art, and the browser receives the video and audio of the specific participant, thereby shielding the video Participants who are not interested in the user's video and audio enhance the WebRTC video conferencing function, improve the user experience, and save network bandwidth and local resource consumption of the terminal.
  • FIG. 3 is a flowchart of a method for transmitting a media stream in a video conference according to Embodiment 2 of the present invention.
  • the implementation entity is a conference server, and the conference server is in a communication network. As shown in FIG. 3, the embodiment specifically includes the following steps:
  • Step 301 Send a first media stream to the browser, where the first media stream includes video and audio information of all participants in the video conference.
  • the conference server when the conference server establishes a connection with the browser of the terminal, that is, when the browser accesses the conference server, the conference server sends a first media stream to the browser, where the first media stream Includes video and audio information of all participants in the video conference.
  • connection between the conference server and the browser is a prior art, which has been briefly described in the foregoing embodiment, and will not be repeated herein.
  • Step 320 Receive a transmission request message sent by the browser through a WebRTC application, where the transmission request message includes an identifier of a participant corresponding to the required video and audio information selected from the video and audio information of all the participants. information.
  • the conference server receives a transmission request message sent by the browser through the WebRTC application, where the transmission request message includes the required view selected from the video and audio information of all the participants.
  • Step 330 Extract, according to the identifier information, video and audio information of the participant corresponding to the identifier information.
  • the conference server parses and extracts the identifier information of the participant included in the transmission request message, and extracts the video and audio information of the participant corresponding to the identifier information according to the identifier information.
  • Step 340 Send a second media stream to the browser, where the second media stream includes the selected video and audio information of the participant.
  • the conference server extracts the video and audio information of the participant corresponding to the identifier information
  • the second media stream includes the selected video and audio information of the participant, thereby implementing According to the user's selection
  • the conference server sends the video and audio information of the specific participant to the terminal, which improves the user experience, and also saves network bandwidth and local resource consumption of the terminal.
  • the step of the conference server generating and transmitting the transmission response message according to the transmission request message is further included. By sending a transmission response message, the browser can explicitly establish a transmission connection with the conference server, and the conference server is ready to send a second media stream to the browser. Specific steps are as follows:
  • a transmission response message is generated according to the transmission request message.
  • the conference server generates a transmission response message according to the transmission request message, and when the transmission response message is generated, the extended WebRTC interface is invoked, and the conference server sends the connection established between the extended WebRTC interface and the WebRTC application to the browser. Transmitting a response message, so that the browser determines that a transmission connection has been established with the conference server; the conference server extracts the identification information of the selected participant from the transmission request message according to the invoked extended WebRTC interface, and selects the selected The identification information of the participants is stored in the participant list.
  • the administrator expands and adds functions to the conference server in advance, that is, expands the WebRTC interface of the conference server, and after expanding the conference server, adds the function of the conference server to make the conference
  • the server can run on the extended interface and protocol.
  • the administrator extends the WebRTC interface of the conference server, and adds a function in the method for generating the transmission response message, so that the conference server can extract at least one participant from the med i acnt-s rc interval in the transmission request message.
  • the identification information is stored, and the extracted identification information of at least one participant is stored in the participant list.
  • the method for extracting the video and audio information of the participant corresponding to the identifier information according to the identifier information in step 330 of the embodiment of the present invention specifically includes:
  • the conference server extracts, according to the identifier information of the participant selected by the user stored in the participant list, the media tracking object of the corresponding participant from the extended WebRTC interface, where the media tracking object includes the participant. Video and audio information.
  • the administrator extends the WebRTC interface of the conference server, and expands the media tracking object in the WebRTC interface, so that the media tracking object can store the video and audio information of the participant.
  • the second media stream is sent to the browser, where the second media stream includes the selected video and audio information of the participant, including:
  • the conference server carries the media tracking object in the second media stream such that the second media stream includes the selected participant's video and audio information.
  • the browser of the terminal sends a transmission request message to the conference server according to an instruction for selecting video and audio information of all participants in the video conference, and further Receiving the video and audio information of the selected participant and playing the received video and audio information through the WebRTC application, thereby solving the problems in the prior art, and the browser receives the video and audio of the specific participant, thereby shielding the video Participants who are not interested in the user's video and audio enhance the WebRTC video conferencing function, improve the user experience, and save network bandwidth and local resource consumption of the terminal.
  • FIG. 4 is a signaling diagram of a method for transmitting a media stream in a video conference according to an embodiment of the present invention
  • the signaling diagram shown in FIG. 4 is a media stream transmission process performed by a browser, a WebRTC application, and a conference server
  • the method for transmitting the media stream in the video conference in FIG. 4 can be performed according to the process described in the foregoing embodiment, and will not be repeated herein.
  • FIG. 5 is a flowchart of a method for transmitting a media stream in a video conference according to Embodiment 3 of the present invention.
  • a conference site includes a first terminal and a second terminal, and the first terminal and the second terminal are The first user of the same user, that is, the first browser of the first terminal and the second browser of the second terminal, can access the conference server through the login information of the same user.
  • the implementation entity is in the second terminal.
  • the second browser in the embodiment of the present invention specifically refers to a mobile terminal such as a smart phone or a tablet computer; or a fixed terminal such as a personal computer or a smart TV. As shown in FIG. 5, the embodiment specifically includes the following steps:
  • Step 51 0 The first browser of the first terminal and the second browser of the second terminal access the conference server by using the same user login information, and the first browser does not send the first media stream to the conference server.
  • the second browser receives the first selection instruction, where the first selection instruction is specifically selecting the video and audio information to be sent from the second terminal.
  • the second browser when the first browser of the first terminal and the second browser of the second terminal access the conference server through the same user login information, that is, the first browser, the second browser When the first browser does not send the first media stream to the conference server, the second browser receives the first selection instruction, where the first selection instruction is input by the user, and the first selection is The command is specifically that the user selects the video and audio information to be sent from the video and audio information that is stored in the second terminal or that is acquired by the second terminal in real time.
  • the first media stream specifically includes the first terminal. Video and audio information.
  • first browser and the second browser accessing the conference server are prior art, which have been briefly described in the foregoing embodiments, and will not be repeated herein.
  • the first browser and the second browser may respectively receive the video frequency information of the selected participant from the conference server according to the foregoing embodiment.
  • the video and audio information obtained by the second terminal in real time in the embodiment of the present invention specifically refers to: real-time video and audio information acquired by the camera and the microphone of the second terminal device itself.
  • Step 520 According to the first selection instruction, the first WebRTC that passes the second terminal should Sending a first transmission request message to the conference server, where the first transmission request message includes port attribute information in the second browser.
  • the second browser sends a first transmission request message to the conference server by using the first WebRTC application of the second terminal, where the first transmission request message includes port attribute information in the second browser.
  • the port attribute information in the second browser specifically refers to a classification of ports in the second browser, that is, a port for transmitting only video information, a port for receiving only video information, and both transmitting and receiving.
  • the port for audio information specifically refers to a classification of ports in the second browser, that is, a port for transmitting only video information, a port for receiving only video information, and both transmitting and receiving.
  • Step 530 When receiving the first transmission response message sent by the conference server according to the first transmission request message, send a second media stream to the conference server through the corresponding port according to the port attribute information.
  • the second media stream includes the video and audio information to be transmitted.
  • the second browser when the second browser receives the first transmission response message sent by the conference server according to the first transmission request message, the second browser determines that a transmission connection has been established with the conference server, and the second browser is configured according to the port attribute information. Transmitting, by the corresponding port (ie, a port that only sends video information, or a port that can send audio information), to the conference server, where the second media stream includes video and audio information to be sent, Further, in a video conference, video/audio can be uploaded to the conference server through the first browser of the first terminal or the second browser of the second terminal, thereby improving the user experience.
  • the corresponding port ie, a port that only sends video information, or a port that can send audio information
  • the second browser before the second browser receives the first selection instruction input by the user, the second browser further includes, by the second browser, receiving, by the conference server, video and audio information of the participant selected by the user, and the like. step. Specific steps are as follows:
  • the second browser accesses the conference server
  • a third media stream that is sent, where the third media stream includes video and audio information of all participants in the video conference.
  • the second browser parses the third media stream and extracts video and audio information of each participant, and views each participant.
  • the audio information is displayed on the user interface
  • the second browser receives the second selection instruction
  • the second selection instruction is input by the user
  • the second selection instruction is specifically the view of all the participants displayed by the user from the user interface.
  • the participant corresponding to the desired video and audio information is selected, that is, the user selects the desired participant according to the video and audio information of all the participants displayed on the user interface.
  • the selected participant is the video and audio information that only receives the selected participant.
  • the second browser sends a second transmission request message to the conference server by using the first WebRTC application, where the second transmission request message includes the identification information of the selected participant. This identification information is used to determine the participants required by the user.
  • the second browser receives the second selection instruction, and further extracts the identification information of the participant selected by the user according to the second selection instruction, and carries the identification information in the second transmission request message.
  • the second browser receives, by the first WebRTC application, a second transmission response message sent by the conference server according to the second transmission request message, where the second transmission response message includes attribute information of the conference server (for example, the conference server Media attribute information, and the like, and the selected identifier information of the participant, so that the second browser explicitly does not send the view in the second terminal to the conference server when the first browser sends the first media stream to the conference server.
  • the conference server only accepts one browser to upload video and audio information.
  • the fourth media stream that is sent by the conference server according to the identifier information included in the second transmission request message, where the fourth media stream includes the selected parameter.
  • the method further includes the step of the second browser generating the first transmission request message according to the first selection instruction.
  • Specific steps are as follows:
  • the second browser receives the creation instruction sent by the first WebRTC application; according to the creation instruction, the second browser invokes the extended WebRTC interface, and determines the sending of the constraint object in the extended WebRTC interface.
  • the video attribute value and the sent audio attribute value when the sent video attribute value is true, the second browser sets the first video port attribute of the received video information to only receive the video port, and the second video that does not receive the video information
  • the port attribute is set to send only the video port; when the sent audio attribute value is true, the second browser sets the attribute of the audio port as the sending and receiving port; the second browser carries the set port attribute information in the first transmission.
  • the request message is such that the first transmission request message includes attribute information of a port in the second browser.
  • the administrator expands and adds functions to the second browser in advance, that is, expands the WebRTC interface of the second browser, and after expanding the second browser, adds the first
  • the function of the second browser enables the second browser to run on the extended interface and protocol.
  • the administrator extends the constraint object in the WebRTC interface of the second browser, adds a sending video attribute value to the constraint object, and sends an audio attribute value, where the attribute value is used to set the attribute of the port in the second browser, and the attribute value True or false; the administrator adds a function in the method for the second browser to generate the first transmission request message, so that the second browser can determine the attribute value, and set the attribute of the port, and carry the set port attribute information.
  • the first transmission request message includes attribute information of a port in the second browser.
  • the second browser can make the second browser conveniently manage the port by setting the attribute of the port, and when the media stream is sent to the conference server, the port is sent according to the attribute of the port, and the conference server is also made clear.
  • the port attribute of the second browser when receiving the media stream sent by the conference server, is correspondingly received according to the attribute of the port, and improves the utilization of the port.
  • the media stream transmission method in the video conference provided by the embodiment of the present invention, multiple terminals belonging to the same user can simultaneously access the conference server and receive video and audio information of a specific participant, when the first browser is not
  • the conference server sends the first media stream
  • the second browser generates a first transmission request message according to the received selection instruction, where the first transmission request message includes attribute information of the port in the second browser;
  • the attribute information is sent to the conference server to send the second media stream, thereby solving the problem in the prior art.
  • two or more terminal devices participate in the same video conference, and each terminal receives the video and audio information of the specific participant. And the user can switch the terminal to upload local video and audio information.
  • the fourth embodiment of the present invention provides a method for transmitting a media stream in a video conference according to the fourth embodiment of the present invention.
  • the implementation object is a conference server, and the conference server is located in a communication network.
  • the embodiment specifically includes the following steps:
  • Step 61 0 When the conference server accepts the first browser of the first terminal and the second browser of the second terminal accesses the conference server by using the same user login information, and the first browser does not send to the conference server When the first media stream is sent, the conference server receives a first transmission request message sent by the second browser by using the first WebRTC application of the second terminal, where the first transmission request message includes the second browsing Attribute information of the port in the device.
  • the conference server when the conference server accepts that the first browser of the first terminal and the second browser of the second terminal access the conference server through the same user login information, that is, the first browser, the conference server receives the first transmission request message sent by the second browser through the first WebRTC application of the second terminal.
  • the first transmission request message includes the attribute information of the port in the second browser.
  • the first media stream specifically includes video and audio information stored in the first terminal, and the first terminal and the second terminal The terminal is used by the same user.
  • connection between the conference server and the first browser and the second browser is a prior art, which has been briefly described in the foregoing embodiment, and will not be repeated herein.
  • the attribute information of the port in the second browser specifically refers to the classification of the port in the second browser, that is, the port for transmitting only the video information, and the port for receiving only the video information. And a port that can both send and receive audio information.
  • Step 620 Send a first transmission to the second browser according to the first transmission request message. And a response message, configured to enable the second browser to determine that a transport connection has been established with the conference server.
  • the conference server parses and extracts the attribute information of the port in the second browser included in the first transmission request message. According to the transmission request message, the conference server determines the classification of each port in the second browser (that is, the conference server explicitly sends/receives to the corresponding port according to the attribute information of the port in the second browser when subsequently transmitting/receiving the media stream. Media stream), the conference server sends a first transmission response message to the second browser.
  • the first transmission response message is used to enable the second browser to determine that a transmission connection has been established with the conference server.
  • Step 630 Receive a second media stream that is sent by the second browser according to the attribute information of the port, where the second media stream includes video and audio information to be sent that is selected from the second terminal.
  • the conference server receives, by the second browser, a second media stream that is sent according to the attribute information of the port, that is, a port that only sends the video information, or a port that can send or receive the audio information, where the second media stream is sent.
  • the video and audio information to be sent selected by the user from the video and audio information stored in the second terminal or acquired by the second terminal in real time, thereby implementing the first browser or the second terminal that can pass through the first terminal in one video conference.
  • the second browser of the terminal uploads video/audio to the conference server to improve the user experience.
  • the conference server before the conference server receives the first transmission request message sent by the second browser by using the first WebRTC application of the second terminal, the conference server further includes the conference server sending the message to the second browser. Select the participant's video and audio information and other steps. The specific steps are as follows: Send a third media stream to the second browser, where the third media stream includes video and audio information of all participants in the video conference.
  • the conference server when the conference server establishes a connection with the second browser, that is, when the second browser accesses the conference server, the conference server sends a third media stream to the second browser, where The third media stream includes video and audio information of all participants in the video conference.
  • the connection between the conference server and the second browser is the prior art, which has been briefly described in the foregoing embodiment, and will not be repeated herein.
  • the conference server receives a second transmission request message sent by the second browser by using the first WebRTC application, where the second transmission request message includes all participants.
  • the identification information of the participant corresponding to the desired video and audio information selected in the video and audio information.
  • the conference server parses and extracts the identifier information of the participant included in the second transmission request message, invokes the extended WebRTC interface, and determines whether the first browser is transmitting the media stream.
  • the conference server determines whether the first browser is transmitting the media stream by using connection information (for example, user identification information, connection identification information, whether audio/video information is being uploaded, etc.) of the user previously saved in the database.
  • connection information for example, user identification information, connection identification information, whether audio/video information is being uploaded, etc.
  • the conference server when each browser accesses the conference server, the conference server creates a data structure to store connection information of the user corresponding to each browser, and stores the created connection information of the user in a database, where the database is located.
  • the conference server creates a data structure to store connection information of the user corresponding to each browser, and stores the created connection information of the user in a database, where the database is located.
  • the communication network In the communication network.
  • the conference server sets its own port attribute to only the send port, that is, the non-receive port.
  • the conference server carries the set port attribute information in the second transmission response message, and sends a second transmission response message to the second browser by using the first WebRTC application, where the second transmission response message is used to enable
  • the second browser determines that when the first browser sends the media stream to the conference server, the video and audio information in the second terminal is not sent to the conference server.
  • the administrator expands and adds functions to the conference server in advance, that is, expands the WebRTC interface of the conference server, and after expanding the conference server, adds the function of the conference server to make the conference
  • the server can run on the extended interface and protocol.
  • the administrator extends the WebRTC interface of the conference server, and adds a function in the method for generating the second transmission response message, so that the conference server can determine whether the first browser is sending the media stream, if the first browser is sending the media stream. , set its own port attribute to only the sending port, and carry the set port attribute information in the second transmission response message.
  • the conference server extracts the video and audio information of the participant corresponding to the identifier information according to the identifier information of the participant extracted from the second transmission request message according to the foregoing optional step.
  • the conference server may extract the identifier information of the at least one participant from the transmission request message, and the conference server extracts the corresponding conference from the extended WebRTC interface according to the extracted identifier information of the at least one participant.
  • Media tracking object the media tracking object includes parameters Video and audio information of the participants.
  • the administrator extends the WebRTC interface of the conference server, and expands the media tracking object in the WebRTC interface, so that the media tracking object can store the participant's video and audio information.
  • the fourth media stream is sent to the second browser, where the fourth media stream includes the selected video and audio information of the participant. Further, according to the user's selection, the video and audio information of the conference server to the specific participant of the terminal improves the user experience, and also saves network bandwidth and resource consumption of the terminal local.
  • the step 630 further includes the step of the conference server sending the media stream to the second browser, where the step is The media stream can be transmitted between the second browser and the conference server, so that the user can transfer the media stream to the conference server through different terminals in one video conference, thereby improving the user experience.
  • Specific steps are as follows:
  • the conference server sends the fifth media stream to the corresponding port in the second browser according to the attribute information of the port in the second browser included in the first transmission request message received in step 61 0.
  • the fifth media stream includes the selected video and audio information of the participants, or the video and audio information of all the participants.
  • the conference server transmits video information to a port that receives only video information in the second browser, and transmits audio information to a port that can transmit or receive audio information.
  • the conference server will also perform the step of terminating the first browser to send the media stream in order to reduce the limitation on the network bandwidth.
  • the extended WebRTC interface is called, and the received video attribute value of the constraint object in the extended WebRTC interface and the received audio attribute value are determined.
  • the conference server invokes the extended WebRTC interface, and determines the received video attribute value and the received audio attribute value of the constraint object in the expanded WebRTC interface.
  • the video port attribute of the received video information is set to only transmit the video port.
  • the conference server sets the video port attribute of the received video information to only the video port.
  • the audio port attribute of the received audio information is set to transmit only the audio port.
  • the conference server sets the audio port attribute of the received audio information to only the audio port.
  • the conference server carries the set port attribute in the third transmission request message, and sends a third transmission request message to the first browser, where the third transmission request message is used to cause the first browser to determine not to
  • the conference server sends the video and audio information in the first terminal.
  • the first browser After receiving the third transmission request message, the first browser parses and extracts the port attribute of the conference server included in the third transmission request message, and clarifies that the conference server refuses to receive the video and audio information sent by itself, and sends a third transmission response message to the conference server.
  • the conference server is clear only to the first The browser sends the media stream without receiving the media stream sent by the first browser, thereby implementing uploading the media stream to the conference server through different terminals in one video conference.
  • the administrator expands and adds functions to the conference server in advance, that is, expands the WebRTC interface of the conference server, and after expanding the conference server, adds the function of the conference server to make the conference
  • the server can run on the extended interface and protocol.
  • the administrator extends the constraint object in the WebRTC interface of the conference server, adds a received video attribute value to the constraint object, and receives an audio attribute value, where the attribute value is used to set an attribute of the port in the conference server, and the attribute value is true or
  • the administrator adds a function to the method in which the conference server generates the third transmission request message, so that the second browser can determine the attribute value, and set the attribute of the own port, and carry the set port attribute in the third transmission request message.
  • the third transmission request message includes attribute information of the own port.
  • the media stream transmission method in the video conference provided by the embodiment of the present invention, multiple terminals belonging to the same user can simultaneously access the conference server and receive video and audio information of a specific participant, when the first browser is not
  • the conference server sends the first media stream
  • the second browser generates a first transmission request message according to the received selection instruction, where the first transmission request message includes attribute information of the port in the second browser;
  • the attribute information is sent to the conference server to send the second media stream, thereby solving the problem in the prior art.
  • two or more terminal devices participate in the same video conference, and each terminal receives the video and audio information of the specific participant. And the user can switch the terminal to upload video and audio information.
  • enhancing the WebRTC video conferencing function improving the user experience, and saving network bandwidth and local resource consumption of the terminal.
  • FIG. 7 is a signaling diagram of another method for transmitting a media stream in a video conference according to an embodiment of the present invention
  • the signaling diagram shown in FIG. 7 is a media stream of multiple browsers, a WebRTC application, and a conference server.
  • the transmission process, the media stream transmission method in the video conference in FIG. 7 can be implemented according to the foregoing The process described in the example is executed and will not be repeated here.
  • the fifth embodiment of the present invention further provides a media stream transmission device in a video conference, which is used to implement a media stream transmission method in the video conference in the first embodiment.
  • the transmission device is located.
  • the transmitting device includes: a receiving unit 810 and a sending unit 820.
  • the receiving unit 810 is configured to receive a first media stream sent by the conference server, where the first media stream includes video and audio information of all participants in the video conference;
  • the receiving unit 810 is further configured to receive a selection instruction, where the selection instruction is specifically selecting a participant corresponding to the required video and audio information from the video and audio information of all the participants;
  • the sending unit 820 is configured to send, by using the WebRTC application, a transmission request message to the conference server according to the selection instruction, where the transmission request message includes the identifier information of the selected participant, and the receiving unit 810 is further configured to: And receiving, by the conference server, a second media stream that is sent according to the identifier information, where the second media stream includes video and audio information of the selected participant.
  • the receiving unit 810 is further configured to: receive, according to the selection instruction, a creation instruction sent by the WebRTC application;
  • the transmitting device further includes: a calling unit 830, configured to invoke the extended WebRTC interface according to the creating instruction, and parse the participant attribute of the constraint object in the extended WebRTC interface; and the extracting unit 840 is configured to: Extracting the identification information of the selected participant from the participant attribute, and storing the identification information of each participant in the participant list;
  • the calling unit 830 is further configured to: invoke a content attribute in the extended SDP protocol;
  • the transmitting device further includes: a loading unit 850, configured to load the participant list into the med i acnt-s rc interval of the content attribute in the extended SDP protocol;
  • the unit 860 is configured to carry the med iacnt-s rc interval in the transmission request message, so that the transmission request message includes the selected identifier information of the participant;
  • the sending unit 820 is further configured to send the transmission request message to the conference server by using the WebRTC application.
  • the device further includes: a storage unit 870, configured to store the selected identifier information of the participant in the participant attribute.
  • the receiving unit 81 is further configured to receive, by using the WebRTC application, a transmission response message sent by the conference server according to the transmission request message, to determine that a transmission connection has been established with the conference server.
  • the transmission device further includes: a transmission unit 880, configured to transmit the second media stream to the WebRTC application, so that the WebRTC application plays the second media stream.
  • the browser of the terminal sends a transmission request message to the conference server according to an instruction for selecting video and audio information of all participants in the video conference, and further Receiving the video and audio information of the selected participant and playing the received video and audio information through the WebRTC application, thereby solving the problems in the prior art, and the browser receives the video and audio of the specific participant, thereby shielding the video Participants who are not interested in the user's video and audio enhance the WebRTC video conferencing function, improve the user experience, and save network bandwidth and local resource consumption of the terminal.
  • the sixth embodiment of the present invention further provides a media stream transmission device in a video conference, which is used to implement a method for transmitting a media stream in a video conference in the second embodiment.
  • the transmission device includes : a transmitting unit 91 0, a receiving unit 920, and an extracting unit 930.
  • the sending unit 91 0 is configured to send, to the browser, a first media stream, where the first media stream includes video and audio information of all participants in the video conference;
  • the receiving unit 920 is configured to receive a transmission request message sent by the browser through a WebRTC application, where the transmission request message includes a required view selected from video and audio information of all participants Identification information of the participant corresponding to the audio information;
  • the extracting unit 930 is configured to extract, according to the identifier information, audio and video information of the participant corresponding to the identifier information;
  • the sending unit 910 is further configured to send a second media stream to the browser, where the second media stream includes the selected video and audio information of the participant.
  • the transmitting device further includes: a calling unit 940, configured to invoke a WebRTC interface of the extended port; the extracting unit 930 is further configured to: extract, select, select, from the transmission request message according to the extended WebRTC interface that is invoked Identification information of the participant;
  • the device further includes: a storage unit 950, configured to store the selected identification information of the participant in the participant list;
  • the sending unit 91 0 is further configured to send, by using the established connection between the extended WebRTC interface and the WebRTC application, a transmission response message to the browser, to enable the browser to determine the conference.
  • the server has established a transport connection.
  • the extracting unit 930 is configured to: extract, according to the selected identifier information of the participant stored in the participant list in the storage unit, a corresponding participant from the extended WebRTC interface.
  • the media tracking object of the user, the media tracking object includes video and audio information of the participant.
  • the sending unit is specifically configured to carry the media tracking object in the second media stream, so that the second media stream includes the selected video and audio information of the participant.
  • the browser of the terminal sends a transmission request message to the conference server according to an instruction for selecting video and audio information of all participants in the video conference, and further Receiving the video and audio information of the selected participant and playing the received video and audio information through the WebRTC application, thereby solving the problems in the prior art, and the browser receives the video and audio of the specific participant, thereby shielding the video Participants who are not interested in the user's video and audio enhance the WebRTC video conferencing function, improve the user experience, and save network bandwidth. And the local resource consumption of the terminal.
  • the seventh embodiment of the present invention further provides a media stream transmission device in a video conference, which is used to implement a method for transmitting a media stream in a video conference in the third embodiment, as shown in FIG. 10, in the video conference.
  • Each of the conference sites includes a first terminal and a second terminal, and the transmission device is located in the second terminal, and the transmission device includes: a receiving unit 1010 and a sending unit 1 020.
  • the receiving unit 1010 is configured to: when the browser of the first terminal accesses the conference server by using the same user login information as the transmission device, and the browser does not send the first media stream to the conference server, receive the first a selection instruction, where the first selection instruction specifically selects video and audio information to be sent from the second terminal;
  • the sending unit 1020 is configured to send, by using the first WebRTC application of the second terminal, a first transmission request message to the conference server according to the first selection instruction, where the first transmission request message is included in the transmission device.
  • Port attribute information ;
  • the sending unit 1020 is further configured to: when receiving the first transmission response message sent by the conference server according to the first transmission request message, send, according to the port attribute information, to the conference server by using a corresponding port. a second media stream, where the second media stream includes the video and audio information to be sent.
  • the receiving unit 1010 is further configured to receive a third media stream sent by the conference server, where the third media stream includes video and audio information of all participants in the video conference;
  • the receiving unit 1010 is further configured to receive a second selection instruction, where the second selection instruction is specifically selecting a participant corresponding to the required video and audio information from the video and audio information of all the participants;
  • the sending unit 1020 is further configured to send, according to the second selection instruction, the second transmission request message to the conference server by using the first WebRTC application, where the second transmission request message includes the selected conference Identification information of the person;
  • the receiving unit 100 is further configured to receive, by using the first WebRTC application, a second transmission response message sent by the conference server, where the second transmission response message is used to enable the transmitting device to determine when the presence When the browser sends the first media stream to the conference server, the video and audio information in the second terminal is not sent to the conference server;
  • the receiving unit 100 is further configured to receive a fourth media stream that is sent by the conference server according to the identifier information, where the fourth media stream includes video and audio information of the selected participant.
  • the transmitting device further includes: the receiving unit 100 is further configured to receive, according to the first selection instruction, a creation instruction sent by the first WebRTC application;
  • the transmitting device further includes: a calling unit 1 030, configured to invoke the extended WebRTC interface according to the creating instruction, and determine a sending video attribute value and a sending audio attribute value of the constraint object in the extended WebRTC interface;
  • the setting unit 1 040 is configured to: when the sent video attribute value is true, set the first video port attribute of the received video information to only receive the video port, and set the second video port attribute of the unreceived video information to Send only the video port;
  • the setting unit 1 040 is further configured to: when the sent audio attribute value is true, set an attribute of the audio port as a sending and receiving port;
  • the transmission device further includes: a loading unit 1 050, configured to carry the set port attribute information in the first transmission request message, so that the first transmission request message includes a port attribute in the transmission device Information
  • the sending unit 1 020 is further configured to send, by using the first WebRTC application of the second terminal, the first transmission request message to the conference server.
  • the media stream transmission device in the video conference provided by the embodiment of the present invention, multiple terminals belonging to the same user can simultaneously access the conference server and receive video and audio information of a specific participant, when the first browser is not
  • the conference server sends the first media stream
  • the second browser receives the a first transmission request message
  • the first transmission request message includes attribute information of a port in the second browser
  • the second media stream is sent to the conference server according to the attribute information of the port, thereby solving the existing The problem occurs in the technology.
  • two or more terminal devices participate in the same video conference, each terminal receives video and audio information of a specific participant, and the user can switch the terminal to upload local video and audio information.
  • enhancing the WebRTC video conferencing function improving the user experience, and saving network bandwidth and local resource consumption of the terminal.
  • the eighth embodiment of the present invention further provides a media stream transmission device in a video conference, which is used to implement a method for transmitting a media stream in a video conference in the fourth embodiment.
  • the transmission device includes : receiving unit 1110 and transmitting unit 1120.
  • the receiving unit 1110 is configured to: when the transmitting device accepts the first browser of the first terminal, and the second browser of the second terminal accesses the transmitting device by using the same user login information, and the first browser Receiving, by the second browser, a first transmission request message sent by the first WebRTC application of the second terminal, when the first media stream is not sent to the transmitting device, where the first transmission request message includes the first Port attribute information in the second browser;
  • the sending unit 1120 is configured to send, according to the first transmission request message, a first transmission response message to the second browser, to enable the second browser to determine that a transmission connection has been established with the transmission device;
  • the receiving unit 1110 is further configured to receive a second media stream that is sent by the second browser according to the port attribute information, where the second media stream includes the video and audio to be sent selected from the second terminal. information.
  • the sending unit 1120 is further configured to: send, to the second browser, a third media stream, where the third media stream includes video and audio information of all participants in the video conference;
  • the receiving unit 111 0 is further configured to receive the second browser by using the first WebRTC Transmitting a second transmission request message, where the second transmission request message includes identifier information of the participant corresponding to the required video and audio information selected from the video and audio information of all the participants;
  • the transmitting device further includes: a determining unit 11 30, configured to invoke the extended WebRTC interface according to the second transmission request message, and determine whether the first browser is transmitting a media stream; and the setting unit 1140 is configured to: If the first browser is transmitting the media stream, setting the port attribute of the transmission device to only the sending port;
  • the sending unit 1120 is further configured to: carry the set port attribute information in the second transmission response message, and send the second transmission response message to the second browser by using the first WebRTC application, where The second transmission response message is configured to enable the second browser to determine that the video and audio in the second terminal are not sent to the transmitting device when the first browser sends the media stream to the transmitting device Information
  • the transmitting device further includes: an extracting unit 1150, configured to extract, according to the identifier information, video and audio information of the participant corresponding to the identifier information;
  • the sending unit 1120 is further configured to send a fourth media stream to the second browser, where the fourth media stream includes the selected video and audio information of the participant.
  • the sending unit 1120 is further configured to send, according to the port attribute information, a fifth media stream to a corresponding port in the second browser.
  • the determining unit 11 30 is further configured to: call the extended WebRTC interface, and determine a received video attribute value and a received audio attribute value of the constraint object in the extended WebRTC interface;
  • the setting unit 1140 is further configured to: when the judgment result of the determining unit is that the received video attribute value is true, set the video port attribute of the received video information to only send the video port; the setting unit 1140 The method further includes: when the determining result of the determining unit is that when the received audio attribute value is true, setting an audio port attribute of the received audio information to only transmitting an audio port; The sending unit 1120 is further configured to: carry the set port attribute information in the third transmission request message, and send the third transmission request message to the first browser, where the third transmission request message is used by And causing the first browser to determine not to send the video and audio information in the first terminal to the transmitting device.
  • the media stream transmission device in the video conference provided by the embodiment of the present invention, multiple terminals belonging to the same user can simultaneously access the conference server and receive video and audio information of a specific participant, when the first browser is not
  • the conference server sends the first media stream
  • the second browser generates a first transmission request message according to the received selection instruction, where the first transmission request message includes attribute information of the port in the second browser;
  • the attribute information is sent to the conference server to send the second media stream, thereby solving the problem in the prior art.
  • the user participates in the same video conference through two or more terminal devices, and each terminal receives the video and audio of the specific participant. Information, and the user can switch terminals to upload local video and audio information. This enhances the WebRTC video conferencing function, improves the user experience, and saves network bandwidth and local resource consumption of the terminal.
  • the media stream transmission device in the video conference may be implemented in the following manner, to implement the method for transmitting the media stream in the video conference in the first embodiment of the present invention, as shown in FIG.
  • the transmission device is in a terminal, and the transmission device includes: a network interface 1210, a processor 1220, and a memory 1230.
  • System bus 1240 is used to connect network interface 1210, processor 1220, and memory 1230.
  • the network interface 1210 is for communicating with a conference server, or a user, in a communication network.
  • Memory 1230 can be a persistent storage, such as a hard drive and flash memory, with software modules and device drivers in memory 1230.
  • the software modules are capable of performing the various functional modules of the above described method of the present invention; the device drivers can be network and interface drivers. At startup, these software modules are loaded into memory 1230, then accessed by processor 1220 and executed as follows:
  • the selection instruction is specifically selecting a participant corresponding to the desired video and audio information from the video and audio information of all the participants
  • the conference server And receiving, by the conference server, the second media stream that is sent according to the identifier information, where the second media stream includes the selected video and audio information of the participant.
  • the transmission request message is sent to the conference server by the WebRTC application.
  • processor 1220 accesses the software module of the memory 1230. Further, after the processor 1220 accesses the software module of the memory 1230, the following is performed: Instruction of the process:
  • the identification information of the selected participant is stored in the participant attribute.
  • the browser of the terminal sends a transmission request message to the conference server according to an instruction for selecting video and audio information of all participants in the video conference, and further Receiving the video and audio information of the selected participant and playing the received video and audio information through the WebRTC application, thereby solving the problems in the prior art, and the browser receives the video and audio of the specific participant, thereby shielding the video Participants who are not interested in the user's video and audio enhance the WebRTC video conferencing function, improve the user experience, and save network bandwidth and local resource consumption of the terminal.
  • the media stream transmission device in the video conference may be implemented in the following manner, to implement the method for transmitting the media stream in the video conference in the second embodiment of the present invention, as shown in FIG.
  • the transmission device includes: a network interface 1 31 0, a processor 1 320, and a memory 1 330.
  • System bus 1 340 is used to connect network interface 1 31 0, processor 1 320 and memory 1 330.
  • the network interface 1 31 0 is used for interactive communication with a browser in the terminal.
  • the memory 1 330 may be a permanent memory such as a hard disk drive and a flash memory, and the memory 1 330 There are software modules and device drivers.
  • the software modules are capable of performing the various functional modules of the above described method of the present invention; the device drivers can be network and interface drivers.
  • the browser And receiving, by the browser, a transmission request message sent by the webRTC application, where the transmission request message includes identifier information of the participant corresponding to the required video and audio information selected from the video and audio information of all the participants;
  • the processor 1 320 accesses the software module of the memory 1 330, executing the specific instruction of extracting the video and audio information of the participant corresponding to the identifier information according to the identifier information: Extracting a media tracking object of the corresponding participant from the extended WebRTC interface according to the selected identifier information of the participant stored in the participant list, where the media tracking object includes the Participant's video and audio information.
  • the second media stream is sent to the transmission browser, and the second media stream includes the video and audio of the participant selected by the user.
  • Specific instructions for the information process :
  • the media tracking object is carried in the second media stream, such that the second media stream includes the selected participant's video and audio information.
  • the browser of the terminal sends a transmission request message to the conference server according to an instruction for selecting video and audio information of all participants in the video conference, and further Receiving the video and audio information of the selected participant and playing the received video and audio information through the WebRTC application, thereby solving the problems in the prior art, and the browser receives the video and audio of the specific participant, thereby shielding the video Participants who are not interested in the user's video and audio enhance the WebRTC video conferencing function, improve the user experience, and save network bandwidth and local resource consumption of the terminal.
  • the media stream transmission device in the video conference provided by the seventh embodiment of the present invention may be implemented in the following manner, to implement the method for transmitting the media stream in the video conference in the third embodiment of the present invention, as shown in FIG.
  • Each of the conference sites includes a first terminal and a second terminal, and the transmission device is located in the second terminal, and the transmission device includes: a network interface 140 0, a processor 1420, and a memory 1430.
  • the system bus 1440 is used to connect the network interface 141 0, the processor 1420, and the memory 1430.
  • the network interface 141 0 is for interactive communication with a conference server, or a user, in a communication network.
  • Memory 1430 can be a persistent storage, such as a hard drive and flash memory, with software modules and device drivers in memory 1430.
  • the software modules are capable of performing the various functional modules of the above described method of the present invention; the device drivers can be network and interface drivers.
  • the first The selecting instruction is specifically: selecting the video and audio information to be sent from the second terminal; sending, according to the first selection instruction, the first transmission request message to the conference server by using the first WebRTC application of the second terminal, The first transmission request message includes port attribute information in the second browser;
  • the second selection instruction is specifically selecting a participant corresponding to the desired video and audio information from the video and audio information of all the participants
  • the second transmission response message is configured to enable the transmitting device to determine, when the browser sends the first media stream to the conference server, not to send the video and audio information in the second terminal to the conference server.
  • the first video port attribute of the received video information is set to receive only the video port, and the second video port attribute of the unreceived video information is set to only send the video port;
  • the first transmission request message is sent to the conference server by the first WebRTC application of the second terminal.
  • the media stream transmission method in the video conference provided by the embodiment of the present invention, multiple terminals belonging to the same user can simultaneously access the conference server and receive video and audio information of a specific participant, when the first browser is not
  • the conference server sends the first media stream
  • the second browser generates a first transmission request message according to the received selection instruction, where the first transmission request message includes attribute information of the port in the second browser;
  • the attribute information sends a second media stream to the conference server, thereby solving the problem in the prior art, and simultaneously, the user passes two or more terminal devices.
  • Participating in the same video conference each terminal receives video and audio information of a specific participant, and the user can switch the terminal to upload local video and audio information.
  • enhancing the WebRTC video conferencing function improving the user experience, and saving network bandwidth and local resource consumption of the terminal.
  • the device for transmitting a media stream in the video conference provided in the eighth embodiment of the present invention may be implemented in the following manner, to implement the method for transmitting the media stream in the video conference in the fourth embodiment of the present invention, as shown in FIG.
  • the transmission device includes: a network interface 151 0, a processor 1 520, and a memory 1 530.
  • the system bus 1540 is used to connect the network interface 1 51 0, the processor 1520, and the memory 1530.
  • the network interface 151 0 is for interactive communication with a browser within the terminal.
  • the memory 1530 can be a persistent storage such as a hard disk drive and flash memory, and the memory 1530 has software modules and device drivers.
  • the software modules are capable of performing the various functional modules of the above described methods of the present invention; the device drivers can be network and interface drivers.
  • the transmitting device accepts the first browser of the first terminal and the second browser of the second terminal accesses the transmitting device by using the same user login information, and the first browser does not send the first browser to the conference server
  • processor 1520 accesses the software module of the memory 1530. Further, after the processor 1520 accesses the software module of the memory 1530, the following is performed: Instruction of the process:
  • processor 1520 accesses the software module of the memory 1530, the instructions of the following process are executed:
  • processor 1520 accesses the software module of the memory 1530, the instructions of the following process are executed:
  • the video port attribute of the received video information is set to only send the video port
  • the audio port attribute of the received audio information is set to transmit only the audio port
  • the media stream transmission device in the video conference provided by the embodiment of the present invention, multiple terminals belonging to the same user can simultaneously access the conference server and receive video and audio information of a specific participant, when the first browser is not
  • the conference server sends the first media stream
  • the second browser generates a first transmission request message according to the received selection instruction, where the first transmission request message includes attribute information of the port in the second browser;
  • the attribute information is sent to the conference server to send the second media stream, thereby solving the problem in the prior art.
  • two or more terminal devices participate in the same video conference, and each terminal receives the video and audio information of the specific participant. And the user can switch the terminal to upload local video and audio information.
  • RAM random access memory
  • ROM read-only memory
  • electrically programmable ROM electrically erasable programmable ROM
  • registers hard disk, removable disk, CD-ROM, or technical field Any other form of storage medium known.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • General Business, Economics & Management (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Telephonic Communication Services (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

本发明实施例涉及一种视频会议中媒体流的传输方法。所述方法包括:接收会议服务器发送的第一媒体流,所述第一媒体流包括视频会议中所有参会者的视音频信息;接收选择指令,所述选择指令具体为从所述所有参会者的视音频信息中选择出所需的视音频信息对应的参会者;根据所述选择指令,通过WebRTC应用向所述会议服务器发送传输请求消息,所述传输请求消息包括选择出的参会者的标识信息;接收所述会议服务器根据所述标识信息发送的第二媒体流,所述第二媒体流包括选择出的参会者的视音频信息。

Description

视频会议中媒体流的传输方法与装置 本申请要求于 2013 年 09 月 05 日提交中国专利局、 申请号为 201310400528.3、 发明名称为 "视频会议中媒体流的传输方法与装置"的中国 专利 申请的优先权, 其全部内 容通过引 用 包含于本申请中 。 技术领域
本发明涉及通讯技术领域, 尤其涉及一种视频会议中媒体流的传输方法 与装置。
背景技术
网络实时通信 (Web Real Time Communication, 简称: WebRTC )技术可 实现不同浏览器与浏览器之间、或浏览器与终端之间的视音频通信、 多方会议 等功能。 如图 1所示。
在图 1的左侧, 用户 1访问 MTC应用网站打开 WebRTC应用网页, 通过 网页中的 JavaScript代码与 MTC应用网站建立通信连接; 在图 1的右侧, 用户 2也访问 MTC应用网站打开 WebRTC应用网页,通过网页中的 JavaScript 代码与 MTC应用网站建立通信连接。此时用户 1和用户 2通过 WeRTC应用网 站提供的用户信息与对方建立连接, 并通过 JavaScript 应用程序编程接口 ( Application Programming Interface, 简称: API )调用各自浏览器中的功 能进行媒体流传输。
目前, 在现有技术中, 当用户 1使用终端 1 (例如: 手机)参加 WebRTC 视频会议时, 会议服务器将参与视频会议中所有的参会者的视频 /音频进行混 频 /混音后, 发送给终端 1, 或者用户 1通过终端 1将终端 1 内的视音频信息 向会议服务器上传; 但是, 现有技术中也暴露出以下不足: 1 )会议服务器只 能将参与视频会议中所有的参会者的视频 /音频进行混频 /混音后分发给各个 用户, 而不能对特定参会者的视音频进行收集、 组合, 降低用户体验, 同时也 增加了终端的使用带宽以及终端本地的资源消耗。 发明内容
本发明实施例提供了一种视频会议中媒体流的传输方法与装置, 可以实 现根据用户的选择, 会议服务器向终端发送特定参会者的视音频信息。
在第一方面, 本发明实施例提供了一种视频会议中媒体流的传输方法, 所述方法包括:
接收会议服务器发送的第一媒体流,所述第一媒体流包括视频会议中所有 参会者的视音频信息;
接收选择指令,所述选择指令具体为从所述所有参会者的视音频信息中选 择出所需的视音频信息对应的参会者;
根据所述选择指令, 通过 WebRTC应用向所述会议服务器发送传输请求消 息, 所述传输请求消息包括选择出的参会者的标识信息;
接收所述会议服务器根据所述标识信息发送的第二媒体流, 所述第二媒 体流包括选择出的参会者的视音频信息。
在第一种可能的实现方式中, 所述根据所述选择指令, 通过 WebRTC应用 向所述会议服务器发送所述传输请求消息之前还包括:
根据所述选择指令, 接收所述 WebRTC应用发送的创建指令;
根据所述创建指令, 调用扩展后的 WebRTC 接口, 并解析所述扩展后的 WebRTC接口中约束对象的参会者属性;
从所述参会者属性中提取选择出的参会者的标识信息,并将每个所述参会 者的标识信息存储在参会者列表内; 调用扩展后的 SDP协议中内容属性;
将所述参会者列表载入所述扩展后的 SDP 协议中内容属性的媒体来源标 mediacnt-s rc区间内;
将所述 med iacnt-s rc区间携带在所述传输请求消息中, 以使得所述传输 请求消息包括选择出的参会者的标识信息;
通过所述 WebRTC应用向所述会议服务器发送所述传输请求消息。
结合第一方面或第一方面的第一种可能的实现方式,在第二种可能的实现 方式中, 所述解析所述扩展后的 WebRTC接口中约束对象的参会者属性之前还 包括:
将选择出的参会者的标识信息存储在所述参会者属性中。
结合第一方面或第一方面的第一种、第二种可能的实现方式,在第三种可 能的实现方式中,所述接收所述会议服务器根据所述标识信息发送的第二媒体 流之前还包括:
通过所述 WebRTC应用接收所述会议服务器根据所述传输请求消息发送的 传输响应消息, 用于确定与所述会议服务器已建立传输连接。
结合第一方面或第一方面的第一种、 第二种、 第三种可能的实现方式, 在 第四种可能的实现方式中,所述接收所述会议服务器根据所述标识信息发送的 第二媒体流之后还包括:
向所述 WebRTC应用传输所述第二媒体流, 以便于所述 WebRTC应用将所 述第二媒体流进行播放。
在第二方面, 本发明实施例提供了一种视频会议中媒体流的传输方法, 所述方法包括:
向浏览器发送第一媒体流,所述第一媒体流包括视频会议中所有参会者的 视音频信息; 接收所述浏览器通过 WebRTC应用发送的传输请求消息, 所述传输请求消 息包括从所述所有参会者的视音频信息中选择出的所需视音频信息对应的参 会者的标识信息;
根据所述标识信息,提取与所述标识信息对应的所述参会者的视音频信息; 向所述浏览器发送第二媒体流, 所述第二媒体流包括选择出的参会者的 视音频信息。
在第一种可能的实现方式中, 所述接收所述浏览器通过 WebRTC应用发送 的传输请求消息之后还包括:
调用扩展后的 WebRTC接口;
根据调用的所述扩展后的 WebRTC接口, 从所述传输请求消息中提取选择 出的所述参会者的标识信息;
将选择出的所述参会者的标识信息存储在参会者列表内;
通过所述扩展后的 WebRTC接口与所述 WebRTC应用之间建立的连接向所 述浏览器发送传输响应消息 ,用于使所述浏览器确定与所述会议服务器已建立 传输连接。
结合第二方面或第二方面的第一种可能的实现方式,在第二种可能的实现 方式中, 所述根据所述标识信息,提取与所述标识信息对应的所述参会者的视 音频信息具体包括:
根据所述参会者列表内存储的选择出的所述参会者的标识信息, 从所述 扩展后的 WebRTC接口中提取对应的参会者的媒体跟踪对象, 所述媒体跟踪对 象包括所述参会者的视音频信息。
结合第二方面或第二方面的第二种可能的实现方式,在第三种可能的实现 方式中, 所述向所述传输浏览器发送第二媒体流, 所述第二媒体流包括选择出 的参会者的视音频信息具体包括: 将所述媒体跟踪对象携带在第二媒体流中, 以使得所述第二媒体流包括 选择出的参会者的视音频信息。
在第三方面, 本发明实施例提供了一种视频会议中媒体流的传输方法, 所述方法包括:
当第一终端的第一浏览器与第二终端的第二浏览器通过同一用户登录信 息接入会议服务器,且所述第一浏览器未向所述会议服务器发送第一媒体流时, 所述第二浏览器接收第一选择指令,所述第一选择指令具体为从所述第二终端 选择出待发送的视音频信息;
根据所述第一选择指令, 通过所述第二终端的第一 WebRTC应用向所述会 议服务器发送第一传输请求消息,所述第一传输请求消息包括所述第二浏览器 中端口属性信息;
当接收到所述会议服务器根据所述第一传输请求消息发送的第一传输响 应消息时,根据所述端口属性信息,通过对应的端口向所述会议服务器发送第 二媒体流, 所述第二媒体流包括所述待发送的视音频信息。
在第一种可能的实现方式中,所述第二浏览器接收用户输入的第一选择指 令之前还包括:
接收所述会议服务器发送的第三媒体流,所述第三媒体流包括视频会议中 所有参会者的视音频信息;
接收第二选择指令,所述第二选择指令具体为从所述所有参会者的视音频 信息中选择出所需的视音频信息对应的参会者;
根据所述第二选择指令, 通过所述第一 WebRTC应用向所述会议服务器发 送所述第二传输请求消息,所述第二传输请求消息包括选择出的参会者的标识 信息;
通过所述第一 WebRTC应用接收所述会议服务器发送的第二传输响应消息, 所述第二传输响应消息用于使所述第二浏览器确定当存在所述第一浏览器向 所述会议服务器发送第一媒体流时,不向所述会议服务器发送所述第二终端中 的视音频信息;
接收所述会议服务器根据所述标识信息发送的第四媒体流, 所述第四媒 体流包括所述用户选择出的参会者的视音频信息。
结合第三方面或第三方面的第一种可能的实现方式,在第二种可能的实现 方式中, 所述根据所述第一选择指令, 通过所述第二终端的第一 WebRTC应用 向所述会议服务器发送第一传输请求消息之前还包括:
根据所述第一选择指令, 接收所述第一 WebRTC应用发送的创建指令; 根据所述创建指令, 调用扩展后的 WebRTC 接口, 并判断所述扩展后的 WebRTC接口中约束对象的发送视频属性值以及发送音频属性值;
当所述发送视频属性值为真时,则将已接收视频信息的第一视频端口属性 设置为仅接收视频端口,将未接收视频信息的第二视频端口属性设置为仅发送 视频端口;
当所述发送音频属性值为真时,则将音频端口的属性设置为发送接收端口; 将已设置的端口属性信息携带在所述第一传输请求消息中,以使得所述第 一传输请求消息包括所述第二浏览器中端口属性信息;
通过所述第二终端的第一 WebRTC应用向所述会议服务器发送所述第一传 输请求消息。
在第四方面, 本发明实施例提供了一种视频会议中媒体流的传输方法, 所述方法包括:
当会议服务器接受第一终端的第一浏览器以及第二终端的第二浏览器通 过同一用户登录信息接入所述会议服务器 ,且所述第一浏览器未向所述会议服 务器发送第一媒体流时,所述会议服务器接收所述第二浏览器通过所述第二终 端的第一 WebRTC应用发送的第一传输请求消息, 所述第一传输请求消息包括 所述第二浏览器中端口属性信息;
根据所述第一传输请求消息, 向所述第二浏览器发送第一传输响应消息, 用于使所述第二浏览器确定与所述会议服务器已建立传输连接;
接收所述第二浏览器根据所述端口属性信息发送的第二媒体流, 所述第 二媒体流包括从所述第二终端选择出的待发送的视音频信息。
在第一种可能的实现方式中,所述会议服务器接收所述第二浏览器通过所 述第二终端的第一 WebRTC应用发送的第一传输请求消息之前还包括:
向所述第二浏览器发送第三媒体流,所述第三媒体流包括视频会议中所有 参会者的视音频信息;
接收所述第二浏览器通过所述第一 WebRTC应用发送的第二传输请求消息, 所述第二传输请求消息包括从所述所有参会者的视音频信息中选择出的所需 视音频信息对应的参会者的标识信息;
根据所述第二传输请求消息, 调用扩展后的 WebRTC接口, 并判断所述第 一浏览器是否正在发送媒体流;
如果所述第一浏览器正在发送媒体流,则将所述会议服务器的端口属性设 置为仅发送端口;
将已设置的端口属性信息携带在第二传输响应消息内, 并通过所述第一 WebRTC 应用向所述第二浏览器发送所述第二传输响应消息, 所述第二传输响 应消息用于使所述第二浏览器确定当存在所述第一浏览器向所述会议服务器 发送媒体流时, 不向所述会议服务器发送所述第二终端中的视音频信息;
根据所述标识信息,提取与所述标识信息对应的所述参会者的视音频信息; 向所述第二浏览器发送第四媒体流, 所述第四媒体流包括选择出的参会 者的视音频信息。 结合第四方面或第四方面的第一种可能的实现方式,在第二种可能的实现 方式中,所述接收所述第二浏览器根据所述端口属性信息发送的第二媒体流之 后还包括:
根据所述端口属性信息, 向所述第二浏览器中对应的端口发送第五媒体 流。
结合第四方面或第四方面的第一种、第二种可能的实现方式,在第三种可 能的实现方式中 ,所述接收所述第二浏览器根据所述端口属性信息发送的第二 媒体流之后还包括:
调用扩展后的 WebRTC接口,并判断所述扩展后的 WebRTC接口中约束对象 的接收视频属性值以及接收音频属性值;
当所述接收视频属性值为真时,则将已接收视频信息的视频端口属性设置 为仅发送视频端口;
当所述接收音频属性值为真时,则将已接收音频信息的音频端口属性设置 为仅发送音频端口;
将已设置的端口属性信息携带在第三传输请求消息中, 并向所述第一浏 览器发送所述第三传输请求消息,所述第三传输请求消息用于使所述第一浏览 器确定不向所述会议服务器发送所述第一终端中的视音频信息。
在第五方面, 本发明实施例提供了一种视频会议中媒体流的传输装置, 所述传输装置处于终端内, 所述装置包括:
接收单元, 用于接收会议服务器发送的第一媒体流, 所述第一媒体流包括 视频会议中所有参会者的视音频信息;
所述接收单元还用于,接收选择指令, 所述选择指令具体为从所述所有参 会者的视音频信息中选择出所需的视音频信息对应的参会者;
发送单元, 用于根据所述选择指令, 通过 WebRTC应用向所述会议服务器 发送传输请求消息, 所述传输请求消息包括选择出的参会者的标识信息; 所述接收单元还用于, 接收所述会议服务器根据所述标识信息发送的第 二媒体流, 所述第二媒体流包括选择出的参会者的视音频信息。
在第一种可能的实现方式中, 所述所述接收单元还用于,根据所述选择指 令, 接收所述 WebRTC应用发送的创建指令;
所述传输装置还包括: 调用单元, 用于根据所述创建指令, 调用扩展后的 WebRTC接口, 并解析所述扩展后的 WebRTC接口中约束对象的参会者属性; 提取单元, 用于从所述参会者属性中提取选择出的参会者的标识信息, 并 将每个所述参会者的标识信息存储在参会者列表内;
所述调用单元还用于, 调用扩展后的 SDP协议中内容属性;
所述传输装置还包括: 载入单元, 用于将所述参会者列表载入所述扩展后 的 SDP协议中内容属性的媒体来源标识 med iacnt-s rc区间内;
放入单元, 用于将所述 med iacnt-s rc区间携带在所述传输请求消息中, 以使得所述传输请求消息包括选择出的参会者的标识信息;
所述发送单元还用于, 通过所述 WebRTC应用向所述会议服务器发送所述 传输请求消息。
结合第五方面或第五方面的第一种可能的实现方式, 在第二种可能的实 现方式中, 所述装置还包括: 存储单元, 用于将选择出的参会者的标识信息存 储在所述参会者属性中。
结合第五方面或第五方面的第一种、第二种可能的实现方式,在第三种可 能的实现方式中, 所述接收单元还用于,
通过所述 WebRTC应用接收所述会议服务器根据所述传输请求消息发送的 传输响应消息, 用于确定与所述会议服务器已建立传输连接。
结合第五方面或第五方面的第一种、 第二种、 第三种可能的实现方式, 在 第四种可能的实现方式中, 所述传输装置还包括:
传输单元, 用于向所述 WebRTC 应用传输所述第二媒体流, 以便于所述 WebRTC应用将所述第二媒体流进行播放。
在第六方面, 本发明实施例提供了一种视频会议中媒体流的传输装置, 所述装置包括:
发送单元, 用于当向浏览器发送第一媒体流, 所述第一媒体流包括视频会 议中所有参会者的视音频信息;
接收单元, 用于接收所述浏览器通过 WebRTC应用发送的传输请求消息, 所述传输请求消息包括从所述所有参会者的视音频信息中选择出的所需视音 频信息对应的参会者的标识信息;
提取单元, 用于根据所述标识信息,提取与所述标识信息对应的所述参会 者的视音频信息;
所述发送单元还用于, 向所述浏览器发送第二媒体流, 所述第二媒体流 包括选择出的参会者的视音频信息。
在第一种可能的实现方式中, 所述传输装置还包括:
调用单元, 用于调用扩展口的 WebRTC接口;
所述提取单元还用于, 根据调用的所述扩展后的 WebRTC接口, 从所述传 输请求消息中提取选择出的所述参会者的标识信息;
所述装置还包括: 存储单元, 用于将选择出的所述参会者的标识信息存储 在参会者列表内;
所述发送单元还用于, 通过所述扩展后的 WebRTC接口与所述 WebRTC应 用之间建立的连接向所述浏览器发送传输响应消息,用于使所述浏览器确定与 所述会议服务器已建立传输连接。
在第二种可能的实现方式中, 所述提取单元具体用于, 识信息, 从所述扩展后的 WebRTC接口中提取对应的参会者的媒体跟踪对象, 所述媒体跟踪对象包括所述参会者的视音频信息。
结合第六方面或第六方面的第二种可能的实现方式,在第三种可能的实现 方式中, 所述发送单元息具体用于,
将所述媒体跟踪对象携带在第二媒体流中, 以使得所述第二媒体流包括 选择出的参会者的视音频信息。
在第七方面, 本发明实施例提供了一种视频会议中媒体流的传输装置, 所述视频会议中的每一会场包括第一终端以及第二终端 ,所述传输装置处于所 述第二终端内, 所述装置包括:
接收单元,用于当第一终端的浏览器与所述传输装置通过同一用户登录信 息接入会议服务器,且所述浏览器未向所述会议服务器发送第一媒体流时,接 收第一选择指令,所述第一选择指令具体为从所述第二终端选择出待发送的视 音频信息;
发送单元,用于根据所述第一选择指令,通过所述第二终端的第一 WebRTC 应用向所述会议服务器发送第一传输请求消息,所述第一传输请求消息包括所 述传输装置中端口属性信息;
所述发送单元还用于, 当接收到所述会议服务器根据所述第一传输请求 消息发送的第一传输响应消息时,根据所述端口属性信息,通过对应的端口向 所述会议服务器发送第二媒体流,所述第二媒体流包括所述待发送的视音频信 息。
在第一种可能的实现方式中, 所述接收单元还用于,接收所述会议服务器 发送的第三媒体流,所述第三媒体流包括视频会议中所有参会者的视音频信息; 所述接收单元还用于,接收第二选择指令, 所述第二选择指令具体为从所 述所有参会者的视音频信息中选择出所需的视音频信息对应的参会者; 所述发送单元还用于, 根据所述第二选择指令, 通过所述第一 WebRTC应 用向所述会议服务器发送所述第二传输请求消息,所述第二传输请求消息包括 选择出的参会者的标识信息;
所述接收单元还用于, 通过所述第一 WebRTC应用接收所述所述会议服务 器发送的第二传输响应消息,所述第二传输响应消息用于使所述传输装置确定 当存在所述浏览器向所述会议服务器发送第一媒体流时 ,不向所述会议服务器 发送所述第二终端中的视音频信息;
所述接收单元还用于, 接收所述会议服务器根据所述标识信息发送的第 四媒体流, 所述第四媒体流包括选择出的参会者的视音频信息。
结合第七方面或第七方面的第一种可能的实现方式,在第二种可能的实现 方式中, 所述接收单元还用于,根据所述第一选择指令,接收所述第一 WebRTC 应用发送的创建指令;
所述传输装置还包括: 调用单元, 用于根据所述创建指令, 调用扩展后的 WebRTC接口, 并判断所述扩展后的 WebRTC接口中约束对象的发送视频属性值 以及发送音频属性值;
设置单元, 用于当所述发送视频属性值为真时, 则将已接收视频信息的第 一视频端口属性设置为仅接收视频端口,将未接收视频信息的第二视频端口属 性设置为仅发送视频端口;
所述设置单元还用于, 当所述发送音频属性值为真时, 则将音频端口的属 性设置为发送接收端口;
所述传输装置还包括: 放入单元, 用于将已设置的端口属性信息携带在所 述第一传输请求消息中,以使得所述第一传输请求消息包括所述传输装置中端 口属性信息; 所述发送单元还用于, 通过所述第二终端的第一 WebRTC应用向所述会议 服务器发送所述第一传输请求消息。
在第八方面, 本发明实施例提供了一种视频会议中媒体流的传输装置, 所述装置包括:
接收单元,用于当所述传输装置接受第一终端的第一浏览器以及第二终端 的第二浏览器通过同一用户登录信息接入所述传输装置,且所述第一浏览器未 向所述传输装置发送第一媒体流时,接收所述第二浏览器通过所述第二终端的 第一 WebRTC应用发送的第一传输请求消息, 所述第一传输请求消息包括所述 第二浏览器中端口属性信息;
发送单元, 用于根据所述第一传输请求消息, 向所述第二浏览器发送第一 传输响应消息, 用于使所述第二浏览器确定与所述传输装置已建立传输连接; 所述接收单元还用于, 接收所述第二浏览器根据所述端口属性信息发送 的第二媒体流,所述第二媒体流包括从所述第二终端选择出的待发送的视音频 信息。
在第一种可能的实现方式中, 所述发送单元还用于, 向所述第二浏览器发 送第三媒体流, 所述第三媒体流包括视频会议中所有参会者的视音频信息; 所述接收单元还用于, 接收所述第二浏览器通过所述第一 WebRTC应用发 送的第二传输请求消息 ,所述第二传输请求消息包括从所述所有参会者的视音 频信息中选择出的所需视音频信息对应的参会者的标识信息;
所述传输装置还包括: 判断单元, 用于根据所述第二传输请求消息, 调用 扩展后的 WebRTC接口, 并判断所述第一浏览器是否正在发送媒体流;
设置单元, 用于如果所述第一浏览器正在发送媒体流, 则将所述传输装置 的端口属性设置为仅发送端口;
所述发送单元还用于,将已设置的端口属性信息携带在第二传输响应消息 内, 并通过所述第一 WebRTC应用向所述第二浏览器发送所述第二传输响应消 息,所述第二传输响应消息用于使所述第二浏览器确定当存在所述第一浏览器 向所述传输装置发送媒体流时,不向所述传输装置发送所述第二终端中的视音 频信息;
所述传输装置还包括: 提取单元, 用于根据所述标识信息, 提取与所述标 识信息对应的所述参会者的视音频信息;
所述发送单元还用于, 向所述第二浏览器发送第四媒体流, 所述第四媒 体流包括选择出的参会者的视音频信息。
结合第八方面或第八方面的第一种可能的实现方式, 在第二种可能的实 现方式中, 所述发送单元还用于, 根据所述端口属性信息, 向所述第二浏览器 中对应的端口发送第五媒体流。
结合第八方面或第八方面的第一种、第二种可能的实现方式,在第三种可 能的实现方式中, 所述判断单元还用于, 调用扩展后的 WebRTC接口, 并判断 所述扩展后的 WebRTC接口中约束对象的接收视频属性值以及接收音频属性值; 所述设置单元还用于,当所述判断单元的判断结果为所述接收视频属性值 为真时, 则将已接收视频信息的视频端口属性设置为仅发送视频端口;
所述设置单元还用于,当所述判断单元的判断结果为所述当所述接收音频 属性值为真时, 则将已接收音频信息的音频端口属性设置为仅发送音频端口; 所述发送单元还用于, 将已设置的端口属性信息携带在第三传输请求消 息中,并向所述第一浏览器发送所述第三传输请求消息, 所述第三传输请求消 息用于使所述第一浏览器确定不向所述传输装置发送所述第一终端中的视音 频信息。
因此, 通过应用本发明实施例提供的视频会议中媒体流的传输方法与装 置,终端的浏览器根据对视频会议中所有参会者的视音频信息进行选择的指令, 向会议服务器发送传输请求消息, 进而接收选择出的参会者的视音频信息, 并 将接收的视音频信息通过 WebRTC应用进行播放, 进而解决现有技术中出现的 问题, 浏览器接收特定参会者的视音频,从而屏蔽掉了用户不感兴趣的参会者 视音频, 增强了 WebRTC视频会议的功能, 提高了用户的体验, 并可以节省网 络带宽以及终端本地的资源消耗。 附图说明
图 1为现有技术中 WebRTC技术系统示意图;
图 2为本发明实施例一提供的视频会议中媒体流的传输方法流程图; 图 3为本发明实施例二提供的视频会议中媒体流的传输方法流程图; 图 4为本发明实施例提供的一种视频会议中媒体流的传输方法信令图; 图 5为本发明实施例三提供的视频会议中媒体流的传输方法流程图; 图 6为本发明实施例四提供的视频会议中媒体流的传输方法流程图; 图 7为本发明实施例提供的另一种视频会议中媒体流的传输方法信令图; 图 8为本发明实施例五提供的视频会议中媒体流的传输装置结构图; 图 9为本发明实施例六提供的视频会议中媒体流的传输装置结构图; 图 10为本发明实施例七提供的视频会议中媒体流的传输装置结构图; 图 11为本发明实施例八提供的视频会议中媒体流的传输装置结构图; 图 12为本发明实施例九提供的视频会议中媒体流的传输装置硬件结构图; 图 1 3为本发明实施例十提供的视频会议中媒体流的传输装置硬件结构图; 图 14为本发明实施例十一提供的视频会议中媒体流的传输装置硬件结构 图;
图 15为本发明实施例十二提供的视频会议中媒体流的传输装置硬件结构 图。 具体实施方式
为使本发明实施例的目的、 技术方案和优点更加清楚, 下面将结合本发 明实施例中的附图, 对本发明实施例中的技术方案进行清楚、 完整地描述, 显 然, 所描述的实施例是本发明一部分实施例, 而不是全部的实施例。 基于本发 明中的实施例 ,本领域普通技术人员在没有做出创造性劳动前提下所获得的所 有其他实施例, 都属于本发明保护的范围。
为便于对本发明实时的理解, 下面将结合附图以具体实施例做进一步的 解释说明, 实施例并不构成对本发明实施例的限定。
实施例一
下面以图 1 为例详细说明本发明实施例一提供的视频会议中媒体流的传 输方法, 图 2为本发明实施例一提供的视频会议中媒体流的传输方法流程图, 在本发明实施例中实施主体为浏览器, 所述浏览器处于终端内, 在本发明实施 例中终端具体是指智能手机、 平板电脑等移动终端; 或者是指个人电脑、 智能 电视等固定终端。 如图 2所示, 该实施例具体包括以下步骤:
步骤 21 0、接收会议服务器发送的第一媒体流, 所述第一媒体流包括视频 会议中所有参会者的视音频信息。
具体地, 在本发明实施例中, 当终端的浏览器接入会议服务器时, 也即 是浏览器与会议服务器建立连接时,浏览器接收会议服务器发送的第一媒体流, 所述第一媒体流包括视频会议中所有参会者的视音频信息。
进一步地, 浏览器接入会议服务器为现有技术, 在此, 仅做简单说明。 浏览器登录网络服务器获取 WebRTC视频会议应用网页; 浏览器接收用户输入 的登录信息 (用户名以及密码), 并向网络服务器发送认证信息, 认证信息包 括用户名以及密码; 网络服务器向数据库发送认证信息; 数据库进行数据验证 后, 向网络服务器发送会议信息, 会议信息包括视频会议的 IP地址, 端口号 等; 网络服务器将获取的会议信息向终端的 WebRTC应用发送; WebRTC应用根 据接收到的会议信息向浏览器发送创建指令以及添加指令,浏览器创建连接对 象, 并在连接对象中添加终端存储的视音频信息; 浏览器通过创建的连接对象 创建连接请求消息, 并将连接对象携带在连接请求消息中, 同时, 浏览器接收 WebRTC 应用发送的保存指令, 将终端的媒体属性信息也携带在连接请求消息 中, 浏览器向 WebRTC应用发送连接请求消息, WebRTC应用将连接请求消息 向会议服务器发送, 会议服务器根据连接请求消息, 创建连接对象, 保存终端 的媒体属性信息, 并根据连接请求消息创建连接响应消息,将会议服务器的媒 体属性信息携带在连接响应消息中; 会议服务器通过 WebRTC应用向浏览器发 送连接响应消息, 至此, 浏览器接入会议服务器, 也即是浏览器与会议服务器 建立连接。
步骤 220、接收选择指令, 所述选择指令具体为从所述所有参会者的视音 频信息中选择出所需的视音频信息对应的参会者。
具体地, 浏览器在接收到会议服务器发送的第一媒体流后, 浏览器将第 一媒体流解析并提取每个参会者的视音频信息 ,将每个参会者的视音频信息显 示在用户界面上, 浏览器接收选择指令, 所述选择指令为用户输入的, 所述选 择指令具体为用户从用户界面上显示的所有参会者的视音频信息中选择出所 需的视音频信息对应的参会者,也即是用户根据用户界面上显示的所有参会者 的视音频信息选择出所需的参会者。
在本发明实施例中, 选择出的参会者也即是后续仅接收选择出的参会者 的视音频信息。
步骤 230、 根据所述选择指令, 通过 WebRTC应用向所述会议服务器发送 传输请求消息, 所述传输请求消息包括选择出的参会者的标识信息。 具体地, 根据选择指令, 浏览器通过 WebRTC应用向会议服务器发送传输 请求消息, 所述传输请求消息包括选择出的参会者的标识信息。 该标识信息用 以确定用户所需的参会者。 所述 WebRTC应用为终端内部的 WebRTC应用。
进一步地, 浏览器接收选择指令的同时, 还根据选择指令, 提取选择出 的参会者的标识信息, 并将标识信息携带在传输请求消息中。
步骤 240、接收所述会议服务器根据所述标识信息发送的第二媒体流, 所 述第二媒体流包括选择出的参会者的视音频信息。
具体地, 浏览器在向会议服务器发送传输请求消息后, 接收会议服务器 根据传输请求消息包括的标识信息发送的第二媒体流,所述第二媒体流包括选 择出的参会者的视音频信息, 进而实现根据用户的选择,会议服务器向终端发 送特定参会者的视音频信息,提高了用户体验, 同时也节省了网络带宽以及终 端本地的资源消耗。
可选地, 在本发明实施例步骤 230之前, 还包括浏览器根据所述选择指 令, 生成所述传输请求消息的步骤。 具体步骤如下:
根据所述选择指令, 生成所述传输请求消息。
具体地, 根据选择指令, 浏览器接收 WebRTC应用发送的创建指令; 根据 创建指令, 浏览器调用扩展后的 WebRTC接口, 并解析扩展后的 WebRTC接口中 约束对象的参会者属性;浏览器从参会者属性中提取选择出的参会者的标识信 息; 并将每个参会者的标识信息存储在参会者列表内; 浏览器调用扩展后的 SDP协议中内容属性; 浏览器将参会者列表载入扩展后的 SDP协议中内容属性 的媒体来源标识 med i acnt-s rc区间内;浏览器将 med iacnt-s rc区间携带在传 输请求消息中, 以使得传输请求消息包括选择出的参会者的标识信息, 并通过 终端的 WebRTC应用向会议服务器发送传输请求消息。
可选地, 在上述浏览器解析扩展后的 WebRTC接口中约束对象的参会者属 性之前还包括浏览器将选择出的参会者的标识信息存储在参会者属性中的步 骤。 可以理解的是, 参会者属性中除了保存选择出的参会者的标识信息以外, 还可扩展保存关于参会者的其他相关信息,在本发明实施例中,仅以保存标识 信息为例说明, 在实际应用中, 还可保存关于参会者的其他相关信息。
需要说明的是, 在本发明实施例中, 管理人员事先对浏览器进行扩展以 及增加功能, 也即是扩展浏览器的 WebRTC接口, 以及浏览器在运行时的 SDP 协议, 在对浏览器进行扩展后, 增加浏览器的功能, 使得浏览器可对扩展后的 接口、 协议进行运行。
进一步地, 管理人员扩展浏览器的 WebRTC接口中约束对象, 为约束对象 增加参会者属性, 该参会者属性用于保存选择出的参会者的标识信息; 管理人 员在浏览器生成传输请求消息的方法中添加功能 ,进而使得浏览器提取参会者 属性的值并经提取的值存储在参会者列表内;管理人员扩展 SDP协议的内容属 性, 增加 med iacnt-s rc区间来存储参会者的标识; 进而使得浏览器将参会者 歹' J表载入 med iacnt- s rc区间内,并将 med iacnt_s rc区间携带在传输请求消息 中, 以使得传输请求消息包括选择出的参会者的标识信息。
可选地, 在本发明实施例步骤 240之前, 还包括浏览器通过 WebRTC应用 接收所述会议服务器根据所述传输请求消息发送的传输响应消息。通过接收的 传输响应消息, 可使浏览器确定与会议服务器已建立传输连接,会议服务器已 经准备向浏览器发送第二媒体流。 具体步骤如下:
通过所述 WebRTC应用接收所述会议服务器根据所述传输请求消息发送的 传输响应消息, 用于使所述浏览器确定与所述会议服务器已建立传输连接。
具体地, 浏览器通过 WebRTC应用接收会议服务器根据传输请求消息发送 的传输响应消息, 用于使浏览器确定与会议服务器已建立传输连接,会议服务 器已经准备向浏览器发送第二媒体流。 可选地, 在本发明实施例步骤 240之后, 还包括浏览器向所述 WebRTC应 用传输所述第二媒体流, 以便于所述 WebRTC应用将所述第二媒体流进行播放 的步骤, 通过该步骤可将第二媒体流对用户进行播放。 具体步骤如下:
向所述 WebRTC应用传输所述第二媒体流, 以便于所述 WebRTC应用将所 述第二媒体流进行播放。
具体地, 浏览器向 WebRTC应用传输第二媒体流, 以便于 WebRTC应用将 第二媒体流对用户进行播放,或者 WebRTC应用将第二媒体流传输至其他应用, 其他应用对第二媒体流进行处理, 例如, 存储等。
因此, 通过应用本发明实施例提供的视频会议中媒体流的传输方法, 终 端的浏览器根据对视频会议中所有参会者的视音频信息进行选择的指令,向会 议服务器发送传输请求消息, 进而接收选择出的参会者的视音频信息, 并将接 收的视音频信息通过 WebRTC应用进行播放,进而解决现有技术中出现的问题, 浏览器接收特定参会者的视音频,从而屏蔽掉了用户不感兴趣的参会者视音频, 增强了 WebRTC视频会议的功能, 提高了用户的体验, 并可以节省网络带宽以 及终端本地的资源消耗。
为便于对本发明实时的理解, 下面将结合附图以具体实施例做进一步的 解释说明, 实施例并不构成对本发明实施例的限定。
实施例二
下面以图 3 为例详细说明本发明实施例二提供的视频会议中媒体流的传 输方法, 图 3为本发明实施例二提供的视频会议中媒体流的传输方法流程图, 在本发明实施例中实施主体为会议服务器, 所述会议服务器处于通信网络内。 如图 3所示, 该实施例具体包括以下步骤:
步骤 31 0、 向浏览器发送第一媒体流, 所述第一媒体流包括视频会议中所 有参会者的视音频信息。 具体地,在本发明实施例中, 当会议服务器与终端的浏览器建立连接时, 也即是浏览器接入会议服务器时,会议服务器向浏览器发送第一媒体流, 所述 第一媒体流包括视频会议中所有参会者的视音频信息。
进一步地, 会议服务器与浏览器建立连接为现有技术, 在前述实施例中 已简要说明, 在此不再复述。
步骤 320、 接收所述浏览器通过 WebRTC应用发送的传输请求消息, 所述 传输请求消息包括从所述所有参会者的视音频信息中选择出的所需视音频信 息对应的参会者的标识信息。
具体地, 会议服务器在向浏览器发送第一媒体流后, 接收浏览器通过 WebRTC 应用发送的传输请求消息, 所述传输请求消息包括从所有参会者的视 音频信息中选择出的所需视音频信息对应的参会者的标识信息。
可以理解的是, 前述实施例已详细说明浏览器生成、 发送传输请求消息 的详细过程, 在此不再复述。
步骤 330、根据所述标识信息, 提取与所述标识信息对应的所述参会者的 视音频信息。
具体地, 会议服务器接收到传输请求消息后, 解析并提取传输请求消息 包括的参会者的标识信息,根据标识信息,提取与标识信息对应的参会者的视 音频信息。
步骤 340、 向所述浏览器发送第二媒体流, 所述第二媒体流包括选择出的 参会者的视音频信息。
具体地, 会议服务器提取到与标识信息对应的参会者的视音频信息后, 向浏览器发送第二媒体流,所述第二媒体流包括选择出的参会者的视音频信息, 进而实现根据用户的选择, 会议服务器向终端发送特定参会者的视音频信息, 提高了用户体验, 同时也节省了网络带宽以及终端本地的资源消耗。 可选地, 在本发明实施例步骤 320之后还包括会议服务器根据所述传输 请求消息, 生成并发送传输响应消息的步骤。 通过发送传输响应消息, 可使浏 览器明确已与会议服务器建立传输连接,会议服务器已经准备向浏览器发送第 二媒体流。 具体步骤如下:
根据传输请求消息, 生成传输响应消息。
具体地, 会议服务器根据传输请求消息, 生成传输响应消息, 在生成传输 响应消息的同时,调用扩展后的 WebRTC接口 ,会议服务器通过扩展后的 WebRTC 接口与 WebRTC应用之间建立的连接向浏览器发送传输响应消息, 以使得浏览 器确定与会议服务器已建立传输连接; 会议服务器根据调用的扩展后的 WebRTC接口从传输请求消息中提取选择出的参会者的标识信息, 并将选择出 的所述参会者的标识信息存储在参会者列表内。
需要说明的是, 在本发明实施例中, 管理人员事先对会议服务器进行扩 展以及增加功能, 也即是扩展会议服务器的 WebRTC接口, 在对会议服务器进 行扩展后, 增加会议服务器的功能, 使得会议服务器可对扩展后的接口、 协议 进行运行。
进一步地, 管理人员扩展会议服务器的 WebRTC接口, 在生成传输响应消 息的方法中添加功能, 进而使得会议服务器可从传输请求消息中的 med i acnt-s rc区间内提取至少 1个参会者的标识信息, 并将提取的至少 1个 参会者的标识信息存储在参会者列表内。
可选地, 本发明实施例步骤 330 中根据所述标识信息, 提取与所述标识 信息对应的所述参会者的视音频信息具体包括:
会议服务器根据所述参会者列表内存储的用户选择出的参会者的标识信 息, 从扩展后的 WebRTC接口中提取对应的参会者的媒体跟踪对象, 所述媒体 跟踪对象包括参会者的视音频信息。 需要说明的是, 在本发明实施例中, 管理人员扩展会议服务器的 WebRTC 接口, 在 WebRTC接口中扩展媒体跟踪对象, 使得媒体跟踪对象可存储参会者 的视音频信息。
可选地, 在本发明实施例步骤 340 中向所述浏览器发送第二媒体流, 所 述第二媒体流包括选择出的参会者的视音频信息具体包括:
会议服务器将媒体跟踪对象携带在第二媒体流中, 以使得第二媒体流包 括选择出的参会者的视音频信息。
因此, 通过应用本发明实施例提供的视频会议中媒体流的传输方法, 终 端的浏览器根据对视频会议中所有参会者的视音频信息进行选择的指令,向会 议服务器发送传输请求消息, 进而接收选择出的参会者的视音频信息, 并将接 收的视音频信息通过 WebRTC应用进行播放,进而解决现有技术中出现的问题, 浏览器接收特定参会者的视音频,从而屏蔽掉了用户不感兴趣的参会者视音频, 增强了 WebRTC视频会议的功能, 提高了用户的体验, 并可以节省网络带宽以 及终端本地的资源消耗。
进一步地, 图 4 为本发明实施例提供的一种视频会议中媒体流的传输方 法信令图; 图 4所示的信令图为浏览器、 WebRTC应用与会议服务器进行媒体 流的传输过程,图 4中的视频会议中媒体流的传输方法均可按照前述实施例描 述的过程执行, 在此不再复述。
为便于对本发明实时的理解, 下面将结合附图以具体实施例做进一步的 解释说明, 实施例并不构成对本发明实施例的限定。
实施例三
下面以图 5 为例详细说明本发明实施例三提供的视频会议中媒体流的传 输方法, 图 5为本发明实施例三提供的视频会议中媒体流的传输方法流程图, 视频会议中的每一会场包括第一终端以及第二终端,且第一终端与第二终端属 于同一用户,也即是第一终端的第一浏览器与第二终端的第二浏览器可通过同 一用户的登录信息接入会议服务器,在本发明实施例中, 实施主体为处于第二 终端内的第二浏览器,在本发明实施例中终端具体是指智能手机、平板电脑等 移动终端; 或者是指个人电脑、 智能电视等固定终端。 如图 5所示, 该实施例 具体包括以下步骤:
步骤 51 0、 当第一终端的第一浏览器与第二终端的第二浏览器通过同一用 户登录信息接入会议服务器 ,且所述第一浏览器未向所述会议服务器发送第一 媒体流时, 所述第二浏览器接收第一选择指令, 所述第一选择指令具体为从所 述第二终端选择出待发送的视音频信息。
具体地, 在本发明实施例中, 当第一终端的第一浏览器与第二终端的第 二浏览器通过同一用户登录信息接入会议服务器时,也即是第一浏览器、 第二 浏览器与会议服务器分别建立连接,且第一浏览器未向会议服务器发送第一媒 体流时, 第二浏览器接收第一选择指令, 所述第一选择指令为用户输入的, 所 述第一选择指令具体为用户从第二终端内存储的或第二终端实时获取的视音 频信息中选择出待发送的视音频信息, 在本发明实施例中, 所述第一媒体流具 体包括第一终端中的视音频信息。
进一步地, 第一浏览器、 第二浏览器接入会议服务器为现有技术, 在前 述实施例中已简要说明, 在此不再复述。
需要说明的是, 在第二浏览器接收第一选择指令之前, 第一浏览器、 第 二浏览器依照前述实施例可从会议服务器中分别接收选择出的参会者的视音 频信息。
本发明实施例中第二终端实时获取的视音频信息具体是指: 通过第二终 端设备自身的摄像头、 麦克获取的实时的视音频信息。
步骤 520、 根据所述第一选择指令, 通过所述第二终端的第一 WebRTC应 用向所述会议服务器发送第一传输请求消息 ,所述第一传输请求消息包括所述 第二浏览器中端口属性信息。
具体地, 根据第一选择指令, 第二浏览器通过第二终端的第一 WebRTC应 用向会议服务器发送第一传输请求消息 ,所述第一传输请求消息包括所述第二 浏览器中端口属性信息。
进一步地, 所述第二浏览器中端口属性信息具体是指第二浏览器中端口 的分类, 即用于仅发送视频信息的端口、用于仅接收视频信息的端口以及既可 发送也可接收音频信息的端口。
步骤 530、 当接收到所述会议服务器根据所述第一传输请求消息发送的第 一传输响应消息时,根据所述端口属性信息,通过对应的端口向所述会议服务 器发送第二媒体流, 所述第二媒体流包括所述待发送的视音频信息。
具体地, 当第二浏览器接收到会议服务器根据第一传输请求消息发送的 第一传输响应消息时, 第二浏览器确定与所述会议服务器已建立传输连接, 第 二浏览器根据端口属性信息, 通过对应的端口 (即: 仅发送视频信息的端口, 或者即可发送也可接收音频信息的端口)向会议服务器发送第二媒体流, 所述 第二媒体流包括待发送的视音频信息,进而实现在一个视频会议中可通过第一 终端的第一浏览器或者第二终端的第二浏览器向会议服务器上传视频 /音频, 提高用户体验。
可选地, 在本发明实施例步骤 51 0 所述第二浏览器接收用户输入的第一 选择指令之前还包括第二浏览器从会议服务器处接收用户选择出的参会者的 视音频信息等步骤。 具体步骤如下:
接收所述会议服务器发送的第三媒体流, 所述第三媒体流包括视频会议 中所有参会者的视音频信息。
具体地, 当第二浏览器接入会议服务器时, 第二浏览器接收会议服务器 发送的第三媒体流,所述第三媒体流包括视频会议中所有参会者的视音频信息。 接收第二选择指令,所述第二选择指令具体为从所述所有参会者的视音频 信息中选择出所需的视音频信息对应的参会者。
具体地, 第二浏览器在接收到会议服务器发送的第三媒体流后, 第二浏 览器将第三媒体流解析并提取每个参会者的视音频信息 ,将每个参会者的视音 频信息显示在用户界面上, 第二浏览器接收第二选择指令, 所述第二选择指令 为用户输入的,所述第二选择指令具体为用户从用户界面上显示的所有参会者 的视音频信息中选择出所需的视音频信息对应的参会者,也即是用户根据用户 界面上显示的所有参会者的视音频信息选择出所需的参会者。
在本发明实施例中, 选择出的参会者也即是后续仅接收选择出的参会者 的视音频信息。
根据所述第二选择指令,通过所述第一 WebRTC应用向所述会议服务器发 送所述第二传输请求消息,所述第二传输请求消息包括选择出的参会者的标识 信息。
具体地, 根据第二选择指令, 第二浏览器通过第一 WebRTC应用向会议服 务器发送第二传输请求消息,所述第二传输请求消息包括选择出的参会者的标 识信息。 该标识信息用以确定用户所需的参会者。
进一步地, 第二浏览器接收第二选择指令的同时, 还根据第二选择指令, 提取用户选择出的参会者的标识信息,并将标识信息携带在第二传输请求消息 中。
通过所述第一 WebRTC应用接收所述会议服务器发送的第二传输响应消息, 所述第二传输响应消息用于使所述第二浏览器确定当存在所述第一浏览器向 所述会议服务器发送第一媒体流时,不向所述会议服务器发送所述第二终端中 的视音频信息。 具体地, 第二浏览器通过第一 WebRTC应用接收会议服务器根据第二传输 请求消息发送的第二传输响应消息 ,所述第二传输响应消息包括所述会议服务 器的属性信息(例如, 会议服务器的媒体属性信息等)以及选择出的参会者的 标识信息,以使得第二浏览器明确当存在第一浏览器向会议服务器发送第一媒 体流时, 不向会议服务器发送第二终端中的视音频信息, 也即是, 在一个视频 会议中, 会议服务器仅接受 1个浏览器上传视音频信息。
接收所述会议服务器根据所述标识信息发送的第四媒体流, 所述第四媒 体流包括选择出的参会者的视音频信息。
具体地, 第二浏览器在向会议服务器发送第二传输请求消息后, 接收会 议服务器根据第二传输请求消息包括的标识信息发送的第四媒体流,所述第四 媒体流包括选择出的参会者的视音频信息, 进而实现根据用户的选择,会议服 务器向终端特定参会者的视音频信息,提高了用户体验, 同时也节省了网络带 宽以及终端本地的资源消耗。
可选地,在本发明实施例步骤 520之前,还包括第二浏览器根据所述第一 选择指令, 生成所述第一传输请求消息的步骤。 具体步骤如下:
根据所述第一选择指令, 生成所述第一传输请求消息。
具体地, 根据第一选择指令, 第二浏览器接收第一 WebRTC应用发送的创 建指令; 根据创建指令, 第二浏览器调用扩展后的 WebRTC接口, 并判断扩展 后的 WebRTC接口中约束对象的发送视频属性值以及发送音频属性值; 当发送 视频属性值为真时,则第二浏览器将已接收视频信息的第一视频端口属性设置 为仅接收视频端口,将未接收视频信息的第二视频端口属性设置为仅发送视频 端口; 当发送音频属性值为真时, 则第二浏览器将音频端口的属性设置为发送 接收端口; 第二浏览器将已设置的端口属性信息携带在第一传输请求消息中, 以使得第一传输请求消息包括所述第二浏览器中端口的属性信息。 需要说明的是, 在本发明实施例中, 管理人员事先对第二浏览器进行扩 展以及增加功能, 也即是扩展第二浏览器的 WebRTC接口, 在对第二浏览器进 行扩展后, 增加第二浏览器的功能, 使得第二浏览器可对扩展后的接口、 协议 进行运行。
进一步地, 管理人员扩展第二浏览器的 WebRTC接口中约束对象, 为约束 对象增加发送视频属性值以及发送音频属性值,该属性值用于设置第二浏览器 中端口的属性,且该属性值为真或者假; 管理人员在第二浏览器生成第一传输 请求消息的方法中添加功能, 进而使得第二浏览器可判断属性值, 并设置自身 端口的属性,将已设置的端口属性信息携带在第一传输请求消息中, 以使得第 一传输请求消息包括第二浏览器中端口的属性信息。
可以理解的是, 第二浏览器通过设置自身端口的属性, 可使得第二浏览 器方便管理自身端口,在向会议服务器发送媒体流时,根据端口的属性对应发 送, 同时, 也使会议服务器明确第二浏览器的端口属性, 在接收会议服务器发 送的媒体流时, 根据端口的属性对应接收, 提高端口的利用率。
因此, 通过应用本发明实施例提供的视频会议中媒体流的传输方法, 属 于同一用户的多个终端可同时接入会议服务器并接收特定参会者的视音频信 息, 当第一浏览器未向会议服务器发送过第一媒体流时, 第二浏览器根据接收 的选择指令, 生成第一传输请求消息, 所述第一传输请求消息包括所述第二浏 览器中端口的属性信息;并根据端口的属性信息向会议服务器发送第二媒体流, 进而解决现有技术中出现的问题, 同时,通过两个或两个以上的终端设备参加 同一视频会议,每个终端接收特定参会者视音频信息, 并且用户可任意切换终 端来上传本地视音频信息。 从而增强了 WebRTC视频会议功能, 提高了用户的 体验, 并节省了网络带宽以及终端本地的资源消耗。
为便于对本发明实时的理解, 下面将结合附图以具体实施例做进一步的 解释说明, 实施例并不构成对本发明实施例的限定。
实施例四 输方法, 图 6为本发明实施例四提供的视频会议中媒体流的传输方法流程图, 在本发明实施例中实施主体为会议服务器, 所述会议服务器处于通信网络内。 如图 6所示, 该实施例具体包括以下步骤:
步骤 61 0、 当会议服务器接受第一终端的第一浏览器以及第二终端的第二 浏览器通过同一用户登录信息接入所述会议服务器 ,且所述第一浏览器未向所 述会议服务器发送第一媒体流时 ,所述会议服务器接收所述第二浏览器通过所 述第二终端的第一 WebRTC应用发送的第一传输请求消息, 所述第一传输请求 消息包括所述第二浏览器中端口的属性信息。
具体地, 在本发明实施例中, 当会议服务器接受第一终端的第一浏览器 以及第二终端的第二浏览器通过同一用户登录信息接入会议服务器时,也即是 第一浏览器、第二浏览器均接入会议服务器,且第一浏览器未向会议服务器发 送第一媒体流时, 会议服务器接收第二浏览器通过第二终端的第一 WebRTC应 用发送的第一传输请求消息,所述第一传输请求消息包括第二浏览器中端口的 属性信息, 在本发明实施例中, 所述第一媒体流具体包括第一终端内存储的视 音频信息, 且第一终端以及第二终端被同一用户使用。
进一步地,会议服务器与第一浏览器、第二浏览器建立连接为现有技术, 在前述实施例中已简要说明, 在此不再复述。
需要说明的是, 在本发明实施例中第二浏览器中端口的属性信息具体是 指第二浏览器中端口的分类, 即用于仅发送视频信息的端口、用于仅接收视频 信息的端口以及既可发送也可接收音频信息的端口。
步骤 620、根据所述第一传输请求消息, 向所述第二浏览器发送第一传输 响应消息, 用于使第二浏览器确定与所述会议服务器已建立传输连接。
具体地, 会议服务器接收到第一传输请求消息后, 解析并提取第一传输 请求消息包括的第二浏览器中端口的属性信息。根据传输请求消息,会议服务 器确定第二浏览器中各端口的分类 (即会议服务器明确在后续发送 /接收媒体 流时,根据第二浏览器中端口的属性信息,将向对应的端口发送 /接收媒体流 ), 会议服务器向第二浏览器发送第一传输响应消息。
进一步地, 所述第一传输响应消息用于使第二浏览器确定与所述会议服 务器已建立传输连接。
步骤 630、接收所述第二浏览器根据所述端口的属性信息发送的第二媒体 流, 所述第二媒体流包括从所述第二终端选择出的待发送的视音频信息。
具体地, 会议服务器接收第二浏览器根据端口的属性信息 (即: 仅发送 视频信息的端口,或者既可发送也可接收音频信息的端口)发送的第二媒体流, 所述第二媒体流包括用户从第二终端内存储的或第二终端实时获取的视音频 信息中选择出的待发送的视音频信息,进而实现在一个视频会议中可通过第一 终端的第一浏览器或者第二终端的第二浏览器向会议服务器上传视频 /音频, 提高用户体验。
可选地, 在本发明实施例步骤 61 0会议服务器接收所述第二浏览器通过 所述第二终端的第一 WebRTC应用发送的第一传输请求消息之前还包括会议服 务器向第二浏览器发送选择出的参会者的视音频信息等步骤。 具体步骤如下: 向所述第二浏览器发送第三媒体流,所述第三媒体流包括视频会议中所有 参会者的视音频信息。
具体地, 在本发明实施例中, 当会议服务器与第二浏览器建立连接后, 也即是第二浏览器接入会议服务器时 ,会议服务器向第二浏览器发送第三媒体 流, 所述第三媒体流包括视频会议中所有参会者的视音频信息。 进一步地,会议服务器与第二浏览器建立连接为现有技术,在前述实施例 中已简要说明, 在此不再复述。
接收所述第二浏览器通过所述第一 WebRTC应用发送的第二传输请求消息, 所述第二传输请求消息包括从所述所有参会者的视音频信息中选择出的所需 视音频信息对应的参会者的标识信息。
具体地, 会议服务器在向第二浏览器发送第三媒体流后, 接收第二浏览 器通过第一 WebRTC应用发送的第二传输请求消息, 所述第二传输请求消息包 括从所有参会者的视音频信息中选择出的所需视音频信息对应的参会者的标 识信息。
可以理解的是, 前述实施例已详细说明浏览器生成、发送传输请求消息的 详细过程, 在此不再复述。
根据所述第二传输请求消息, 调用扩展后的 WebRTC接口, 并判断所述第 一浏览器是否正在发送媒体流。
具体地,会议服务器接收到第二传输请求消息后, 解析并提取第二传输请 求消息包括的参会者的标识信息, 调用扩展后的 WebRTC接口, 并判断第一浏 览器是否正在发送媒体流。
进一步地,会议服务器通过在先在数据库中保存的用户的连接信息(例如, 用户标识信息、 连接标识信息、 是否正在上传音视频信息等)判断第一浏览器 是否正在发送媒体流。
需要说明的是, 当每个浏览器接入会议服务器时,会议服务器创建数据结 构保存每个浏览器对应的用户的连接信息,并将创建的用户的连接信息存储在 数据库中, 所述数据库位于通信网络中。
如果所述第一浏览器正在发送媒体流,则将自身的端口属性设置为仅发送 端口。 具体地,如果第一浏览器正在向会议服务器发送媒体流, 则会议服务器将 自身的端口属性设置为仅发送端口, 也即是, 非接收端口。
将已设置的端口属性信息携带在第二传输响应消息内, 并通过所述第一 WebRTC 应用向所述第二浏览器发送所述第二传输响应消息, 所述第二传输响 应消息用于使所述第二浏览器确定当存在所述第一浏览器向所述会议服务器 发送媒体流时, 不向所述会议服务器发送所述第二终端中的视音频信息。
具体地,会议服务器将已设置的端口属性信息携带在第二传输响应消息内, 并通过第一 WebRTC应用向第二浏览器发送第二传输响应消息, 所述第二传输 响应消息用于使第二浏览器确定当存在第一浏览器向所述会议服务器发送媒 体流时, 不向会议服务器发送第二终端中的视音频信息。
需要说明的是, 在本发明实施例中, 管理人员事先对会议服务器进行扩 展以及增加功能, 也即是扩展会议服务器的 WebRTC接口, 在对会议服务器进 行扩展后, 增加会议服务器的功能, 使得会议服务器可对扩展后的接口、 协议 进行运行。
进一步地, 管理人员扩展会议服务器的 WebRTC接口, 在生成第二传输响 应消息的方法中添加功能,进而使得会议服务器可判断第一浏览器是否正在发 送媒体流, 如果第一浏览器正在发送媒体流, 则将自身的端口属性设置为仅发 送端口, 并将已设置的端口属性信息携带在第二传输响应消息内。
根据所述标识信息,提取与所述标识信息对应的所述参会者的视音频信息。 具体地 ,会议服务器根据前述可选步骤从第二传输请求消息中提取的参会 者的标识信息, 提取与标识信息对应的参会者的视音频信息。
进一步地, 会议服务器可从传输请求消息中提取出至少 1 个参会者的标 识信息, 会议服务器根据提取的至少 1 个参会者的标识信息, 从扩展后的 WebRTC接口中提取对应的参会者的媒体跟踪对象, 所述媒体跟踪对象包括参 会者的视音频信息。
需要说明的是, 在本发明实施例中, 管理人员扩展会议服务器的 WebRTC 接口, 在 WebRTC接口中扩展媒体跟踪对象, 使得媒体跟踪对象可存储参会者 的视音频信息。
向所述第二浏览器发送第四媒体流, 所述第四媒体流包括选择出的参会 者的视音频信息。
具体地, 会议服务器提取到与标识信息对应的参会者的视音频信息后, 向第二浏览器发送第四媒体流,所述第四媒体流包括选择出的参会者的视音频 信息,进而实现根据用户的选择,会议服务器向终端特定参会者的视音频信息, 提高了用户体验, 同时也节省了网络带宽以及终端本地的资源消耗。
可选地, 在本发明实施例步骤 630接收所述第二浏览器根据所述端口属 性信息发送的第二媒体流之后还包括会议服务器向第二浏览器发送媒体流的 步骤,通过该步骤即可实现第二浏览器与会议服务器之间相处传递媒体流, 进 而实现让用户在一个视频会议中通过不同终端向会议服务器相互传递媒体流, 提高了用户体验。 具体步骤如下:
根据所述端口属性信息, 向所述第二浏览器中对应的端口发送第五媒体 流。
具体地, 会议服务器根据步骤 61 0 中接收到的第一传输请求消息包括的 第二浏览器中端口的属性信息, 向第二浏览器中对应的端口发送第五媒体流。 在本发明实施例中, 第五媒体流包括选择出的参会者的视音频信息, 或者全部 参会者的视音频信息。
进一步地, 会议服务器向第二浏览器中仅接收视频信息的端口发送视频 信息, 向即可发送也可接收音频信息的端口发送音频信息。
可选地, 由于在前述可选步骤中第二浏览器与会议服务器之间进行媒体 流的相互传递, 此时,会议服务器为减少对网络带宽的限制还将执行终止第一 浏览器发送媒体流的步骤。
调用扩展后的 WebRTC接口,并判断所述扩展后的 WebRTC接口中约束对象 的接收视频属性值以及接收音频属性值。
具体地,会议服务器在与第二浏览器之间进行媒体流的相互传递后,调用 扩展后的 WebRTC接口,并判断扩后的 WebRTC接口中约束对象的接收视频属性 值以及接收音频属性值。
当所述接收视频属性值为真时,则将已接收视频信息的视频端口属性设置 为仅发送视频端口。
具体地, 当接收视频属性值为真时, 则会议服务器将已接收视频信息的视 频端口属性设置为仅发送视频端口。
当所述接收音频属性值为真时,则将已接收音频信息的音频端口属性设置 为仅发送音频端口。
具体地, 当接收音频属性值为真时, 则会议服务器将已接收音频信息的音 频端口属性设置为仅发送音频端口。
将已设置的端口属性携带在第三传输请求消息中, 并向所述第一浏览器 发送所述第三传输请求消息,所述第三传输请求消息用于使所述第一浏览器确 定不向所述会议服务器发送所述第一终端中的视音频信息。
具体地, 会议服务器将已设置的端口属性携带在第三传输请求消息中, 并向第一浏览器发送第三传输请求消息,所述第三传输请求消息用于使第一浏 览器确定不向会议服务器发送第一终端中的视音频信息。
第一浏览器接收到第三传输请求消息后, 解析并提取第三传输请求消息 包括的会议服务器的端口属性,明确会议服务器拒绝接收自身发送的视音频信 息, 向会议服务器发送第三传输响应消息, 此时, 会议服务器明确仅向第一浏 览器发送媒体流, 而不接收第一浏览器发送的媒体流, 进而实现在一个视频会 议中通过不同终端向会议服务器上传媒体流。
需要说明的是, 在本发明实施例中, 管理人员事先对会议服务器进行扩 展以及增加功能, 也即是扩展会议服务器的 WebRTC接口, 在对会议服务器进 行扩展后, 增加会议服务器的功能, 使得会议服务器可对扩展后的接口、 协议 进行运行。
进一步地, 管理人员扩展会议服务器的 WebRTC接口中约束对象, 为约束 对象增加接收视频属性值以及接收音频属性值,该属性值用于设置会议服务器 中端口的属性,且该属性值为真或者为假; 管理人员在会议服务器生成第三传 输请求消息的方法中添加功能, 进而使得第二浏览器可判断属性值, 并设置自 身端口的属性,将已设置的端口属性携带在第三传输请求消息中, 以使得第三 传输请求消息包括自身端口的属性信息。
因此, 通过应用本发明实施例提供的视频会议中媒体流的传输方法, 属 于同一用户的多个终端可同时接入会议服务器并接收特定参会者的视音频信 息, 当第一浏览器未向会议服务器发送过第一媒体流时, 第二浏览器根据接收 的选择指令, 生成第一传输请求消息, 所述第一传输请求消息包括所述第二浏 览器中端口的属性信息;并根据端口的属性信息向会议服务器发送第二媒体流, 进而解决现有技术中出现的问题, 同时,通过两个或两个以上的终端设备参加 同一视频会议,每个终端接收特定参会者视音频信息, 并且用户可任意切换终 端来上传视音频信息。从而增强了 WebRTC视频会议功能,提高了用户的体验, 并节省了网络带宽以及终端本地的资源消耗。
进一步地, 图 7 为本发明实施例提供的另一种视频会议中媒体流的传输 方法信令图; 图 7所示的信令图为多个浏览器、 WebRTC应用与会议服务器进 行媒体流的传输过程,图 7中的视频会议中媒体流的传输方法均可按照前述实 施例描述的过程执行, 在此不再复述。
实施例五
相应地, 本发明实施例五还提供了一种视频会议中媒体流的传输装置, 用以实现实施例一中的视频会议中媒体流的传输方法,如图 8所示, 所述传输 装置处于终端内, 所述传输装置包括: 接收单元 810和发送单元 820。
所述接收单元 810 , 用于接收会议服务器发送的第一媒体流, 所述第一媒 体流包括视频会议中所有参会者的视音频信息;
所述接收单元 810还用于,接收选择指令, 所述选择指令具体为从所述所 有参会者的视音频信息中选择出所需的视音频信息对应的参会者;
发送单元 820 , 用于根据所述选择指令, 通过 WebRTC应用向所述会议服 务器发送传输请求消息, 所述传输请求消息包括选择出的参会者的标识信息; 所述接收单元 810还用于, 接收所述会议服务器根据所述标识信息发送 的第二媒体流, 所述第二媒体流包括选择出的参会者的视音频信息。
所述接收单元 810还用于, 根据所述选择指令, 接收所述 WebRTC应用发 送的创建指令;
所述传输装置还包括: 调用单元 830 , 用于根据所述创建指令, 调用扩展 后的 WebRTC接口,并解析所述扩展后的 WebRTC接口中约束对象的参会者属性; 提取单元 840 , 用于从所述参会者属性中提取选择出的参会者的标识信息, 并将每个所述参会者的标识信息存储在参会者列表内;
所述调用单元 830还用于, 调用扩展后的 SDP协议中内容属性;
所述传输装置还包括: 载入单元 850 , 用于将所述参会者列表载入所述扩 展后的 SDP协议中内容属性的 med i acnt-s rc区间内;
放入单元 860 , 用于将所述 med iacnt-s rc 区间携带在所述传输请求消息 中, 以使得所述传输请求消息包括选择出的参会者的标识信息; 所述发送单元 820还用于, 通过所述 WebRTC应用向所述会议服务器发送 所述传输请求消息。
所述装置还包括: 存储单元 870 , 用于将选择出的参会者的标识信息存储 在所述参会者属性中。
所述接收单元 81 0还用于, 通过所述 WebRTC应用接收所述会议服务器根 据所述传输请求消息发送的传输响应消息,用于确定与所述会议服务器已建立 传输连接。
所述传输装置还包括: 传输单元 880 , 用于向所述 WebRTC应用传输所述 第二媒体流, 以便于所述 WebRTC应用将所述第二媒体流进行播放。
因此, 通过应用本发明实施例提供的视频会议中媒体流的传输装置, 终 端的浏览器根据对视频会议中所有参会者的视音频信息进行选择的指令,向会 议服务器发送传输请求消息, 进而接收选择出的参会者的视音频信息, 并将接 收的视音频信息通过 WebRTC应用进行播放,进而解决现有技术中出现的问题, 浏览器接收特定参会者的视音频,从而屏蔽掉了用户不感兴趣的参会者视音频, 增强了 WebRTC视频会议的功能, 提高了用户的体验, 并可以节省网络带宽以 及终端本地的资源消耗。
实施例六
相应地, 本发明实施例六还提供了一种视频会议中媒体流的传输装置, 用以实现实施例二中的视频会议中媒体流的传输方法,如图 9所示, 所述传输 装置包括: 发送单元 91 0、 接收单元 920和提取单元 930。
所述发送单元 91 0 , 用于向浏览器发送第一媒体流, 所述第一媒体流包括 视频会议中所有参会者的视音频信息;
接收单元 920 , 用于接收所述浏览器通过 WebRTC应用发送的传输请求消 息,所述传输请求消息包括从所述所有参会者的视音频信息中选择出的所需视 音频信息对应的参会者的标识信息;
提取单元 930 , 用于 4艮据所述标识信息, 提取与所述标识信息对应的所述 参会者的视音频信息;
所述发送单元 91 0还用于, 向所述浏览器发送第二媒体流, 所述第二媒体 流包括选择出的参会者的视音频信息。
所述传输装置还包括: 调用单元 940 , 用于调用扩展口的 WebRTC接口; 所述提取单元 930还用于, 根据调用的所述扩展后的 WebRTC接口, 从所 述传输请求消息中提取选择出的所述参会者的标识信息;
所述装置还包括: 存储单元 950 , 用于将选择出的所述参会者的标识信息 存储在参会者列表内;
所述发送单元 91 0还用于, 通过所述扩展后的 WebRTC接口与所述 WebRTC 应用之间建立的连接向所述浏览器发送传输响应消息,用于使所述浏览器确定 与所述会议服务器已建立传输连接。
所述提取单元 930具体用于,根据所述存储单元中所述参会者列表内存储 的选择出的所述参会者的标识信息, 从所述扩展后的 WebRTC接口中提取对应 的参会者的媒体跟踪对象, 所述媒体跟踪对象包括所述参会者的视音频信息。
所述发送单元息 91 0具体用于,将所述媒体跟踪对象携带在第二媒体流中, 以使得所述第二媒体流包括选择出的参会者的视音频信息。
因此, 通过应用本发明实施例提供的视频会议中媒体流的传输装置, 终 端的浏览器根据对视频会议中所有参会者的视音频信息进行选择的指令,向会 议服务器发送传输请求消息, 进而接收选择出的参会者的视音频信息, 并将接 收的视音频信息通过 WebRTC应用进行播放,进而解决现有技术中出现的问题, 浏览器接收特定参会者的视音频,从而屏蔽掉了用户不感兴趣的参会者视音频, 增强了 WebRTC视频会议的功能, 提高了用户的体验, 并可以节省网络带宽以 及终端本地的资源消耗。
实施例七
相应地, 本发明实施例七还提供了一种视频会议中媒体流的传输装置, 用以实现实施例三中的视频会议中媒体流的传输方法, 如图 10所示, 所述视 频会议中的每一会场包括第一终端以及第二终端,所述传输装置处于第二终端 内, 所述传输装置包括: 接收单元 1010和发送单元 1 020。
所述接收单元 1010 , 用于当第一终端的浏览器与所述传输装置通过同一 用户登录信息接入会议服务器,且所述浏览器未向所述会议服务器发送第一媒 体流时,接收第一选择指令, 所述第一选择指令具体为从所述第二终端选择出 待发送的视音频信息;
发送单元 1020 , 用于根据所述第一选择指令, 通过所述第二终端的第一 WebRTC 应用向所述会议服务器发送第一传输请求消息, 所述第一传输请求消 息包括所述传输装置中端口属性信息;
所述发送单元 1020还用于, 当接收到所述会议服务器根据所述第一传输 请求消息发送的第一传输响应消息时,根据所述端口属性信息, 通过对应的端 口向所述会议服务器发送第二媒体流,所述第二媒体流包括所述待发送的视音 频信息。
所述接收单元 1010还用于, 接收所述会议服务器发送的第三媒体流, 所 述第三媒体流包括视频会议中所有参会者的视音频信息;
所述接收单元 1010还用于, 接收第二选择指令, 所述第二选择指令具体 为从所述所有参会者的视音频信息中选择出所需的视音频信息对应的参会者; 所述发送单元 1020还用于 ,根据所述第二选择指令,通过所述第一 WebRTC 应用向所述会议服务器发送所述第二传输请求消息,所述第二传输请求消息包 括选择出的参会者的标识信息; 所述接收单元 1 01 0还用于,通过所述第一 WebRTC应用接收所述会议服务 器发送的第二传输响应消息,所述第二传输响应消息用于使所述传输装置确定 当存在所述浏览器向所述会议服务器发送第一媒体流时 ,不向所述会议服务器 发送所述第二终端中的视音频信息;
所述接收单元 1 01 0还用于, 接收所述会议服务器根据所述标识信息发送 的第四媒体流, 所述第四媒体流包括选择出的参会者的视音频信息。
所述传输装置还包括: 所述接收单元 1 01 0还用于, 根据所述第一选择指 令, 接收所述第一 WebRTC应用发送的创建指令;
所述传输装置还包括: 调用单元 1 030 , 用于根据所述创建指令, 调用扩 展后的 WebRTC接口,并判断所述扩展后的 WebRTC接口中约束对象的发送视频 属性值以及发送音频属性值;
设置单元 1 040 , 用于当所述发送视频属性值为真时, 则将已接收视频信 息的第一视频端口属性设置为仅接收视频端口,将未接收视频信息的第二视频 端口属性设置为仅发送视频端口;
所述设置单元 1 040还用于, 当所述发送音频属性值为真时, 则将音频端 口的属性设置为发送接收端口;
所述传输装置还包括: 放入单元 1 050 , 用于将已设置的端口属性信息携 带在所述第一传输请求消息中,以使得所述第一传输请求消息包括所述传输装 置中端口属性信息;
所述发送单元 1 020还用于, 通过所述第二终端的第一 WebRTC应用向所 述会议服务器发送所述第一传输请求消息。
因此, 通过应用本发明实施例提供的视频会议中媒体流的传输装置, 属 于同一用户的多个终端可同时接入会议服务器并接收特定参会者的视音频信 息, 当第一浏览器未向会议服务器发送过第一媒体流时, 第二浏览器根据接收 的选择指令, 生成第一传输请求消息, 所述第一传输请求消息包括所述第二浏 览器中端口的属性信息;并根据端口的属性信息向会议服务器发送第二媒体流, 进而解决现有技术中出现的问题, 同时,通过两个或两个以上的终端设备参加 同一视频会议,每个终端接收特定参会者视音频信息, 并且用户可任意切换终 端来上传本地视音频信息。 从而增强了 WebRTC视频会议功能, 提高了用户的 体验, 并节省了网络带宽以及终端本地的资源消耗。
实施例八
相应地, 本发明实施例八还提供了一种视频会议中媒体流的传输装置, 用以实现实施例四中的视频会议中媒体流的传输方法, 如图 11所示, 所述传 输装置包括: 接收单元 1110和发送单元 1120。
所述接收单元 1110 , 用于当所述传输装置接受第一终端的第一浏览器以 及第二终端的第二浏览器通过同一用户登录信息接入所述传输装置,且所述第 一浏览器未向所述传输装置发送第一媒体流时,接收所述第二浏览器通过所述 第二终端的第一 WebRTC应用发送的第一传输请求消息, 所述第一传输请求消 息包括所述第二浏览器中端口属性信息;
发送单元 1120 , 用于根据所述第一传输请求消息, 向所述第二浏览器发 送第一传输响应消息 ,用于使所述第二浏览器确定与所述传输装置已建立传输 连接;
所述接收单元 1110还用于, 接收所述第二浏览器根据所述端口属性信息 发送的第二媒体流,所述第二媒体流包括从所述第二终端选择出的待发送的视 音频信息。
所述发送单元 1120还用于, 向所述第二浏览器发送第三媒体流, 所述第 三媒体流包括视频会议中所有参会者的视音频信息;
所述接收单元 111 0还用于, 接收所述第二浏览器通过所述第一 WebRTC 应用发送的第二传输请求消息 ,所述第二传输请求消息包括从所述所有参会者 的视音频信息中选择出的所需视音频信息对应的参会者的标识信息;
所述传输装置还包括:判断单元 11 30 ,用于根据所述第二传输请求消息, 调用扩展后的 WebRTC接口, 并判断所述第一浏览器是否正在发送媒体流; 设置单元 1140 , 用于如果所述第一浏览器正在发送媒体流, 则将所述传 输装置的端口属性设置为仅发送端口;
所述发送单元 1120还用于, 将已设置的端口属性信息携带在第二传输响 应消息内, 并通过所述第一 WebRTC应用向所述第二浏览器发送所述第二传输 响应消息,所述第二传输响应消息用于使所述第二浏览器确定当存在所述第一 浏览器向所述传输装置发送媒体流时,不向所述传输装置发送所述第二终端中 的视音频信息;
所述传输装置还包括: 提取单元 1150 , 用于根据所述标识信息, 提取与 所述标识信息对应的所述参会者的视音频信息;
所述发送单元 1120还用于, 向所述第二浏览器发送第四媒体流, 所述第 四媒体流包括选择出的参会者的视音频信息。
所述发送单元 1120还用于, 根据所述端口属性信息, 向所述第二浏览器 中对应的端口发送第五媒体流。
所述判断单元 11 30还用于,调用扩展后的 WebRTC接口, 并判断所述扩展 后的 WebRTC接口中约束对象的接收视频属性值以及接收音频属性值;
所述设置单元 1140还用于, 当所述判断单元的判断结果为所述接收视频 属性值为真时, 则将已接收视频信息的视频端口属性设置为仅发送视频端口; 所述设置单元 1140还用于, 当所述判断单元的判断结果为所述当所述接 收音频属性值为真时,则将已接收音频信息的音频端口属性设置为仅发送音频 端口; 所述发送单元 1120还用于, 将已设置的端口属性信息携带在第三传输请 求消息中, 并向所述第一浏览器发送所述第三传输请求消息, 所述第三传输请 求消息用于使所述第一浏览器确定不向所述传输装置发送所述第一终端中的 视音频信息。
因此, 通过应用本发明实施例提供的视频会议中媒体流的传输装置, 属 于同一用户的多个终端可同时接入会议服务器并接收特定参会者的视音频信 息, 当第一浏览器未向会议服务器发送过第一媒体流时, 第二浏览器根据接收 的选择指令, 生成第一传输请求消息, 所述第一传输请求消息包括所述第二浏 览器中端口的属性信息;并根据端口的属性信息向会议服务器发送第二媒体流, 进而解决现有技术中出现的问题, 同时, 用户通过两个或两个以上的终端设备 参加同一视频会议,每个终端接收特定参会者视音频信息, 并且用户可任意切 换终端来上传本地视音频信息。 从而增强了 WebRTC视频会议功能, 提高了用 户的体验, 并节省了网络带宽以及终端本地的资源消耗。
实施例九
另外, 本发明实施例五提供的视频会议中媒体流的传输装置还可通过以 下形式实现, 用以实现本发明实施例一中的视频会议中媒体流的传输方法,如 图 12所示, 所述传输装置处于终端内, 所述传输装置包括: 网络接口 1210、 处理器 1220和存储器 1230。 系统总线 1240用于连接网络接口 1210、 处理器 1220和存储器 1230。
网络接口 1210用于与处于通信网络中的会议服务器, 或者用户进行交互 通信。
存储器 1230 可以是永久存储器, 例如硬盘驱动器和闪存, 存储器 1230 中具有软件模块和设备驱动程序。软件模块能够执行本发明上述方法的各种功 能模块; 设备驱动程序可以是网络和接口驱动程序。 在启动时, 这些软件模块被加载到存储器 1230 中, 然后被处理器 1220 访问并执行如下指令:
接收会议服务器发送的第一媒体流,所述第一媒体流包括视频会议中所有 参会者的视音频信息;
接收选择指令,所述选择指令具体为从所述所有参会者的视音频信息中选 择出所需的视音频信息对应的参会者;
根据所述选择指令, 通过 WebRTC应用向所述会议服务器发送传输请求消 息, 所述传输请求消息包括所述用户选择出的参会者的标识信息;
接收所述会议服务器根据所述标识信息发送的第二媒体流, 所述第二媒 体流包括选择出的参会者的视音频信息。
进一步的, 所述处理器 1220访问存储器 1230的软件模块后, 执行以下 过程的指令:
根据所述选择指令, 接收所述 WebRTC应用发送的创建指令;
根据所述创建指令, 调用扩展后的 WebRTC 接口, 并解析所述扩展后的 WebRTC接口中约束对象的参会者属性;
从所述参会者属性中提取选择出的参会者的标识信息,并将每个所述参会 者的标识信息存储在参会者列表内;
调用扩展后的 SDP协议中内容属性;
将所述参会者列表载入所述扩展后的 SDP 协议中内容属性的媒体来源标 med iacnt-s rc区间内;
将所述 med iacnt-s rc区间携带在所述传输请求消息中, 以使得所述传输 请求消息包括选择出的参会者的标识信息;
通过所述 WebRTC应用向所述会议服务器发送所述传输请求消息。
进一步地, 所述处理器 1220访问存储器 1230的软件模块后, 执行以下 过程的指令:
将选择出的参会者的标识信息存储在所述参会者属性中。
进一步的, 所述处理器 1220访问存储器 1230的软件模块后, 执行以下 过程的指令:
通过所述 WebRTC应用接收所述会议服务器根据所述传输请求消息发送的 传输响应消息, 用于确定与所述会议服务器已建立传输连接。
进一步的, 所述处理器 1220访问存储器 1230的软件模块后, 执行以下 过程的指令:
向所述 WebRTC应用传输所述第二媒体流, 以便于所述 WebRTC应用将所 述第二媒体流进行播放。
因此, 通过应用本发明实施例提供的视频会议中媒体流的传输装置, 终 端的浏览器根据对视频会议中所有参会者的视音频信息进行选择的指令,向会 议服务器发送传输请求消息, 进而接收选择出的参会者的视音频信息, 并将接 收的视音频信息通过 WebRTC应用进行播放,进而解决现有技术中出现的问题, 浏览器接收特定参会者的视音频,从而屏蔽掉了用户不感兴趣的参会者视音频, 增强了 WebRTC视频会议的功能, 提高了用户的体验, 并可以节省网络带宽以 及终端本地的资源消耗。
实施例十
另外, 本发明实施例六提供的视频会议中媒体流的传输装置还可通过以 下形式实现, 用以实现本发明实施例二中的视频会议中媒体流的传输方法,如 图 1 3所示,所述传输装置包括: 网络接口 1 31 0、处理器 1 320和存储器 1 330。 系统总线 1 340用于连接网络接口 1 31 0、 处理器 1 320和存储器 1 330。
网络接口 1 31 0用于与终端内的浏览器进行交互通信。
存储器 1 330 可以是永久存储器, 例如硬盘驱动器和闪存, 存储器 1 330 中具有软件模块和设备驱动程序。软件模块能够执行本发明上述方法的各种功 能模块; 设备驱动程序可以是网络和接口驱动程序。
在启动时, 这些软件模块被加载到存储器 1 330 中, 然后被处理器 1 320 访问并执行如下指令:
向浏览器发送第一媒体流,所述第一媒体流包括视频会议中所有参会者的 视音频信息;
接收所述浏览器通过 WebRTC应用发送的传输请求消息, 所述传输请求消 息包括从所述所有参会者的视音频信息中选择出的所需视音频信息对应的参 会者的标识信息;
根据所述标识信息,提取与所述标识信息对应的所述参会者的视音频信息; 向所述浏览器发送第二媒体流, 所述第二媒体流包括选择出的参会者的 视音频信息。
进一步的, 所述处理器 1 320访问存储器 1 330的软件模块后, 执行以下 过程的指令:
调用扩展后的 WebRTC接口;
根据调用的所述扩展后的 WebRTC接口, 从所述传输请求消息中提取选择 出的所述参会者的标识信息;
将选择出的所述参会者的标识信息存储在参会者列表内;
通过所述扩展后的 WebRTC接口与所述 WebRTC应用之间建立的连接向所 述浏览器发送传输响应消息 ,用于使所述浏览器确定与所述会议服务器已建立 传输连接。
进一步的, 所述处理器 1 320访问存储器 1 330的软件模块后, 执行根据 所述标识信息,提取与所述标识信息对应的所述参会者的视音频信息过程的具 体指令: 根据所述参会者列表内存储的选择出的所述参会者的标识信息, 从所述 扩展后的 WebRTC接口中提取对应的参会者的媒体跟踪对象, 所述媒体跟踪对 象包括所述参会者的视音频信息。
进一步的, 所述处理器 1 320访问存储器 1 330的软件模块后, 执行向所 述传输浏览器发送第二媒体流,所述第二媒体流包括所述用户选择出的参会者 的视音频信息过程的具体指令:
将所述媒体跟踪对象携带在第二媒体流中, 以使得所述第二媒体流包括 选择出的参会者的视音频信息。
因此, 通过应用本发明实施例提供的视频会议中媒体流的传输装置, 终 端的浏览器根据对视频会议中所有参会者的视音频信息进行选择的指令,向会 议服务器发送传输请求消息, 进而接收选择出的参会者的视音频信息, 并将接 收的视音频信息通过 WebRTC应用进行播放,进而解决现有技术中出现的问题, 浏览器接收特定参会者的视音频,从而屏蔽掉了用户不感兴趣的参会者视音频, 增强了 WebRTC视频会议的功能, 提高了用户的体验, 并可以节省网络带宽以 及终端本地的资源消耗。
实施例十一
另外, 本发明实施例七提供的视频会议中媒体流的传输装置还可通过以 下形式实现, 用以实现本发明实施例三中的视频会议中媒体流的传输方法,如 图 14所示, 所述视频会议中的每一会场包括第一终端以及第二终端, 所述传 输装置处于第二终端内, 所述传输装置包括: 网络接口 141 0、 处理器 1420和 存储器 1430。 系统总线 1440用于连接网络接口 141 0、 处理器 1420和存储器 1430。
网络接口 141 0用于与处于通信网络中的会议服务器, 或者用户进行交互 通信。 存储器 1430 可以是永久存储器, 例如硬盘驱动器和闪存, 存储器 1430 中具有软件模块和设备驱动程序。软件模块能够执行本发明上述方法的各种功 能模块; 设备驱动程序可以是网络和接口驱动程序。
在启动时, 这些软件模块被加载到存储器 1430 中, 然后被处理器 1420 访问并执行如下指令:
当第一终端的浏览器与所述传输装置通过同一用户登录信息接入会议服 务器,且所述浏览器未向所述会议服务器发送第一媒体流时,接收第一选择指 令, 所述第一选择指令具体为从所述第二终端选择出待发送的视音频信息; 根据所述第一选择指令, 通过所述第二终端的第一 WebRTC应用向所述会 议服务器发送第一传输请求消息,所述第一传输请求消息包括所述第二浏览器 中端口属性信息;
当接收到所述会议服务器根据所述第一传输请求消息发送的第一传输响 应消息时,根据所述端口属性信息,通过对应的端口向所述会议服务器发送第 二媒体流, 所述第二媒体流包括所述待发送的视音频信息。
进一步地, 所述处理器 1420访问存储器 1430的软件模块后, 执行以下 过程的指令:
接收所述会议服务器发送的第三媒体流,所述第三媒体流包括视频会议中 所有参会者的视音频信息;
接收第二选择指令,所述第二选择指令具体为从所述所有参会者的视音频 信息中选择出所需的视音频信息对应的参会者;
根据所述第二选择指令, 通过所述第一 WebRTC应用向所述会议服务器发 送所述第二传输请求消息,所述第二传输请求消息包括选择出的参会者的标识 信息;
通过所述第一 WebRTC应用接收所述会议服务器发送的第二传输响应消息, 所述第二传输响应消息用于使所述传输装置确定当存在所述浏览器向所述会 议服务器发送第一媒体流时,不向所述会议服务器发送所述第二终端中的视音 频信息;
接收所述会议服务器根据所述标识信息发送的第四媒体流, 所述第四媒 体流包括选择出的参会者的视音频信息。
进一步地, 所述处理器 1420访问存储器 1430的软件模块后, 执行以下 过程的指令:
根据所述第一选择指令, 接收所述第一 WebRTC应用发送的创建指令; 根据所述创建指令, 调用扩展后的 WebRTC 接口, 并判断所述扩展后的
WebRTC接口中约束对象的发送视频属性值以及发送音频属性值;
当所述发送视频属性值为真时,则将已接收视频信息的第一视频端口属性 设置为仅接收视频端口,将未接收视频信息的第二视频端口属性设置为仅发送 视频端口;
当所述发送音频属性值为真时,则将音频端口的属性设置为发送接收端口; 将已设置的端口属性信息携带在所述第一传输请求消息中, 以使得所述 第一传输请求消息包括所述第二浏览器中端口属性信息;
通过所述第二终端的第一 WebRTC应用向所述会议服务器发送所述第一传 输请求消息。
因此, 通过应用本发明实施例提供的视频会议中媒体流的传输方法, 属 于同一用户的多个终端可同时接入会议服务器并接收特定参会者的视音频信 息, 当第一浏览器未向会议服务器发送过第一媒体流时, 第二浏览器根据接收 的选择指令, 生成第一传输请求消息, 所述第一传输请求消息包括所述第二浏 览器中端口的属性信息;并根据端口的属性信息向会议服务器发送第二媒体流, 进而解决现有技术中出现的问题, 同时, 用户通过两个或两个以上的终端设备 参加同一视频会议,每个终端接收特定参会者视音频信息, 并且用户可任意切 换终端来上传本地视音频信息。 从而增强了 WebRTC视频会议功能, 提高了用 户的体验, 并节省了网络带宽以及终端本地的资源消耗。
实施例十二
另外, 本发明实施例八提供的视频会议中媒体流的传输装置还可通过以 下形式实现, 用以实现本发明实施例四中的视频会议中媒体流的传输方法,如 图 15所示,所述传输装置包括: 网络接口 151 0、处理器 1 520和存储器 1 530。 系统总线 1540用于连接网络接口 1 51 0、 处理器 1520和存储器 1530。
网络接口 151 0用于与终端内的浏览器进行交互通信。
存储器 1530 可以是永久存储器, 例如硬盘驱动器和闪存, 存储器 1530 中具有软件模块和设备驱动程序。软件模块能够执行本发明上述方法的各种功 能模块; 设备驱动程序可以是网络和接口驱动程序。
在启动时, 这些软件模块被加载到存储器 1530 中, 然后被处理器 1520 访问并执行如下指令:
当所述传输装置接受第一终端的第一浏览器以及第二终端的第二浏览器 通过同一用户登录信息接入所述传输装置,且所述第一浏览器未向所述会议服 务器发送第一媒体流时, 接收所述第二浏览器通过所述第二终端的第一 WebRTC 应用发送的第一传输请求消息, 所述第一传输请求消息包括所述第二 浏览器中端口属性信息;
根据所述第一传输请求消息, 向所述第二浏览器发送第一传输响应消息, 用于使所述第二浏览器确定与所述传输装置已建立传输连接;
接收所述第二浏览器根据所述端口属性信息发送的第二媒体流, 所述第 二媒体流包括从所述第二终端选择出的待发送的视音频信息。
进一步地, 所述处理器 1520访问存储器 1530的软件模块后, 执行以下 过程的指令:
向所述第二浏览器发送第三媒体流,所述第三媒体流包括视频会议中所有 参会者的视音频信息;
接收所述第二浏览器通过所述第一 WebRTC应用发送的第二传输请求消息, 所述第二传输请求消息包括从所述所有参会者的视音频信息中选择出的所需 视音频信息对应的参会者的标识信息;
根据所述第二传输请求消息, 调用扩展后的 WebRTC接口, 并判断所述第 一浏览器是否正在发送媒体流;
如果所述第一浏览器正在发送媒体流,则将所述传输装置的端口属性设置 为仅发送端口;
将已设置的端口属性信息携带在第二传输响应消息内, 并通过所述第一 WebRTC 应用向所述第二浏览器发送所述第二传输响应消息, 所述第二传输响 应消息用于使所述第二浏览器确定当存在所述第一浏览器向所述传输装置发 送媒体流时, 不向所述传输装置发送所述第二终端中的视音频信息;
根据所述标识信息,提取与所述标识信息对应的所述参会者的视音频信息; 向所述第二浏览器发送第四媒体流, 所述第四媒体流包括选择出的参会 者的视音频信息。
进一步地, 所述处理器 1520访问存储器 1530的软件模块后, 执行以下 过程的指令:
根据所述端口属性信息, 向所述第二浏览器中对应的端口发送第五媒体 流。
进一步地, 所述处理器 1520访问存储器 1530的软件模块后, 执行以下 过程的指令:
调用扩展后的 WebRTC接口,并判断所述扩展后的 WebRTC接口中约束对象 的接收视频属性值以及接收音频属性值;
当所述接收视频属性值为真时,则将已接收视频信息的视频端口属性设置 为仅发送视频端口;
当所述接收音频属性值为真时,则将已接收音频信息的音频端口属性设置 为仅发送音频端口;
将已设置的端口属性信息携带在第三传输请求消息中, 并向所述第一浏 览器发送所述第三传输请求消息,所述第三传输请求消息用于使所述第一浏览 器确定不向所述传输装置发送所述第一终端中的视音频信息。
因此, 通过应用本发明实施例提供的视频会议中媒体流的传输装置, 属 于同一用户的多个终端可同时接入会议服务器并接收特定参会者的视音频信 息, 当第一浏览器未向会议服务器发送过第一媒体流时, 第二浏览器根据接收 的选择指令, 生成第一传输请求消息, 所述第一传输请求消息包括所述第二浏 览器中端口的属性信息;并根据端口的属性信息向会议服务器发送第二媒体流, 进而解决现有技术中出现的问题, 同时,通过两个或两个以上的终端设备参加 同一视频会议,每个终端接收特定参会者视音频信息, 并且用户可任意切换终 端来上传本地视音频信息。 从而增强了 WebRTC视频会议功能, 提高了用户的 体验, 并节省了网络带宽以及终端本地的资源消耗。
专业人员应该还可以进一步意识到, 结合本文中所公开的实施例描述的 各示例的单元及算法步骤, 能够以电子硬件、计算机软件或者二者的结合来实 现, 为了清楚地说明硬件和软件的可互换性,在上述说明中已经按照功能一般 性地描述了各示例的组成及步骤。 这些功能究竟以硬件还是软件方式来执行, 取决于技术方案的特定应用和设计约束条件。专业技术人员可以对每个特定的 应用来使用不同方法来实现所描述的功能,但是这种实现不应认为超出本发明 的范围。 结合本文中所公开的实施例描述的方法或算法的步骤可以用硬件、 处理 器执行的软件模块, 或者二者的结合来实施。 软件模块可以置于随机存储器 ( RAM )、 内存、 只读存储器(ROM )、 电可编程 R0M、 电可擦除可编程 R0M、 寄 存器、 硬盘、 可移动磁盘、 CD-R0M、 或技术领域内所公知的任意其它形式的存 储介质中。
以上所述的具体实施方式, 对本发明的目的、 技术方案和有益效果进行 了进一步详细说明,所应理解的是,以上所述仅为本发明的具体实施方式而已, 并不用于限定本发明的保护范围, 凡在本发明的精神和原则之内, 所做的任何 修改、 等同替换、 改进等, 均应包含在本发明的保护范围之内。

Claims

权 利 要 求
1、 一种视频会议中媒体流的传输方法, 其特征在于, 所述方法包括: 接收会议服务器发送的第一媒体流,所述第一媒体流包括视频会议中所有 参会者的视音频信息;
接收选择指令,所述选择指令具体为从所述所有参会者的视音频信息中选 择出所需的视音频信息对应的参会者;
根据所述选择指令, 通过 WebRTC应用向所述会议服务器发送传输请求消 息, 所述传输请求消息包括选择出的参会者的标识信息;
接收所述会议服务器根据所述标识信息发送的第二媒体流,所述第二媒体 流包括选择出的参会者的视音频信息。
2、 根据权利要求 1所述的传输方法, 其特征在于, 所述根据所述选择指 令, 通过 WebRTC应用向所述会议服务器发送所述传输请求消息之前还包括: 根据所述选择指令, 接收所述 WebRTC应用发送的创建指令;
根据所述创建指令, 调用扩展后的 WebRTC 接口, 并解析所述扩展后的 WebRTC接口中约束对象的参会者属性;
从所述参会者属性中提取选择出的参会者的标识信息,并将每个所述参会 者的标识信息存储在参会者列表内;
调用扩展后的 SDP协议中内容属性;
将所述参会者列表载入所述扩展后的 SDP 协议中内容属性的媒体来源标 med iacnt-s rc区间内;
将所述 med iacnt-s rc区间携带在所述传输请求消息中, 以使得所述传输 请求消息包括选择出的参会者的标识信息;
通过所述 WebRTC应用向所述会议服务器发送所述传输请求消息。
3、 根据权利要求 2所述的传输方法, 其特征在于, 所述解析所述扩展后 的 WebRTC接口中约束对象的参会者属性之前还包括:
将选择出的参会者的标识信息存储在所述参会者属性中。
4、 根据权利要求 1、 2或 3所述的传输方法, 其特征在于, 所述接收所述 会议服务器根据所述标识信息发送的第二媒体流之前还包括:
通过所述 WebRTC应用接收所述会议服务器根据所述传输请求消息发送的 传输响应消息, 用于确定与所述会议服务器已建立传输连接。
5、 根据权利要求 1、 2、 3或 4所述的传输方法, 其特征在于, 所述接收 所述会议服务器根据所述标识信息发送的第二媒体流之后还包括:
向所述 WebRTC应用传输所述第二媒体流,以便于所述 WebRTC应用将所述 第二媒体流进行播放。
6、 一种视频会议中媒体流的传输方法, 其特征在于, 所述方法包括: 向浏览器发送第一媒体流,所述第一媒体流包括视频会议中所有参会者的 视音频信息;
接收所述浏览器通过 WebRTC应用发送的传输请求消息, 所述传输请求消 息包括从所述所有参会者的视音频信息中选择出的所需视音频信息对应的参 会者的标识信息;
根据所述标识信息,提取与所述标识信息对应的所述参会者的视音频信息; 向所述浏览器发送第二媒体流,所述第二媒体流包括选择出的参会者的视 音频信息。
7、 根据权利要求 6所述的传输方法, 其特征在于, 所述接收所述浏览器 通过 WebRTC应用发送的传输请求消息之后还包括:
调用扩展后的 WebRTC接口;
根据调用的所述扩展后的 WebRTC接口, 从所述传输请求消息中提取选择 出的所述参会者的标识信息;
将选择出的所述参会者的标识信息存储在参会者列表内;
通过所述扩展后的 WebRTC接口与所述 WebRTC应用之间建立的连接向所述 浏览器发送传输响应消息,用于使所述浏览器确定与会议服务器已建立传输连 接。
8、 根据权利要求 7所述的传输方法, 其特征在于, 所述根据所述标识信 息, 提取与所述标识信息对应的所述参会者的视音频信息具体包括:
根据所述参会者列表内存储的选择出的所述参会者的标识信息,从所述扩 展后的 WebRTC接口中提取对应的参会者的媒体跟踪对象, 所述媒体跟踪对象 包括所述参会者的视音频信息。
9、 根据权利要求 8所述的传输方法, 其特征在于, 所述向所述传输浏览 器发送第二媒体流,所述第二媒体流包括选择出的参会者的视音频信息具体包 括:
将所述媒体跟踪对象携带在第二媒体流中,以使得所述第二媒体流包括选 择出的参会者的视音频信息。
1 0、 一种视频会议中媒体流的传输方法, 其特征在于, 所述方法包括: 当第一终端的第一浏览器与第二终端的第二浏览器通过同一用户登录信 息接入会议服务器,且所述第一浏览器未向所述会议服务器发送第一媒体流时, 所述第二浏览器接收第一选择指令,所述第一选择指令具体为从所述第二终端 选择出待发送的视音频信息;
根据所述第一选择指令, 通过所述第二终端的第一 WebRTC应用向所述会 议服务器发送第一传输请求消息,所述第一传输请求消息包括所述第二浏览器 中端口属性信息;
当接收到所述会议服务器根据所述第一传输请求消息发送的第一传输响 应消息时,根据所述端口属性信息,通过对应的端口向所述会议服务器发送第 二媒体流, 所述第二媒体流包括所述待发送的视音频信息。
1 1、 根据权利要求 1 0所述的传输方法, 其特征在于, 所述第二浏览器接 收用户输入的第一选择指令之前还包括:
接收所述会议服务器发送的第三媒体流,所述第三媒体流包括视频会议中 所有参会者的视音频信息;
接收第二选择指令,所述第二选择指令具体为从所述所有参会者的视音频 信息中选择出所需的视音频信息对应的参会者;
根据所述第二选择指令, 通过所述第一 WebRTC应用向所述会议服务器发 送所述第二传输请求消息,所述第二传输请求消息包括选择出的参会者的标识 信息;
通过所述第一 WebRTC应用接收所述会议服务器发送的第二传输响应消息, 所述第二传输响应消息用于使所述第二浏览器确定当存在所述第一浏览器向 所述会议服务器发送第一媒体流时,不向所述会议服务器发送所述第二终端中 的视音频信息;
接收所述会议服务器根据所述标识信息发送的第四媒体流,所述第四媒体 流包括选择出的参会者的视音频信息。
12、 根据权利要求 1 0或 1 1所述的传输方法, 其特征在于, 所述根据所述 第一选择指令, 通过所述第二终端的第一 WebRTC应用向所述会议服务器发送 第一传输请求消息之前还包括:
根据所述第一选择指令, 接收所述第一 WebRTC应用发送的创建指令; 根据所述创建指令, 调用扩展后的 WebRTC 接口, 并判断所述扩展后的 WebRTC接口中约束对象的发送视频属性值以及发送音频属性值;
当所述发送视频属性值为真时,则将已接收视频信息的第一视频端口属性 设置为仅接收视频端口,将未接收视频信息的第二视频端口属性设置为仅发送 视频端口;
当所述发送音频属性值为真时,则将音频端口的属性设置为发送接收端口; 将已设置的端口属性信息携带在所述第一传输请求消息中,以使得所述第 一传输请求消息包括所述第二浏览器中端口属性信息;
通过所述第二终端的第一 WebRTC应用向所述会议服务器发送所述第一传 输请求消息。
1 3、 一种视频会议中媒体流的传输方法, 其特征在于, 所述方法包括: 当会议服务器接受第一终端的第一浏览器以及第二终端的第二浏览器通 过同一用户登录信息接入所述会议服务器 ,且所述第一浏览器未向所述会议服 务器发送第一媒体流时 ,所述会议服务器接收所述第二浏览器通过所述第二终 端的第一 WebRTC应用发送的第一传输请求消息, 所述第一传输请求消息包括 所述第二浏览器中端口属性信息;
根据所述第一传输请求消息, 向所述第二浏览器发送第一传输响应消息, 用于使所述第二浏览器确定与所述会议服务器已建立传输连接;
接收所述第二浏览器根据所述端口属性信息发送的第二媒体流,所述第二 媒体流包括从所述第二终端选择出的待发送的视音频信息。
14、 根据权利要求 1 3所述的传输方法, 其特征在于, 所述会议服务器接 收所述第二浏览器通过所述第二终端的第一 WebRTC应用发送的第一传输请求 消息之前还包括:
向所述第二浏览器发送第三媒体流,所述第三媒体流包括视频会议中所有 参会者的视音频信息;
接收所述第二浏览器通过所述第一 WebRTC应用发送的第二传输请求消息, 所述第二传输请求消息包括从所述所有参会者的视音频信息中选择出的所需 视音频信息对应的参会者的标识信息;
根据所述第二传输请求消息, 调用扩展后的 WebRTC接口, 并判断所述第 一浏览器是否正在发送媒体流;
如果所述第一浏览器正在发送媒体流,则将所述会议服务器的端口属性设 置为仅发送端口;
将已设置的端口属性信息携带在第二传输响应消息内, 并通过所述第一 WebRTC 应用向所述第二浏览器发送所述第二传输响应消息, 所述第二传输响 应消息用于使所述第二浏览器确定当存在所述第一浏览器向所述会议服务器 发送媒体流时, 不向所述会议服务器发送所述第二终端中的视音频信息;
根据所述标识信息,提取与所述标识信息对应的所述参会者的视音频信息; 向所述第二浏览器发送第四媒体流,所述第四媒体流包括选择出的参会者 的视音频信息。
15、 根据权利要求 1 3或 14所述的传输方法, 其特征在于, 所述接收所述 第二浏览器根据所述端口属性信息发送的第二媒体流之后还包括:
根据所述端口属性信息,向所述第二浏览器中对应的端口发送第五媒体流。
16、 根据权利要求 1 3、 14或 15所述的传输方法, 其特征在于, 所述接收 所述第二浏览器根据所述端口属性信息发送的第二媒体流之后还包括:
调用扩展后的 WebRTC接口,并判断所述扩展后的 WebRTC接口中约束对象 的接收视频属性值以及接收音频属性值;
当所述接收视频属性值为真时,则将已接收视频信息的视频端口属性设置 为仅发送视频端口;
当所述接收音频属性值为真时,则将已接收音频信息的音频端口属性设置 为仅发送音频端口;
将已设置的端口属性信息携带在第三传输请求消息中,并向所述第一浏览 器发送所述第三传输请求消息,所述第三传输请求消息用于使所述第一浏览器 确定不向所述会议服务器发送所述第一终端中的视音频信息。
17、 一种视频会议中媒体流的传输装置, 所述传输装置处于终端内, 其特 征在于, 所述传输装置包括:
接收单元, 用于接收会议服务器发送的第一媒体流, 所述第一媒体流包括 视频会议中所有参会者的视音频信息;
所述接收单元还用于,接收选择指令, 所述选择指令具体为从所述所有参 会者的视音频信息中选择出所需的视音频信息对应的参会者;
发送单元, 用于根据所述选择指令, 通过 WebRTC应用向所述会议服务器 发送传输请求消息, 所述传输请求消息包括选择出的参会者的标识信息; 所述接收单元用于,接收所述会议服务器根据所述标识信息发送的第二媒 体流, 所述第二媒体流包括选择出的参会者的视音频信息。
18、 根据权利要求 17所述的传输装置, 其特征在于, 所述所述接收单元 还用于, 根据所述选择指令, 接收所述 WebRTC应用发送的创建指令;
所述传输装置还包括: 调用单元, 用于根据所述创建指令, 调用扩展后的 WebRTC接口, 并解析所述扩展后的 WebRTC接口中约束对象的参会者属性; 提取单元, 用于从所述参会者属性中提取选择出的参会者的标识信息, 并 将每个所述参会者的标识信息存储在参会者列表内;
所述调用单元还用于, 调用扩展后的 SDP协议中内容属性;
所述传输装置还包括: 载入单元, 用于将所述参会者列表载入所述扩展后 的 SDP协议中内容属性的媒体来源标识 med iacnt-s rc区间内;
放入单元, 用于将所述 med iacnt-s rc区间携带在所述传输请求消息中, 以使得所述传输请求消息包括选择出的参会者的标识信息;
所述发送单元还用于, 通过所述 WebRTC应用向所述会议服务器发送所述 传输请求消息。
19、 根据权利要求 18所述的传输装置, 其特征在于, 所述装置还包括: 存储单元, 用于将选择出的参会者的标识信息存储在所述参会者属性中。
20、 根据权利要求 17、 18或 19所述的传输装置, 其特征在于, 所述接收 单元还用于,
通过所述 WebRTC应用接收所述会议服务器根据所述传输请求消息发送的 传输响应消息, 用于确定与所述会议服务器已建立传输连接。
21、 根据权利要求 17、 18、 19或 20所述的传输装置, 其特征在于, 所述 传输装置还包括:
传输单元, 用于向所述 WebRTC 应用传输所述第二媒体流, 以便于所述 WebRTC应用将所述第二媒体流进行播放。
22、一种视频会议中媒体流的传输装置,其特征在于,所述传输装置包括: 发送单元, 用于向浏览器发送第一媒体流, 所述第一媒体流包括视频会议 中所有参会者的视音频信息;
接收单元, 用于接收所述浏览器通过 WebRTC应用发送的传输请求消息, 所述传输请求消息包括从所述所有参会者的视音频信息中选择出的所需视音 频信息对应的参会者的标识信息;
提取单元, 用于根据所述标识信息,提取与所述标识信息对应的所述参会 者的视音频信息;
所述发送单元还用于, 向所述浏览器发送第二媒体流, 所述第二媒体流包 括选择出的参会者的视音频信息。
23、 根据权利要求 22所述的传输装置, 其特征在于, 所述传输装置还包 括:
调用单元, 用于调用扩展口的 WebRTC接口; 所述提取单元还用于, 根据调用的所述扩展后的 WebRTC接口, 从所述传 输请求消息中提取选择出的所述参会者的标识信息;
所述装置还包括: 存储单元, 用于将选择出的所述参会者的标识信息存储 在参会者列表内;
所述发送单元还用于 ,通过所述扩展后的 WebRTC接口与所述 WebRTC应用 之间建立的连接向所述浏览器发送传输响应消息,用于使所述浏览器确定与所 述会议服务器已建立传输连接。
24、 根据权利要求 22所述的传输装置, 其特征在于, 所述提取单元具体 用于, 识信息, 从所述扩展后的 WebRTC接口中提取对应的参会者的媒体跟踪对象, 所述媒体跟踪对象包括所述参会者的视音频信息。
25、 根据权利要求 24所述的传输装置, 其特征在于, 所述发送单元息具 体用于,
将所述媒体跟踪对象携带在第二媒体流中,以使得所述第二媒体流包括选 择出的参会者的视音频信息。
26、 一种视频会议中媒体流的传输装置, 所述视频会议中的每一会场包括 第一终端以及第二终端, 所述传输装置处于所述第二终端内, 其特征在于, 所 述传输装置包括:
接收单元,用于当第一终端的浏览器与所述传输装置通过同一用户登录信 息接入会议服务器,且所述浏览器未向所述会议服务器发送第一媒体流时,接 收第一选择指令,所述第一选择指令具体为从所述第二终端选择出待发送的视 音频信息;
发送单元,用于根据所述第一选择指令,通过所述第二终端的第一 WebRTC 应用向所述会议服务器发送第一传输请求消息,所述第一传输请求消息包括所 述传输装置中端口属性信息;
所述发送单元还用于,当接收到所述会议服务器根据所述第一传输请求消 息发送的第一传输响应消息时,根据所述端口属性信息, 通过对应的端口向所 述会议服务器发送第二媒体流,所述第二媒体流包括所述待发送的视音频信息。
27、 根据权利要求 26所述的传输装置, 其特征在于, 所述接收单元还用 于,接收所述会议服务器发送的第三媒体流, 所述第三媒体流包括视频会议中 所有参会者的视音频信息;
所述接收单元还用于,接收第二选择指令, 所述第二选择指令具体为从所 述所有参会者的视音频信息中选择出所需的视音频信息对应的参会者;
所述发送单元还用于, 根据所述第二选择指令, 通过所述第一 WebRTC应 用向所述会议服务器发送所述第二传输请求消息,所述第二传输请求消息包括 选择出的参会者的标识信息;
所述接收单元还用于, 通过所述第一 WebRTC应用接收所述所述会议服务 器发送的第二传输响应消息,所述第二传输响应消息用于使所述传输装置确定 当存在所述浏览器向所述会议服务器发送第一媒体流时 ,不向所述会议服务器 发送所述第二终端中的视音频信息;
所述接收单元还用于,接收所述会议服务器根据所述标识信息发送的第四 媒体流, 所述第四媒体流包括选择出的参会者的视音频信息。
28、 根据权利要求 26或 27所述的传输装置, 其特征在于, 所述接收单元 还用于,根据所述第一选择指令,接收所述第一 WebRTC应用发送的创建指令; 所述传输装置还包括: 调用单元, 用于根据所述创建指令, 调用扩展后的 WebRTC接口, 并判断所述扩展后的 WebRTC接口中约束对象的发送视频属性值 以及发送音频属性值; 设置单元, 用于当所述发送视频属性值为真时, 则将已接收视频信息的第 一视频端口属性设置为仅接收视频端口,将未接收视频信息的第二视频端口属 性设置为仅发送视频端口;
所述设置单元还用于, 当所述发送音频属性值为真时, 则将音频端口的属 性设置为发送接收端口;
所述传输装置还包括: 放入单元, 用于将已设置的端口属性信息携带在所 述第一传输请求消息中,以使得所述第一传输请求消息包括所述传输装置中端 口属性信息;
所述发送单元还用于, 通过所述第二终端的第一 WebRTC应用向所述会议 服务器发送所述第一传输请求消息。
29、一种视频会议中媒体流的传输装置,其特征在于,所述传输装置包括: 接收单元,用于当所述传输装置接受第一终端的第一浏览器以及第二终端 的第二浏览器通过同一用户登录信息接入所述传输装置,且所述第一浏览器未 向所述传输装置发送第一媒体流时,接收所述第二浏览器通过所述第二终端的 第一 WebRTC应用发送的第一传输请求消息, 所述第一传输请求消息包括所述 第二浏览器中端口属性信息;
发送单元, 用于根据所述第一传输请求消息, 向所述第二浏览器发送第一 传输响应消息, 用于使所述第二浏览器确定与所述传输装置已建立传输连接; 所述接收单元还用于,接收所述第二浏览器根据所述端口属性信息发送的 第二媒体流,所述第二媒体流包括从所述第二终端选择出的待发送的视音频信 息。
30、 根据权利要求 29所述的传输装置, 其特征在于, 所述发送单元还用 于, 向所述第二浏览器发送第三媒体流, 所述第三媒体流包括视频会议中所有 参会者的视音频信息; 所述接收单元还用于, 接收所述第二浏览器通过所述第一 WebRTC应用发 送的第二传输请求消息 ,所述第二传输请求消息包括从所述所有参会者的视音 频信息中选择出的所需视音频信息对应的参会者的标识信息;
所述传输装置还包括: 判断单元, 用于根据所述第二传输请求消息, 调用 扩展后的 WebRTC接口, 并判断所述第一浏览器是否正在发送媒体流;
设置单元, 用于如果所述第一浏览器正在发送媒体流, 则将所述传输装置 的端口属性设置为仅发送端口;
所述发送单元还用于,将已设置的端口属性信息携带在第二传输响应消息 内, 并通过所述第一 WebRTC应用向所述第二浏览器发送所述第二传输响应消 息,所述第二传输响应消息用于使所述第二浏览器确定当存在所述第一浏览器 向所述传输装置发送媒体流时,不向所述传输装置发送所述第二终端中的视音 频信息;
所述传输装置还包括: 提取单元, 用于根据所述标识信息, 提取与所述标 识信息对应的所述参会者的视音频信息;
所述发送单元还用于, 向所述第二浏览器发送第四媒体流, 所述第四媒体 流包括选择出的参会者的视音频信息。
31、 根据权利要求 29或 30所述的传输装置, 其特征在于, 所述发送单元 还用于,根据所述端口属性信息, 向所述第二浏览器中对应的端口发送第五媒 体流。
32、 根据权利要求 29、 30或 31所述的传输装置, 其特征在于, 所述判断 单元还用于,调用扩展后的 WebRTC接口, 并判断所述扩展后的 WebRTC接口中 约束对象的接收视频属性值以及接收音频属性值;
所述设置单元还用于,当所述判断单元的判断结果为所述接收视频属性值 为真时, 则将已接收视频信息的视频端口属性设置为仅发送视频端口; 所述设置单元还用于,当所述判断单元的判断结果为所述当所述接收音频 属性值为真时, 则将已接收音频信息的音频端口属性设置为仅发送音频端口; 所述发送单元还用于,将已设置的端口属性信息携带在第三传输请求消息 中, 并向所述第一浏览器发送所述第三传输请求消息, 所述第三传输请求消息 用于使所述第一浏览器确定不向所述传输装置发送所述第一终端的视音频信 息。
PCT/CN2014/084777 2013-09-05 2014-08-20 视频会议中媒体流的传输方法与装置 WO2015032277A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
EP14842852.7A EP3021556B1 (en) 2013-09-05 2014-08-20 Transmission method and device for media stream in video conference
US14/915,469 US9467650B2 (en) 2013-09-05 2014-08-20 Method and apparatus for transmitting media stream in video conference

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201310400528.3A CN104427296B (zh) 2013-09-05 2013-09-05 视频会议中媒体流的传输方法与装置
CN201310400528.3 2013-09-05

Publications (1)

Publication Number Publication Date
WO2015032277A1 true WO2015032277A1 (zh) 2015-03-12

Family

ID=52627787

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2014/084777 WO2015032277A1 (zh) 2013-09-05 2014-08-20 视频会议中媒体流的传输方法与装置

Country Status (4)

Country Link
US (1) US9467650B2 (zh)
EP (1) EP3021556B1 (zh)
CN (1) CN104427296B (zh)
WO (1) WO2015032277A1 (zh)

Cited By (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2521742A (en) * 2013-10-31 2015-07-01 Avaya Inc Providing intelligent management for web real-time communications (webRTC) interactive flows, and related methods, systems, and computer-readable media
US9112840B2 (en) 2013-07-17 2015-08-18 Avaya Inc. Verifying privacy of web real-time communications (WebRTC) media channels via corresponding WebRTC data channels, and related methods, systems, and computer-readable media
US9294458B2 (en) 2013-03-14 2016-03-22 Avaya Inc. Managing identity provider (IdP) identifiers for web real-time communications (WebRTC) interactive flows, and related methods, systems, and computer-readable media
US9363133B2 (en) 2012-09-28 2016-06-07 Avaya Inc. Distributed application of enterprise policies to Web Real-Time Communications (WebRTC) interactive sessions, and related methods, systems, and computer-readable media
US9525718B2 (en) 2013-06-30 2016-12-20 Avaya Inc. Back-to-back virtual web real-time communications (WebRTC) agents, and related methods, systems, and computer-readable media
US9531808B2 (en) 2013-08-22 2016-12-27 Avaya Inc. Providing data resource services within enterprise systems for resource level sharing among multiple applications, and related methods, systems, and computer-readable media
US9614890B2 (en) 2013-07-31 2017-04-04 Avaya Inc. Acquiring and correlating web real-time communications (WEBRTC) interactive flow characteristics, and related methods, systems, and computer-readable media
US9749363B2 (en) 2014-04-17 2017-08-29 Avaya Inc. Application of enterprise policies to web real-time communications (WebRTC) interactive sessions using an enterprise session initiation protocol (SIP) engine, and related methods, systems, and computer-readable media
US9769214B2 (en) 2013-11-05 2017-09-19 Avaya Inc. Providing reliable session initiation protocol (SIP) signaling for web real-time communications (WEBRTC) interactive flows, and related methods, systems, and computer-readable media
US9912705B2 (en) 2014-06-24 2018-03-06 Avaya Inc. Enhancing media characteristics during web real-time communications (WebRTC) interactive sessions by using session initiation protocol (SIP) endpoints, and related methods, systems, and computer-readable media
US10129243B2 (en) 2013-12-27 2018-11-13 Avaya Inc. Controlling access to traversal using relays around network address translation (TURN) servers using trusted single-use credentials
US10164929B2 (en) 2012-09-28 2018-12-25 Avaya Inc. Intelligent notification of requests for real-time online interaction via real-time communications and/or markup protocols, and related methods, systems, and computer-readable media
US10205624B2 (en) 2013-06-07 2019-02-12 Avaya Inc. Bandwidth-efficient archiving of real-time interactive flows, and related methods, systems, and computer-readable media
US10225212B2 (en) 2013-09-26 2019-03-05 Avaya Inc. Providing network management based on monitoring quality of service (QOS) characteristics of web real-time communications (WEBRTC) interactive flows, and related methods, systems, and computer-readable media
US10263952B2 (en) 2013-10-31 2019-04-16 Avaya Inc. Providing origin insight for web applications via session traversal utilities for network address translation (STUN) messages, and related methods, systems, and computer-readable media
US10581927B2 (en) 2014-04-17 2020-03-03 Avaya Inc. Providing web real-time communications (WebRTC) media services via WebRTC-enabled media servers, and related methods, systems, and computer-readable media
CN115150369A (zh) * 2022-06-29 2022-10-04 湖北天融信网络安全技术有限公司 音视频代理方法及音视频代理容器

Families Citing this family (25)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102014012355A1 (de) * 2014-08-25 2016-02-25 Unify Gmbh & Co. Kg Verfahren zur Steuerung einer Multimedia-Anwendung, Softwareprodukt und Vorrichtung
CN106161179B (zh) * 2015-03-26 2019-12-20 中兴通讯股份有限公司 一种基于网页的实时通信的媒体处理方法与装置
CN104754310A (zh) * 2015-04-10 2015-07-01 腾讯科技(北京)有限公司 终端设备摄像头接入目标设备的方法和装置
CN106209949A (zh) * 2015-05-07 2016-12-07 北京大学 基于WebRTC的交互式直播方法及装置
CN105338288A (zh) * 2015-11-20 2016-02-17 深圳联友科技有限公司 一种多人网络视频会话方法及系统
US11165832B1 (en) * 2015-12-21 2021-11-02 Google Llc Techniques for automatic cross-device meeting authentication
CN107155083B (zh) * 2016-03-02 2020-03-17 腾讯科技(深圳)有限公司 一种多端多媒体数据处理方法、装置和系统
CN107277425A (zh) * 2016-04-08 2017-10-20 中兴通讯股份有限公司 一种服务器、会场终端以及云会议处理方法
US10153002B2 (en) * 2016-04-15 2018-12-11 Intel Corporation Selection of an audio stream of a video for enhancement using images of the video
GB201609986D0 (en) 2016-06-08 2016-07-20 Cyviz As Streamed communications
CN105979225B (zh) * 2016-06-27 2019-10-25 贵阳朗玛信息技术股份有限公司 一种多人视频房间的监控方法和装置
CN107707868B (zh) * 2016-08-08 2020-09-25 中国电信股份有限公司 视频会议加入方法、多接入会议服务器和视频会议系统
US10659759B2 (en) * 2016-08-29 2020-05-19 Stratus Systems, Inc. Selective culling of multi-dimensional data sets
US10353663B2 (en) 2017-04-04 2019-07-16 Village Experts, Inc. Multimedia conferencing
CN107302640B (zh) * 2017-06-08 2019-10-01 携程旅游信息技术(上海)有限公司 电话会议控制系统及其控制方法
US11386562B2 (en) 2018-12-28 2022-07-12 Cyberlink Corp. Systems and methods for foreground and background processing of content in a live video
EP3984190B1 (en) * 2019-06-12 2022-12-14 Koninklijke Philips N.V. Dynamic modification of functionality of a real-time communications session
CN110213527A (zh) * 2019-07-08 2019-09-06 海能达通信股份有限公司 一种视频会话控制方法及用户端及服务器
GB201918314D0 (en) * 2019-12-12 2020-01-29 Issured Ltd MEA: connexus - a platform agnostic video interview platform that uses blockchain for retention of evidential integrity
CN111367493A (zh) * 2020-03-06 2020-07-03 广州视源电子科技股份有限公司 多媒体会议中音频的控制方法和装置
CN111556275A (zh) * 2020-04-08 2020-08-18 视联动力信息技术股份有限公司 音视频流调度方法、装置、指挥调度端及存储介质
CN111866440B (zh) * 2020-07-29 2021-03-09 全时云商务服务股份有限公司 一种推送视频数据方法、装置、设备及存储介质
CN112203038B (zh) * 2020-10-12 2022-09-16 北京字节跳动网络技术有限公司 在线会议的处理方法、装置、电子设备及计算机存储介质
EP4027284A1 (en) * 2021-01-07 2022-07-13 Unify Patente GmbH & Co. KG Computer-implemented method of performing a webrtc-based communication and collaboration session and webrtc-based communication and collaboration platform
CN114884924A (zh) * 2022-04-24 2022-08-09 康键信息技术(深圳)有限公司 一种音视频通道的选择方法、装置、电子设备及存储介质

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101677397A (zh) * 2008-09-19 2010-03-24 中兴通讯股份有限公司 通过视频会议终端查看监控媒体的方法和视频会议终端
CN102281460A (zh) * 2011-08-18 2011-12-14 宋健 一种基于视频会议实现的网络电视台直播的方法和系统
CN102469294A (zh) * 2010-11-08 2012-05-23 中兴通讯股份有限公司 一种视频会议的动态调整媒体内容的方法和系统
CN203070033U (zh) * 2013-03-06 2013-07-17 罗实 一种基于Web的PLC远程监控系统

Family Cites Families (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6421706B1 (en) * 1998-02-25 2002-07-16 Worldcom, Inc. Multicast and unicast internet protocol content distribution having a feedback mechanism for real-time and store and forward information transfer
US8234335B1 (en) * 2004-06-29 2012-07-31 Sprint Spectrum L.P. Customized grouping of participants in real-time conference set-up
CN100403794C (zh) * 2004-12-29 2008-07-16 华为技术有限公司 一种实现流媒体业务的视讯终端和方法
US8719342B2 (en) 2006-04-25 2014-05-06 Core Wireless Licensing, S.a.r.l. Third-party session modification
CN101175198A (zh) * 2006-11-02 2008-05-07 华为技术有限公司 网络电视的业务控制方法及系统、终端和应用处理模块
WO2012163075A1 (zh) * 2011-12-31 2012-12-06 华为技术有限公司 一种视频会议的处理方法、装置和通信系统
WO2013108121A2 (en) * 2012-01-17 2013-07-25 IPalive AB A device, software module, system or business method for global real-time telecommunication
US8867731B2 (en) * 2012-11-05 2014-10-21 Genesys Telecommunications Laboratories, Inc. System and method for web-based real time communication with optimized transcoding
EP2837154B1 (de) * 2013-02-22 2018-11-14 Unify GmbH & Co. KG Verfahren zur steuerung von datenströmen einer virtuellen sitzung mit mehreren teilnehmern, kollaborationsserver, computerprogramm, computerprogrammprodukt und digitales speichermedium
US10694149B2 (en) * 2013-03-26 2020-06-23 Verizon Patent And Licensing Inc. Web based security system
US9065969B2 (en) * 2013-06-30 2015-06-23 Avaya Inc. Scalable web real-time communications (WebRTC) media engines, and related methods, systems, and computer-readable media
US9614890B2 (en) * 2013-07-31 2017-04-04 Avaya Inc. Acquiring and correlating web real-time communications (WEBRTC) interactive flow characteristics, and related methods, systems, and computer-readable media
US20150039760A1 (en) * 2013-07-31 2015-02-05 Avaya Inc. Remotely controlling web real-time communications (webrtc) client functionality via webrtc data channels, and related methods, systems, and computer-readable media

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101677397A (zh) * 2008-09-19 2010-03-24 中兴通讯股份有限公司 通过视频会议终端查看监控媒体的方法和视频会议终端
CN102469294A (zh) * 2010-11-08 2012-05-23 中兴通讯股份有限公司 一种视频会议的动态调整媒体内容的方法和系统
CN102281460A (zh) * 2011-08-18 2011-12-14 宋健 一种基于视频会议实现的网络电视台直播的方法和系统
CN203070033U (zh) * 2013-03-06 2013-07-17 罗实 一种基于Web的PLC远程监控系统

Cited By (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10164929B2 (en) 2012-09-28 2018-12-25 Avaya Inc. Intelligent notification of requests for real-time online interaction via real-time communications and/or markup protocols, and related methods, systems, and computer-readable media
US9363133B2 (en) 2012-09-28 2016-06-07 Avaya Inc. Distributed application of enterprise policies to Web Real-Time Communications (WebRTC) interactive sessions, and related methods, systems, and computer-readable media
US9294458B2 (en) 2013-03-14 2016-03-22 Avaya Inc. Managing identity provider (IdP) identifiers for web real-time communications (WebRTC) interactive flows, and related methods, systems, and computer-readable media
US10205624B2 (en) 2013-06-07 2019-02-12 Avaya Inc. Bandwidth-efficient archiving of real-time interactive flows, and related methods, systems, and computer-readable media
US9525718B2 (en) 2013-06-30 2016-12-20 Avaya Inc. Back-to-back virtual web real-time communications (WebRTC) agents, and related methods, systems, and computer-readable media
US9112840B2 (en) 2013-07-17 2015-08-18 Avaya Inc. Verifying privacy of web real-time communications (WebRTC) media channels via corresponding WebRTC data channels, and related methods, systems, and computer-readable media
US9614890B2 (en) 2013-07-31 2017-04-04 Avaya Inc. Acquiring and correlating web real-time communications (WEBRTC) interactive flow characteristics, and related methods, systems, and computer-readable media
US9531808B2 (en) 2013-08-22 2016-12-27 Avaya Inc. Providing data resource services within enterprise systems for resource level sharing among multiple applications, and related methods, systems, and computer-readable media
US10225212B2 (en) 2013-09-26 2019-03-05 Avaya Inc. Providing network management based on monitoring quality of service (QOS) characteristics of web real-time communications (WEBRTC) interactive flows, and related methods, systems, and computer-readable media
US10263952B2 (en) 2013-10-31 2019-04-16 Avaya Inc. Providing origin insight for web applications via session traversal utilities for network address translation (STUN) messages, and related methods, systems, and computer-readable media
GB2521742A (en) * 2013-10-31 2015-07-01 Avaya Inc Providing intelligent management for web real-time communications (webRTC) interactive flows, and related methods, systems, and computer-readable media
US9769214B2 (en) 2013-11-05 2017-09-19 Avaya Inc. Providing reliable session initiation protocol (SIP) signaling for web real-time communications (WEBRTC) interactive flows, and related methods, systems, and computer-readable media
US10129243B2 (en) 2013-12-27 2018-11-13 Avaya Inc. Controlling access to traversal using relays around network address translation (TURN) servers using trusted single-use credentials
US11012437B2 (en) 2013-12-27 2021-05-18 Avaya Inc. Controlling access to traversal using relays around network address translation (TURN) servers using trusted single-use credentials
US9749363B2 (en) 2014-04-17 2017-08-29 Avaya Inc. Application of enterprise policies to web real-time communications (WebRTC) interactive sessions using an enterprise session initiation protocol (SIP) engine, and related methods, systems, and computer-readable media
US10581927B2 (en) 2014-04-17 2020-03-03 Avaya Inc. Providing web real-time communications (WebRTC) media services via WebRTC-enabled media servers, and related methods, systems, and computer-readable media
US9912705B2 (en) 2014-06-24 2018-03-06 Avaya Inc. Enhancing media characteristics during web real-time communications (WebRTC) interactive sessions by using session initiation protocol (SIP) endpoints, and related methods, systems, and computer-readable media
CN115150369A (zh) * 2022-06-29 2022-10-04 湖北天融信网络安全技术有限公司 音视频代理方法及音视频代理容器

Also Published As

Publication number Publication date
CN104427296A (zh) 2015-03-18
EP3021556A4 (en) 2016-08-03
CN104427296B (zh) 2019-03-01
EP3021556A1 (en) 2016-05-18
US20160227161A1 (en) 2016-08-04
EP3021556B1 (en) 2019-04-03
US9467650B2 (en) 2016-10-11

Similar Documents

Publication Publication Date Title
WO2015032277A1 (zh) 视频会议中媒体流的传输方法与装置
CN104253856B (zh) 可缩放Web实时通信媒体引擎以及相关的方法、系统
CN107682657B (zh) 一种基于WebRTC的多人语音视频通话方法及系统
CN106161814B (zh) 一种多方会议的混音方法和装置
US9686329B2 (en) Method and apparatus for displaying webcast rooms
US9332039B2 (en) Method, apparatus, and system for establishing voice communication
CN104125540B (zh) 多方通话终端及从多方通话转换为一对一通话的方法
CN102185862B (zh) 网络游戏系统的通信方法、装置及系统
WO2019090902A1 (zh) 屏幕共享的方法、装置、电子设备及存储介质
EP2933982B1 (en) Media stream transfer method and user equipment
CN111147506A (zh) 一种基于html5播放流媒体数据的方法、系统及存储设备
WO2014183427A1 (en) Method and apparatus for displaying webcast rooms
CN103167327A (zh) 信息互动方法、装置及系统
US10419543B2 (en) Method and system for establishing a connection between a seeker device and a target device
US10778736B2 (en) On demand in-band signaling for conferences
US20190104164A1 (en) Method, computer-readable storage device and apparatus for establishing persistent messaging sessions
EP2879363A1 (en) Apparatus, system, and method of managing counterpart terminal information, and carrier medium
CN104683403B (zh) 用于资源共享的方法、资源服务器和系统
Panagiotakis et al. Architecture for real time communications over the web
US20170171339A1 (en) Advertisement data transmission method, electrnoic device and system
WO2017030963A1 (en) Incorporating user content within a communication session interface
US20170034227A1 (en) System and methods for an online conference session
US9059860B2 (en) Techniques for announcing conference attendance changes in multiple languages
WO2023160076A1 (zh) 信息交互方法、装置及计算机设备、存储介质、程序产品
KR20190098398A (ko) 화상 통신 서비스 제공 방법

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 14842852

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 2014842852

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 14915469

Country of ref document: US

NENP Non-entry into the national phase

Ref country code: DE