WO2015003532A1 - 多媒体会议的建立方法、装置及系统 - Google Patents

多媒体会议的建立方法、装置及系统 Download PDF

Info

Publication number
WO2015003532A1
WO2015003532A1 PCT/CN2014/078126 CN2014078126W WO2015003532A1 WO 2015003532 A1 WO2015003532 A1 WO 2015003532A1 CN 2014078126 W CN2014078126 W CN 2014078126W WO 2015003532 A1 WO2015003532 A1 WO 2015003532A1
Authority
WO
WIPO (PCT)
Prior art keywords
media
conference
data stream
multimedia data
receiving device
Prior art date
Application number
PCT/CN2014/078126
Other languages
English (en)
French (fr)
Inventor
杨玮玮
刘艳
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Publication of WO2015003532A1 publication Critical patent/WO2015003532A1/zh

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/1066Session management
    • H04L65/1069Session establishment or de-establishment
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00Data switching networks
    • H04L12/02Details
    • H04L12/16Arrangements for providing special services to substations
    • H04L12/18Arrangements for providing special services to substations for broadcast or conference, e.g. multicast
    • H04L12/1813Arrangements for providing special services to substations for broadcast or conference, e.g. multicast for computer conferences, e.g. chat rooms
    • H04L12/1822Conducting the conference, e.g. admission, detection, selection or grouping of participants, correlating users to one or more conference sessions, prioritising transmission
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/40Support for services or applications
    • H04L65/403Arrangements for multi-party communication, e.g. for conferences
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/14Systems for two-way working
    • H04N7/15Conference systems

Definitions

  • the present invention relates to network communication technologies, and in particular, to a method, an apparatus, and a system for establishing a multimedia conference.
  • BACKGROUND OF THE INVENTION With the development of conference television, the venue has evolved from a previous camera, an active video, and a moving image display to a multi-camera, multi-channel active video, and multi-way moving image display.
  • the multi-channel camera, the multi-channel active video, and the multi-way activity image in the same site are associated by a physical or logical relationship.
  • the site A is a three-screen site; the site B is a two-screen site; the site C is a single-screen site. That is, the traditional conference television, the first camera of the site A picks up the image of the participant at the first location in the site A is displayed on the first screen of the local site A or the remote site B or C.
  • the selection of media streams for sending and receiving is mainly based on information such as audio and video encoding and decoding, due to the single capability of each participant device.
  • the existing conference negotiation mechanism only provides encoding H.264/H.265/VP8 and resolution 720P/1080P, which makes the participants unable to understand the more intuitive content information of the media stream.
  • In the conference scene of multi-site and multi-media media streams there are many media data streams such as high-definition pictures and high-fidelity audio.
  • the traditional media information such as codec can not complete the media selection required for the conference, and the social class cannot be provided.
  • the embodiments of the present invention provide a method, a device, and a system for establishing a multimedia conference, so as to solve the defects of the existing conference media stream negotiation mechanism, and implement targeted control of the negotiation selection of the multimedia data stream in the multimedia conference.
  • an embodiment of the present invention provides a method for establishing a multimedia conference, including: The media receiving device receives the media announcement message sent by the media providing device, where the media announcement message carries the multimedia data stream identifier that can be sent by the media providing device, and the conference role attribute of the participant corresponding to each multimedia data stream;
  • the media receiving device sends a media configuration message to the media providing device, where the media configuration message carries the selected multimedia data stream identifier according to the role attribute of the participant corresponding to the multimedia data stream;
  • the media receiving device completes establishment of a media transmission channel with the media providing device, and receives, by the media transmission channel, a multimedia data stream corresponding to the selected multimedia data stream identifier sent by the media providing device. .
  • the conference role attribute of the participant corresponding to the multimedia data stream includes one or more of the following information:
  • the conference system control role of the participant corresponding to the multimedia data stream indicates the authority position in the conference control.
  • a multimedia data stream corresponds to multiple participants
  • the one multimedia data stream corresponds to The conference role properties of the participants are:
  • the method before the media receiving device sends the media configuration message to the media providing device, the method further includes:
  • the media receiving device selects a multimedia data stream identifier according to a conference role attribute of the participant corresponding to the multimedia data stream.
  • the method before the media receiving device sends the media configuration message to the media providing device, the method further includes:
  • the media receiving device sends a multimedia selection option to the conference control entity, where the multimedia selection option includes a multimedia data stream identifier received by the media receiving device, and a conference role attribute of the participant corresponding to each multimedia data stream;
  • the media receiving device receives the multimedia data stream identifier selected by the conference control entity according to the conference role attribute of the participant.
  • the conference server is based on all participants All multimedia data streams obtained by the conference terminal and its conference role attributes are constructed to construct a media announcement message.
  • an embodiment of the present invention provides a media receiving apparatus, including:
  • a first receiving module configured to receive a media announcement message sent by the media providing device, where the media announcement message carries a multimedia data stream identifier that can be sent by the media providing device, and a conference of the participant corresponding to each multimedia data stream Role attribute
  • a first sending module configured to send, to the media providing device, a media configuration message, where the media configuration message carries a multimedia data stream identifier that is selected according to a role attribute of the participant corresponding to the multimedia data stream;
  • a first processing module configured to complete establishment of a media transmission channel with the media providing device, and receive, by the media transmission channel, a location corresponding to the selected multimedia data stream identifier sent by the media providing device The multimedia data stream.
  • the conference role attribute of the participant corresponding to the multimedia data stream includes one or more of the following information:
  • the conference system control role of the participant corresponding to the multimedia data stream indicates the authority position in the conference control.
  • a multimedia data stream corresponds to multiple participants
  • the one multimedia data stream corresponds to The conference role properties of the participants are:
  • the media receiving device further includes:
  • a second processing module configured to select a multimedia data stream identifier according to a conference role attribute of the participant corresponding to the multimedia data stream.
  • the media receiving device further includes:
  • a second processing module configured to send a multimedia selection option to the conference control entity, where the multimedia selection option includes identifier information of the multimedia data stream received by the first receiving module, and a conference role attribute of the participant corresponding to each multimedia data stream; receiving a multimedia data stream identifier selected by the conference control entity according to the conference role attribute of the participant.
  • a selection module configured to present a multimedia selection option to the conference control entity, where the multimedia selection option includes identifier information of the available multimedia data stream, and a conference role attribute corresponding to each of the multimedia data streams; acquiring the conference control entity The selection result of the feedback of the selection of the multimedia data stream is completed.
  • an embodiment of the present invention provides a media providing apparatus, including:
  • a second sending module configured to send a media announcement message to the media receiving device, where the media announcement message carries a multimedia data stream identifier that can be sent by the media providing device, and a conference role attribute of the participant corresponding to each multimedia data stream ;
  • a second receiving module configured to receive a media configuration message sent by the media receiving device, where the media configuration message carries a multimedia data stream identifier selected according to a conference role attribute of the participant corresponding to the multimedia data stream;
  • a third processing module configured to establish a media transmission channel with the media receiving device, and send, by using the media transmission channel, the multimedia data stream corresponding to the selected multimedia data stream identifier to the media receiving device.
  • a second processing module configured to establish a media transmission channel with the media receiving device, and send the selected multimedia data stream to the media receiving device by using the media transmission channel.
  • the conference role attribute of the participant corresponding to the multimedia data stream includes one or more of the following information:
  • the conference system control role of the participant corresponding to the multimedia data stream indicates the authority position in the conference control.
  • a multimedia data stream corresponds to multiple participants
  • the one multimedia data stream corresponds to The conference role properties of the participants are:
  • the fourth aspect provides a system for establishing a multimedia conference, including: any one of the first to fourth possible implementation manners of the second aspect, the second aspect A media receiving apparatus provided by any one of the first to second possible implementations of the third aspect, the third aspect, and the medium providing apparatus.
  • the method, device, and system for establishing a multimedia conference provided by the embodiment of the present invention can enable the media receiving device to select a multimedia data stream based on the role of the conference role by providing a conference role attribute corresponding to the participant of the multimedia data stream, thereby enriching the multimedia
  • the playback control of the data stream enhances the conference experience and reduces the overhead of media processing resources and network transmission bandwidth.
  • Embodiment 1 is a schematic flowchart of Embodiment 1 of a method for establishing a multimedia conference according to the present invention
  • FIG. 2 and FIG. 3 are schematic diagrams of a second embodiment of a method for establishing a multimedia conference according to the present invention
  • FIG. 4 is a schematic diagram of a conference control entity interface of a second embodiment of a method for establishing a multimedia conference according to the present invention
  • FIG. 5 is a schematic flowchart of Embodiment 3 of a method for establishing a multimedia conference according to the present invention
  • Embodiment 4 of a media receiving apparatus according to the present invention
  • Embodiment 7 is a schematic structural diagram of Embodiment 5 of a media receiving apparatus according to the present invention.
  • Embodiment 6 of a media providing apparatus is a schematic structural diagram of Embodiment 6 of a media providing apparatus according to the present invention.
  • Embodiment 7 of a media receiving apparatus is a schematic structural diagram of Embodiment 7 of a media receiving apparatus according to the present invention.
  • Embodiment 8 of a media providing apparatus according to the present invention.
  • FIG. 11 is a schematic structural diagram of Embodiment 9 of a system for establishing a multimedia conference according to the present invention.
  • the technical solutions in the embodiments of the present invention are clearly and completely described in the following with reference to the accompanying drawings in the embodiments of the present invention.
  • the embodiments are a part of the embodiments of the invention, and not all of the embodiments. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative efforts are within the scope of the present invention.
  • Embodiment 1 is a schematic structural diagram of Embodiment 9 of a system for establishing a multimedia conference according to the present invention.
  • FIG. 1 is a schematic flowchart of Embodiment 1 of a method for establishing a multimedia conference according to the present invention.
  • the embodiment of the present invention provides a method for establishing a multimedia conference, which may be performed by any media receiving device.
  • the media receiving device may be implemented by software and/or hardware, and may be a conference terminal or a conference server, where the conference
  • the terminal can be a telepresence terminal, a general conference room terminal, a personal computer (PC), a notebook (Laptop), or a mobile terminal device such as a mobile phone or a tablet computer.
  • the terminal can support the transmission and reception of multimedia data such as audio and video, and can be based on audio and picture quality. There are different levels of division, such as video pictures can be divided into high definition, standard definition and normal picture.
  • the method in this embodiment includes:
  • Step 101 The media receiving device receives a media announcement message sent by the media providing device, where the media announcement message carries a multimedia data stream identifier that can be sent by the media providing device, and a conference of the participant corresponding to each multimedia data stream. Role attribute.
  • the media receiving device and the media providing device may be at least two conference terminals in a point-to-point conference, or may be a conference terminal in a multipoint conference and a multipoint control unit (referred to as a conference server).
  • MCU multipoint control unit
  • the two are relatively existing, that is, the media receiving device can also serve as a media providing device, and the media providing device can also serve as a media receiving device.
  • the multimedia data stream provided by the conference terminal is first provided to the conference server.
  • the conference terminal serves as a media providing device
  • the conference server serves as a media receiving device.
  • the conference server provides the multimedia data stream to other conference terminals.
  • the role of the conference server is the media providing device, and the other conference terminals serve as the media receiving device.
  • the MCU is responsible for call signaling processing, conference control, video core exchange, mixing, video and audio adaptation, and split screen processing.
  • the conference terminal includes a video codec module, an audio codec module, a signaling module, a control module, a configuration module, and other functional modules, and is mainly used for receiving and initiating a call to the remote conference terminal, and collecting the local camera group and the microphone.
  • the video and audio streams are encoded and sent to the remote conference terminal, and the video and audio streams of the remote conference terminal are decoded and output to the display and speaker of the local conference terminal.
  • the camera group may be composed of one or more cameras, and each camera corresponds to a respective site area.
  • the media providing device collects the multimedia data stream through a camera and a microphone, and correspondingly Obtaining the conference role attribute of the participant corresponding to the multimedia data stream, where the participant conference role attribute can be obtained by pre-configuration, system API call, or online negotiation.
  • the conference role attribute is used to represent the role location and attribute embodiment of the corresponding participant in the multimedia data stream, and specifically includes one or more of the conference organization role, the conference system control role, and the conference card information, for example, a certain way of the conference site.
  • the screen contains the real-time image collection of the conference chairperson, and the conference role attribute of the multimedia data stream is "Chairman".
  • the multimedia data stream includes at least one real-time picture of the site or a secondary stream of the shared content of the conference, that is, content shared between the sites, for example, an auxiliary stream slide, an auxiliary stream video, an auxiliary stream picture, and the like.
  • Step 102 The media receiving device sends a media configuration message to the media providing device, where the media configuration message carries a multimedia data stream identifier selected according to a conference role attribute of the participant corresponding to the multimedia data stream.
  • the multimedia data stream may be selected by the media receiving device according to the conference role attribute of the participant corresponding to the multimedia data stream, or may be selected by interacting with the conference control entity. For example, when the conference terminal is the media receiving device, sending the multimedia to the conference control entity according to the identifier information of the multimedia data stream in the media announcement message sent by the media providing device and the conference role attribute of the participant corresponding to the multimedia data stream.
  • the conference control entity notifies the media receiving device of the result of the selection; and then the media receiving device generates a media configuration message based on the result of the selection.
  • the conference control entity may be integrated into the conference terminal or be a separate device, such as a tablet supporting conference control.
  • the selection of the multimedia data stream identifier by the conference role attribute of the participant may be selected according to the priority of the role attribute, or may be selected according to a preset rule of the receiving end.
  • Step 103 The media receiving device completes establishment of a media transmission channel with the media providing device, and receives, by the media transmission channel, a corresponding to the selected multimedia data stream identifier sent by the media providing device. Multimedia data stream.
  • the two conference sites directly communicate with each other, and the first conference terminal sends the media announcement message to the second conference terminal.
  • the first conference terminal sends the media announcement message to the second conference terminal.
  • only the first conference terminal and the second conference terminal The establishment of a media transmission channel between conference terminals; in a multipoint conference, generally 3
  • One or more site communication needs to be processed by the MCU in the middle, and the MCU controls and forwards the multimedia data stream.
  • Shenzhen conference venue can provide three channels of fixed content multimedia data streams, and the identifiers and corresponding conference role attributes are respectively S-VC0 (audience).
  • S-VC1 (meeting chairman) and S-VC2 (audience); Beijing venue can also provide three channels of fixed content multimedia data streams, and their logos and corresponding conference role attributes are B-VC0 (audience), B- VC1 (audience) and B-VC2 (conference speaker); Shanghai venue can provide two fixed-content multimedia data streams, and their logos and corresponding conference role attributes are H-VC0 (host) and H-VC1 ( Audience) ⁇
  • Each site and MCU are used as media receiving devices to negotiate and interact with each of the venues. As the media center of the conference, the MCU can synthesize and provide information to all participants in the media of all participants.
  • the media providing device and the media receiving device may be any combination of the conference terminal and the conference server MCU, depending on the actual application scenario.
  • the conference terminal sends the multimedia data to the MCU
  • the conference terminal is the media providing device
  • the MCU is the media receiving device
  • the conference terminal is the media receiving device.
  • the media transmission side is a media providing device
  • the media receiving side conference terminal is a media receiving device.
  • the session between the media providing device and the media receiving device is established by selecting the multimedia data stream according to the conference role attribute corresponding to the multimedia data stream, and the media receiving device is implemented according to the conference.
  • the role attribute selects the multimedia data stream, and selectively controls the negotiation and presentation of the multimedia data stream in the multimedia conference, thereby completing the control transmission of the conference multimedia data stream under the condition of saving media processing resources and network transmission bandwidth.
  • the conference role attribute of the participant corresponding to the multimedia data stream includes at least one or more of the following information: the multimedia data stream corresponds to The conference organization role of the participant, indicating the duties and duties in the conference organization; the multimedia data stream corresponding to the conference system control role of the participant, indicating the authority position in the conference control; the multimedia data stream corresponding to the conference business card of the participant , indicating business card information in social relations.
  • the conference organization role is used to provide the multimedia data stream corresponding to the position of the participant in the conference organization, and the specific value may traverse the relevant definition in the current standard mechanism, and the conference organization role may be selected by the user through input or option.
  • the specific parameters of the conference organization role are set for the multimedia data stream.
  • the conference organization role can be, for example:
  • Secretary - a meeting minutes or document maintainer, also called a recorder, etc., depending on the occasion;
  • Participant Participant; Participant who attends the meeting but has no other role, also known as the audience or audience; Speaker (Speaker) - Conference Speaker;
  • the priority of each conference role attribute can be set, for example, the priority of the chair is higher than that of the vice chair, the priority of the vice chair is higher than that of the secretary, the priority of the secretary is higher than that of the speaker, and the priority of the speaker is higher than the translation.
  • Other embodiments may be used in advance, and the embodiments of the present invention are not limited herein. If a multimedia data stream corresponds to multiple participants, for example, a certain video screen in a conference contains two participants A and B, where A is the chairman of the organization conference and B is the conference secretary, then this multimedia data stream corresponds to The value of the conference role attribute of the participant is located in the "chairperson", that is, the conference role attribute corresponding to the highest priority participant among the plurality of participants.
  • a multimedia data stream corresponds to a participant's conference role, which includes more than one type of value, for example, a participant corresponding to a certain screen, is the current speaker of the conference (Speaker), and is also a presenter of the conference sharing material (Presenter). All the above values should be included in the conference role attribute of the participant corresponding to the multimedia data stream.
  • the conference system control role is used to provide a position of the multimedia data stream corresponding to the character in the conference control, and may include at least three types: a presenter (Presider;), a controller (Controller), and a viewer (Participant) to determine the conference. Positioning and goals in control.
  • Conference system control role can pass The voice control mechanism (for example, Binary Floor Control Protocol, referred to as: BFCP protocol) is determined.
  • BFCP protocol Binary Floor Control Protocol
  • the conference card is used to provide related business card information of the person corresponding to the multimedia data stream, and may include several types of different information, such as an institution, a title, a professional position, and a specific conference role.
  • the media providing device may first acquire an identifier of a related person in the multimedia data stream, and query the acquired character in an association system or a network through an application programming interface (API) interface. Identify the corresponding conference card.
  • API application programming interface
  • the business card mechanism of the Internet Engineering Task Force (IETF) is introduced into the multi-stream conference and media stream binding, for example:
  • vCARD information can be See Request For Comments (RFC) 6350 for classification: Identification Properties Delivery addressing Properties Communications Properties, Geographical Properties, Organizational Properties, Explanatory Properties, Security Properties, Calendar Properties.
  • the conference role attribute corresponding to the multimedia data stream may further include the site information corresponding to the multimedia data stream.
  • the site information may be added to the entire site level, for example: Shenzhen, Guangzhou, and Zhuhai III.
  • a three-party conference is held at the conference site.
  • the conference site information can be bound to the media stream corresponding to the conference terminal at the conference site in Shenzhen.
  • the "Shenzhen Conference Site” is used to capture the scene level attribute (Capture Scene Attribute).
  • the media providing device and the media receiving device are one of the following conference devices: a conference terminal or a conference server.
  • FIG. 2 and FIG. 3 are schematic flowcharts of Embodiment 2 of a method for establishing a multimedia conference according to the present invention.
  • the method may further include:
  • Step 201 The media receiving device selects a multimedia data stream based on a default rule according to a conference role attribute of the participant corresponding to the multimedia data stream.
  • This embodiment may be applicable, for example, when the conference server is used as the media receiving device, and may select based on default rules without user participation, for example, a preset priority rule based on the role of the conference role, or a match between the conference role attribute and the conference terminal attribute. Rules, select the multimedia data stream.
  • the method may further include:
  • Step 301 The media receiving device presents a multimedia selection option to the conference control entity, where the multimedia selection option includes identifier information of the available multimedia data stream, and a conference role attribute corresponding to each of the multimedia data streams.
  • the media receiving device displays the identification information of each of the multimedia data streams corresponding to the corresponding conference role attribute; or the media receiving device displays each of the multimedia data streams, and displays the multimedia data streams.
  • the corresponding conference role attribute is displayed in the area.
  • the conference control entity is operated by the conference controller, and the conference role attribute of the multimedia data stream presented thereon allows the conference controller to select the multimedia data stream to be received for each media receiving device based on the conference role attribute.
  • FIG. 4 is a diagram showing an example of a conference control entity interface in Embodiment 2 of a method for establishing a multimedia conference according to the present invention.
  • the media receiving device provides a multimedia selection option for the user on the user conference control entity interface, including:
  • a multimedia data stream that the user can select as shown in FIG. 4: a first multimedia data stream 41, a second multimedia data stream 42 and a third multimedia data stream 43;
  • the attribute information corresponding to the multimedia data stream is given, including the codec and resolution of the multimedia data stream, as shown in Fig. 4: H.264/1080P, VP8/720P and H.264 /360P;
  • Conference role attributes of the multimedia data stream such as shown in Figure 4, conference organization role: conference presenter 411, conference chairman 421 and audience 431; conference control role: shared presentation 412, shared control 422 and non-shared party 432; conference Business cards: Shenzhen No. 413, Provincial Education Department 423 and Zhuhai Middle School 433.
  • the user selects the multimedia data stream that is desired to be received according to the option shown in FIG. 4, and saves the corresponding conference role attribute to determine a subsequent play policy.
  • the media receiving device constructs a media configuration message according to the user selection, and responds to the media providing device to complete the multimedia conference.
  • the media configures the interaction of the messages to establish a media session.
  • Step 302 The media receiving apparatus acquires a selection result fed back by the conference control entity to complete selection of a multimedia data stream.
  • the media receiving device presents the identifier information of the multimedia data stream and the corresponding conference role attribute for the user to select, and feeds the result of the selection to the media providing device to implement the conference corresponding to the user according to the multimedia data stream.
  • the role attribute selectively selects the multimedia data stream that needs to be presented, thereby establishing a multimedia conference.
  • FIG. 5 is a schematic flowchart of Embodiment 3 of a method for establishing a multimedia conference according to the present invention.
  • the embodiment of the present invention provides a method for establishing a multimedia conference.
  • the method may be implemented by any media providing device.
  • the media providing device may be implemented by software and/or hardware, and may be a conference terminal or a conference server.
  • the method in this embodiment includes:
  • Step 501 The media providing device sends a media announcement message to the media receiving device, where the media establishment request message carries the multimedia data stream identifier that can be sent by the media providing device, and the conference of the participant corresponding to each multimedia data stream. Role attribute.
  • the media providing device acquires the multimedia data stream and the conference role attribute corresponding to the multimedia data stream at each site, generates a media announcement message according to the multimedia data stream and the conference role attribute, and sends the message to the media receiving device.
  • the media providing device may be a conference terminal in a point-to-point conference, or may be a conference terminal or an MCU in a multipoint conference.
  • Step 502 The media providing device receives the media configuration message sent by the media receiving device, where the media configuration message carries the identifier information of the multimedia data stream that is selected according to the conference role attribute.
  • Step 503 The media providing device establishes a media transmission channel with the media receiving device, and sends the selected multimedia data stream to the media receiving device by using the media transmission channel.
  • the media providing device acquires the identification information of the multimedia data stream and the corresponding conference role attribute, and carries the acquired identification information and the conference in each of the sending and receiving messages that establish a session flow with the media receiving device.
  • the role attribute after the multimedia conference is established, implements the negotiation selection, control and presentation of the multimedia data stream in a targeted manner to avoid the defect that only the media stream codec and resolution are presented in the conference negotiation mechanism in the prior art.
  • the media providing device and the media receiving device are one of the following conference devices: a conference terminal or a conference server.
  • the media providing device is a conference server
  • the media receiving device receiving the media announcement message sent by the media providing device may include: the conference server is obtained according to the conference terminal from all the participants. All multimedia data streams and their conferencing role attributes are built, and media announcement messages are constructed. The following is an example:
  • the conference server aggregates the multimedia data streams from the three-party venue, and carries the identification information of the multimedia data stream groups of the three-party venue and their corresponding conference role attributes in the three-party media announcement message. And presenting the identification information and the conference role attribute to the conference terminal in the tripartite conference site, and providing the user with the basis for the presentation strategy.
  • the participants in Shenzhen can select the multimedia data stream of Guangzhou or Zhuhai to play.
  • the presentation layout of the multimedia data stream selection option on the conference control entity may be implemented by: providing a list of each of the multimedia data streams, including identification information, corresponding conference role attributes, and other possible
  • the media stream content feature parameter is provided in the form of a preview of the multimedia data stream, supplemented by the identification information, the introduction of the corresponding conference character attribute, or other layout mode for the user to intuitively select.
  • FIG. 6 is a schematic structural diagram of Embodiment 4 of a media receiving apparatus according to the present invention.
  • the media receiving apparatus may be a conference terminal or a conference server.
  • the media receiving apparatus of this embodiment includes: a first receiving module 61, a first sending module 62, and a first processing module 63, wherein the first receiving module 61 is configured to receive a media announcement sent by the media providing apparatus.
  • the first sending module 62 is used to The media providing device sends a media configuration message, where the media configuration message carries the selected multimedia data stream identifier according to the role attribute of the participant corresponding to the multimedia data stream.
  • the first processing module 63 is configured to complete establishment of a media transmission channel with the media providing device, and receive, by the media transmission channel, a location corresponding to the selected multimedia data stream identifier sent by the media providing device. The multimedia data stream.
  • the media receiving device in this embodiment may be used to perform the technical solution of the method embodiment shown in FIG. 1 , and the implementation principle and technical effects are similar, and details are not described herein again.
  • the conference role attribute corresponding to the multimedia data stream includes at least one or more of the following information:
  • the conference card of the participant corresponding to the multimedia data stream represents the business card information of the character in the social relationship.
  • the media providing device and the media receiving device are one of the following conference devices: a conference terminal or a conference server.
  • FIG. 7 is a schematic structural diagram of Embodiment 5 of the media receiving device of the present invention.
  • the media receiving device of the present embodiment may further include: a second processing module 71, configured to: Selecting a multimedia data stream identifier according to the conference role attribute of the participant corresponding to the multimedia data stream; or the second processing module 71 is configured to send a multimedia selection option to the conference control entity, where the multimedia selection option includes the first receiving module The identifier information of the received multimedia data stream, and the conference role attribute of the participant corresponding to each multimedia data stream; receiving the multimedia data stream identifier selected by the conference control entity according to the conference role attribute of the participant.
  • the media receiving device in the embodiment of the present invention may be used to implement the technical solution of the foregoing method for establishing a multimedia conference.
  • the implementation principle and technical effects are similar, and details are not described herein again.
  • FIG. 8 is a schematic structural diagram of Embodiment 6 of a media providing apparatus according to the present invention.
  • the media providing apparatus may be a conference terminal or a conference server.
  • the media providing apparatus of this embodiment includes: a second sending module 81, a second receiving module 82, and a third processing module 83.
  • the second sending module 81 is configured to send a media announcement message to the media receiving device, where the media announcement message carries the multimedia data stream identifier that can be sent by the media providing device, and the conference of the participant corresponding to each multimedia data stream.
  • the second receiving module 82 is configured to receive a media configuration message sent by the media receiving device, where the media configuration message carries the multimedia data selected according to the conference role attribute of the participant corresponding to the multimedia data stream.
  • a third processing module 83 configured to establish a media transmission channel with the media receiving device, and send, by using the media transmission channel, the multimedia corresponding to the selected multimedia data stream identifier to the media receiving device data flow.
  • the media providing device of this embodiment may be used to implement the technical solution of the method embodiment shown in FIG. 5, and the implementation principle and technical effects are similar, and details are not described herein again.
  • the conference role attribute corresponding to the multimedia data stream includes at least one or more of the following information:
  • the conference card of the participant corresponding to the multimedia data stream represents the business card information of the character in the social relationship.
  • the media providing device and the media receiving device are one of the following conference devices: a conference terminal or a conference server.
  • the second sending module is specifically configured to construct a media announcement message according to all multimedia data streams obtained from conference terminals of all participants and their conference role attributes.
  • FIG. 9 is a schematic structural diagram of Embodiment 7 of a media receiving apparatus according to the present invention.
  • the media receiving apparatus may be a conference terminal or a conference server.
  • the media receiving device 90 of the embodiment of the present invention may include: a transceiver 91 and a processor 92.
  • the transceiver 91 is configured to receive the media announcement message sent by the media providing device, where the media announcement message carries the identifier information of the multimedia data stream that can be sent by the media providing device, and the participant corresponding to each multimedia data stream. a conference role attribute; and, sending, to the media providing device, a media configuration message, where the media configuration message carries a multimedia data stream identifier selected according to a role attribute of the participant corresponding to the multimedia data stream; Forming a media transmission channel with the media providing device, and receiving, by the media transmission channel, the multimedia data stream that is sent by the media providing device and corresponding to the selected multimedia data stream identifier.
  • the transceiver provided in all embodiments of the present invention may be composed of mutually independent transmitters and receivers, or may be coupled together with receiving and transmitting functions, and the present invention is not limited thereto. .
  • the conference role attribute corresponding to the multimedia data stream includes at least one or more of the following: a conference organization role of the corresponding person in the multimedia data stream, indicating a duty position in the conference organization; the multimedia The conference system control role of the participant corresponding to the data stream indicates the authority position in the conference control; the conference card of the participant corresponding to the multimedia data stream indicates the card information of the participant in the social relationship.
  • the media providing device and the media receiving device are one of the following conference devices: a conference terminal or a conference server.
  • the processor 92 is further configured to: perform a multimedia data stream selection according to a default rule according to a conference role attribute of the multimedia data stream; or the processor 92 is further configured to present a multimedia selection option to the conference control entity.
  • the multimedia selection option includes identification information of the available multimedia data stream, and a conference role attribute corresponding to each of the multimedia data streams; and obtaining a selection result fed back by the conference control entity to complete the selection of the multimedia data stream.
  • the device may be specifically configured to perform the method on the side of the media receiving device.
  • the steps of the method disclosed in the embodiment of the present invention may be directly implemented as a hardware device, or may be performed by a combination of hardware and software modules.
  • the software modules can be located in mature storage media such as random access memory, flash memory, read-only memory or registers.
  • the embodiment of the present invention establishes a session between the media providing device and the media receiving device by selecting the multimedia data stream according to the conference role attribute corresponding to the multimedia data stream, and presenting the selected multimedia data stream by the media receiving device.
  • the media receiving device performs selection control on the multimedia data stream according to the conference role attribute, and selectively controls, selects, controls, and presents the multimedia data stream in the multimedia conference.
  • FIG. 10 is a schematic structural diagram of Embodiment 8 of a media providing apparatus according to the present invention.
  • the media providing apparatus may be a conference terminal or a conference server.
  • the media providing device 100 of this embodiment may include: a transceiver 11 and a processor 12.
  • the transceiver 11 is configured to send a media announcement message to the media receiving device, where the media setup request message carries an identifier of the multimedia data stream that can be sent by the media providing device. Information, and a conference role attribute of the participant corresponding to each multimedia data stream; and receiving a media configuration message sent by the media receiving device, where the media configuration message carries a conference according to the participant corresponding to the multimedia data stream a role attribute, the selected multimedia data stream identifier; the processor 12 is configured to establish a media transmission channel with the media receiving device, and send the selected multimedia data stream to the media receiving device by using the media transmission channel Identify the corresponding multimedia data stream.
  • the conference role attribute corresponding to the multimedia data stream includes at least one or more of the following information: a conference organization role of the corresponding participant in the multimedia data stream, indicating a job title in the conference organization;
  • the multimedia data stream corresponds to the conference system control role of the participant, and represents the authority position in the conference control;
  • the multimedia data stream corresponds to the conference business card of the participant, and represents the business card information of the character in the social relationship.
  • the media providing device and the media receiving device are one of the following conference devices: a conference terminal or a conference server.
  • the transceiver 11 may be specifically configured to construct a media announcement message according to all multimedia data streams and conference role attributes acquired from the conference terminals of all participants.
  • the embodiment of the present invention obtains the identification information of the multimedia data stream and the corresponding conference role attribute, and carries the acquired identification information and the conference role attribute in each of the sending and receiving messages that establish a session flow with the media receiving device to implement multimedia.
  • the selective selection, control and presentation of the multimedia data stream in the multimedia conference are controlled to avoid the defect of only the media stream codec and resolution in the conference negotiation mechanism in the prior art.
  • FIG. 11 is a schematic structural diagram of Embodiment 9 of a system for establishing a multimedia conference according to the present invention.
  • the multimedia conference establishing system 110 includes: a media providing device 111 and a media receiving device 112.
  • the media providing device 111 and the media receiving device 112 may refer to the embodiment shown in Fig. 6 or Fig. 7, respectively, or the media providing device 111 and the media receiving device 112 may refer to the embodiment shown in Fig. 8, respectively.
  • the aforementioned program can be stored in a computer readable storage medium.
  • the program when executed, performs the steps including the foregoing method embodiments; and the foregoing storage medium includes: ROM, RAM, disk or optical disk, and the like, which can store program codes. Medium.

Abstract

本发明实施例提供一种多媒体会议的建立方法、装置及系统,该方法包括:媒体接收实体媒体接收装置接收媒体提供实体媒体提供装置发送的媒体宣告消息,所述媒体宣告消息中携带所述媒体提供装置所能够发送的多媒体数据流的标识信息,以及每个多媒体数据流对应的与会者的会议角色属性;所述媒体接收装置向所述媒体提供装置发送媒体配置消息;所述媒体接收装置完成与所述媒体提供装置之间的媒体传输通道的建立,并通过所述媒体传输通道接收所述媒体提供装置发送与所述选择的多媒体数据流标识对应的多媒体数据流。本发明通过根据多媒体数据流对应的会议角色属性实现对所述多媒体数据流的选择,有针对性的控制多媒体会议中多媒体数据流的协商和呈现。

Description

技术领域 本发明实施例涉及网络通信技术,尤其涉及一种多媒体会议的建立方法、 装置及系统。 背景技术 随着会议电视的发展, 会场由以前的一路摄像机、 一路活动视频和一个 活动图像的显示器, 发展到多路摄像机、 多路活动视频和多路活动图像的显 示器。 在同一会场的多路摄像机、 多路活动视频和多路活动图像通过物理的 或者逻辑的关系进行关联, 例如, 会场 A为三屏会场; 会场 B为两屏会场; 会场 C为单屏会场, 即传统会议电视,会场 A的第一摄像机拾取会场 A中第 一位置的与会者的图像在本端会场 A或者远端会场 B或 C的第一屏幕显示。
在传统的音视频呼叫、 视频会议中, 由于各个与会方设备能力的单一, 发送和接收的媒体流的选择主要是基于音视频编解码等信息。 现有的会议协 商机制仅提供编码 H.264/H.265/VP8和分辨率 720P/1080P等, 使得与会方不 能了解媒体流更为直观的内容信息。 这样在多会场、 多路媒体流的会议场景 中, 存在众多诸如高清画面、 高保真音频的媒体数据流, 仅根据编解码等传 统信息已经无法完成会议需要的媒体选择, 也就无法提供社交类增强业务及 体验, 例如, 希望看到主持人的画面等; 而如果等待媒体实际接收和播放之 后再进行筛选, 则需要复杂的媒体处理资源和更高的网络传输带宽来保障, 这在多方高质量视频会议中往往是不实际的。 发明内容
本发明实施例提供一种多媒体会议的建立方法、 装置及系统, 以解决现 有的会议媒体流协商机制的缺陷, 实现有针对性的控制多媒体会议中多媒体 数据流的协商选择。
第一方面, 本发明实施例提供一种多媒体会议的建立方法, 包括: 媒体接收装置接收媒体提供装置发送的媒体宣告消息, 所述媒体宣告 消息携带所述媒体提供装置所能够发送的多媒体数据流标识, 以及每个多 媒体数据流对应的与会者的会议角色属性;
所述媒体接收装置向所述媒体提供装置发送媒体配置消息, 所述媒体 配置消息携带根据所述多媒体数据流对应的与会者的角色属性, 选择的多 媒体数据流标识;
所述媒体接收装置完成与所述媒体提供装置之间的媒体传输通道的 建立, 并通过所述媒体传输通道接收所述媒体提供装置发送的与所述选择 的多媒体数据流标识对应的多媒体数据流。
结合第一方面, 在第一方面的第一种可能的实现方式中, 所述多媒体 数据流对应的与会者的会议角色属性包括如下信息的一种或多种:
所述多媒体数据流对应的与会者的会议组织角色, 以表示在会议组织 中的职责职务;
所述多媒体数据流对应的与会者的会议系统控制角色, 以表示在会议 控制中的权限职务。
结合第一方面或第一方面的第一种可能的实现方式, 在第一方面的第 二种可能的实现方式中, 若一个多媒体数据流对应多个与会者, 则所述一 个多媒体数据流对应的与会者的会议角色属性为:
所述多个与会者中优先级最高的与会者对应的会议角色属性。
结合第一方面, 在第一方面的第三种可能的实现方式中, 所述媒体接 收装置向所述媒体提供装置发送媒体配置消息之前, 进一歩包括:
所述媒体接收装置根据所述多媒体数据流对应的与会者的会议角色 属性, 选择多媒体数据流标识。
结合第一方面, 在第一方面的第四种可能的实现方式中, 所述媒体接 收装置向所述媒体提供装置发送媒体配置消息之前, 进一歩包括:
所述媒体接收装置向会议控制实体发送多媒体选择选项, 所述多媒体 选择选项包括所述媒体接收装置接收的多媒体数据流标识, 以及每个多媒 体数据流对应的与会者的会议角色属性;
所述媒体接收装置接收所述会议控制实体发送的根据所述与会者的 会议角色属性选择的多媒体数据流标识。所述会议服务器根据从所有与会 方的会议终端所获取到的所有多媒体数据流及其会议角色属性, 构建媒体 宣告消息。
第二方面, 本发明实施例提供一种媒体接收装置, 包括:
第一接收模块, 用于接收媒体提供装置发送的媒体宣告消息, 所述媒 体宣告消息中携带所述媒体提供装置所能够发送的多媒体数据流标识, 以 及每个多媒体数据流对应的与会者的会议角色属性;
第一发送模块, 用于向所述媒体提供装置发送媒体配置消息, 所述媒 体配置消息携带根据所述多媒体数据流对应的与会者的角色属性, 选择的 多媒体数据流标识;
第一处理模块, 用于完成与所述媒体提供装置之间的媒体传输通道的 建立, 并通过所述媒体传输通道接收所述媒体提供装置发送的与所述选择 的多媒体数据流标识对应的所述多媒体数据流。
结合第二方面, 在第二方面的第一种可能的实现方式中, 所述多媒体 数据流对应的与会者的会议角色属性包括如下信息的一种或多种:
所述多媒体数据流对应的与会者的会议组织角色, 以表示在会议组织 中的职责职务;
所述多媒体数据流对应的与会者的会议系统控制角色, 以表示在会议 控制中的权限职务。
结合第二方面或第二方面的第一种可能的实现方式, 在第二方面的第 二种可能的实现方式中, 若一个多媒体数据流对应多个与会者, 则所述一 个多媒体数据流对应的与会者的会议角色属性为:
所述多个与会者中优先级最高的与会者对应的会议角色属性。
结合第二方面, 在第二方面的第三种可能的实现方式中, 所述媒体接 收装置还包括:
第二处理模块, 用于根据所述多媒体数据流对应的与会者的会议角色 属性, 选择多媒体数据流标识。
结合第二方面, 在第二方面的第四种可能的实现方式中, 所述媒体接 收装置还包括:
第二处理模块, 用于向会议控制实体发送多媒体选择选项, 所述多媒 体选择选项包括所述第一接收模块接收的多媒体数据流的标识信息, 以及 每个多媒体数据流对应的与会者的会议角色属性; 接收所述会议控制实体 发送的根据所述与会者的会议角色属性选择的多媒体数据流标识。选择模 块, 用于向会议控制实体呈现多媒体选择选项, 所述多媒体选择选项包括 可供选择的多媒体数据流的标识信息, 以及各所述多媒体数据流对应的会 议角色属性; 获取所述会议控制实体完成多媒体数据流的选择而反馈的选 择结果。
第三方面, 本发明实施例提供一种媒体提供装置, 包括:
第二发送模块, 用于向媒体接收装置发送媒体宣告消息, 所述媒体宣 告消息携带所述媒体提供装置所能发送的多媒体数据流标识, 以及每个多 媒体数据流对应的与会者的会议角色属性;
第二接收模块, 用于接收所述媒体接收装置发送的媒体配置消息, 所 述媒体配置消息中携带根据所述多媒体数据流对应的与会者的会议角色 属性, 选择的多媒体数据流标识;
第三处理模块, 用于建立与所述媒体接收装置之间的媒体传输通道, 并通过所述媒体传输通道向所述媒体接收装置发送所述选择的多媒体数 据流标识对应的多媒体数据流。 第二处理模块, 用于建立与所述媒体接收 装置之间的媒体传输通道, 并通过所述媒体传输通道为所述媒体接收装置 发送所选择的多媒体数据流。
结合第三方面, 在第三方面的第一种可能的实现方式中, 所述多媒体 数据流对应的与会者的会议角色属性包括如下信息的一种或多种:
所述多媒体数据流对应的与会者的会议组织角色, 以表示在会议组织 中的职责职务;
所述多媒体数据流对应的与会者的会议系统控制角色, 表示在会议控 制中的权限职务。
结合第三方面或第三方面的第一种可能的实现方式, 在第三方面的第 二种可能的实现方式中, 若一个多媒体数据流对应多个与会者, 则所述一 个多媒体数据流对应的与会者的会议角色属性为:
所述多个与会者中优先级最高的与会者对应的会议角色属性。
第四方面, 本发明实施例提供一种多媒体会议的建立系统, 包括: 如第二方面、 第二方面的第一种至第四种可能的实现方式中的任意一种 提供的媒体接收装置和如第三方面、 第三方面的第一种至第二种可能的实现 方式中的任意一种提供的媒体提供装置。
本发明实施例提供的多媒体会议的建立方法、 装置及系统, 通过提供多 媒体数据流对应与会者的会议角色属性, 能够使得媒体接收装置基于会议角 色属性对多媒体数据流进行选择, 从而丰富了对多媒体数据流的播放控制, 增强了会议体验, 并降低了媒体处理资源的开销和网络传输带宽。 附图说明 为了更清楚地说明本发明实施例或现有技术中的技术方案, 下面将对实 施例或现有技术描述中所需要使用的附图作一简单地介绍, 显而易见地, 下 面描述中的附图是本发明的一些实施例, 对于本领域普通技术人员来讲, 在 不付出创造性劳动性的前提下, 还可以根据这些附图获得其他的附图。
图 1为本发明多媒体会议的建立方法实施例一的流程示意图;
图 2和图 3为本发明多媒体会议的建立方法实施例二的流程示意图; 图 4为本发明多媒体会议的建立方法实施例二的会议控制实体界面示例 图;
图 5为本发明多媒体会议的建立方法实施例三的流程示意图;
图 6为本发明媒体接收装置实施例四的结构示意图;
图 7为本发明媒体接收装置实施例五的结构示意图;
图 8为本发明媒体提供装置实施例六的结构示意图;
图 9为本发明媒体接收装置实施例七的结构示意图;
图 10为本发明媒体提供装置实施例八的结构示意图;
图 11为本发明多媒体会议的建立系统实施例九的结构示意图。 具体实施方式 为使本发明实施例的目的、 技术方案和优点更加清楚, 下面将结合本发 明实施例中的附图, 对本发明实施例中的技术方案进行清楚、 完整地描述, 显然, 所描述的实施例是本发明一部分实施例, 而不是全部的实施例。 基于 本发明中的实施例, 本领域普通技术人员在没有作出创造性劳动前提下所获 得的所有其他实施例, 都属于本发明保护的范围。 实施例一
图 1为本发明多媒体会议的建立方法实施例一的流程示意图。 本发明实 施例提供了一种多媒体会议的建立方法, 该方法可以由任意的媒体接收装置 来执行, 该媒体接收装置可以通过软件和 /或硬件实现, 可以为会议终端或会 议服务器,其中,会议终端可以为智真终端、普通会议室终端、个人电脑(PC)、 笔记本 (Laptop) 或手机、 平板电脑等移动终端设备, 可以支持音视频等多 媒体数据的收发, 根据音频和画面质量的不同可以有不同等级的划分, 如视 频画面可以分为高清、 标清和普通画面。
如图 1所示, 本实施例的方法包括:
歩骤 101 : 媒体接收装置接收媒体提供装置发送的媒体宣告消息, 所述 媒体宣告消息中携带所述媒体提供装置所能够发送的多媒体数据流标识, 以 及每个多媒体数据流对应的与会者的会议角色属性。
具体地, 所述媒体接收装置和媒体提供装置可以是点对点会议中的至少 两个会议终端, 也可以是多点会议中的各会议终端和作为会议服务器的多点 控制单元 (Multipoint Control Unit, 简称: MCU), 二者是相对存在的, 即媒 体接收装置同时也可以作为媒体提供装置, 媒体提供装置同时也可以作为媒 体接收装置。 通常, 会议终端提供的多媒体数据流先提供给会议服务器, 在 此过程中, 会议终端作为媒体提供装置, 会议服务器作为媒体接收装置。 而 后, 会议服务器将多媒体数据流提供给其他会议终端, 则此过程中, 会议服 务器的角色是媒体提供装置, 其他会议终端作为媒体接收装置。 当有多个多 媒体数据流在同歩传输时, 则各会议终端和会议服务器在不同的过程中的角 色会发生变化。
其中, 在多方会议中, MCU负责呼叫信令处理、 会议控制、 视频核心交 换、 混音、 视音频适配和分屏处理。 所述会议终端包括视频编解码模块、 音 频编解码模块、 信令模块、 控制模块、 配置模块和其它功能模块, 主要用于 接收和发起对远端会议终端的呼叫, 把本地摄像机组和麦克风采集的视频和 音频码流编码后发送给远端会议终端, 同时把远端会议终端的视频和音频码 流进行解码并输出到本端会议终端的显示器和喇叭。 其中, 所述摄像机组可 以由一个或多个摄像机组成, 每个摄像机对应各自的会场区域。
所述媒体提供装置通过摄像机和麦克风采集所述多媒体数据流, 并相应 获取与所述多媒体数据流对应的与会者的会议角色属性, 这里获取与会者会 议角色属性可以通过预先配置, 系统 API调用, 或在线协商的方式获取。 所 述会议角色属性用于表征多媒体数据流中对应与会者的角色定位和属性体 现, 具体包括会议组织角色、 会议系统控制角色和会议名片信息中的一种或 多种, 例如, 会场的某一路画面中包含会议主席的实时图像采集, 则该多媒 体数据流的会议角色属性为 "主席" 。 其中, 所述多媒体数据流至少包括一 个会场的实时画面或会议共享内容的辅流, 即会场间共享的内容, 例如, 辅 流幻灯片、 辅流视频、 辅流图片等。
歩骤 102:所述媒体接收装置向所述媒体提供装置发送媒体配置消息, 所述媒体配置消息携带根据所述多媒体数据流对应的与会者的会议角色 属性, 选择的多媒体数据流标识。
本歩骤中, 多媒体数据流的选择可以是媒体接收装置直接依据所述多媒 体数据流对应的与会者的会议角色属性进行选择, 也可以是通过与会议控制 实体交互来完成选择。 例如, 会议终端作为媒体接收装置时, 根据所述媒体 提供装置发送的媒体宣告消息中的多媒体数据流的标识信息和所述多媒体数 据流对应的与会者的会议角色属性, 向会议控制实体发送多媒体选择选项, 其中包括各个可供选择的多媒体数据流的标识信息, 以及各所述多媒体数据 流对应的与会者的会议角色属性, 以供会议控制实体完成对希望在会议中接 收的多媒体数据流的选择; 会议控制实体将选择结果告知媒体接收装置; 而 后媒体接收装置再据此选择结果产生媒体配置消息。 其中, 该会议控制实体 可以集成会议终端中, 或者是独立的设备, 例如支持会议控制的平板电脑。 本发明实施例中,通过与会者的会议角色属性进行多媒体数据流标识的选择, 可以根据角色属性的优先级进行选择, 也可以按接收端预先设定的规则进行 选择。
歩骤 103: 所述媒体接收装置完成与所述媒体提供装置之间的媒体传输 通道的建立, 并通过所述媒体传输通道接收所述媒体提供装置发送的与所述 选择的多媒体数据流标识对应的多媒体数据流。
具体地, 在点对点会议中, 两个会场之间直接通信, 不需要 MCU的参与, 第一会议终端将媒体宣告消息发送给第二会议终端, 该种情况下, 只有第一 会议终端和第二会议终端之间媒体传输通道的建立; 在多点会议中, 一般是 3 个或 3个以上的会场通信, 需要经过 MCU的中间处理, 由 MCU进行多媒体数 据流的控制和转发, 此时, 存在第一会议终端和 MCU之间媒体传输通道的建 立和 MCU与第二会议终端之间媒体传输通道的建立。
例如, 某包含深圳、 北京、 上海和成都的多方会议中, 其中: 深圳会场 可以提供三路固定内容的多媒体数据流, 其标识及对应的会议角色属性取值 分别为 S-VC0 (观众) 、 S-VC1 (会议主席) 和 S-VC2 (观众) ; 北京会场也 可以提供三路固定内容的多媒体数据流, 其标识及对应的会议角色属性取值 分别为 B-VC0 (观众) 、 B-VC1 (观众) 和 B-VC2 (会议主讲) ; 上海会场可 以提供两路固定内容的多媒体数据流, 其标识及对应的会议角色属性取值分 别为 H-VC0 (主持人) 和 H-VC1 (观众) ·' 所述各会场和 MCU作为媒体接收 装置, 与各所述会场分别协商交互。 MCU作为会议的媒体中心, 可以综合所 有与会方的媒体提供信息并通告给每个与会方。 例如成都, 可以根据不同数 据流的与会者角色属性, 选择接收来自各对应会场的多媒体数据流, 例如深 ±川的 S-VC1 (会议主席) 、 北京的 B-VC2 (会议主讲)和上海的 H-VC0 (主持 人) 。
在上述发明实施例中, 媒体提供装置和媒体接收装置可以是会议终端、 会议服务器 MCU的任意组合, 具体取决于实际应用场景。 例如, 会议终端向 MCU发送多媒体数据时,会议终端是媒体提供装置,而 MCU是媒体接收装置; 反过来, MCU向会议终端发送多媒体数据时, MCU是媒体提供装置, 而会议 终端是媒体接收装置; 同样存在两个会议终端之间直接建立连接进行点对点 的通信, 这时在每个传输方向上, 媒体发送侧为媒体提供装置, 媒体接收侧 的会议终端为媒体接收装置。
在本发明实施例中, 通过根据多媒体数据流对应的会议角色属性对所述 多媒体数据流进行选择,建立媒体提供装置和媒体接收装置双方之间的会话, 实现所述媒体接收装置根据所述会议角色属性对所述多媒体数据流进行选 择, 有针对性的控制多媒体会议中多媒体数据流的协商和呈现, 从而可以在 节省媒体处理资源和网络传输带宽的条件下完成对会议多媒体数据流的控制 传输。
需要说明的是, 在本发明所有实施例中, 所述多媒体数据流对应的与会 者的会议角色属性包括如下信息的至少一种或多种: 所述多媒体数据流对应 与会者的会议组织角色, 表示在会议组织中的职责职务; 所述多媒体数据流 对应与会者的会议系统控制角色, 表示在会议控制中的权限职务; 所述多媒 体数据流对应与会者的会议名片, 表示在社会关系中的名片信息。
其中, 所述会议组织角色用于提供所述多媒体数据流对应与会者在会议 组织中的职务, 其具体取值可以遍历当前标准机制中的相关定义, 会议组织 角色可以由用户通过输入或选项选择等方式为多媒体数据流设置会议组织角 色的具体参数。 会议组织角色例如可以为:
主席 (Chairman;)—召开并主持会议议程, 根据不同场合也称主持人 (moderator) 或 ί艮告人 (rapporteur) ;
副主席 (Vice-Chairman)—主席协助人;
秘书 (Secretary) —会议纪要或文档维护人, 根据不同场合也称记录员 (recorder) 等;
与会人 (Participant;)—出席会议但没有其它角色的人, 也称观众或听众; 演讲人 (Speaker)—会议演讲方;
翻译 (Translator)—会场不同语言翻译者;
计时员(Timekeeper)—会议计时。
这里, 可以设置各会议角色属性的优先级, 如主席的优先级高于副主席, 副主席的优先级高于秘书, 秘书的优先级高于演讲人, 演讲人的优先级高于 翻译, 当然也可以为其他优先级顺先, 本发明实施例在此不作限制。 如果一 个多媒体数据流对应多个与会者, 例如会议中的某一路视频画面中同时包含 2 个与会者甲和乙, 其中甲为组织会议的主席, 乙为会议秘书, 则这一个多 媒体数据流对应的与会者的会议角色属性的取值定位 "主席", 也即所述多个 与会者中优先级最高的与会者对应的会议角色属性。 如果一个多媒体数据流 对应与会者的会议角色包含多于一个的类型取值,例如某画面对应的与会者, 是会议当前的演讲人(Speaker) ,同时也是会议共享材料的宣讲者(Presenter) , 则在所述多媒体数据流对应的与会者的会议角色属性中应包含上述所有取 值。
所述会议系统控制角色用于提供所述多媒体数据流对应人物在会议控制 中的职务, 可以至少包括三类: 宣讲者 (Presenter;)、 控制方 ^Controller)和观众 (Participant), 来确定会议控制中的定位和目标。 会议系统控制角色可以通过 话语权控制机制 (例如, Binary Floor Control Protocol , 简称: BFCP协议) 确定。
所述会议名片用于提供所述多媒体数据流对应人物的相关名片信息, 可 以包括几类不同信息, 例如, 机构、 头衔、 职业职位和特定会议角色等。 例 如, 所述媒体提供装置可以先获取所述多媒体数据流中相关人物的标识, 并 通过应用程序编程接口 (Application Programming Interface, 简称: API) 接 口在关联系统中或网络中查询获取所述人物的标识对应的会议名片。 借用互 联网工程任务组 (Internet Engineering Task Force, 简称: IETF) 的名片机制 引入到多流会议中和媒体流绑定, 例如:
CSE 1 (VC 1 [vCARD 1 { syntax} ] ,VC2 [vCARD2 { syntax} ] ,VC3 [vCARD3 { synt ax}])
CSE2(VC4[vCARDl { syntax} , vC ARD2 { syntax} ,vC ARD3 { syntax} ] ) CSE3(AC1 [vCARDl { syntax} , vC ARD2 { syntax} ,vC ARD3 { syntax} ] ) 其中, vCARD的信息可参见请求评议 (Request For Comments, 简称: RFC) 6350的分类: Identification Properties Delivery addressing properties Communications Properties、 Geographical Properties、 Organizational Properties、 Explanatory Properties、 Security Properties、 Calendar Properties。
所述多媒体数据流对应的会议角色属性还可以包括所述多媒体数据流对 应的会场信息, 在所述多媒体数据流的粒度上, 可以为整个会场级别增加会 场信息, 例如: 深圳、 广州和珠海三个会场举办三方会议, 可以在深圳会场 端的会议终端所对应的媒体流绑定会场信息, 例如"深圳会场"等, 对应会议 协商机制即为捕获场景级别属性 (Capture Scene Attribute) 。
需要说明的是, 在本发明所有实施例中, 所述媒体提供装置和所述媒体 接收装置是如下会议设备中的一种: 会议终端或会议服务器。
实施例二
图 2和图 3为本发明多媒体会议的建立方法实施例二的流程示意图。 本 发明实施例在上述实施例的基础上, 所述媒体接收装置接收媒体提供装置发 送的媒体宣告消息之后, 如图 2所示, 所述方法还可以包括:
歩骤 201 : 所述媒体接收装置根据多媒体数据流对应的与会者的会议 角色属性, 基于默认规则进行多媒体数据流的选择。 此实施方式例如可适用于会议服务器作为媒体接收装置时, 可以不需 要用户参与而基于默认规则进行选择, 例如, 基于会议角色属性的预设优 先级规则, 或者会议角色属性与会议终端属性的匹配规则, 选择多媒体数 据流。
或者, 如图 3所示, 所述方法还可以包括:
歩骤 301 : 所述媒体接收装置向会议控制实体呈现多媒体选择选项, 所 述多媒体选择选项包括可供选择的多媒体数据流的标识信息, 以及各所述多 媒体数据流对应的会议角色属性。
具体地, 所述媒体接收装置将各所述多媒体数据流的标识信息与其对应 的会议角色属性对应显示;或所述媒体接收装置将各所述多媒体数据流显示, 且在各多媒体数据流的显示区域内显示其所对应的会议角色属性。如前所述, 会议控制实体由会议控制者操作, 在其上呈现的多媒体数据流的会议角色属 性, 可让会议控制者基于会议角色属性为各媒体接收装置选择应接收的多媒 体数据流。
图 4为本发明多媒体会议的建立方法实施例二的会议控制实体界面示例 图。 如图 4所示, 所述媒体接收装置在用户会议控制实体接口为用户提供多 媒体选择选项, 包括:
1 ) 用户可以选择的多媒体数据流, 如图 4所示: 第一多媒体数据流 41、 第二多媒体数据流 42和第三多媒体数据流 43 ;
2)在每个多媒体数据流中, 给出多媒体数据流对应的属性信息, 包括多 媒体数据流的编解码和分辨率, 如图 4 所示: H.264/1080P、 VP8/720P 和 H.264/360P;
3 ) 多媒体数据流的会议角色属性, 例如图 4中所示, 会议组织角色: 会 议主讲 411、 会议主席 421和观众 431 ; 会议控制角色: 共享讲解 412、 共享 控制 422和非共享方 432; 会议名片: 深圳一中 413、 省教育厅 423和珠海中 学 433。
用户按图 4中所示选项选择希望接收的多媒体数据流, 并保存对应会议 角色属性以决定后续的播放策略; 媒体接收装置根据用户选择构造媒体配置 消息, 响应给媒体提供装置, 从而完成多媒体会议媒体配置消息的交互, 进 而建立媒体会话。 歩骤 302: 所述媒体接收装置获取所述会议控制实体完成多媒体数据流 的选择而反馈的选择结果。
在本发明实施例中, 媒体接收装置呈现多媒体数据流的标识信息以及其 所对应的会议角色属性供用户选择,并将该选择的结果反馈给媒体提供装置, 实现用户根据多媒体数据流对应的会议角色属性有针对性的选择需要呈现的 多媒体数据流, 从而建立多媒体会议。
实施例三
图 5为本发明多媒体会议的建立方法实施例三的流程示意图。 本发明实 施例提供了一种多媒体会议的建立方法, 该方法可以由任意的媒体提供装置 来执行, 该媒体提供装置可以通过软件和 /或硬件实现, 可以为会议终端或会 议服务器。 如图 5所示, 本实施例的方法包括:
歩骤 501 : 媒体提供装置向媒体接收装置发送媒体宣告消息, 所述媒体 建立请求消息中携带所述媒体提供装置所能够发送的多媒体数据流标识, 以 及每个多媒体数据流对应的与会者的会议角色属性。
具体地, 媒体提供装置在各会场获取多媒体数据流以及所述多媒体数据 流对应的会议角色属性, 根据所述多媒体数据流和会议角色属性生成媒体宣 告消息, 并发送给媒体接收装置。
如前述实施例所介绍, 媒体提供装置可以为点对点会议中的会议终端, 也可以为多点会议中的会议终端或 MCU。
歩骤 502: 所述媒体提供装置接收所述媒体接收装置发送的媒体配置消 息, 所述媒体配置消息中携带根据所述会议角色属性选择接收的多媒体数据 流的标识信息。
歩骤 503 : 所述媒体提供装置建立与所述媒体接收装置之间的媒体传输 通道, 并通过所述媒体传输通道为所述媒体接收装置发送所选择的多媒体数 据流。
在本发明实施例中, 媒体提供装置获取多媒体数据流的标识信息和其所 对应的会议角色属性, 并在与媒体接收装置建立会话流程的各收发消息中携 带所获取的所述标识信息和会议角色属性, 实现多媒体会议建立后, 有针对 性的实现所述多媒体数据流的协商选择、 控制和呈现, 以避免现有技术中会 议协商机制中仅呈现媒体流编解码和分辨率的缺陷。 在上述实施例的基础上, 所述媒体提供装置和所述媒体接收装置是如下 会议设备中的一种: 会议终端或会议服务器。
在本发明实施例的一种场景中, 所述媒体提供装置为会议服务器, 则媒 体接收装置接收媒体提供装置发送的媒体宣告消息可以包括: 所述会议服务 器根据从所有与会方的会议终端所获取到的所有多媒体数据流及其会议角色 属性, 构建媒体宣告消息。 以下进行举例说明:
例如, 深圳、 广州和珠海三方会议时, 会议服务器汇总获取到来自三方 会场的多媒体数据流, 并在三方媒体宣告消息中携带三方会场的多媒体数据 流组的标识信息和其各自对应的会议角色属性, 并将所述标识信息和会议角 色属性呈现到三方会场中的会议终端上, 在呈现策略上为用户提供依据, 例 如, 深圳的与会者就可以选择广州或珠海的多媒体数据流进行播放。
在上述基础上, 所述多媒体数据流的选择选项在会议控制实体上的呈现 布局可以通过以下方式实现: 提供各所述多媒体数据流的列表, 包括标识信 息、 对应会议角色属性, 以及其它可能的媒体流内容特征参数; 以画面预览 的方式, 提供各所述多媒体数据流的预览画面, 辅以标识信息、 对应会议角 色属性的介绍; 或者其它布局方式以供用户直观选择。
实施例四
图 6为本发明媒体接收装置实施例四的结构示意图, 该媒体接收装置 可以为会议终端或会议服务器。 如图 6所示, 本实施例的媒体接收装置包 括: 第一接收模块 61、 第一发送模块 62和第一处理模块 63, 其中, 第一 接收模块 61用于接收媒体提供装置发送的媒体宣告消息, 所述媒体宣告 消息中携带所述媒体提供装置所能够发送的多媒体数据流的标识信息, 以 及所每个多媒体数据流对应的与会者的会议角色属性; 第一发送模块 62 用于向所述媒体提供装置发送媒体配置消息, 所述媒体配置消息携带根据 所述多媒体数据流对应的与会者的角色属性, 选择的多媒体数据流标识。 第一处理模块 63用于完成与所述媒体提供装置之间的媒体传输通道的建 立, 并通过所述媒体传输通道接收所述媒体提供装置发送的与所述选择的 多媒体数据流标识对应的所述多媒体数据流。
本实施例的媒体接收装置, 可以用于执行图 1所示方法实施例的技术方 案, 其实现原理和技术效果类似, 此处不再赘述。 进一歩地, 所述多媒体数据流对应的会议角色属性包括如下信息的至 少一种或多种:
所述多媒体数据流对应的与会者的会议组织角色, 以表示在会议组织 中的职责职务;
所述多媒体数据流对应的与会者的会议系统控制角色, 表示在会议控 制中的权限职务;
所述多媒体数据流对应的与会者的会议名片, 表示所述人物在社会关 系中的名片信息。
进一歩地, 所述媒体提供装置和所述媒体接收装置是如下会议设备中 的一种: 会议终端或会议服务器。
实施例五
图 7为本发明媒体接收装置实施例五的结构示意图, 本实施例的媒体 接收装置在图 6所示装置结构的基础上, 所述媒体接收装置还可以包括: 第二处理模块 71,用于根据所述多媒体数据流对应的与会者的会议角色属 性, 选择多媒体数据流标识; 或者第二处理模块 71用于向会议控制实体 发送多媒体选择选项, 所述多媒体选择选项包括所述第一接收模块接收的 多媒体数据流的标识信息, 以及每个多媒体数据流对应的与会者的会议角 色属性; 接收所述会议控制实体发送的根据所述与会者的会议角色属性选 择的多媒体数据流标识。
本发明实施例的媒体接收装置, 可以用于执行上述任意多媒体会议的建 立方法实施例的技术方案, 其实现原理和技术效果类似, 此处不再赘述。
实施例六
图 8为本发明媒体提供装置实施例六的结构示意图, 该媒体提供装置 可以为会议终端或会议服务器。 如图 8所示, 本实施例的媒体提供装置包 括: 第二发送模块 81、 第二接收模块 82和第三处理模块 83。
其中, 第二发送模块 81用于向媒体接收装置发送媒体宣告消息, 所 述媒体宣告消息携带所述媒体提供装置所能发送的多媒体数据流标识, 以 及每个多媒体数据流对应的与会者的会议角色属性; 第二接收模块 82, 用 于接收所述媒体接收装置发送的媒体配置消息, 所述媒体配置消息中携带 根据所述多媒体数据流对应的与会者的会议角色属性, 选择的多媒体数据 流标识; 第三处理模块 83, 用于建立与所述媒体接收装置之间的媒体传输 通道, 并通过所述媒体传输通道向所述媒体接收装置发送所述选择的多媒 体数据流标识对应的多媒体数据流。
本实施例的媒体提供装置, 可以用于执行图 5所示方法实施例的技术方 案, 其实现原理和技术效果类似, 此处不再赘述。
进一歩地, 所述多媒体数据流对应的会议角色属性包括如下信息的至 少一种或多种:
所述多媒体数据流对应的与会者的会议组织角色, 以表示在会议组织 中的职责职务;
所述多媒体数据流对应的与会者的会议系统控制角色, 表示在会议控 制中的权限职务;
所述多媒体数据流对应的与会者的会议名片, 表示所述人物在社会关 系中的名片信息。
进一歩地, 所述媒体提供装置和所述媒体接收装置是如下会议设备中 的一种: 会议终端或会议服务器。
进一歩地, 所述媒体提供装置为会议服务器时, 第二发送模块具体用 于根据从所有与会方的会议终端所获取到的所有多媒体数据流及其会议 角色属性, 构建媒体宣告消息。
实施例七
图 9为本发明媒体接收装置实施例七的结构示意图, 该媒体接收装置 可以为会议终端或会议服务器。 如图 9所示, 本发明实施例的媒体接收装 置 90可以包括: 收发器 91和处理器 92。
其中, 收发器 91用于接收媒体提供装置发送的媒体宣告消息, 所述 媒体宣告消息中携带所述媒体提供装置所能够发送的多媒体数据流的标 识信息, 以及每个多媒体数据流对应的与会者的会议角色属性; 以及, 向 所述媒体提供装置发送媒体配置消息, 所述媒体配置消息携带根据所述多 媒体数据流对应的与会者的角色属性, 选择的多媒体数据流标识; 处理器 92用于完成与所述媒体提供装置之间的媒体传输通道的建立,并通过所述 媒体传输通道接收所述媒体提供装置发送的与所述选择的多媒体数据流 标识对应的所述多媒体数据流。 需要说明的是, 本发明所有实施例中所提供的收发器可以由相互独立 的发送器和接收器组成, 也可以是耦合在一起的具有接收和发送功能的器 件, 本发明不以此为限。
进一歩地, 所述多媒体数据流对应的会议角色属性包括如下信息的至 少一种或多种: 所述多媒体数据流中对应人物的会议组织角色, 表示在会 议组织中的职责职务; 所述多媒体数据流对应的与会者的会议系统控制角 色, 表示在会议控制中的权限职务; 所述多媒体数据流对应的与会者的会 议名片, 表示与会者在社会关系中的名片信息。
进一歩地, 所述媒体提供装置和所述媒体接收装置是如下会议设备中 的一种: 会议终端或会议服务器。
进一歩地, 所述处理器 92还用于根据多媒体数据流的会议角色属性, 基于默认规则进行多媒体数据流的选择; 或者, 所述处理器 92还用于向 会议控制实体呈现多媒体选择选项, 所述多媒体选择选项包括可供选择的 多媒体数据流的标识信息, 以及各所述多媒体数据流对应的会议角色属 性; 获取所述会议控制实体完成多媒体数据流的选择而反馈的选择结果。
该装置可以具体为执行所述媒体接收装置侧的方法歩骤, 结合本发明 实施例所公开的方法的歩骤可以直接体现为硬件器件执行完成, 或者用硬 件及软件模块组合执行完成。 软件模块可以位于随机存储器、 闪存、 只读 存储器或寄存器等本领域成熟的存储介质中。
本发明实施例通过根据多媒体数据流对应的会议角色属性对所述多媒体 数据流进行选择, 并通过媒体接收装置呈现所选择的多媒体数据流, 建立媒 体提供装置和媒体接收装置双方之间的会话, 实现所述媒体接收装置根据所 述会议角色属性对所述多媒体数据流进行选择控制, 有针对性的控制多媒体 会议中多媒体数据流的协商选择、 控制和呈现。
实施例八
图 10为本发明媒体提供装置实施例八的结构示意图, 该媒体提供装 置可以为会议终端或会议服务器。 如图 10所示, 本实施例的媒体提供装 置 100可以包括: 收发器 11和处理器 12。
其中, 收发器 11用于向媒体接收装置发送媒体宣告消息, 所述媒体 建立请求消息中携带所述媒体提供装置所能发送的多媒体数据流的标识 信息, 以及每个多媒体数据流对应的与会者的会议角色属性; 以及, 接收 所述媒体接收装置发送的媒体配置消息, 所述媒体配置消息中携带根据所 述多媒体数据流对应的与会者的会议角色属性, 选择的多媒体数据流标 识; 处理器 12用于建立与所述媒体接收装置之间的媒体传输通道, 并通 过所述媒体传输通道向所述媒体接收装置发送所述选择的多媒体数据流 标识对应的多媒体数据流。
进一歩地, 所述多媒体数据流对应的会议角色属性包括如下信息的至 少一种或多种: 所述多媒体数据流中对应与会者的会议组织角色, 表示在 会议组织中的职责职务; 所述多媒体数据流对应与会者的会议系统控制角 色, 表示在会议控制中的权限职务; 所述多媒体数据流对应与会者的会议 名片, 表示所述人物在社会关系中的名片信息。
进一歩地, 所述媒体提供装置和所述媒体接收装置是如下会议设备中 的一种: 会议终端或会议服务器。
进一歩地, 所述媒体提供装置 100为会议服务器时, 收发器 11具体 可以用于根据从所有与会方的会议终端所获取到的所有多媒体数据流及 其会议角色属性, 构建媒体宣告消息。
本发明实施例通过获取多媒体数据流的标识信息和其所对应的会议角色 属性, 并在与媒体接收装置建立会话流程的各收发消息中携带所获取的所述 标识信息和会议角色属性, 实现多媒体会议建立后, 有针对性的控制多媒体 会议中多媒体数据流的协商选择、 控制和呈现, 以避免现有技术中会议协商 机制中仅呈现媒体流编解码和分辨率的缺陷。
实施例九
图 11为本发明多媒体会议的建立系统实施例九的结构示意图, 如图 11所示, 该多媒体会议的建立系统 110包括: 媒体提供装置 111和媒体接 收装置 112。
媒体提供装置 111和媒体接收装置 112可以分别参见图 6或图 7所示 的实施例, 或者, 媒体提供装置 111和媒体接收装置 112可以分别参见图 8所示的实施例。
本领域普通技术人员可以理解: 实现上述各方法实施例的全部或部分歩 骤可以通过程序指令相关的硬件来完成。 前述的程序可以存储于一计算机可 读取存储介质中。 该程序在执行时, 执行包括上述各方法实施例的歩骤; 而 前述的存储介质包括: ROM、 RAM, 磁碟或者光盘等各种可以存储程序代码 的介质。
最后应说明的是: 以上各实施例仅用以说明本发明的技术方案, 而非对 其限制; 尽管参照前述各实施例对本发明进行了详细的说明, 本领域的普通 技术人员应当理解:其依然可以对前述各实施例所记载的技术方案进行修改, 或者对其中部分或者全部技术特征进行等同替换; 而这些修改或者替换, 并 不使相应技术方案的本质脱离本发明各实施例技术方案的范围。

Claims

权 利 要 求
1、 一种多媒体会议的建立方法, 其特征在于, 包括:
媒体接收装置接收媒体提供装置发送的媒体宣告消息, 所述媒体宣告 消息携带所述媒体提供装置所能够发送的多媒体数据流标识, 以及每个多 媒体数据流对应的与会者的会议角色属性;
所述媒体接收装置向所述媒体提供装置发送媒体配置消息, 所述媒体 配置消息携带根据所述多媒体数据流对应的与会者的角色属性, 选择的多 媒体数据流标识;
所述媒体接收装置完成与所述媒体提供装置之间的媒体传输通道的 建立, 并通过所述媒体传输通道接收所述媒体提供装置发送的与所述选择 的多媒体数据流标识对应的多媒体数据流。
2、 根据权利要求 1所述的方法, 其特征在于, 所述多媒体数据流对 应的与会者的会议角色属性包括如下信息的一种或多种:
所述多媒体数据流对应的与会者的会议组织角色, 以表示在会议组织 中的职责职务;
所述多媒体数据流对应的与会者的会议系统控制角色, 以表示在会议 控制中的权限职务。
3、 根据权利要求 1或 2所述的方法, 其特征在于, 若一个多媒体数 据流对应多个与会者, 则所述一个多媒体数据流对应的与会者的会议角色 属性为:
所述多个与会者中优先级最高的与会者对应的会议角色属性。
4、 根据权利要求 1所述的方法, 其特征在于, 所述媒体接收装置向 所述媒体提供装置发送媒体配置消息之前, 进一歩包括:
所述媒体接收装置根据所述多媒体数据流对应的与会者的会议角色 属性, 选择多媒体数据流标识。
5、 根据权利要求 1所述的方法, 其特征在于, 所述媒体接收装置向 所述媒体提供装置发送媒体配置消息之前, 进一歩包括:
所述媒体接收装置向会议控制实体发送多媒体选择选项, 所述多媒体 选择选项包括所述媒体接收装置接收的多媒体数据流标识, 以及每个多媒 体数据流对应的与会者的会议角色属性; 所述媒体接收装置接收所述会议控制实体发送的根据所述与会者的 会议角色属性选择的多媒体数据流标识。
6、 一种媒体接收装置, 其特征在于, 包括:
第一接收模块, 用于接收媒体提供装置发送的媒体宣告消息, 所述媒 体宣告消息中携带所述媒体提供装置所能够发送的多媒体数据流标识, 以 及每个多媒体数据流对应的与会者的会议角色属性;
第一发送模块, 用于向所述媒体提供装置发送媒体配置消息, 所述媒 体配置消息携带根据所述多媒体数据流对应的与会者的角色属性, 选择的 多媒体数据流标识;
第一处理模块, 用于完成与所述媒体提供装置之间的媒体传输通道的 建立, 并通过所述媒体传输通道接收所述媒体提供装置发送的与所述选择 的多媒体数据流标识对应的所述多媒体数据流。
7、 根据权利要求 6所述的媒体接收装置, 其特征在于, 所述多媒体 数据流对应的与会者的会议角色属性包括如下信息的一种或多种:
所述多媒体数据流对应的与会者的会议组织角色, 以表示在会议组织 中的职责职务;
所述多媒体数据流对应的与会者的会议系统控制角色, 以表示在会议 控制中的权限职务。
8、 根据权利要求 6或 7所述的媒体接收装置, 其特征在于, 若一个 多媒体数据流对应多个与会者, 则所述一个多媒体数据流对应的与会者的 会议角色属性为:
所述多个与会者中优先级最高的与会者对应的会议角色属性。
9、 根据权利要求 6所述的媒体接收装置, 其特征在于, 所述媒体接 收装置还包括:
第二处理模块, 用于根据所述多媒体数据流对应的与会者的会议角色 属性, 选择多媒体数据流标识。
10、 根据权利要求 6所述的媒体接收装置, 其特征在于, 所述媒体接 收装置还包括:
第二处理模块, 用于向会议控制实体发送多媒体选择选项, 所述多媒 体选择选项包括所述第一接收模块接收的多媒体数据流的标识信息, 以及 每个多媒体数据流对应的与会者的会议角色属性; 接收所述会议控制实体 发送的根据所述与会者的会议角色属性选择的多媒体数据流标识。
11、 一种媒体提供装置, 其特征在于, 包括:
第二发送模块, 用于向媒体接收装置发送媒体宣告消息, 所述媒体宣 告消息携带所述媒体提供装置所能发送的多媒体数据流标识, 以及每个多 媒体数据流对应的与会者的会议角色属性;
第二接收模块, 用于接收所述媒体接收装置发送的媒体配置消息, 所 述媒体配置消息中携带根据所述多媒体数据流对应的与会者的会议角色 属性, 选择的多媒体数据流标识;
第三处理模块, 用于建立与所述媒体接收装置之间的媒体传输通道, 并通过所述媒体传输通道向所述媒体接收装置发送所述选择的多媒体数 据流标识对应的多媒体数据流。
12、 根据权利要求 11所述的媒体提供装置, 其特征在于, 所述多媒 体数据流对应的与会者的会议角色属性包括如下信息的一种或多种:
所述多媒体数据流对应的与会者的会议组织角色, 以表示在会议组织 中的职责职务;
所述多媒体数据流对应的与会者的会议系统控制角色, 表示在会议控 制中的权限职务。
13、 根据权利要求 11或 12所述的媒体提供装置, 其特征在于, 若一 个多媒体数据流对应多个与会者, 则所述一个多媒体数据流对应的与会者 的会议角色属性为:
所述多个与会者中优先级最高的与会者对应的会议角色属性。
14、 一种多媒体会议的建立系统, 其特征在于, 包括:
如权利要求 6-10任一项所述的媒体接收装置和如权利要求 11-13任一项 所述的媒体提供装置。
PCT/CN2014/078126 2013-07-08 2014-05-22 多媒体会议的建立方法、装置及系统 WO2015003532A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201310284623.1A CN104283857A (zh) 2013-07-08 2013-07-08 多媒体会议的建立方法、装置及系统
CN201310284623.1 2013-07-08

Publications (1)

Publication Number Publication Date
WO2015003532A1 true WO2015003532A1 (zh) 2015-01-15

Family

ID=52258342

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2014/078126 WO2015003532A1 (zh) 2013-07-08 2014-05-22 多媒体会议的建立方法、装置及系统

Country Status (2)

Country Link
CN (1) CN104283857A (zh)
WO (1) WO2015003532A1 (zh)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111711784A (zh) * 2020-06-15 2020-09-25 北京字节跳动网络技术有限公司 会议控制方法、装置、可读介质及电子设备
CN113206975A (zh) * 2021-04-29 2021-08-03 北京融讯科创技术有限公司 视频会议画面展示方法、装置、设备及存储介质
WO2023220095A1 (en) * 2022-05-10 2023-11-16 Apple Inc. Seamless continuation of communications sessions

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107453935B (zh) * 2016-05-31 2021-01-15 华为技术有限公司 回收会议资源的方法、装置及会议系统
CN109525792B (zh) * 2018-11-27 2022-04-22 平安科技(深圳)有限公司 会议录制管理方法及系统、终端和计算机可读存储介质
CN110213527A (zh) * 2019-07-08 2019-09-06 海能达通信股份有限公司 一种视频会话控制方法及用户端及服务器
WO2022252564A1 (zh) * 2021-05-31 2022-12-08 华为云计算技术有限公司 消息传输方法、装置及系统

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102137061A (zh) * 2010-01-22 2011-07-27 中兴通讯股份有限公司 多媒体会议观察指导方法及系统及下一代业务网络平台
CN102843542A (zh) * 2012-09-07 2012-12-26 华为技术有限公司 多流会议的媒体协商方法、设备和系统

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090164575A1 (en) * 2007-11-26 2009-06-25 Haivision Systems Inc. Method and system for the establishment of complex network telepresence conference
US8358328B2 (en) * 2008-11-20 2013-01-22 Cisco Technology, Inc. Multiple video camera processing for teleconferencing
US8471888B2 (en) * 2009-08-07 2013-06-25 Research In Motion Limited Methods and systems for mobile telepresence

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102137061A (zh) * 2010-01-22 2011-07-27 中兴通讯股份有限公司 多媒体会议观察指导方法及系统及下一代业务网络平台
CN102843542A (zh) * 2012-09-07 2012-12-26 华为技术有限公司 多流会议的媒体协商方法、设备和系统

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111711784A (zh) * 2020-06-15 2020-09-25 北京字节跳动网络技术有限公司 会议控制方法、装置、可读介质及电子设备
CN113206975A (zh) * 2021-04-29 2021-08-03 北京融讯科创技术有限公司 视频会议画面展示方法、装置、设备及存储介质
CN113206975B (zh) * 2021-04-29 2022-12-02 北京融讯科创技术有限公司 视频会议画面展示方法、装置、设备及存储介质
WO2023220095A1 (en) * 2022-05-10 2023-11-16 Apple Inc. Seamless continuation of communications sessions

Also Published As

Publication number Publication date
CN104283857A (zh) 2015-01-14

Similar Documents

Publication Publication Date Title
US11153533B2 (en) System and method for scalable media switching conferencing
US9024997B2 (en) Virtual presence via mobile
US8860776B2 (en) Conference terminal, conference server, conference system and data processing method
US9124765B2 (en) Method and apparatus for performing a video conference
US8830294B2 (en) Method and system for video conference control, videoconferencing network equipment, and videoconferencing site
WO2015003532A1 (zh) 多媒体会议的建立方法、装置及系统
US8531502B2 (en) Method, device and system for presenting virtual conference site of video conference
WO2011063763A1 (zh) 一种包含远程呈现会场的会议控制方法、装置及系统
WO2015154608A1 (zh) 一种视频会议资料共享方法、系统及装置
KR20140098573A (ko) 영상 회의 서비스 제공 장치 및 방법
US11882385B2 (en) System and method for scalable media switching conferencing
US9013537B2 (en) Method, device, and network systems for controlling multiple auxiliary streams
WO2014177082A1 (zh) 一种视频会议中处理视频的方法及终端
WO2016026336A1 (zh) 音频视频会议中的远程互动方法、系统及mcu
WO2016206471A1 (zh) 多媒体业务处理方法、系统及装置
US20200329083A1 (en) Video conference transmission method and apparatus, and mcu
WO2016045496A1 (zh) 一种媒体控制方法和设备
US11102451B2 (en) Videoconferencing server for providing multi-screen videoconferencing by using a plurality of videoconferencing terminals and method therefor
WO2014026478A1 (zh) 一种视频会议信号处理的方法、视频会议服务器及系统
WO2015018216A1 (zh) 多内容媒体通信方法、装置及系统
NO346416B1 (en) Method, computer program and system for configuring a multi-point video conferencing session

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 14822592

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 14822592

Country of ref document: EP

Kind code of ref document: A1