WO2012163075A1

WO2012163075A1 - Video conferencing processing method, apparatus and communication system

Info

Publication number: WO2012163075A1
Application number: PCT/CN2011/085112
Authority: WO
Inventors: 胡云; 梁维; 蔡亲飞
Original assignee: 华为技术有限公司
Priority date: 2011-12-31
Filing date: 2011-12-31
Publication date: 2012-12-06
Also published as: CN102893603A; CN102893603B

Abstract

A video conferencing processing method, comprising: receiving a conference initiation request sent by a conference initiator; establishing a conference according to the conference initiation request, and determining an endpoint grade list, the endpoint grade list comprising one or more endpoint grades, each endpoint grade corresponding to a group of audio and video parameters for defining the media format of an audio and video conversation; acquiring a media format set of a participating endpoint; negotiating the audio and video parameters according to the endpoint grade list and the media format set to determine the endpoint grades; and establishing a conference session with the participating endpoint according to the determined endpoint grades. Also correspondingly provided are a video conferencing processing method and a video conferencing system.

Description

Method, device and communication system for processing video

Technical field

The present invention relates to the field of communications technologies, and in particular, to a video conference processing method, apparatus, and communication system.

Background technique

With the rapid development of the global economy, video conferencing systems have become an essential tool for the daily work of businesses and individuals.

The video conferencing system interworks with the audio and video of each participant terminal through the media resource server (MRS, Media Resource Server), and processes the audio and video media of all participants, such as multi-party mixing, codec conversion and the like. In the same conference, when the terminal receiving the media stream and the peer terminal transmitting the media stream adopt different rates, or adopt different video protocols, the MRS needs to perform media stream conversion, and first decodes the media stream sent by the sender. The decoded media stream is re-encoded according to the protocol and rate of the receiver and sent to the receiver. This process is called rate or protocol adaptation. Each adaptation of a type of terminal will consume one adaptation resource, so if there are more terminal types, the more adaptive resources are consumed.

In order to save the adaptation resources, the types and media capabilities of the participating terminals are often limited in the prior art. However, with the development of economy and technology, the terminal types and media capabilities are also increasingly diversified, for terminal types and media. The ability to limit, obviously will greatly reduce the user experience, and is not conducive to expanding the applicability of the video conferencing system, how to allow more different types of terminals and terminals supporting different types of media capabilities to access the same video conference while Saving adaptive resources has become a concern.

Summary of the invention

The embodiment of the invention provides a method, a device and a communication system for processing a video conference, which can reduce the adaptation conversion of the media stream without limiting the terminal type and the media capability, so as to save the adaptation resource.

A method for processing a video conference, including:

Receiving a conference initiation request sent by the conference initiator;

Creating a conference according to the conference initiation request, and determining a terminal profile list, where the terminal profile list includes one or more terminal profiles, each terminal profile corresponding to a set of audio and video parameters for defining a media format of the audio and video call; Obtain a media format set of the participating terminal;

Performing audio and video parameter negotiation according to the terminal profile list and the media format set to determine a terminal profile;

Establish a conference call with the participating terminal according to the determined terminal level.

Optionally, the processing method of the video conference may further include:

Reserving an adaptation resource according to the terminal profile list;

During the conference call, the reserved adaptation resources are used to perform media adaptation conversion for interworking between different terminal grades.

A video conference processing device, including:

a receiving unit, configured to receive a conference initiation request sent by a conference initiator;

a processing unit, configured to create a conference according to the conference initiation request received by the receiving unit, and determine a terminal profile list, where the terminal profile list includes one or more terminal profiles, and each terminal profile corresponds to a group for defining an audio and video call. Audio and video parameters of the media format;

An obtaining unit, configured to obtain a media format set of the participating terminal;

a negotiation unit, configured to perform audio and video parameter negotiation according to the terminal file list determined by the processing unit and the media format set obtained by the acquiring unit, to determine a terminal level; and, optionally, the processing device of the video conference may further include a reservation a unit and an adaptation unit, configured to reserve an adaptation resource according to the terminal location list determined by the processing unit, and an adaptation unit, configured to use the reserved resource reserved by the reserved unit during the conference call Media adaptation conversion is performed by interworking between different terminal grades.

A video conferencing system includes any of the video conferencing processing devices provided by the embodiments of the present invention.

In the embodiment of the present invention, a corresponding terminal grade is set for each media format, and then the audio and video parameters are negotiated according to the terminal profile list and the media format set to determine the terminal grade, thereby requiring the participating terminal to adopt a certain media format to reduce The adaptation of the media stream is converted, and the media adaptation conversion is performed for the participant terminal that cannot adopt the same media format, thereby reducing the consumption of the adaptation resource as a whole. That is to say, with this solution, the media adaptation resources can be saved while the participating terminals ensuring various terminal types and media capabilities can access the same conference. DRAWINGS

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the embodiments or the description of the prior art will be briefly described below. Obviously, the drawings in the following description It is only some embodiments of the present invention, and those skilled in the art can obtain other drawings according to these drawings without any creative work.

1 is a flowchart of a method for processing a video conference according to an embodiment of the present invention;

FIG. 2 is a schematic diagram of a method for processing a video conference according to an embodiment of the present invention; FIG. 2 is another flowchart of a method for processing a video conference according to an embodiment of the present invention; FIG. Yet another flow chart of the processing method;

detailed description

BRIEF DESCRIPTION OF THE DRAWINGS The technical solutions in the embodiments of the present invention will be described in detail below with reference to the accompanying drawings. All other embodiments obtained by a person skilled in the art based on the embodiments of the present invention without creative efforts are within the scope of the present invention.

Embodiments of the present invention provide a method, an apparatus, and a communication system for processing a video conference. The following is a detailed description. Embodiment 1

This embodiment is described from the perspective of a processing device of a video conference, where the processing device of the video conference may include an application server (AS, Application Server) and a media resource server (MRS, Media Resource Server).

A method for processing a video conference, comprising: receiving a conference initiation request sent by a conference initiator; creating a conference according to the conference initiation request, and determining a terminal profile list, wherein the terminal profile list includes a terminal profile, and each terminal profile corresponds to a group And an audio and video parameter for defining a media format of the audio and video call; acquiring a media format set of the participant terminal; performing audio and video parameter negotiation according to the determined terminal profile list and the obtained media format set to determine a terminal level; The terminal level establishes a conference call with the participant terminal. Referring to Figure 1, the specific process can be as follows:

101. Receive a conference initiation request sent by a conference initiator.

For example, the scheduled conference initiation request or the immediate conference initiation module sent by the conference initiator may be specifically received. The conference initiation request may specify a terminal profile list used by the conference, or may also specify a participant terminal list to participate in the conference, that is, step 101 may adopt any one of the following methods:

(1) receiving a conference initiation request that is sent by the conference initiator and carrying the first indication information, where the first indication information indicates a terminal profile list used by the conference;

The terminal profile list includes at least one (ie, one or more) terminal profiles, each terminal profile corresponding to a set of audio and video parameters, such as voice codec, video codec, resolution, and bandwidth, and the parameters may be accurately The media format of the audio and video call is defined, that is, each terminal file corresponds to a set of audio and video parameters for defining a media format of the audio and video call.

It should be noted that the first indication information may include specific content of the terminal profile list, or may include only one first identifier. If the first identifier is included, the processing device of the video conference searches for the preset first correspondence table according to the first identifier, and obtains a corresponding terminal profile list; wherein, the first correspondence The correspondence between the first identifier and the terminal profile list is stored in the table.

(2) receiving a conference initiation request that is sent by the conference initiator and carrying the second indication information, where the second indication information indicates the participant terminal list that participates in the conference, that is, the second indication information indicates which terminals of the terminal participating in the conference have .

Of course, in addition to the two methods listed above, the terminal profile list may also be specified in other manners, and details are not described herein again.

In addition, since the video conference can have two video streams, one is the main video stream, which is used to display the participants, and the other is the secondary video stream, which is used to share the desktop, for example, sharing slides, etc., so, the terminal level list The primary video stream and the secondary video stream may also be specified separately. For example, a list of primary video stream terminal files of one or more terminals may be defined, and at the same time, a secondary video stream terminal file list of one or more terminals may be defined. ; Alternatively, you can define a list of terminal profiles that apply to the master at the same time. The video stream and the secondary video stream are not described here.

102. Create a conference according to the conference initiation request received in step 101, and determine a terminal profile list; for example, the specific information may be as follows:

(1) If the conference initiation request is carried in step 101, the conference initiation request is performed according to the conference initiation request, and the terminal profile list may be determined according to the conference initiation request. And determining a terminal profile list according to the first indication information.

For example, if the first indication information includes the specific content of the terminal profile list, the final identifier is directly determined, and after receiving the first identifier, the processing device of the video conference searches for the preset first correspondence according to the first identifier. a table, thereby obtaining a corresponding terminal profile list; wherein, the first correspondence table stores a correspondence between the first identifier and the terminal profile list.

(2) If the conference initiation request that carries the second indication information is received in step 101, the conference is created according to the conference initiation request, and the terminal profile list may be specifically determined to: create a conference according to the conference initiation request, and according to the The second indication information and the pre-stored media capabilities of the participating terminal calculate a terminal profile list. The media capability of the terminal, and then, after receiving the conference initiation request carrying the second indication information, automatically calculating the terminal profile list according to the second indication information and the media capability of the pre-stored participant terminal.

The method for reserving the resource according to the terminal location list determined in step 102 is as follows: Step 103 is optional. The method for reserving the resource allocation may be referred to the prior art, and details are not described herein. For example, if there are two terminal grades in the terminal profile list, then only one adapter resource needs to be reserved at this time. If there are three terminal grades in the terminal profile list, then the two-way adaptation resource needs to be reserved at this time. By analogy, and so on, of course, if there is only one terminal level in the terminal list, it means that all the media formats used by the terminals are the same. In this case, it is not necessary to reserve the adaptation resources, that is, the reserved adaptation resources are 0.

104. Obtain a media format set of the participating terminal.

For example, the call request of the participating conference initiated by the participant terminal may be received, where the call request of the conference participant carries the media format set of the conference terminal. Or,

If the terminal is invited to join the conference, the processing device of the video conference may send a call request for inviting the conference to the terminal, and after receiving the call request for the invitation to participate in the conference, the terminal returns corresponding In response to the message, the response message may carry the media format set of the terminal.

The media format set refers to a collection of media formats that the terminal can support, and the media format set can reflect the media capabilities of the terminal.

105. Perform audio and video parameter negotiation according to the terminal profile list determined in step 102 and the media format set obtained in step 104 to determine the terminal level; for example, the specifics may be as follows:

Matching the audio file parameters of the terminal profile list and the media format set. If they match, select the appropriate terminal profile from the matched terminal profiles according to the preset policy. For example, the terminal capable of providing the highest audio and video parameters may be selected. The grade (that is, the terminal grade of the best media effect) is used as the determined terminal grade; if it cannot match, the error prompt information is returned, so that after receiving the error prompt information, the terminal can prompt the user according to the error prompt information. So that users can handle it in time.

It should be noted that, if only the video capability negotiation fails between the conference terminal and the processing device of the video conference, the processing device of the video conference may allow the video terminal to join in a pure voice manner. Of course, pure voice may also be implemented in a specific implementation. As one of the terminal grades, the method can directly select the terminal grade.

If the determined terminal profile list and the obtained media format set cannot match, that is, if the media format set of the terminal cannot match any one of the terminal sessions, the processing device of the video conference may temporarily add one to the conference. A new terminal level is added, and corresponding adaptation resources are added for the new terminal level, thereby supporting the terminal to join the conference. That is, the processing method of the video conference can also include:

Add a terminal level to the terminal profile list according to the media format set, and add an adaptation resource for the added terminal class.

In addition, if there is a terminal level that is not used in the terminal file list supported by the conference during the conference (that is, the terminal that actually participates in the conference does not match the terminal grades), the processing device of the video conference may also The terminal level is temporarily deleted, and the corresponding adaptation resource is released, so that the occupation of the adaptation resource can be saved. That is, the processing method of the video conference may further include:

The terminal level that is not used in the terminal profile list is deleted, and the adaptation resource corresponding to the deleted terminal file is released.

106. Establish a conference call with the participant terminal according to the determined terminal level; for example, the specific information may be as follows: Since each terminal grade corresponds to a set of audio and video parameters, such as voice codec, video codec, resolution and bandwidth, these parameters can accurately define the media format of the audio and video call, so as long as the corresponding audio and video The parameters can be set up to hold a conference call with the participating terminal.

If the adaptation resource is reserved according to the determined terminal location list (step 103), optionally, in the process of the conference call, the reserved adaptation resource may also be used as the interworking between different terminal grades. Perform media adaptation conversion. That is, the method may further include step 107;

107. During the conference call, the reserved adaptation resource is used to perform media adaptation conversion for interworking between different terminal grades.

Since each terminal grade corresponds to a set of audio and video parameters for defining the media format of the audio and video call, if the terminal grades are different, it means that the media format of the audio and video call is different, so, for different terminal grades For the interworking, the media adaptation is required. The method for media adaptation conversion can be specifically referred to the prior art, and details are not described herein.

As can be seen from the above, in this embodiment, a corresponding terminal level is set for each media format, and then the audio and video parameters are negotiated according to the terminal file list and the media format set to determine the terminal level, thereby requiring the participating terminal to adopt a certain media format. In order to reduce the adaptation conversion of the media stream, the media adaptation conversion is performed for the participant terminal that cannot adopt the same media format, thereby reducing the consumption of the adaptation resource as a whole. That is to say, with this solution, the matching resources can be saved while the participating terminals ensuring various terminal types and media capabilities can access the same conference. According to the method described in the first embodiment, the processing device of the video conference, including the application server and the media resource server, will be described in detail in the second embodiment and the third embodiment. Embodiment 2

In this embodiment, the first indication information carried in the conference initiation request sent by the conference initiator is taken as an example for description. The first indication information indicates a list of terminal profiles used by the conference.

As shown in FIG. 2a, the figure is a schematic diagram of a scene of a video conference system. In the scenario diagram, the video conference system includes a processing device and a terminal of the video conference, where the processing device of the video conference may specifically include an application server and a media resource server, and the terminal may have multiple, for example, as shown in FIG. 2a, the terminal may be included. The media capabilities of each terminal may be as shown in Table 1, and the terminal B, the terminal C, the terminal D, and the terminal E. Media ability

Terminal name

Coding resolution bandwidth

H.264 1080p 8M

H.264 1080p 4M

Terminal A

H.264 720p 2M

H.264 720p 1M

H.264 1080p 8M

H.264 1080p 4M

Terminal B

H.264 720p 2M

H.264 720p 1M

H.264 4CIF 768K

Terminal C H.264 CIF 512K

H.264 CIF 384K

H.264 4CIF 768K

Terminal D H.264 CIF 512K

H.264 CIF 384K

H.264 CIF 512K

Terminal E H.263 CIF 384K

H.263 QCIF 128K

Terminal A and terminal B belong to a high definition terminal, terminal C and terminal D belong to a standard definition terminal, and terminal E belongs to a soft terminal. It should be noted that, under the premise of the same code, the terminal itself supports downward adaptation. For example, if the terminal supports H.264, if the terminal supports "H.264, 1080p, 8M", it means The terminal can also support "H.264, 1080p, 4M,," "H.264, 720p, 2M" and "H.264, 720p, 1M", etc. Therefore, in general, when representing the media capabilities of a terminal, Just write the highest supported media capabilities of the same code. It should be understood that Table 1 lists most media capabilities only for a clearer description.

The specific functions of each device in the video conference system can be as follows: (1) User: The registered user of the video conferencing system, including the administrators of the video conferencing system and the conference initiator. The administrator can define and maintain a list of terminal grades at the system level, enterprise level, and user level; the conference initiator can define and maintain a list of the terminal profiles of the user. The conference is initiated (2) The conference terminal: The terminal participating in the conference may be various types of voice terminals or video terminals, and usually supports multiple media formats, and supports media negotiation through signaling and peers during the call process. Establish a call based on the media negotiation result and the peer. Embodiments of the present invention may not require modifications to existing participating terminals. For example, terminal A, terminal B, terminal C, terminal D, and terminal E in FIG. 2a are participating terminals.

(3) Application Server (AS, Application Server): The application server of the video conferencing system can provide functions such as user management, conference management, resource scheduling, and conference control, and control the media resource server to provide media processing functions; the application server can also Each participant (including the participant terminal and the media resource server) performs session control and manages the conference call between the participant terminal and the media resource server. In the embodiment of the present invention, the application server increases the terminal level management function, stores the user-defined terminal file list, and controls the media resource server to access the conference terminal according to the specified terminal level.

(4) Media Resource Server (MRS): The media resource server of the video conferencing system provides media processing functions under the control of the application server, and supports adaptation conversion between multiple media formats, through signaling and participating terminals. Conduct media negotiation, establish a conference call with the participating terminal according to the negotiation result, and connect the terminal to the conference. In the embodiment of the present invention, the media resource server needs to increase the processing function of the terminal level. After receiving the terminal file list sent by the application server, the device reserves the matching resources according to the terminal file list, and according to the terminal file list and the participating terminal. Perform media negotiation and connect the participating terminal to the conference in a certain terminal level (that is, a media format).

The following describes the processing method of the video conference in the above application scenario by using the terminal A to send a conference initiation request, that is, the terminal A as the conference initiator. As shown in Figure 2b, the specific process can be as follows:

The conference initiator sends a conference initiation request to the application server to schedule a conference or initiate an immediate conference. The conference initiation request may carry the first indication information to specify a terminal profile list used by the conference. The terminal profile list includes at least one terminal profile, and each terminal profile corresponds to a set of audio and video parameters, such as voice codec, video codec, resolution, and bandwidth. These parameters can accurately define the media format of the audio and video call. That is, each terminal grade corresponds to a set of audio and video parameters for defining the media format of the audio and video call.

202. The application server invokes the media resource server to create a conference, and sends a list of terminal profiles specified by the conference initiator to the media resource server.

203. The media resource server creates a conference, and may reserve an adaptation resource of the conference according to the specified terminal profile list (that is, the media format list allowed in the conference).

Step 201 to step 203 are steps for initiating a conference.

204. The call request of the participating terminal to the application server, wherein the call request of the participating conference carries the media format set of the participating terminal.

The media format set refers to a set of media formats that the terminal can support, and may include one or more media formats, and the media format set may reflect the media capabilities of the terminal.

For example, the terminal B, the terminal C, the terminal D, and the terminal E can respectively send a call request to the application server to the application server, and carry the respective media format sets in the call requests of the participating conferences, that is, the conferences sent by the terminal A. The call request carries the media format set of the terminal A, and the call request of the conference sent by the terminal B carries the media format set of the terminal B, and the call request of the conference C sent by the terminal C carries the media format set of the terminal C, and the terminal The call request of the conference sent by D carries the media format set of the terminal D, the call request of the conference sent by the terminal E carries the media format set of the terminal E, and so on. The media capabilities of terminal A, terminal B, terminal C, terminal D, and terminal E can be seen in Table 1.

205. The application server obtains a media format set of the participant terminal from the call request of the conference, and initiates a call request for the conference to the media resource server, and transparently transmits the media format set of the terminal to the media resource server.

After the call request of the conference arrives at the media resource server, the media resource server obtains the media format set of the terminal from the call request of the conference, and performs media negotiation according to the obtained media format set and the terminal file list supported by the conference. The media negotiation results, for example, can be as follows: The media resource server matches the obtained media format set and the terminal file list supported by the conference to the audio and video parameters to determine the terminal level. If the media format set of the terminal can match, for example, the terminal format can be matched to multiple terminal files, the media resource The server selects a suitable terminal grade from the matched terminal grades according to the preset policy. For example, the terminal grade (ie, the terminal grade of the best media effect) in which the highest audio and video parameters can be provided may be preferentially selected as the determined terminal grade; If the match does not match, an error message is returned, so that after receiving the error message, the terminal can prompt the user according to the error message, so that the user can process in time.

For example, the terminal grades are classified into three types: "HD terminal", "standard definition terminal" and "soft terminal", and the media capabilities of these three terminal grades are defined as follows:

(1) HD terminal: Can support "H.264, 1080p, 8M,," "H.264, 1080p, 4M,,,

"H.264, 1080p, 2M" and "H.264, 1080p, 8M" four media formats;

(2) SD terminal: It can support "H.264, 4CIF, 768K,," "H.264, CIF, 512K" and "H.264, CIF, 384K" three media formats;

(3) Soft terminal: It can support "H.264, CIF, 512K,," "H.264, CIF, 384K" and "H.264, QCIF, 128K" three media formats.

Taking terminal C as an example, as shown in Table 1, terminal C can support three media formats: "H.264, 4CIF, 768K", "H.264, CIF, 512K" and "H.264, CIF, 384K", according to The above terminal format division shows that "H.264, CIF, 512K" and "H.264, CIF, 384K" match both "standard definition terminal" and "soft terminal", so it can be determined with the terminal. The matching terminal grades of C have "standard definition terminal" and "soft terminal". Since the media effect of "standard definition terminal" is better than "soft terminal", it is possible to select "standard definition terminal" as the terminal grade for terminal C.

For the same reason, it can be the same for other participating terminals, and will not be described here. The result of the negotiation may be a certain terminal level, which defines a certain media format supported by the terminal and the media resource server. The negotiation result may also be an error prompt message, indicating that the media format set of the terminal cannot match any terminal level supported by the conference.

208. The application server receives the media negotiation result returned by the media resource server, and transparently transmits the media negotiation result to the conference terminal. 209. After receiving the media negotiation result returned by the application server, the participant terminal performs subsequent operations according to the media negotiation result, for example, as follows:

If a certain terminal level is specified in the media negotiation result, the conference call is established according to the specified terminal level, that is, the participant terminal joins the conference.

If the media negotiation result returned by the conference system includes an error message, the terminal prompts the user for subsequent operations, such as re-initiating a call request to participate in the conference, and the like.

Steps 204 to 209 are steps to participate in the initiation of the conference.

210. During the conference call, the media resource server only needs to use the reserved adaptation resources to perform media adaptation conversion for interworking between different terminal grades.

It should be noted that, in the process of the conference, the conference initiator may also add or delete the terminal level in the conference. After the terminal grade is added or deleted, the application server sends the added or deleted terminal grade to the media resource server. The corresponding media adaptation resource is added or deleted by the media resource server for the added or deleted terminal level.

As can be seen from the above, in this embodiment, the corresponding terminal level is set for each media format. When the conference initiator initiates the conference, the terminal profile list used by the conference is specified, and then the audio and video parameter negotiation is performed according to the terminal profile list and the media format set. To determine the terminal level, the participant terminal is required to adopt a certain media format to reduce the adaptation conversion of the media stream, and the media adaptation conversion is performed for the participant terminal that cannot use the same media format, thereby reducing the overall. Adaptation resource consumption. That is to say, with this solution, for different types of terminals, as long as their media capabilities are the same or overlap, the same conference format can be added to the same conference, thereby effectively controlling the media format type in the conference, and reducing the appropriate The consumption of resources. Embodiment 3

In the second embodiment, the terminal level is mainly specified by the conference initiator. Optionally, the terminal level may also be specified by other methods, such as the processing capability of the video conference according to the second indication information and the media capacity of the pre-stored participant terminal. Calculated, and so on.

In this embodiment, the processing method of the video conference in the application scenario of the implementation scenario 2 is described by taking the terminal information as the example of the second indication information and the media capacity of the pre-stored participant terminal as an example. . Referring to Figure 3, the specific process can be as follows:

301. The conference initiator sends a conference initiation request to the application server through terminal A to schedule a conference or initiate an immediate conference. The conference initiation request carries the second indication information, where the indication participates in the conference terminal list of the conference, that is, the second indication information indicates which terminals of the terminal participating in the conference have.

302. The application server invokes the media resource server to create a conference, and calculates a terminal profile list according to the second indication information and the media capability of the pre-stored participant terminal, and delivers the terminal profile list specified by the conference initiator to the media resource server.

The application server records the media capabilities of all video terminals in the video conference system, for example, the information shown in Table 1 (see Table 1 in Embodiment 2), and the like. In this way, when the application server learns the terminal participating in the conference, the media capability of the corresponding terminal can be found, and the corresponding terminal profile list is obtained according to the correspondence between the media capability and the terminal grade.

It should be noted that, in this embodiment, the system administrator or other administrators may pre-define and maintain the terminal level. When the conference initiator initiates the conference, the video conference system automatically invokes the preset terminal profile setting information. .

303. The media resource server creates a conference, and reserves an adaptation resource of the conference according to the specified terminal profile list (that is, the media format list allowed in the conference).

Steps 301 to 303 are steps for initiating a conference.

304. A call request for the conference to be initiated by the participant terminal to the application server, where the call request of the conference participant carries the media format set of the conference terminal.

For example, the terminal B, the terminal C, the terminal D, and the terminal E can separately send a call request to the application server to the application server, and carry the respective media format set in the call request of the participating conference, that is, the terminal The call request of the conference sent by the terminal A carries the media format set of the terminal A. The call request of the conference B sent by the terminal B carries the media format set of the terminal B, and the call request sent by the terminal C is carried in the call request of the conference. The media format set of the terminal C, the call request of the terminal D sent by the terminal D carries the media format set of the terminal D, the call request of the terminal E sent by the terminal E carries the media format set of the terminal E, and so on, etc. Wait. For the media capabilities of the terminal A, the terminal B, the terminal C, the terminal D, and the terminal E, refer to Table 1 (Table 1 in Embodiment 2).

305. The application server obtains a media format set of the participant terminal from the call request of the conference, and initiates a call request for the conference to the media resource server, and transparently transmits the media format set of the terminal to the media resource server.

306. After the call request of the conference reaches the media resource server, the media resource server obtains the media format set of the terminal from the call request of the conference, and performs media negotiation according to the obtained media format set and the terminal profile list supported by the conference. The audio and video parameters are negotiated, and the media negotiation result is obtained. For example, the specifics may be as follows:

The media resource server matches the obtained media format set and the terminal file list supported by the conference to the audio and video parameters to determine the terminal level. If the media format set of the terminal can match, for example, the terminal format can be matched to multiple terminal files, the media resource The server selects a suitable terminal grade from the matched terminal grades according to a preset policy (which can be set according to the requirements of the actual application). For example, the terminal grade in which the highest audio and video parameters can be provided can be preferentially selected (ie, The terminal level of the best media effect is determined as the terminal level; if it cannot be matched, the error prompt information is returned, so that after receiving the error prompt information, the terminal can prompt the user according to the error prompt information, so that the user Handle in time.

(1) HD terminal: Can support "H.264, 1080p, 8M,," "H.264, 1080p, 4M,," "H.264, 1080p, 2M" and "H.264, 1080p, 8M" Media format

(3) Soft terminal: can support "H.264, CIF, 512K,,, "H.264, CIF, 384K" and "H.264, QCIF, 128K" three media formats.

Taking terminal C as an example, as shown in Table 1, terminal C can support three media formats: "H.264, 4CIF, 768K", "Η.264, CIF, 512K" and "H.264, CIF, 384", according to According to the above terminal format division, "H.264, CIF, 512K" and "H.264, CIF, 384Κ" are matched with "standard definition terminal" and "soft terminal", so it can be determined with the terminal. The matching terminal grades of C have "standard definition terminal" and "soft terminal". Since the media effect of "standard definition terminal" is better than "soft terminal", it is possible to select "standard definition terminal" as the terminal grade for terminal C.

For the same reason, the same is true for other participating terminals, and will not be described here. The result of the negotiation may be a certain terminal level, which defines a certain media format supported by the terminal and the media resource server. The negotiation result may also be an error prompt message, indicating that the media format set of the terminal cannot match any terminal level supported by the conference.

308. The application server receives the media negotiation result returned by the media resource server, and transparently transmits the media negotiation result to the conference terminal.

309. After receiving the media negotiation result returned by the application server, the participant terminal performs subsequent operations according to the media negotiation result, for example, as follows:

If the media negotiation result returned by the conference system contains an error message, the terminal prompts the user.

Steps 304 to 309 are steps to participate in the conference.

310. During the conference call, the media resource server only needs to use the reserved adaptation resources to perform media adaptation conversion for interworking between different terminal grades.

As can be seen from the above, this embodiment adopts a corresponding terminal level for each media format, when the conference When the initiator initiates the conference, the terminal used by the conference is specified, and the application server calculates the terminal profile list according to the media capabilities of the specified terminal and the pre-stored terminal, and then the media resource server performs audio and video parameter negotiation according to the terminal profile list and the media format set. To determine the terminal level, the participant terminal is required to adopt a certain media format to reduce the adaptation conversion of the media stream, and the media adaptation conversion is performed for the participant terminal that cannot use the same media format, thereby reducing the overall. Adaptation resource consumption. That is to say, with this solution, for different types of terminals, as long as their media capabilities are the same or overlap, the same conference format can be added to the same conference, thereby effectively controlling the media format type in the conference, and reducing the appropriate The consumption of resources. Embodiment 4

In order to better implement the above method, the embodiment of the present invention further provides a processing device for a video conference. As shown in FIG. 4a, the processing device of the video conference may include a receiving unit 401, a processing unit 402, and an obtaining unit 404. Negotiation unit 405 and establishment unit 406.

The receiving unit 401 is configured to receive a conference initiation request sent by the conference initiator.

For example, the receiving unit 401 may specifically receive a scheduled conference initiation request or an immediate conference initiation request sent by the conference initiator. The receiving conference initiator may specifically be a conference initiating module in a processing device of the terminal or the video conference.

The processing unit 402 is configured to create a conference according to the conference initiation request received by the receiving unit 401, and determine a terminal profile list; where the terminal profile list includes one or more (ie, at least one) terminal profiles, and each terminal profile corresponds to a group Audio and video parameters used to define the media format of audio and video calls, such as voice codec, video codec, resolution and bandwidth;

The obtaining unit 404 is configured to obtain a media format set of the participating terminal.

For example, the obtaining unit 404 may specifically receive a call request of the participating conference initiated by the participant terminal, where the call request carries the media format set of the participating terminal; or sends a call request to the participating terminal to participate in the conference, and receives the return request from the conference terminal. a response message, where the response message carries a media format set of the participating terminal;

The negotiating unit 405 is configured to obtain the terminal file list and the obtaining unit 404 according to the processing unit 402. Acquiring the audio and video parameters of the obtained media format set to determine the terminal level;

For example, the negotiating unit 405 may specifically match the terminal profile list and the audio and video parameters of the media format set; if it can match, select a suitable terminal profile from the matched terminal profiles according to the preset policy, for example, from matching. The terminal level is selected to provide the highest audio and video parameters of the terminal level (ie, the terminal level of the best media effect); if it cannot be matched, an error message is returned.

It should be noted that, if only the video capability negotiation fails between the conference terminal and the processing device of the video conference, the processing device of the video conference may allow the video terminal to join in a pure voice manner. Of course, pure voice may also be implemented in a specific implementation. Method as one of the terminal grades, then negotiate the unit

405 directly select the terminal grade.

The establishing unit 406 is configured to establish a conference call with the participating terminal according to the terminal level determined by the negotiating unit 405.

Since each terminal grade corresponds to a set of audio and video parameters, such as voice codec, video codec, resolution and bandwidth, these parameters can accurately define the media format of the audio and video call, so as long as the corresponding audio and video The parameter attending terminal can establish a conference call.

Optionally, as shown in FIG. 4b, the processing device of the video conference may further include a reservation unit 403 and an adaptation unit 407;

The reservation unit 403 is configured to reserve an adaptation resource according to the terminal location list determined by the processing unit 402. The method for reserving the adaptation resource may be referred to the prior art, and details are not described herein. For example, if there are two terminal grades in the terminal profile list, then only one adapter resource needs to be reserved at this time. If there are three terminal grades in the terminal profile list, then three adapter resources need to be reserved at this time. By analogy, and so on, of course, if there is only one terminal level in the terminal list, it means that all the media formats used by the terminals are the same. In this case, it is not necessary to reserve the adaptation resources, that is, the reserved adaptation resources are 0.

The adapting unit 407 is configured to perform media adaptation conversion for interworking between different terminal grades by using the adaptation resource reserved by the reservation unit 403 during the conference call.

Since each terminal grade corresponds to a set of audio and video parameters for defining the media format of the audio and video call, if the terminal grades are different, it means that the media format of the audio and video call is different, so, for different terminal grades For the interworking, the media adaptation is required. The method for media adaptation conversion can be specifically referred to the prior art, and details are not described herein. Fixed, ie:

The receiving unit 401 is specifically configured to receive a conference initiation request that is sent by the conference initiator and that carries the first indication information, where the first indication information indicates a terminal profile list used by the conference;

Then, the processing unit 402 is specifically configured to create a conference according to the conference initiation request received by the receiving unit 401, and determine a terminal profile list according to the first indication information.

It should be noted that the first indication information may include specific content of the terminal profile list, or may include only one first identifier. If the first identifier is included, the processing device of the video conference searches for the preset first correspondence table according to the first identifier, and obtains a corresponding terminal profile list; wherein, the first correspondence The correspondence between the first identifier and the terminal profile list is stored in the table. The end-level list may also be specified in other manners, for example, the conference initiator specifies the list of participating terminals participating in the conference, and then the processing device of the video conference calculates the terminal-level list according to the participant terminal list and the media capabilities of the pre-stored terminal. , which is:

The receiving unit 401 is specifically configured to receive a conference initiation request that is sent by the conference initiator and that carries the second indication information, where the second indication information indicates the participant terminal list that participates in the conference;

At this time, the processing unit 402 is specifically configured to create a conference according to the conference initiation request received by the receiving unit 401, and calculate a terminal profile list according to the second indication information and the media capacity of the pre-stored participant terminal.

In addition, since the video conference can have two video streams, one is the main video stream, which is used to display the participants, and the other is the secondary video stream, which is used to share the desktop, for example, sharing slides, etc., so, the terminal level list The primary video stream and the secondary video stream may also be specified separately. For example, a list of primary video stream terminal files of one or more terminals may be defined, and at the same time, a secondary video stream terminal file list of one or more terminals may also be defined. Alternatively, a terminal list may be defined for both the primary video stream and the secondary video stream, and details are not described herein.

In addition, if the determined terminal profile list and the obtained media format set cannot match, that is, if the media format set of the terminal cannot match any one of the terminal segments in the conference, the video conference The processing device can temporarily add a new terminal level to the conference, and add corresponding adaptation resources for the new terminal level, thereby supporting the terminal to join the conference. That is, the processing device of the video conference may further include an adding unit;

And an adding unit, configured to add a terminal level in the terminal file list according to the media format set, and add an adaptation resource for the added terminal level.

Similarly, if there is a terminal level that is not used in the terminal file list supported by the conference during the conference (that is, the terminal that actually participates in the conference does not match the terminal grades), the processing device of the video conference also The terminal level can be temporarily deleted, and the corresponding adaptation resource is released, so that the occupation of the adaptation resource can be saved. That is, the processing device of the video conference may further include a deleting unit, and the deleting unit is configured to delete the terminal level that is not used in the terminal file list, and release the matching resource corresponding to the deleted terminal file.

It should be noted that, in a specific implementation, the foregoing units may be implemented as a separate entity, or may be implemented in any combination, and implemented as the same entity or multiple entities. For example, the processing device of the video conference may specifically include an application server. AS, Application Server and Media Resource Server (MRS). For the implementation of the above, refer to the previous embodiments, and details are not described herein.

It can be seen that the processing device of the video conference in this embodiment uses the frequency parameter negotiation for each media format to determine the terminal level, thereby requiring the participating terminal to adopt a certain media format to reduce the adaptation of the media stream. For the participant terminal that cannot adopt the same media format, the adaptation unit 407 performs media adaptation conversion, thereby reducing the consumption of the adaptation resource as a whole. That is to say, with this solution, for different types of terminals, as long as their media capabilities are the same or overlap, the same conference format can be added to the same conference, thereby effectively controlling the media format type in the conference, and reducing the appropriate The consumption of resources. Embodiment 5

Correspondingly, the embodiment of the present invention further provides a video conference system, including any video conference processing device provided by the embodiment of the present invention, where the processing device of the video conference can be specifically referred to the fourth embodiment, and is not in jtb. Let me repeat. In addition, the video conference system may further include a terminal;

The terminal is configured to send a call request to the conference to the processing device of the video conference, and receive the terminal grade sent by the processing device of the video conference, and establish a conference call with the processing device of the video conference according to the terminal grade.

The call request of the conference device that is sent by the terminal to the processing device of the video conference may carry the media format set of the conference terminal. Of course, if the media format set of each terminal in the video conference system has been saved in the processing device of the video conference, In this case, the media format set of the participating terminal may not be carried, but the processing device of the video conference may directly obtain the corresponding media format set according to the pre-stored media format of the participating terminal.

The specific implementation of the above various devices may participate in the foregoing embodiments, and details are not described herein again.

As can be seen from the above, the video conference system of the embodiment adopts a terminal class for each media format, and then determines the terminal level by performing audio and video parameter negotiation according to the terminal profile list and the media format set, thereby requesting the participant terminal to adopt a certain terminal. A media format is used to reduce the adaptation of the media stream, and the media adaptation is performed for the participant terminal that cannot use the same media format, thereby reducing the consumption of the adaptation resource as a whole. That is to say, the solution can save media adaptation resources while ensuring that all terminal types and media capabilities of the participating terminals can access the same conference. A person skilled in the art may understand that all or part of the various steps of the foregoing embodiments may be completed by a program instructing related hardware. The program may be stored in a computer readable storage medium, and the storage medium may include: Read only memory (ROM, Read Only Memory), random access memory (RAM), disk or optical disk.

The foregoing description of the method, apparatus, and communication system for video conferencing provided by the embodiments of the present invention is merely for facilitating understanding of the method and core idea of the present invention. Meanwhile, for those skilled in the art, The present invention is not limited by the scope of the present invention.

Claims

Rights request

A method for processing a video conference, comprising:

Receiving a conference initiation request sent by the conference initiator;

And creating a conference according to the conference initiation request, and determining a terminal profile list, where the terminal profile list includes one or more terminal profiles, each terminal profile corresponding to a set of audio and video parameters for defining a media format of the audio and video call;

Obtain a media format set of the participating terminal;

2. The method of claim 1 wherein

The receiving the conference initiation request sent by the conference initiator is specifically: receiving a conference initiation request that is sent by the conference initiator and carrying the first indication information, where the first indication information indicates a terminal profile list used by the conference;

Then, the conference is created according to the conference initiation request, and the terminal profile list is specifically determined to: create a conference according to the conference initiation request, and determine a terminal profile list according to the first indication information.

3. The method of claim 1 wherein:

The receiving the conference initiation request sent by the conference initiator is specifically: receiving a conference initiation request that is sent by the conference initiator and carrying the second indication information, where the second indication information indicates a participant terminal list that participates in the conference;

And the determining the terminal profile list according to the conference initiation request, and determining that the terminal profile list is: creating a conference according to the conference initiation request, and calculating a terminal profile list according to the second indication information and the pre-stored media capability of the participant terminal.

The method according to any one of claims 1 to 3, wherein the obtaining a media format set of the conference terminal comprises:

Receiving a call request of the participating conference initiated by the participant terminal, where the call request carries the media format set of the participating terminal; or

Sending a call request to the participant terminal to participate in the conference, and receiving a response message returned by the participant terminal, where the response message carries the media format set of the participant terminal.

The method according to any one of claims 1 to 3, further comprising: reserving an adaptation resource according to the terminal profile list;

The method according to any one of claims 1 to 3, wherein the audio and video parameter negotiation is performed according to the terminal file list and the media format set to determine the terminal level, including: Matching audio and video parameters of the media format set;

If it can match, select the terminal grade that can provide the highest audio and video parameters from the matched terminal grades;

If it does not match, an error message is returned.

The method according to claim 6, wherein if the terminal profile list and the media format set cannot match, the method further includes:

Adding a terminal level to the terminal file list according to the media format set, and

Add adaptive resources for the new terminal level.

The method according to claim 6, wherein the method further comprises: deleting a terminal level that is not used in the terminal profile list, and releasing the adaptation resource corresponding to the deleted terminal file.

A processing device for a video conference, comprising:

a negotiating unit, configured to perform audio and video parameter negotiation according to the terminal profile list determined by the processing unit and the media format set obtained by the acquiring unit, to determine a terminal level;

The processing device of the video conference according to claim 9, wherein the receiving unit is configured to receive a conference initiation request that is sent by the conference initiator and that carries the first indication information, where the first indication information indicates a list of terminal grades used in this meeting; The processing unit is specifically configured to create a conference according to the conference initiation request received by the receiving unit, and determine a terminal profile list according to the first indication information.

The device for processing a video conference according to claim 9, wherein the receiving unit is configured to receive a conference initiation request that is sent by the conference initiator and that carries the second indication information, where the second indication information is A list of participating terminals participating in this meeting;

The processing unit is specifically configured to create a conference according to the conference initiation request received by the receiving unit, and calculate a terminal profile list according to the second indication information and the media capacity of the pre-stored participant terminal.

The processing device for a video conference according to any one of claims 9 to 11, characterized in that

The acquiring unit is configured to receive a call request of the participating conference initiated by the participant terminal, where the call request carries the media format set of the participating terminal; or, sends a call request to the participating terminal to participate in the conference, and receives a response message returned by the participant terminal. The response message carries a media format set of the participant terminal.

The processing device for a video conference according to any one of claims 9 to 11, further comprising a reservation unit and an adaptation unit;

a reservation unit, configured to reserve an adaptation resource according to the terminal location list determined by the processing unit; and an adaptation unit, configured to use the reserved resource reserved by the reservation unit to be between different terminal levels during the conference call Interworking for media adaptation conversion.

The negotiating unit is specifically configured to match the audio and video parameters of the terminal profile list and the media format set; if matched, select a terminal profile that can provide the highest audio and video parameters from the matched terminal profiles; if not, Then an error message is returned.

The processing device for a video conference according to claim 14, further comprising a booster unit;

The adding unit is configured to add a terminal file to the terminal file list according to the media format set, and add an adaptation resource for the added terminal class.

The processing device for a video conference according to claim 14, further comprising Delete unit

The deleting unit is configured to delete a terminal level that is not used in the terminal file list, and release an adaptation resource corresponding to the deleted terminal file.

A video conferencing system comprising the processing device of any of the video conferences of claims 9 to 16.