WO2010037293A1

WO2010037293A1 - Method and system for improving quality of multimedia calls, media controlling equipment and media processing equipment

Info

Publication number: WO2010037293A1
Application number: PCT/CN2009/073618
Authority: WO
Inventors: 唐廷芳; 许志勇
Original assignee: 华为技术有限公司
Priority date: 2008-09-28
Filing date: 2009-08-28
Publication date: 2010-04-08
Also published as: CN101686178B; CN101686178A

Abstract

The invention discloses a method and system for improving the quality of multimedia calls, and a media controlling equipment and media processing equipment. In one group of the embodiments, the media controlling equipment compares the parameters in the quality information feedback with the corresponding parameters in the current session, and notifies the transcoder in the media processing equipment to adjust the media data dynamically, or instructs the media processing equipment, by extending the H.248 instruction message of the media controlling equipment, to send the quality extended messages to adjust the media data dynamically, so as to improve the quality of the multimedia calls. In another group of the embodiments, in the process of participating in coding, decoding and transmitting the media data, the media processing equipment detects the quality of the media data transmitted by the media data transmitter dynamically and notifies the quality problem information to the media controlling equipment when the quality declines, and then the media controlling equipment communicates with the media data transmitter, so as to adjust the media data transmitted by the media data transmitter.

Description

Method and system for improving multimedia call quality, media control device and media processing device

The present invention relates to the field of mobile communication technologies, and in particular, to a method and system for improving multimedia call quality, a media control device, and a media processing device. Background technique

A multimedia communication system refers to a network system capable of providing multimedia sessions, such as audio and video communication. There are a variety of multimedia communication systems, including H.324 networks using H.324, H.245, H.223, etc.; H.323, H.225.0. H.245, real-time transport protocol (Real-time Transport) Protocol, hereinafter referred to as RTP) / Real-time Transport Control Protocol (RTCP) protocol, H.323 network; Session Initiation Protocol (SIP), Session Description Protocol (Session) Description Protocol, hereinafter referred to as SDP, RTP/RTCP, etc. IP Multimedia Subsystem (IMS) network, etc.

The interworking between different multimedia communication systems requires the interworking of signaling and media. The separation architecture is generally completed by the media control device and the media processing device. In different networks, the entities that are the media control device and the media processing device are not identical. For example, the media control device may be a media gateway controller (MGC), a mobile switching center server, a media gateway control function, a media resource function control, etc.; the media processing device may be a media gateway (Media Gateway, hereinafter referred to as MGW), IP multimedia-media gateway, media resource function processing, etc. In this paper, MGC and MGW are unified as the collective name of media control equipment and media processing equipment. The media control device mainly bears the processing of signaling, and the media processing device mainly bears the processing of the media bearer.

Currently, in the 3GPP MTSI (IMS Multimedia Telephony) standard, a dynamic rate adaptation mechanism is being introduced to improve the call quality of multimedia phones under IMS. By between two multimedia terminals Add some in-band feedback mechanism to dynamically adjust the call quality of the multimedia phone. It mainly expands the feedback of bandwidth information, frame rate and video image balance, video buffer information and average receiving rate.

In the existing 3GPP TS 26.114, a rate adaptation method in a media terminal call in a different network is given. For example, the IMS network side and the circuit switching (Circuit Switch, hereinafter referred to as CS) network side media terminal interaction as an example, as shown in FIG. 1 , the IMS network side to the CS network side rate adaptation diagram, the IMS network side to the CS network side The process of eliminating the jitter buffer is: When the data sent by the IMS network side is not stable enough, and the buffer of the MGW overflows, the MGW will drop the data packet and send the RTCP reception report to the IMS multimedia terminal (Received) Report, referred to as RR) message, informs the IMS multimedia terminal that the data packet has been lost, and the IMS multimedia terminal takes further measures to eliminate the jitter. The IMS multimedia terminal can initiate a codec renegotiation process to modify the codec and select Small bandwidth encoding ensures data transfer quality.

However, in the process of eliminating the jitter buffer from the CS network side to the IMS network side, when the data sent from the CS network side is not stable enough, the buffer overflows, or the MGW detects that the data from the CS network side is lost. In the case of the packet, the H.245 message is terminated in the MGC, and the MGC cannot obtain the media data quality information detected by the MGW. Therefore, in the above scenario, the corresponding H.245 message cannot be triggered by the MGC, and the flow control information is The H.324 multimedia terminal on the CS network side is fed back, so that the H.324 multimedia terminal cannot process the jitter buffer.

However, in the existing 3GPP TS 29.163, flow control initiated by the CS network side H.324 multimedia terminal is defined. For example, when the H.324 multimedia terminal moves in a wireless environment, such as a bad wireless signal, the H.324 multimedia terminal will receive a notification of reduced bearer capability, and the H.324 multimedia terminal will initiate an H.245 flow control command. The MGC and the MGW are notified that the bandwidth is reduced. The MGC closes the old logical channel according to the flow control command, re-encodes the negotiation, and then opens the new bearer channel.

However, in this method, when the H.324 multimedia terminal initiates flow control, only the renegotiation of the codec can be triggered. However, in most cases where flow control is required, there is no need to change the codec. It may only need to renegotiate the bandwidth or update the codec rate or the same codec mode. Know that the IMS multimedia terminal can be adjusted. It can be seen that the flow control process initiated by the H.324 multimedia terminal cannot implement a flow control process other than codec renegotiation. Summary of the invention

The embodiments of the present invention provide a method and system for improving multimedia call quality, and a media control and processing device, so as to implement multiple flow control modes when a multimedia terminal initiates flow control, thereby improving call quality of the multimedia terminal.

The embodiment of the present invention further provides a method and system for improving multimedia call quality, a media control device, and a media processing device, to detect media data quality sent by the multimedia terminal, and trigger quality information to be fed back to the multimedia terminal to improve the call of the multimedia terminal. quality.

The embodiment of the invention provides a method for improving multimedia call quality, including:

Receiving quality information feedback sent by the first multimedia terminal;

And indicating, according to the quality information feedback, the media source to adjust media data sent to the first multimedia terminal.

The embodiment of the invention provides a media control device, including:

a first receiving module, configured to receive quality information feedback sent by the first multimedia terminal, where the quality information includes a maximum bandwidth request, a frame rate and an image resolution trade-off ratio request, a packet loss rate information, and a buffer information. At least one

The first indication module is configured to: according to the quality information feedback, instruct the media source to adjust media data sent to the first multimedia terminal, where the media source is a media processing device or a second multimedia terminal.

The embodiment of the invention provides a media processing device, including:

a transcoder, configured to adjust media data sent to the first multimedia terminal according to the notification of the media control device; and/or

a conversion module, configured to: when receiving the H.248 indication message sent by the media control device, construct a quality extension message according to the parameter in the H.248 indication message and send the message to the second multimedia Body terminal.

An embodiment of the present invention provides a system for improving a multimedia call quality, including a first multimedia terminal and a second multimedia terminal, and further includes:

a media control device, configured to send a notification, an indication, or trigger renegotiation according to the quality information sent by the first multimedia terminal, to adjust media data sent to the first multimedia terminal; And configured to adjust or instruct the second multimedia terminal to adjust media data sent to the first multimedia terminal according to the notification or indication sent by the media control device.

Instructing the media processing device to detect media data sent by the media data sender and determining parameters for detecting the media data;

Receiving quality information reported by the media processing device;

And according to the quality information, the media data sender is instructed to adjust the media data sent by the media data sender.

The embodiment of the invention provides a media control device, including:

a second indication module, configured to instruct the media processing device to detect media data sent by the media data sender, and determine a parameter used to detect the media data;

a second receiving module, configured to receive quality information reported by the media processing device;

And a third indication module, configured to instruct the media data sender to adjust the media data sent by the media data sender according to the quality information.

The embodiment of the invention provides a media processing device, including:

a calculating module, configured to calculate, according to a parameter of the detected media data determined by the media control device, in the process of receiving the media data;

The reporting module is configured to report the calculated quality information to the media control device when the calculation finds that the media data cannot be adjusted by itself.

The embodiment of the invention provides a system for improving multimedia call quality, including:

The sender of the media data is used to send the media data, and triggers the media according to the received feedback information. Re-negotiation of body control equipment;

a media processing device, configured to detect media data sent by the media data sender, and adjust a quality of the media data, and if the media data cannot be adjusted by itself, the calculated quality information is Reporting to the media control device;

a media control device, configured to instruct the media processing device to detect media data sent by the media data sender, determine a parameter used to detect the media data, and receive quality information reported by the media processing device, and according to the quality Information indicating the media data sender to adjust the media data sent by the media data sender.

According to the foregoing technical solution, the method and system for improving multimedia call quality, the media control device, and the media processing device in the embodiment of the present invention may compare the parameter in the quality information feedback with the corresponding parameter in the current session by using the media control device, and further Notifying the transcoder in the media processing device to dynamically adjust the media data, or dynamically adjusting the media data by triggering negotiation between the media control device and the multimedia terminal, or by extending the H.248 indication message between the media control device and the media processing device, The media control device instructs the media processing device to send the quality extension message to dynamically adjust the media data, thereby improving the quality of the multimedia call. The media processing device can also dynamically detect the source of the media during the process of participating in the codec and the media transmission. The quality of the media data, and when the quality is degraded, the quality control information is notified to the media control device, and the media control device interacts with the media source to adjust the media data sent by the media source. DRAWINGS

1 is a schematic diagram of rate adaptation of a IMS network side to a CS network side; FIG. 2A is a schematic diagram of a message format of a TMMBR according to an embodiment of the present invention;

2B is a schematic diagram of a message format of a TSTR according to an embodiment of the present invention;

3 is a schematic structural diagram of an interworking network of a multimedia terminal according to an embodiment of the present invention;

4 is a schematic flowchart of Embodiment 1 of a method for improving multimedia call quality according to the present invention;

FIG. 5 is a signaling flowchart of Embodiment 2 of a method for improving multimedia call quality according to the present invention; FIG. 6 is another signaling flowchart of Embodiment 2 of the method for improving multimedia call quality according to the present invention; FIG. 7 is still another signaling flowchart of Embodiment 2 of the method for improving multimedia call quality according to the present invention; FIG. 9 is a schematic structural diagram of Embodiment 1 of a media control device according to the present invention;

FIG. 10 is a schematic structural diagram of Embodiment 1 of a media processing device according to the present invention;

FIG. 11 is a schematic structural diagram of Embodiment 1 of a method for improving multimedia call quality according to the present invention; FIG. 12 is a schematic flowchart of Embodiment 4 of a method for improving multimedia call quality according to the present invention; 14 is a schematic structural diagram of Embodiment 2 of a media control device according to the present invention;

15 is a schematic structural diagram of Embodiment 2 of a media processing device according to the present invention;

FIG. 16 is a schematic structural diagram of Embodiment 2 of a system for improving multimedia call quality according to the present invention. detailed description

The present invention will be further described in detail below by way of specific embodiments and drawings.

First, the protocol used in the embodiment of the present invention is briefly introduced as follows.

The H.248 protocol is defined by the ITU-T SG16 standard organization and is dedicated to media resource control protocols. The parameters with business relevance can be logically aggregated into a package, which is a method of extending the protocol functions provided by the H.248 protocol. The H.248 protocol extends the functionality of the protocol through the package, adding new functions to the protocol. Generally, there is no need to modify the protocol ontology, but only a new package. A package can be thought of as a package of independent features. When the media processing device claims to support the package, it supports this feature. The media control device can use the attributes, events, signals, statistics defined in the package. The media resources on the media processing device are operated to implement corresponding business logic.

The H.245 protocol is a control protocol for multimedia communications developed by ITU-T. The H.245 protocol includes command-type messages. After the call is established, the peer is required to perform certain operations according to the commands of the local end. The following two commands are used in the embodiments of the present invention, but the embodiment of the present invention is not limited to using only this. Two commands are used to implement quality information feedback during the call.

The flow control command is used to send the flow control command carrying the highest bit rate parameter to the peer end when the local network quality changes, and the peer end is required to send a certain media stream to the local end. Or the bit rate of the entire multiplexed stream is flow-controlled; after receiving the command, the peer end sends the media stream or the entire multiplexed stream that is sent to the local end to the highest bit rate that is not limited by the local end.

The Miscellaneous command includes a plurality of function commands. In the embodiment of the present invention, a video Temporal Spatial Trade Off command is used, and the command is a request for updating the frame rate, and the peer receives the request. After this command, the video stream will be sent at the new frame rate. The quality of the video can be improved at the same transmission rate. For video with a small change in the time axis of the picture, it can be transmitted with a low frame rate and high resolution; for a video with a faster change on the time axis of the picture, it can be transmitted with a low resolution and high frame rate, which can be improved. The effect of video quality.

RTP is a real-time transport protocol that provides end-to-end transport services to support the transmission of real-time data in network services; Real-Time Transport Control Protocol (RTCP) is used to monitor and report RTP transmissions. An extended message in a manner of using RTCP extended message to provide video feedback information may include: two types under the 3⁄4 port:

1. Temporary Maximum Media Stream Bit Rate Request (TMMBR), which uses the message format shown in Figure 2Α, where the exponential scale of the numerical part of the maximum total media bit rate is exceeded (exponential Scaling of the mantissa for the maximum total media bit rate, MxTBR Exp ), the numerical part of the maximum total media bit rate (MxTBR Mantissa) and the measurement overhead (Measured Overhead) can calculate the bandwidth value;

2. Temporal-Spatial Trade-off Request (TSTR), using the message format shown in Figure 2B, where the index (Index) is 0-31, which is used to indicate the frame rate and video. The value of the quality. 0 is the lowest frame rate, the highest image quality; 31 is the highest frame rate, the lowest image quality. The embodiment of the present invention is an example of interworking between an IMS multimedia terminal on the IMS network side and an H.324 multimedia terminal on the CS network side, as shown in FIG. The media data involved in the embodiments of the present invention includes but is not limited to: audio, video, message, and the like. The embodiment of the present invention uses the specific example to illustrate: adding a media control device and a media processing device to adjust the media data after the session establishment of the multimedia terminal and the rate adaptation processing capability, and the technical solution for improving the quality of the multimedia call.

As shown in FIG. 4, a schematic flowchart of Embodiment 1 of a method for improving multimedia call quality according to the present invention includes the following steps:

Step 101: After the multimedia session is established, the MGC receives the H.324 multimedia terminal, that is, the quality information feedback sent by the first multimedia terminal.

In the scenario where the IMS multimedia terminal communicates with the H.324 multimedia terminal, the following conditions may occur in the H.324 multimedia terminal, but are not limited to the following cases: the bandwidth of the access network decreases, the receiving buffer overflows or underflows. Packet loss, poor video quality, etc., where the video quality is not good, the frame rate is too low, the image is not continuous, or the frame rate is too high, and the image is not clear; therefore, the quality information may include the maximum bandwidth request and the frame rate. The image quality trade-off ratio request, packet loss rate information, buffer information, etc., the quality information feedback may be a flow control (Flow control) command request, a frame rate and image quality video space-time trade-off ratio (video Temporal Spatial Trade Off ) order, etc.

Step 102: The MGC instructs the media source to adjust the media data sent to the H.324 multimedia terminal according to the quality information feedback.

The media source is a device that can adjust the media data to be received by the first multimedia terminal (ie, the H.324 multimedia terminal), and may be another terminal that sends the media data, that is, the second multimedia terminal or the media. The intermediate device on the data transmission path; in the embodiment of the present invention, the second multimedia terminal is an IMS multimedia terminal, and the intermediate device is an MGW.

When the quality feedback information received by the MGC is as exemplified in step 101, the MGC may specifically perform the following processing:

1. When the bandwidth of the access network on the H.324 side decreases and the buffer size on the H.324 side changes, When the average receiving rate changes and the packet loss rate of the media data received by the H.324 multimedia terminal is too high, the MGC will receive a flow control command request initiated by the H.324 terminal:

The MGW can be used as a media source. If there is a transcoder in the established session or a transcoder can be inserted, there are two possible MGC processes: one is to compare the maximum bandwidth requested in the flow control command request. The codec rate and/or session bandwidth in the codec mode used in the current session. When the requested maximum bandwidth is within the current session bandwidth and does not need to reselect the codec rate, only the MGW is notified through the transcoding. The device converts the codec rate of the received media data to the peer; the other is to compare the maximum bandwidth requested in the flow control command request with the codec rate and/or the codec mode of the current session. Session bandwidth, when the requested maximum bandwidth is outside the current session bandwidth, but does not need to reselect the codec rate, it may be necessary to trigger session bandwidth renegotiation with the H.324 multimedia terminal; when the requested maximum bandwidth is in the current session Within the bandwidth range, but need to re-select the codec rate, you may need to trigger with H.32 4 codec rate renegotiation of the multimedia terminal; when the requested maximum bandwidth is outside the current session bandwidth range and the codec rate needs to be reselected, it may be necessary to trigger session bandwidth and/or codec with the H.324 multimedia terminal. The renegotiation of the rate; and the MGW is also required to perform a conversion of the codec rate of the received media data by the transcoder in the transcoder to apply the negotiated session bandwidth and/or the codec rate. The MGW is notified by the transcoder to convert the codec rate of the media data sent by the received IMS side by using the existing SDP parameter on the H.248 interface, or by extending the H.248. The message passes the corresponding parameters.

The IMS multimedia terminal acts as the media source. If there is no transcoder or transcoder in the established session but the transcoding is unsuccessful, the MGC compares the maximum bandwidth requested in the flow control command request with the codec used in the current session. Codec rate and/or session bandwidth in the mode, if it is within the current session bandwidth but needs to reselect the codec rate, it may trigger the H.324 multimedia terminal and/or with the codec rate of the media data. Re-negotiation of the IMS multimedia terminal; if it is outside the current session bandwidth range, but does not need to re-select the codec rate, it may trigger a re-enforcement with the H.324 multimedia terminal and/or the IMS multimedia terminal for the session bandwidth of the media data. Negotiation; if outside the bandwidth of the current session, and when the codec rate needs to be reselected, it may be triggered for the session bandwidth and/or codec rate of the media data with the H.324 multimedia terminal and/or with the IMS multimedia terminal. Re-negotiation.

When the IMS multimedia terminal is used as the media source, the MGC can also extract the maximum bandwidth requested in the flow control command request, and extend the H.248 indication message, and use the H.248 indication message to instruct the MGW to encapsulate the RTCP TMMBR and send it to the IMS multimedia terminal. The IMS multimedia terminal will judge according to the maximum bandwidth parameter encapsulated in the RTCP TMMBR. If the session bandwidth and the codec rate are within the range supported by it, it will be directly adjusted. Otherwise, the renegotiation process may be triggered to dynamically adjust the media data sent by the IMS multimedia terminal. Coding. The signal parameter in the H.248 indication message may be consistent with the parameter in the quality information feedback, or the signal parameter in the H.248 indication message may also be: the quality extension packet to be converted by converting the parameter in the quality information feedback Parameters.

2. When the MGC receives the video Temporal Spatial Trade Off command for the frame rate and image quality sent by the H.324 multimedia terminal:

If there is a transcoder in the session or can be inserted into the transcoder, the MGC will inform the MGW to adjust the frame rate of the media data sent to the H.324 multimedia terminal through the transcoder in the command according to the trade-off ratio parameter included in the command. Image resolution, and may trigger renegotiation with the H.324 multimedia terminal for the frame rate of the media data; wherein the MGW is notified by the transcoder to convert the codec rate of the received media data from the IMS side, It can be passed by using the existing SDP parameters on the H.248 interface, or by extending the H.248 message. However, because the media data sent by the IMS multimedia terminal does not necessarily meet the requirements of the trade-off ratio parameter through the adjustment of the transcoder, it may still need to be adjusted from the IMS multimedia terminal side. For example, the MGC may receive the video time-space trade-off ratio. After the command, the frame rate of the media data is triggered to renegotiate with the H.324 multimedia terminal and/or with the IMS multimedia terminal, or the MGC indicates the trade-off ratio parameter to the MGW through the extended H.248 message, and the MGW passes the RTCP TSTR message. Sending to the IMS multimedia terminal, the IMS multimedia terminal will judge according to the trade-off ratio parameter. If the current encoded frame rate is within its supported range, the media data coding is directly adjusted, otherwise the renegotiation process may be triggered. Dynamically adjust the encoding of the media data it sends.

The method for improving the quality of the multimedia call provided by this embodiment may be implemented by the foregoing method, but is not limited to the foregoing method, and dynamically adjusts the codec rate of the media data, the video time-space trade-off ratio, and the like, thereby improving the quality of the multimedia call. For the processing in the above various cases, the method for improving the multimedia call quality will be described in detail below through specific embodiments.

When the H.324 multimedia terminal detects that the network bandwidth is degraded, or the processing capability is insufficient, the receiving buffer overflows or underflows, or the packet loss rate exceeds the upper threshold, the 324.324 multimedia terminal will pass the Η.245 message to the network side. The MGC/MGW feeds back the flow control command request with the requested maximum bandwidth, and requires the peer end of the session to reduce the session bandwidth and/or the codec rate to dynamically adjust the local end, that is, the call of the H.324 multimedia terminal. quality.

As shown in FIG. 5, it is a signaling flowchart of Embodiment 2 of a method for improving multimedia call quality according to the present invention. After the multimedia session is established, the transcoder is included in the session or the transcoder can be inserted when the session is needed. At this time, the media data can be transcoded by the transcoder in the MGW, thereby adjusting the encoding and decoding rate of the media data. , to meet the maximum bandwidth requested in the flow control command request. In this case, if the transcoder can do the above, the specific steps are as follows:

Step 201: The H.324 multimedia terminal detects that the session bandwidth is changed when the media data is received, and the sending quality information is fed back to the MGC, that is, the H.245 flow control command with the requested maximum bandwidth is sent to the MGC;

For example, in the case of a shortage of radio resources, the bandwidth allocated to a single user will decrease at this time, and it is necessary to reduce the rate at which the H.324 multimedia terminal receives the media data; or when the radio resource is translated, it is allocated to The bandwidth of a single user will increase. At this time, it is necessary to increase the rate at which the H.324 multimedia terminal receives the media data; and the H.245 flow control command is forwarded by the MGW;

Step 202: The MGC returns an H.245 flow control command response message to the H.324 multimedia terminal through the MGW.

Step 203: The MGC notifies the MGW through the H.248 message to adjust the encoding of the media data by using the transcoder, thereby adjusting the encoding and decoding rate of the media data to conform to the H.324 multimedia terminal. The requested maximum bandwidth requirement;

The MGC informs the MGW through the H.248 message to adjust the encoding of the media data through the transcoder, and can transmit the existing SDP parameters through the H.248 interface, or pass the corresponding parameters by extending the H.248 message. The extension of the H.248 message transmission is similar to the extension of the RTCP feedback indication. The difference is that the relevant parameters can be passed as the H.248 attribute. The parameter format is similar and will not be described here.

Step 204, the MGW completes the adjustment, and returns a media data adjustment response message to the MGC;

Step 205: The MGC sends an H.245 flow control indication to the H.324 multimedia terminal by the MGW, and notifies the H.324 multimedia terminal of the adjustment confirmation of the media data sent to the H.324 multimedia terminal. Step 206: H.324 multimedia terminal The H.245 flow control indication response message is sent to the MGC through the MGW in response to the H.245 flow control indication.

In this embodiment, the foregoing description is that the maximum bandwidth requested by the H.324 multimedia terminal is within the range that can be self-adjusted by the H.324 side, so there is no need to trigger the process of renegotiation of the MGC and the H.324 multimedia terminal. At this point, step 205 and step 206 may advance to step 202. If the maximum bandwidth requested by the H.324 multimedia terminal is not within the self-adjustable range of the H.324 side, then the process of renegotiation of the MGC and the H.324 multimedia terminal is triggered after the above step 202, the renegotiation The process will be described in detail in the examples below.

As shown in FIG. 6, another signaling flow diagram of Embodiment 2 of the method for improving multimedia call quality according to the present invention is shown. When no transcoder resources can be provided to the session in the MGW, or the transcoder can be obtained in the session but cannot be adjusted by the transcoder, that is, when the transcoding is unsuccessful, the media data received by the H.324 multimedia terminal is The adjustment of the transmission bandwidth can also be achieved by initiating renegotiation of the MGC with the H.324 multimedia terminal and/or renegotiation with the IMS multimedia terminal. The specific steps are as follows: Step 301: The H.324 multimedia terminal detects that the bandwidth of the received data changes, and the sending quality information is fed back to the MGC, that is, the H.245 flow control command with the requested maximum bandwidth is sent to the MGC; Step 302, The MGC returns an H.245 flow control command response message through the MGW;

Step 303: The MGC compares the maximum bandwidth requested by the H.324 multimedia terminal with the current session. Width, and according to the comparison result, the codec or codec rate or session bandwidth is renegotiated with the H.324 multimedia terminal;

If the requested maximum bandwidth is not within the codec range used by the H.324 side of the current session, the codec renegotiation of the MGC and the H.324 multimedia terminal needs to be initiated, if the requested maximum bandwidth is not used by the IMS side of the current session. Within the codec range, the codec renegotiation of the MGC and the IMS multimedia terminal needs to be initiated. If the requested maximum bandwidth is not within the codec range used by the H.324 side and the IMS side, the MGC and the two sides need to be initiated. Decoding renegotiation; in addition, if the requested maximum bandwidth is within the range of codecs used by the H.324 side and/or IMS side of the current session, when the requested maximum bandwidth is outside the current session bandwidth range, but not When the codec rate needs to be reselected, it may be necessary to initiate renegotiation of the session bandwidth between the MGC and the H.324 multimedia terminal and/or the IMS multimedia terminal; when the requested maximum bandwidth is within the current session bandwidth, but needs to be re-selected When decoding the rate, it may be necessary to initiate the codec of the MGC and the H.324 multimedia terminal and/or the IMS multimedia terminal. Rate renegotiation; when the requested maximum bandwidth is outside the current session bandwidth and the codec rate needs to be reselected, it may be necessary to initiate the session bandwidth and coding of the MGC with the H.324 multimedia terminal and/or with the IMS multimedia terminal. Re-negotiation of the decoding rate; the step 303 in this embodiment is that the requested maximum bandwidth is within the codec range used by the current session, but the codec rate and session bandwidth between the MGC and the H.324 multimedia terminal are to be initiated. Re-negotiate; order to the H.324 multimedia terminal;

Step 305: The H.324 multimedia terminal replies to the MGC by the MGW to close the old logical channel acknowledgement message/open a new logical channel acknowledgement message;

For example, the encoding mode AMR supports multiple rates in the range of 4.75-12.2 kb/s. When the session bandwidth is 6 kb/s, the session can use a rate of 5.9 kb/s. When the maximum bandwidth of the request is 10 kb/s, it can be re-established. The negotiation session bandwidth is 10 kb/s and the coding rate is 7.95 kb/s. At this time, the coding mode is still AMR mode; Step 306: The MGC sends an H.245 flow control indication to the H.324 multimedia terminal by using the MGW, and notifies the H.324 multimedia terminal that the renegotiation of the session bandwidth and/or the codec rate is completed.

Step 307: The H.324 multimedia terminal sends an H.245 flow control indication response message to the MGC through the MGW, in response to the H.245 flow control indication.

After the MG is re-negotiated with the H.324 multimedia terminal in the foregoing steps, if the IMS multimedia terminal needs to be negotiated, step 308 is performed, and the codec rate and/or the session bandwidth of the MGC and the IMS multimedia terminal are initiated. Negotiation.

As shown in FIG. 7, another signaling flow chart of Embodiment 2 of the method for improving multimedia call quality according to the present invention is shown. When the requested maximum bandwidth is within the codec range, the codec rate range, and the session bandwidth range used by the current session, the renegotiation process in the above embodiment is not required. In this case, the MGC and the MGW can be used in this embodiment. The H.248 interface extends the H.248 indication message, instructing the MGW to send an RTCP quality extension, such as an RTCP TMMBR message. The MGC detects the H.245 flow control command request, instructs the MGW, and the MGW feeds the quality information to the IMS multimedia terminal through the RTCP TMMBR, and the IMS multimedia terminal controls the transmission of the media data according to the parameters in the RTCP TMMBR.

The extended H.248 indication message may be an extension by the H.248 signal, and the signal parameters in the extended H.248 signal are defined, but are not limited to: consistent with the parameters in the H.245 flow control command request, Or the MGC converts the parameters in the H.245 flow control command request, and the signal parameters carried in the H.248 signal are consistent with the parameters in the RTCP TMMBR. That is, the conversion of the parameters in the H.245 flow control command request and the parameters in the RTCP TMMBR can be performed by the MGW or by the MGC.

The extended H.248 signal is as follows:

Signal name: RTCP feedback Indication (RTCP feedback indication)

Signal parameters:

Parameter 1 : MBR

Parameter ID: 0x01 Description: Used to indicate the maximum bandwidth of the request, in units of 100bit/s

Type: integer

The specific steps of the method for improving the multimedia call quality in this embodiment are as follows:

Step 401: The H.324 multimedia terminal detects that the bandwidth of the received data changes, and sends the quality information to the MGC, that is, sends the H.245 flow control command with the largest bandwidth to the MGC;

Step 402: The MGC returns an H.245 flow control command response message by using the MGW.

Step 403: The MGC extends the H.248 indication message, where is the H.248 signal, and sends an indication signal with the requested maximum bandwidth to the MGW.

The maximum bandwidth parameter in the H.248 signal may be a parameter in the H.245 flow control command request, or may be converted into a parameter that can be carried in the RTCP extended packet; or a format description different from the above two formats. This parameter.

Step 404: After the MGW receives the indication signal, if the parameter is not converted in step 403, the signal parameter carried in the H.248 indication signal is converted and converted into an RTCP extension packet. The parameter, that is, constitutes an RTCP extended message, that is, TRCP TMMBR;

Step 405: The MGW sends the RTCP extension to the IMS multimedia terminal, and the IMS multimedia terminal controls the transmission of the media data.

Step 406, the MGW returns a response message of the indication signal to the MGC;

Step 407: The MGC sends an H.245 flow control indication to the H.324 multimedia terminal by using the MGW, and notifies the H.324 multimedia terminal that the IMS multimedia terminal is instructed to control the transmission of the media data. Step 408: The H.324 multimedia terminal passes the MGW to The MGC sends an H.245 flow control indication response message in response to the H.245 flow control indication.

Steps 407 and 408 in this embodiment may also be implemented at step 402.

The second embodiment of the present invention improves the quality of the multimedia call. The method for improving the quality of the multimedia terminal is described in detail. The signaling interaction between the MGC and the MGW is increased, and the quality of the multimedia call can be dynamically improved in various ways. FIG. 8 is a signaling flowchart of Embodiment 3 of a method for improving multimedia call quality according to the present invention. The H.324 multimedia terminal detects that its video quality is not good. The main reason is that when the frame rate and image quality are not suitable, for example, in the case of a certain bandwidth, the frame rate cannot be too high for a video with intense video content. Low, you need to choose high frame rate, low picture quality to ensure communication quality; and for video content tends to be static, it is hoped to use low frame rate, high picture quality, then the user feels better. At this time, the H.324 multimedia terminal can send a video spatio-temporal trade-off ratio command to the MGC according to the picture situation seen, and the MGC can adjust the transcoder adjustment session to the H according to the trade-off ratio parameter in the command. The frame rate and image resolution of the media data of the .324 multimedia terminal may trigger renegotiation with the H.324 multimedia terminal for the frame rate of the media data, or may be directed to the media data after the MGC receives the video time-space ratio command. The frame rate triggers renegotiation with the H.324 multimedia terminal and/or with the IMS multimedia terminal to adjust the frame rate at which the IMS multimedia terminal transmits the media data, the media data being renegotiated by the transcoder and/or the initiated frame rate The process of the adjustment is similar to the process in which the MGC receives the flow control command in the foregoing embodiment, and details are not described herein again. In addition, the MGC extended H.248 indication message may also be instructed by the MGW to notify the IMS multimedia terminal to adjust the trade-off ratio of the frame rate of the media data to the image resolution, which is specifically described as follows:

The extended H.248 signal is:

Signal name: RTCP feedback Indication (RTCP feedback indication)

Signal parameters:

Parameter 2: TSTR

Parameter ID: 0x02

Description: Used to indicate the ratio of frame rate and image content to the request, ranging from 0 to 31, where 0 is the lowest frame rate, the best picture, 31 is the highest frame rate, and poor picture quality.

Type: integer

When the MGC receives the trade-off ratio request of the frame rate and the image content, that is, the H.245 video Temporal Spatial Trade Off command, the H.248 indication message is extended, here is the H.248 signal, indicating that the MGW passes the RTCP. The extended message TSTR feeds back the weighted ratio parameter to the IMS The multimedia terminal, the IMS multimedia terminal will control the transmission of the media data according to the weight ratio parameter of the frame rate and the image content. Specific steps are as follows:

Step 501: The H.324 multimedia terminal detects that the video quality is not good, and sends an H.245 video space-time ratio command to the MGC;

Step 502: The MGC returns an H.245 video space-time ratio command response message through the MGW. Step 503: The MGC extends the H.248 indication message, where is the H.248 signal, and sends an indication signal with a trade-off ratio parameter to the MGW.

The trade-off ratio parameter in the H.248 signal may be a parameter in the H.245 flow control command request, or may be converted here to be consistent with the parameter in the RTCP extended message, or other than the above two types of parameters. Parameter

Step 504: After receiving the indication signal, if the MGW does not perform parameter conversion in step 403, the signal parameter carried in the H.248 indication signal is converted and converted into an RTCP extended message RTCP TSTR. Carrying parameters, that is, constitute RTCP TSTR;

Step 505: The MGW sends the RTCP extension TSTR to the IMS multimedia terminal, and the IMS multimedia terminal adjusts the frame rate of the transmitted media data and/or the renegotiation process of the trigger frame rate. Step 506: The MGW returns a response message of the indication signal. To the MGC;

Step 507: The MGC sends an H.245 weighted ratio indication to the H.324 multimedia terminal by the MGW, notifying the H.324 multimedia terminal that the frame rate of the media data indicating that the IMS adjustment is sent is completed; and the response message is in response to the H.245 weighted ratio. Instructions.

Steps 507 and 508 in this embodiment may also be implemented at step 502.

In this embodiment, the MGC may also adjust the frame rate and image resolution of the media data sent to the H.324 multimedia terminal according to the trade-off ratio parameter notification in the command, wherein the MGC is notified by the H.248 message. The MGW can pass the existing SDP parameters on the H.248 interface through the transcoder, or pass the corresponding parameters by extending the H.248 message, if the message extension in the extended H.248 message is similar to the RTCP feedback indication. Expansion, the difference is related The parameters can also be passed as H.248 attributes. The format of the parameters is similar and will not be described here.

The third embodiment of the present invention improves the quality of the multimedia call. The method for improving the call quality of the multimedia terminal by adjusting the relationship between the frame rate and the image quality is described. The MGC instructs the MGW to send the RTCP extended message to the IMS network side, and the IMS multimedia terminal Adjust the frame rate to dynamically improve the quality of multimedia calls.

FIG. 9 is a schematic structural diagram of Embodiment 1 of a media control device according to the present invention. The media control device includes: a first receiving module 11 that receives quality information feedback sent by the first multimedia terminal after the multimedia session is established, where the quality information is a maximum bandwidth request, a frame rate and an image resolution trade-off ratio request, and a lost The packet rate information, the buffer information, and the first indication module 12 that instructs the media source to adjust the media data sent to the first multimedia terminal according to the quality information feedback.

The first indication module 12 may include: a notification submodule 121 that notifies the media processing device to adjust the media data sent to the first multimedia terminal by using the transcoder therein according to the parameter in the quality information feedback, where the media The source end is the media processing device; comparing the parameters carried in the quality information feedback with the corresponding parameters in the current session sub-module 122; triggering the re-creation with the first multimedia terminal and/or with the second multimedia terminal Negotiating to adjust the triggering sub-module 123 of the media data sent to the first multimedia terminal, where the media source is the second multimedia terminal.

The first indication module 12 may further include: extracting parameters in the quality information feedback, extending the extended sub-module 124 of the H.248 indication message; using the H.248 indication message to instruct the media processing device to encapsulate the quality extension message, and sending the The indication sub-module 125 of the second multimedia terminal, where the signal parameters in the H.248 indication message include but are not limited to: the quality in the quality information feedback, or the quality obtained by converting the parameters in the quality information feedback The parameters to be encapsulated in the extended message.

The specific process of the interaction between the media control device and the media processing device and the multimedia terminal after receiving the quality information feedback from the multimedia terminal in the embodiment is as described in the foregoing method for improving the quality of the multimedia call, and details are not described herein again. The media control device compares the parameters in the quality information feedback with the corresponding parameters in the current session, and then notifies the transcoder in the media processing device to dynamically adjust the codec rate and session bandwidth of the media data, or trigger the media to control the device and many The media terminal negotiates to dynamically adjust the codec rate and the session bandwidth of the media data, or by extending the H.248 indication message between the media control device and the media processing device, and the media control device instructs the media processing device to send the quality extension message. Dynamically adjust the codec rate and session bandwidth of media data to improve the quality of multimedia calls.

FIG. 10 is a schematic structural diagram of Embodiment 1 of a media processing device according to the present invention. The media processing device includes: a transcoder 21 that adjusts media data sent to the first multimedia terminal according to a notification of the media control device; and/or when receiving an H.248 indication message of the media control device, directly The signal parameter in the H.248 indication message is encapsulated into the quality extension message, sent to the second multimedia terminal, or the signal parameter in the H.248 indication message is converted into a parameter to be encapsulated in the quality extension message, and The conversion module 22 is packaged into a quality extension message.

After the media processing device in this embodiment receives the indication from the media control device, the specific process of interaction with the media control device and the multimedia terminal is as described in the foregoing method for improving the quality of the multimedia call, and details are not described herein again. The media processing device can process the indication of the media control device in time through interaction with the media control device and the multimedia terminal, thereby dynamically improving the quality of the multimedia call.

As shown in FIG. 11, it is a schematic structural diagram of Embodiment 1 of a system for improving multimedia call quality according to the present invention. The improved multimedia call quality system includes: a first multimedia terminal that sends quality information feedback

3, the quality information is the maximum bandwidth request, the frame rate and image resolution trade-off ratio request, the packet loss rate information, the buffer information; according to the quality information feedback, sending a notification, indicating or triggering renegotiation, to adjust to send to the first The media control device 1 of the media data of the multimedia terminal 3; after receiving the notification or indication sent by the media control device, adjusting the media source of the media data sent to the first multimedia terminal 3.

The media control device 1 may include: a first receiving module 11 that receives the quality information feedback sent by the first multimedia terminal 3 after the multimedia session is established; and according to the quality information feedback, instructs the media source to adjust to send to the first multimedia The first indication module 12 of the media data of the body terminal 3.

The media source may be the media processing device 2 or the second multimedia terminal 4. When the media source is the media processing device 2, the media processing device 2 includes a first indication according to the media control device 1. The notification sent by the module 12 adjusts the transcoder 21 of the media data sent to the first multimedia terminal 3; when the media source is the second multimedia terminal 4, the media processing device 2 may include the medium when receiving the media When the H.248 indication message of the device 1 is controlled, the signal parameters in the H.248 indication message are directly encapsulated into the quality extension text, sent to the second multimedia terminal 4, or the signal parameters in the H.248 indication message are converted. The parameter to be encapsulated in the quality extension packet is encapsulated into a conversion module 22 of the quality extension message. At this time, the second multimedia terminal 4 adjusts and sends the message to the first multimedia terminal according to the received quality extension message. 3 media data quality.

In the embodiment, the specific implementation process of the multimedia call quality system, the media control device, the media processing device, and the first and second multimedia terminals is as described in the foregoing method for improving the quality of the multimedia call. I won't go into details here. The improved multimedia call quality system can process the information quality feedback of the multimedia terminal in time by increasing the protocol interaction between the media control device and the media processing device, thereby dynamically improving the quality of the multimedia call.

As shown in FIG. 12, it is a schematic flowchart of Embodiment 4 of a method for improving multimedia call quality according to the present invention, which includes the following steps:

Step 601: After the multimedia session is established, the MGC instructs the MGW to detect the media data sent by the media data sender, and determines the quality parameter of the detected media data.

During the session establishment process before step 601, the MGC first determines whether the MGW implements media codec between different media sources, such as conference video mixing or audio and video transcoding; the MGC determines media data that needs to be detected by the MGW. a quality parameter, and instructing the MGW to detect the quality of the media data sent by the media data sender;

Step 602: The MGC receives the quality problem information reported by the MGW.

Step 603: According to the quality problem information, the MGC instructs the media data sender to adjust the media data sent by the media data sender.

When the MGW detects that the quality of the media data sent by the media data sender falls below the quality parameter level specified by the MGC, it reports the quality problem information to the MGC, which carries the parameter information for solving the problem; the MGC reports according to the MGW. Quality problem information, you can send a feedback letter The media data sender, the media data sender triggers the renegotiation process with the MGC to adjust the media data sent by the media data sender, and may also send the feedback information to the media data sender, and is triggered by the MGC and the media data is sent. The party renegotiation process is used to adjust the media data sent by the media data sender, and the MG may directly trigger the renegotiation process with the media data sender to adjust the media data sent by the media data sender. Thus, the media data sent by the media data sender can be dynamically adjusted.

The method for improving multimedia call quality provided by this embodiment, the quality level setting and detection standard are determined by the media controller, possibly but not limited to network bandwidth degradation; or insufficient processing capability, receiving buffer overflow or underflow; or detecting The packet loss rate is too high. In this embodiment, the IMS multimedia terminal and the H.324 multimedia terminal are connected to each other in the scenario shown in FIG. 3. Therefore, the media control device is an MGC, and the media processing device is an MGW. This embodiment can also be applied to scenarios between multiple multimedia terminals in the same network.

The method for improving the quality of the multimedia call provided by the embodiment can dynamically detect the quality of the media data sent by the media data sender in the process of participating in the codec and the media transmission, and the quality problem is caused when the quality is degraded. The information notification media control device may send the feedback information to the media data sender by the media control device, directly adjust the media data by the media data sender, or trigger the renegotiation process to adjust the media data, or directly trigger the media by the media control device. The renegotiation process of the data sender may also send the feedback information and the renegotiation process with the media data sender by the media control device, so that the media data sent by the media data sender can be dynamically adjusted.

As shown in FIG. 13 , it is a schematic flowchart of Embodiment 5 of the method for improving multimedia call quality according to the present invention, which is a processing flow of buffer detection. For the detection of the buffer information on the H.324 side of the MGW, the MGW itself can perform the adjustment of the buffer on the H.324 multimedia terminal side to adapt to the change of the media data sent by the H.324 multimedia terminal; When the impact of the change of the media data sent by the H.324 multimedia terminal on the buffer exceeds the adjustment range of the MGW, the MGW in this embodiment needs to send the quality problem to the MGC, and send the H.245 flow through the MGC. Party controlling the command To request the H.324 multimedia terminal, that is, the media data sender, to modify the bandwidth of the transmitted media data stream to complete the dynamic adjustment of the session process.

In order for the MGC to instruct the MGW to detect the buffer information, the following H.248 events are defined:

Detect media quality events

Event Name: Media Quality Event

Event detection parameters: None

Test result parameters:

Parameter 1 : mb (maximum bandwidth)

Parameter ID: 0x01

Description: The MGW has a certain adjustment capability for its buffer according to the average receiving rate of the media data. When it exceeds its own adjustment or is expected to exceed its own adjustment range, it will initiate flow control to the H.324 multimedia terminal to adjust the media. Source, that is, the bandwidth of the media data of the H.324 multimedia terminal, to meet the quality requirements of the H.324 multimedia terminal, unit 100bit/s Type: Integer

An example of the MGC/MGW performing buffer detection when a call is made between the H.324 multimedia terminal on the CS network side and the IMS multimedia terminal on the IMS network side, the following steps are included: Step 701: The MGC instructs the MGW to perform media on the media. The detection of the average receiving rate of the data, sending an H.248 detection request to the MGW;

Step 702: The MGW returns a detection request response message to the MGC.

Step 703: During the process of receiving the media data, the MGW detects that the adjustment of the average rate of the media data exceeds its own adjustment range, or is expected to exceed its own adjustment range, and needs to request the MGC to implement the flow control command. Adjustment of the bandwidth of the media data sent by the H.324 multimedia terminal;

Step 704: The MGW reports the quality problem information to the MGC through the H.248 message, that is, requests the flow control event, and carries the suggested bandwidth value mb, and the value may be received according to the buffer information and the average Bandwidth is estimated;

For example, when the buffer is about to overflow and the average rate is vl, the MGW will suggest a rate value less than vl; otherwise, if the buffer is about to underflow, a rate value higher than vl will be suggested;

Step 705: The MGC returns an H.248 response message to the MGW.

Step 706: The MGC sends a flow control command message to the H.324 multimedia terminal by using the MGW, with a modified bandwidth value.

Step 707: The H.324 multimedia terminal replies to the MGC by using the MGW to reply to the flow control indication message, and modifies the bandwidth of the media data sent by the MGW.

The MGW performs quality detection and reporting of quality problem information, which can also trigger the MGC to send H.245 jitter indication to the H.324 multi-media terminal. The H.248 event of the extended MGC and the triggering process of the MGC transmitting the H.245 jitter indication to the H.324 multimedia terminal are similar to the triggering process of the flow control command message in steps 701 to 707 of the above embodiment. After receiving the H.245 jitter indication, the H.324 multimedia terminal may also send a H.245 Flow Control Command request to trigger a new round of flow control process, that is, H.324 multimedia. After receiving the feedback information, the terminal triggers the renegotiation process with the MGC, which is similar to the renegotiation process described in detail above, and is not described here.

When the media data sender that sends the media data is an IMS multimedia terminal, the media quality detection feedback for the IMS multimedia terminal side can be implemented by RTCP message feedback. If the modification of the media data transmission bandwidth is performed, the flow control can be triggered by the RTCP TMMBR message feedback; if the codec or the renegotiation of related parameters is also required, the IMS multimedia terminal can trigger the relevant renegotiation after receiving the RTCP message.

FIG. 14 is a schematic structural diagram of Embodiment 2 of a media control device according to the present invention. The media control device includes: after the multimedia session is established, instructing the media processing device to detect the media data sent by the media data sender, and determining a second indication module 61 for detecting the quality parameter of the media data; receiving the quality problem information reported by the media processing device The second receiving module 62; the third indication module that instructs the media data sender to adjust the media data sent by the media data sender according to the quality problem information 63. The MGC may send the feedback information to the media data sender according to the quality problem information reported by the MGW, and the media data sender may trigger the renegotiation process with the MGC to adjust the media data sent by the media data sender, or send the feedback information to the MGC. The media data sender, and the MGC triggers a renegotiation process with the media data sender to adjust the media data sent by the media data sender, and may also directly trigger the renegotiation process with the media data sender by the MGC to adjust the media data. Media data sent by the sender.

The functions of the respective modules of the media control device provided in this embodiment are implemented as described in the above method for improving the multimedia call quality. The media control device can improve the quality of the multimedia call by instructing the media processing device to perform quality detection and quality data reporting to trigger quality feedback to the media data sender.

FIG. 15 is a schematic structural diagram of Embodiment 2 of a media processing device according to the present invention. The media processing device includes: a calculation module 71 for calculating the media data according to the quality parameter of the detected media data determined by the media control device during the process of receiving the media data; when the calculation finds that the media data cannot be adjusted by itself, The calculated quality problem information is reported to the reporting module 72 of the media control device.

The function of each module of the media processing device provided in this embodiment is implemented as described in the above method for improving the quality of the multimedia call. The media processing device may perform quality detection according to the indication of the media control device, and report the quality data to the media control device to trigger quality feedback of the media control device to the media data sender, thereby improving the quality of the multimedia call.

As shown in FIG. 16, FIG. 16 is a schematic structural diagram of Embodiment 2 of a system for improving multimedia call quality according to the present invention. The system includes: a media data sender 5, a media processing device 7, and a media control device 6 that transmit media data and trigger renegotiation with the media processing device 7 based on the received feedback information.

The media data sender 5 is configured to send media data after the multimedia session is established, and trigger renegotiation with the media control device according to the received feedback information.

The media control device 6 may include: a second indication module 61 that instructs the media processing device 7 to detect the media data sent by the media data sender 5, and determines a quality parameter of the media data; The second receiving module 62 of the quality problem information reported by the media processing device 7; the third indication module 63 that instructs the media data sender to adjust the media data sent by the media data sender 5 according to the quality problem information.

The media processing device 7 is configured to detect the media data sent by the media data sender 5, and adjust the quality of the media data. When the media data cannot be adjusted by itself, the calculated quality information is reported to the media control. The device 6 may include: a calculation module 71 for calculating the media data according to the quality parameter of the detected media data determined by the media control device 6 during the process of receiving the media data; when the calculation finds that the media data cannot be adjusted by itself, The calculated quality problem information is reported to the reporting module 72 of the media control device 6.

The function of each module for improving the multimedia call quality system provided in this embodiment is implemented as described in the above method for improving the quality of the multimedia call. In the multimedia call quality improvement system, the media processing device may perform quality detection on the media data sent by the media data sender according to the indication of the media control device, and report the quality data to the media control device to trigger the media control device to media data. The sender's quality feedback improves the quality of the multimedia call.

It should be noted that, the embodiment of the present invention is not limited to the network architecture shown in FIG. 3, and when other multimedia terminals in the same network or different multimedia terminals in different networks are in a call, to improve the call quality, The technical solutions of the embodiments of the invention are also applicable.

It should be noted that the above embodiments are only for explaining the technical solutions of the present invention, and are not intended to be limiting; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those skilled in the art that: The technical solutions described in the foregoing embodiments are modified, or some of the technical features are equivalently replaced. The modifications and substitutions do not depart from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

Claim

A method for improving quality of multimedia calls, comprising:

Receiving quality information feedback sent by the first multimedia terminal;

The method for improving the quality of the multimedia call according to claim 1, wherein the media processing device is used as the media source, and the media source is adjusted to send the first to the first according to the quality information feedback. The media data of the multimedia terminal includes:

Notifying the media processing device to adjust media data sent to the first multimedia terminal by using a transcoder according to parameters in the quality information feedback; or

Comparing the parameter in the quality information feedback with the corresponding parameter in the current session, triggering renegotiation with the first multimedia terminal according to the comparison result, and notifying the media processing according to the parameter in the quality information feedback The device adjusts the media data sent to the first multimedia terminal through the transcoder.

The method for improving the quality of the multimedia call according to claim 2, wherein the notifying the media processing device to send to the first multimedia through a transcoder according to the parameter in the feedback of the quality information The media data of the body terminal includes:

And extracting a parameter in the quality information feedback, to extend the H.248 indication message, and instructing, by the extended H.248 indication message, the media processing device to adjust to send to the first multimedia terminal by using a transcoder Media data.

The method for improving the quality of the multimedia call according to claim 1, wherein the second multimedia terminal is used as the source of the media, and the user is instructed to adjust the source of the media according to the feedback of the quality information. The media data of the first multimedia terminal includes:

And directly adjusting the media data sent by the second multimedia terminal according to the parameter in the quality information feedback; or

Comparing the parameters in the quality information feedback with the corresponding parameters in the current session, according to the comparison And triggering renegotiation with the first multimedia terminal and/or with the second multimedia terminal to adjust media data sent to the first multimedia terminal.

The method for improving multimedia call quality according to claim 4, wherein the renegotiation comprises: codec renegotiation, codec rate renegotiation, session bandwidth re-negotiation, and frame rate renegotiation.

The method for improving the quality of the multimedia call according to claim 1, wherein the second multimedia terminal is used as the media source, and the user is instructed to adjust the source to the media source according to the quality information feedback. The media data of the first multimedia terminal includes:

Extracting parameters in the quality information feedback to extend the H.248 indication message;

Instructing, by the extended H.248 indication message, the media processing device to construct a quality extension message and transmitting the same to the second multimedia terminal;

The second multimedia terminal adjusts media data sent to the first multimedia terminal according to the information in the quality extension message.

The method for improving multimedia call quality according to any one of claims 1-6, wherein the quality information comprises a maximum bandwidth request, a frame rate and image resolution trade-off ratio request, a packet loss rate information, and a buffer. At least one of the information.

8. A media control device, comprising:

The media control device according to claim 8, wherein the first indication module comprises:

a notification submodule, configured to notify the media processing according to the parameter in the quality information feedback The device adjusts the media data sent to the first multimedia terminal by using a transcoder;

a comparison submodule, configured to compare parameters in the quality information feedback with corresponding parameters in a current session;

a triggering submodule, configured to trigger renegotiation with the first multimedia terminal and/or the second multimedia terminal according to a comparison result output by the comparison submodule, to adjust to send to the first Media data of the multimedia terminal.

An extension submodule, configured to extract parameters in the quality information feedback, and extend an H.248 indication message;

And an indication submodule, configured to instruct the media processing device to construct a quality extension message by using the extended H.248 indication message and send the same to the second multimedia terminal.

A media processing device, comprising:

And a conversion module, configured to: when receiving the H.248 indication message sent by the media control device, construct a quality extension message according to the parameter in the H.248 indication message and send the quality extension message to the second multimedia terminal.

12. A system for improving the quality of a multimedia call, comprising a first multimedia terminal and a second multimedia terminal, further comprising:

13. A method for improving multimedia call quality, characterized in that:

Instructing the media processing device to detect media data sent by the sender of the media data, and determining to be used for checking Measuring parameters of the media data;

Receiving quality information reported by the media processing device;

The method for improving multimedia call quality according to claim 13, wherein the instructing media processing device detects media data sent by a media data sender, and determines parameters and receiving for detecting the media data. The quality information reported by the media processing device further includes:

During the process of receiving the media data, the media processing device calculates the media data according to the parameter;

When the media processing device calculates that the media data cannot be adjusted by itself, the calculated quality information is reported.

The method for improving multimedia call quality according to claim 13 or 14, wherein the media data sender is instructed to adjust the media data sent by the media data sender according to the quality information, including:

Sending feedback information to the media data sender according to the quality information, directly adjusting the media data sent by the media data sender, or triggering a renegotiation process by the media data sender to adjust media data transmission Media data sent by the party; or

Transmitting feedback information to the media data sender according to the quality information, and triggering a renegotiation process with the media data sender to adjust media data sent by the media data sender; or

And according to the quality information, directly triggering a renegotiation process with the media data sender to adjust media data sent by the media data sender.

16. A media control device, comprising:

a second indication module, configured to instruct the media processing device to detect media data sent by the media data sender, and determine a parameter used to detect the media data; a second receiving module, configured to receive quality information reported by the media processing device;

17. A media processing device, comprising:

18. A system for improving multimedia call quality, characterized in that:

a media data sender, configured to send media data, and trigger renegotiation with the media control device according to the received feedback information;