CN112511782B - Video conference method, first terminal, MCU, system and storage medium - Google Patents

Video conference method, first terminal, MCU, system and storage medium Download PDF

Info

Publication number
CN112511782B
CN112511782B CN201910872672.4A CN201910872672A CN112511782B CN 112511782 B CN112511782 B CN 112511782B CN 201910872672 A CN201910872672 A CN 201910872672A CN 112511782 B CN112511782 B CN 112511782B
Authority
CN
China
Prior art keywords
decoding
terminal
video
mcu
video coding
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201910872672.4A
Other languages
Chinese (zh)
Other versions
CN112511782A (en
Inventor
许磊
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
ZTE Corp
Original Assignee
ZTE Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by ZTE Corp filed Critical ZTE Corp
Priority to CN201910872672.4A priority Critical patent/CN112511782B/en
Priority to PCT/CN2020/109332 priority patent/WO2021052077A1/en
Publication of CN112511782A publication Critical patent/CN112511782A/en
Application granted granted Critical
Publication of CN112511782B publication Critical patent/CN112511782B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L9/00—Cryptographic mechanisms or cryptographic arrangements for secret or secure communications; Network security protocols
    • H04L9/40—Network security protocols
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/14—Systems for two-way working
    • H04N7/15—Conference systems
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/40—Support for services or applications
    • H04L65/403—Arrangements for multi-party communication, e.g. for conferences
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60—Network streaming of media packets
    • H04L65/75—Media network packet handling
    • H04L65/756—Media network packet handling adapting media to device capabilities
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/14—Systems for two-way working
    • H04N7/15—Conference systems
    • H04N7/152—Multipoint control units therefor

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Computer Security & Cryptography (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Telephonic Communication Services (AREA)
  • Data Exchanges In Wide-Area Networks (AREA)

Abstract

The invention provides a video conference method, a first terminal, an MCU, a system and a storage medium, wherein network quality parameters are acquired in the video conference process, so that encoding and decoding capacities are adjusted according to the network quality parameters, media files are encoded and decoded by utilizing the adjusted encoding and decoding capacities, and encoded and decoded media streams and the network quality parameters are sent to the MCU; further, the MCU receives a media stream from the first terminal and network quality parameters, adjusts the encoding and decoding capability according to the network quality parameters, and encodes and decodes the media stream to be transmitted by utilizing the adjusted encoding and decoding capability, wherein the media stream to be transmitted is from other reference terminals except the first terminal, and further transmits the encoded and decoded media stream to the first terminal; the first terminal receives a media stream from the MCU; the method solves the problems that in the prior art, video images of partial terminals are unsmooth or poor in effect due to network reasons, and user experience is poor.

Description

Video conference method, first terminal, MCU, system and storage medium
Technical Field
The invention relates to the technical field of audio and video, in particular to a video conference method, a first terminal, a multipoint control unit (Multipoint Control Unit, MCU), a system and a storage medium.
Background
With the rapid development of IP networks and multimedia communication technologies, video conferencing systems are widely used in modern enterprises. The video conference system is to use a television device and a video conference terminal to call a plurality of user terminals distributed in each place into the same conference through an MCU.
In practical application, miniaturized conferences and self-service conferences are more and more, terminals and MCUs of various manufacturers are often required to be held, and at present, in a traditional conference television system, a frequently visible scene is that video images of part of terminals are unsmooth or poor in effect due to network reasons in the conference, so that the experience satisfaction degree of users is greatly reduced.
Disclosure of Invention
The video conference method, the first terminal, the MCU, the system and the storage medium mainly solve the technical problems that in the prior art, video images of part of terminals are unsmooth or poor in effect due to network reasons in a conference, and user experience is poor.
In order to solve the above technical problems, an embodiment of the present invention provides a video conference method, which is applied to a first terminal, and includes:
Acquiring network quality parameters in the video conference process;
Adjusting the encoding and decoding capacity according to the network quality parameters;
Encoding and decoding the media file by utilizing the adjusted encoding and decoding capability;
transmitting the coded and decoded media stream and the network quality parameter to a multipoint control unit MCU;
A media stream is received from the MCU.
In order to solve the above technical problems, an embodiment of the present invention provides a video conference method, which is applied to a multipoint control unit MCU, including:
Receiving a media stream from a first terminal and network quality parameters in the video conference process;
Adjusting the encoding and decoding capacity according to the network quality parameters;
Encoding and decoding a media stream to be transmitted by utilizing the adjusted encoding and decoding capability, wherein the media stream to be transmitted is from other participant terminals except the first terminal;
and sending the coded and decoded media stream to the first terminal.
In order to solve the technical problems, the embodiment of the invention provides a video conference method, wherein a first terminal acquires network quality parameters in the video conference process, adjusts encoding and decoding capabilities according to the network quality parameters, encodes and decodes media files by utilizing the adjusted encoding and decoding capabilities, and sends the encoded and decoded media streams and the network quality parameters to a multipoint control unit MCU;
The MCU receives a media stream from a first terminal and network quality parameters in the video conference process, adjusts coding and decoding capabilities according to the network quality parameters, and codes and decodes the media stream to be sent by utilizing the adjusted coding and decoding capabilities, wherein the media stream to be sent is from other reference terminals except the first terminal, and sends the coded and decoded media stream to the first terminal;
The first terminal receives a media stream from the MCU.
In order to solve the above technical problem, an embodiment of the present invention further provides a first terminal, where the first terminal includes: the device comprises a first acquisition module, a first adjustment module, a first coding and decoding module, a first sending module and a first receiving module;
The first acquisition module is used for acquiring network quality parameters in the video conference process;
the first adjusting module is used for adjusting the encoding and decoding capacity according to the network quality parameters;
the first encoding and decoding module is used for encoding and decoding the media file by utilizing the adjusted encoding and decoding capability;
the first sending module is used for sending the coded and decoded media stream and the network quality parameter to the multipoint control unit MCU;
The first receiving module is used for receiving the media stream from the MCU.
In order to solve the above technical problems, an embodiment of the present invention further provides a multipoint control unit MCU, where the MCU includes: the device comprises a second receiving module, a second adjusting module, a second encoding and decoding module and a second sending module;
The second receiving module is used for receiving the media stream from the first terminal and the network quality parameter in the video conference process;
The second adjusting module is used for adjusting the encoding and decoding capacity according to the network quality parameters;
The second encoding and decoding module is used for encoding and decoding a media stream to be transmitted by utilizing the adjusted encoding and decoding capability, wherein the media stream to be transmitted is from other participant terminals except the first terminal;
The second sending module is used for sending the coded and decoded media stream to the first terminal.
In order to solve the technical problems, the embodiment of the invention also provides a system, which comprises a multipoint control unit MCU and at least two first terminals;
The first terminal is used for acquiring network quality parameters in the video conference process, adjusting the encoding and decoding capability according to the network quality parameters, encoding and decoding the media file by utilizing the adjusted encoding and decoding capability, and transmitting the encoded and decoded media stream and the network quality parameters to the MCU;
The MCU receives a media stream from the first terminal and network quality parameters in the video conference process, adjusts the encoding and decoding capability according to the network quality parameters, and utilizes the adjusted encoding and decoding capability to encode and decode a media stream to be transmitted, wherein the media stream to be transmitted is from other reference terminals except the first terminal, and the encoded and decoded media stream is transmitted to the first terminal;
the first terminal is also configured to receive a media stream from the MCU.
To solve the above technical problem, an embodiment of the present invention provides a storage medium, where one or more first computer programs are stored, where the one or more first computer programs may be executed by one or more processors, so as to implement the steps of the first terminal corresponding to the video conference method as described above;
Or alternatively, the first and second heat exchangers may be,
The storage medium stores one or more second computer programs executable by one or more processors to implement the steps of the MCU-corresponding video conferencing method as described above.
The beneficial effects of the invention are as follows:
According to the video conference method, the first terminal, the MCU, the system and the storage medium, the first terminal acquires the network quality parameters in the video conference process, so that the encoding and decoding capacity is adjusted according to the network quality parameters, the media file is encoded and decoded by utilizing the adjusted encoding and decoding capacity, and the encoded and decoded media stream and the network quality parameters are sent to the multipoint control unit MCU; further, the MCU receives a media stream from the first terminal and network quality parameters, adjusts the encoding and decoding capability according to the network quality parameters, and encodes and decodes the media stream to be transmitted by utilizing the adjusted encoding and decoding capability, wherein the media stream to be transmitted is from other reference terminals except the first terminal, and further transmits the encoded and decoded media stream to the first terminal; further, the first terminal receives a media stream from the MCU; the method solves the problems that in the prior art, video images of partial terminals are unsmooth or poor in effect due to network reasons, and user experience is poor. The video conference method, the first terminal, the MCU, the system and the storage medium provided by the embodiment of the invention realize the dynamic adjustment of the encoding and decoding capability by combining the current network quality parameters in the video conference process, greatly improve the effect of video conference images and further improve the experience satisfaction degree of users.
Additional features and corresponding advantages of the invention will be set forth in the description which follows, and in part will be apparent from the description, or may be learned by practice of the invention.
Drawings
The invention will be further described with reference to the accompanying drawings and examples, in which:
fig. 1 is a basic flow diagram of a terminal-side videoconferencing method according to an embodiment of the present invention;
Fig. 2 is a basic flow chart diagram of a terminal-side videoconferencing method according to an embodiment of the present invention;
Fig. 3 is a schematic diagram of a basic flow of a side-video conference method of an MCU according to a first embodiment of the present invention;
Fig. 4 is a basic flow chart diagram II of a side-video conference method of an MCU according to the first embodiment of the present invention;
fig. 5 is a basic flow diagram of a video conference method according to a third embodiment of the present invention;
fig. 6 is a basic flow diagram of a terminal-side videoconferencing method according to a fourth embodiment of the present invention;
Fig. 7 is a basic flow diagram of a side-view conference method for an MCU according to a fourth embodiment of the present invention;
fig. 8 is a basic flow diagram of a side-view conference method for an MCU according to a fifth embodiment of the present invention;
fig. 9 is a schematic structural diagram of a first terminal according to a sixth embodiment of the present invention;
fig. 10 is a schematic structural diagram of an MCU according to a sixth embodiment of the present invention;
fig. 11 is a schematic structural diagram of a system according to a seventh embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the following detailed description of the embodiments of the present invention is given with reference to the accompanying drawings. It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the scope of the invention.
Embodiment one:
In order to solve the problems that in the prior art, video images are not smooth or have poor effects and poor user experience degree of partial terminals are caused by network reasons in a conference, in the embodiment of the invention, a video conference method is provided, wherein a first terminal acquires network quality parameters in the video conference process, and then the encoding and decoding capacity is adjusted according to the network quality parameters, media files are encoded and decoded by utilizing the adjusted encoding and decoding capacity, and the encoded and decoded media streams and the network quality parameters are sent to a multipoint control unit MCU; referring to fig. 1, fig. 1 is a basic flow chart of a video conference method according to the present embodiment.
S101: network quality parameters are obtained during the videoconference.
Optionally, in this embodiment, before acquiring the network quality parameter during the videoconference, at least the following steps are further included, as shown in fig. 2:
S201: and sending first video coding and decoding protocol information to the MCU, wherein the first video coding and decoding protocol information comprises all video coding and decoding protocols supported by the first terminal.
First, the first terminal in this embodiment supports at least one video codec protocol; for example, the first terminal supports two video codec protocols, which are N, K, and at this time, the first terminal sends first video codec protocol information to the MCU side, where the first video codec protocol information includes N, K.
S202: and receiving second video coding and decoding protocol information from the MCU, wherein the second video coding and decoding protocol information comprises the video coding and decoding protocol with the highest priority supported by the first terminal.
Then, the MCU judges the video coding and decoding protocol supported by the first terminal, determines a video coding and decoding protocol with the best video conference quality for the first terminal, determines the priority of the video coding and decoding protocol as the highest, adds the video coding and decoding protocol to the second video coding and decoding protocol information and sends the video coding and decoding protocol information to the first terminal; for example, in carrying the above example, further, the MCU side determines that the priority of the video codec protocol N is highest, that is, the second video codec protocol information includes N, further, sends the second video codec protocol information to the first terminal, and thus the first terminal receives the second video codec protocol information from the MCU.
S203: joining the conference with the highest priority video codec protocol.
Finally, the first terminal adds the video coding and decoding protocol with the highest priority supported by the first terminal and included by the second video coding and decoding protocol information into the conference; for example, still taking over the above example, further, the first terminal joins the conference in video codec protocol N.
Optionally, in this embodiment, joining the conference with the highest priority video codec protocol includes at least two modes:
mode one: joining the conference by actively calling the MCU.
It should be understood that the first terminal may actively call the MCU to join the conference by means of a calling number or an interactive voice and video response (INTERACTIVE VOICE AND VIDEO RESPONSE, IVVR) or the like, and in practical application, may be flexibly adjusted according to a specific application scenario.
Mode two: and actively adding the conference through the MCU.
It should also be understood that the first terminal may also join the conference passively, i.e. the conference manager adds the first terminal actively through the MCU, the first terminal joining the conference at this time.
Optionally, the network quality parameter in the present embodiment includes, but is not limited to, a packet loss rate, a network jitter, and a network delay, and optionally, the network quality parameter includes any one or any combination of a packet loss rate, a network jitter, and a network delay.
S102: and adjusting the encoding and decoding capacity according to the network quality parameters.
Optionally, in this embodiment, the codec capability is adjusted according to the network quality parameter, including at least two cases:
In the first case, when the corresponding value of the network quality parameter is within a preset first threshold range, the current network condition is judged to be in a first level, and the transmission rate of the current coding and decoding is adjusted.
It should be appreciated that adjusting the transmission rate of the current codec includes: decreasing the transmission rate of the codec or increasing the transmission rate of the codec.
For a better understanding, a specific example is described herein:
For example, a preset first threshold range is set as [ A1, A2], meanwhile, a network quality parameter is set as a packet loss rate, when a terminal obtains that a corresponding value of the packet loss rate is within the first threshold range as [ A1, A2] after passing through strategies such as forward error correction (Forward Error Correction, FEC) or packet loss strategy compensation, the current network condition is determined to be in a first level at this time, and the transmission rate of the current coding and decoding is adjusted; specifically, let the previous packet loss rate correspond to A1, and this time the packet loss rate is A2, where A1 and A2 are both in [ A1, A2], when A1> A2, the transmission rate of the current codec should be increased, and when A2> A1, the transmission rate of the current codec should be decreased.
It should be noted that, what is listed here is only a specific example, in practical application, flexible adjustment needs to be made according to a specific application scenario, and meanwhile, the preset first threshold value and the reduced or increased transmission rate value are flexibly set by a developer according to experiments or experience.
And secondly, when the corresponding value of the network quality parameter is in a preset second threshold range, judging that the current network condition is in a second level, and adjusting the resolution and/or the frame rate of the current encoding and decoding.
It should be appreciated that adjusting the resolution and/or frame rate of the current codec includes: the resolution and/or frame rate of the codec is reduced or the resolution and/or frame rate of the codec is increased.
For a better understanding, a specific example is still described herein:
For example, a preset second threshold range is set as [ A3, A4], meanwhile, a network quality parameter is set as a packet loss rate, when a terminal obtains that a corresponding value of the packet loss rate is within the second threshold range as [ A3, A4] after passing through strategies such as forward error correction (Forward Error Correction, FEC) or packet loss strategy compensation, the current network condition is determined to be in a second level at this time, and the resolution and/or frame rate of the current coding and decoding are adjusted; specifically, let the previous packet loss rate correspond to A3, and this time the packet loss rate is A4, where A3 and A4 are both within [ A3, A4], when A3> A4, the resolution and/or frame rate of the current codec should be increased, and when A4> A3, the resolution and/or frame rate of the current codec should be decreased.
It should be noted that, what is illustrated here is only a specific example, in practical applications, flexible adjustment needs to be made according to specific application scenarios, and meanwhile, the second threshold value and the reduced or increased resolution and/or frame rate value are flexibly set by the developer according to experiments or experience.
It should be noted that, the maximum value of the preset first threshold range is smaller than the minimum value of the preset second threshold range, for example, the above examples are taken as examples, and the magnitude relationship of A1, A2, A3, and A4 is A1< A2< A3< A4.
S103: and encoding and decoding the media file by utilizing the adjusted encoding and decoding capability.
It should be appreciated that after the adjusted codec capability, the media file is further encoded using the adjusted codec capability.
S104: and sending the coded and decoded media stream and the network quality parameters to a multipoint control unit MCU.
It should be appreciated that further, the encoded and decoded media stream and the acquired network quality parameters are sent to the MCU.
S105: a media stream is received from the MCU.
It should also be appreciated that the first terminal also receives a media stream from the MCU transmission.
In order to solve the problems that in the prior art, video images are not smooth or have poor effects and user experience is poor in part of terminals due to network reasons in a conference, in the embodiment of the invention, an MCU receives a media stream from a first terminal and network quality parameters in the video conference process, adjusts encoding and decoding capabilities according to the network quality parameters, and encodes and decodes the media stream to be transmitted by utilizing the adjusted encoding and decoding capabilities, wherein the media stream to be transmitted is from other participant terminals except the first terminal, and transmits the encoded and decoded media stream to the first terminal; referring to fig. 3, fig. 3 is a basic flow chart of a video conference method according to the present embodiment.
S301: a media stream from a first terminal and network quality parameters are received during a video conference.
Optionally, the MCU in this embodiment is compatible with at least two video codec protocols, so in this embodiment, before receiving the media stream from the first terminal and the network quality parameters during the video conference, at least the following steps are further included, as shown in fig. 4:
S401: first video codec protocol information is received from the first terminal, the first video codec protocol information including video codec protocols supported by the first terminal.
First, the first terminal in this embodiment supports at least one video codec protocol; for example, the first terminal supports two video codec protocols, N, K, and at this time, the first terminal sends first video codec protocol information to the MCU, where the first video codec protocol information includes N, K, and the MCU receives the first video codec protocol information from the first terminal side.
S402: and sequencing the priorities of the video coding and decoding protocols, wherein the priority of the video coding and decoding protocol corresponding to the video conference with better quality is higher, and the second video coding and decoding protocol information is determined, and the second video coding and decoding protocol information comprises the video coding and decoding protocol with the highest priority supported by the first terminal.
Then, the MCU judges the video coding and decoding protocol supported by the first terminal side, determines a video coding and decoding protocol with the best video conference quality for the first terminal, determines the priority of the video coding and decoding protocol as the highest, adds the video coding and decoding protocol to the second video coding and decoding protocol information and sends the video coding and decoding protocol information to the first terminal; for example, in carrying the above example, further, the MCU determines that the video codec protocol N has the highest priority, i.e., the second video codec protocol information includes N.
S403: and sending the second video coding and decoding protocol information to the first terminal.
Finally, the MCU sends second video coding and decoding protocol information corresponding to the video coding and decoding protocol with the highest priority supported by the first terminal to the first terminal side; for example, still taking over the above example, further, the MCU transmits second video codec protocol information to the first terminal.
Optionally, the network quality parameter in the present embodiment includes, but is not limited to, a packet loss rate, a network jitter, and a network delay, and optionally, the network quality parameter includes any one or any combination of a packet loss rate, a network jitter, and a network delay.
S302: and adjusting the encoding and decoding capacity according to the network quality parameters.
Optionally, in this embodiment, the codec capability is adjusted according to the network quality parameter, including at least two cases:
And in the first case, when the corresponding value of the network quality parameter is in a preset third threshold range, judging that the current network condition is in a third level, and adjusting the transmission rate of the current coding and decoding.
It should be appreciated that adjusting the transmission rate of the current codec includes: decreasing the transmission rate of the codec or increasing the transmission rate of the codec.
For a better understanding, a specific example is described herein:
For example, a preset third threshold range is set as [ B1, B2], meanwhile, a network quality parameter is set as a packet loss rate, when a terminal obtains that a corresponding value of the packet loss rate is within the third threshold range as [ B1, B2] after passing through a strategy such as forward error correction (ForwBrd Error Correction, FEC) or packet loss strategy compensation, the current network condition is determined to be in a third level at this time, and the transmission rate of the current codec is adjusted; specifically, let the previous packet loss rate correspond to B1, and this time the packet loss rate is B2, where B1 and B2 are both in [ B1, B2], and when B1> B2, the transmission rate of the current codec should be increased, and when B2> B1, the transmission rate of the current codec should be decreased.
It should be noted that, what is listed here is only a specific example, in practical application, flexible adjustment needs to be made according to a specific application scenario, and meanwhile, the third threshold value and the reduced or increased transmission rate value are preset flexibly by a developer according to experiments or experience.
And secondly, when the corresponding value of the network quality parameter is in a preset fourth threshold range, judging that the current network condition is in a fourth level, and adjusting the resolution and/or the frame rate of the current encoding and decoding.
It should be appreciated that adjusting the resolution and/or frame rate of the current codec includes: the resolution and/or frame rate of the codec is reduced or the resolution and/or frame rate of the codec is increased.
For a better understanding, a specific example is still described herein:
for example, a preset fourth threshold range is set as [ B3, B4], meanwhile, a network quality parameter is set as a packet loss rate, when a terminal obtains a corresponding value of the packet loss rate within the fourth threshold range as [ B3, B4] after passing through a strategy such as forward error correction (ForwBrd Error Correction, FEC) or packet loss strategy compensation, the current network condition is determined to be in a fourth level at this time, and the resolution and/or frame rate of the current codec are adjusted; specifically, let the previous packet loss rate correspond to B3, and this packet loss rate is B4, where B3 and B4 are both in [ B3, B4], and when B3> B4, the resolution and/or frame rate of the current codec should be increased, and when B4> B3, the resolution and/or frame rate of the current codec should be decreased.
It should be noted that, what is illustrated here is only a specific example, in practical applications, flexible adjustment needs to be made according to specific application scenarios, and meanwhile, the fourth threshold value and the reduced or increased resolution and/or frame rate value are flexibly set by the developer according to experiments or experience.
Here, the maximum value of the preset third threshold range is smaller than the minimum value of the preset fourth threshold range, and for example, the above examples are described as examples, and the magnitude relationship of B1< B2< B3< B4 is B1, B2, B3, and B4.
It should be further noted that the preset first threshold range may be equal to or different from the preset third threshold range, and the preset second threshold range may be equal to or different from the preset fourth threshold range, so that in practical application, the adjustment may be flexibly performed according to a specific application scenario.
Optionally, in this embodiment, after reducing the transmission rate of the codec or reducing the resolution and/or the frame rate of the codec, the method further includes: the excess codec resources are freed up for other videoconferencing uses.
Optionally, in this embodiment, before increasing the transmission rate of the codec or increasing the resolution and/or the frame rate of the codec, the method further includes: and acquiring the coding and decoding resources.
S303: and encoding and decoding the media stream to be transmitted by utilizing the adjusted encoding and decoding capability, wherein the media stream to be transmitted is from other reference terminals except the first terminal.
It should be appreciated that after the adjusted codec capability, the media stream to be transmitted is further encoded and decoded by using the adjusted codec capability, where the media stream to be transmitted is from a reference terminal other than the first terminal.
S304: and sending the coded and decoded media stream to the first terminal.
It should be appreciated that further, the encoded and decoded media stream is transmitted to the first terminal.
According to the video conference method provided by the embodiment of the invention, the first terminal acquires the network quality parameters in the video conference process, so that the encoding and decoding capability is adjusted according to the network quality parameters, the media file is encoded and decoded by utilizing the adjusted encoding and decoding capability, and the encoded and decoded media stream and the network quality parameters are sent to the multipoint control unit MCU; further, the MCU receives a media stream from the first terminal and network quality parameters, adjusts the encoding and decoding capability according to the network quality parameters, and encodes and decodes the media stream to be transmitted by utilizing the adjusted encoding and decoding capability, wherein the media stream to be transmitted is from other reference terminals except the first terminal, and further transmits the encoded and decoded media stream to the first terminal; further, the first terminal receives a media stream from the MCU; the problems that in the prior art, video images of part of terminals are unsmooth or poor in effect and user experience degree is poor due to network reasons in a conference are solved; the method and the device realize the dynamic adjustment of the encoding and decoding capacities by combining the current network quality parameters in the video conference process, greatly improve the effect of video conference images and further improve the experience satisfaction of users.
Meanwhile, in the video conference method provided by the embodiment of the invention, the MCU is compatible with at least two video coding and decoding protocols, namely compatible with the video coding and decoding protocols supported by terminals of all manufacturers, so that the complex operation that the existing MCU only supports a single video coding and decoding protocol and can enter a conference only by configuring the video coding and decoding protocol before participating in the conference is avoided; and the MCU ensures that each terminal can enter the conference with the optimal capability, so that the effect of video conference images is further improved, and the experience satisfaction degree of users is further improved.
Embodiment two:
In order to solve the problems that in the prior art, video images of part of terminals are unsmooth or poor in effect and user experience degree is poor due to network reasons in a conference, the embodiment of the invention provides a video conference method.
Step one: a first terminal acquires network quality parameters in the video conference process, adjusts the encoding and decoding capability according to the network quality parameters, encodes and decodes a media file by utilizing the adjusted encoding and decoding capability, and sends the encoded and decoded media stream and the network quality parameters to a multipoint control unit MCU;
step two: the MCU receives a media stream from a first terminal and network quality parameters in the video conference process, adjusts the encoding and decoding capability according to the network quality parameters, encodes and decodes the media stream to be transmitted by utilizing the adjusted encoding and decoding capability, and transmits the encoded and decoded media stream to the first terminal when the media stream to be transmitted comes from other participant terminals except the first terminal;
Step three: the first terminal receives a media stream from the MCU.
It should be noted that, in order to avoid redundancy, not all examples in the first embodiment are not fully described in the present embodiment, and it should be clear that all examples in the first embodiment are applicable to the present embodiment.
The video conference method provided by the embodiment of the invention solves the problems that in the prior art, partial terminals have unsmooth video images or poor effects due to network reasons, and the user experience is poor; the method and the device realize the dynamic adjustment of the encoding and decoding capacities by combining the current network quality parameters in the video conference process, greatly improve the effect of video conference images and further improve the experience satisfaction of users.
Embodiment III:
on the basis of the foregoing embodiments, the embodiments of the present invention provide a specific video conference method process, as shown in fig. 5, and fig. 5 is a basic flow diagram of the video conference method provided in the present embodiment.
S501: the first terminal sends first video codec protocol information to the MCU, wherein the first video codec protocol information includes each video codec protocol supported by the first terminal.
S502: the MCU receives first video coding and decoding protocol information from the first terminal, and prioritizes the video coding and decoding protocols, wherein the higher the priority of the video coding and decoding protocol corresponding to the video conference with better quality is, the second video coding and decoding protocol information is determined, and the second video coding and decoding protocol information comprises the video coding and decoding protocol with highest priority supported by the first terminal.
S503: and sending the second video coding and decoding protocol information to the first terminal.
S504: the first terminal joins the conference in the video codec protocol with the highest priority.
S505: the first terminal acquires network quality parameters in the video conference process.
S506: the first terminal adjusts the encoding and decoding capability according to the network quality parameters.
S507: and the first terminal utilizes the adjusted encoding and decoding capability to encode and decode the media file.
S508: and the first terminal sends the coded and decoded media stream and the network quality parameters to the MCU.
S509: the MCU receives the media stream from the first terminal and the network quality parameter, and adjusts the encoding and decoding capability according to the network quality parameter.
S510: and the MCU utilizes the adjusted encoding and decoding capability to encode and decode the media stream to be transmitted, wherein the media stream to be transmitted is from other participant terminals except the first terminal.
S511: and the MCU sends the coded and decoded media stream to the first terminal.
The video conference method provided by the embodiment of the invention realizes better capability interaction of each terminal in the video conference, and each terminal in the video conference can select more adaptive coding and decoding capability according to the real-time condition of the network, thereby ensuring the quality of the video conference and improving the video conference experience of users.
Embodiment four:
The embodiment of the invention provides a specific video conference method process based on the embodiment.
First, an example of "adjusting codec capability according to network quality parameters" will be described with reference to fig. 6.
S601: and acquiring the packet loss rate in the video conference process.
S602: judging whether the packet loss rate is within a preset first threshold range or not;
if yes, S603 is executed, and if no, S604 is executed.
S603: and judging that the current network condition is at a first level, and adjusting the transmission rate of the current encoding and decoding.
S604: judging whether the packet loss rate is within a preset second threshold range or not;
If yes, S605 is executed, and if no, the flow is ended.
S605: and judging that the current network condition is at a second level, and adjusting the resolution and/or the frame rate of the current encoding and decoding.
Next, taking the MCU side as an example, the "adjusting the codec capability according to the network quality parameter" will be described as shown in fig. 7.
S701: and acquiring the packet loss rate in the video conference process.
S702: judging whether the packet loss rate is within a preset third threshold range or not;
If yes, S703 is executed, and if no, S704 is executed.
S703: and judging that the current network condition is in a third level, and adjusting the transmission rate of the current encoding and decoding.
S704: judging whether the packet loss rate is within a preset fourth threshold range or not;
if yes, S705 is executed, if no, the flow is ended.
S705: and judging that the current network condition is in a fourth level, judging that the current network condition is in the fourth level, and adjusting the resolution and/or the frame rate of the current encoding and decoding.
The video conference method provided by the embodiment of the invention realizes that each terminal in the video conference selects more adaptive coding and decoding capacity according to the real-time condition of the network, such as transmission rate, resolution, frame rate and the like, ensures the quality of the video conference and improves the video conference experience of users.
Fifth embodiment:
The embodiment of the invention provides a specific video conference method process based on the embodiment.
Taking the MCU side as an example, the "adjusting the codec capability according to the network quality parameter" will be described as shown in fig. 8.
S801: and acquiring the packet loss rate in the video conference process.
S802: judging whether the packet loss rate is within a preset third threshold range or not;
If yes, S803 is executed, and if no, S808 is executed.
S803: judging whether the transmission rate of the current coding and decoding needs to be reduced or not;
If yes, S804 is executed, and if no, S806 is executed.
S804: and reducing the transmission rate of the current coding and decoding.
S805: the excess codec resources are freed up for other videoconferencing uses.
S806: and acquiring the coding and decoding resources.
S807: the transmission rate of the current codec is increased.
S808: judging whether the packet loss rate is within a preset fourth threshold range or not;
If yes, S809 is executed, if no, the flow ends.
S809: judging whether the resolution and/or the frame rate of the current encoding and decoding are required to be reduced or not;
if yes, S910 is executed, and if no, S912 is executed.
S810: the resolution and/or frame rate of the current codec is reduced.
S811: the excess codec resources are freed up for other videoconferencing uses.
S812: and acquiring the coding and decoding resources.
S813: the resolution and/or frame rate of the current codec is increased.
According to the video conference method provided by the embodiment of the invention, under the condition of network deterioration, the encoding and decoding resources are effectively released so as to be used for other video conferences, and the efficient use of the conference encoding and decoding resources is effectively ensured.
Example six:
In order to solve the problem that in the prior art, in a conference, a part of terminals have unsmooth video images or poor effects due to network reasons, and the user experience is poor, in an embodiment of the present invention, a first terminal is provided, and as shown in fig. 9, the first terminal includes a first acquisition module 901, a first adjustment module 902, a first codec module 903, a first sending module 904, and a first receiving module 905; wherein,
The first obtaining module 901 is configured to obtain a network quality parameter during a video conference;
The first adjustment module 902 is configured to adjust the codec capability according to the network quality parameter;
the first codec module 903 is configured to codec the media file using the adjusted codec capability;
The first sending module 904 is configured to send the encoded and decoded media stream and the network quality parameter to the multipoint control unit MCU;
the first receiving module 905 is configured to receive a media stream from the MCU.
Optionally, the first sending module 904 is further configured to send first video codec protocol information to the MCU before acquiring the network quality parameter during the video conference, where the first video codec protocol information includes each video codec protocol supported by the first terminal.
Optionally, the first receiving module 905 is further configured to receive second video codec protocol information from the MCU, where the second video codec protocol information includes a video codec protocol with a highest priority supported by the first terminal, and further, the first terminal joins the conference with the video codec protocol with the highest priority.
Optionally, the first adjustment module 902 adjusts the codec capability according to the network quality parameter, including at least two cases:
In the first case, when the corresponding value of the network quality parameter is within a preset first threshold range, the current network condition is judged to be in a first level, and the transmission rate of the current coding and decoding is adjusted.
It should be appreciated that adjusting the transmission rate of the current codec includes: decreasing the transmission rate of the codec or increasing the transmission rate of the codec.
And secondly, when the corresponding value of the network quality parameter is in a preset second threshold range, judging that the current network condition is in a second level, and adjusting the resolution and/or the frame rate of the current encoding and decoding.
It should be appreciated that adjusting the resolution and/or frame rate of the current codec includes: the resolution and/or frame rate of the codec is reduced or the resolution and/or frame rate of the codec is increased.
In order to solve the problem that in the prior art, video images of part of terminals are not smooth or have poor effects due to network reasons, and the user experience is poor in a conference, in an embodiment of the present invention, an MCU is provided, and as shown in fig. 10, the MCU includes a second receiving module 1001, a second adjusting module 1002, a second encoding and decoding module 1003, and a second transmitting module 1004; wherein,
The second receiving module 1001 is configured to receive a media stream and a network quality parameter from the first terminal during a video conference;
the second adjustment module 1002 is configured to adjust the codec capability according to the network quality parameter;
the second codec module 1003 is configured to codec a media stream to be sent by using the adjusted codec capability, where the media stream to be sent is from other participant terminals except the first terminal;
the second sending module 1004 is configured to send the encoded and decoded media stream to the first terminal.
Optionally, the MCU is compatible with at least two video codec protocols, and the second receiving module 1001 is further configured to receive, before receiving the media stream and the network quality parameter from the first terminal during the video conference, first video codec protocol information from the first terminal, where the first video codec protocol information includes each video codec protocol supported by the first terminal.
Optionally, the MCU further includes a determining module, where the determining module is configured to prioritize the video codec protocols, and the video codec protocols correspond to higher priorities of video codec protocols with better video conference quality, determine second video codec protocol information, where the second video codec protocol information includes a video codec protocol with a highest priority supported by the first terminal, and further, the second sending module 1004 sends the second video codec protocol information to the first terminal.
Optionally, the second adjustment module 1002 adjusts the codec capability according to the network quality parameter, including at least two cases:
And in the first case, when the corresponding value of the network quality parameter is in a preset third threshold range, judging that the current network condition is in a third level, and adjusting the transmission rate of the current coding and decoding.
It should be appreciated that adjusting the transmission rate of the current codec includes: decreasing the transmission rate of the codec or increasing the transmission rate of the codec.
And secondly, when the corresponding value of the network quality parameter is in a preset fourth threshold range, judging that the current network condition is in a fourth level, and adjusting the resolution and/or the frame rate of the current encoding and decoding.
It should be appreciated that adjusting the resolution and/or frame rate of the current codec includes: the resolution and/or frame rate of the codec is reduced or the resolution and/or frame rate of the codec is increased.
Optionally, in this embodiment, the transmission rate of the codec is reduced, or after the resolution and/or frame rate of the codec is reduced, the redundant codec resources are released for other videoconferences.
Optionally, in this embodiment, the transmission rate of the codec is increased, or the codec resource is acquired before the resolution and/or the frame rate of the codec are increased.
It should be noted that, in order to avoid redundancy, not all examples of the first to fifth embodiments are not fully described in the present embodiment, and it should be clear that all examples of the first to fifth embodiments are applicable to the present embodiment.
The first terminal and the MCU provided by the embodiment of the invention solve the problems that in the prior art, partial terminals have unsmooth video images or poor effects and poor user experience degree due to network reasons in a conference; compared with the prior art, the first terminal and the MCU provided by the embodiment of the invention realize the dynamic adjustment of the encoding and decoding capacities by combining the current network quality parameters in the video conference process, so that the effect of video conference images is greatly improved, and the experience satisfaction of users is further improved.
Meanwhile, the MCU provided by the embodiment of the invention is compatible with at least two video coding and decoding protocols, namely compatible with the video coding and decoding protocols supported by terminals of all manufacturers, so that the complex operation that the existing MCU only supports a single video coding and decoding protocol and can enter a conference only by configuring the video coding and decoding protocol before participating in the conference is avoided; and the MCU ensures that each terminal can enter the conference with the optimal capability, so that the effect of video conference images is further improved, and the experience satisfaction degree of users is further improved.
Embodiment seven:
In order to solve the problem that in the prior art, in a conference, a part of terminals have unsmooth video images or poor effects due to network reasons, and the user experience is poor, a system is provided in an embodiment of the present invention, and as shown in fig. 11, the system includes an MCU1101 as described in embodiment six and at least two first terminals 1102 as described in embodiment six; wherein,
The first terminal 1102 is configured to obtain a network quality parameter during a video conference, adjust a codec capability according to the network quality parameter, codec a media file with the adjusted codec capability, and send a media stream after codec and the network quality parameter to the MCU1101;
in the video conference process, the MCU1101 receives a media stream and network quality parameters from the first terminal 1102, adjusts the encoding and decoding capability according to the network quality parameters, encodes and decodes a media stream to be transmitted by using the adjusted encoding and decoding capability, and transmits the encoded and decoded media stream to the first terminal 1102 from other reference terminals (i.e. other first terminals which are references) except the first terminal 1102;
the first terminal 1102 is also operable to receive a media stream from the MCU 1101.
It should be understood that only the process of interaction between one first terminal and the MCU is taken as an example, and the process of interaction between other first terminals and the MCU is the same, which is not described herein.
Meanwhile, the embodiment of the invention also provides a storage medium (i.e. a computer readable storage medium), wherein the storage medium stores one or more first computer programs, and the one or more first computer programs can be executed by one or more processors, so as to implement the steps of the video conference method corresponding to the first terminal; or the storage medium stores one or more second computer programs executable by one or more processors to implement the steps of the MCU-corresponding video conferencing method as described above.
Computer-readable storage media include volatile or nonvolatile, removable or non-removable media implemented in any method or technology for storage of information such as computer-readable instructions, data structures, computer program modules or other data. Computer-readable storage media includes, but is not limited to, RAM (Random Access Memory ), ROM (Read-Only Memory), EEPROM (ELECTRICALLY ERASABLE PROGRAMMABLE READ ONLY MEMORY, charged erasable programmable Read-Only Memory), flash Memory or other Memory technology, CD-ROM (Compact Disc Read-Only Memory), digital Versatile Disks (DVD) or other optical disk storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to store the desired information and which can be accessed by a computer.
It will be apparent to one skilled in the art that all or some of the steps of the methods, systems, functional modules/units in the apparatus disclosed above may be implemented as software (which may be implemented in program code executable by a computing apparatus), firmware, hardware, and suitable combinations thereof. In a hardware implementation, the division between the functional modules/units mentioned in the above description does not necessarily correspond to the division of physical components; for example, one physical component may have multiple functions, or one function or step may be performed cooperatively by several physical components. Some or all of the physical components may be implemented as software executed by a processor, such as a central processing unit, digital signal processor, or microprocessor, or as hardware, or as an integrated circuit, such as an application specific integrated circuit. Such software may be distributed on computer-readable media, which may include computer storage media (or non-transitory media) and communication media (or transitory media), for execution by a computing device, and in some cases, the steps shown or described may be performed in a different order than that described herein. The term computer storage media includes both volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data, as known to those skilled in the art.
Furthermore, as is well known to those of ordinary skill in the art, communication media typically embodies computer readable instructions, data structures, program modules or other data in a modulated data signal such as a carrier wave or other transport mechanism and includes any information delivery media. Therefore, the present invention is not limited to any specific combination of hardware and software.
The foregoing is a further detailed description of embodiments of the invention in connection with the specific embodiments, and it is not intended that the invention be limited to the specific embodiments described. It will be apparent to those skilled in the art that several simple deductions or substitutions may be made without departing from the spirit of the invention, and these should be considered to be within the scope of the invention.

Claims (13)

1. A video conference method is applied to a first terminal and comprises the following steps:
Acquiring network quality parameters in the video conference process;
Adjusting the encoding and decoding capacity according to the network quality parameters;
Encoding and decoding the media file by utilizing the adjusted encoding and decoding capability;
transmitting the coded and decoded media stream and the network quality parameter to a multipoint control unit MCU;
Receiving a media stream from the MCU; the media stream of the MCU is a media stream obtained by encoding and decoding a media stream to be transmitted by the MCU based on the adjusted encoding and decoding capability of the MCU, and the media stream to be transmitted is from other participant terminals except the first terminal;
the network quality parameters include network jitter;
before the network quality parameters are acquired in the video conference process, the method further comprises the following steps:
Transmitting first video coding and decoding protocol information to the MCU, wherein the first video coding and decoding protocol information comprises all video coding and decoding protocols supported by a first terminal;
Receiving second video coding and decoding protocol information from the MCU, wherein the second video coding and decoding protocol information comprises a video coding and decoding protocol with highest priority supported by a first terminal; the video coding and decoding protocol with the highest priority is the video coding and decoding protocol with the best video conference quality relative to the first terminal;
And joining the conference by the video coding and decoding protocol with the highest priority.
2. The video conferencing method of claim 1 wherein said adjusting codec capability based on said network quality parameter comprises:
When the corresponding value of the network quality parameter is within a preset first threshold value range, judging that the current network condition is at a first level, and adjusting the transmission rate of the current coding and decoding;
When the corresponding value of the network quality parameter is within a preset second threshold range, judging that the current network condition is at a second level, and adjusting the resolution and/or frame rate of the current encoding and decoding;
The maximum value of the preset first threshold range is smaller than the minimum value of the preset second threshold range.
3. The video conferencing method of claim 1, wherein joining the conference in the highest priority video codec protocol comprises:
Joining a conference by actively calling the MCU;
Or alternatively, the first and second heat exchangers may be,
And actively adding the conference through the MCU.
4. A videoconference method according to any of claims 1-3, wherein said network quality parameter comprises at least one of packet loss rate, network latency.
5. A video conference method applied to a multipoint control unit MCU, comprising:
Receiving a media stream from a first terminal and network quality parameters in a video conference process, wherein the media stream of the first terminal is obtained by encoding and decoding a media file by the first terminal based on the adjusted encoding and decoding capability of the first terminal;
Adjusting the encoding and decoding capacity according to the network quality parameters;
Encoding and decoding a media stream to be transmitted by utilizing the adjusted encoding and decoding capability, wherein the media stream to be transmitted is from other participant terminals except the first terminal;
Transmitting the coded and decoded media stream to a first terminal;
the network quality parameters include network jitter;
the MCU is compatible with at least two video coding and decoding protocols;
before receiving the media stream and the network quality parameter from the first terminal in the video conference process, the method further comprises:
Receiving first video coding and decoding protocol information from a first terminal, wherein the first video coding and decoding protocol information comprises all video coding and decoding protocols supported by the first terminal;
The priority ordering is carried out on the video coding and decoding protocols, wherein the priority of the video coding and decoding protocol corresponding to the video conference with better quality is higher, and second video coding and decoding protocol information is determined, and the second video coding and decoding protocol information comprises the video coding and decoding protocol with highest priority supported by the first terminal; the video coding and decoding protocol with the highest priority is the video coding and decoding protocol with the best video conference quality relative to the first terminal;
And sending the second video coding and decoding protocol information to the first terminal.
6. The video conferencing method of claim 5 wherein said adjusting codec capability based on said network quality parameter comprises:
when the corresponding value of the network quality parameter is within a preset third threshold value range, judging that the current network condition is at a third level, and adjusting the transmission rate of the current coding and decoding;
When the corresponding value of the network quality parameter is in a preset fourth threshold range, judging that the current network condition is in a fourth level, and adjusting the resolution and/or frame rate of the current encoding and decoding;
the maximum value of the preset third threshold range is smaller than the minimum value of the preset fourth threshold range.
7. The video conferencing method of claim 5, wherein the adjusting the transmission rate of the current codec comprises: decreasing the transmission rate of the codec or increasing the transmission rate of the codec;
the adjusting the resolution and/or frame rate of the current codec includes: decreasing the resolution and/or frame rate of the codec, or increasing the resolution and/or frame rate of the codec;
the method further comprises the following steps of: releasing redundant coding and decoding resources for other video conferences;
The method further comprises the following steps of: and acquiring the coding and decoding resources.
8. The video conferencing method of any of claims 5-7 wherein the network quality parameter comprises at least one of a packet loss rate, a network delay.
9. A video conferencing method, comprising:
A first terminal acquires network quality parameters in the video conference process, adjusts encoding and decoding capabilities according to the network quality parameters, encodes and decodes a media file by utilizing the adjusted encoding and decoding capabilities, and sends the encoded and decoded media stream and the network quality parameters to a multipoint control unit MCU;
The MCU receives a media stream from a first terminal and network quality parameters in the video conference process, adjusts coding and decoding capabilities according to the network quality parameters, and codes and decodes the media stream to be sent by utilizing the adjusted coding and decoding capabilities, wherein the media stream to be sent is from other reference terminals except the first terminal, and sends the coded and decoded media stream to the first terminal;
the first terminal receives a media stream from the MCU;
the network quality parameters include network jitter;
before acquiring the network quality parameter, the first terminal is further configured to: transmitting first video coding and decoding protocol information to the MCU, wherein the first video coding and decoding protocol information comprises all video coding and decoding protocols supported by a first terminal; receiving second video coding and decoding protocol information from the MCU, wherein the second video coding and decoding protocol information comprises a video coding and decoding protocol with highest priority supported by a first terminal; joining the conference by the video coding and decoding protocol with the highest priority;
the MCU is compatible with at least two video coding and decoding protocols;
Before receiving the media stream and the network quality parameter from the first terminal, the MCU is further used for receiving first video coding and decoding protocol information from the first terminal, wherein the first video coding and decoding protocol information comprises all video coding and decoding protocols supported by the first terminal; the priority ordering is carried out on the video coding and decoding protocols, wherein the priority of the video coding and decoding protocol corresponding to the video conference with better quality is higher, and second video coding and decoding protocol information is determined, and the second video coding and decoding protocol information comprises the video coding and decoding protocol with highest priority supported by the first terminal; and sending the second video coding and decoding protocol information to the first terminal.
10. A first terminal, the first terminal comprising: the device comprises a first acquisition module, a first adjustment module, a first coding and decoding module, a first sending module and a first receiving module;
The first acquisition module is used for acquiring network quality parameters in the video conference process;
the first adjusting module is used for adjusting the encoding and decoding capacity according to the network quality parameters;
the first encoding and decoding module is used for encoding and decoding the media file by utilizing the adjusted encoding and decoding capability;
the first sending module is used for sending the coded and decoded media stream and the network quality parameter to the multipoint control unit MCU;
The first receiving module is used for receiving the media stream from the MCU; the network quality parameters include network jitter; the media stream of the MCU is a media stream obtained by encoding and decoding a media stream to be transmitted by the MCU based on the adjusted encoding and decoding capability of the MCU, and the media stream to be transmitted is from other participant terminals except the first terminal;
the first sending module is further configured to send first video codec protocol information to the MCU before acquiring the network quality parameter in the video conference process, where the first video codec protocol information includes each video codec protocol supported by the first terminal;
The first receiving module is further configured to receive second video codec protocol information from the MCU, where the second video codec protocol information includes a video codec protocol with a highest priority supported by the first terminal, and further, the first terminal joins the conference with the video codec protocol with the highest priority; the video codec protocol with the highest priority is the video codec protocol with the best video conference quality relative to the first terminal.
11. A multipoint control unit MCU, the MCU comprising: the device comprises a second receiving module, a second adjusting module, a second encoding and decoding module and a second sending module;
The second receiving module is used for receiving a media stream from a first terminal and network quality parameters in the video conference process, wherein the media stream of the first terminal is obtained by encoding and decoding a media file by the first terminal based on the adjusted encoding and decoding capability of the first terminal;
The second adjusting module is used for adjusting the encoding and decoding capacity according to the network quality parameters;
The second encoding and decoding module is used for encoding and decoding a media stream to be transmitted by utilizing the adjusted encoding and decoding capability, wherein the media stream to be transmitted is from other participant terminals except the first terminal;
the second sending module is used for sending the coded and decoded media stream to the first terminal;
the network quality parameters include network jitter;
the MCU is compatible with at least two video coding and decoding protocols;
the second receiving module is further configured to receive first video codec protocol information from the first terminal before receiving the media stream and the network quality parameter from the first terminal in the video conference process, where the first video codec protocol information includes each video codec protocol supported by the first terminal;
The MCU comprises a determining module, wherein the determining module is used for sequencing the priorities of the video coding and decoding protocols, the higher the priority of the video coding and decoding protocol corresponding to the better video conference quality is, the second video coding and decoding protocol information is determined, and the second video coding and decoding protocol information comprises the video coding and decoding protocol with the highest priority supported by the first terminal; the second sending module is further configured to send the second video codec protocol information to the first terminal, where the video codec protocol with the highest priority is a video codec protocol with the best video conference quality relative to the first terminal.
12. A video conference system, characterized in that the video conference system comprises a multipoint control unit MCU and at least two first terminals;
The first terminal is used for acquiring network quality parameters in the video conference process, adjusting the encoding and decoding capability according to the network quality parameters, encoding and decoding the media file by utilizing the adjusted encoding and decoding capability, and transmitting the encoded and decoded media stream and the network quality parameters to the MCU;
The MCU receives a media stream from the first terminal and network quality parameters in the video conference process, adjusts the encoding and decoding capability according to the network quality parameters, and utilizes the adjusted encoding and decoding capability to encode and decode a media stream to be transmitted, wherein the media stream to be transmitted is from other reference terminals except the first terminal, and the encoded and decoded media stream is transmitted to the first terminal;
the first terminal is also used for receiving a media stream from the MCU;
the network quality parameters include network jitter;
before acquiring the network quality parameter, the first terminal is further configured to: transmitting first video coding and decoding protocol information to the MCU, wherein the first video coding and decoding protocol information comprises all video coding and decoding protocols supported by a first terminal; receiving second video coding and decoding protocol information from the MCU, wherein the second video coding and decoding protocol information comprises a video coding and decoding protocol with highest priority supported by a first terminal; joining the conference by the video coding and decoding protocol with the highest priority;
the MCU is compatible with at least two video coding and decoding protocols;
Before receiving the media stream and the network quality parameter from the first terminal, the MCU is further used for receiving first video coding and decoding protocol information from the first terminal, wherein the first video coding and decoding protocol information comprises all video coding and decoding protocols supported by the first terminal; the priority ordering is carried out on the video coding and decoding protocols, wherein the priority of the video coding and decoding protocol corresponding to the video conference with better quality is higher, and second video coding and decoding protocol information is determined, and the second video coding and decoding protocol information comprises the video coding and decoding protocol with highest priority supported by the first terminal; and sending the second video coding and decoding protocol information to the first terminal.
13. A storage medium storing one or more first computer programs executable by one or more processors to implement the steps of the videoconferencing method of any of claims 1 to 4;
Or alternatively, the first and second heat exchangers may be,
The storage medium stores one or more second computer programs executable by one or more processors to implement the steps of the videoconferencing method of any of claims 6 to 8.
CN201910872672.4A 2019-09-16 2019-09-16 Video conference method, first terminal, MCU, system and storage medium Active CN112511782B (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201910872672.4A CN112511782B (en) 2019-09-16 2019-09-16 Video conference method, first terminal, MCU, system and storage medium
PCT/CN2020/109332 WO2021052077A1 (en) 2019-09-16 2020-08-14 Videoconferencing method, first terminal, mcu, system, and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910872672.4A CN112511782B (en) 2019-09-16 2019-09-16 Video conference method, first terminal, MCU, system and storage medium

Publications (2)

Publication Number Publication Date
CN112511782A CN112511782A (en) 2021-03-16
CN112511782B true CN112511782B (en) 2024-05-07

Family

ID=74884010

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910872672.4A Active CN112511782B (en) 2019-09-16 2019-09-16 Video conference method, first terminal, MCU, system and storage medium

Country Status (2)

Country Link
CN (1) CN112511782B (en)
WO (1) WO2021052077A1 (en)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111182239B (en) * 2020-01-12 2021-07-06 苏州浪潮智能科技有限公司 AI video processing method and device
CN113992883B (en) * 2021-10-29 2022-07-29 安徽文香科技有限公司 Video conference processing method, processing device, conference system, and storage medium
CN116781973B (en) * 2022-03-09 2024-04-23 广州开得联智能科技有限公司 Video encoding and decoding method and device, storage medium and electronic equipment
CN115002012B (en) * 2022-08-04 2022-11-15 广州市保伦电子有限公司 Transmission monitoring system for wireless network video conference
CN115378915B (en) * 2022-08-11 2024-01-16 深圳乐播科技有限公司 Data sharing method and electronic equipment

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101155083A (en) * 2006-09-27 2008-04-02 中兴通讯股份有限公司 Network state estimation method based on packet loss rate
CN101883240A (en) * 2010-06-09 2010-11-10 广东威创视讯科技股份有限公司 Video conference system based on MCU (Microprogrammed Control Unit) and video transmission lost packet processing method thereof
CN103209442A (en) * 2012-01-16 2013-07-17 华为终端有限公司 Method and terminal for dynamically setting voice service transmission parameters
CN103686227A (en) * 2012-09-17 2014-03-26 南京中兴力维软件有限公司 Method, device and system for capturing and coding audio/video of mobile terminal
CN103716648A (en) * 2012-10-08 2014-04-09 深圳市子元技术有限公司 Information transmission method for remote teaching system and remote teaching system
CN106209399A (en) * 2015-04-30 2016-12-07 华为技术有限公司 Conference terminal preordering method, Conference server and conference terminal switched system
CN107295286A (en) * 2016-03-31 2017-10-24 掌赢信息科技（上海）有限公司 A kind of video call data transmission method, system, server and video conversation apparatus
CN107770473A (en) * 2016-08-16 2018-03-06 大唐移动通信设备有限公司 A kind of audio, video data transfer control method and device
CN108881780A (en) * 2018-07-17 2018-11-23 聚好看科技股份有限公司 Method, the server of clarity mode are dynamically adjusted in video calling
CN108933914A (en) * 2017-05-24 2018-12-04 中兴通讯股份有限公司 A kind of method and system carrying out video conference using mobile terminal

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TW200805965A (en) * 2006-07-13 2008-01-16 Sunplus Technology Co Ltd Method and system for controlling multimedia QoS in a handheld device
JP5304213B2 (en) * 2008-12-15 2013-10-02 沖電気工業株式会社 Data processing apparatus, program and method, and network system
CN101984661B (en) * 2010-11-23 2012-05-23 广东威创视讯科技股份有限公司 Information transmission method of video conference system and video conference system
CN103888713A (en) * 2014-02-25 2014-06-25 广州市保伦电子有限公司 Video conference communication method
US9106887B1 (en) * 2014-03-13 2015-08-11 Wowza Media Systems, LLC Adjusting encoding parameters at a mobile device based on a change in available network bandwidth
CN105471865A (en) * 2015-11-23 2016-04-06 苏州工业园区云视信息技术有限公司 Method for dynamic network state adaptation of video stream

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101155083A (en) * 2006-09-27 2008-04-02 中兴通讯股份有限公司 Network state estimation method based on packet loss rate
CN101883240A (en) * 2010-06-09 2010-11-10 广东威创视讯科技股份有限公司 Video conference system based on MCU (Microprogrammed Control Unit) and video transmission lost packet processing method thereof
CN103209442A (en) * 2012-01-16 2013-07-17 华为终端有限公司 Method and terminal for dynamically setting voice service transmission parameters
CN103686227A (en) * 2012-09-17 2014-03-26 南京中兴力维软件有限公司 Method, device and system for capturing and coding audio/video of mobile terminal
CN103716648A (en) * 2012-10-08 2014-04-09 深圳市子元技术有限公司 Information transmission method for remote teaching system and remote teaching system
CN106209399A (en) * 2015-04-30 2016-12-07 华为技术有限公司 Conference terminal preordering method, Conference server and conference terminal switched system
CN107295286A (en) * 2016-03-31 2017-10-24 掌赢信息科技（上海）有限公司 A kind of video call data transmission method, system, server and video conversation apparatus
CN107770473A (en) * 2016-08-16 2018-03-06 大唐移动通信设备有限公司 A kind of audio, video data transfer control method and device
CN108933914A (en) * 2017-05-24 2018-12-04 中兴通讯股份有限公司 A kind of method and system carrying out video conference using mobile terminal
CN108881780A (en) * 2018-07-17 2018-11-23 聚好看科技股份有限公司 Method, the server of clarity mode are dynamically adjusted in video calling

Also Published As

Publication number Publication date
WO2021052077A1 (en) 2021-03-25
CN112511782A (en) 2021-03-16

Similar Documents

Publication Publication Date Title
CN112511782B (en) Video conference method, first terminal, MCU, system and storage medium
US8180915B2 (en) Coding data streams
US10091461B2 (en) System and method for real-time adaptation of a conferencing system to current conditions of a conference session
US20080100694A1 (en) Distributed caching for multimedia conference calls
EP3127285B1 (en) Method and systems for optimizing bandwidth utilization in a multi-participant full mesh peer-to-peer video session
US9014028B2 (en) Identifying and transitioning to an improved VOIP session
US8842159B2 (en) Encoding processing for conferencing systems
KR20190031239A (en) Methods and apparatus for use of compact concurrent codecs in multimedia communications
US20170155870A1 (en) Priority of uplink streams in video switching
US9232244B2 (en) Efficient frame forwarding in large scale real-time screen content sharing meetings
CN113992883B (en) Video conference processing method, processing device, conference system, and storage medium
US8791982B1 (en) Video multicast engine
CN113423008B (en) Video data transmission method, server and viewer side equipment
US9369511B2 (en) Telecommunication network
CN110708569B (en) Video processing method and device, electronic equipment and storage medium
US9509618B2 (en) Method of transmitting data in a communication system
WO2017003768A1 (en) Methods and apparatus for codec negotiation in decentralized multimedia conferences
CN112040234B (en) Video encoding method, video decoding method, video encoding device, video decoding device, electronic equipment and storage medium
US20070121532A1 (en) Application specific encoding of content
EP3503559A1 (en) Method and terminal for managing a streaming session of an immersive video spatially tiled with a set of tiles and stored on a network equipment
CN116962613A (en) Data transmission method and device, computer equipment and storage medium
CN112770077B (en) Video conference I frame coding method and device
CN112040232A (en) Real-time communication transmission method and device and real-time communication processing method and device
US10880554B2 (en) Bit stream management in video communication
JP2002176633A (en) Multi-point video conference system, video data coding quantity control method, and recording medium recorded with program therefor

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant