CN117041469A - Video conference code rate smoothing method, device, equipment and storage medium - Google Patents

Video conference code rate smoothing method, device, equipment and storage medium Download PDF

Info

Publication number
CN117041469A
CN117041469A CN202310927435.XA CN202310927435A CN117041469A CN 117041469 A CN117041469 A CN 117041469A CN 202310927435 A CN202310927435 A CN 202310927435A CN 117041469 A CN117041469 A CN 117041469A
Authority
CN
China
Prior art keywords
video conference
smoothing
parameter
data packets
parameters
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202310927435.XA
Other languages
Chinese (zh)
Inventor
陈志华
佟鑫
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Rongxun Technology Co ltd
Original Assignee
Beijing Rongxun Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Rongxun Technology Co ltd filed Critical Beijing Rongxun Technology Co ltd
Priority to CN202310927435.XA priority Critical patent/CN117041469A/en
Publication of CN117041469A publication Critical patent/CN117041469A/en
Pending legal-status Critical Current

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/14—Systems for two-way working
    • H04N7/15—Conference systems
    • H04N7/152—Multipoint control units therefor
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • H04N21/440281—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the temporal resolution, e.g. by frame skipping
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
    • H04N21/462—Content or additional data management, e.g. creating a master electronic program guide from data received from the Internet and a Head-end, controlling the complexity of a video stream by scaling the resolution or bit-rate based on the client capabilities
    • H04N21/4621—Controlling the complexity of the content stream or additional data, e.g. lowering the resolution or bit-rate of the video stream for a mobile client with a small screen

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The invention relates to the technical field of data transmission, and discloses a video conference code rate smoothing method, a device, equipment and a storage medium, wherein the method comprises the following steps: determining a smoothing precondition parameter according to video parameters of the video conference and the packet sending delay time; judging the numerical relation between the parameters of the pre-sent data packets and the parameters of the smoothing preconditions, wherein the parameters of the pre-sent data packets are data packets contained in the video conference; and sequentially sending the data packets contained in the video conference to the terminal equipment participating in the video conference based on the numerical relation. Compared with the existing video conference rate smoothing method, the method and the device for smoothing the video conference rate sequentially send the data packets contained in the video conference to the terminal equipment participating in the video conference by judging the numerical relation between the pre-sent data packet parameters and the smoothing precondition parameters, so that the problem of data backlog caused by different sizes of the data packets in the existing video conference rate smoothing method is avoided, and the smoothness of the video conference rate is improved.

Description

Video conference code rate smoothing method, device, equipment and storage medium
Technical Field
The present invention relates to the field of data transmission technologies, and in particular, to a method, an apparatus, a device, and a storage medium for smoothing a video conference code rate.
Background
Today, video conferencing systems are typically built on the basis of MCUs (Multi Control Unit, multi-node control units). In video conference systems, different video conference specifications, such as 720P30, 1080P60, and even 4K conferences, the packet transmission rate between the MCU and the terminal is generally different from 64kbps to 16 Mbps. When a plurality of terminals supporting 1080P are added to a high-definition conference (for example 1080P 60), the packet sending rate between the MCU and the terminals is very high (generally 8 Mbps), the frame rate of the image codec fluctuates, and "burrs" and "spikes" are easily formed (i.e. at a certain time point, the abrupt data packet flow is very large). The MCU and the terminal are usually connected through a switch, if the switch is overloaded or the switching capacity is low, packet loss is easily caused by excessive burrs and spikes.
To solve such problems, the conventional method is to directly control the packet sending rate, i.e., pause T time after sending N packets (the packet sending rate is N/T). This approach may alleviate the packet loss problem to some extent, but it may lead to packet backlog. For example, the 1 st packet has a size of 1500 bytes and the 2 nd packet has a size of 200 bytes. If the conventional method is adopted, i.e. the time T is paused for every 1 packet, but the occupied bandwidth is smaller for the 2 nd packet, the burst rate of the instant burst is not easy to form, so that the pause time for the 2 nd packet is unnecessary, which causes backlog of the data packet. In view of this, there is a need in the industry for a method that can improve the rate smoothness of existing video conferences without creating packet backlog.
The foregoing is provided merely for the purpose of facilitating understanding of the technical solutions of the present invention and is not intended to represent an admission that the foregoing is prior art.
Disclosure of Invention
The invention mainly aims to provide a video conference code rate smoothing method, device, equipment and storage medium, and aims to solve the technical problem that the prior art cannot improve the code rate smoothness of the existing video conference and meanwhile does not generate data packet backlog.
In order to achieve the above object, the present invention provides a video conference rate smoothing method, which includes the following steps:
determining a smoothing precondition parameter according to video parameters of the video conference and the packet sending delay time;
judging the numerical relation between a pre-sent data packet parameter and the smoothing precondition parameter, wherein the pre-sent data packet parameter is a data packet parameter contained in the video conference;
and sequentially sending the data packets contained in the video conference to terminal equipment participating in the video conference based on the numerical relation.
Optionally, the step of determining the smoothing precondition parameter according to the video parameter of the video conference and the packet delay time includes:
acquiring a video bandwidth corresponding to terminal equipment participating in a video conference when the video conference is carried out, and distributing a preset coefficient for the video bandwidth;
and determining a smoothing precondition parameter based on the video bandwidth, the preset coefficient and the packet sending delay time, wherein the smoothing precondition parameter is used for calculating the packet sending data quantity of the terminal equipment when the terminal equipment participates in the video conference.
Optionally, the step of determining a numerical relationship between the pre-sent packet parameter and the smoothing precondition parameter includes:
copying the data packet sent by intervention from the first buffer queue to the second buffer queue;
traversing all the pre-sent data packets in the second buffer queue in sequence to obtain pre-sent data packet parameters corresponding to the pre-sent data packets;
and carrying out numerical comparison on the pre-sent data packet parameter and the smoothing precondition parameter to obtain a numerical relation.
Optionally, before the step of copying the packet from the first buffer queue if the packet is sent to the second buffer queue, the method further includes:
receiving video data generated by the video conference in real time, and splitting the video data into a plurality of pre-sent data packets;
and sequentially arranging the plurality of pre-sent data packets into a first buffer queue according to time sequence.
Optionally, after the step of comparing the value of the pre-sent data packet parameter with the smoothing precondition parameter to obtain a value relationship, the method further includes:
detecting whether all pre-sent data packets in the second buffer queue are traversed;
if yes, copying the data packets from the first buffer queue if intervention is performed to send the data packets to the second buffer queue after a preset unit time interval until all the data packets contained in the video conference are copied.
Optionally, the step of sequentially sending the data packets included in the video conference to the terminal devices participating in the video conference based on the numerical relation includes:
if the numerical relation is that the parameters of the pre-sent data packets are larger than or equal to the smooth precondition parameters, delaying the sending process of the pre-sent data packets, wherein the delay time is equal to the packet sending delay time;
updating the numerical value of the pre-sent data packet parameter to obtain a first updated parameter;
and sequentially sending the data packets contained in the video conference to terminal equipment participating in the video conference based on the first updating parameters and the smoothing precondition parameters.
Optionally, the step of sequentially sending the data packets included in the video conference to the terminal devices participating in the video conference based on the numerical relationship further includes:
if the numerical relation is that the parameters of the pre-sent data packets are smaller than the smoothing precondition parameters, the pre-sent data packets are sent to the terminal equipment participating in the video conference;
updating the numerical value of the pre-sent data packet parameter to obtain a second updated parameter;
and sequentially sending the data packets contained in the video conference to terminal equipment participating in the video conference based on the second updating parameters and the smoothing precondition parameters.
In addition, in order to achieve the above object, the present invention further provides a video conference rate smoothing device, where the video conference rate smoothing device includes:
the parameter determining module is used for determining a smoothing precondition parameter according to the video parameter of the video conference and the packet sending delay time;
the numerical value judging module is used for judging the numerical value relation between the pre-sent data packet parameter and the smoothing precondition parameter, wherein the pre-sent data packet parameter is the data packet parameter contained in the video conference;
and the data sending module is used for sequentially sending the data packets contained in the video conference to the terminal equipment participating in the video conference based on the numerical relation.
In addition, in order to achieve the above object, the present invention also proposes a video conference rate smoothing device, the device comprising: a memory, a processor, and a video conference rate smoothing program stored on the memory and executable on the processor, the video conference rate smoothing program configured to implement the steps of the video conference rate smoothing method as described above.
In addition, in order to achieve the above object, the present invention also proposes a storage medium having stored thereon a video conference rate smoothing program which, when executed by a processor, implements the steps of the video conference rate smoothing method as described above.
The method comprises the steps of determining a smoothing precondition parameter according to video parameters of a video conference and packet sending delay time; judging the numerical relation between the parameters of the pre-sent data packets and the parameters of the smoothing preconditions, wherein the parameters of the pre-sent data packets are data packets contained in the video conference; and sequentially sending the data packets contained in the video conference to the terminal equipment participating in the video conference based on the numerical relation. Compared with the existing video conference rate smoothing method for controlling packet sending based on fixed rate, the method of the invention sequentially sends the data packets contained in the video conference to the terminal equipment participating in the video conference by judging the numerical relation between the pre-sent data packet parameters and the smoothing precondition parameters, thereby avoiding the data backlog problem caused by different sizes of the data packets in the existing video conference rate smoothing method and improving the smoothness of the video conference rate.
Drawings
Fig. 1 is a schematic structural diagram of video conference rate smoothing equipment in a hardware running environment according to an embodiment of the present invention;
fig. 2 is a flowchart of a first embodiment of a video conference rate smoothing method according to the present invention;
fig. 3 is a flowchart illustrating a second embodiment of a video conference rate smoothing method according to the present invention;
fig. 4 is a flowchart of a third embodiment of a video conference rate smoothing method according to the present invention;
fig. 5 is a block diagram of a video conference rate smoothing apparatus according to a first embodiment of the present invention.
The achievement of the objects, functional features and advantages of the present invention will be further described with reference to the accompanying drawings, in conjunction with the embodiments.
Detailed Description
It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the scope of the invention.
Referring to fig. 1, fig. 1 is a schematic structural diagram of a video conference rate smoothing device in a hardware running environment according to an embodiment of the present invention.
As shown in fig. 1, the video conference rate smoothing apparatus may include: a processor 1001, such as a central processing unit (Central Processing Unit, CPU), a communication bus 1002, a user interface 1003, a network interface 1004, a memory 1005. Wherein the communication bus 1002 is used to enable connected communication between these components. The user interface 1003 may include a Display, an input unit such as a Keyboard (Keyboard), and the optional user interface 1003 may further include a standard wired interface, a wireless interface. The network interface 1004 may optionally include a standard wired interface, a Wireless interface (e.g., a Wireless-Fidelity (Wi-Fi) interface). The Memory 1005 may be a high-speed random access Memory (Random Access Memory, RAM) or a stable nonvolatile Memory (NVM), such as a disk Memory. The memory 1005 may also optionally be a storage device separate from the processor 1001 described above.
Those skilled in the art will appreciate that the structure shown in fig. 1 does not constitute a limitation on video conference rate smoothing apparatus, and may include more or fewer components than shown, or may combine certain components, or may be a different arrangement of components.
As shown in fig. 1, an operating system, a network communication module, a user interface module, and a video conference rate smoothing program may be included in the memory 1005 as one storage medium.
In the video conference rate smoothing device shown in fig. 1, the network interface 1004 is mainly used for data communication with a network server; the user interface 1003 is mainly used for data interaction with a user; the processor 1001 and the memory 1005 in the video conference rate smoothing device of the present invention may be disposed in the video conference rate smoothing device, where the video conference rate smoothing device invokes a video conference rate smoothing program stored in the memory 1005 through the processor 1001, and executes the video conference rate smoothing method provided by the embodiment of the present invention.
The embodiment of the invention provides a video conference code rate smoothing method, and referring to fig. 2, fig. 2 is a flow chart of a first embodiment of the video conference code rate smoothing method.
In this embodiment, the video conference rate smoothing method includes the following steps:
step S10: and determining a smoothing precondition parameter according to the video parameters of the video conference and the packet sending delay time.
It should be noted that, the execution body of the method of the present embodiment may be a computing service device with functions of data processing, network communication and program running, for example, a mobile phone, a tablet computer, a personal computer, etc., or may be other electronic devices capable of implementing the same or similar functions, which is not limited in this embodiment. Various embodiments of the video conference rate smoothing method of the present invention will be described herein by taking a video conference rate smoothing device (hereinafter referred to as smoothing device) as an example.
It can be understood that, because there may be a large difference between the video frames corresponding to each time point when the video conference is performed, there may also be a large difference between the corresponding packet flows, and at this time, the frame rate of the video image codec fluctuates, so that "burrs" and "spikes" are easily formed. Based on this, when encountering a transmission scene with a larger data packet flow, buffering can be realized by setting a time parameter, so that the "glitch" and the "spike" are avoided, and the time parameter is the packet sending delay time.
It should be understood that the smoothing precondition parameter may be a threshold capability parameter that the terminal device participating in the video conference will not generate the "glitch" or "spike" when participating in the video conference.
Step S20: and judging the numerical relation between the pre-sent data packet parameter and the smoothing precondition parameter, wherein the pre-sent data packet parameter is the data packet parameter contained in the video conference.
It should be noted that, the video conference may be considered as a set of several images, and the images may be sent to all terminal devices participating in the video conference in the form of data packets, where the data packets are pre-sent data packets corresponding to the pre-sent data packet parameters.
In a specific implementation, the numerical relation between the pre-sent data packet parameter and the smoothing precondition parameter may be determined by a numerical comparison method. The pre-transmission packet parameter may be a data size of a pre-transmission packet, and the smoothing precondition parameter may be a data size of a smoothing precondition. For example, assuming that the data size of the smoothing precondition is set to 1000 bytes and the data size of the pre-transmission data packet at a certain time is set to 500 bytes, it may be determined that the pre-transmission data packet parameter is smaller than the smoothing precondition parameter at this time; if the data size of the pre-sent data packet at the next moment is 1000 bytes, then it can be determined that the pre-sent data packet parameter is equal to the smoothing precondition parameter.
Step S30: and sequentially sending the data packets contained in the video conference to terminal equipment participating in the video conference based on the numerical relation.
In a specific implementation, a preset rule can be set to determine how to sequentially send data packets contained in the video conference to terminal equipment participating in the video conference, and the preset rule can contain a packet sending mode of corresponding pre-sent data packet parameters and smooth precondition parameters under the scene of meeting different numerical relations, so that the problem that a fixed packet sending mode is adopted for all the data packets in the prior art is avoided.
Further, in this embodiment, in order to flexibly adjust the smoothing precondition parameter based on the video bandwidth of the video conference, the step S10 may include:
step S101: acquiring video bandwidths corresponding to terminal equipment participating in a video conference when the video conference is carried out, and distributing preset coefficients for the video bandwidths.
The video bandwidth refers to the maximum data transmission rate used for transmitting video data in network transmission, and its values are different according to the content, resolution and audio quality of the video conference. For example, a larger video bandwidth is required to maintain a good conference experience in a high definition video conference than in a normal video conference.
Step S102: and determining a smoothing precondition parameter based on the video bandwidth, the preset coefficient and the packet sending delay time, wherein the smoothing precondition parameter is used for calculating the packet sending data quantity of the terminal equipment when the terminal equipment participates in the video conference.
In a specific implementation, assuming that in a certain video conference, the preset coefficient is X, the above-mentioned smoothing precondition parameter cache_max (unit is a byte) may be expressed as:
Cache_Max＝BandWidth*T*X；
the BandWidth is the video BandWidth corresponding to the video conference, and the unit is the baud rate; the T is a packet delay time in milliseconds.
According to the embodiment, the video bandwidth corresponding to the terminal equipment participating in the video conference is obtained when the video conference is carried out, and the preset coefficient is distributed for the video bandwidth; determining a smoothing precondition parameter based on the video bandwidth, a preset coefficient and a packet sending delay time, wherein the smoothing precondition parameter is used for calculating the packet sending data quantity of the terminal equipment when the terminal equipment participates in the video conference; judging the numerical relation between the parameters of the pre-sent data packets and the parameters of the smoothing preconditions, wherein the parameters of the pre-sent data packets are data packets contained in the video conference; and sequentially sending the data packets contained in the video conference to the terminal equipment participating in the video conference based on the numerical relation. Compared with the existing video conference rate smoothing method for controlling packet sending based on fixed rate, the method in the embodiment sequentially sends the data packets contained in the video conference to the terminal equipment participating in the video conference by judging the numerical relation between the pre-sent data packet parameters and the smoothing precondition parameters, so that the problem of data backlog caused by different sizes of the data packets in the existing video conference rate smoothing method is avoided, and the smoothness of the video conference rate is improved.
Referring to fig. 3, fig. 3 is a flowchart illustrating a second embodiment of a video conference rate smoothing method according to the present invention.
Based on the above-mentioned first embodiment, in this embodiment, in order to avoid backlog of a data packet included in a video conference, thereby improving smoothness of data traffic, the step S20 may include:
step S201: copying the data packet sent by intervention from the first buffer queue to the second buffer queue.
In a specific implementation, in order to prevent backlog of data packets, two buffer queues may be set to receive the data packets contained in the video conference. More specifically, after receiving the stream of video conference output, the MCU (Multi Control Unit, multi-node control unit) in the smoothing device may copy the pre-sent data packet to the buffer_list_in queue (i.e. the first Buffer queue), and create a smoothing thread, where the thread periodically fetches the pre-sent data packet from the buffer_list_in queue and copies the pre-sent data packet to the buffer_list_tmp queue (i.e. the second Buffer queue).
Step S202: and traversing all the pre-sent data packets in the second buffer queue in sequence to obtain the pre-sent data packet parameters corresponding to the pre-sent data packets.
In a specific implementation, the iterator may sequentially traverse all the pre-sent data packets in the second buffer queue, or may sequentially traverse all the pre-sent data packets in the second buffer queue through recursive traversal. Of course, other traversing methods capable of traversing the data packet are also applicable to the present embodiment, and will not be described herein.
Step S203: and carrying out numerical comparison on the pre-sent data packet parameter and the smoothing precondition parameter to obtain a numerical relation.
Further, in this embodiment, in order to ensure the real-time performance of the video conference, before step S201, the method may further include:
step S190: and receiving video data generated by the video conference in real time, and splitting the video data into a plurality of pre-sent data packets.
It should be appreciated that the video image of each participant in a video conference will be captured as a series of consecutive video frames that are transmitted continuously over a period of time to form a smooth video picture, i.e., the video data described above, which may be split into a number of pre-sent data packets. In addition, before the video data is split into the data packets, the data volume can be reduced by encoding and compressing, so that the real-time performance of the video conference is ensured, and meanwhile, the smoothness of the video conference is further improved.
Step S200: and sequentially arranging the plurality of pre-sent data packets into a first buffer queue according to time sequence.
In a specific implementation, to ensure consistency of video data, the number of pre-sent data packets may be arranged into a first buffer queue based on a time stamp.
Further, in this embodiment, in order to avoid the packet loss problem that may be caused when the packet sending data volume is large, after the step S203, the method may further include:
step S204: and detecting whether all the pre-sent data packets in the second buffer queue are traversed.
Step S205: if yes, copying the data packets from the first buffer queue if intervention is performed to send the data packets to the second buffer queue after a preset unit time interval until all the data packets contained in the video conference are copied.
In the embodiment, video data generated by a video conference is received in real time, and the video data is split into a plurality of pre-sent data packets; sequentially arranging a plurality of pre-sent data packets into a first buffer queue according to a time sequence; copying the data packet sent by intervention from the first buffer queue to the second buffer queue; traversing all the pre-sent data packets in the second buffer queue in sequence to obtain pre-sent data packet parameters corresponding to the pre-sent data packets; comparing the pre-sent data packet parameters with the smoothing precondition parameters in a numerical value manner to obtain a numerical value relationship; detecting whether all pre-sent data packets in the second buffer queue are traversed; if yes, copying the data packets which are sent to the second buffer queue if intervention is performed from the first buffer queue after a preset unit time interval until all the data packets contained in the video conference are copied. Compared with the existing implementation method of the video conference, the method of the embodiment receives the data packet contained in the video conference by setting the two buffer queues, so that the data congestion caused by the backlog problem of the data packet contained in the video conference is avoided, and the smoothness of the video conference code rate is further improved.
Referring to fig. 4, fig. 4 is a flowchart illustrating a third embodiment of a video conference rate smoothing method according to the present invention.
Based on the above embodiments, in this embodiment, in order to determine whether to delay the transmission process of the pre-transmission data packet according to the smoothing precondition parameter, the step S30 may include:
step S301: and if the numerical relation is that the parameters of the pre-sent data packets are larger than or equal to the smooth precondition parameters, delaying the sending process of the pre-sent data packets, wherein the delay time is equal to the packet sending delay time.
In a specific implementation, assuming that the pre-sent data packet parameter is use_size and the smoothing precondition parameter is cache_max, when use_size is greater than or equal to cache_max, it indicates that the sending buffer of the smoothing device is fully loaded at this time, delay is required, and the delay time may be equal to the packet sending delay time T.
Step S302: and updating the numerical value of the pre-sent data packet parameter to obtain a first updated parameter.
It should be understood that, when it is determined in the above step S301 that the transmission process of the pre-transmission packet needs to be delayed, the value of use_size needs to be updated to use_size-cache_max, and then the next round of numerical relationship determination is performed.
Step S303: and sequentially sending the data packets contained in the video conference to terminal equipment participating in the video conference based on the first updating parameters and the smoothing precondition parameters.
Step S304: and if the numerical relation is that the parameters of the pre-sent data packets are smaller than the smoothing precondition parameters, sending the pre-sent data packets to the terminal equipment participating in the video conference.
In a specific implementation, it is also assumed that the pre-sent data packet parameter is use_size, and the smoothing precondition parameter is cache_max, and when use_size is smaller than cache_max, it means that the sending buffer of the smoothing device is not fully loaded at this time, and the current data packet can be sent immediately without delay.
Step S305: and updating the numerical value of the pre-sent data packet parameter to obtain a second updated parameter.
It should be understood that, when it is determined in the above step S304 that the pre-transmission data packet can be transmitted to the terminal device participating in the video conference, the value of use_size needs to be updated to use_size+cache_max, and then the next round of numerical relationship determination is performed.
Step S306: and sequentially sending the data packets contained in the video conference to terminal equipment participating in the video conference based on the second updating parameters and the smoothing precondition parameters.
According to the embodiment, if the numerical relation is that the parameters of the pre-sent data packets are larger than or equal to the smooth precondition parameters, the sending process of the pre-sent data packets is delayed, and the delay time is equal to the packet sending delay time; updating the numerical value of the pre-sent data packet parameter to obtain a first updated parameter; sequentially transmitting data packets contained in the video conference to terminal equipment participating in the video conference based on the first updating parameters and the smoothing precondition parameters; if the numerical relation is that the parameters of the pre-sent data packets are smaller than the parameters of the smoothing preconditions, the pre-sent data packets are sent to terminal equipment participating in the video conference; updating the numerical value of the pre-sent data packet parameter to obtain a second updated parameter; and sequentially transmitting the data packets contained in the video conference to the terminal equipment participating in the video conference based on the second updating parameters and the smoothing precondition parameters. Compared with the existing implementation method of the video conference, the method of the embodiment determines whether to delay the packet sending according to the pre-sent data packet parameters and the smoothing precondition parameters, so that the flexibility of the packet sending in the video conference process is improved, and the smoothness of the video conference code rate is further improved.
In addition, the embodiment of the invention also provides a storage medium, wherein the storage medium is stored with a video conference rate smoothing program, and the video conference rate smoothing program realizes the steps of the video conference rate smoothing method when being executed by a processor.
Referring to fig. 5, fig. 5 is a block diagram illustrating a first embodiment of a video conference rate smoothing apparatus according to the present invention.
As shown in fig. 5, the video conference rate smoothing device provided by the embodiment of the invention includes:
a parameter determining module 501, configured to determine a smoothing precondition parameter according to a video parameter of the video conference and a packet delay time;
the numerical value judging module 502 is configured to judge a numerical value relationship between a pre-sent data packet parameter and the smoothing precondition parameter, where the pre-sent data packet parameter is a data packet parameter included in the video conference;
and the data sending module 503 is configured to send, in sequence, data packets included in the video conference to terminal devices participating in the video conference based on the numerical relationship.
The embodiment determines a smoothing precondition parameter according to video parameters of the video conference and packet sending delay time; judging the numerical relation between the parameters of the pre-sent data packets and the parameters of the smoothing preconditions, wherein the parameters of the pre-sent data packets are data packets contained in the video conference; and sequentially sending the data packets contained in the video conference to the terminal equipment participating in the video conference based on the numerical relation. Compared with the existing video conference rate smoothing method for controlling packet sending based on fixed rate, the method in the embodiment sequentially sends the data packets contained in the video conference to the terminal equipment participating in the video conference by judging the numerical relation between the pre-sent data packet parameters and the smoothing precondition parameters, so that the problem of data backlog caused by different sizes of the data packets in the existing video conference rate smoothing method is avoided, and the smoothness of the video conference rate is improved.
Based on the first embodiment of the video conference rate smoothing device of the present invention, a second embodiment of the video conference rate smoothing device of the present invention is presented.
In this embodiment, the parameter determining module 501 is further configured to obtain a video bandwidth corresponding to a terminal device participating in a video conference when the terminal device performs the video conference, and allocate a preset coefficient to the video bandwidth; and determining a smoothing precondition parameter based on the video bandwidth, the preset coefficient and the packet sending delay time, wherein the smoothing precondition parameter is used for calculating the packet sending data quantity of the terminal equipment when the terminal equipment participates in the video conference.
Further, the value determining module 502 is further configured to copy, from the first buffer queue, the data packet sent if the intervention is performed to the second buffer queue; traversing all the pre-sent data packets in the second buffer queue in sequence to obtain pre-sent data packet parameters corresponding to the pre-sent data packets; and carrying out numerical comparison on the pre-sent data packet parameter and the smoothing precondition parameter to obtain a numerical relation.
Further, the value judging module 502 is further configured to receive video data generated by the video conference in real time, and split the video data into a plurality of pre-sent data packets; and sequentially arranging the plurality of pre-sent data packets into a first buffer queue according to time sequence.
Further, the value determining module 502 is further configured to detect whether all the pre-sent data packets in the second buffer queue have been traversed; if yes, copying the data packets from the first buffer queue if intervention is performed to send the data packets to the second buffer queue after a preset unit time interval until all the data packets contained in the video conference are copied.
Further, the data sending module 503 is further configured to delay a sending process of the pre-sent data packet if the numerical relationship is that the pre-sent data packet parameter is greater than or equal to the smoothing precondition parameter, where a delay time is equal to the packet sending delay time; updating the numerical value of the pre-sent data packet parameter to obtain a first updated parameter; and sequentially sending the data packets contained in the video conference to terminal equipment participating in the video conference based on the first updating parameters and the smoothing precondition parameters.
Further, the data sending module 503 is further configured to send a pre-sent data packet to the terminal device participating in the video conference if the numerical relation is that the pre-sent data packet parameter is smaller than the smoothing precondition parameter; updating the numerical value of the pre-sent data packet parameter to obtain a second updated parameter; and sequentially sending the data packets contained in the video conference to terminal equipment participating in the video conference based on the second updating parameters and the smoothing precondition parameters.
Other embodiments or specific implementation manners of the video conference rate smoothing device of the present invention may refer to the above method embodiments, and are not described herein again.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or system that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or system. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or system that comprises the element.
The foregoing embodiment numbers of the present invention are merely for the purpose of description, and do not represent the advantages or disadvantages of the embodiments.
From the above description of the embodiments, it will be clear to those skilled in the art that the above-described embodiment method may be implemented by means of software plus a necessary general hardware platform, but of course may also be implemented by means of hardware, but in many cases the former is a preferred embodiment. Based on such understanding, the technical solution of the present invention may be embodied essentially or in a part contributing to the prior art in the form of a software product stored in a storage medium (e.g. read-only memory/random-access memory, magnetic disk, optical disk), comprising instructions for causing a terminal device (which may be a mobile phone, a computer, a server, or a network device, etc.) to perform the method according to the embodiments of the present invention.
The foregoing description is only of the preferred embodiments of the present invention, and is not intended to limit the scope of the invention, but rather is intended to cover any equivalents of the structures or equivalent processes disclosed herein or in the alternative, which may be employed directly or indirectly in other related arts.

Claims (10)

1. A method for rate smoothing of video conferences, the method comprising the steps of:
determining a smoothing precondition parameter according to video parameters of the video conference and the packet sending delay time;
judging the numerical relation between a pre-sent data packet parameter and the smoothing precondition parameter, wherein the pre-sent data packet parameter is a data packet parameter contained in the video conference;
and sequentially sending the data packets contained in the video conference to terminal equipment participating in the video conference based on the numerical relation.
2. The video conference rate smoothing method as claimed in claim 1, wherein said step of determining a smoothing precondition parameter based on video parameters of the video conference and a packet delay time comprises:
acquiring a video bandwidth corresponding to terminal equipment participating in a video conference when the video conference is carried out, and distributing a preset coefficient for the video bandwidth;
and determining a smoothing precondition parameter based on the video bandwidth, the preset coefficient and the packet sending delay time, wherein the smoothing precondition parameter is used for calculating the packet sending data quantity of the terminal equipment when the terminal equipment participates in the video conference.
3. The method for smoothing video conference rate as claimed in claim 1, wherein said step of determining a numerical relation between a pre-transmission packet parameter and said smoothing precondition parameter comprises:
copying the data packet sent by intervention from the first buffer queue to the second buffer queue;
traversing all the pre-sent data packets in the second buffer queue in sequence to obtain pre-sent data packet parameters corresponding to the pre-sent data packets;
and carrying out numerical comparison on the pre-sent data packet parameter and the smoothing precondition parameter to obtain a numerical relation.
4. The method of claim 3, wherein copying the packets from the first buffer queue if intervening in the step of sending the packets to the second buffer queue further comprises:
receiving video data generated by the video conference in real time, and splitting the video data into a plurality of pre-sent data packets;
and sequentially arranging the plurality of pre-sent data packets into a first buffer queue according to time sequence.
5. The method for smoothing video conference rate as claimed in claim 4, wherein after said step of comparing said pre-sent packet parameters with said smoothing precondition parameters to obtain a numerical relationship, further comprising:
detecting whether all pre-sent data packets in the second buffer queue are traversed;
if yes, copying the data packets from the first buffer queue if intervention is performed to send the data packets to the second buffer queue after a preset unit time interval until all the data packets contained in the video conference are copied.
6. The video conference rate smoothing method according to claim 1, wherein the step of sequentially transmitting the data packets included in the video conference to the terminal devices participating in the video conference based on the numerical relationship comprises:
if the numerical relation is that the parameters of the pre-sent data packets are larger than or equal to the smooth precondition parameters, delaying the sending process of the pre-sent data packets, wherein the delay time is equal to the packet sending delay time;
updating the numerical value of the pre-sent data packet parameter to obtain a first updated parameter;
and sequentially sending the data packets contained in the video conference to terminal equipment participating in the video conference based on the first updating parameters and the smoothing precondition parameters.
7. The method for smoothing video conference rate according to claim 6, wherein the step of sequentially transmitting the data packets included in the video conference to the terminal devices participating in the video conference based on the numerical relationship further comprises:
if the numerical relation is that the parameters of the pre-sent data packets are smaller than the smoothing precondition parameters, the pre-sent data packets are sent to the terminal equipment participating in the video conference;
updating the numerical value of the pre-sent data packet parameter to obtain a second updated parameter;
and sequentially sending the data packets contained in the video conference to terminal equipment participating in the video conference based on the second updating parameters and the smoothing precondition parameters.
8. A video conference rate smoothing device, characterized in that the video conference rate smoothing device comprises:
the parameter determining module is used for determining a smoothing precondition parameter according to the video parameter of the video conference and the packet sending delay time;
the numerical value judging module is used for judging the numerical value relation between the pre-sent data packet parameter and the smoothing precondition parameter, wherein the pre-sent data packet parameter is the data packet parameter contained in the video conference;
and the data sending module is used for sequentially sending the data packets contained in the video conference to the terminal equipment participating in the video conference based on the numerical relation.
9. A video conference rate smoothing device, the device comprising: a memory, a processor, and a video conference rate smoothing program stored on the memory and executable on the processor, the video conference rate smoothing program configured to implement the steps of the video conference rate smoothing method of any one of claims 1 to 7.
10. A storage medium having stored thereon a video conference rate smoothing program which, when executed by a processor, implements the steps of the video conference rate smoothing method of any of claims 1 to 7.
CN202310927435.XA 2023-07-26 2023-07-26 Video conference code rate smoothing method, device, equipment and storage medium Pending CN117041469A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202310927435.XA CN117041469A (en) 2023-07-26 2023-07-26 Video conference code rate smoothing method, device, equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202310927435.XA CN117041469A (en) 2023-07-26 2023-07-26 Video conference code rate smoothing method, device, equipment and storage medium

Publications (1)

Publication Number Publication Date
CN117041469A true CN117041469A (en) 2023-11-10

Family

ID=88632735

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202310927435.XA Pending CN117041469A (en) 2023-07-26 2023-07-26 Video conference code rate smoothing method, device, equipment and storage medium

Country Status (1)

Country Link
CN (1) CN117041469A (en)

Similar Documents

Publication Publication Date Title
CN111628847B (en) Data transmission method and device
US9607354B1 (en) Method and system for application broadcast
WO2020259448A1 (en) Data processing method and apparatus, computer-readable storage medium, and electronic device
CN109660879B (en) Live broadcast frame loss method, system, computer equipment and storage medium
US7958532B2 (en) Method of transmitting layered video-coded information
US7734104B2 (en) Image coding apparatus, image decoding apparatus and image processing system
CN109600610B (en) Data encoding method, terminal and computer readable storage medium
KR20180031547A (en) Method and apparatus for adaptively providing multiple bit rate stream media in server
CN113992967B (en) Screen projection data transmission method and device, electronic equipment and storage medium
WO2019154221A1 (en) Method for sending streaming data and data sending device
US8861372B2 (en) Method and device for fast pushing unicast stream in fast channel change
JP2015536594A (en) Aggressive video frame drop
CN113068001B (en) Data processing method, device, equipment and medium based on cascade camera
CN112866746A (en) Multi-path streaming cloud game control method, device, equipment and storage medium
CN110022335B (en) Data packet transmitting method, device, server and computer readable storage medium
US20160360220A1 (en) Selective packet and data dropping to reduce delay in real-time video communication
CN115209189B (en) Video stream transmission method, system, server and storage medium
CN109309805B (en) Multi-window display method, device, equipment and system for video conference
US9577947B2 (en) System and architecture to optimize video traffic over internet protocol networks
CN117041469A (en) Video conference code rate smoothing method, device, equipment and storage medium
US11553224B1 (en) Method and device for adjusting bit rate during live streaming
CN116546276A (en) Link bandwidth estimation method, device, equipment, storage medium and program product
CN113472680A (en) Packet loss processing method and device, communication device and system
CN111953612A (en) Data transmission control method and device
CN111404908B (en) Data interaction method and device, electronic equipment and readable storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination