WO2020155913A1 - Video transmission method, device, apparatus, and storage medium - Google Patents

Video transmission method, device, apparatus, and storage medium Download PDF

Info

Publication number
WO2020155913A1
WO2020155913A1 PCT/CN2019/126714 CN2019126714W WO2020155913A1 WO 2020155913 A1 WO2020155913 A1 WO 2020155913A1 CN 2019126714 W CN2019126714 W CN 2019126714W WO 2020155913 A1 WO2020155913 A1 WO 2020155913A1
Authority
WO
WIPO (PCT)
Prior art keywords
resolution
bit rate
video
video stream
lowest
Prior art date
Application number
PCT/CN2019/126714
Other languages
French (fr)
Chinese (zh)
Inventor
田建超
Original Assignee
广州视源电子科技股份有限公司
广州视臻信息科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 广州视源电子科技股份有限公司, 广州视臻信息科技有限公司 filed Critical 广州视源电子科技股份有限公司
Publication of WO2020155913A1 publication Critical patent/WO2020155913A1/en

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/2343Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • H04N21/23439Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements for generating different versions
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/2343Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • H04N21/234363Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by altering the spatial resolution, e.g. for clients with a lower screen resolution
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/239Interfacing the upstream path of the transmission network, e.g. prioritizing client content requests
    • H04N21/2393Interfacing the upstream path of the transmission network, e.g. prioritizing client content requests involving handling client requests
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/262Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists
    • H04N21/26208Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists the scheduling operation being performed under constraints
    • H04N21/26216Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists the scheduling operation being performed under constraints involving the channel capacity, e.g. network bandwidth

Definitions

  • the present disclosure relates to the field of communication transmission technology, for example, to a video transmission method, device, device, and computer-readable storage medium.
  • the needs of subscribers are also very different. Taking video subscription as an example, different subscribers expect different content, such as terminals with different sizes of screens. The video resolution will be different. Therefore, when the video source of the publishing end is multicast, it often needs to support sending multiple video streams of the same or different resolutions. The most common ones are sending 180p, 360p, 720p and 1080p, etc. For each video stream with different levels of resolution, the video stream information that needs to be sent is determined according to the subscription status of the subscriber.
  • the video source as the publisher After receiving the subscription information from the subscriber, the video source as the publisher first needs to assign a bit rate to the resolution level subscribed by the subscriber.
  • the current conventional practice of related technologies is to set a minimum bit rate for each level of division. , The target bit rate and the highest bit rate, and then when the upstream bit rate of the video source end is sufficient, assign the lowest bit rate, target bit rate and highest bit rate to each level in turn until all the upstream bit rates are allocated.
  • related technologies usually perform adaptive bit rate control at the video source, and adjust the subscriber's subscription level according to the real-time situation of the uplink bit rate.
  • the uplink bit rate of the video source when the uplink bit rate of the video source is reduced, Then, send the video stream lower than the subscription level to the subscriber to ensure the smoothness of the video; when the upstream bit rate of the video source end is sufficient, send the subscribed video stream of this level to the subscriber to ensure the video Clarity.
  • the inventor found that when the network fluctuates greatly, if the bit rate allocated to a certain level fluctuates just above the minimum bit rate, the source will always send the video stream and Switching between not sending the video stream of this level, because every time it is never sent to the beginning of the transmission, the key frame corresponding to this level needs to be re-sent, thus occupying more uplink bandwidth, which not only causes a waste of resources, but also frequent videos The switching of the resolution also affects the user's viewing experience.
  • the purpose of the present disclosure is to provide a video transmission method, device, equipment, and computer-readable storage medium, to avoid frequent switching of frequency levels due to the influence of the uplink code rate, and to achieve comprehensive use of uplink bandwidth.
  • embodiments of the present disclosure provide a video transmission method, including the following steps:
  • the video subscription information of the subscribing device is acquired; wherein the video subscription information includes the subscribed video The first resolution of the stream;
  • the current uplink bit rate is less than the sum of the lowest bit rate corresponding to the first resolution and the bit rate threshold, and the video stream includes an unsubscribed second resolution lower than the first resolution , Obtaining the lowest bit rate and the bit rate threshold corresponding to the second resolution according to the second resolution;
  • the current uplink bit rate is greater than or equal to the sum of the lowest bit rate corresponding to the second resolution and the bit rate threshold, sending the video stream corresponding to the second resolution to the subscription device.
  • the current uplink bit rate is greater than or equal to the sum of the lowest bit rate corresponding to the first resolution and the bit rate threshold, use the first resolution to The sending of the video stream by the subscription device includes:
  • sending to the subscription device corresponds to The video stream of the second resolution includes:
  • the current allocable code rate is the difference between the uplink code rate and the transmission code rate .
  • the fourth implementation manner of the first aspect further includes:
  • the current allocable bit rate is greater than or equal to the difference between the lowest bit rate corresponding to the first resolution and the bit rate threshold, sending the video stream corresponding to the first resolution to the subscription device.
  • the method further includes:
  • the current allocable bit rate is less than the difference between the lowest bit rate corresponding to the first resolution and the bit rate threshold, determine whether the video stream includes an unsubscribed second resolution lower than the first resolution rate;
  • the video stream includes an unsubscribed second resolution lower than the first resolution, obtaining the lowest bit rate and the bit rate threshold of the second resolution according to the second resolution;
  • the current allocable bit rate is greater than or equal to the sum of the lowest bit rate corresponding to the second resolution and the bit rate threshold, sending the video stream corresponding to the second resolution to the subscription device.
  • the method further includes:
  • Receive video subscription information of the subscription device wherein the video subscription information includes the first resolution of the subscribed video stream.
  • the present disclosure provides a video transmission device, including:
  • the video subscription information obtaining unit is configured to obtain the video subscription information of the subscribing device when it is detected that the current uplink bit rate is updated and the subscribed video stream of the first resolution is not sent to the subscribing device at the previous moment;
  • the video subscription information includes the first resolution of the subscribed video stream;
  • the first code rate parameter determination unit is configured to obtain the minimum code rate corresponding to the first resolution and the code rate threshold according to the first resolution;
  • the first video stream sending unit is configured to, if the current uplink bit rate is greater than or equal to the sum of the lowest bit rate corresponding to the first resolution and the bit rate threshold, send to the subscribing device corresponding to the first resolution Rate of video streaming;
  • the second bit rate parameter determination unit is configured to: if the current uplink bit rate is less than the sum of the lowest bit rate corresponding to the first resolution and the bit rate threshold, and the video stream includes a bit rate lower than the first resolution When the second resolution is not subscribed to, obtain the lowest bit rate and the bit rate threshold corresponding to the second resolution according to the second resolution;
  • the second video stream sending unit is configured to send a signal corresponding to the second resolution to the subscription device if the current uplink bit rate is greater than or equal to the sum of the lowest bit rate corresponding to the second resolution and the bit rate threshold. Rate of the video stream.
  • the first video stream sending unit includes:
  • the first transmission code rate determination module is configured to, if the current allocable code rate is greater than or equal to the sum of the lowest code rate corresponding to the first resolution and the code rate threshold, according to the lowest code rate corresponding to the first resolution Rate determines the transmission code rate;
  • the first video stream sending module is configured to send the video stream corresponding to the first resolution to the subscription device at the transmission bit rate.
  • the second video stream sending unit includes:
  • the second transmission code rate determining unit is configured to, if the current allocable code rate is greater than or equal to the sum of the lowest code rate corresponding to the second resolution and the code rate threshold, according to the lowest code rate corresponding to the second resolution Rate determines the transmission code rate;
  • the second video stream sending module is configured to send the video stream corresponding to the second resolution to the subscription device at the transmission bit rate.
  • the current allocable code rate is the difference between the uplink code rate and the transmission code rate .
  • the fourth implementation manner of the second aspect further includes:
  • the third bit rate parameter determination module is used to obtain the video subscribed by the subscribing device when the current uplink bit rate update is detected and the video stream of the first resolution has been sent to the subscribing device at the last moment The lowest bit rate and the bit rate threshold corresponding to the first resolution of the stream;
  • the third video stream sending unit is configured to send to the subscription device the difference between the lowest bit rate corresponding to the first resolution and the bit rate threshold if the current allocable bit rate is greater than or equal to the Resolution of the video stream.
  • the fifth implementation manner of the second aspect further includes:
  • the second resolution determining module is configured to determine whether the video stream includes a bit rate lower than the first bit rate if the current allocable bit rate is less than the minimum bit rate corresponding to the first resolution and the bit rate threshold.
  • the unsubscribed second resolution of the resolution is configured to determine whether the video stream includes a bit rate lower than the first bit rate if the current allocable bit rate is less than the minimum bit rate corresponding to the first resolution and the bit rate threshold.
  • the fourth code rate parameter determination module is configured to, if the video stream includes an unsubscribed second resolution lower than the first resolution, obtain the lowest code of the second resolution according to the second resolution Rate and bit rate threshold;
  • the fourth video stream sending unit is configured to send to the subscription device corresponding to the second bit rate if the current allocable bit rate is greater than or equal to the sum of the lowest bit rate corresponding to the second resolution and the bit rate threshold. Resolution of the video stream.
  • the method further includes:
  • the subscription information receiving module is configured to receive the video subscription information of the subscription device; wherein the video subscription information includes the first resolution of the subscribed video stream.
  • embodiments of the present disclosure provide a video transmission device, including a processor, a memory, and a computer program stored in the memory and configured to be executed by the processor, and the processor executes the The computer program implements the video transmission method as described in any one of the first aspect.
  • an embodiment of the present disclosure provides a computer-readable storage medium, the computer-readable storage medium includes a stored computer program, wherein the device where the computer-readable storage medium is located is controlled when the computer program is running Perform the video transmission method as described in any one of the first aspect.
  • the subscribed video stream of the first resolution is not sent to the subscribing device at the last moment, obtain the video subscription information of the subscribing device and determine the minimum corresponding to the first resolution of the subscribed video stream
  • the code rate and the code rate threshold if the current uplink code rate is greater than or equal to the sum of the lowest code rate corresponding to the first resolution and the code rate threshold, send to the subscription device the data corresponding to the first resolution Video stream, if the current uplink bit rate is less than the sum of the lowest bit rate corresponding to the first resolution and the bit rate threshold, and the video stream includes an unsubscribed second bit rate lower than the first resolution
  • obtain the lowest bit rate and the bit rate threshold corresponding to the second resolution according to the second resolution if the current uplink bit rate is greater than or equal to the lowest bit rate corresponding to the second resolution and the bit rate threshold
  • the sum of the rate thresholds, the video stream corresponding to the second resolution is sent to the subscription device, where the condition
  • Fig. 1 is a schematic flowchart of a video transmission method provided by the first embodiment of the present disclosure.
  • Fig. 2 is a schematic structural diagram of a video transmission device provided by a second embodiment of the present disclosure.
  • Fig. 3 is a schematic structural diagram of a video transmission device provided by a third embodiment of the present disclosure.
  • the first embodiment of the present disclosure provides a video transmission method, which can be executed by a video transmission device, and the video transmission device may be composed of two or more physical entities, or may be composed of one physical entity.
  • the video transmission device can be a computing device such as a computer, mobile phone, tablet, smart tablet, or server.
  • the video transmission device serves as the publisher's video source terminal in the publish-subscribe mode, and transmits the subscribed video stream to the subscribing device according to the subscription status of the subscribing device.
  • the subscribing device may be a computer, a mobile phone, a tablet, a smart tablet or a server
  • the subscription device may subscribe to a video stream of one resolution level according to its actual situation, or may subscribe to video streams of multiple resolution levels.
  • the video transmission method includes the following steps:
  • the video stream is set with several resolutions.
  • the video stream is set with 4 resolution levels, namely 180p, 360p, 720p and 1080p, etc.
  • the subscribing device will subscribe the desired video stream to the video transmission device as the publisher of the video source.
  • the subscriber needs to carry resolution information to inform the The video transmission device itself expects to receive the resolution.
  • the video transmission device After receiving the video subscription information of the subscription device, the video transmission device obtains the first resolution of the subscribed video stream included in the video subscription information, and then according to the The first resolution expected by the subscribing device determines the video stream to be sent.
  • the subscribing device may subscribe to a video stream of one resolution level, or may subscribe to multiple video streams of different resolution levels.
  • the resolution level subscribed by the subscribing device is distinguished from the non-subscribed resolution level, the resolution level of the video stream subscribed by the subscribing device is defined as the first resolution, and the subscriber is not subscribed
  • the resolution level of the video stream is defined as the second resolution.
  • the video transmission device when it is detected that the current uplink bit rate is updated, and the subscribed video stream of the first resolution is not sent to the subscribed device at the last moment, it may be that the video transmission device has just received the subscriber's In the case of a subscription request, the first video stream level was not allocated a bit rate during the last uplink bit rate update, or it may be that the last allocable bit rate during the last uplink bit rate update did not meet the requirements of the first resolution.
  • the code rate range therefore, either the second resolution is determined by the downward switching, or the second resolution is not met and the second resolution is not met, and the video transmission device acquires the video subscription information of the subscription receiving device.
  • S12 Obtain a minimum bit rate and a bit rate threshold corresponding to the first resolution according to the first resolution.
  • the video stream is set with several resolutions, for example, the video stream is set with 4 resolution levels, respectively For 180P, 360P, 720P, 1080P, etc., each resolution level is set with the corresponding minimum bit rate and switching threshold, where the minimum bit rate represents the minimum transmission bit rate required to transmit to the video stream of that resolution level
  • the minimum bit rate represents the minimum transmission bit rate required to transmit to the video stream of that resolution level
  • setting the minimum bit rate required for a 180P resolution video stream is 30k, and the corresponding switching threshold is 0K
  • a 360P resolution video stream requires a minimum bit rate of 200k, and the corresponding switching threshold is 50K
  • 720P resolution video The minimum bit rate required for a stream is 600k, and the corresponding switching threshold is 100K
  • the minimum bit rate required for a 1080P resolution video stream is 800k, and the corresponding switching threshold is 150K, etc.
  • the present disclosure is for the resolution level
  • the division of the resolution and the specific values of the minimum bit rate and switching threshold are
  • the video transmission device obtains the lowest bit rate corresponding to the first resolution according to the first resolution, and The bit rate threshold is used to further determine whether to send the video stream of the first resolution.
  • the subscription device may subscribe to a video stream of one resolution level, or may subscribe to multiple video streams of different resolution levels.
  • the current The assignable code rate is the difference between the uplink code rate and the transmission code rate. If the assigned transmission code rate is 0, then the current assignable code rate is equal to the current uplink code rate.
  • the video transmission device determines that the current assignable code rate (that is, the current Uplink code rate) The relationship between the minimum code rate corresponding to the first resolution and the sum of the code rate threshold, if the current allocable code rate is greater than or equal to the minimum code rate corresponding to the first resolution and the If the sum of the bit rate thresholds, the video transmission device determines the transmission bit rate according to the lowest bit rate corresponding to the first resolution, and then sends the transmission bit rate corresponding to the first resolution to the subscription device Rate of the video stream.
  • the current assignable code rate that is, the current Uplink code rate
  • the video transmission device when the video transmission device subscribes to multiple video streams of different resolution levels, the video transmission device starts with the first resolution of the lowest level of subscription and starts with the highest level of subscription.
  • the first resolution with a lower level may have been traversed before and the corresponding transmission code rate may have been determined, then the transmission code rate is not 0, and the current allocable code rate is the uplink code rate and the transmission code rate
  • the video transmission device determines the relationship between the current allocable bit rate and the sum of the lowest bit rate corresponding to the first resolution and the bit rate threshold.
  • the video transmission device determines the transmission bit rate according to the minimum bit rate corresponding to the first resolution, and then transmits the bit rate to the The subscription device sends a video stream corresponding to the first resolution.
  • the video transmission device determines the relationship between the current allocable bit rate and the sum of the lowest bit rate corresponding to the first resolution and the bit rate threshold. If the current allocable bit rate is less than the total bit rate, The sum of the lowest bit rate corresponding to the first resolution and the bit rate threshold indicates that the current allocable bit rate does not support sending the video stream of the first resolution, and the video transmission device determines whether the video stream is Including an unsubscribed second resolution lower than the first resolution to perform a resolution switching process, if the video stream includes an unsubscribed second resolution lower than the first resolution , The video transmission device obtains the lowest bit rate and the bit rate threshold of the second resolution according to the second resolution.
  • the video transmission device determines the magnitude relationship between the current allocable bit rate and the sum of the lowest bit rate corresponding to the second resolution and the bit rate threshold. If the current allocable bit rate is greater than or Equal to the sum of the lowest bit rate corresponding to the second resolution and the bit rate threshold, the video transmission device determines the transmission bit rate according to the lowest bit rate corresponding to the second resolution, and uses the transmission code Send the video stream corresponding to the second resolution to the subscription device; if the current allocable bit rate is less than the sum of the lowest bit rate corresponding to the second resolution and the bit rate threshold, the video The transmission device does not send the video stream; it should be noted that if the video transmission device acquires multiple unsubscribed second resolutions, and the second resolutions all meet the current allocable bit rate greater than or equal to all When the minimum bit rate corresponding to the second resolution and the sum of the bit rate threshold are selected, the second resolution with the highest level is selected.
  • a subscription device subscribes to a video stream with a first resolution of 720P.
  • the transmission code rate cannot be determined for the first video stream level, but the 180P level and 360P level of the second resolution that are not subscribed meet the conditions, then the higher level 360P level is selected to determine the transmission code rate.
  • the video transmission device encodes and sends the video stream whose transmission bit rate is determined, because the resolution of the video stream whose transmission bit rate is determined is different from that of the subscription device to the video transmission device.
  • the expected resolution of the subscribed video stream may be different. If the upstream bit rate meets the sum of the minimum bit rate corresponding to the subscribed first resolution and the bit rate threshold, the video transmission device sends the first subscribed to the subscribed device.
  • the subscriber is not subscribed to the second resolution quality video stream, the first resolution level is higher than the second resolution level, when the video transmission device starts to send a certain resolution video stream
  • First it is necessary to send the key frame corresponding to the resolution level.
  • the subscribing device receives the key frame corresponding to the resolution level of the video stream, it can start to decode the received video stream according to the received key frame.
  • the video transmission device sets a total of 4 resolution levels of 180P, 360P, 720P, and 1080P.
  • the minimum bit rate required to set a video stream with a resolution of 180P is 30k, and the corresponding switching threshold is 0K;
  • the minimum bit rate required for a 360P resolution video stream is 200k, and the corresponding switching threshold is 50K;
  • the minimum bit rate required for a 720P resolution video stream is 600k, and the corresponding switching threshold is 100K;
  • the 1080P resolution video stream requires The minimum bit rate is 800k, and the corresponding switching threshold is 150K; for example, the subscription device subscribes to the video transmission device for a 360P-level video stream, at the first moment, the upstream bit rate of the video transmission device as the video publishing source is 210k ,
  • Video transmission equipment The video transmission equipment needs to determine the current allocable bit rate at this time, that is, whether the uplink bit rate at this moment meets the sum of the minimum bit rate corresponding to the first resolution greater than or equal to
  • determine whether the down switching condition is met determine that there is a non-subscribed 180P lower than the subscribed 360P first resolution level
  • the second resolution, and the uplink bit rate at this moment is greater than the sum of the minimum bit rate and the switching threshold corresponding to the second resolution, 210K is greater than 30K, and the downward switching conditions are met, according to the minimum code of the second resolution of 180P
  • the transmission bit rate is determined by the transmission bit rate, and the video stream corresponding to the second resolution is sent to the subscriber at the transmission bit rate; at the second moment, the uplink bit rate of the video transmission device as the video publishing source is updated to 300k, because the video transmission device did not determine the transmission bit rate for the first video stream level of 360P at the first moment, it is necessary to determine the current allocable bit rate, that is, whether the uplink bit rate meets the corresponding first resolution greater than or equal to 360P
  • the sum of the minimum bit rate and the switching threshold of 300k is higher than 250k.
  • the transmission bit rate is determined according to the minimum bit rate of the first resolution of 360P, and the transmission bit rate is used to send the transmission bit rate corresponding to the subscribed device
  • the lowest bit rate of a resolution determines the transmission bit rate, and sends the video stream corresponding to the first resolution to the subscription device at the transmission bit rate, so that even if the uplink bit rate fluctuates near the lowest bit rate As long as the amplitude of the fluctuation does not exceed 2 times the switching threshold, frequent switching will not occur, thereby avoiding occupying too much upstream bandwidth and ensuring the transmission efficiency of the video stream.
  • the first embodiment of the present disclosure provides a video transmission method, which receives video subscription information of a subscription device and determines the lowest bit rate and bit rate threshold corresponding to the first resolution of the subscribed video stream. If the current uplink The bit rate is greater than or equal to the sum of the lowest bit rate corresponding to the first resolution and the bit rate threshold, and the video stream corresponding to the first resolution is sent to the subscription device, if the current uplink bit rate is less than the total bit rate.
  • the second resolution Obtain the minimum bit rate corresponding to the second resolution and the bit rate threshold, and if the current uplink bit rate is greater than or equal to the sum of the minimum bit rate corresponding to the second resolution and the bit rate threshold, send a notification to the subscription device Send a video stream corresponding to the second resolution, where the condition for switching from the first resolution to the second resolution is determined by the lowest bit rate of the second resolution and the switching threshold, and the corresponding lowest bit rate
  • the switching threshold dynamically adjusts the sending conditions of the first resolution and the second resolution, so that the switching between video streams of different resolutions is no longer based on the lowest bit rate of each resolution, so that the resolution of the
  • the control of inter-switching helps to reduce the frequent switching of video streams of different resolutions caused by the influence of the uplink bit rate, thereby reducing the transmission of key frames, reducing the occupation of excessive uplink bandwidth, and real
  • the video transmission method further includes:
  • the current allocable bit rate is greater than or equal to the difference between the lowest bit rate corresponding to the first resolution and the bit rate threshold, sending the video stream corresponding to the first resolution to the subscription device.
  • the video transmission device detects the total bit rate of the uplink interface in real time, that is, the uplink bit rate to ensure the quality of the video stream sent to the subscription device.
  • the video transmission device detects that the current When the uplink bit rate is updated, and the video stream has been sent to the subscription device at the last moment, the update condition can be set according to the actual situation, for example, the uplink bit rate of this time may be higher than the uplink code of the last time. Rate has changed, or this time the uplink bit rate has changed more than the previous uplink bit rate than the preset amplitude threshold, etc., the current video transmission device reconfirms all the data that can be sent according to the currently updated uplink bit rate.
  • the subscribing device can subscribe to a video stream of one resolution level, or it can subscribe to multiple video streams of different resolution levels.
  • the subscribing device subscribes to a video stream of a resolution level
  • the current allocable bit rate is equal to the current uplink bit rate; when the video transmission device subscribes to multiple video streams of different resolution levels, the video transmission device subscribes to the lowest level of the subscription.
  • a resolution starts and ends with the first resolution of the highest level subscribed. It traverses all the first resolutions subscribed by the subscription device from low to high, and the current allocable bit rate is the The difference between the uplink code rate and the transmission code rate.
  • the transmission code rate is 0, and the current allocable code rate is equal to the uplink code rate.
  • Code rate if the first resolution with a lower level may have been traversed before the first resolution is traversed and the corresponding transmission code rate has been determined, then the current allocable code rate is the same as the uplink code rate.
  • the video transmission device obtains the lowest bitrate and the bitrate threshold corresponding to the first resolution of the video stream subscribed by the subscription device, and the current allocable bitrate is the uplink.
  • the video transmission device determines the magnitude relationship between the current allocable bit rate and the lowest bit rate corresponding to the first resolution and the difference between the bit rate threshold, and if the current allocable bit rate is The bit rate is greater than or equal to the difference between the lowest bit rate corresponding to the first resolution and the bit rate threshold, the video transmission device still determines the transmission bit rate according to the lowest bit
  • the uplink bit rate when the uplink bit rate is low, when the video transmission device switches down from the subscribed first resolution to the non-subscribed second resolution, it needs to satisfy that the current allocable bit rate is less than The difference between the lowest bit rate corresponding to the first resolution and the corresponding switching threshold.
  • the uplink bit rate When the uplink bit rate is high, the video transmission device switches upwards from the second resolution to the subscribed first resolution.
  • the current allocable code rate is greater than or equal to the sum of the minimum code rate corresponding to the first resolution and the corresponding switching threshold, so that even if the uplink code rate fluctuates near the minimum code rate, as long as the amplitude of the fluctuation does not exceed
  • the switching threshold is 2 times, and it will not switch frequently, thereby avoiding occupying too much upstream bandwidth and ensuring the transmission efficiency of the video stream.
  • the video transmission method further includes:
  • the video stream includes an unsubscribed second resolution lower than the first resolution, obtain the lowest bit rate and the bit rate threshold of the second resolution according to the second resolution.
  • the current allocable bit rate is greater than or equal to the sum of the lowest bit rate corresponding to the second resolution and the bit rate threshold, sending the video stream corresponding to the second resolution to the subscription device.
  • the current allocable bit rate is the difference between the uplink bit rate and the transmission bit rate
  • the video transmission device determines that the current allocable bit rate corresponds to the lowest value of the first resolution.
  • the relationship between the size of the difference between the bit rate and the bit rate threshold is the relationship between the size of the difference between the bit rate and the bit rate threshold.
  • the video transmission device determines that the current allocable bit rate is the same as the The relationship between the minimum bit rate corresponding to the second resolution and the sum of the bit rate threshold.
  • the video transmission device determines the transmission bit rate according to the lowest bit rate corresponding to the second resolution, and sends the video stream corresponding to the second resolution to the subscription device at the transmission bit rate;
  • the assignable bit rate is less than the sum of the lowest bit rate corresponding to the second resolution and the bit rate threshold, then the video transmission device does not send the video stream.
  • the video transmission device sets a total of 4 resolution levels of 180P, 360P, 720P, and 1080P.
  • the minimum bit rate required to set a video stream with a resolution of 180P is 30k, and the corresponding switching threshold is 0K;
  • the minimum bit rate required for a 360P resolution video stream is 200k, and the corresponding switching threshold is 50K;
  • the minimum bit rate required for a 720P resolution video stream is 600k, and the corresponding switching threshold is 100K;
  • the 1080P resolution video stream requires The minimum bit rate is 800k, and the corresponding switching threshold is 150K; for example, the subscribing device subscribes to the video transmission device for 180P-level and 720P-level video streams, at time t0, the upstream bit rate of the video transmission device as the video publishing source It is 20k, traverses all the first resolutions from low to high, first traverses the first resolution of 180P, due to the current assignable bit rate, the current uplink bit rate is less than the lowest bit
  • the transmission code rate is not determined for the first resolution of 180P. Since there is no second resolution lower than the level of the first resolution of 180P, the downward switching condition is not met and the end is over.
  • the upstream bit rate of the video transmission device as the video publishing source is updated to 30k. All first resolutions are traversed from low to high, and the first resolution of 180P is traversed first.
  • the uplink bit rate meets the sum of the minimum bit rate corresponding to the first resolution greater than or equal to 180P and the switching threshold, 30k ⁇ 30k, so the transmission bit rate is determined for the first resolution of 180P, and the determined minimum bit rate is 30k, the remaining current assignable code rate is the difference between the uplink code rate and the transmission code rate, that is, the remaining current assignable code rate is 0, end.
  • the upstream bit rate of the resolution video transmission device as the video publishing source is updated to 400k, traversing all the first resolutions from low to high, and first traversing the first resolution of 180P.
  • the uplink bit rate at the moment meets the sum of the minimum bit rate corresponding to the first resolution greater than or equal to 180P and the switching threshold, 400k ⁇ 30k, so the transmission bit rate is determined for the first resolution of 180P, and the determined transmission bit rate
  • the minimum is 30k
  • continue to traverse take the first resolution of the next subscribed 720P, because the current allocable bit rate is less than the first resolution of 720P
  • the sum of the corresponding minimum bit rate and switching threshold is 370k ⁇ 750k. Therefore, the transmission bit rate is not determined for the first resolution of 720P.
  • the transmission code rate is determined by the second resolution, and the video stream corresponding to the second resolution is sent to the subscription device at the transmission code rate.
  • the upstream bit rate of the video transmission device as the video distribution source is updated to 800k, traversing all the first resolutions from low to high, first traversing the first resolution of 180P, because the current bit rate can be allocated, that is The uplink bit rate meets the sum of the minimum bit rate corresponding to the first resolution greater than or equal to 180P and the switching threshold, and 800k ⁇ 30k.
  • each resolution of the video transmission device is set with the highest bit rate corresponding to the resolution, for example, the resolution video transmission device is set to 180P, 360P, 720P, 1080P There are 4 resolutions in total.
  • the minimum bit rate corresponding to the 180P resolution is 30k, the highest bit rate is 200K, and the corresponding switching threshold is 0K;
  • the 360P resolution corresponds to the minimum bit rate of 200k and the highest bit rate of 700K, corresponding
  • the switching threshold is 50K;
  • the resolution of 720P corresponds to the lowest bit rate of 600k, the highest bit rate is 1800K, and the corresponding switching threshold is 100K;
  • the resolution of 1080P corresponds to the lowest bit rate of 800k and the highest bit rate of 3000K, corresponding to the switch
  • the threshold is 150K; for example, the subscription device subscribes to the video transmission device for 360P-level and 720P-level video streams, at t0, the upstream bit rate of the resolution video transmission device as the video publishing source is 600k, traversing from low to high For all first resolutions, first traverse the first resolution of 360P.
  • the subscribed first resolution of 720P because the current allocable bit rate is less than the sum of the lowest bit rate corresponding to the first resolution of 720P and the switching threshold, 400k ⁇ 750k, so the transmission bit rate is not determined for the first resolution of 720P ,
  • each resolution setting of the resolution video transmission device There is the highest bit rate corresponding to the resolution, which represents the maximum allowable bit rate of the resolution.
  • the transmission bit rate determined by the resolution video transmission device for any resolution cannot be greater than the highest bit rate of the resolution.
  • the assignable code rate is greater than the determined highest code rate of one of the resolutions, then the transmission code rate is determined according to the highest code rate of the resolution, and the remaining code rates are no longer allocated.
  • the video transmission method further includes:
  • Receive video subscription information of the subscription device wherein the video subscription information includes the first resolution of the subscribed video stream.
  • the video stream is set with several resolutions.
  • the video stream is set with 4 resolution levels, namely 180p, 360p, 720p and 1080p, etc.
  • the subscribing device will subscribe the desired video stream to the video transmission device as the publisher of the video source.
  • the subscriber needs to carry resolution information to inform the The video transmission device itself expects to receive the resolution.
  • the video transmission device After receiving the video subscription information of the subscription device, the video transmission device obtains the first resolution of the subscribed video stream included in the video subscription information, and then according to the The first resolution expected by the subscribing device determines the video stream sent.
  • a second embodiment of the present disclosure provides a video transmission device, including:
  • the video subscription information obtaining unit 21 is configured to obtain the video subscription information of the subscribing device when it is detected that the current uplink bit rate is updated and the subscribed video stream of the first resolution is not sent to the subscribing device at the previous moment; wherein, The video subscription information includes the first resolution of the subscribed video stream.
  • the first code rate parameter determining unit 22 is configured to obtain the minimum code rate corresponding to the first resolution and the code rate threshold according to the first resolution.
  • the first video stream sending unit 23 is configured to, if the current uplink bit rate is greater than or equal to the sum of the lowest bit rate corresponding to the first resolution and the bit rate threshold, send to the subscribing device corresponding to the first Resolution of the video stream.
  • the second bit rate parameter determination unit 24 is configured to: if the current uplink bit rate is less than the sum of the lowest bit rate corresponding to the first resolution and the bit rate threshold, and the video stream includes a bit rate lower than the first When the second resolution of the resolution is not subscribed, the lowest bit rate and the bit rate threshold corresponding to the second resolution are obtained according to the second resolution.
  • the second video stream sending unit 25 is configured to, if the current uplink bit rate is greater than or equal to the sum of the lowest bit rate corresponding to the second resolution and the bit rate threshold, to the subscribing device corresponding to the second Resolution of the video stream.
  • the first video stream sending unit 23 includes:
  • the first transmission code rate determination module is configured to, if the current allocable code rate is greater than or equal to the sum of the lowest code rate corresponding to the first resolution and the code rate threshold, according to the lowest code rate corresponding to the first resolution The rate determines the transmission bit rate.
  • the first video stream sending module is configured to send the video stream corresponding to the first resolution to the subscription device at the transmission bit rate.
  • the second video stream sending unit 25 includes:
  • the second transmission code rate determining unit is configured to, if the current allocable code rate is greater than or equal to the sum of the lowest code rate corresponding to the second resolution and the code rate threshold, according to the lowest code rate corresponding to the second resolution The rate determines the transmission bit rate.
  • the second video stream sending module is configured to send the video stream corresponding to the second resolution to the subscription device at the transmission bit rate.
  • the currently allocatable code rate is the uplink code rate and the transmission code rate Difference.
  • the method further includes:
  • the third bit rate parameter determination module is used to obtain the video subscribed by the subscribing device when the current uplink bit rate update is detected and the video stream of the first resolution has been sent to the subscribing device at the last moment The lowest bit rate and the bit rate threshold corresponding to the first resolution of the stream.
  • the third video stream sending unit is configured to send to the subscription device the difference between the lowest bit rate corresponding to the first resolution and the bit rate threshold if the current allocable bit rate is greater than or equal to the Resolution of the video stream.
  • the method further includes:
  • the second resolution determining module is configured to determine whether the video stream includes a bit rate lower than the first bit rate if the current allocable bit rate is less than the minimum bit rate corresponding to the first resolution and the bit rate threshold. The second resolution of the unsubscribed resolution.
  • the fourth code rate parameter determination module is configured to, if the video stream includes an unsubscribed second resolution lower than the first resolution, obtain the lowest code of the second resolution according to the second resolution Rate and bit rate threshold.
  • the fourth video stream sending unit is configured to send to the subscription device corresponding to the second bit rate if the current allocable bit rate is greater than or equal to the sum of the lowest bit rate corresponding to the second resolution and the bit rate threshold. Resolution of the video stream.
  • the method further includes:
  • the subscription information receiving module is configured to receive the video subscription information of the subscription device; wherein the video subscription information includes the first resolution of the subscribed video stream.
  • the device embodiments described above are only illustrative, and the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physically separate. Units can be located in one place or distributed to multiple network units. Some or all of the modules can be selected according to actual needs to achieve the objectives of the solutions of the embodiments.
  • the connection relationship between the modules indicates that they have a communication connection between them, which can be implemented as one or more communication buses or signal lines. Those of ordinary skill in the art can understand and implement it without creative work.
  • FIG. 3 is a schematic diagram of a video transmission device provided by a third embodiment of the present disclosure.
  • the video transmission device of this embodiment includes: at least one processor 11, such as a CPU, at least one network interface 14 or other user interface 13, a memory 15, at least one communication bus 12, and the communication bus 12 is used to implement communication between these components.
  • Connect communication may include a USB interface and other standard interfaces and wired interfaces.
  • the network interface 14 may include a Wi-Fi interface and other wireless interfaces.
  • the memory 15 may include a high-speed RAM memory, and may also include a non-volatile memory (non-volatile memory), such as at least one disk memory.
  • the memory 15 may include at least one storage device located far away from the aforementioned processor 11.
  • the memory 15 stores the following elements, executable modules or data structures, or their subsets, or their extended sets:
  • the operating system 151 including various system programs, is used to implement various basic services and process hardware-based tasks;
  • the processor 11 is configured to call the program 152 stored in the memory 15 to execute the video transmission method described in the foregoing embodiment, for example, step S11 shown in FIG. 1.
  • the processor executes the computer program, the function of each module/unit in the above-mentioned device embodiments, such as a video subscription information receiving unit, is realized.
  • the computer program may be divided into one or more modules/units, and the one or more modules/units are stored in the memory and executed by the processor to complete the present disclosure.
  • the one or more modules/units may be a series of computer program instruction segments capable of completing specific functions, and the instruction segments are used to describe the execution process of the computer program in the video transmission device.
  • the video transmission device may be a computing device such as a desktop computer, a notebook, a palmtop computer, and a cloud server.
  • the video transmission device may include, but is not limited to, a processor and a memory.
  • Those skilled in the art can understand that the schematic diagram is only an example of the video transmission device, and does not constitute a limitation on the video transmission device. It may include more or less components than those shown in the figure, or combine certain components. , Or different parts.
  • the so-called processor 11 may be a central processing unit (Central Processing Unit, CPU), other general-purpose processors, digital signal processors (Digital Signal Processor, DSP), application specific integrated circuits (Application Specific Integrated Circuit, ASIC), Ready-made programmable gate array (Field-Programmable Gate Array, FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc.
  • the general-purpose processor can be a microprocessor or the processor can also be any conventional processor, etc.
  • the processor 11 is the control center of the video transmission equipment, and various interfaces and lines are used to connect each of the entire video transmission equipment. section.
  • the memory 15 may be used to store the computer program and/or module, and the processor 11 executes or executes the computer program and/or module stored in the memory 15 and calls data stored in the memory to achieve Various functions of the video transmission device.
  • the memory may mainly include a program storage area and a data storage area.
  • the program storage area may store an operating system, an application program required by at least one function, and the like; the data storage area may store data created according to the use of a mobile phone.
  • the memory 15 may include a high-speed random access memory, and may also include a non-volatile memory, such as a hard disk, a memory, a plug-in hard disk, a Smart Media Card (SMC), and a Secure Digital (SD) Card, Flash Card, at least one magnetic disk storage device, flash memory device, or other volatile solid-state storage device.
  • a non-volatile memory such as a hard disk, a memory, a plug-in hard disk, a Smart Media Card (SMC), and a Secure Digital (SD) Card, Flash Card, at least one magnetic disk storage device, flash memory device, or other volatile solid-state storage device.
  • the fourth embodiment of the present disclosure provides a computer-readable storage medium. If the integrated module/unit of the video transmission device is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer Read the storage medium. Based on this understanding, the present disclosure implements all or part of the processes in the above-mentioned embodiments and methods, and can also be completed by instructing relevant hardware through a computer program.
  • the computer program can be stored in a computer-readable storage medium. When the program is executed by the processor, it can implement the steps of the foregoing method embodiments.
  • the computer program includes computer program code, and the computer program code may be in the form of source code, object code, executable file, or some intermediate forms.
  • the computer-readable medium may include: any entity or device capable of carrying the computer program code, recording medium, U disk, mobile hard disk, magnetic disk, optical disk, computer memory, read-only memory (ROM, Read-Only Memory) , Random Access Memory (RAM, Random Access Memory), electrical carrier signal, telecommunications signal, and software distribution media, etc.
  • ROM Read-Only Memory
  • RAM Random Access Memory
  • electrical carrier signal telecommunications signal
  • software distribution media etc.
  • the content contained in the computer-readable medium can be appropriately increased or decreased in accordance with the requirements of the legislation and patent practice in the jurisdiction.
  • the computer-readable medium Does not include electrical carrier signals and telecommunication signals.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Databases & Information Systems (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The present disclosure provides a video transmission method, device, apparatus, and a computer readable storage medium, wherein the method comprises: when the current uplink code rate update is detected, and a subscribed video stream with the first resolution is not sent to a subscription apparatus at the previous moment, acquiring video subscription information of the subscription apparatus; acquiring the lowest code rate and a code rate threshold corresponding to the first resolution; if the current uplink code rate is less than the sum of the lowest code rate and the code rate threshold corresponding to the first resolution, and the video stream comprises a second resolution which is unsubscribed and lower than the first resolution, acquiring the lowest code rate and a code rate threshold corresponding to the second resolution; if the current uplink code rate is greater than or equal to the sum of the lowest code rate and the code rate threshold corresponding to the second resolution, sending the video stream corresponding to the second resolution to the subscription apparatus. The present disclosure implements the control of switching between the resolution levels, avoids the frequent switching of the resolution levels due to the influence of the uplink code rate, and realizes the comprehensive utilization of the uplink bandwidth.

Description

一种视频传输方法、装置、设备及存储介质Video transmission method, device, equipment and storage medium
本申请要求在2019年2月1日提交中国专利局、申请号为201910106110.9的中国专利申请的优先权,以上申请的全部内容通过引用结合在本申请中。This application claims the priority of the Chinese patent application filed with the Chinese Patent Office with application number 201910106110.9 on February 1, 2019. The entire content of the above application is incorporated into this application by reference.
技术领域Technical field
本公开涉及通信传输技术领域,例如涉及一种视频传输方法、装置、设备及计算机可读存储介质。The present disclosure relates to the field of communication transmission technology, for example, to a video transmission method, device, device, and computer-readable storage medium.
背景技术Background technique
在基于事件(如视频)的发布端/订阅者模式中,订阅者的需求也是千差万别,以视频订阅为例,不同的订阅者希望得到的内容也会不同,比如具有不同大小屏幕的终端期望得到的视频分辨率会有所不同,因此作为发布端的视频源端在进行多播时,往往需要支持发送多路相同或者不同分辨率的视频流,最常见的是发送180p、360p、720p及1080p等各个不同层级分辨率的视频流,需要发送的视频流信息则根据订阅者的订阅情况决定。In the publisher/subscriber model based on events (such as video), the needs of subscribers are also very different. Taking video subscription as an example, different subscribers expect different content, such as terminals with different sizes of screens. The video resolution will be different. Therefore, when the video source of the publishing end is multicast, it often needs to support sending multiple video streams of the same or different resolutions. The most common ones are sending 180p, 360p, 720p and 1080p, etc. For each video stream with different levels of resolution, the video stream information that needs to be sent is determined according to the subscription status of the subscriber.
作为发布端的视频源端在收到订阅者的订阅信息后,首先需要为订阅者所订阅的分辨率层次分配码率,目前相关技术的常规做法是为划分的每一层次设定一个最低码率,目标码率和最高码率,然后在视频源端的上行码率足够的情况下,依次给每一层次分配最低码率,目标码率和最高码率,直到将上行所有码率分配完毕。同时为了提高视频的传输质量,相关技术通常在视频源端进行自适应码率控制,根据上行码率的实时情况实现订阅者订阅层次的调整,例如在视源源端的上行码率降低的情况下,则向订阅者发送比订阅层次更低的视频流,以保证视频的流畅度;当视频源端的上行码率足够的情况下,则向订阅者发送订阅的本层次的视频流,以保证视频的清晰度。After receiving the subscription information from the subscriber, the video source as the publisher first needs to assign a bit rate to the resolution level subscribed by the subscriber. The current conventional practice of related technologies is to set a minimum bit rate for each level of division. , The target bit rate and the highest bit rate, and then when the upstream bit rate of the video source end is sufficient, assign the lowest bit rate, target bit rate and highest bit rate to each level in turn until all the upstream bit rates are allocated. At the same time, in order to improve the quality of video transmission, related technologies usually perform adaptive bit rate control at the video source, and adjust the subscriber's subscription level according to the real-time situation of the uplink bit rate. For example, when the uplink bit rate of the video source is reduced, Then, send the video stream lower than the subscription level to the subscriber to ensure the smoothness of the video; when the upstream bit rate of the video source end is sufficient, send the subscribed video stream of this level to the subscriber to ensure the video Clarity.
在实现本公开的过程中,发明人发现:当网络波动较大的时候,如果给某一层次分配的码率恰好在最低码率上下波动,则源端会一直在发送该层次的视频流和不发送该层次的视频流之间切换,由于每次从不发送到开始发送,都需要重新发送该层次对应的关键帧,从而占用更多的上行带宽,不仅造成了资源的浪费,频繁的视频分辨率的切换也影响用户的观看体验。In the process of implementing the present disclosure, the inventor found that when the network fluctuates greatly, if the bit rate allocated to a certain level fluctuates just above the minimum bit rate, the source will always send the video stream and Switching between not sending the video stream of this level, because every time it is never sent to the beginning of the transmission, the key frame corresponding to this level needs to be re-sent, thus occupying more uplink bandwidth, which not only causes a waste of resources, but also frequent videos The switching of the resolution also affects the user's viewing experience.
发明内容Summary of the invention
针对上述问题,本公开的目的在于提供一种视频传输方法、装置、设备及计算机可读存 储介质,避免因上行码率的影响导致分频率层级频繁切换,实现上行带宽的综合使用。In view of the above problems, the purpose of the present disclosure is to provide a video transmission method, device, equipment, and computer-readable storage medium, to avoid frequent switching of frequency levels due to the influence of the uplink code rate, and to achieve comprehensive use of uplink bandwidth.
第一方面,本公开实施例提供了一种视频传输方法,包括以下步骤:In the first aspect, embodiments of the present disclosure provide a video transmission method, including the following steps:
当检测到当前上行码率更新,且上一时刻未向订阅设备发送订阅的第一分辨率的视频流时,获取所述订阅设备的视频订阅信息;其中,所述视频订阅信息包括订阅的视频流的第一分辨率;When it is detected that the current uplink bit rate is updated, and the subscribed video stream of the first resolution is not sent to the subscribing device at the last moment, the video subscription information of the subscribing device is acquired; wherein the video subscription information includes the subscribed video The first resolution of the stream;
根据所述第一分辨率获取该第一分辨率对应的最低码率以及码率阈值;Acquiring, according to the first resolution, the lowest bit rate and the bit rate threshold corresponding to the first resolution;
若当前上行码率大于或者等于所述第一分辨率对应的最低码率以及所述码率阈值之和,向所述订阅设备发送对应于所述第一分辨率的视频流;If the current uplink bit rate is greater than or equal to the sum of the lowest bit rate corresponding to the first resolution and the bit rate threshold, sending a video stream corresponding to the first resolution to the subscription device;
若当前上行码率小于所述第一分辨率对应的最低码率以及所述码率阈值之和,且所述视频流包括有低于所述第一分辨率的未订阅的第二分辨率时,根据所述第二分辨率获取该第二分辨率对应的最低码率以及码率阈值;If the current uplink bit rate is less than the sum of the lowest bit rate corresponding to the first resolution and the bit rate threshold, and the video stream includes an unsubscribed second resolution lower than the first resolution , Obtaining the lowest bit rate and the bit rate threshold corresponding to the second resolution according to the second resolution;
若当前上行码率大于或者等于所述第二分辨率对应的最低码率以及所述码率阈值之和,向所述订阅设备发送对应于所述第二分辨率的视频流。If the current uplink bit rate is greater than or equal to the sum of the lowest bit rate corresponding to the second resolution and the bit rate threshold, sending the video stream corresponding to the second resolution to the subscription device.
在第一方面的第一种实现方式中,所述若当前上行码率大于或者等于所述第一分辨率对应的最低码率以及所述码率阈值之和,以所述第一分辨率向所述订阅设备发送所述视频流,包括:In the first implementation manner of the first aspect, if the current uplink bit rate is greater than or equal to the sum of the lowest bit rate corresponding to the first resolution and the bit rate threshold, use the first resolution to The sending of the video stream by the subscription device includes:
若当前可分配码率大于或者等于所述第一分辨率对应的最低码率以及所述码率阈值之和,根据所述第一分辨率对应的最低码率确定传输码率;If the current allocable code rate is greater than or equal to the sum of the minimum code rate corresponding to the first resolution and the code rate threshold, determine the transmission code rate according to the minimum code rate corresponding to the first resolution;
以所述传输码率向所述订阅设备发送对应于所述第一分辨率的视频流。Sending a video stream corresponding to the first resolution to the subscription device at the transmission bit rate.
在第一方面的第二种实现方式中,所述若当前上行码率大于或者等于所述第二分辨率对应的最低码率以及所述码率阈值之和,向所述订阅设备发送对应于所述第二分辨率的视频流,包括:In a second implementation manner of the first aspect, if the current uplink bit rate is greater than or equal to the sum of the lowest bit rate corresponding to the second resolution and the bit rate threshold, sending to the subscription device corresponds to The video stream of the second resolution includes:
若当前可分配码率大于或者等于所述第二分辨率对应的最低码率以及所述码率阈值之和,根据所述第二分辨率对应的最低码率确定传输码率;If the current allocable code rate is greater than or equal to the sum of the minimum code rate corresponding to the second resolution and the code rate threshold, determine the transmission code rate according to the minimum code rate corresponding to the second resolution;
以所述传输码率向所述订阅设备发送对应于所述第二分辨率的视频流。Sending a video stream corresponding to the second resolution to the subscription device at the transmission code rate.
根据第一方面的第一种实现方式或者第二种实现方式,在第一方面的第三种实现方式中,所述当前可分配码率为所述上行码率与所述传输码率之差。According to the first implementation manner or the second implementation manner of the first aspect, in the third implementation manner of the first aspect, the current allocable code rate is the difference between the uplink code rate and the transmission code rate .
根据第一方面的第三种实现方式,在第一方面的第四种实现方式中,还包括:According to the third implementation manner of the first aspect, the fourth implementation manner of the first aspect further includes:
当检测到当前上行码率更新,且上一时刻已向所述订阅设备发送所述第一分辨率的视频流时,获取所述订阅设备所订阅的视频流的第一分辨率对应的最低码率以及码率阈值;When it is detected that the current uplink bit rate is updated, and the video stream of the first resolution has been sent to the subscribing device at the previous moment, obtain the lowest code corresponding to the first resolution of the video stream subscribed by the subscribing device Rate and bit rate threshold;
若当前可分配码率大于或者等于所述第一分辨率对应的最低码率以及所述码率阈值之差, 向所述订阅设备发送对应于所述第一分辨率的视频流。If the current allocable bit rate is greater than or equal to the difference between the lowest bit rate corresponding to the first resolution and the bit rate threshold, sending the video stream corresponding to the first resolution to the subscription device.
根据第一方面的第四种实现方式,在第一方面的第五种实现方式中,还包括:According to the fourth implementation manner of the first aspect, in the fifth implementation manner of the first aspect, the method further includes:
若当前可分配码率小于所述第一分辨率对应的最低码率以及所述码率阈值之差,确定所述视频流是否包括有低于所述第一分辨率的未订阅的第二分辨率;If the current allocable bit rate is less than the difference between the lowest bit rate corresponding to the first resolution and the bit rate threshold, determine whether the video stream includes an unsubscribed second resolution lower than the first resolution rate;
若所述视频流包括有低于所述第一分辨率的未订阅的第二分辨率,根据所述第二分辨率获取该第二分辨率的最低码率以及码率阈值;If the video stream includes an unsubscribed second resolution lower than the first resolution, obtaining the lowest bit rate and the bit rate threshold of the second resolution according to the second resolution;
若当前可分配码率大于或者等于所述第二分辨率对应的最低码率以及所述码率阈值之和,向所述订阅设备发送对应于所述第二分辨率的视频流。If the current allocable bit rate is greater than or equal to the sum of the lowest bit rate corresponding to the second resolution and the bit rate threshold, sending the video stream corresponding to the second resolution to the subscription device.
根据第一方面的以上任一种实现方式,在第一方面的第六种实现方式中,还包括:According to any one of the foregoing implementation manners of the first aspect, in the sixth implementation manner of the first aspect, the method further includes:
接收所述订阅设备的视频订阅信息;其中,所述视频订阅信息包括订阅的视频流的第一分辨率。Receive video subscription information of the subscription device; wherein the video subscription information includes the first resolution of the subscribed video stream.
第二方面,本公开提供了一种视频传输装置,包括:In a second aspect, the present disclosure provides a video transmission device, including:
视频订阅信息获取单元,用于当检测到当前上行码率更新,且上一时刻未向订阅设备发送订阅的第一分辨率的视频流时,获取所述订阅设备的视频订阅信息;其中,所述视频订阅信息包括订阅的视频流的第一分辨率;The video subscription information obtaining unit is configured to obtain the video subscription information of the subscribing device when it is detected that the current uplink bit rate is updated and the subscribed video stream of the first resolution is not sent to the subscribing device at the previous moment; The video subscription information includes the first resolution of the subscribed video stream;
第一码率参数确定单元,用于根据所述第一分辨率获取该第一分辨率对应的最低码率以及码率阈值;The first code rate parameter determination unit is configured to obtain the minimum code rate corresponding to the first resolution and the code rate threshold according to the first resolution;
第一视频流发送单元,用于若当前上行码率大于或者等于所述第一分辨率对应的最低码率以及所述码率阈值之和,向所述订阅设备发送对应于所述第一分辨率的视频流;The first video stream sending unit is configured to, if the current uplink bit rate is greater than or equal to the sum of the lowest bit rate corresponding to the first resolution and the bit rate threshold, send to the subscribing device corresponding to the first resolution Rate of video streaming;
第二码率参数确定单元,用于若当前上行码率小于所述第一分辨率对应的最低码率以及所述码率阈值之和,且所述视频流包括有低于所述第一分辨率的未订阅的第二分辨率时,根据所述第二分辨率获取该第二分辨率对应的最低码率以及码率阈值;The second bit rate parameter determination unit is configured to: if the current uplink bit rate is less than the sum of the lowest bit rate corresponding to the first resolution and the bit rate threshold, and the video stream includes a bit rate lower than the first resolution When the second resolution is not subscribed to, obtain the lowest bit rate and the bit rate threshold corresponding to the second resolution according to the second resolution;
第二视频流发送单元,用于若当前上行码率大于或者等于所述第二分辨率对应的最低码率以及所述码率阈值之和,向所述订阅设备发送对应于所述第二分辨率的视频流。The second video stream sending unit is configured to send a signal corresponding to the second resolution to the subscription device if the current uplink bit rate is greater than or equal to the sum of the lowest bit rate corresponding to the second resolution and the bit rate threshold. Rate of the video stream.
在第二方面的第一种实现方式中,所述第一视频流发送单元,包括:In a first implementation manner of the second aspect, the first video stream sending unit includes:
第一传输码率确定模块,用于若当前可分配码率大于或者等于所述第一分辨率对应的最低码率以及所述码率阈值之和,根据所述第一分辨率对应的最低码率确定传输码率;The first transmission code rate determination module is configured to, if the current allocable code rate is greater than or equal to the sum of the lowest code rate corresponding to the first resolution and the code rate threshold, according to the lowest code rate corresponding to the first resolution Rate determines the transmission code rate;
第一视频流发送模块,用于以所述传输码率向所述订阅设备发送对应于所述第一分辨率的视频流。The first video stream sending module is configured to send the video stream corresponding to the first resolution to the subscription device at the transmission bit rate.
在第二方面的第二种实现方式中,所述第二视频流发送单元包括:In a second implementation manner of the second aspect, the second video stream sending unit includes:
第二传输码率确定单元,用于若当前可分配码率大于或者等于所述第二分辨率对应的最 低码率以及所述码率阈值之和,根据所述第二分辨率对应的最低码率确定传输码率;The second transmission code rate determining unit is configured to, if the current allocable code rate is greater than or equal to the sum of the lowest code rate corresponding to the second resolution and the code rate threshold, according to the lowest code rate corresponding to the second resolution Rate determines the transmission code rate;
第二视频流发送模块,用于以所述传输码率向所述订阅设备发送对应于所述第二分辨率的视频流。The second video stream sending module is configured to send the video stream corresponding to the second resolution to the subscription device at the transmission bit rate.
根据第二方面的第一种实现方式或者第二种实现方式,在第二方面的第三种实现方式中,所述当前可分配码率为所述上行码率与所述传输码率之差。According to the first implementation manner or the second implementation manner of the second aspect, in the third implementation manner of the second aspect, the current allocable code rate is the difference between the uplink code rate and the transmission code rate .
根据第二方面的第三种实现方式,在第二方面的第四种实现方式中,还包括:According to the third implementation manner of the second aspect, the fourth implementation manner of the second aspect further includes:
第三码率参数确定模块,用于当检测到当前上行码率更新,且上一时刻已向所述订阅设备发送所述第一分辨率的视频流时,获取所述订阅设备所订阅的视频流的第一分辨率对应的最低码率以及码率阈值;The third bit rate parameter determination module is used to obtain the video subscribed by the subscribing device when the current uplink bit rate update is detected and the video stream of the first resolution has been sent to the subscribing device at the last moment The lowest bit rate and the bit rate threshold corresponding to the first resolution of the stream;
第三视频流发送单元,用于若当前可分配码率大于或者等于所述第一分辨率对应的最低码率以及所述码率阈值之差,向所述订阅设备发送对应于所述第一分辨率的视频流。The third video stream sending unit is configured to send to the subscription device the difference between the lowest bit rate corresponding to the first resolution and the bit rate threshold if the current allocable bit rate is greater than or equal to the Resolution of the video stream.
根据第二方面的第四种实现方式,在第二方面的第五种实现方式中,还包括:According to the fourth implementation manner of the second aspect, the fifth implementation manner of the second aspect further includes:
第二分辨率确定模块,用于若当前可分配码率小于所述第一分辨率对应的最低码率以及所述码率阈值之差,确定所述视频流是否包括有低于所述第一分辨率的未订阅的第二分辨率;The second resolution determining module is configured to determine whether the video stream includes a bit rate lower than the first bit rate if the current allocable bit rate is less than the minimum bit rate corresponding to the first resolution and the bit rate threshold. The unsubscribed second resolution of the resolution;
第四码率参数确定模块,用于若所述视频流包括有低于所述第一分辨率的未订阅的第二分辨率,根据所述第二分辨率获取该第二分辨率的最低码率以及码率阈值;The fourth code rate parameter determination module is configured to, if the video stream includes an unsubscribed second resolution lower than the first resolution, obtain the lowest code of the second resolution according to the second resolution Rate and bit rate threshold;
第四视频流发送单元,用于若当前可分配码率大于或者等于所述第二分辨率对应的最低码率以及所述码率阈值之和,向所述订阅设备发送对应于所述第二分辨率的视频流。The fourth video stream sending unit is configured to send to the subscription device corresponding to the second bit rate if the current allocable bit rate is greater than or equal to the sum of the lowest bit rate corresponding to the second resolution and the bit rate threshold. Resolution of the video stream.
根据第二方面的以上任一种实现方式,在第二方面的第六种实现方式中,还包括:According to any one of the foregoing implementation manners of the second aspect, in the sixth implementation manner of the second aspect, the method further includes:
订阅信息接收模块,用于接收所述订阅设备的视频订阅信息;其中,所述视频订阅信息包括订阅的视频流的第一分辨率。The subscription information receiving module is configured to receive the video subscription information of the subscription device; wherein the video subscription information includes the first resolution of the subscribed video stream.
第三方面,本公开实施例提供了一种视频传输装置设备,包括处理器、存储器以及存储在所述存储器中且被配置为由所述处理器执行的计算机程序,所述处理器执行所述计算机程序时实现如第一方面中任意一项所述的视频传输方法。In a third aspect, embodiments of the present disclosure provide a video transmission device, including a processor, a memory, and a computer program stored in the memory and configured to be executed by the processor, and the processor executes the The computer program implements the video transmission method as described in any one of the first aspect.
第四方面,本公开实施例提供了一种计算机可读存储介质,所述计算机可读存储介质包括存储的计算机程序,其中,在所述计算机程序运行时控制所述计算机可读存储介质所在设备执行如第一方面中任意一项所述的视频传输方法。In a fourth aspect, an embodiment of the present disclosure provides a computer-readable storage medium, the computer-readable storage medium includes a stored computer program, wherein the device where the computer-readable storage medium is located is controlled when the computer program is running Perform the video transmission method as described in any one of the first aspect.
以上实施例具有如下有益效果:The above embodiments have the following beneficial effects:
当检测到当前上行码率更新,且上一时刻未向订阅设备发送订阅的第一分辨率的视频流时,获取订阅设备的视频订阅信息并确定订阅的视频流的第一分辨率对应的最低码率以及码率阈值,若当前上行码率大于或者等于所述第一分辨率对应的最低码率以及所述码率阈值之 和,向所述订阅设备发送对应于所述第一分辨率的视频流,若当前上行码率小于所述第一分辨率对应的最低码率以及所述码率阈值之和,且所述视频流包括有低于所述第一分辨率的未订阅的第二分辨率时,根据所述第二分辨率获取该第二分辨率对应的最低码率以及码率阈值,若当前上行码率大于或者等于所述第二分辨率对应的最低码率以及所述码率阈值之和,向所述订阅设备发送对应于所述第二分辨率的视频流,其中从第一分辨率切换为第二分辨率的条件由所述第二分辨率的最低码率及切换阈值确定的,通过对应的最低码率及切换阈值对所述第一分辨率和第二分辨率的发送条件进行动态调整,使得不同分辨率的视频流层次之间的切换不再基于各个视频流层次的最低码率,从而实现对于分辨率之间切换的控制,有利于减少因上行码率的影响导致的不同分辨率的视频流频繁切换的问题,从而减少关键帧的发送,减少过多的上行带宽的占用,实现运行资源的综合使用,同时也保证订阅者良好的订阅体验。When it is detected that the current uplink bit rate is updated, and the subscribed video stream of the first resolution is not sent to the subscribing device at the last moment, obtain the video subscription information of the subscribing device and determine the minimum corresponding to the first resolution of the subscribed video stream The code rate and the code rate threshold, if the current uplink code rate is greater than or equal to the sum of the lowest code rate corresponding to the first resolution and the code rate threshold, send to the subscription device the data corresponding to the first resolution Video stream, if the current uplink bit rate is less than the sum of the lowest bit rate corresponding to the first resolution and the bit rate threshold, and the video stream includes an unsubscribed second bit rate lower than the first resolution For resolution, obtain the lowest bit rate and the bit rate threshold corresponding to the second resolution according to the second resolution, if the current uplink bit rate is greater than or equal to the lowest bit rate corresponding to the second resolution and the bit rate threshold The sum of the rate thresholds, the video stream corresponding to the second resolution is sent to the subscription device, where the condition for switching from the first resolution to the second resolution is determined by the lowest bit rate of the second resolution and the switching If the threshold is determined, the sending conditions of the first resolution and the second resolution are dynamically adjusted through the corresponding minimum bit rate and switching threshold, so that the switching between video stream levels of different resolutions is no longer based on each video stream The lowest bit rate of the level, so as to realize the control of switching between resolutions, which is helpful to reduce the frequent switching of video streams of different resolutions caused by the influence of the upstream bit rate, thereby reducing the transmission of key frames and reducing excessive The occupancy of the uplink bandwidth realizes the comprehensive use of operating resources, while also ensuring a good subscription experience for subscribers.
附图说明Description of the drawings
为了更清楚地说明本公开的技术方案,下面将对实施方式中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本公开的一些实施方式,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。In order to explain the technical solutions of the present disclosure more clearly, the following will briefly introduce the drawings that need to be used in the embodiments. Obviously, the drawings in the following description are only some embodiments of the present disclosure, which are common in the art. As far as technical personnel are concerned, they can also obtain other drawings based on these drawings without creative work.
图1是本公开第一实施例提供的视频传输方法的流程示意图。Fig. 1 is a schematic flowchart of a video transmission method provided by the first embodiment of the present disclosure.
图2是本公开第二实施例提供的视频传输装置的结构示意图。Fig. 2 is a schematic structural diagram of a video transmission device provided by a second embodiment of the present disclosure.
图3是本公开第三实施例提供的视频传输设备的结构示意图。Fig. 3 is a schematic structural diagram of a video transmission device provided by a third embodiment of the present disclosure.
具体实施方式detailed description
下面将结合本公开实施例中的附图,对本公开实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本公开一部分实施例,而不是全部的实施例。基于本公开中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都属于本公开保护的范围。The technical solutions in the embodiments of the present disclosure will be described clearly and completely with reference to the accompanying drawings in the embodiments of the present disclosure. Obviously, the described embodiments are only a part of the embodiments of the present disclosure, rather than all the embodiments. Based on the embodiments in the present disclosure, all other embodiments obtained by those of ordinary skill in the art without creative work shall fall within the protection scope of the present disclosure.
请参阅图1,本公开第一实施例提供了一种视频传输方法,其可由视频传输设备来执行,所述视频传输设备可以是两个或多个物理实体构成,也可以是一个物理实体构成,该视频传输设备可以是电脑,手机,平板电脑、智能平板或者服务器等计算设备。所述视频传输设备作为发布-订阅模式中的发布者视频源端,根据订阅设备的订阅情况向订阅设备传输订阅的视频流,所述订阅设备可以是电脑,手机,平板电脑、智能平板或者服务器等计算设备,所述订阅设备可以根据自身的实际情况订阅一个分辨率层级的视频流,也可以订阅多个分辨率层级的视频流。Referring to Fig. 1, the first embodiment of the present disclosure provides a video transmission method, which can be executed by a video transmission device, and the video transmission device may be composed of two or more physical entities, or may be composed of one physical entity. , The video transmission device can be a computing device such as a computer, mobile phone, tablet, smart tablet, or server. The video transmission device serves as the publisher's video source terminal in the publish-subscribe mode, and transmits the subscribed video stream to the subscribing device according to the subscription status of the subscribing device. The subscribing device may be a computer, a mobile phone, a tablet, a smart tablet or a server Such as computing devices, the subscription device may subscribe to a video stream of one resolution level according to its actual situation, or may subscribe to video streams of multiple resolution levels.
请参阅图1,所述视频传输方法包括以下步骤:Referring to Figure 1, the video transmission method includes the following steps:
S11,当检测到当前上行码率更新,且上一时刻未向订阅设备发送订阅的第一分辨率的视频流时,获取所述接收订阅设备的视频订阅信息;其中,所述视频订阅信息包括订阅的视频流的第一分辨率。S11: When it is detected that the current uplink bit rate is updated, and the subscribed video stream of the first resolution is not sent to the subscribing device at the previous moment, obtain the video subscription information of the subscribing device; wherein, the video subscription information includes The first resolution of the subscribed video stream.
在本公开实施例中,在作为视频源发布者的所述视频传输设备中,所述视频流设置有若干分辨率,例如所述视频流设置有4种分辨率层级,分别为180p、360p、720p及1080p等,所述订阅设备会向作为视频源发布者的所述视频传输设备订阅期望的视频流,订阅者向所述视频传输设备订阅视频流时,需要携带分辨率信息,告知所述视频传输设备自己期望接收的分辨率,所述视频传输设备在接收所述订阅设备的视频订阅信息之后,获取所述视频订阅信息中包括的订阅的视频流的第一分辨率,然后根据所述订阅设备期望的第一分辨率确定发送的视频流,需要说明的是,所述订阅设备可订阅一个分辨率层级的视频流,也可以订阅多个不同分辨率层级的视频流,为将所述订阅设备所订阅的分辨率层级以及非订阅的分辨率层级区别开来,将作为所述订阅设备订阅的所述视频流的分辨率层级定义为第一分辨率,将所述订阅者非订阅的所述视频流的分辨率层级定义为第二分辨率。In the embodiment of the present disclosure, in the video transmission device as a video source publisher, the video stream is set with several resolutions. For example, the video stream is set with 4 resolution levels, namely 180p, 360p, 720p and 1080p, etc., the subscribing device will subscribe the desired video stream to the video transmission device as the publisher of the video source. When subscribing to the video transmission device, the subscriber needs to carry resolution information to inform the The video transmission device itself expects to receive the resolution. After receiving the video subscription information of the subscription device, the video transmission device obtains the first resolution of the subscribed video stream included in the video subscription information, and then according to the The first resolution expected by the subscribing device determines the video stream to be sent. It should be noted that the subscribing device may subscribe to a video stream of one resolution level, or may subscribe to multiple video streams of different resolution levels. The resolution level subscribed by the subscribing device is distinguished from the non-subscribed resolution level, the resolution level of the video stream subscribed by the subscribing device is defined as the first resolution, and the subscriber is not subscribed The resolution level of the video stream is defined as the second resolution.
在本公开实施例中,当检测到当前上行码率更新,且上一时刻未向订阅设备发送订阅的第一分辨率的视频流时,可能是所述视频传输设备刚接收到该订阅者的订阅请求的情况,上一次上行码率更新时没有为该第一视频流层级分配码率,也可能是上一次上行码率更新时上一次的可分配码率不满足该第一分辨率的需求码率范围,因此或者满足向下切换确定了第二分辨率,或者不满足向下切换条件也没有确定第二分辨率,此时所述视频传输设备获取所述接收订阅设备的视频订阅信息。In the embodiment of the present disclosure, when it is detected that the current uplink bit rate is updated, and the subscribed video stream of the first resolution is not sent to the subscribed device at the last moment, it may be that the video transmission device has just received the subscriber's In the case of a subscription request, the first video stream level was not allocated a bit rate during the last uplink bit rate update, or it may be that the last allocable bit rate during the last uplink bit rate update did not meet the requirements of the first resolution. The code rate range, therefore, either the second resolution is determined by the downward switching, or the second resolution is not met and the second resolution is not met, and the video transmission device acquires the video subscription information of the subscription receiving device.
S12,根据所述第一分辨率获取该第一分辨率对应的最低码率以及码率阈值。S12: Obtain a minimum bit rate and a bit rate threshold corresponding to the first resolution according to the first resolution.
在本公开实施例中,需要说明的是,在作为视频源发布者的所述视频传输设备中,所述视频流设置有若干分辨率,例如所述视频流设置有4种分辨率层级,分别为180P,360P,720P,1080P等,每一分辨率层级分别设置有对应的最低码率以及切换阈值,其中所述最低码率表示传输给该分辨率层级的视频流所需要的最小传输码率,例如设置180P分辨率的视频流需要的最低码率为30k,对应的切换阈值为0K;360P分辨率的视频流需要的最低码率为200k,对应的切换阈值为50K;720P分辨率的视频流需要的最低码率为600k,对应的切换阈值为100K;1080P分辨率的视频流需要的最低码率为800k,对应的切换阈值为150K等等;需要说明的是,本公开对于分辨率层级的划分以及最低码率、切换阈值的具体数值的设置不做任何限定,上述数值仅为举例说明,本领域技术人员可以理解的是,所述分辨率层级的划分以及最低码率、切换阈值的具体数值的设置可依据实际情况进行设置,为进一步发送所述订阅 设备订阅的所述视频流,首先所述视频传输设备根据所述第一分辨率获取该第一分辨率对应的最低码率以及码率阈值,以进一步确定是否要发送所述第一分辨率的视频流。In the embodiments of the present disclosure, it should be noted that, in the video transmission device as the video source publisher, the video stream is set with several resolutions, for example, the video stream is set with 4 resolution levels, respectively For 180P, 360P, 720P, 1080P, etc., each resolution level is set with the corresponding minimum bit rate and switching threshold, where the minimum bit rate represents the minimum transmission bit rate required to transmit to the video stream of that resolution level For example, setting the minimum bit rate required for a 180P resolution video stream is 30k, and the corresponding switching threshold is 0K; a 360P resolution video stream requires a minimum bit rate of 200k, and the corresponding switching threshold is 50K; 720P resolution video The minimum bit rate required for a stream is 600k, and the corresponding switching threshold is 100K; the minimum bit rate required for a 1080P resolution video stream is 800k, and the corresponding switching threshold is 150K, etc.; it should be noted that the present disclosure is for the resolution level The division of the resolution and the specific values of the minimum bit rate and switching threshold are not limited in any way. The above values are only examples. Those skilled in the art can understand that the division of the resolution levels and the minimum bit rate and switching threshold The setting of the specific value can be set according to actual conditions. To further send the video stream subscribed by the subscription device, first, the video transmission device obtains the lowest bit rate corresponding to the first resolution according to the first resolution, and The bit rate threshold is used to further determine whether to send the video stream of the first resolution.
S13,若当前上行码率大于或者等于所述第一分辨率对应的最低码率以及所述码率阈值之和,向所述服务器发送对应于所述第一分辨率的视频流。S13: If the current uplink bit rate is greater than or equal to the sum of the lowest bit rate corresponding to the first resolution and the bit rate threshold, send a video stream corresponding to the first resolution to the server.
在本公开实施例中,所述订阅设备可订阅一个分辨率层级的视频流,也可以订阅多个不同分辨率层级的视频流,当所述订阅设备订阅一个分辨率层级的视频流时,当前可分配码率为上行码率与传输码率之差,已分配的传输码率为0,则当前可分配码率等于当前上行码率,所述视频传输设备判断当前可分配码率(即当前上行码率)与所述第一分辨率对应的最低码率和所述码率阈值之和的大小关系,若当前可分配码率大于或者等于所述第一分辨率对应的最低码率以及所述码率阈值之和,则所述视频传输设备根据所述第一分辨率对应的最低码率确定传输码率,然后以所述传输码率向所述订阅设备发送对应于所述第一分辨率的视频流。In the embodiment of the present disclosure, the subscription device may subscribe to a video stream of one resolution level, or may subscribe to multiple video streams of different resolution levels. When the subscription device subscribes to a video stream of a resolution level, the current The assignable code rate is the difference between the uplink code rate and the transmission code rate. If the assigned transmission code rate is 0, then the current assignable code rate is equal to the current uplink code rate. The video transmission device determines that the current assignable code rate (that is, the current Uplink code rate) The relationship between the minimum code rate corresponding to the first resolution and the sum of the code rate threshold, if the current allocable code rate is greater than or equal to the minimum code rate corresponding to the first resolution and the If the sum of the bit rate thresholds, the video transmission device determines the transmission bit rate according to the lowest bit rate corresponding to the first resolution, and then sends the transmission bit rate corresponding to the first resolution to the subscription device Rate of the video stream.
在本公开实施例中,当所述视频传输设备订阅多个不同分辨率层级的视频流时,所述视频传输设备以订阅的最低层级的第一分辨率为起始,且以订阅的最高层级的第一分辨率为终止,从低到高依次遍历所述订阅设备所订阅的所有第一分辨率,在遍历的每一层级的第一分辨率中,若在遍历到所述第一分辨率之前可能已经遍历了层级更低的第一分辨率并确定了相应的传输码率,则所述传输码率不为0,所述当前可分配码率为所述上行码率与所述传输码率之差,所述视频传输设备判断当前可分配码率与所述第一分辨率对应的最低码率和所述码率阈值之和的大小关系,若当前可分配码率大于或者等于所述第一分辨率对应的最低码率以及所述码率阈值之和,则所述视频传输设备根据所述第一分辨率对应的最低码率确定传输码率,然后以所述传输码率向所述订阅设备发送对应于所述第一分辨率的视频流。In the embodiment of the present disclosure, when the video transmission device subscribes to multiple video streams of different resolution levels, the video transmission device starts with the first resolution of the lowest level of subscription and starts with the highest level of subscription. The first resolution of traverses all the first resolutions subscribed to by the subscription device from low to high. Among the first resolutions of each level of traversal, if you traverse to the first resolution The first resolution with a lower level may have been traversed before and the corresponding transmission code rate may have been determined, then the transmission code rate is not 0, and the current allocable code rate is the uplink code rate and the transmission code rate The video transmission device determines the relationship between the current allocable bit rate and the sum of the lowest bit rate corresponding to the first resolution and the bit rate threshold. If the current allocable bit rate is greater than or equal to the The minimum bit rate corresponding to the first resolution and the sum of the bit rate threshold, the video transmission device determines the transmission bit rate according to the minimum bit rate corresponding to the first resolution, and then transmits the bit rate to the The subscription device sends a video stream corresponding to the first resolution.
S14,若当前上行码率小于所述第一分辨率对应的最低码率以及所述码率阈值之和,且所述视频流包括有低于所述第一分辨率的未订阅的第二分辨率时,根据所述第二分辨率获取该第二分辨率对应的最低码率以及码率阈值。S14: If the current uplink bit rate is less than the sum of the lowest bit rate corresponding to the first resolution and the bit rate threshold, and the video stream includes an unsubscribed second resolution lower than the first resolution In the case of data rate, the minimum bit rate and the bit rate threshold corresponding to the second resolution are obtained according to the second resolution.
在本公开实施例中,所述视频传输设备判断当前可分配码率与所述第一分辨率对应的最低码率和所述码率阈值之和的大小关系,若当前可分配码率小于所述第一分辨率对应的最低码率以及所述码率阈值之和,表明当前可分配码率不支持发送所述第一分辨率的视频流,则所述视频传输设备确定所述视频流是否包括有低于所述第一分辨率的未订阅的第二分辨率,以进行分辨率切换的过程,若所述视频流包括有低于所述第一分辨率的未订阅的第二分辨率,则所述视频传输设备根据所述第二分辨率获取该第二分辨率的最低码率以及码率阈值。In the embodiment of the present disclosure, the video transmission device determines the relationship between the current allocable bit rate and the sum of the lowest bit rate corresponding to the first resolution and the bit rate threshold. If the current allocable bit rate is less than the total bit rate, The sum of the lowest bit rate corresponding to the first resolution and the bit rate threshold indicates that the current allocable bit rate does not support sending the video stream of the first resolution, and the video transmission device determines whether the video stream is Including an unsubscribed second resolution lower than the first resolution to perform a resolution switching process, if the video stream includes an unsubscribed second resolution lower than the first resolution , The video transmission device obtains the lowest bit rate and the bit rate threshold of the second resolution according to the second resolution.
S15,若当前上行码率大于或者等于所述第二分辨率对应的最低码率以及所述码率阈值之和,向所述服务器发送对应于所述第二分辨率的视频流。S15: If the current uplink bit rate is greater than or equal to the sum of the lowest bit rate corresponding to the second resolution and the bit rate threshold, send a video stream corresponding to the second resolution to the server.
在本公开实施例中,所述视频传输设备判断当前可分配码率与所述第二分辨率对应的最低码率和所述码率阈值之和的大小关系,若当前可分配码率大于或者等于所述第二分辨率对应的最低码率以及所述码率阈值之和,则所述视频传输设备根据所述第二分辨率对应的最低码率确定传输码率,并以所述传输码率向所述订阅设备发送对应于所述第二分辨率的视频流;若当前可分配码率小于所述第二分辨率对应的最低码率以及所述码率阈值之和,则所述视频传输设备不发送所述视频流;需要说明的是,若所述视频传输设备获取有多个未订阅的第二分辨率,且所述第二分辨率均满足当前可分配码率大于或者等于所述第二分辨率对应的最低码率以及所述码率阈值之和时,选择层级最高的第二分辨率,比如订阅设备订阅第一分辨率为720P层级的视频流,当前可分配码率不满足该层级的码率需求,无法为该第一视频流层级确定传输码率,但是未订阅的第二分辨率的180P层级和360P层级都满足条件,则选择较高层级的360P层级确定传输码率。In the embodiment of the present disclosure, the video transmission device determines the magnitude relationship between the current allocable bit rate and the sum of the lowest bit rate corresponding to the second resolution and the bit rate threshold. If the current allocable bit rate is greater than or Equal to the sum of the lowest bit rate corresponding to the second resolution and the bit rate threshold, the video transmission device determines the transmission bit rate according to the lowest bit rate corresponding to the second resolution, and uses the transmission code Send the video stream corresponding to the second resolution to the subscription device; if the current allocable bit rate is less than the sum of the lowest bit rate corresponding to the second resolution and the bit rate threshold, the video The transmission device does not send the video stream; it should be noted that if the video transmission device acquires multiple unsubscribed second resolutions, and the second resolutions all meet the current allocable bit rate greater than or equal to all When the minimum bit rate corresponding to the second resolution and the sum of the bit rate threshold are selected, the second resolution with the highest level is selected. For example, a subscription device subscribes to a video stream with a first resolution of 720P. To meet the bit rate requirements of this level, the transmission code rate cannot be determined for the first video stream level, but the 180P level and 360P level of the second resolution that are not subscribed meet the conditions, then the higher level 360P level is selected to determine the transmission code rate.
在本公开实施例中,所述视频传输设备对确定了传输码率的所述视频流进行编码和发送,因为确定传输码率的所述视频流的分辨率与订阅设备向所述视频传输设备订阅的视频流的期望分辨率可能不一样,如果上行码率满足订阅的第一分辨率对应的最低码率以及所述码率阈值之和,所述视频传输设备发送与订阅设备订阅的第一分辨率相同质量的视频流,但是当上行码率较低时,即不满足订阅的第一分辨率对应的最低码率以及所述码率阈值之和,所述视频传输设备会根据符合条件发送订阅者非订阅的第二分辨率的质量的视频流,所述第一分辨率的层级高于所述第二分辨率的层级,当所述视频传输设备开始发送某一分辨率的视频流时,首先需要发送该分辨率层级对应的关键帧,当所述订阅设备接收到该视频流的分辨率层级对应的关键帧时,才能根据收到的关键帧开始解码接收到的所述视频流。In the embodiment of the present disclosure, the video transmission device encodes and sends the video stream whose transmission bit rate is determined, because the resolution of the video stream whose transmission bit rate is determined is different from that of the subscription device to the video transmission device. The expected resolution of the subscribed video stream may be different. If the upstream bit rate meets the sum of the minimum bit rate corresponding to the subscribed first resolution and the bit rate threshold, the video transmission device sends the first subscribed to the subscribed device. Video streams with the same resolution and quality, but when the upstream bit rate is low, that is, the minimum bit rate corresponding to the first resolution subscribed and the sum of the bit rate threshold are not met, the video transmission device will send according to the conditions The subscriber is not subscribed to the second resolution quality video stream, the first resolution level is higher than the second resolution level, when the video transmission device starts to send a certain resolution video stream First, it is necessary to send the key frame corresponding to the resolution level. When the subscribing device receives the key frame corresponding to the resolution level of the video stream, it can start to decode the received video stream according to the received key frame.
在本公开实施例中,例如所述视频传输设备设置180P,360P,720P,1080P共4个分辨率层级,设置180P分辨率的视频流需要的最低码率为30k,对应的切换阈值为0K;360P分辨率的视频流需要的最低码率为200k,对应的切换阈值为50K;720P分辨率的视频流需要的最低码率为600k,对应的切换阈值为100K;1080P分辨率的视频流需要的最低码率为800k,对应的切换阈值为150K;比如订阅设备向所述视频传输设备订阅360P层级的视频流,初始第一时刻,作为视频发布源端的所述视频传输设备的上行码率为210k,视频传输设备所述视频传输设备需要判断此时的当前可分配码率,即此刻的上行码率是否满足大于或者等于360P的第一分辨率对应的最低码率及切换阈值之和,由于210K小于250k,因此不给订阅的360P的第一视频流层次确定传输码率,下面判断是否满足向下切换条件:确定存在比订阅的360P的第一分辨率的层级更低的非订阅的180P的第二分辨率,且此刻的上行码率大于所述第二分辨率对应的最低码率及切换阈值之和,210K大于30K,满足向下切换的条件,根据180P的 第二分辨率的最低码率确定传输码率,并以所述传输码率向所述订阅者发送对应于所述第二分辨率的视频流;第二时刻,作为视频发布源端的所述视频传输设备上行码率更新为300k,由于第一时刻所述视频传输设备没有给360P的第一视频流层次确定传输码率,因此需要判断当前可分配码率,即上行码率是否满足大于或者等于360P的第一分辨率对应的最低码率及切换阈值之和,由于300k高于250k,因此根据360P的第一分辨率的最低码率确定传输码率,并以所述传输码率向所述订阅设备发送对应于所述第一分辨率的视频流;第三时刻,作为视频发布源端的所述视频传输设备上行码率为180k,由于第二时刻源端有给360P的第一视频流层次确定传输码率,因此需要判断当前可分配码率,即此刻的上行码率是否满足大于或者等于360P的第一分辨率对应的最低码率及切换阈值之差,由于180k高于150k,因此第三时刻仍然根据360P的第一分辨率的最低码率确定传输码率,并以所述传输码率向所述订阅设备发送对应于所述第一分辨率的视频流,这样即使上行的码率在最低码率附近波动时,只要波动的幅度不超过切换阈值的2倍,也不会频繁的切换,从而避免占据过多的上行带宽,保证所述视频流的传输效率。In the embodiment of the present disclosure, for example, the video transmission device sets a total of 4 resolution levels of 180P, 360P, 720P, and 1080P. The minimum bit rate required to set a video stream with a resolution of 180P is 30k, and the corresponding switching threshold is 0K; The minimum bit rate required for a 360P resolution video stream is 200k, and the corresponding switching threshold is 50K; the minimum bit rate required for a 720P resolution video stream is 600k, and the corresponding switching threshold is 100K; the 1080P resolution video stream requires The minimum bit rate is 800k, and the corresponding switching threshold is 150K; for example, the subscription device subscribes to the video transmission device for a 360P-level video stream, at the first moment, the upstream bit rate of the video transmission device as the video publishing source is 210k , Video transmission equipment The video transmission equipment needs to determine the current allocable bit rate at this time, that is, whether the uplink bit rate at this moment meets the sum of the minimum bit rate corresponding to the first resolution greater than or equal to 360P and the switching threshold, because 210K It is less than 250k, so the transmission bit rate is not determined for the subscribed 360P first video stream level. Next, determine whether the down switching condition is met: determine that there is a non-subscribed 180P lower than the subscribed 360P first resolution level The second resolution, and the uplink bit rate at this moment is greater than the sum of the minimum bit rate and the switching threshold corresponding to the second resolution, 210K is greater than 30K, and the downward switching conditions are met, according to the minimum code of the second resolution of 180P The transmission bit rate is determined by the transmission bit rate, and the video stream corresponding to the second resolution is sent to the subscriber at the transmission bit rate; at the second moment, the uplink bit rate of the video transmission device as the video publishing source is updated to 300k, because the video transmission device did not determine the transmission bit rate for the first video stream level of 360P at the first moment, it is necessary to determine the current allocable bit rate, that is, whether the uplink bit rate meets the corresponding first resolution greater than or equal to 360P The sum of the minimum bit rate and the switching threshold of 300k is higher than 250k. Therefore, the transmission bit rate is determined according to the minimum bit rate of the first resolution of 360P, and the transmission bit rate is used to send the transmission bit rate corresponding to the subscribed device The first resolution video stream; at the third moment, the upstream bit rate of the video transmission device as the video publishing source is 180k. Because the source at the second moment determines the transmission bit rate for the first video stream level of 360P, it needs Determine the current allocable bit rate, that is, whether the uplink bit rate at this moment meets the difference between the minimum bit rate corresponding to the first resolution greater than or equal to 360P and the switching threshold. Since 180k is higher than 150k, the third moment is still based on the 360P first resolution. The lowest bit rate of a resolution determines the transmission bit rate, and sends the video stream corresponding to the first resolution to the subscription device at the transmission bit rate, so that even if the uplink bit rate fluctuates near the lowest bit rate As long as the amplitude of the fluctuation does not exceed 2 times the switching threshold, frequent switching will not occur, thereby avoiding occupying too much upstream bandwidth and ensuring the transmission efficiency of the video stream.
综上所述,本公开第一实施例提供了一种视频传输方法,接收订阅设备的视频订阅信息并确定订阅的视频流的第一分辨率对应的最低码率以及码率阈值,若当前上行码率大于或者等于所述第一分辨率对应的最低码率以及所述码率阈值之和,向所述订阅设备发送对应于所述第一分辨率的视频流,若当前上行码率小于所述第一分辨率对应的最低码率以及所述码率阈值之和,且所述视频流包括有低于所述第一分辨率的未订阅的第二分辨率时,根据所述第二分辨率获取该第二分辨率对应的最低码率以及码率阈值,若当前上行码率大于或者等于所述第二分辨率对应的最低码率以及所述码率阈值之和,向所述订阅设备发送对应于所述第二分辨率的视频流,其中从第一分辨率切换为第二分辨率的条件由所述第二分辨率的最低码率及切换阈值确定的,通过对应的最低码率及切换阈值对所述第一分辨率和第二分辨率的发送条件进行动态调整,使得不同分辨率的视频流之间的切换不再基于各个分辨率的最低码率,从而实现对于分辨率之间切换的控制,有利于减少因上行码率的影响导致的不同分辨率的视频流频繁切换的问题,从而减少关键帧的发送,减少过多的上行带宽的占用,实现运行资源的综合使用,同时也保证订阅者良好的订阅体验。In summary, the first embodiment of the present disclosure provides a video transmission method, which receives video subscription information of a subscription device and determines the lowest bit rate and bit rate threshold corresponding to the first resolution of the subscribed video stream. If the current uplink The bit rate is greater than or equal to the sum of the lowest bit rate corresponding to the first resolution and the bit rate threshold, and the video stream corresponding to the first resolution is sent to the subscription device, if the current uplink bit rate is less than the total bit rate. When the minimum bit rate corresponding to the first resolution and the sum of the bit rate threshold, and the video stream includes an unsubscribed second resolution lower than the first resolution, according to the second resolution Obtain the minimum bit rate corresponding to the second resolution and the bit rate threshold, and if the current uplink bit rate is greater than or equal to the sum of the minimum bit rate corresponding to the second resolution and the bit rate threshold, send a notification to the subscription device Send a video stream corresponding to the second resolution, where the condition for switching from the first resolution to the second resolution is determined by the lowest bit rate of the second resolution and the switching threshold, and the corresponding lowest bit rate And the switching threshold dynamically adjusts the sending conditions of the first resolution and the second resolution, so that the switching between video streams of different resolutions is no longer based on the lowest bit rate of each resolution, so that the resolution of the The control of inter-switching helps to reduce the frequent switching of video streams of different resolutions caused by the influence of the uplink bit rate, thereby reducing the transmission of key frames, reducing the occupation of excessive uplink bandwidth, and realizing the comprehensive use of operating resources. It also guarantees a good subscription experience for subscribers.
为了便于对本公开的理解,下面将对本公开的一些示例实施例进行描述。In order to facilitate the understanding of the present disclosure, some example embodiments of the present disclosure will be described below.
本公开第一个示例实施例:The first exemplary embodiment of the present disclosure:
在本公开第一实施例的基础上,所述视频传输方法还包括:Based on the first embodiment of the present disclosure, the video transmission method further includes:
当检测到当前上行码率更新,且上一时刻已向所述订阅设备发送所述视频流时,获取所 述订阅设备所订阅的视频流的第一分辨率对应的最低码率以及码率阈值。When it is detected that the current uplink bit rate is updated, and the video stream has been sent to the subscribing device at the last moment, obtain the lowest bit rate and bit rate threshold corresponding to the first resolution of the video stream subscribed by the subscribing device .
若当前可分配码率大于或者等于所述第一分辨率对应的最低码率以及所述码率阈值之差,向所述订阅设备发送对应于所述第一分辨率的视频流。If the current allocable bit rate is greater than or equal to the difference between the lowest bit rate corresponding to the first resolution and the bit rate threshold, sending the video stream corresponding to the first resolution to the subscription device.
在本公开实施例中,所述视频传输设备实时检测上行接口的总的码率,即上行码率,以保证向所述订阅设备发送的视频流的质量,所述视频传输设备在检测到当前上行码率更新,且上一时刻已向所述订阅设备发送所述视频流时,其中所述更新的条件可依据实际情况进行设置,例如可以为本次的上行码率较上一次的上行码率发生了变化,或者本次的上行码率较上一次的上行码率的变化幅度超过了预设幅度阈值等等,当前所述视频传输设备根据当前更新的上行码率重新确认可以发送的所述视频流的分辨率,所述订阅设备可订阅一个分辨率层级的视频流,也可以订阅多个不同分辨率层级的视频流,当所述订阅设备订阅一个分辨率层级的视频流时,已分配的传输码率为0,则当前可分配码率等于当前上行码率;当所述视频传输设备订阅多个不同分辨率层级的视频流时,所述视频传输设备以订阅的最低层级的第一分辨率为起始,且以订阅的最高层级的第一分辨率为终止,从低到高依次遍历所述订阅设备所订阅的所有第一分辨率,所述当前可分配码率为所述上行码率与所述传输码率之差,若当前遍历的是所述订阅者的第一个第一分辨率,则所述传输码率为0,所述当前可分配码率等于所述上行码率,若在遍历到所述第一分辨率之前可能已经遍历了层级更低的第一分辨率并确定了相应的传输码率,则所述当前可分配码率为所述上行码率与所述传输码率之差,则所述视频传输设备获取所述订阅设备所订阅的视频流的第一分辨率对应的最低码率以及码率阈值,所述当前可分配码率为所述上行码率与所述传输码率之差,所述视频传输设备判断当前可分配码率与所述第一分辨率对应的最低码率和所述码率阈值之差的大小关系,若当前可分配码率大于或者等于所述第一分辨率对应的最低码率以及所述码率阈值之差,所述视频传输设备仍然根据所述第一分辨率对应的最低码率确定传输码率,并以所述传输码率向所述订阅设备发送对应于所述第一分辨率的视频流。In the embodiment of the present disclosure, the video transmission device detects the total bit rate of the uplink interface in real time, that is, the uplink bit rate to ensure the quality of the video stream sent to the subscription device. The video transmission device detects that the current When the uplink bit rate is updated, and the video stream has been sent to the subscription device at the last moment, the update condition can be set according to the actual situation, for example, the uplink bit rate of this time may be higher than the uplink code of the last time. Rate has changed, or this time the uplink bit rate has changed more than the previous uplink bit rate than the preset amplitude threshold, etc., the current video transmission device reconfirms all the data that can be sent according to the currently updated uplink bit rate. Regarding the resolution of the video stream, the subscribing device can subscribe to a video stream of one resolution level, or it can subscribe to multiple video streams of different resolution levels. When the subscribing device subscribes to a video stream of a resolution level, If the allocated transmission bit rate is 0, the current allocable bit rate is equal to the current uplink bit rate; when the video transmission device subscribes to multiple video streams of different resolution levels, the video transmission device subscribes to the lowest level of the subscription. A resolution starts and ends with the first resolution of the highest level subscribed. It traverses all the first resolutions subscribed by the subscription device from low to high, and the current allocable bit rate is the The difference between the uplink code rate and the transmission code rate. If the current traversal is the first resolution of the subscriber, the transmission code rate is 0, and the current allocable code rate is equal to the uplink code rate. Code rate, if the first resolution with a lower level may have been traversed before the first resolution is traversed and the corresponding transmission code rate has been determined, then the current allocable code rate is the same as the uplink code rate If the difference between the transmission bitrates, the video transmission device obtains the lowest bitrate and the bitrate threshold corresponding to the first resolution of the video stream subscribed by the subscription device, and the current allocable bitrate is the uplink The difference between the bit rate and the transmission bit rate, the video transmission device determines the magnitude relationship between the current allocable bit rate and the lowest bit rate corresponding to the first resolution and the difference between the bit rate threshold, and if the current allocable bit rate is The bit rate is greater than or equal to the difference between the lowest bit rate corresponding to the first resolution and the bit rate threshold, the video transmission device still determines the transmission bit rate according to the lowest bit rate corresponding to the first resolution, and The transmission code rate sends the video stream corresponding to the first resolution to the subscription device.
在本公开实施例中,在上行码率较低时,所述视频传输设备从订阅的第一分辨率向下切换为非订阅的第二分辨率时,需要满足所述当前可分配码率小于所述第一分辨率对应的最低码率及对应的切换阈值之差,在上行码率较高时,所述视频传输设备从所述第二分辨率向上切换为订阅的第一分辨率,需要满足所述当前可分配码率大于或者等于所述第一分辨率对应的最低码率及对应的切换阈值之和,这样即使上行的码率在最低码率附近波动时,只要波动的幅度不超过切换阈值的2倍,也不会频繁的切换,从而避免占据过多的上行带宽,保证视频流的传输效率。In the embodiment of the present disclosure, when the uplink bit rate is low, when the video transmission device switches down from the subscribed first resolution to the non-subscribed second resolution, it needs to satisfy that the current allocable bit rate is less than The difference between the lowest bit rate corresponding to the first resolution and the corresponding switching threshold. When the uplink bit rate is high, the video transmission device switches upwards from the second resolution to the subscribed first resolution. It is satisfied that the current allocable code rate is greater than or equal to the sum of the minimum code rate corresponding to the first resolution and the corresponding switching threshold, so that even if the uplink code rate fluctuates near the minimum code rate, as long as the amplitude of the fluctuation does not exceed The switching threshold is 2 times, and it will not switch frequently, thereby avoiding occupying too much upstream bandwidth and ensuring the transmission efficiency of the video stream.
本公开第二个示例实施例:The second exemplary embodiment of the present disclosure:
在本公开第一个示例实施例的基础上,所述视频传输方法还包括:Based on the first exemplary embodiment of the present disclosure, the video transmission method further includes:
若当前可分配码率小于所述第一分辨率对应的最低码率以及所述码率阈值之差,确定所述视频流是否包括有低于所述第一分辨率的未订阅的第二分辨率。If the current allocable bit rate is less than the difference between the lowest bit rate corresponding to the first resolution and the bit rate threshold, determine whether the video stream includes an unsubscribed second resolution lower than the first resolution rate.
若所述视频流包括有低于所述第一分辨率的未订阅的第二分辨率,根据所述第二分辨率获取该第二分辨率的最低码率以及码率阈值。If the video stream includes an unsubscribed second resolution lower than the first resolution, obtain the lowest bit rate and the bit rate threshold of the second resolution according to the second resolution.
若当前可分配码率大于或者等于所述第二分辨率对应的最低码率以及所述码率阈值之和,向所述订阅设备发送对应于所述第二分辨率的视频流。If the current allocable bit rate is greater than or equal to the sum of the lowest bit rate corresponding to the second resolution and the bit rate threshold, sending the video stream corresponding to the second resolution to the subscription device.
在本公开实施例中,所述当前可分配码率为所述上行码率与所述传输码率之差,所述视频传输设备判断当前可分配码率与所述第一分辨率对应的最低码率和所述码率阈值之差的大小关系,若当前可分配码率小于所述第一分辨率对应的最低码率以及所述码率阈值之差,并且所述视频流包括有低于所述第一分辨率的未订阅的第二分辨率时,根据第二分辨率获取该第二分辨率的最低码率以及码率阈值,所述视频传输设备判断当前可分配码率与所述第二分辨率对应的最低码率和所述码率阈值之和的大小关系,若当前可分配码率大于或者等于所述第二分辨率对应的最低码率以及所述码率阈值之和,则所述视频传输设备根据所述第二分辨率对应的最低码率确定传输码率,并以所述传输码率向所述订阅设备发送对应于所述第二分辨率的视频流;若当前可分配码率小于所述第二分辨率对应的最低码率以及所述码率阈值之和,则所述视频传输设备不发送所述视频流。In the embodiment of the present disclosure, the current allocable bit rate is the difference between the uplink bit rate and the transmission bit rate, and the video transmission device determines that the current allocable bit rate corresponds to the lowest value of the first resolution. The relationship between the size of the difference between the bit rate and the bit rate threshold. If the current allocable bit rate is less than the minimum bit rate corresponding to the first resolution and the difference between the bit rate threshold, and the video stream includes a bit rate lower than When the second resolution of the first resolution is not subscribed, the lowest bit rate and the bit rate threshold of the second resolution are acquired according to the second resolution, and the video transmission device determines that the current allocable bit rate is the same as the The relationship between the minimum bit rate corresponding to the second resolution and the sum of the bit rate threshold. If the current allocable bit rate is greater than or equal to the sum of the minimum bit rate corresponding to the second resolution and the bit rate threshold, The video transmission device determines the transmission bit rate according to the lowest bit rate corresponding to the second resolution, and sends the video stream corresponding to the second resolution to the subscription device at the transmission bit rate; The assignable bit rate is less than the sum of the lowest bit rate corresponding to the second resolution and the bit rate threshold, then the video transmission device does not send the video stream.
在本公开实施例中,例如所述视频传输设备设置180P,360P,720P,1080P共4个分辨率层级,设置180P分辨率的视频流需要的最低码率为30k,对应的切换阈值为0K;360P分辨率的视频流需要的最低码率为200k,对应的切换阈值为50K;720P分辨率的视频流需要的最低码率为600k,对应的切换阈值为100K;1080P分辨率的视频流需要的最低码率为800k,对应的切换阈值为150K;;例如订阅设备向所述视频传输设备订阅180P层级和720P层级的视频流,t0时刻,作为视频发布源端的所述视频传输设备的上行码率为20k,从低到高遍历所有第一分辨率,首先遍历180P的第一分辨率,由于当前可分配码率,即此刻的上行码率小于180P的第一分辨率对应的最低码率及切换阈值之和,20k<30k,因此不给180P的第一分辨率确定传输码率,由于没有比180P的第一分辨率的层级更低的第二分辨率,向下切换条件不满足,结束。t1时刻,作为视频发布源端的所述视频传输设备的上行码率更新为30k,从低到高遍历所有第一分辨率,首先遍历180P的第一分辨率,由于当前可分配码率,即此刻的上行码率满足大于或者等于180P的第一分辨率对应的最低码率及切换阈值之和,30k≥30k,因此给180P的第一分辨率确定传输码率,且确定的传输码率最小为30k,剩下的当前可分配码率为所述上行码率与所述传输码率之差,即剩下的当前可分配码率为0,结束。t2时刻, 作为视频发布源端的所述分辨率视频传输设备的上行码率更新为400k,从低到高遍历所有第一分辨率,首先遍历180P的第一分辨率,由于当前可分配码率,即此刻的上行码率满足大于或者等于180P的第一分辨率对应的最低码率及切换阈值之和,400k≥30k,因此给180P的第一分辨率确定传输码率,且确定的传输码率最小为30k,剩下的当前可分配码率为370K(400K-30K=370K),继续遍历,取下一个订阅的720P的第一分辨率,由于当前可分配码率小于720P的第一分辨率对应的最低码率及切换阈值之和,370k<750k,因此不给720P的第一分辨率确定传输码率,下面判断向下切换条件是否满足:确定非订阅的第二分辨率360P,没有分配过码率,且当前可分配码率满足大于或者等于360P的第二分辨率对应的最低码率及切换阈值之和,370k≥300k,因此360P的第二分辨率满足向下切换条件,给360P的第二分辨率确定传输码率,并以所述传输码率向所述订阅设备发送对应于所述第二分辨率的视频流。t3时刻,作为视频发布源端的所述视频传输设备的上行码率更新为800k,从低到高遍历所有第一分辨率,首先遍历180P的第一分辨率,由于当前可分配码率,即此刻的上行码率满足大于或者等于180P的第一分辨率对应的最低码率及切换阈值之和,800k≥30k,因此给180P的第一分辨率确定传输码率,且确定的传输码率最小为30k,剩下的当前可分配码率为770K(800K-30K=770K),继续遍历,取下一个订阅的720P的第一分辨率,由于当前可分配码率满足待遇或者等于720P的第一分辨率对应的最低码率及切换阈值之和,因此给720P的第一分辨率确定传输码率,并以所述传输码率向所述订阅设备发送对应于所述第一分辨率的视频流,遍历结束,返回。In the embodiment of the present disclosure, for example, the video transmission device sets a total of 4 resolution levels of 180P, 360P, 720P, and 1080P. The minimum bit rate required to set a video stream with a resolution of 180P is 30k, and the corresponding switching threshold is 0K; The minimum bit rate required for a 360P resolution video stream is 200k, and the corresponding switching threshold is 50K; the minimum bit rate required for a 720P resolution video stream is 600k, and the corresponding switching threshold is 100K; the 1080P resolution video stream requires The minimum bit rate is 800k, and the corresponding switching threshold is 150K; for example, the subscribing device subscribes to the video transmission device for 180P-level and 720P-level video streams, at time t0, the upstream bit rate of the video transmission device as the video publishing source It is 20k, traverses all the first resolutions from low to high, first traverses the first resolution of 180P, due to the current assignable bit rate, the current uplink bit rate is less than the lowest bit rate corresponding to the first resolution of 180P and switch The sum of the thresholds is 20k<30k. Therefore, the transmission code rate is not determined for the first resolution of 180P. Since there is no second resolution lower than the level of the first resolution of 180P, the downward switching condition is not met and the end is over. At time t1, the upstream bit rate of the video transmission device as the video publishing source is updated to 30k. All first resolutions are traversed from low to high, and the first resolution of 180P is traversed first. Since the current bit rate can be allocated, it is now The uplink bit rate meets the sum of the minimum bit rate corresponding to the first resolution greater than or equal to 180P and the switching threshold, 30k≥30k, so the transmission bit rate is determined for the first resolution of 180P, and the determined minimum bit rate is 30k, the remaining current assignable code rate is the difference between the uplink code rate and the transmission code rate, that is, the remaining current assignable code rate is 0, end. At t2, the upstream bit rate of the resolution video transmission device as the video publishing source is updated to 400k, traversing all the first resolutions from low to high, and first traversing the first resolution of 180P. Because of the current allocable bit rate, The uplink bit rate at the moment meets the sum of the minimum bit rate corresponding to the first resolution greater than or equal to 180P and the switching threshold, 400k≥30k, so the transmission bit rate is determined for the first resolution of 180P, and the determined transmission bit rate The minimum is 30k, the remaining current allocable bit rate is 370K (400K-30K=370K), continue to traverse, take the first resolution of the next subscribed 720P, because the current allocable bit rate is less than the first resolution of 720P The sum of the corresponding minimum bit rate and switching threshold is 370k<750k. Therefore, the transmission bit rate is not determined for the first resolution of 720P. The following judges whether the down-switching conditions are met: Determine the non-subscribed second resolution of 360P, no allocation Over the bit rate, and the current allocable bit rate meets the minimum bit rate and switching threshold corresponding to the second resolution greater than or equal to 360P, 370k ≥ 300k, so the second resolution of 360P meets the down-switching condition, giving 360P The transmission code rate is determined by the second resolution, and the video stream corresponding to the second resolution is sent to the subscription device at the transmission code rate. At t3, the upstream bit rate of the video transmission device as the video distribution source is updated to 800k, traversing all the first resolutions from low to high, first traversing the first resolution of 180P, because the current bit rate can be allocated, that is The uplink bit rate meets the sum of the minimum bit rate corresponding to the first resolution greater than or equal to 180P and the switching threshold, and 800k≥30k. Therefore, the transmission bit rate is determined for the first resolution of 180P, and the determined minimum bit rate is 30k, the remaining current allocable code rate is 770K (800K-30K=770K), continue to traverse, and take the first resolution of the next subscribed 720P, because the current allocable code rate meets the treatment or is equal to the first resolution of 720P The sum of the lowest bit rate corresponding to the data rate and the switching threshold, therefore, the transmission bit rate is determined for the first resolution of 720P, and the video stream corresponding to the first resolution is sent to the subscription device at the transmission bit rate, After the traversal is over, return.
在本公开实施例中,需要说明的是,所述视频传输设备的每一分辨率设置有对应于该分辨率的最高码率,例如所述分辨率视频传输设备设置180P,360P,720P,1080P共4个分辨率,设置180P的分辨率对应的最低码率为30k,最高码率为200K,对应的切换阈值为0K;360P的分辨率对应最低码率为200k,最高码率为700K,对应的切换阈值为50K;720P的分辨率对应最低码率为600k,最高码率为1800K,对应的切换阈值为100K;1080P的分辨率对应最低码率为800k,最高码率为3000K,对应的切换阈值为150K;例如订阅设备向所述视频传输设备订阅360P层级和720P层级的视频流,t0时刻,作为视频发布源端的所述分辨率视频传输设备的上行码率为600k,从低到高遍历所有第一分辨率,首先遍历360P的第一分辨率,由于当前可分配码率,即此刻的上行码率满足大于或者等于360P的第一分辨率对应的最低码率及切换阈值之和,600k≥250k,因此给360P的第一分辨率确定传输码率,且确定的传输码率最小为200k,剩下的当前可分配码率为400K(600K-200K=400K),继续遍历,取下一个订阅的720P的第一分辨率,由于当前可分配码率小于720P的第一分辨率对应的最低码率及切换阈值之和,400k<750k,因此不给720P的第一分辨率确定传输码率,下面判断向 下切换条件是否满足:确定非订阅的第二分辨率180P,没有分配过码率,且当前可分配码率满足大于或者等于180P的第二分辨率对应的最低码率及切换阈值之和,400k≥30k,因此180P的第二分辨率满足向下切换条件,又400K≥200k,根据180P的第二分辨率的最高码率给180P的第二分辨率确定传输码率,剩余的码率不再进行分配,并以所述传输码率向所述订阅者发送对应于所述第二视频层次的视频流,需要说明的是,所述分辨率视频传输设备的每一分辨率设置有对应于该分辨率的最高码率,表示该分辨率最大允许的码率,所述分辨率视频传输设备为任一分辨率确定的传输码率不能大于该分辨率的最高码率,若当前可分配码率大于确定的其中一个分辨率的最高码率,则根据所述分辨率的最高码率确定传输码率,剩余的码率不再进行分配。In the embodiments of the present disclosure, it should be noted that each resolution of the video transmission device is set with the highest bit rate corresponding to the resolution, for example, the resolution video transmission device is set to 180P, 360P, 720P, 1080P There are 4 resolutions in total. The minimum bit rate corresponding to the 180P resolution is 30k, the highest bit rate is 200K, and the corresponding switching threshold is 0K; the 360P resolution corresponds to the minimum bit rate of 200k and the highest bit rate of 700K, corresponding The switching threshold is 50K; the resolution of 720P corresponds to the lowest bit rate of 600k, the highest bit rate is 1800K, and the corresponding switching threshold is 100K; the resolution of 1080P corresponds to the lowest bit rate of 800k and the highest bit rate of 3000K, corresponding to the switch The threshold is 150K; for example, the subscription device subscribes to the video transmission device for 360P-level and 720P-level video streams, at t0, the upstream bit rate of the resolution video transmission device as the video publishing source is 600k, traversing from low to high For all first resolutions, first traverse the first resolution of 360P. Because the current assignable bit rate, that is, the uplink bit rate at this moment meets the sum of the minimum bit rate corresponding to the first resolution greater than or equal to 360P and the switching threshold, 600k ≥250k, so determine the transmission code rate for the first resolution of 360P, and the determined transmission code rate is at least 200k, and the remaining current assignable code rate is 400K (600K-200K=400K), continue to traverse, and take the next one The subscribed first resolution of 720P, because the current allocable bit rate is less than the sum of the lowest bit rate corresponding to the first resolution of 720P and the switching threshold, 400k<750k, so the transmission bit rate is not determined for the first resolution of 720P , The following judge whether the down-switching conditions are met: Determine the non-subscribed second resolution 180P, no bit rate has been allocated, and the current allocable bit rate meets the minimum bit rate and switching threshold corresponding to the second resolution greater than or equal to 180P The sum is 400k≥30k, so the second resolution of 180P satisfies the down-switching condition, and 400K≥200k, according to the highest bit rate of the second resolution of 180P, determine the transmission rate for the second resolution of 180P, and the remaining The bit rate is no longer allocated, and the video stream corresponding to the second video level is sent to the subscriber at the transmission bit rate. It should be noted that each resolution setting of the resolution video transmission device There is the highest bit rate corresponding to the resolution, which represents the maximum allowable bit rate of the resolution. The transmission bit rate determined by the resolution video transmission device for any resolution cannot be greater than the highest bit rate of the resolution. The assignable code rate is greater than the determined highest code rate of one of the resolutions, then the transmission code rate is determined according to the highest code rate of the resolution, and the remaining code rates are no longer allocated.
在本公开第三个示例实施例中:In the third exemplary embodiment of the present disclosure:
在以上任一实施例的基础上,所述视频传输方法还包括:On the basis of any of the above embodiments, the video transmission method further includes:
接收所述订阅设备的视频订阅信息;其中,所述视频订阅信息包括订阅的视频流的第一分辨率。Receive video subscription information of the subscription device; wherein the video subscription information includes the first resolution of the subscribed video stream.
在本公开实施例中,在作为视频源发布者的所述视频传输设备中,所述视频流设置有若干分辨率,例如所述视频流设置有4种分辨率层级,分别为180p、360p、720p及1080p等,所述订阅设备会向作为视频源发布者的所述视频传输设备订阅期望的视频流,订阅者向所述视频传输设备订阅视频流时,需要携带分辨率信息,告知所述视频传输设备自己期望接收的分辨率,所述视频传输设备在接收所述订阅设备的视频订阅信息之后,获取所述视频订阅信息中包括的订阅的视频流的第一分辨率,然后根据所述订阅设备期望的第一分辨率确定发送的视频流。In the embodiment of the present disclosure, in the video transmission device as a video source publisher, the video stream is set with several resolutions. For example, the video stream is set with 4 resolution levels, namely 180p, 360p, 720p and 1080p, etc., the subscribing device will subscribe the desired video stream to the video transmission device as the publisher of the video source. When subscribing to the video transmission device, the subscriber needs to carry resolution information to inform the The video transmission device itself expects to receive the resolution. After receiving the video subscription information of the subscription device, the video transmission device obtains the first resolution of the subscribed video stream included in the video subscription information, and then according to the The first resolution expected by the subscribing device determines the video stream sent.
请参阅图2,本公开第二实施例提供了一种视频传输装置,包括:Referring to FIG. 2, a second embodiment of the present disclosure provides a video transmission device, including:
视频订阅信息获取单元21,用于当检测到当前上行码率更新,且上一时刻未向订阅设备发送订阅的第一分辨率的视频流时,获取所述订阅设备的视频订阅信息;其中,所述视频订阅信息包括订阅的视频流的第一分辨率。The video subscription information obtaining unit 21 is configured to obtain the video subscription information of the subscribing device when it is detected that the current uplink bit rate is updated and the subscribed video stream of the first resolution is not sent to the subscribing device at the previous moment; wherein, The video subscription information includes the first resolution of the subscribed video stream.
第一码率参数确定单元22,用于根据所述第一分辨率获取该第一分辨率对应的最低码率以及码率阈值。The first code rate parameter determining unit 22 is configured to obtain the minimum code rate corresponding to the first resolution and the code rate threshold according to the first resolution.
第一视频流发送单元23,用于若当前上行码率大于或者等于所述第一分辨率对应的最低码率以及所述码率阈值之和,向所述订阅设备发送对应于所述第一分辨率的视频流。The first video stream sending unit 23 is configured to, if the current uplink bit rate is greater than or equal to the sum of the lowest bit rate corresponding to the first resolution and the bit rate threshold, send to the subscribing device corresponding to the first Resolution of the video stream.
第二码率参数确定单元24,用于若当前上行码率小于所述第一分辨率对应的最低码率以及所述码率阈值之和,且所述视频流包括有低于所述第一分辨率的未订阅的第二分辨率时,根据所述第二分辨率获取该第二分辨率对应的最低码率以及码率阈值。The second bit rate parameter determination unit 24 is configured to: if the current uplink bit rate is less than the sum of the lowest bit rate corresponding to the first resolution and the bit rate threshold, and the video stream includes a bit rate lower than the first When the second resolution of the resolution is not subscribed, the lowest bit rate and the bit rate threshold corresponding to the second resolution are obtained according to the second resolution.
第二视频流发送单元25,用于若当前上行码率大于或者等于所述第二分辨率对应的最低码率以及所述码率阈值之和,向所述订阅设备发送对应于所述第二分辨率的视频流。The second video stream sending unit 25 is configured to, if the current uplink bit rate is greater than or equal to the sum of the lowest bit rate corresponding to the second resolution and the bit rate threshold, to the subscribing device corresponding to the second Resolution of the video stream.
在第二实施例的第一种实现方式中,所述第一视频流发送单元23,包括:In the first implementation manner of the second embodiment, the first video stream sending unit 23 includes:
第一传输码率确定模块,用于若当前可分配码率大于或者等于所述第一分辨率对应的最低码率以及所述码率阈值之和,根据所述第一分辨率对应的最低码率确定传输码率。The first transmission code rate determination module is configured to, if the current allocable code rate is greater than or equal to the sum of the lowest code rate corresponding to the first resolution and the code rate threshold, according to the lowest code rate corresponding to the first resolution The rate determines the transmission bit rate.
第一视频流发送模块,用于以所述传输码率向所述订阅设备发送对应于所述第一分辨率的视频流。The first video stream sending module is configured to send the video stream corresponding to the first resolution to the subscription device at the transmission bit rate.
在第二实施例的第二种实现方式中,所述第二视频流发送单元25包括:In a second implementation manner of the second embodiment, the second video stream sending unit 25 includes:
第二传输码率确定单元,用于若当前可分配码率大于或者等于所述第二分辨率对应的最低码率以及所述码率阈值之和,根据所述第二分辨率对应的最低码率确定传输码率。The second transmission code rate determining unit is configured to, if the current allocable code rate is greater than or equal to the sum of the lowest code rate corresponding to the second resolution and the code rate threshold, according to the lowest code rate corresponding to the second resolution The rate determines the transmission bit rate.
第二视频流发送模块,用于以所述传输码率向所述订阅设备发送对应于所述第二分辨率的视频流。The second video stream sending module is configured to send the video stream corresponding to the second resolution to the subscription device at the transmission bit rate.
根据第二实施例的第一种实现方式或者第二种实现方式,在第二实施例的第三种实现方式中,所述当前可分配码率为所述上行码率与所述传输码率之差。According to the first implementation manner or the second implementation manner of the second embodiment, in the third implementation manner of the second embodiment, the currently allocatable code rate is the uplink code rate and the transmission code rate Difference.
根据第二实施例的第三种实现方式,在第二实施例的第四种实现方式中,还包括:According to the third implementation manner of the second embodiment, in the fourth implementation manner of the second embodiment, the method further includes:
第三码率参数确定模块,用于当检测到当前上行码率更新,且上一时刻已向所述订阅设备发送所述第一分辨率的视频流时,获取所述订阅设备所订阅的视频流的第一分辨率对应的最低码率以及码率阈值。The third bit rate parameter determination module is used to obtain the video subscribed by the subscribing device when the current uplink bit rate update is detected and the video stream of the first resolution has been sent to the subscribing device at the last moment The lowest bit rate and the bit rate threshold corresponding to the first resolution of the stream.
第三视频流发送单元,用于若当前可分配码率大于或者等于所述第一分辨率对应的最低码率以及所述码率阈值之差,向所述订阅设备发送对应于所述第一分辨率的视频流。The third video stream sending unit is configured to send to the subscription device the difference between the lowest bit rate corresponding to the first resolution and the bit rate threshold if the current allocable bit rate is greater than or equal to the Resolution of the video stream.
根据第二实施例的第四种实现方式,在第二实施例的第五种实现方式中,还包括:According to the fourth implementation manner of the second embodiment, in the fifth implementation manner of the second embodiment, the method further includes:
第二分辨率确定模块,用于若当前可分配码率小于所述第一分辨率对应的最低码率以及所述码率阈值之差,确定所述视频流是否包括有低于所述第一分辨率的未订阅的第二分辨率。The second resolution determining module is configured to determine whether the video stream includes a bit rate lower than the first bit rate if the current allocable bit rate is less than the minimum bit rate corresponding to the first resolution and the bit rate threshold. The second resolution of the unsubscribed resolution.
第四码率参数确定模块,用于若所述视频流包括有低于所述第一分辨率的未订阅的第二分辨率,根据所述第二分辨率获取该第二分辨率的最低码率以及码率阈值。The fourth code rate parameter determination module is configured to, if the video stream includes an unsubscribed second resolution lower than the first resolution, obtain the lowest code of the second resolution according to the second resolution Rate and bit rate threshold.
第四视频流发送单元,用于若当前可分配码率大于或者等于所述第二分辨率对应的最低码率以及所述码率阈值之和,向所述订阅设备发送对应于所述第二分辨率的视频流。The fourth video stream sending unit is configured to send to the subscription device corresponding to the second bit rate if the current allocable bit rate is greater than or equal to the sum of the lowest bit rate corresponding to the second resolution and the bit rate threshold. Resolution of the video stream.
根据第二实施例的以上任一种实现方式,在第二实施例的第六种实现方式中,还包括:According to any of the foregoing implementation manners of the second embodiment, in the sixth implementation manner of the second embodiment, the method further includes:
订阅信息接收模块,用于接收所述订阅设备的视频订阅信息;其中,所述视频订阅信息包括订阅的视频流的第一分辨率。The subscription information receiving module is configured to receive the video subscription information of the subscription device; wherein the video subscription information includes the first resolution of the subscribed video stream.
需说明的是,以上所描述的装置实施例仅仅是示意性的,其中所述作为分离部件说明的 单元可以是或者也可以不是物理上分开的,作为单元显示的部件可以是或者也可以不是物理单元,即可以位于一个地方,或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部模块来实现本实施例方案的目的。另外,本公开提供的装置实施例附图中,模块之间的连接关系表示它们之间具有通信连接,可以实现为一条或多条通信总线或信号线。本领域普通技术人员在不付出创造性劳动的情况下,即可以理解并实施。It should be noted that the device embodiments described above are only illustrative, and the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physically separate. Units can be located in one place or distributed to multiple network units. Some or all of the modules can be selected according to actual needs to achieve the objectives of the solutions of the embodiments. In addition, in the drawings of the device embodiments provided by the present disclosure, the connection relationship between the modules indicates that they have a communication connection between them, which can be implemented as one or more communication buses or signal lines. Those of ordinary skill in the art can understand and implement it without creative work.
请参见图3,是本公开第三实施例提供的视频传输设备的示意图。该实施例的视频传输设备包括::至少一个处理器11,例如CPU,至少一个网络接口14或者其他用户接口13,存储器15,至少一个通信总线12,通信总线12用于实现这些组件之间的连接通信。其中,用户接口13可以包括USB接口以及其他标准接口、有线接口。网络接口14可以包括Wi-Fi接口以及其他无线接口。存储器15可能包含高速RAM存储器,也可能还包括非不稳定的存储器(non-volatilememory),例如至少一个磁盘存储器。存储器15可以包含至少一个位于远离前述处理器11的存储装置。Refer to FIG. 3, which is a schematic diagram of a video transmission device provided by a third embodiment of the present disclosure. The video transmission device of this embodiment includes: at least one processor 11, such as a CPU, at least one network interface 14 or other user interface 13, a memory 15, at least one communication bus 12, and the communication bus 12 is used to implement communication between these components. Connect communication. The user interface 13 may include a USB interface and other standard interfaces and wired interfaces. The network interface 14 may include a Wi-Fi interface and other wireless interfaces. The memory 15 may include a high-speed RAM memory, and may also include a non-volatile memory (non-volatile memory), such as at least one disk memory. The memory 15 may include at least one storage device located far away from the aforementioned processor 11.
在一些实施方式中,存储器15存储了如下的元素,可执行模块或者数据结构,或者他们的子集,或者他们的扩展集:In some embodiments, the memory 15 stores the following elements, executable modules or data structures, or their subsets, or their extended sets:
操作系统151,包含各种系统程序,用于实现各种基础业务以及处理基于硬件的任务;The operating system 151, including various system programs, is used to implement various basic services and process hardware-based tasks;
程序152。 Procedure 152.
在一实施方式中,处理器11用于调用存储器15中存储的程序152,执行上述实施例所述的视频传输方法,例如图1所示的步骤S11。或者,所述处理器执行所述计算机程序时实现上述各装置实施例中各模块/单元的功能,例如视频订阅信息接收单元。In an implementation manner, the processor 11 is configured to call the program 152 stored in the memory 15 to execute the video transmission method described in the foregoing embodiment, for example, step S11 shown in FIG. 1. Alternatively, when the processor executes the computer program, the function of each module/unit in the above-mentioned device embodiments, such as a video subscription information receiving unit, is realized.
示例性的,所述计算机程序可以被分割成一个或多个模块/单元,所述一个或者多个模块/单元被存储在所述存储器中,并由所述处理器执行,以完成本公开。所述一个或多个模块/单元可以是能够完成特定功能的一系列计算机程序指令段,该指令段用于描述所述计算机程序在所述视频传输设备中的执行过程。Exemplarily, the computer program may be divided into one or more modules/units, and the one or more modules/units are stored in the memory and executed by the processor to complete the present disclosure. The one or more modules/units may be a series of computer program instruction segments capable of completing specific functions, and the instruction segments are used to describe the execution process of the computer program in the video transmission device.
所述视频传输设备可以是桌上型计算机、笔记本、掌上电脑及云端服务器等计算设备。所述视频传输设备可包括,但不仅限于,处理器、存储器。本领域技术人员可以理解,所述示意图仅仅是所述视频传输设备的示例,并不构成对所述视频传输设备的限定,可以包括比图示更多或更少的部件,或者组合某些部件,或者不同的部件。The video transmission device may be a computing device such as a desktop computer, a notebook, a palmtop computer, and a cloud server. The video transmission device may include, but is not limited to, a processor and a memory. Those skilled in the art can understand that the schematic diagram is only an example of the video transmission device, and does not constitute a limitation on the video transmission device. It may include more or less components than those shown in the figure, or combine certain components. , Or different parts.
所称处理器11可以是中央处理单元(Central Processing Unit,CPU),还可以是其他通用处理器、数字信号处理器(Digital Signal Processor,DSP)、专用集成电路(Application Specific Integrated Circuit,ASIC)、现成可编程门阵列(Field-Programmable Gate Array,FPGA)或者其他可编程逻辑器件、分立门或者晶体管逻辑器件、分立硬件组件等。通用处理器可以是微 处理器或者该处理器也可以是任何常规的处理器等,所述处理器11是所述视频传输设备的控制中心,利用各种接口和线路连接整个视频传输设备的各个部分。The so-called processor 11 may be a central processing unit (Central Processing Unit, CPU), other general-purpose processors, digital signal processors (Digital Signal Processor, DSP), application specific integrated circuits (Application Specific Integrated Circuit, ASIC), Ready-made programmable gate array (Field-Programmable Gate Array, FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor can be a microprocessor or the processor can also be any conventional processor, etc. The processor 11 is the control center of the video transmission equipment, and various interfaces and lines are used to connect each of the entire video transmission equipment. section.
所述存储器15可用于存储所述计算机程序和/或模块,所述处理器11通过运行或执行存储在所述存储器15内的计算机程序和/或模块,以及调用存储在存储器内的数据,实现所述视频传输设备的各种功能。所述存储器可主要包括存储程序区和存储数据区,其中,存储程序区可存储操作系统、至少一个功能所需的应用程序等;存储数据区可存储根据手机的使用所创建的数据等。此外,存储器15可以包括高速随机存取存储器,还可以包括非易失性存储器,例如硬盘、内存、插接式硬盘,智能存储卡(Smart Media Card,SMC),安全数字(Secure Digital,SD)卡,闪存卡(Flash Card)、至少一个磁盘存储器件、闪存器件、或其他易失性固态存储器件。The memory 15 may be used to store the computer program and/or module, and the processor 11 executes or executes the computer program and/or module stored in the memory 15 and calls data stored in the memory to achieve Various functions of the video transmission device. The memory may mainly include a program storage area and a data storage area. The program storage area may store an operating system, an application program required by at least one function, and the like; the data storage area may store data created according to the use of a mobile phone. In addition, the memory 15 may include a high-speed random access memory, and may also include a non-volatile memory, such as a hard disk, a memory, a plug-in hard disk, a Smart Media Card (SMC), and a Secure Digital (SD) Card, Flash Card, at least one magnetic disk storage device, flash memory device, or other volatile solid-state storage device.
本公开第四实施例提供了一种计算机可读存储介质,所述视频传输设备集成的模块/单元如果以软件功能单元的形式实现并作为独立的产品销售或使用时,可以存储在一个计算机可读取存储介质中。基于这样的理解,本公开实现上述实施例方法中的全部或部分流程,也可以通过计算机程序来指令相关的硬件来完成,所述的计算机程序可存储于一计算机可读存储介质中,该计算机程序在被处理器执行时,可实现上述各个方法实施例的步骤。其中,所述计算机程序包括计算机程序代码,所述计算机程序代码可以为源代码形式、对象代码形式、可执行文件或某些中间形式等。所述计算机可读介质可以包括:能够携带所述计算机程序代码的任何实体或装置、记录介质、U盘、移动硬盘、磁碟、光盘、计算机存储器、只读存储器(ROM,Read-Only Memory)、随机存取存储器(RAM,Random Access Memory)、电载波信号、电信信号以及软件分发介质等。需要说明的是,所述计算机可读介质包含的内容可以根据司法管辖区内立法和专利实践的要求进行适当的增减,例如在某些司法管辖区,根据立法和专利实践,计算机可读介质不包括电载波信号和电信信号。The fourth embodiment of the present disclosure provides a computer-readable storage medium. If the integrated module/unit of the video transmission device is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer Read the storage medium. Based on this understanding, the present disclosure implements all or part of the processes in the above-mentioned embodiments and methods, and can also be completed by instructing relevant hardware through a computer program. The computer program can be stored in a computer-readable storage medium. When the program is executed by the processor, it can implement the steps of the foregoing method embodiments. Wherein, the computer program includes computer program code, and the computer program code may be in the form of source code, object code, executable file, or some intermediate forms. The computer-readable medium may include: any entity or device capable of carrying the computer program code, recording medium, U disk, mobile hard disk, magnetic disk, optical disk, computer memory, read-only memory (ROM, Read-Only Memory) , Random Access Memory (RAM, Random Access Memory), electrical carrier signal, telecommunications signal, and software distribution media, etc. It should be noted that the content contained in the computer-readable medium can be appropriately increased or decreased in accordance with the requirements of the legislation and patent practice in the jurisdiction. For example, in some jurisdictions, according to the legislation and patent practice, the computer-readable medium Does not include electrical carrier signals and telecommunication signals.

Claims (10)

  1. 一种视频传输方法,包括以下步骤:A video transmission method includes the following steps:
    当检测到当前上行码率更新,且上一时刻未向订阅设备发送订阅的第一分辨率的视频流时,获取所述订阅设备的视频订阅信息;其中,所述视频订阅信息包括订阅的视频流的第一分辨率;When it is detected that the current uplink bit rate is updated, and the subscribed video stream of the first resolution is not sent to the subscribing device at the last moment, the video subscription information of the subscribing device is acquired; wherein the video subscription information includes the subscribed video The first resolution of the stream;
    根据所述第一分辨率获取该第一分辨率对应的最低码率以及码率阈值;Acquiring, according to the first resolution, the lowest bit rate and the bit rate threshold corresponding to the first resolution;
    若当前上行码率大于或者等于所述第一分辨率对应的最低码率以及所述码率阈值之和,向所述订阅设备发送对应于所述第一分辨率的视频流;If the current uplink bit rate is greater than or equal to the sum of the lowest bit rate corresponding to the first resolution and the bit rate threshold, sending a video stream corresponding to the first resolution to the subscription device;
    若当前上行码率小于所述第一分辨率对应的最低码率以及所述码率阈值之和,且所述视频流包括有低于所述第一分辨率的未订阅的第二分辨率时,根据所述第二分辨率获取该第二分辨率对应的最低码率以及码率阈值;If the current uplink bit rate is less than the sum of the lowest bit rate corresponding to the first resolution and the bit rate threshold, and the video stream includes an unsubscribed second resolution lower than the first resolution , Obtaining the lowest bit rate and the bit rate threshold corresponding to the second resolution according to the second resolution;
    若当前上行码率大于或者等于所述第二分辨率对应的最低码率以及所述码率阈值之和,向所述订阅设备发送对应于所述第二分辨率的视频流。If the current uplink bit rate is greater than or equal to the sum of the lowest bit rate corresponding to the second resolution and the bit rate threshold, sending the video stream corresponding to the second resolution to the subscription device.
  2. 根据权利要求1所述的视频传输方法,其中,所述若当前上行码率大于或者等于所述第一分辨率对应的最低码率以及所述码率阈值之和,以所述第一分辨率向所述订阅设备发送所述视频流,包括:The video transmission method according to claim 1, wherein if the current uplink bit rate is greater than or equal to the sum of the lowest bit rate corresponding to the first resolution and the bit rate threshold, the first resolution Sending the video stream to the subscription device includes:
    若当前可分配码率大于或者等于所述第一分辨率对应的最低码率以及所述码率阈值之和,根据所述第一分辨率对应的最低码率确定传输码率;If the current allocable code rate is greater than or equal to the sum of the minimum code rate corresponding to the first resolution and the code rate threshold, determine the transmission code rate according to the minimum code rate corresponding to the first resolution;
    以所述传输码率向所述订阅设备发送对应于所述第一分辨率的视频流。Sending a video stream corresponding to the first resolution to the subscription device at the transmission bit rate.
  3. 根据权利要求1所述的视频传输方法,其中,所述若当前上行码率大于或者等于所述第二分辨率对应的最低码率以及所述码率阈值之和,向所述订阅设备发送对应于所述第二分辨率的视频流,包括:The video transmission method according to claim 1, wherein if the current uplink bit rate is greater than or equal to the sum of the lowest bit rate corresponding to the second resolution and the bit rate threshold, the corresponding bit rate is sent to the subscription device The video stream at the second resolution includes:
    若当前可分配码率大于或者等于所述第二分辨率对应的最低码率以及所述码率阈值之和,根据所述第二分辨率对应的最低码率确定传输码率;If the current allocable code rate is greater than or equal to the sum of the minimum code rate corresponding to the second resolution and the code rate threshold, determine the transmission code rate according to the minimum code rate corresponding to the second resolution;
    以所述传输码率向所述订阅设备发送对应于所述第二分辨率的视频流。Sending a video stream corresponding to the second resolution to the subscription device at the transmission code rate.
  4. 根据权利要求2或3所述的视频传输方法,其中,所述当前可分配码率为所述上行码率与所述传输码率之差。The video transmission method according to claim 2 or 3, wherein the current allocable bit rate is the difference between the uplink bit rate and the transmission bit rate.
  5. 根据权利要求4所述的视频传输方法,还包括:The video transmission method according to claim 4, further comprising:
    当检测到当前上行码率更新,且上一时刻已向所述订阅设备发送所述第一分辨率的视频流时,获取所述订阅设备所订阅的视频流的第一分辨率对应的最低码率以及码率阈值;When it is detected that the current uplink bit rate is updated, and the video stream of the first resolution has been sent to the subscribing device at the previous moment, obtain the lowest code corresponding to the first resolution of the video stream subscribed by the subscribing device Rate and bit rate threshold;
    若当前可分配码率大于或者等于所述第一分辨率对应的最低码率以及所述码率阈值之差, 向所述订阅设备发送对应于所述第一分辨率的视频流。If the current allocable bit rate is greater than or equal to the difference between the lowest bit rate corresponding to the first resolution and the bit rate threshold, sending the video stream corresponding to the first resolution to the subscription device.
  6. 根据权利要求5所述的视频传输方法,还包括:The video transmission method according to claim 5, further comprising:
    若当前可分配码率小于所述第一分辨率对应的最低码率以及所述码率阈值之差,确定所述视频流是否包括有低于所述第一分辨率的未订阅的第二分辨率;If the current allocable bit rate is less than the difference between the lowest bit rate corresponding to the first resolution and the bit rate threshold, determine whether the video stream includes an unsubscribed second resolution lower than the first resolution rate;
    若所述视频流包括有低于所述第一分辨率的未订阅的第二分辨率,根据所述第二分辨率获取该第二分辨率的最低码率以及码率阈值;If the video stream includes an unsubscribed second resolution lower than the first resolution, obtaining the lowest bit rate and the bit rate threshold of the second resolution according to the second resolution;
    若当前可分配码率大于或者等于所述第二分辨率对应的最低码率以及所述码率阈值之和,向所述订阅设备发送对应于所述第二分辨率的视频流。If the current allocable bit rate is greater than or equal to the sum of the lowest bit rate corresponding to the second resolution and the bit rate threshold, sending the video stream corresponding to the second resolution to the subscription device.
  7. 根据权利要求1至6任意一项所述的视频传输方法,还包括:The video transmission method according to any one of claims 1 to 6, further comprising:
    接收所述订阅设备的视频订阅信息;其中,所述视频订阅信息包括订阅的视频流的第一分辨率。Receive video subscription information of the subscription device; wherein the video subscription information includes the first resolution of the subscribed video stream.
  8. 一种视频传输装置,包括:A video transmission device includes:
    视频订阅信息获取单元,用于当检测到当前上行码率更新,且上一时刻未向订阅设备发送订阅的第一分辨率的视频流时,获取所述订阅设备的视频订阅信息;其中,所述视频订阅信息包括订阅的视频流的第一分辨率;The video subscription information obtaining unit is configured to obtain the video subscription information of the subscribing device when it is detected that the current uplink bit rate is updated and the subscribed video stream of the first resolution is not sent to the subscribing device at the previous moment; The video subscription information includes the first resolution of the subscribed video stream;
    第一码率参数确定单元,用于根据所述第一分辨率获取该第一分辨率对应的最低码率以及码率阈值;The first code rate parameter determination unit is configured to obtain the minimum code rate corresponding to the first resolution and the code rate threshold according to the first resolution;
    第一视频流发送单元,用于若当前上行码率大于或者等于所述第一分辨率对应的最低码率以及所述码率阈值之和,向所述订阅设备发送对应于所述第一分辨率的视频流;The first video stream sending unit is configured to, if the current uplink bit rate is greater than or equal to the sum of the lowest bit rate corresponding to the first resolution and the bit rate threshold, send to the subscribing device corresponding to the first resolution Rate of video streaming;
    第二码率参数确定单元,用于若当前上行码率小于所述第一分辨率对应的最低码率以及所述码率阈值之和,且所述视频流包括有低于所述第一分辨率的未订阅的第二分辨率时,根据所述第二分辨率获取该第二分辨率对应的最低码率以及码率阈值;The second bit rate parameter determination unit is configured to: if the current uplink bit rate is less than the sum of the lowest bit rate corresponding to the first resolution and the bit rate threshold, and the video stream includes a bit rate lower than the first resolution When the second resolution is not subscribed to, obtain the lowest bit rate and the bit rate threshold corresponding to the second resolution according to the second resolution;
    第二视频流发送单元,用于若当前上行码率大于或者等于所述第二分辨率对应的最低码率以及所述码率阈值之和,向所述订阅设备发送对应于所述第二分辨率的视频流。The second video stream sending unit is configured to send a signal corresponding to the second resolution to the subscription device if the current uplink bit rate is greater than or equal to the sum of the lowest bit rate corresponding to the second resolution and the bit rate threshold. Rate of the video stream.
  9. 一种视频传输装置设备,包括处理器、存储器以及存储在所述存储器中且被配置为由所述处理器执行的计算机程序,所述处理器执行所述计算机程序时实现如权利要求1至7中任意一项所述的视频传输方法。A video transmission device, comprising a processor, a memory, and a computer program stored in the memory and configured to be executed by the processor. The processor executes the computer program as claimed in claims 1 to 7 The video transmission method described in any one of.
  10. 一种计算机可读存储介质,所述计算机可读存储介质包括存储的计算机程序,其中,在所述计算机程序运行时控制所述计算机可读存储介质所在设备执行如权利要求1至7中任意一项所述的视频传输方法。A computer-readable storage medium, the computer-readable storage medium includes a stored computer program, wherein, when the computer program is running, the device where the computer-readable storage medium is located is controlled to execute any one of claims 1 to 7 The video transmission method described in item.
PCT/CN2019/126714 2019-02-01 2019-12-19 Video transmission method, device, apparatus, and storage medium WO2020155913A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201910106110.9A CN109660826B (en) 2019-02-01 2019-02-01 Video transmission method, device, equipment and storage medium
CN201910106110.9 2019-02-01

Publications (1)

Publication Number Publication Date
WO2020155913A1 true WO2020155913A1 (en) 2020-08-06

Family

ID=66122088

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2019/126714 WO2020155913A1 (en) 2019-02-01 2019-12-19 Video transmission method, device, apparatus, and storage medium

Country Status (2)

Country Link
CN (1) CN109660826B (en)
WO (1) WO2020155913A1 (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109660826B (en) * 2019-02-01 2020-09-29 广州视源电子科技股份有限公司 Video transmission method, device, equipment and storage medium
CN113038136B (en) * 2019-12-25 2022-10-11 成都鼎桥通信技术有限公司 Video self-adaptive adjustment method and device

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102246458A (en) * 2008-12-15 2011-11-16 微软公司 Video conferencing subscription using multiple bit rate streams
CN104661088A (en) * 2013-11-22 2015-05-27 乐视网信息技术(北京)股份有限公司 Video source switching method and device
US20150381690A1 (en) * 2014-06-26 2015-12-31 Arris Enterprises, Inc. Server side adaptive bit rate control for http streaming clients
CN105376642A (en) * 2014-08-18 2016-03-02 深圳Tcl新技术有限公司 Video playing resolution switching method and system
CN106028085A (en) * 2016-06-14 2016-10-12 浙江工业大学 DASH-based multi-client-side code rate self-adaption and oscillation compensation method
CN106454412A (en) * 2016-09-09 2017-02-22 腾讯科技(北京)有限公司 Method and apparatus for adjusting code rate
CN109660826A (en) * 2019-02-01 2019-04-19 广州视源电子科技股份有限公司 A kind of video transmission method, device, equipment and storage medium

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103561283A (en) * 2013-10-30 2014-02-05 乐视致新电子科技(天津)有限公司 Method and device for code rate switch of smart television
CN104702922A (en) * 2013-12-10 2015-06-10 中国电信股份有限公司 Method and system for transmitting video
CN105025249B (en) * 2014-04-22 2018-12-07 中国移动通信集团江苏有限公司 Video monitoring data transfer control method, device and video monitoring system
CN106658072A (en) * 2016-12-05 2017-05-10 乐视控股(北京)有限公司 Method and system for adjusting video encoding rates
CN108400956A (en) * 2017-02-07 2018-08-14 阿里巴巴集团控股有限公司 Distribution method, the device and system of video data stream
CN108337535B (en) * 2018-03-21 2020-12-29 广州视源电子科技股份有限公司 Client video forwarding method, device, equipment and storage medium

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102246458A (en) * 2008-12-15 2011-11-16 微软公司 Video conferencing subscription using multiple bit rate streams
CN104661088A (en) * 2013-11-22 2015-05-27 乐视网信息技术(北京)股份有限公司 Video source switching method and device
US20150381690A1 (en) * 2014-06-26 2015-12-31 Arris Enterprises, Inc. Server side adaptive bit rate control for http streaming clients
CN105376642A (en) * 2014-08-18 2016-03-02 深圳Tcl新技术有限公司 Video playing resolution switching method and system
CN106028085A (en) * 2016-06-14 2016-10-12 浙江工业大学 DASH-based multi-client-side code rate self-adaption and oscillation compensation method
CN106454412A (en) * 2016-09-09 2017-02-22 腾讯科技(北京)有限公司 Method and apparatus for adjusting code rate
CN109660826A (en) * 2019-02-01 2019-04-19 广州视源电子科技股份有限公司 A kind of video transmission method, device, equipment and storage medium

Also Published As

Publication number Publication date
CN109660826A (en) 2019-04-19
CN109660826B (en) 2020-09-29

Similar Documents

Publication Publication Date Title
WO2022095795A1 (en) Communication method and apparatus, computer readable medium, and electronic device
JP6442507B2 (en) How to allocate available network bandwidth during ongoing traffic sessions performed by devices on the network, corresponding devices
CN108881972B (en) Code rate allocation method, device, equipment and storage medium
WO2020155913A1 (en) Video transmission method, device, apparatus, and storage medium
CN112422879A (en) Method and device for dynamically adjusting media capability
JP2017504995A5 (en)
CN109392013B (en) Method for adjusting quality of service (QoS) and communication device
CN107547909B (en) Media file online playing control method, device and system
CN111225209A (en) Video data plug flow method, device, terminal and storage medium
CN102148747A (en) Media stream transmission method and device
CN113542660A (en) Method, system and storage medium for realizing conference multi-picture high-definition display
CN107147738A (en) The method of performance optimization based on cloud desktop spice communication protocols
WO2020143423A1 (en) Video stream code rate allocation method and device and computer readable storage medium
CN115209189B (en) Video stream transmission method, system, server and storage medium
CN109309805B (en) Multi-window display method, device, equipment and system for video conference
US11265356B2 (en) Network assistance functions for virtual reality dyanmic streaming
JP2021527351A (en) Network-controlled uplink media transmission for collaborative media production in scenarios with limited network capacity
CN109788233B (en) Video layer updating method, device, equipment and medium
CN110572697A (en) remote teaching method and device for multiple video channels and server
CN107135171B (en) Multimedia stream transmission method and media stream sending equipment
CN112770077B (en) Video conference I frame coding method and device
CN108040261B (en) Network live broadcast management method and device and storage medium
CN102550104B (en) Method and device for allocating resources in a mobile communication system
CN116614656A (en) Multimedia stream pushing method, device, electronic equipment and readable medium
CN117082245A (en) Video encoding method, video encoding device, storage medium and electronic device

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19913547

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19913547

Country of ref document: EP

Kind code of ref document: A1

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 19.11.2021)

122 Ep: pct application non-entry in european phase

Ref document number: 19913547

Country of ref document: EP

Kind code of ref document: A1