WO2021254494A1 - 视频图像传输方法、装置和系统 - Google Patents
视频图像传输方法、装置和系统 Download PDFInfo
- Publication number
- WO2021254494A1 WO2021254494A1 PCT/CN2021/100977 CN2021100977W WO2021254494A1 WO 2021254494 A1 WO2021254494 A1 WO 2021254494A1 CN 2021100977 W CN2021100977 W CN 2021100977W WO 2021254494 A1 WO2021254494 A1 WO 2021254494A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- video image
- frame rate
- ratio
- collection terminal
- video
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims abstract description 41
- 230000005540 biological transmission Effects 0.000 title claims abstract description 23
- 230000004044 response Effects 0.000 claims description 15
- 238000004590 computer program Methods 0.000 claims description 12
- 238000012545 processing Methods 0.000 claims description 11
- 238000012544 monitoring process Methods 0.000 description 8
- 238000010586 diagram Methods 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 3
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000004891 communication Methods 0.000 description 1
- 230000006835 compression Effects 0.000 description 1
- 238000007906 compression Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/238—Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
- H04N21/637—Control signals issued by the client directed to the server or network components
- H04N21/6373—Control signals issued by the client directed to the server or network components for rate control, e.g. request to the server to modify its transmission rate
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
- H04N21/647—Control signaling between network components and server or clients; Network processes for video distribution between server and clients, e.g. controlling the quality of the video stream, by dropping packets, protecting content from unauthorised alteration within the network, monitoring of network load, bridging between two different networks, e.g. between IP and wireless
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
- H04N21/647—Control signaling between network components and server or clients; Network processes for video distribution between server and clients, e.g. controlling the quality of the video stream, by dropping packets, protecting content from unauthorised alteration within the network, monitoring of network load, bridging between two different networks, e.g. between IP and wireless
- H04N21/64746—Control signals issued by the network directed to the server or the client
- H04N21/64761—Control signals issued by the network directed to the server or the client directed to the server
- H04N21/64769—Control signals issued by the network directed to the server or the client directed to the server for rate control
Definitions
- the present disclosure relates to the field of data transmission technology, and in particular to a video image collection terminal, a video image transmission method, a video image transmission system, a computer-readable storage medium, an electronic device, and a video playback system.
- the video image collection terminal pushes the collected video images to the cloud server, and the client obtains the video image from the cloud server for playback, which can realize the real-time display of the video image collected by the video image collection terminal on the client.
- the present disclosure provides a video image transmission method, including:
- the first speed information, the second speed information, and the current value of the first frame rate of the video image collected by the video image collection terminal and the second frame rate of the video image uploaded by the video image collection terminal A ratio n, determining a target ratio m of the first frame rate to the second frame rate, wherein the target ratio m and the ratio n are both positive integers;
- the speed at which the video image collection terminal uploads the video image is adjusted so that the adjusted speed at which the video image collection terminal uploads the video image is equal to the speed at which the cloud server receives the video image. Speed matching.
- adjusting the speed at which the video image collection terminal uploads the video image according to the target ratio m of the first frame rate to the second frame rate includes: making the video image collection terminal every time m frames of video images are collected, one of the m frames of video images is uploaded.
- the first speed information includes: the bit rate of the video image uploaded by the video image collection terminal, and the second speed information includes: the bit rate of the video image received by the cloud server;
- the target ratio m is set to be greater than the current ratio n; in response to the video image collection terminal uploading The bit rate of the video image is less than the bit rate of the video image received by the cloud server, and the target ratio m is set to be less than the current ratio n.
- the first speed information, the second speed information, and the first frame rate at which the video image collection terminal collects the video image and the video image collection terminal uploads the video
- the current ratio n of the second frame rate of the image, and determining the target ratio m of the first frame rate to the second frame rate includes:
- the target ratio m is determined according to the product of the ratio x and the current ratio n and the reference frame rate range.
- determining the target ratio m according to the product of the ratio x and the current ratio n and the reference frame rate range includes:
- the target ratio m is determined according to the boundary value of the reference frame rate range.
- the minimum value of the reference frame rate range is between 14 frames per second and 20 frames per second.
- the video image transmission method further includes:
- the second speed information is sent to the video image collection terminal.
- the present disclosure also provides a video image collection terminal, including:
- Collection device configured to collect video images
- An uploading device configured to upload the video images collected by the collecting device to the cloud server in real time
- Processing device configured as:
- the first speed information, the second speed information, and the current ratio n of the first frame rate of the video image collected by the collection device to the second frame rate of the video information uploaded by the upload device determine A target ratio m of the first frame rate to the second frame rate, wherein the target ratio m and the ratio n are both positive integers;
- the adjustment device is configured to adjust the speed at which the upload device uploads the video image according to the target ratio m, so that the adjusted speed at which the upload device uploads the video image and the cloud server receives the video image The speed matches.
- the adjustment device is configured to adjust the speed at which the upload device uploads the video image, so that every m frames of video image collected by the collection device, the upload device uploads one of the m frames of video image One of the frames.
- the first speed information includes: the bit rate of the video image uploaded by the acquisition device, and the second speed information includes: the bit rate of the video image received by the cloud server;
- the processing device is configured to: in response to the bit rate of the video image uploaded by the upload device being greater than the bit rate of the video image received by the cloud server, set the target ratio m to be greater than the current ratio n;
- the bit rate of the video image uploaded by the uploading device is lower than the bit rate of the video image received by the cloud server, and the target ratio m is set to be less than the current ratio n.
- the processing device is configured as:
- the target ratio m is determined according to the product of the ratio x and the current ratio n and the reference frame rate range.
- the processing device is configured as:
- the target ratio m is determined according to the boundary value of the reference frame rate range.
- the adjustment device adjusts the speed at which the upload device uploads the video image in real time.
- the present disclosure also provides a video transmission system, including:
- Cloud server configured as:
- the second speed information is sent to the video image collection terminal.
- the present disclosure also provides a computer-readable storage medium on which a computer program is stored, and when the computer program is executed by a processor, the above-mentioned video image transmission method according to the present disclosure is realized.
- an electronic device including:
- the memory stores a computer program; when the computer program is executed by the processor, the above-mentioned video image transmission method according to the present disclosure is realized.
- the present disclosure also provides a video playback system, including:
- the video playback terminal is configured to obtain and play video images from the cloud server.
- Fig. 1 is a flowchart of a method for uploading a video image according to an embodiment of the present disclosure
- Fig. 2 is a flowchart of a method for uploading a video image according to an embodiment of the present disclosure
- Fig. 3 is a flowchart of a method for monitoring the receiving speed of a video image according to an embodiment of the present disclosure
- FIG. 4 is a schematic diagram of functional modules of a video image collection terminal according to an embodiment of the present disclosure
- Fig. 5 is a schematic diagram of functional modules of a cloud server according to an embodiment of the present disclosure.
- the video image collection terminal pushes the collected video images to the cloud server, and the client obtains the video image from the cloud server for playback, so that the video image collected by the video image collection terminal can be displayed on the client Real-time display.
- the client side may freeze when watching the video, which affects the smoothness of viewing.
- the upload network speed that is, the upload speed of the video image capture terminal uploading the video image to the cloud server
- the download network speed that is, the download speed of the client terminal to obtain the video image from the cloud server
- video definition can be divided into smooth, standard definition, high-definition, Blu-ray, etc., for the client to automatically select the definition or manually select the definition by the user, so that you can choose to watch a lower-definition video when the download network speed is slow.
- Video choose to watch a higher definition video when the download network speed is faster, to ensure the smoothness of viewing.
- video image collection terminals there are few ways to improve. When the upload network speed is poor, the upload speed of the video image collection terminal does not match the receiving speed of the cloud server, which will also cause the video played by the client to freeze. For example, a video image collection terminal collects 30 frames of video images per second, and the cloud server can only receive 15 frames of video images per second.
- the cloud server takes 2 seconds to receive 30 frames of video images, causing the cloud server and the client to be in 2
- the video images received within seconds are actually the video images collected by the video image collection terminal within 1 second, that is to say, the 1 second image collected by the video image collection terminal will be played for 2 seconds on the client side, which will cause the customer The video played on the terminal freezes.
- Fig. 1 is a flowchart of a method for uploading a video image according to an embodiment of the present disclosure. As shown in Fig. 1, the method for uploading a video image includes steps S11 to S14.
- Step S11 Collect a video image, and upload the video image to a cloud server in real time.
- the video image collection terminal collects the video image, it can perform processing processes such as encoding and compression on the video image to form video stream data, and collect the video image in the form of video stream data. Upload to cloud server.
- Step S12 Obtain the upload speed information when uploading the video image from the local to the cloud server, and the receiving speed information when the cloud server receives the video image.
- the upload speed information includes: the data volume of the video image uploaded by the video image collection terminal in a unit time.
- the receiving speed information includes: the data volume of the video image received by the cloud server in a unit time.
- the unit time can be set to 1 second.
- the upload speed information and the receiving speed information are both for the same frame or several frames of video images.
- the upload speed information of the video image is determined locally, and the receiving speed information of the cloud server when receiving the video image is different with different network conditions (such as network congestion), therefore, the upload speed information and the receiving speed The information is not necessarily the same.
- Step S13 Determine the target ratio m of the video image collection frame rate to the upload frame rate according to the receiving speed information, upload speed information, and the current ratio n of the video image collection frame rate to the upload frame rate, where m and n are both Positive integer.
- the capture frame rate may refer to the number of frames of video images captured by the video image capture terminal in a unit time
- the upload frame rate may refer to the video uploaded to the cloud server by the video image capture terminal in a unit time. The number of frames of the image.
- the acquisition frame rate is a fixed frequency
- Step S14 Adjust the upload speed of the video image according to the target ratio m, so that the adjusted upload speed matches the speed at which the cloud server receives the video image.
- “matching the adjusted upload speed with the speed at which the cloud server receives the video image” means “making the difference between the adjusted upload speed and the speed at which the cloud server receives the video image as small as possible”.
- the adjusted upload speed can be made equal to the speed at which the cloud server receives the video image.
- the present disclosure does not specifically limit this, as long as the difference between the adjusted upload speed and the speed at which the cloud server receives the video image is greater than the difference between the upload speed before the adjustment and the speed at which the cloud server receives the video image.
- the video image collection terminal uploads one of the m frames of video images every time m frames of video images are collected.
- video protocols such as RTMP can be used for uploading.
- m represents the target ratio of the acquisition frame rate to the upload frame rate.
- the target ratio m When the target ratio m is larger, among the video images collected by the video image collection terminal, the number of frames of the uploaded video image is smaller. Therefore, in the embodiments of the present disclosure, by controlling the size of the target ratio m, the number of frames of video images uploaded by the video image collection terminal per unit time can be adjusted, thereby improving the reception speed of the cloud server and the video image collection terminal The client's playback freeze caused by the upload speed mismatch.
- using the video image uploading method according to the embodiments of the present disclosure can reduce the number of frames of video images uploaded by the video image collection terminal per unit time when the video image receiving speed of the cloud server drops (the network environment becomes worse). That is to reduce the upload speed of the video image acquisition terminal, so that the receiving speed of the cloud server matches the upload speed of the video image acquisition terminal, and avoids the client playing card due to the mismatch between the receiving speed of the cloud server and the upload speed of the video image acquisition terminal The question of the day.
- step S11 is performed continuously, and step S12 to step S14 are performed during the execution of step S11, rather than after the execution of step S11 is completed.
- step S14 includes: uploading one frame of video image every m-1 frame of video image.
- a video image collection terminal collects 30 frames of video images within 1 second
- the target ratio of the collection frame rate to the upload frame rate is 2
- the video image collection terminal uploads 1 frame of video image every 1 frame of video image.
- the video image collection terminal uploads 15 frames of video images within 1 second; if the target ratio of the collection frame rate to the upload frame rate is 3, the video image collection terminal uploads 1 frame of video image every 2 frames of video images.
- the video The image collection terminal uploads 10 frames of video images within 1 second.
- the number of frames of video images collected by the above-mentioned video image collection terminal within 1 second is only an example.
- the video image collection terminal can also collect 60 frames of video images, 120 frames of video images, and 120 frames of video images within 1 second.
- 240 frames of video images and 330 frames of video images are even higher, which are specifically determined according to actual needs and are not limited here.
- Fig. 2 is a flowchart of a method for uploading a video image according to an embodiment of the present disclosure.
- the method for uploading a video image according to an embodiment of the present disclosure will be described in detail below with reference to FIG. 2.
- the upload speed information includes: the bit rate of the uploaded video image;
- the receiving speed information includes: the bit rate of the cloud server to receive the video image.
- video images are uploaded in the form of video stream data, and the bit rate here refers to the number of data bits transmitted per unit time during data transmission, and the unit is kbps, which is kilobits per second. The higher the bit rate, the higher the accuracy.
- the value of the current ratio n is increased to obtain the target ratio m, that is, the target ratio m is set to be greater than the current ratio n.
- the value of the current ratio n is reduced to obtain the target ratio m, that is, the target ratio m is set to be smaller than the current ratio n.
- the receiving speed information is determined by the cloud server.
- the cloud server can determine the network status according to the network data of the network port, and then determine the bit rate of the received video image according to the network status.
- the bit rate of the received video image is larger; when the network condition is poor, the bit rate of the received video image is smaller.
- the bit rate of the uploaded video image is greater than the bit rate of the received video image, it means that the network environment is poor and the video image uploaded by the video image collection terminal cannot be received by the cloud server in time.
- the target ratio m is set to be greater than the current ratio n , So as to reduce the number of frames of video images uploaded by the video image collection terminal in a unit time, and avoid jams when the client is playing the video.
- the bit rate of the uploaded video image is lower than the bit rate of the received video image, it indicates that the network environment is better.
- the video image uploaded by the video image collection terminal can be received by the cloud server in time, and the cloud server can also receive more information in a unit of time.
- the target ratio m is set to be smaller than the current ratio n, so that the number of frames of video images uploaded by the video image collection terminal per unit time increases, and the clarity of the video played by the client is improved.
- the current uploading video image bit rate of the video image collection terminal is greater than the current receiving video image bit rate of the cloud server, suppose the video image collection terminal collects 30 frames of video images per second, and the video image collection terminal currently uploads 30 frames per second Video image. At this time, the current ratio n of the collection frame rate of the video image collection terminal to the upload frame rate is 1.
- the video image collection terminal monitors that the bit rate of the uploaded video image is 6000000kbps, and the cloud server detects that the bit rate of the received video image is 3000000kbps.
- the cloud server sends the monitored bit rate of the received video image to the video image collection terminal, and the video image is collected.
- the terminal After comparing the bit rate of the uploaded video image with the bit rate of the received video image, the terminal determines that the bit rate of the uploaded video image is far greater than the bit rate of the received video image.
- the target ratio m can be made greater than the current ratio n, that is, the target ratio m can be greater than 1 (for example, m can be 2, 3, 4...), so that the video image collection terminal uploads at least one frame of video image every interval Frame video images, that is, reduce the number of frames of video images uploaded by the video image collection terminal in a unit time.
- the bit rate of the video image uploaded by the video image collection terminal is kept the same or approximately the same as the bit rate of the video image received by the cloud server, so as to prevent the client from being stuck when watching the video.
- step S13 includes steps S131 and S132.
- Step S131 Determine the ratio x of the bit rate of the uploaded video image to the bit rate of the received video image.
- Step S132 Determine the target ratio m according to the product of the ratio x and the current ratio n, and the reference upload frame rate.
- the reference upload frame rate may include: the minimum number of uploaded frames and/or the maximum number of uploaded frames of the video image collection terminal in a unit time.
- the reference upload frame rate is used to prevent the target ratio m from being too large or too small, which in turn causes the number of frames uploaded by the video image collection terminal per unit time to be too small or too large, which affects the display effect of the client.
- step S132 in the case that the reference upload frame rate is the minimum number of upload frames of the video image collection terminal in a unit time, step S132 includes steps S1321 to S1325.
- Step S1321 according to the ratio x and the current ratio n, determine the adjustment ratio n'of the captured frame rate of the video image to the upload frame rate, and the adjustment ratio n'is the value obtained by rounding the product of the ratio x and the current ratio n.
- “rounding" in the embodiments of the present disclosure refers to rounding down.
- Step S1322 according to the acquisition frame rate of the video image and the adjustment ratio, determine the adjusted upload frame rate.
- Step S1323 Compare the adjusted upload frame rate with the reference upload frame rate. If the adjusted upload frame rate is greater than or equal to the reference upload frame rate, then perform step S1324. If the adjusted upload frame rate is less than the reference upload frame rate, then Step S1325 is executed.
- Step S1324 The value obtained by rounding the product of the ratio x and the current ratio n (that is, the adjusted ratio) is used as the target ratio m.
- Step S1325 Determine the target ratio m according to the reference upload frame rate.
- the reference upload frame rate is between 14 frames/sec and 20 frames/sec.
- the reference upload frame rate may be set to 15 frames/sec or 16 frames/sec.
- the benchmark upload frame rate as the minimum number of uploaded frames per unit time of the video image collection terminal as an example, assuming that the benchmark upload frame rate is 15 frames per second, the video image collection terminal collects 30 frames of video images per second, and the video image collection terminal Currently, 30 frames of video images are uploaded per second. At this time, the current ratio n of the acquisition frame rate of the video image acquisition terminal to the upload frame rate is 1.
- the bit rate of the uploaded video image monitored by the video image collection terminal is 6,000,000 kbps, and the bit rate of the received video image monitored by the cloud server is 2,000,000 kbps.
- the video image collection terminal uploads 1 frame of video image every 1 frame of video image
- the video image collection terminal uploads the number of video images within 1 second from 30 frames to 15 frames
- the video image collection terminal uploads the video image
- the bit rate is reduced from 6000000kbps to 3000000kbps, which is close to the bit rate of the received video image of the cloud server.
- the cloud server may send the monitored bit rate of the received video image to the video image collection terminal at intervals, so that the video image collection terminal can adjust the number of frames of the uploaded video image per unit time in real time. For example, after the video image collection terminal undergoes the aforementioned adjustments, it again receives the bit rate of the received video image sent by the cloud server. Assuming that the network environment becomes better, the bit rate of the received video image monitored by the cloud server is 6000000kbps. At this time, the bit rate of the uploaded video image is 3000000kbps after the last adjustment, and the upload frame rate is 15 frames per second. , The acquisition frame rate remains unchanged, and 30 frames of video images are acquired per second. The current ratio n of the acquisition frame rate of the video image acquisition terminal to the upload frame rate is 2.
- the video image collection terminal uploads the number of video images within 1 second from 15 frames to 30 frames, and the video image collection terminal uploads the video image bit rate from 3000000kbps to 6000000kbps, which is the same as the bit rate of the video image received by the cloud server.
- the above method for determining the target ratio m is only an exemplary implementation. In other embodiments, other methods may be used to determine the target ratio m, as long as the video is uploaded When the bit rate of the image is greater than the bit rate of the received video image, m>n; when the bit rate of the uploaded video image is less than the bit rate of the received video image, m ⁇ n is sufficient.
- the present disclosure also provides a method for monitoring the receiving speed of video images, which is applied to a cloud server.
- Fig. 3 is a flowchart of a method for monitoring the receiving speed of a video image according to an embodiment of the present disclosure. As shown in Fig. 3, the monitoring method includes steps S21 to S23.
- Step S21 Receive the video image uploaded by the video image collection terminal.
- Step S22 Determine the receiving speed information according to the data amount of the video image received per unit time.
- Step S23 Send the receiving speed information to the video image collection terminal, so that the video image collection terminal can determine the target ratio m of the collection frame rate of the video image to the upload frame rate according to the reception speed information.
- the cloud server may send the foregoing receiving speed information to the video image collection terminal through a communication protocol such as udp or tcp.
- the receiving speed information may include the bit rate of the received video image.
- the cloud server can monitor the bit rate of the received video image in real time, and send the bit rate as the receiving speed information to the video image collection terminal according to a preset period (for example, 10 minutes, 30 minutes, or 1 hour or other time).
- the monitored receiving speed information can be sent to the video image collection terminal, so that the video image collection terminal can determine the collection frame rate and the frame rate of the video image according to the receiving speed information.
- the target ratio of the upload frame rate is m, so that the receiving speed of the cloud server matches the local upload speed, and avoids the problem that the client's playback freezes due to the mismatch between the receiving speed of the cloud server and the local upload speed.
- FIG. 4 is a schematic diagram of modules of the video image collection terminal according to an embodiment of the present disclosure.
- the video image collection terminal includes a collection device 11, an upload device 12, a processing device 13, and an adjustment device 14.
- the capture device 11 is configured to capture video images.
- the collection device 11 may be a camera.
- the uploading device 12 is configured to upload the video images collected by the collecting device 11 to the cloud server in real time.
- the processing device 13 is configured to obtain upload speed information when the upload device 12 uploads video data to the cloud server, and the receiving speed information of the cloud server 2 when receiving video images; according to the receiving speed information, upload speed information, and collection of video images
- the current ratio n of the frame rate to the upload frame rate determines the target ratio m of the captured frame rate of the video image to the upload frame rate, where m and n are both positive integers.
- the adjusting device 14 is configured to adjust the uploading speed of the video image by the uploading device 12 according to the target ratio m, so that the adjusted speed of the uploading device 12 for uploading the video image matches the speed of receiving the video image by the cloud server.
- the adjusting device 14 is configured to adjust the uploading device 12 uploading video image speed, so that every time the collecting device 11 collects m frames of video images, the uploading device 12 uploads one of the m frames of video images.
- the upload speed information includes: the data volume of the video image uploaded by the video image collection terminal in a unit time; the receiving speed information includes: the data volume of the video image received by the cloud server in the unit time.
- the unit time can be set to 1 second.
- the collection frame rate may refer to the number of frames of video images collected by the video image collection terminal in a unit time, and the upload frame rate may refer to the number of frames of video images that the video image collection terminal uploads to the cloud server in a unit time.
- the acquisition frame rate is a fixed frequency
- the target ratio m is larger, the value of m-1 is also larger.
- the number of frames between two adjacent frames to be uploaded is greater; when the target ratio m The smaller the value, the smaller the value of m-1.
- the number of frames between two adjacent frames to be uploaded is smaller. Therefore, in the embodiment of the present disclosure, by controlling the size of the target ratio m, it is possible to control the number of frames between two adjacent frames to be uploaded in the video images collected by the video image collection terminal, thereby Control the number of frames of video images uploaded by the video image collection terminal in a unit time.
- the use of the video image acquisition terminal according to the embodiments of the present disclosure can reduce the number of frames of video images uploaded by the video image acquisition terminal per unit time when the video image receiving speed of the cloud server drops (the network environment becomes worse). That is to reduce the upload speed of the video image acquisition terminal, so that the receiving speed of the cloud server matches the upload speed of the video image acquisition terminal, and avoids the client playing card due to the mismatch between the receiving speed of the cloud server and the upload speed of the video image acquisition terminal The question of the day.
- FIG. 5 is a schematic diagram of modules of the cloud server according to an embodiment of the present disclosure.
- the cloud server includes:
- the receiving module 21 is configured to receive video images uploaded by a video image collection terminal
- the monitoring module 22 is configured to determine the receiving speed information according to the data amount of the video image received per unit time
- the sending module 23 is configured to send the receiving speed information to the video image collection terminal, so that the video image collection terminal can determine the target ratio m of the collection frame rate of the video image to the upload frame rate according to the reception speed information.
- the receiving speed information may include the bit rate of the received video image
- the cloud server may monitor the bit rate of the received video image in real time, and send the bit rate as the receiving speed information to the video image according to a preset period. Collection terminal.
- the monitored receiving speed information can be sent to the video image collection terminal, so that the video image collection terminal can determine the target of the video image collection frame rate and the upload frame rate according to the receiving speed information
- the ratio is m, so that the receiving speed of the cloud server matches the local upload speed, and avoids the problem that the client's playback is stuck due to the mismatch between the receiving speed of the cloud server and the local upload speed.
- the present disclosure also provides a computer-readable storage medium on which a computer program is stored, and when the computer program is executed by a processor, the above-mentioned video image uploading method or the above-mentioned video image receiving speed monitoring method is realized.
- Computer-readable storage media includes volatile and non-volatile, removable and removable media implemented in any method or technology for storing information (such as computer-readable instructions, data structures, program modules, or other data). Remove and non-removable media.
- Computer-readable storage media include but are not limited to RAM, ROM, EEPROM, flash memory or other memory technologies, CD-ROM, digital versatile disk (DVD) or other optical disk storage, magnetic cassettes, magnetic tapes, magnetic disk storage or other magnetic storage media, Or it can be used to store desired information and can be any other medium that can be accessed by a computer.
- the present disclosure also provides an electronic device, which includes:
- Computer programs are stored in the memory.
- the above video image uploading method or the above video image receiving speed monitoring method is realized.
- the embodiment of the present disclosure also provides a video playback system, including: the above-mentioned video image collection terminal, the above-mentioned cloud server, and the video playback terminal.
- the video playback terminal is configured to obtain and play video images from the cloud server, so that the video images collected by the video image collection terminal are displayed in real time on the video playback terminal.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Computer Security & Cryptography (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Information Transfer Between Computers (AREA)
Abstract
本公开提供一种视频图像传输方法，包括：通过视频图像采集终端，采集视频图像，并实时将视频图像上传至云服务器；获取视频图像采集终端上传视频图像的第一速度信息、以及云服务器接收视频图像的第二速度信息；根据第一速度信息、第二速度信息以及视频图像采集终端采集视频图像的第一帧率与视频图像采集终端上传视频图像的第二帧率的当前比值n，确定第一帧率与第二帧率的目标比值m，其中，目标比值m和比值n均为正整数；根据目标比值m，调整视频图像采集终端上传视频图像的速度，使得视频图像采集终端上传视频图像的调整后的速度与云服务器接收视频图像的速度匹配。
Description
本公开涉及数据传输技术领域，具体涉及一种视频图像采集终端、视频图像传输方法、视频图像传输系统、计算机可读存储介质、电子设备及视频播放系统。
在网络视频播放过程中，视频图像采集终端将采集的视频图像推送到云服务器，客户端从云服务器获取视频图像进行播放，可以实现视频图像采集终端采集的视频图像在客户端上的实时显示。
发明内容
一方面，本公开提供一种视频图像传输方法，包括：
通过视频图像采集终端，采集视频图像，并实时将所述视频图像上传至云服务器；
获取所述视频图像采集终端上传所述视频图像的第一速度信息、以及所述云服务器接收所述视频图像的第二速度信息；
根据所述第一速度信息、所述第二速度信息以及所述视频图像采集终端采集所述视频图像的第一帧率与所述视频图像采集终端上传所述视频图像的第二帧率的当前比值n，确定所述第一帧率与所述第二帧率的目标比值m，其中，所述目标比值m和所述比值n均为正整数；
根据所述目标比值m，调整所述视频图像采集终端上传所述视频图像的速度，使得所述视频图像采集终端上传所述视频图像的调整后的速度与所述云服务器接收所述视频图像的速度匹配。
在本公开的实施例中，根据所述第一帧率与所述第二帧率的目标比值m，调整所述视频图像采集终端上传所述视频图像的速度包括：使所述视频图像采集终端每采集m帧视频图像，上传m帧视频图像中的其中一帧。
在本公开的实施例中，所述第一速度信息包括：所述视频图像采集终端上传视频图像的码率，所述第二速度信息包括：所述云服务器接收视频图像的码率；
响应于所述视频图像采集终端上传视频图像的码率大于所述云服务器接收视频图像的码率，将所述目标比值m设置为大于所述当前比值n；响应于所述视频图像采集终端上传视频图像的码率小于所述云服务器接收视频图像的码率，将所述目标比值m设置为小于所述当前比值n。
在本公开的实施例中，根据所述第一速度信息、所述第二速度信息以及所述视频图像采集终端采集所述视频图像的第一帧率与所述视频图像采集终端上传所述视频图像的第二帧率的当前比值n，确定所述第一帧率与所述第二帧率的目标比值m包括：
确定所述视频图像采集终端上传视频图像的码率与所述云服务器接收视频图像的码率的比值x；
根据所述比值x与所述当前比值n的乘积、以及基准帧率范围，确定所述目标比值m。
在本公开的实施例中，根据所述比值x与所述当前比值n的乘积、以及所述基准帧率范围，确定所述目标比值m包括：
根据所述比值x与所述当前比值n，确定所述第一帧率与所述第二帧率的调整比值，该调整比值为所述比值x与所述当前比值n的乘积取整后的值；
根据所述第一帧率与所述调整比值，确定调整后的第二帧率；
比较所述调整后的第二帧率与所述基准帧率范围，响应于所述调整后的第二帧率在所述基准帧率范围内，将所述调整比值作为所述目标比值m；响应于所述调整后的第二帧率在所述基准帧率范围外，根据所述基准帧率范围的边界值确定所述目标比值m。
在本公开的实施例中，所述基准帧率范围的最小值在14帧数/秒至20帧数/秒之间。
在本公开的实施例中，所述视频图像传输方法还包括：
所述云服务器接收所述视频图像采集终端上传的视频图像；
根据单位时间内所述云服务器接收到的视频图像的数据量，确定所述第二速度信息；
将所述第二速度信息发送至所述视频图像采集终端。
另一方面，本公开还提供了一种视频图像采集终端，包括：
采集装置，配置为采集视频图像；
上传装置，配置为实时将所述采集装置采集的视频图像上传至云服务器；
处理装置，配置为：
获取所述上传装置上传所述视频图像的第一速度信息、以及所述云服务器接收所述视频图像的第二速度信息；
根据所述第一速度信息、所述第二速度信息以及所述采集装置采集所述视频图像的第一帧率与所述上传装置上传所述视频信息的第二帧率的当前比值n，确定所述第一帧率与所述第二帧率的目标比值m，其中，所述目标比值m和所述比值n均为正整数；
调整装置，配置为根据所述目标比值m，调整所述上传装置上传所述视频图像的速度，使得所述上传装置上传所述视频图像的调整后的速度与所述云服务器接收所述视频图像的速度匹配。
在本公开的实施例中，所述调整装置配置为调整所述上传装置上传所述视频图像的速度，使得所述采集装置每采集m帧视频图像，所述上传装置上传m帧视频图像中的其中一帧。
在本公开的实施例中，所述第一速度信息包括：所述采集装置上传视频图像的码率，所述第二速度信息包括：所述云服务器接收视频图像的码率；
所述处理装置配置为：响应于所述上传装置上传视频图像的码率大于所述云服务器接收视频图像的码率，将所述目标比值m设置为大于所述当前比值n；响应于所述上传装置上传视频图像的码率小于所述云服务器接收视频图像的码率，将所述目标比值m设置为小于所述当前比值n。
在本公开的实施例中，所述处理装置配置为：
确定所述上传装置上传视频图像的码率与所述云服务器接收视频图像的码率的比值x；
根据所述比值x与所述当前比值n的乘积、以及基准帧率范围，确定所述目标比值m。
在本公开的实施例中，所述处理装置配置为：
根据所述比值x与所述当前比值n，确定所述第一帧率与所述第二帧率的调整比值，该调整比值为所述比值x与所述当前比值n的乘积取整后的值；
根据所述第一帧率与所述调整比值，确定调整后的第二帧率；
比较所述调整后的第二帧率与所述基准帧率范围，响应于所述调整后的第二帧率在所述基准帧率范围内，将所述调整比值作为所述目标比值m；响应于所述调整后的第二帧率在所述基准帧率范围外，根据所述基准帧率范围的边界值确定所述目标比值m。
在本公开的实施例中，所述调整装置实时地调整所述上传装置上传所述视频图像的速度。
另一方面，本公开还提供一种视频传输系统，包括：
根据本公开的上述视频图像采集终端；以及
云服务器，配置为：
接收所述视频图像采集终端上传的视频图像；
根据单位时间内接收到的视频图像的数据量，确定所述第二速度信息；
将所述第二速度信息发送至所述视频图像采集终端。
另一方面，本公开还提供一种计算机可读存储介质，其上存储有计算机程序，所述计算机程序被处理器执行时实现根据本公开的上述视频图像传输方法。
另一方面，本公开还提供一种电子设备，包括：
处理器和存储器；
所述存储器存储有计算机程序；所述计算机程序被所述处理器执行时实现根据本公开的上述视频图像传输方法。
另一方面，本公开还提供一种视频播放系统，包括：
根据本公开的上述视频传输系统；以及
视频播放终端，配置为从所述云服务器获取视频图像，并进行播放。
附图是用来提供对本公开的进一步理解，并且构成说明书的一部分，与下面的具体实施方式一起用于解释本公开，但并不构成对本公开的限制。在附图中：
图1为根据本公开实施例的视频图像上传方法的流程图；
图2为根据本公开实施例的视频图像上传方法的流程图；
图3为根据本公开实施例的视频图像接收速度的监测方法的流程图；
图4为根据本公开实施例的视频图像采集终端的功能模块示意图；
图5为根据本公开实施例的云服务器的功能模块示意图。
以下结合附图对本公开的具体实施方式进行详细说明。应当理解的是，此处所描述的具体实施方式仅用于说明和解释本公开，并不用于限制本公开。
除非另作定义，本公开实施例使用的技术术语或者科学术语应当为本公开所属领域内具有一般技能的人士所理解的通常意义。本公开中使用的“第一”、“第二”以及类似的词语并不表示任何顺序、数量或者重要性，而只是用来区分不同的组成部分。
在利用网络进行视频直播的过程中，视频图像采集终端将采集的视频图像推送到云服务器，客户端从云服务器获取视频图像进行播放，从而可以实现视频图像采集终端采集的视频图像在客户端上的实时显示。
目前，在视频图像采集终端采集的视频图像在客户端实时显示的过程中，由于网络不佳，可能会导致客户端观看视频时发生卡顿，影响观看的流畅性。在该过程中，涉及到两个网络速度：上传网络速度(即，视频图像采集终端向云服务器上传视频图像的上传速度)和下载网络速度(即，客户端从云服务器 获取视频图像的下载速度)。在客户端，可以采用调整视频清晰度的方式进行适配。例如，视频清晰度可分为流畅、标清、高清、蓝光等，以供客户端自动选择清晰度或由用户手动选择清晰度，从而可以通过在下载网络速度较慢时选择观看较低清晰度的视频，在下载网络速度较快时选择观看较高清晰度的视频，确保观看的流畅性。但是，对于视频图像采集终端而言，却鲜有改善方式。当上传网络速度较差时，视频图像采集终端的上传速度与云服务器的接收速度不匹配，同样会引起客户端播放的视频卡顿。例如，视频图像采集终端每秒采集30帧视频图像，云服务器每秒只能接收15帧视频图像，那么，云服务器接收完30帧视频图像的时间为2秒，导致云服务器和客户端在2秒内所接收到的视频图像实际为视频图像采集终端在1秒内采集的视频图像，也就是说，视频图像采集终端所采集的1秒的图像在客户端将会播放2秒，进而造成客户端播放的视频出现卡顿。
有鉴于此，本公开提供一种视频图像上传方法，应用于视频图像采集终端。图1为根据本公开实施例的视频图像上传方法的流程图。如图1所示，该视频图像上传方法包括步骤S11至S14。
步骤S11、采集视频图像，并实时将所述视频图像上传至云服务器。
在本公开的实施例中，视频图像采集终端在采集到视频图像后，可以对视频图像进行编码、压缩等处理过程，从而形成视频流数据，并以视频流数据的形式将采集到的视频图像上传至云服务器。
步骤S12、获取将视频图像从本地上传至云服务器时的上传速度信息、以及云服务器在接收视频图像时的接收速度信息。
在本文中，本地是指用于采集和上传视频图像的视频图像采集终端，例如摄像机。上传速度信息包括：视频图像采集终端在单位时间内上传视频图像的数据量。接收速度信息包括：云服务器在单位时间内接收视频图像的数据量。单位时间可以设置为1秒。在本公开的实施例中，上传速度信息和接收速度信息均是针对相同的一帧或若干帧视频图像而言。但是，由于该视频图像的上传速度信息由本地决定，而云服务器在接收该视频图像时的接收速度信息则随着 网络状况的不同(例如网络拥堵)而不同，因此，上传速度信息和接收速度信息不一定相同。
步骤S13、根据接收速度信息、上传速度信息以及视频图像的采集帧率与上传帧率的当前比值n，确定视频图像的采集帧率与上传帧率的目标比值m，其中，m和n均为正整数。
在本公开的实施例中，采集帧率可以是指视频图像采集终端在单位时间内采集的视频图像的帧数，上传帧率可以是指视频图像采集终端在单位时间内上传至云服务器的视频图像的帧数。在采集帧率为一固定频率的情况下，采集帧率与上传帧率的比值越大，则上传帧率越小，也即视频图像采集终端在单位时间内上传至云服务器的视频图像的帧数越少；采集帧率与上传帧率的比值越小，则上传帧率越大，也即视频图像采集终端在单位时间内上传至云服务器的视频图像的帧数越多；当采集帧率与上传帧率的比值为1时，则说明在单位时间内，视频图像采集终端将采集到的图像全部进行了上传。
步骤S14、根据目标比值m，调整视频图像的上传速度，使得调整后的上传速度与云服务器接收视频图像的速度匹配。
在本公开中，“调整后的上传速度与云服务器接收视频图像的速度匹配”是指“使得调整后的上传速度与云服务器接收视频图像的速度之差尽可能地小”。例如，可以使得调整后的上传速度与云服务器接收视频图像的速度相等。本公开对此不作具体限制，只要能够使得调整后的上传速度与云服务器接收视频图像的速度之差大于调整前的上传速度与云服务器接收视频图像的速度之差即可。
在本公开的实施例中，视频图像采集终端每采集m帧视频图像，上传m帧视频图像中的其中一帧。在上传视频图像时，可以采用RTMP等视频协议进行上传。
需要说明的是，m表征采集帧率与上传帧率的目标比值，但是，在确定m的值时，并不一定需要先确定采集帧率的具体值和上传帧率的具体值，只需确定出每采集多少帧上传一帧即可。
当目标比值m越大时，在视频图像采集终端所采集到的视频图像中，上传视频图像的帧数就越少。因此，在本公开的实施例中，通过控制目标比值m的大小，即可调整视频图像采集终端在单位时间内上传视频图像的帧数，进而改善因云服务器的接收速度与视频图像采集终端的上传速度不匹配而导致的客户端播放卡顿的问题。
综上，采用根据本公开实施例的视频图像上传方法，可以在云服务器的视频图像接收速度下降(网络环境变差)时，降低视频图像采集终端在单位时间内上传视频图像的帧数，也即降低视频图像采集终端的上传速度，从而使云服务器的接收速度与视频图像采集终端的上传速度相匹配，避免由于云服务器的接收速度与视频图像采集终端的上传速度不匹配导致客户端播放卡顿的问题。
需要说明的是，在本公开的实施例中，步骤S11是持续进行的，步骤S12至步骤S14则是在步骤S11的执行过程中进行的，而非是在步骤S11执行完成后才执行的。
在一些实施例中，步骤S14包括：每间隔m-1帧视频图像，上传一帧视频图像。
例如，在视频图像采集终端在1秒内采集30帧视频图像的情况下，若采集帧率与上传帧率的目标比值为2，则视频图像采集终端每间隔1帧视频图像上传1帧视频图像，视频图像采集终端在1秒内上传15帧视频图像；若采集帧率与上传帧率的目标比值为3，则视频图像采集终端每间隔2帧视频图像上传1帧视频图像，此时，视频图像采集终端在1秒内上传10帧视频图像。
还需要说明的是，上述的视频图像采集终端在1秒内采集的视频图像的帧数仅为示例性说明，视频图像采集终端也可以在1秒内采集60帧视频图像、120帧视频图像、240帧视频图像、330帧视频图像甚至更高，具体根据实际需要确定，在此不做限定。
图2为根据本公开实施例的视频图像上传方法的流程图。下面结合图2对根据本公开实施例的视频图像上传方法进行详细说明。在一些实施例中，上传速度信息包括：上传视频图像的码率；接收速度信息包括：云服务器接收视频 图像的码率。如上文所述，视频图像是以视频流数据的形式进行上传的，而这里的码率是指数据传输时单位时间传送的数据位数，单位是kbps即千位每秒。码率越大，精度就越高。
当上传视频图像的码率大于接收视频图像的码率时，增大所述当前比值n的值，以得到所述目标比值m，即，将目标比值m设置为大于当前比值n。当上传视频图像的码率小于接收视频图像的码率时，减小所述当前比值n的值，以得到所述目标比值m，即，将目标比值m设置为小于当前比值n。
在本公开的实施例中，接收速度信息是由云服务器确定的。例如，云服务器可以根据网口的网络数据确定网络状况，进而根据网络状况确定接收视频图像的码率。当网络状况良好时，接收视频图像的码率则较大；当网络状况差时，接收视频图像的码率则较小。当上传视频图像的码率大于接收视频图像的码率时，说明网络环境较差，视频图像采集终端上传的视频图像无法被云服务器及时接收，此时，将目标比值m设置为大于当前比值n，从而降低视频图像采集终端在单位时间内上传的视频图像的帧数，避免客户端播放视频时发生卡顿。而当上传视频图像的码率小于接收视频图像的码率时，说明网络环境较好，视频图像采集终端上传的视频图像可以被云服务器及时接收，且在单位时间内，云服务器还可以接收更多的视频图像，此时，将目标比值m设置为小于当前比值n，从而使视频图像采集终端在单位时间内上传的视频图像的帧数增加，提高客户端播放视频的清晰度。
以视频图像采集终端当前的上传视频图像的码率大于云服务器当前的接收视频图像的码率为例，假设视频图像采集终端每秒采集30帧视频图像，视频图像采集终端当前每秒上传30帧视频图像。此时，视频图像采集终端的采集帧率与上传帧率的当前比值n为1。视频图像采集终端监测到上传视频图像的码率为6000000kbps，云服务器监测到接收视频图像的码率为3000000kbps，云服务器将监测到的接收视频图像的码率发送至视频图像采集终端，视频图像采集终端将上传视频图像的码率与接收视频图像的码率进行比较后，确定上传视频图像的码率远远大于接收视频图像的码率。此时可以使目标比值m大于当前比值n， 也即，使目标比值m大于1(例如m可以取2、3、4……)，从而使视频图像采集终端每间隔至少一帧视频图像上传一帧视频图像，即，降低视频图像采集终端在单位时间内上传的视频图像的帧数。结果，使视频图像采集终端上传视频图像的码率与云服务器接收视频图像的码率保持一致或近似一致，避免客户端观看视频时发生卡顿。
在一些实施例中，如图2所示，步骤S13包括步骤S131和S132。
步骤S131、确定上传视频图像的码率与接收视频图像的码率的比值x。
步骤S132、根据比值x与当前比值n的乘积、以及基准上传帧率确定目标比值m。
在本公开的实施例中，基准上传帧率可以包括：视频图像采集终端在单位时间内的最低上传帧数和/或最高上传帧数。在本公开的实施例中，基准上传帧率用于防止目标比值m过大或过小，进而导致视频图像采集终端在单位时间内上传的帧数过小或过大，影响客户端的显示效果。
在一些实施例中，在基准上传帧率是视频图像采集终端在单位时间内的最低上传帧数的情况下，步骤S132包括步骤S1321至S1325。
步骤S1321、根据比值x与当前比值n，确定视频图像的采集帧率与上传帧率的调整比值n’，该调整比值n’为比值x与当前比值n的乘积取整后的值。示例性的，本公开实施例中的“取整”为向下取整。
步骤S1322、根据视频图像的采集帧率与调整比值，确定调整后的上传帧率。
步骤S1323、比较调整后的上传帧率与基准上传帧率，若调整后的上传帧率大于或等于基准上传帧率，则执行步骤S1324，若调整后的上传帧率小于基准上传帧率，则执行步骤S1325。
步骤S1324、将比值x与当前比值n的乘积取整后的值(即，调整比值)作为目标比值m。
步骤S1325、根据基准上传帧率确定目标比值m。
在一些实施例中，基准上传帧率在14帧数/秒至20帧数/秒之间，例如，基准上传帧率可以设置为15帧数/秒或16帧数/秒。
以基准上传帧率为视频图像采集终端在单位时间内的最低上传帧数为例，假设基准上传帧率为15帧数/秒，视频图像采集终端每秒采集30帧视频图像，视频图像采集终端当前每秒上传30帧视频图像，此时，视频图像采集终端的采集帧率与上传帧率的当前比值n为1。视频图像采集终端监测到的上传视频图像的码率为6000000kbps，云服务器监测到的接收视频图像的码率为2000000kbps。云服务器将监测到的接收视频图像的码率发送至视频图像采集终端，视频图像采集终端根据上传视频图像的码率与接收视频图像的码率，计算得到比值x＝3。之后，视频图像采集终端将x与n相乘并取整，得到采集帧率与上传帧率的调整比值n’＝3，采集帧率与调整比值n’的比值即为调整后的上传帧率a＝10帧数/秒。此时，由于调整后的上传帧率小于基准上传帧率(15帧数/秒)，因此，以采集帧率与基准上传帧率的比值取整后作为目标比值m，此时m＝2。在该情况下，视频图像采集终端每间隔1帧视频图像上传1帧视频图像，视频图像采集终端在1秒内上传视频图像的帧数由30帧减为15帧，视频图像采集终端上传视频图像的码率由6000000kbps减至3000000kbps，与云服务器的接收视频图像的码率相接近。
云服务器可以每间隔一段时间向视频图像采集终端发送一次其监测到的接收视频图像的码率，以使视频图像采集终端可以实时调整单位时间内上传视频图像的帧数。例如，视频图像采集终端在经过前文所述的调整之后，再次接收到云服务器发送的接收视频图像的码率。假设网络环境变好，云服务器监测到的接收视频图像的码率为6000000kbps，此时，上传视频图像的码率为上次调整后的码率3000000kbps，上传帧率为每秒上传15帧视频图像，采集帧率保持不变，仍为每秒采集30帧视频图像，视频图像采集终端的采集帧率与上传帧率的当前比值n为2。视频图像采集终端根据上传视频图像的码率与接收视频图像的码率，计算得到比值x＝1/2。之后，视频图像采集终端将x与n相乘并取整，得到采集帧率与上传帧率的调整比值n’＝1，采集帧率与调整比值n’的比值即为调整后的上传帧率a＝30。此时，由于调整后的上传帧率大于基准上传帧率，因此，以调整比值n’作为目标比值m，此时m＝1，视频图像采集终端每间隔0 帧视频图像上传1帧视频图像，视频图像采集终端在1秒内上传视频图像的帧数由15帧增加为30帧，视频图像采集终端上传视频图像的码率由3000000kbps增至6000000kbps，与云服务器的接收视频图像的码率相同。
需要说明的是，在本公开的实施例中，上述的确定目标比值m的方式只是一种示例性实施方式，在另一些实施例中，还可以采用其他方式确定目标比值m，只要当上传视频图像的码率大于接收视频图像的码率时，m＞n；当上传视频图像的码率小于接收视频图像的码率时，m<n即可。
本公开还提供一种视频图像接收速度的监测方法，应用于云服务器。图3为根据本公开实施例的视频图像接收速度的监测方法的流程图。如图3所示，该监测方法包括步骤S21至S23。
步骤S21、接收视频图像采集终端上传的视频图像。
步骤S22、根据单位时间内接收到的视频图像的数据量，确定接收速度信息。
步骤S23、将接收速度信息发送至视频图像采集终端，以供视频图像采集终端根据接收速度信息确定视频图像的采集帧率与上传帧率的目标比值m。例如，云服务器可以通过udp或tcp等通信协议向视频图像采集终端发送上述接收速度信息。
在本公开的实施例中，接收速度信息可以包括接收视频图像的码率。云服务器可以实时监测接收视频图像的码率，并根据一预设周期(例如，10分钟、30分钟或1小时或其他时间)将该码率作为接收速度信息发送至视频图像采集终端。
采用根据本公开实施例的视频图像接收速度的监测方法，可以将监测到的接收速度信息发送至视频图像采集终端，从而使视频图像采集终端可以根据该接收速度信息确定视频图像的采集帧率与上传帧率的目标比值m，进而使云服务器的接收速度与本地的上传速度相匹配，避免由于云服务器的接收速度与本地的上传速度不匹配导致客户端播放卡顿的问题。
本公开还提供一种视频图像采集终端，图4为根据本公开实施例的视频图像采集终端的模块示意图。如图4所示，该视频图像采集终端包括采集装置11、 上传装置12、处理装置13和调整装置14。
采集装置11配置为采集视频图像。在一些实施例中，采集装置11可以为摄像头。
上传装置12配置为实时将采集装置11采集的视频图像上传至云服务器。
处理装置13配置为：获取上传装置12将视频数据上传至云服务器时的上传速度信息、以及云服务器2在接收视频图像时的接收速度信息；根据接收速度信息、上传速度信息以及视频图像的采集帧率与上传帧率的当前比值n，确定视频图像的采集帧率与上传帧率的目标比值m，其中，m和n均为正整数。
调整装置14配置为根据目标比值m，调整上传装置12上传视频图像的速度，使得上传装置12上传视频图像的调整后的速度与云服务器接收视频图像的速度匹配。
在本公开的实施例中，调整装置14配置为调整上传装置12上传视频图像的速度，使得采集装置11每采集m帧视频图像，上传装置12上传m帧视频图像中的其中一帧。
在本公开的实施例中，上传速度信息包括：视频图像采集终端在单位时间内上传视频图像的数据量；接收速度信息包括：云服务器在单位时间内接收视频图像的数据量。在本公开中，单位时间可以设置为1秒。采集帧率可以是指视频图像采集终端在单位时间内采集的视频图像的帧数，上传帧率可以是指视频图像采集终端在单位时间内上传至云服务器的视频图像的帧数。在采集帧率为一固定频率的情况下，采集帧率与上传帧率的比值越大，则上传帧率越小，也即视频图像采集终端在单位时间内上传至云服务器的视频图像的帧数越少；采集帧率与上传帧率的比值越小，则上传帧率越大，也即视频图像采集终端在单位时间内上传至云服务器的视频图像的帧数越多；当采集帧率与上传帧率的比值为1时，则说明在单位时间内，视频图像采集终端将采集到的图像全部进行了上传。当目标比值m越大，m-1的值也越大，在视频图像采集终端所采集到的视频图像中，相邻两个待上传帧之间所间隔的帧数越多；当目标比值m越小，m-1的值也越小，在视频图像采集终端所采集到的视频图像中，相邻两个待 上传帧之间所间隔的帧数越少。因此，在本公开的实施例中，通过控制目标比值m的大小，即可控制在视频图像采集终端所采集到的视频图像中，相邻两个待上传帧之间所间隔的帧数，从而控制视频图像采集终端在单位时间内上传的视频图像的帧数。
综上，采用根据本公开实施例的视频图像采集终端，可以在云服务器的视频图像接收速度下降(网络环境变差)时，降低视频图像采集终端在单位时间内上传视频图像的帧数，也即降低视频图像采集终端的上传速度，从而使云服务器的接收速度与视频图像采集终端的上传速度相匹配，避免由于云服务器的接收速度与视频图像采集终端的上传速度不匹配导致客户端播放卡顿的问题。
本公开还提供一种云服务器，图5为根据本公开实施例的云服务器的模块示意图。如图5所示，该云服务器包括：
接收模块21，配置为接收视频图像采集终端上传的视频图像；
监测模块22，配置为根据单位时间内接收到的视频图像的数据量，确定接收速度信息；
发送模块23，配置为将接收速度信息发送至视频图像采集终端，以供视频图像采集终端根据接收速度信息确定视频图像的采集帧率与上传帧率的目标比值m。
在本公开的实施例中，接收速度信息可以包括接收视频图像的码率，云服务器可以实时监测接收视频图像的码率，并根据一预设周期将该码率作为接收速度信息发送至视频图像采集终端。
采用根据本公开实施例的云服务器，可以将监测到的接收速度信息发送至视频图像采集终端，从而使视频图像采集终端可以根据该接收速度信息确定视频图像的采集帧率与上传帧率的目标比值m，进而使云服务器的接收速度与本地的上传速度相匹配，避免由于云服务器的接收速度与本地的上传速度不匹配导致客户端播放卡顿的问题。
本公开还提供一种计算机可读存储介质，其上存储有计算机程序，计算机程序被处理器执行时实现上述的视频图像上传方法或上述的视频图像接收速度 的监测方法。
在本文中，计算机可读存储介质包括在用于存储信息(诸如计算机可读指令、数据结构、程序模块或其他数据)的任何方法或技术中实施的易失性和非易失性、可移除和不可移除介质。计算机可读存储介质包括但不限于RAM、ROM、EEPROM、闪存或其他存储器技术、CD-ROM、数字多功能盘(DVD)或其他光盘存储、磁盒、磁带、磁盘存储或其他磁存储介质、或者可以用于存储期望的信息并且可以被计算机访问的任何其他的介质。
本公开还提供一种电子设备，电子设备包括：
处理器和存储器。
存储器存储有计算机程序。计算机程序被处理器执行时实现上述的视频图像上传方法或上述的视频图像接收速度的监测方法。
本公开实施例还提供一种视频播放系统，包括：上述的视频图像采集终端、上述的云服务器、以及视频播放终端。视频播放终端配置为从所述云服务器获取视频图像，并进行播放，从而实现视频图像采集终端采集的视频图像在视频播放终端实时显示。
可以理解的是，以上实施方式仅仅是为了说明本公开的原理而采用的示例性实施方式，然而本公开并不局限于此。对于本领域内的普通技术人员而言，在不脱离本公开的精神和实质的情况下，可以做出各种变型和改进，这些变型和改进也视为本公开的保护范围。
Claims (17)
- 一种视频图像传输方法，包括：通过视频图像采集终端，采集视频图像，并实时将所述视频图像上传至云服务器；获取所述视频图像采集终端上传所述视频图像的第一速度信息、以及所述云服务器接收所述视频图像的第二速度信息；根据所述第一速度信息、所述第二速度信息以及所述视频图像采集终端采集所述视频图像的第一帧率与所述视频图像采集终端上传所述视频图像的第二帧率的当前比值n，确定所述第一帧率与所述第二帧率的目标比值m，其中，所述目标比值m和所述比值n均为正整数；根据所述目标比值m，调整所述视频图像采集终端上传所述视频图像的速度，使得所述视频图像采集终端上传所述视频图像的调整后的速度与所述云服务器接收所述视频图像的速度匹配。
- 根据权利要求1所述的视频图像传输方法，其中，根据所述第一帧率与所述第二帧率的目标比值m，调整所述视频图像采集终端上传所述视频图像的速度包括：使所述视频图像采集终端每采集m帧视频图像，上传m帧视频图像中的其中一帧。
- 根据权利要求1所述的视频图像传输方法，其中，所述第一速度信息包括：所述视频图像采集终端上传视频图像的码率，所述第二速度信息包括：所述云服务器接收视频图像的码率；响应于所述视频图像采集终端上传视频图像的码率大于所述云服务器接收视频图像的码率，将所述目标比值m设置为大于所述当前比值n；响应于所述视频图像采集终端上传视频图像的码率小于所述云服务器接收视频图像的码率，将所述目标比值m设置为小于所述当前比值n。
- 根据权利要求3所述的视频图像传输方法，其中，根据所述第一速度信息、所述第二速度信息以及所述视频图像采集终端采集所述视频图像的第一帧率与所述视频图像采集终端上传所述视频图像的第二帧率的当前比值n，确定所述第一帧率与所述第二帧率的目标比值m包括：确定所述视频图像采集终端上传视频图像的码率与所述云服务器接收视频图像的码率的比值x；根据所述比值x与所述当前比值n的乘积、以及基准帧率范围，确定所述目标比值m。
- 根据权利要求4所述的视频图像传输方法，其中，根据所述比值x与所述当前比值n的乘积、以及所述基准帧率范围，确定所述目标比值m包括：根据所述比值x与所述当前比值n，确定所述第一帧率与所述第二帧率的调整比值，该调整比值为所述比值x与所述当前比值n的乘积取整后的值；根据所述第一帧率与所述调整比值，确定调整后的第二帧率；比较所述调整后的第二帧率与所述基准帧率范围，响应于所述调整后的第二帧率在所述基准帧率范围内，将所述调整比值作为所述目标比值m；响应于所述调整后的第二帧率在所述基准帧率范围外，根据所述基准帧率范围的边界值确定所述目标比值m。
- 根据权利要求5所述的视频图像传输方法，其中，所述基准帧率范围的最小值在14帧数/秒至20帧数/秒之间。
- 根据权利要求1所述的视频图像传输方法，还包括：所述云服务器接收所述视频图像采集终端上传的视频图像；根据单位时间内所述云服务器接收到的视频图像的数据量，确定所述第二速度信息；将所述第二速度信息发送至所述视频图像采集终端。
- 一种视频图像采集终端，包括：采集装置，配置为采集视频图像；上传装置，配置为实时将所述采集装置采集的视频图像上传至云服务器；处理装置，配置为：获取所述上传装置上传所述视频图像的第一速度信息、以及所述云服务器接收所述视频图像的第二速度信息；根据所述第一速度信息、所述第二速度信息以及所述采集装置采集所述视频图像的第一帧率与所述上传装置上传所述视频信息的第二帧率的当前比值n，确定所述第一帧率与所述第二帧率的目标比值m，其中，所述目标比值m和所述比值n均为正整数；调整装置，配置为根据所述目标比值m，调整所述上传装置上传所述视频图像的速度，使得所述上传装置上传所述视频图像的调整后的速度与所述云服务器接收所述视频图像的速度匹配。
- 根据权利要求8所述的视频图像采集终端，其中，所述调整装置配置为调整所述上传装置上传所述视频图像的速度，使得所述采集装置每采集m帧视频图像，所述上传装置上传m帧视频图像中的其中一帧。
- 根据权利要求8所述的视频图像采集终端，其中，所述第一速度信息包括：所述采集装置上传视频图像的码率，所述第二速度信息包括：所述云服务器接收视频图像的码率；所述处理装置配置为：响应于所述上传装置上传视频图像的码率大于所述云服务器接收视频图像的码率，将所述目标比值m设置为大于所述当前比值n；响应于所述上传装置上传视频图像的码率小于所述云服务器接收视频图像的码率，将所述目标比值m设置为小于所述当前比值n。
- 根据权利要求10所述的视频图像采集终端，其中，所述处理装置配置为：确定所述上传装置上传视频图像的码率与所述云服务器接收视频图像的码率的比值x；根据所述比值x与所述当前比值n的乘积、以及基准帧率范围，确定所述目标比值m。
- 根据权利要求11所述的视频图像采集终端，其中，所述处理装置配置为：根据所述比值x与所述当前比值n，确定所述第一帧率与所述第二帧率的调整比值，该调整比值为所述比值x与所述当前比值n的乘积取整后的值；根据所述第一帧率与所述调整比值，确定调整后的第二帧率；比较所述调整后的第二帧率与所述基准帧率范围，响应于所述调整后的第二帧率在所述基准帧率范围内，将所述调整比值作为所述目标比值m；响应于所述调整后的第二帧率在所述基准帧率范围外，根据所述基准帧率范围的边界值确定所述目标比值m。
- 根据权利要求8所述的视频图像采集终端，其中，所述调整装置实时地调整所述上传装置上传所述视频图像的速度。
- 一种视频传输系统，包括：如权利要求8至13中任一项所述的视频图像采集终端；以及云服务器，配置为：接收所述视频图像采集终端上传的视频图像；根据单位时间内接收到的视频图像的数据量，确定所述第二速度信息；将所述第二速度信息发送至所述视频图像采集终端。
- 一种计算机可读存储介质，其上存储有计算机程序，所述计算机程序被处理器执行时实现如权利要求1至7中任一项所述的视频图像传输方法。
- 一种电子设备，包括：处理器和存储器；所述存储器存储有计算机程序；所述计算机程序被所述处理器执行时实现如权利要求1至7中任一项所述的视频图像传输方法。
- 一种视频播放系统，包括：如权利要求14所述的视频传输系统；以及视频播放终端，配置为从所述云服务器获取视频图像，并进行播放。
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010566292.0 | 2020-06-19 | ||
| CN202010566292.0A CN113824992B (zh) | 2020-06-19 | 2020-06-19 | 终端及上传方法、服务器及监测方法、介质、设备及系统 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2021254494A1 true WO2021254494A1 (zh) | 2021-12-23 |
Family
ID=78911988
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2021/100977 WO2021254494A1 (zh) | 2020-06-19 | 2021-06-18 | 视频图像传输方法、装置和系统 |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN113824992B (zh) |
| WO (1) | WO2021254494A1 (zh) |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101198042A (zh) * | 2007-12-26 | 2008-06-11 | 广东威创视讯科技股份有限公司 | 视频编码的码率控制方法及视频数据的发射设备 |
| CN103607559A (zh) * | 2013-11-07 | 2014-02-26 | 成都斯科瑞特科技有限公司 | 视频文件的通讯方法、监控终端、监控服务器以及视频监控系统 |
| CN105430532A (zh) * | 2015-11-18 | 2016-03-23 | 南京创维信息技术研究院有限公司 | 一种视频数据传输自适应调整的控制方法及其系统 |
| CN105656602A (zh) * | 2015-12-31 | 2016-06-08 | 小米科技有限责任公司 | 数据传输方法及装置 |
| CN106911432A (zh) * | 2017-03-29 | 2017-06-30 | 武汉米风通信技术有限公司 | 广电频谱超窄带物联网通信信道速率自适应方法及装置 |
| US20170289006A1 (en) * | 2016-03-31 | 2017-10-05 | Fujitsu Limited | Information generation method, information generation device, and non-transitory recording medium for storing information generation program |
| US20180359413A1 (en) * | 2016-01-29 | 2018-12-13 | SZ DJI Technology Co., Ltd. | Method, system, device for video data transmission and photographing apparatus |
| CN111107440A (zh) * | 2019-12-26 | 2020-05-05 | 腾讯科技（深圳）有限公司 | 视频传输控制方法及装置、设备、存储介质 |
Family Cites Families (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TWI497986B (zh) * | 2011-06-10 | 2015-08-21 | Chicony Electronics Co Ltd | 具畫面品質調整功能之影像傳輸方法以及系統 |
| US20130227162A1 (en) * | 2012-02-29 | 2013-08-29 | F-Secure Corporation | Management of Data Upload Speed |
| CN105450633B (zh) * | 2015-11-03 | 2019-03-29 | 广州视睿电子科技有限公司 | 一种文档上传方法、系统及解析服务器 |
| CN108989832B (zh) * | 2017-05-31 | 2021-12-10 | 腾讯科技（深圳）有限公司 | 一种图像数据处理方法及其设备、存储介质、终端 |
| CN108924640A (zh) * | 2018-07-11 | 2018-11-30 | 湖南双鸿科技有限公司 | 视频传输方法、装置和计算机可读存储介质 |
| CN109587510B (zh) * | 2018-12-10 | 2021-11-02 | 广州虎牙科技有限公司 | 一种直播方法、装置、设备和存储介质 |
| CN109729439B (zh) * | 2019-01-11 | 2022-06-17 | 北京世纪好未来教育科技有限公司 | 实时视频传输方法 |
| CN110557647A (zh) * | 2019-08-29 | 2019-12-10 | 山东柄烁网络科技有限公司 | 一种简便的直录播会议推流技术 |
-
2020
- 2020-06-19 CN CN202010566292.0A patent/CN113824992B/zh active Active
-
2021
- 2021-06-18 WO PCT/CN2021/100977 patent/WO2021254494A1/zh active Application Filing
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101198042A (zh) * | 2007-12-26 | 2008-06-11 | 广东威创视讯科技股份有限公司 | 视频编码的码率控制方法及视频数据的发射设备 |
| CN103607559A (zh) * | 2013-11-07 | 2014-02-26 | 成都斯科瑞特科技有限公司 | 视频文件的通讯方法、监控终端、监控服务器以及视频监控系统 |
| CN105430532A (zh) * | 2015-11-18 | 2016-03-23 | 南京创维信息技术研究院有限公司 | 一种视频数据传输自适应调整的控制方法及其系统 |
| CN105656602A (zh) * | 2015-12-31 | 2016-06-08 | 小米科技有限责任公司 | 数据传输方法及装置 |
| US20180359413A1 (en) * | 2016-01-29 | 2018-12-13 | SZ DJI Technology Co., Ltd. | Method, system, device for video data transmission and photographing apparatus |
| US20170289006A1 (en) * | 2016-03-31 | 2017-10-05 | Fujitsu Limited | Information generation method, information generation device, and non-transitory recording medium for storing information generation program |
| CN106911432A (zh) * | 2017-03-29 | 2017-06-30 | 武汉米风通信技术有限公司 | 广电频谱超窄带物联网通信信道速率自适应方法及装置 |
| CN111107440A (zh) * | 2019-12-26 | 2020-05-05 | 腾讯科技（深圳）有限公司 | 视频传输控制方法及装置、设备、存储介质 |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113824992A (zh) | 2021-12-21 |
| CN113824992B (zh) | 2023-04-14 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9794601B2 (en) | Dynamic programming across multiple streams | |
| US11317143B2 (en) | Dynamic reduction in playout of replacement content to help align end of replacement content with end of replaced content | |
| WO2017151654A1 (en) | Method and system for detecting and responding to changing of media channel | |
| US11812103B2 (en) | Dynamic playout of transition frames while transitioning between playout of media streams | |
| WO2019134293A1 (zh) | 一种直播方法、装置、服务器及介质 | |
| US10541894B2 (en) | Method for assessing the perceived quality of adaptive video streaming | |
| US11496781B2 (en) | Advanced preparation for content revision based on expected latency in obtaining new content | |
| CN108881931B (zh) | 一种数据缓冲方法及网络设备 | |
| US20190230277A1 (en) | Method and system for auto-setting of cameras | |
| EP3449634B1 (fr) | Procédé de composition contextuelle d'une représentation vidéo intermédiaire | |
| TWI723394B (zh) | 修正視訊串流流量的方法、機上盒及電腦可讀儲存介質 | |
| WO2021254494A1 (zh) | 视频图像传输方法、装置和系统 | |
| CN108810468B (zh) | 一种优化显示效果的视频传输装置及方法 | |
| CN109698961B (zh) | 一种监控方法、装置及电子设备 | |
| US10873778B2 (en) | Reducing digital video recorder storage through reduced encoding of certain program portions | |
| US11438545B2 (en) | Video image-based media stream bandwidth reduction | |
| US20240187704A1 (en) | Video image transmission method, device and system | |
| US20230031929A1 (en) | Reducing digital video recorder storage through reduced encoding of certain program portions | |
| US10021159B2 (en) | Method of stabilized adaptive video streaming for high dynamic range (HDR) | |
| US20230121792A1 (en) | Low latency content delivery | |
| EP3664456A1 (en) | Apparatus and method for playing streamed media | |
| CN110214352A (zh) | 与存储介质的损耗程度相适配的记录方法 | |
| JP6660357B2 (ja) | 品質推定装置、品質推定方法及びプログラム | |
| US10051025B2 (en) | Method and apparatus for estimating packet loss | |
| CN115665485A (zh) | 视频画面优化方法及装置、存储介质和视频终端 |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 21826314 Country of ref document: EP Kind code of ref document: A1 |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 17773116 Country of ref document: US |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 21826314 Country of ref document: EP Kind code of ref document: A1 |
|
| 32PN | Ep: public notification in the ep bulletin as address of the adressee cannot be established |
Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 03/07/2023) |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 21826314 Country of ref document: EP Kind code of ref document: A1 |