CN115883877A - A method and system for transmitting ultra-high-definition video streams - Google Patents

Abstract

The invention provides a transmission method and a system of ultra-high definition video stream, which relate to the technical field of signal processing, and the method comprises the following steps: receiving an ultra high definition video stream; intercepting a plurality of frames of video images from an ultra-high definition video stream, and performing difference recombination on pictures of adjacent frames of images in the video images to obtain a difference image sequence; monitoring performance load parameters and network transmission parameters in real time, and switching corresponding encoding and decoding modes according to the performance load parameters to perform image compression on the difference image sequence; determining the data packet amount and the network transmission protocol of the compressed difference image sequence according to the network transmission parameters; and transmitting the compressed difference image sequence to a display end according to the data packet quantity and a transmission protocol, and realizing stable transmission and smooth display of the ultra-high-definition video stream by the mode.

Description

A method and system for transmitting ultra-high-definition video streams

technical field

The invention belongs to the technical field of signal processing, and in particular relates to a method and system for transmitting ultra-high-definition video streams.

Background technique

The statements in this section merely provide background technical information related to the present invention, and do not necessarily constitute prior art that is already known to those skilled in the art.

With the popularization of high-speed networks, and the continuous iterative update of shooting equipment and display equipment, video specifications have gradually increased to new heights, video resolution has been increased from the original 4K to 8K, and ultra-high-definition video has more powerful dynamics. Capture ability, but also provide users with more comfortable visual enjoyment.

However, ultra-high-definition video has much higher requirements for the transmission and display process than traditional video technologies. The transmission process of 8K resolution dynamic video involves video interception, video image compression, network data transmission, video image decoding, and video image rendering and display. technology. Various technologies also have problems in supporting 8K high resolution, such as slow capture of images, inefficient encoding and decoding, large amount of network transmission data, etc., resulting in the transmission of image display freezes and blurred screens, seriously affecting User experience.

Contents of the invention

In order to solve the above problems, the present invention provides a method and system for transmitting ultra-high-definition video streams, which are used to solve the problems of slow video image capture speed, inefficient encoding and decoding, and unclear images in the existing video transmission process, and realize ultra-high-definition Stable transmission and smooth display of video streams, thereby improving user experience.

In order to achieve the above object, the present invention mainly includes the following aspects:

In a first aspect, an embodiment of the present invention provides a method for transmitting an ultra-high-definition video stream, including:

Receive ultra-high-definition video streams;

Intercepting multiple frames of video images from the ultra-high-definition video stream, performing differential reorganization on pictures of each adjacent frame in the video image, to obtain a sequence of differential images;

Real-time monitoring of performance load parameters and network transmission parameters, switching the corresponding encoding and decoding methods according to the performance load parameters to perform image compression on the difference image sequence; and, according to the network transmission parameters, determining the data of the compressed difference image sequence Packet volume and network transport protocol;

The compressed difference image sequence is transmitted to the display terminal according to the data packet size and transmission protocol.

In a possible implementation manner, for any two adjacent frames in the video image, the interlaced scanning method is used to compare the differences between the pictures of the two adjacent frame images, and the number of adjacent difference lines is merged A difference image is obtained; a plurality of the difference images form a sequence of difference images.

In a possible implementation manner, the performance load parameter includes but not limited to one or more of CPU occupancy, memory occupancy, and GPU occupancy; the standard value of the performance load parameter is obtained, and according to the monitored The variation range of the performance load parameter relative to the standard value determines the codec method used for image compression.

In a possible implementation manner, the codec mode includes but is not limited to one or more of jpg2000, H264, and H265.

In a possible implementation manner, the network transmission parameters include a network bandwidth occupancy rate and a network packet loss rate; when the network bandwidth occupancy rate is higher than a preset occupancy threshold, and the network packet loss rate exceeds a first preset When the packet loss rate threshold is set, adjust the packet volume.

In a possible implementation manner, the manner of adjusting the amount of data packets includes: adjusting a delay time for sending data packets, and/or increasing/decreasing buffer queues.

In a possible implementation manner, the network transmission protocol includes a multicast protocol and a unicast protocol; initially, the multicast protocol is used to transmit the difference image sequence, and when the network packet loss rate exceeds the second preset packet loss When the rate threshold exceeds the preset time interval, switch the multicast protocol to the unicast protocol.

In the second aspect, the embodiment of the present invention also provides a transmission system for ultra-high-definition video streams, including:

A receiving module, configured to receive ultra-high-definition video streams;

An intercepting module, configured to intercept multiple frames of video images from the ultra-high-definition video stream, and perform differential reorganization on the pictures of each adjacent frame image in the video image to obtain a sequence of differential images;

The compression module is used to monitor the performance load parameters and network transmission parameters in real time, and switch the corresponding codec mode according to the performance load parameters to perform image compression on the difference image sequence; and, according to the network transmission parameters, determine the compressed Packet size and transmission protocol of the difference image sequence;

The transmission module is used to transmit the compressed difference image sequence to the display terminal according to the data packet size and transmission protocol.

In a third aspect, an embodiment of the present invention provides a computer device, including: a processor, a memory, and a bus, the memory stores machine-readable instructions executable by the processor, and when the computer device is running, the processor The memory communicates with the memory through a bus, and when the machine-readable instructions are executed by the processor, the steps of the ultra-high-definition video stream transmission method described in the first aspect are executed.

In a fourth aspect, an embodiment of the present invention provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the supercomputer described in the above-mentioned first aspect is executed. Steps of a transmission method of a high-definition video stream.

The above one or more technical solutions have the following beneficial effects:

The present invention provides a method for transmitting ultra-high-definition video streams. By intercepting multi-frame video images in ultra-high-definition video streams, the pictures of adjacent frame images are differentially reorganized, and according to the monitored performance load parameters and network transmission parameters, adopt Different encoding and decoding methods perform image compression on the difference image sequence, and transmit the compressed difference image sequence to the display terminal according to the corresponding data packet volume and network transmission protocol. Through this method, the stable transmission and smoothness of ultra-high-definition video stream can be realized show.

Description of drawings

The accompanying drawings constituting a part of the present invention are used to provide a further understanding of the present invention, and the schematic embodiments of the present invention and their descriptions are used to explain the present invention and do not constitute improper limitations to the present invention.

FIG. 1 is a schematic flowchart of a method for transmitting an ultra-high-definition video stream provided by Embodiment 1 of the present invention.

Detailed ways

The present invention will be further described below in conjunction with the accompanying drawings and embodiments.

It should be noted that the following detailed description is exemplary and intended to provide further explanation of the present invention. Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs.

It should be noted that the terminology used here is only for describing specific embodiments, and is not intended to limit exemplary embodiments according to the present invention. As used herein, unless the context clearly dictates otherwise, the singular is intended to include the plural, and it should also be understood that when the terms "comprising" and/or "comprising" are used in this specification, they mean There are features, steps, operations, means, components and/or combinations thereof.

Embodiment one

As shown in Figure 1, an embodiment of the present invention provides a method for transmitting an ultra-high-definition video stream, including the following steps:

S101: Receive an ultra-high-definition video stream.

In a specific implementation, the ultra-high-definition video stream sent by the video acquisition device is received, and the ultra-high-definition video stream is subjected to video interception, video image compression, network data transmission, video image decoding, and video image rendering and display processing, and is performed on the display terminal. show.

S102: Intercept multiple frames of video images from the ultra-high-definition video stream, and perform difference reorganization on pictures of adjacent frame images in the video images to obtain a difference image sequence.

Existing image capture usually adopts the method of static acquisition to obtain image data, which will lead to a slow capture speed of ultra-high-definition video. In this embodiment, the picture dynamic comparison algorithm is used to obtain the picture change parts of the previous and subsequent adjacent frames, so as to reduce the amount of processed data, thereby saving the time cost of video capture and improving the efficiency of video capture.

In the specific implementation, GDI window and DirectX two video capture methods are adopted to adapt to the high-speed capture of ultra-high-definition video streams under different system platforms. Obtain the CPU performance load parameters and whether the user has set the screenshot type to determine the currently used 8K video capture method. When the CPU performance load parameter is below 30%, the DirectX interception method is used, and the screen capture requires more than 15 frames. Use the DX interception method , in other cases, use the method of intercepting the screen in the GDI window.

As an optional implementation, for any two adjacent frames in the video image, the interlaced scanning method is used to compare the differences between the pictures of the two adjacent frames, and the number of rows of adjacent differences is merged to obtain a difference image ; A plurality of the difference images form a sequence of difference images.

In the specific implementation, dynamic comparison (Dynamic Compare) is performed on the data after the intercepted picture, and the interlaced scanning algorithm is used to compare the differences between the pictures of the front and rear adjacent frames, and the random interlaced number from 1 to 10 or the set Fix the number of interlaced lines to compare RGB data. Once there is a difference in the comparison in the algorithm, it immediately jumps to the adjacent frame of the next comparison; The number of rows is merged, and finally enters the difference data block queue, and the data in the difference data block queue will be sequentially compressed.

S103: Monitor performance load parameters and network transmission parameters in real time, switch the corresponding codec mode according to the performance load parameters to perform image compression on the difference image sequence; and determine the compressed difference image sequence according to the network transmission parameters The data packet volume and network transmission protocol.

In the existing methods for dynamic image compression, a fixed codec standard cannot adapt to loads of different system environments, resulting in the problem of low-efficiency coding. Based on this, in order to adapt to the load of different system environments, this embodiment detects the performance load parameters of the local system in real time, and switches the corresponding codec mode according to the performance load parameters to perform image compression on the above-mentioned difference image sequence. Optionally, the performance load parameter includes but not limited to one or more of CPU occupancy, memory occupancy, and GPU occupancy; obtain the standard value of the performance load parameter, and compare the monitored performance load parameter with the The range of variation of the standard value determines the codec used for image compression. Optionally, the encoding and decoding methods include but are not limited to one or more of jpg2000, H264, and H265.

In the specific implementation, the built-in three encoding and decoding algorithms include jpg2000, H264, and H265. By continuously monitoring the load of the local system environment, including the CPU, memory, and GPU occupancy, combined with the performance requirements of the three encoding and decoding algorithms for the hardware and encoding effect characteristics to perform dynamic switching. Here, H265 has high requirements on hardware performance and high image compression rate; jpg2000 compressed image quality is higher but the amount of data is relatively large; H264 is relatively balanced.

Specifically, the system initially uses H264 dynamic image compression, while monitoring performance load parameters, including CPU occupancy, memory occupancy, and GPU occupancy; When the standard value fluctuates around 20%, switch to the jpg2000 compression algorithm, and the picture quality will be higher; if it exceeds the standard value by 50%, switch to the H264 encoding and decoding algorithm, and the hardware parameters are better. Adopt H265 codec algorithm.

In this way, not only can the speed of the entire codec be improved, but also the local environment can maintain a healthy load during 8K resolution dynamic video transmission, so as to meet the long-term stable operation of the entire system.

As an optional implementation, the network transmission parameters include network bandwidth occupancy rate and network packet loss rate; when the network bandwidth occupancy rate is higher than the preset occupancy rate threshold, and the network packet loss rate exceeds the first preset packet loss rate If the rate threshold is exceeded, adjust the packet volume.

The amount of data generated by 8K resolution dynamic video will increase exponentially, and the intensity of dynamic picture changes will also increase the amount of transmitted data. Based on this, this embodiment adopts a method of dynamic self-adaptive adjustment for network transmission, which uses dynamic monitoring of the size of the data volume sent by the network and combines the data statistics of received packets at the receiving end to adjust the algorithm of the data packet. When the amount of sending is large and the packet loss rate received by the client is higher than 10%, automatically adjust the amount of data packets at the sending end. Optionally, the adjustment method of the amount of data packets includes: adjusting the delay time of sending data packets, and/or, Increase/decrease cache queue.

At the same time, when the parameters of the network transmission are good, the relevant parameters can be automatically increased to make the dynamic video effect smoother and clearer. The network transmission protocol adopts the combination of multicast and unicast. In the network environment and the packet loss rate is less than 5%. Under the condition of using multicast transmission, if the sending device supports high bandwidth, it adopts unicast transmission, which is highly suitable for the user's network environment.

Optionally, the network transmission protocol includes a multicast protocol and a unicast protocol; initially, the multicast protocol is used to transmit the difference image sequence, and when the network packet loss rate exceeds a second preset packet loss rate threshold (such as 10 %) and the duration exceeds a preset time interval (such as 3 seconds), or when the packet loss sequence interval is frequent, the multicast protocol is switched to the unicast protocol.

S104: Transmit the compressed difference image sequence to the display terminal according to the data packet size and the transmission protocol.

Compared with the existing image capture method, the method provided in this embodiment can increase the video capture speed by about 20% on average, and the average capture time of a single 8K image frame can be increased by more than 10 ms without considering the complexity of the video. Through dynamic codec algorithm selection and network load monitoring technology, the frame rate of 8K resolution dynamic video transmission can reach 25 frames per second in a gigabit environment, and the picture quality is clear without blurring.

Embodiment two

Embodiments of the present invention also provide a transmission system for ultra-high-definition video streams, including:

A receiving module, configured to receive ultra-high-definition video streams;

An intercepting module, configured to intercept multiple frames of video images from the ultra-high-definition video stream, and perform differential reorganization on the pictures of each adjacent frame image in the video image to obtain a sequence of differential images;

The compression module is used to monitor the performance load parameters and network transmission parameters in real time, and switch the corresponding codec mode according to the performance load parameters to perform image compression on the difference image sequence; and, according to the network transmission parameters, determine the compressed Packet size and transmission protocol of the difference image sequence;

The transmission module is used to transmit the compressed difference image sequence to the display terminal according to the data packet size and transmission protocol.

The ultra-high-definition video stream transmission system provided in this embodiment is used to implement the aforementioned ultra-high-definition video stream transmission method, so the specific implementation of the ultra-high-definition video stream transmission system can be seen in the above-mentioned ultra-high-definition video stream transmission method. The embodiment part will not be repeated here.

Embodiment three

The embodiment of the present invention also provides a computer device, and the computer device includes a processor, a memory, and a bus. The memory stores machine-readable instructions executable by the processor. When the computer device is running, the processor communicates with the memory through a bus. When the machine-readable instructions are executed by the processor , the steps of the ultra-high-definition video stream transmission method in the method embodiment shown in FIG. 1 above can be executed. For the specific implementation, refer to the method embodiment, and details are not repeated here.

Embodiment four

An embodiment of the present invention also provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is run by a processor, the ultra-high-definition video stream described in the above-mentioned method embodiments is executed. The steps of the transfer method.

Those of ordinary skill in the art can understand that all or part of the processes in the methods of the above embodiments can be implemented through computer programs to instruct related hardware, and the programs can be stored in a computer-readable storage medium. During execution, it may include the processes of the embodiments of the above-mentioned methods. Wherein, the storage medium may be a magnetic disk, an optical disk, a read-only memory (Read-Only Memory, ROM) or a random access memory (Random Access Memory, RAM), etc.

The above descriptions are only preferred embodiments of the present invention, and are not intended to limit the present invention. For those skilled in the art, the present invention may have various modifications and changes. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of the present invention shall be included within the protection scope of the present invention.

Claims (10)

1. A transmission method of ultra-high-definition video stream, characterized in that, comprising: Receive ultra-high-definition video streams; Intercepting multiple frames of video images from the ultra-high-definition video stream, performing differential reorganization on pictures of each adjacent frame image in the video image, to obtain a sequence of differential images; Real-time monitoring of performance load parameters and network transmission parameters, switching the corresponding encoding and decoding methods according to the performance load parameters to perform image compression on the difference image sequence; and, according to the network transmission parameters, determining the data of the compressed difference image sequence Packet volume and network transport protocol; The compressed difference image sequence is transmitted to the display terminal according to the data packet size and transmission protocol. 2. The transmission method of ultra-high-definition video stream as claimed in claim 1, is characterized in that, for any two adjacent frames in the video image, adopt the mode of interlaced scanning to carry out difference comparison to the picture of two adjacent frames Yes, merge adjacent difference rows to obtain a difference image; a plurality of the difference images form a difference image sequence. 3. The transmission method of ultra-high-definition video stream as claimed in claim 1, is characterized in that, described performance load parameter comprises but not limited to one or more in CPU occupancy rate, memory occupancy rate and GPU occupancy rate; Obtain all The standard value of the performance load parameter, and determine the encoding and decoding method for image compression according to the variation range of the monitored performance load parameter relative to the standard value. 4. The method for transmitting an ultra-high-definition video stream according to claim 3, wherein the codec method includes but is not limited to one or more of jpg2000, H264, and H265. 5. The transmission method of ultra-high-definition video stream as claimed in claim 1, is characterized in that, described network transmission parameter comprises network bandwidth occupancy rate and network packet loss rate; When described network bandwidth occupancy rate is higher than preset occupancy rate threshold, and when the network packet loss rate exceeds the first preset packet loss rate threshold, the amount of data packets is adjusted. 6. The method for transmitting ultra-high-definition video streams according to claim 5, wherein the method of adjusting the amount of data packets includes: adjusting delay time for sending data packets, and/or increasing/decreasing buffer queues. 7. the transmission method of ultra-high-definition video stream as claimed in claim 5, is characterized in that, described network transmission protocol comprises multicast protocol and unicast protocol; Adopt multicast protocol to carry out the transmission of difference image sequence when initially, in the When the network packet loss rate exceeds the second preset packet loss rate threshold and the duration exceeds the preset time interval, the multicast protocol is switched to the unicast protocol. 8. A transmission system for ultra-high-definition video streams, comprising: A receiving module, configured to receive ultra-high-definition video streams; An intercepting module, configured to intercept multiple frames of video images from the ultra-high-definition video stream, and perform differential reorganization on the pictures of each adjacent frame image in the video image to obtain a sequence of differential images; The compression module is used to monitor the performance load parameters and network transmission parameters in real time, and switch the corresponding codec mode according to the performance load parameters to perform image compression on the difference image sequence; and, according to the network transmission parameters, determine the compressed Packet size and transmission protocol of the difference image sequence; The transmission module is used to transmit the compressed difference image sequence to the display terminal according to the data packet size and transmission protocol. 9. A computer device, characterized in that it comprises: a processor, a memory and a bus, the memory stores machine-readable instructions executable by the processor, and when the computer device is running, the processor and the The memories communicate through the bus, and the machine-readable instructions are executed by the processor to execute the steps of the ultra-high-definition video stream transmission method according to any one of claims 1 to 7. 10. A computer-readable storage medium, wherein a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the supercomputer according to any one of claims 1 to 7 is executed. Steps of a transmission method of a high-definition video stream.

Images