CN115883877A - Method and system for transmitting ultra-high-definition video stream - Google Patents

Method and system for transmitting ultra-high-definition video stream Download PDF

Info

Publication number
CN115883877A
CN115883877A CN202211481886.7A CN202211481886A CN115883877A CN 115883877 A CN115883877 A CN 115883877A CN 202211481886 A CN202211481886 A CN 202211481886A CN 115883877 A CN115883877 A CN 115883877A
Authority
CN
China
Prior art keywords
definition video
video stream
high definition
image sequence
transmission
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202211481886.7A
Other languages
Chinese (zh)
Inventor
张玉新
蔡存民
林德举
张祺
张伟
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Inspur Digital Shandong Technology Co Ltd
Original Assignee
Inspur Digital Shandong Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Inspur Digital Shandong Technology Co Ltd filed Critical Inspur Digital Shandong Technology Co Ltd
Priority to CN202211481886.7A priority Critical patent/CN115883877A/en
Publication of CN115883877A publication Critical patent/CN115883877A/en
Pending legal-status Critical Current

Links

Images

Landscapes

  • Compression Or Coding Systems Of Tv Signals (AREA)

Abstract

The invention provides a transmission method and a system of ultra-high definition video stream, which relate to the technical field of signal processing, and the method comprises the following steps: receiving an ultra high definition video stream; intercepting a plurality of frames of video images from an ultra-high definition video stream, and performing difference recombination on pictures of adjacent frames of images in the video images to obtain a difference image sequence; monitoring performance load parameters and network transmission parameters in real time, and switching corresponding encoding and decoding modes according to the performance load parameters to perform image compression on the difference image sequence; determining the data packet amount and the network transmission protocol of the compressed difference image sequence according to the network transmission parameters; and transmitting the compressed difference image sequence to a display end according to the data packet quantity and a transmission protocol, and realizing stable transmission and smooth display of the ultra-high-definition video stream by the mode.

Description

Method and system for transmitting ultra-high-definition video stream
Technical Field
The invention belongs to the technical field of signal processing, and particularly relates to a transmission method and system of an ultra-high definition video stream.
Background
The statements in this section merely provide background information related to the present disclosure and may not necessarily constitute prior art that is already known to a person of ordinary skill in the art.
With the popularization of high-speed networks and the continuous iterative updating of shooting equipment and display equipment, the specification of videos is gradually improved to a new height, the resolution ratio of the videos is improved to 8K from the original 4K, and ultrahigh-definition videos have stronger dynamic capturing capability and provide more comfortable visual enjoyment for users.
However, the requirements of the ultra-high-definition video on the transmission and display processes are much higher than those of the traditional video technology, and the 8K-resolution dynamic video relates to technologies of video interception, video image compression, network data transmission, video image decoding, video image rendering and display and the like in the transmission process. The 8K high resolution is supported by various technologies, and the problems that the high resolution cannot be supported efficiently, such as slow image capturing, low efficiency of encoding and decoding, large network transmission data volume and the like, are also existed, so that the transmitted image is displayed in a stuck and screen-blooming state, and the user experience is seriously influenced.
Disclosure of Invention
In order to solve the above problems, the present invention provides a transmission method and system for an ultra high definition video stream, so as to solve the problems of slow video frame capture speed, low coding and decoding efficiency, and unclear frame in the existing video transmission process, and realize stable transmission and smooth display of the ultra high definition video stream, thereby improving user experience.
In order to achieve the above object, the present invention mainly includes the following aspects:
in a first aspect, an embodiment of the present invention provides a method for transmitting an ultra high definition video stream, including:
receiving an ultra high definition video stream;
intercepting a plurality of frames of video images from the ultra-high definition video stream, and performing difference recombination on pictures of each adjacent frame in the video images to obtain a difference image sequence;
monitoring performance load parameters and network transmission parameters in real time, and switching corresponding coding and decoding modes according to the performance load parameters to perform image compression on the difference image sequence; determining the data packet amount and the network transmission protocol of the compressed difference image sequence according to the network transmission parameters;
and transmitting the compressed difference image sequence to a display end according to the data packet quantity and the transmission protocol.
In a possible implementation manner, for any two adjacent frames in the video image, difference comparison is performed on pictures of two adjacent frame images in an interlaced scanning manner, and adjacent difference line numbers are combined to obtain a difference image; a plurality of the difference images constitute a difference image sequence.
In one possible implementation, the performance load parameters include, but are not limited to, one or more of CPU occupancy, memory occupancy, and GPU occupancy; and acquiring a standard value of the performance load parameter, and determining an encoding and decoding mode for image compression according to the variation range of the monitored performance load parameter relative to the standard value.
In one possible embodiment, the codec includes, but is not limited to, one or more of jpg2000, H264, and H265.
In one possible implementation, the network transmission parameters include a network bandwidth occupancy rate and a network packet loss rate; and under the condition that the network bandwidth occupancy rate is higher than a preset occupancy rate threshold value and the network packet loss rate exceeds a first preset packet loss rate threshold value, adjusting the data packet volume.
In a possible implementation manner, the adjusting manner of the data packet amount includes: adjust the delay time for sending data packets, and/or increase/decrease the buffer queue.
In one possible embodiment, the network transport protocol includes a multicast protocol and a unicast protocol; and initially, transmitting the differential image sequence by adopting a multicast protocol, and switching the multicast protocol to a unicast protocol under the condition that the network packet loss rate exceeds a second preset packet loss rate threshold and the duration time exceeds a preset time interval.
In a second aspect, an embodiment of the present invention further provides a system for transmitting an ultra high definition video stream, including:
the receiving module is used for receiving the ultra-high definition video stream;
the intercepting module is used for intercepting multi-frame video images from the ultra-high definition video stream and carrying out difference recombination on the pictures of each adjacent frame image in the video images to obtain a difference image sequence;
the compression module is used for monitoring performance load parameters and network transmission parameters in real time and switching corresponding coding and decoding modes according to the performance load parameters to perform image compression on the difference image sequence; determining the data packet amount and the transmission protocol of the compressed difference image sequence according to the network transmission parameters;
and the transmission module is used for transmitting the compressed difference image sequence to a display end according to the data packet quantity and the transmission protocol.
In a third aspect, an embodiment of the present invention provides a computer device, including: a processor, a memory and a bus, the memory storing machine-readable instructions executable by the processor, the processor and the memory communicating via the bus when the computer device is running, the machine-readable instructions when executed by the processor performing the steps of the method for transmitting ultra high definition video stream as described in the first aspect above.
In a fourth aspect, the embodiments of the present invention provide a computer-readable storage medium, where a computer program is stored, where the computer program is executed by a processor to perform the steps of the method for transmitting ultra high definition video stream as described in the first aspect.
The above one or more technical solutions have the following beneficial effects:
the invention provides a transmission method of an ultra-high-definition video stream, which comprises the steps of intercepting a plurality of frames of video images in the ultra-high-definition video stream, carrying out difference recombination on the pictures of adjacent frames of images, adopting different coding and decoding modes to carry out image compression on a difference image sequence according to monitored performance load parameters and network transmission parameters, and transmitting the compressed difference image sequence to a display end according to corresponding data packet quantity and a network transmission protocol.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, are included to provide a further understanding of the invention, and are incorporated in and constitute a part of this specification, illustrate exemplary embodiments of the invention and together with the description serve to explain the invention and not to limit the invention.
Fig. 1 is a schematic flowchart of a transmission method of an ultra high definition video stream according to an embodiment of the present invention.
Detailed Description
The invention is further described with reference to the following figures and examples.
It is to be understood that the following detailed description is exemplary and is intended to provide further explanation of the invention as claimed. Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs.
It is noted that the terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of exemplary embodiments according to the invention. As used herein, the singular forms "a", "an" and "the" are intended to include the plural forms as well, and it should be understood that when the terms "comprises" and/or "comprising" are used in this specification, they specify the presence of stated features, steps, operations, devices, components, and/or combinations thereof, unless the context clearly indicates otherwise.
Example one
As shown in fig. 1, an embodiment of the present invention provides a method for transmitting an ultra high definition video stream, including the following steps:
s101: an ultra high definition video stream is received.
In specific implementation, an ultra-high-definition video stream sent by a video acquisition device is received, and the ultra-high-definition video stream is subjected to video interception, video image compression, network data transmission, video image decoding, video image rendering and display and the like and is displayed at a display end.
S102: and intercepting multi-frame video images from the ultra-high definition video stream, and performing difference recombination on pictures of adjacent frame images in the video images to obtain a difference image sequence.
The conventional image capturing usually adopts a mode of acquiring image data statically, so that the capturing speed of the ultra-high-definition video is slow. In the embodiment, the frame dynamic comparison algorithm is adopted to obtain the frame change parts of the front and rear adjacent frames so as to reduce the data amount to be processed, thereby saving the time cost of video capture and improving the video capture efficiency.
In specific implementation, two video capturing modes of a GD I window and a Di rectX are adopted to adapt to high-speed capturing of ultra-high definition video streams under different system platforms. Acquiring CPU performance load parameters and judging the acquisition method of the currently used 8K video picture by judging whether a user sets a screen capture type, wherein a Di rectX capture method is adopted under the condition that the CPU performance load parameters are below 30%, a DX capture method is adopted for capturing more than 15 frames, and a GD I window capture method is adopted under other conditions.
As an optional implementation manner, for any two adjacent frames in the video image, difference comparison is performed on pictures of the two adjacent frames in an interlaced scanning manner, and the adjacent difference line numbers are combined to obtain a difference image; a plurality of the difference images constitute a difference image sequence.
In specific implementation, the data after the picture is captured is dynamically compared (Dynami c Compare), specifically, an interlaced scanning algorithm is adopted to Compare the difference of the pictures of the front and the back adjacent frames, the comparison of the RGB data is performed through the random number of lines from 1 to 10 or the fixed number of lines, and once the algorithm has the difference, the next adjacent frame is skipped to immediately; and after the comparison of the whole image data is finished, difference recombination calculation is carried out, the line numbers of adjacent differences are merged, and finally the merged line numbers enter a difference data block queue, and the data of the difference data block queue carries out subsequent compression processing on the sequence.
S103: monitoring performance load parameters and network transmission parameters in real time, and switching corresponding coding and decoding modes according to the performance load parameters to perform image compression on the difference image sequence; and determining the data packet amount and the network transmission protocol of the compressed difference image sequence according to the network transmission parameters.
In the existing method for compressing dynamic images, the standard for fixing one codec cannot adapt to the load of different system environments, thereby generating the problem of inefficient coding. Based on this, in order to adapt to loads of different system environments, the embodiment performs image compression on the difference image sequence by detecting the performance load parameter of the local system in real time and switching the corresponding encoding and decoding modes according to the performance load parameter. Optionally, the performance load parameters include, but are not limited to, one or more of CPU occupancy, memory occupancy, and GPU occupancy; and acquiring a standard value of the performance load parameter, and determining an encoding and decoding mode for image compression according to the variation range of the monitored performance load parameter relative to the standard value. Optionally, the encoding and decoding manner includes but is not limited to one or more of jpg2000, H264, and H265.
In specific implementation, three built-in coding and decoding algorithms comprise jpg2000, H264 and H265, the load of the system environment of the computer, including the occupation of a CPU, a memory and a GPU, is continuously monitored, and dynamic switching is performed by combining the performance requirement and the coding effect characteristic of the three coding and decoding algorithms on hardware, wherein the performance requirement of the H265 on the hardware is high, and the compression rate of an image is high; the jpg2000 compressed image has higher picture quality but larger data volume; h264 is relatively well balanced.
Specifically, the system initially adopts H264 dynamic image compression, and simultaneously monitors performance load parameters including CPU occupancy rate, memory occupancy rate and GPU occupancy rate; when the picture changes are small, the occupancy rates of a CPU (Central processing Unit) and a GPU (graphics processing Unit) are small, and the picture quality is higher by switching to a jpg2000 compression algorithm under the condition that the occupancy rates exceed the standard value by 20% and float up and down; and under the condition of fluctuating by 50 percent over the standard value, switching to an H264 coding and decoding algorithm, and under the condition of better hardware parameters, adopting an H265 coding and decoding algorithm.
By the mode, the speed of the whole encoding and decoding can be improved, and the health load of the environment of the video can be kept in the 8K resolution ratio dynamic video transmission process, so that the long-term stable operation of the whole system is met.
As an optional implementation manner, the network transmission parameter includes a network bandwidth occupancy rate and a network packet loss rate; and under the condition that the network bandwidth occupancy rate is higher than a preset occupancy rate threshold value and the network packet loss rate exceeds a first preset packet loss rate threshold value, adjusting the data packet volume.
The amount of data generated by 8K resolution motion video will increase by a factor, and the amount of data transmitted will also increase by the intensity of the motion pictures. Based on this, this embodiment adopts a dynamic adaptive adjustment method for network transmission, and the method adopts dynamic monitoring of the size of the data amount of the network packet and performs algorithm adjustment of the data packet in combination with the data statistics of the packet received by the receiving end, and automatically adjusts the data packet amount of the transmitting end under the conditions that the transmission amount of the network data packet is large and the packet loss rate of the client is higher than 10%, optionally, the adjustment method of the data packet amount includes: adjust the delay time for sending data packets, and/or increase/decrease the buffer queue.
Meanwhile, when various parameters of network transmission are good, related parameters can be automatically increased, so that the dynamic video effect is smoother and clearer, multicast and unicast are combined on a network transmission protocol, multicast transmission is adopted under the conditions that the network environment and the packet loss rate are less than 5%, unicast transmission is adopted under the condition that a sending device supports high bandwidth, and the method and the device are highly suitable for the network environment of a user.
Optionally, the network transport protocol includes a multicast protocol and a unicast protocol; initially, a multicast protocol is adopted to transmit the differential image sequence, and the multicast protocol is switched to a unicast protocol under the conditions that the network packet loss rate exceeds a second preset packet loss rate threshold (for example, 10%), the duration time exceeds a preset time interval (for example, 3 seconds), or the packet loss sequence interval is frequent.
S104: and transmitting the compressed difference image sequence to a display end according to the data packet quantity and the transmission protocol.
Compared with the existing image capturing method, the method provided by the embodiment can improve the video capturing speed by about 20% on average, and the time for capturing a single 8K image picture on average can be improved by more than 10ms under the condition of not considering the video complexity. By the dynamic coding and decoding algorithm selection and the network load monitoring technology, the frame rate of 8K resolution dynamic video transmission can be kept to be 25 frames/second under a gigabit environment, and the picture quality is clear without screen splash.
Example two
An embodiment of the present invention further provides a system for transmitting an ultra high definition video stream, including:
the receiving module is used for receiving the ultra-high definition video stream;
the intercepting module is used for intercepting multi-frame video images from the ultra-high definition video stream and carrying out difference recombination on the pictures of each adjacent frame image in the video images to obtain a difference image sequence;
the compression module is used for monitoring performance load parameters and network transmission parameters in real time and switching corresponding coding and decoding modes according to the performance load parameters to perform image compression on the difference image sequence; determining the data packet amount and the transmission protocol of the compressed difference image sequence according to the network transmission parameters;
and the transmission module is used for transmitting the compressed difference image sequence to a display end according to the data packet quantity and the transmission protocol.
The transmission system for ultra high definition video stream provided in this embodiment is used to implement the foregoing transmission method for ultra high definition video stream, and therefore, specific implementation in the transmission system for ultra high definition video stream may be found in the foregoing embodiment section of the transmission method for ultra high definition video stream, and details are not repeated here.
EXAMPLE III
The embodiment of the invention also provides computer equipment, which comprises a processor, a memory and a bus. The memory stores machine-readable instructions executable by the processor, and when a computer device runs, the processor communicates with the memory through a bus, and when the machine-readable instructions are executed by the processor, the steps of the transmission method for ultra-high-definition video streams in the method embodiment shown in fig. 1 may be executed.
Example four
An embodiment of the present invention further provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the steps of the transmission method for ultra high definition video streams in the foregoing method embodiments are executed.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by a computer program, which can be stored in a computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. The storage medium may be a magnetic disk, an optical disk, a Read-only Memory (ROM), a Random Access Memory (RAM), or the like.
The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention, and various modifications and changes may be made by those skilled in the art. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims (10)

1. A method for transmitting an ultra high definition video stream, comprising:
receiving an ultra-high definition video stream;
intercepting a plurality of frames of video images from the ultrahigh-definition video stream, and performing difference recombination on pictures of each adjacent frame of image in the video images to obtain a difference image sequence;
monitoring performance load parameters and network transmission parameters in real time, and switching corresponding coding and decoding modes according to the performance load parameters to perform image compression on the difference image sequence; determining the data packet amount and the network transmission protocol of the compressed difference image sequence according to the network transmission parameters;
and transmitting the compressed difference image sequence to a display end according to the data packet quantity and the transmission protocol.
2. The transmission method of ultra high definition video stream according to claim 1, wherein for any two adjacent frames in the video image, difference comparison is performed on pictures of the two adjacent frames in an interlaced scanning manner, and the number of lines of adjacent differences is combined to obtain a difference image; a plurality of the difference images constitute a difference image sequence.
3. The method of transmitting ultra high definition video streams of claim 1, wherein the performance load parameters include, but are not limited to, one or more of CPU occupancy, memory occupancy, and GPU occupancy; and acquiring a standard value of the performance load parameter, and determining an encoding and decoding mode for image compression according to the variation range of the monitored performance load parameter relative to the standard value.
4. The method for transmitting ultra high definition video stream according to claim 3, wherein the encoding and decoding manner includes but is not limited to one or more of jpg2000, H264, and H265.
5. The transmission method of ultra high definition video stream according to claim 1, wherein the network transmission parameters include network bandwidth occupancy and network packet loss rate; and under the condition that the network bandwidth occupancy rate is higher than a preset occupancy rate threshold value and the network packet loss rate exceeds a first preset packet loss rate threshold value, adjusting the data packet quantity.
6. The transmission method for ultra high definition video streaming according to claim 5, wherein the adjusting of the amount of the data packets comprises: adjust the delay time for sending data packets, and/or increase/decrease the buffer queue.
7. The transmission method of ultra high definition video stream according to claim 5, wherein the network transmission protocol comprises a multicast protocol and a unicast protocol; and initially, transmitting the differential image sequence by adopting a multicast protocol, and switching the multicast protocol to a unicast protocol under the condition that the network packet loss rate exceeds a second preset packet loss rate threshold and the duration time exceeds a preset time interval.
8. A system for transmitting ultra high definition video streams, comprising:
the receiving module is used for receiving the ultra-high definition video stream;
the intercepting module is used for intercepting multi-frame video images from the ultra-high definition video stream and carrying out difference recombination on the pictures of each adjacent frame image in the video images to obtain a difference image sequence;
the compression module is used for monitoring performance load parameters and network transmission parameters in real time and switching corresponding coding and decoding modes according to the performance load parameters to perform image compression on the difference image sequence; determining the data packet amount and the transmission protocol of the compressed difference image sequence according to the network transmission parameters;
and the transmission module is used for transmitting the compressed difference image sequence to a display end according to the data packet quantity and the transmission protocol.
9. A computer device, comprising: processor, memory and bus, said memory storing machine-readable instructions executable by said processor, said processor and said memory communicating over the bus when a computer device is running, said machine-readable instructions when executed by said processor performing the steps of the method for transmission of ultra high definition video stream according to any one of claims 1 to 7.
10. A computer-readable storage medium, characterized in that the computer-readable storage medium has stored thereon a computer program which, when being executed by a processor, performs the steps of the method for transmission of ultra high definition video stream according to any one of claims 1 to 7.
CN202211481886.7A 2022-11-24 2022-11-24 Method and system for transmitting ultra-high-definition video stream Pending CN115883877A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202211481886.7A CN115883877A (en) 2022-11-24 2022-11-24 Method and system for transmitting ultra-high-definition video stream

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202211481886.7A CN115883877A (en) 2022-11-24 2022-11-24 Method and system for transmitting ultra-high-definition video stream

Publications (1)

Publication Number Publication Date
CN115883877A true CN115883877A (en) 2023-03-31

Family

ID=85763812

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202211481886.7A Pending CN115883877A (en) 2022-11-24 2022-11-24 Method and system for transmitting ultra-high-definition video stream

Country Status (1)

Country Link
CN (1) CN115883877A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117615175A (en) * 2023-11-24 2024-02-27 书行科技(北京)有限公司 Video playing method, device, electronic equipment and computer readable storage medium

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117615175A (en) * 2023-11-24 2024-02-27 书行科技(北京)有限公司 Video playing method, device, electronic equipment and computer readable storage medium

Similar Documents

Publication Publication Date Title
CA2737728C (en) Low latency video encoder
US10701370B2 (en) System and method for automatic encoder adjustment based on transport data
WO2021244341A1 (en) Picture coding method and apparatus, electronic device and computer readable storage medium
US10091528B2 (en) Method and system for scalable video compression and transmission
CN110769296B (en) Video code rate self-adaptive adjusting mode based on local cache during transmission
US20140233637A1 (en) Managed degradation of a video stream
CN102457544B (en) Method and system for acquiring screen image in screen sharing system based on Internet
TWI743919B (en) Video processing apparatus and processing method of video stream
CN109729437B (en) Streaming media self-adaptive transmission method, terminal and system
US20180077385A1 (en) Data, multimedia & video transmission updating system
CN105812711B (en) Optimize the method and system of picture quality in video call process
JP2005260935A (en) Method and apparatus for increasing average image refresh rate in compressed video bitstream
JP2004502356A (en) Multicast transmission system including bandwidth scaler
KR100954303B1 (en) spatial resolution control system for video applications and transmission control method for video applications using the spatial resolution control system
CN107333143B (en) 5G multi-access concurrent transmission control system and method
CN107743252A (en) A kind of method for reducing live delay
CN109168041B (en) Mobile terminal monitoring method and system
CN115883877A (en) Method and system for transmitting ultra-high-definition video stream
CN104320716A (en) A video uplink transmission method based on collaborative multiple terminals
AU2019201095A1 (en) System and method for automatic encoder adjustment based on transport data
CN112468764B (en) Method, system, server and storage medium for streaming media adaptive transmission
Li et al. A joint optimization method of coding and transmission for conversational HD video service
CN116962613A (en) Data transmission method and device, computer equipment and storage medium
WO2010062471A2 (en) Methods and systems for improving network response during channel change
CN105306970B (en) A kind of control method and device of live streaming media transmission speed

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination