CN116634089A

CN116634089A - Video transmission method, device, equipment and storage medium

Info

Publication number: CN116634089A
Application number: CN202310912151.3A
Authority: CN
Inventors: 张贞雷; 李拓; 邹晓峰; 满宏涛; 刘刚; 刘凯
Original assignee: Suzhou Inspur Intelligent Technology Co Ltd
Current assignee: Suzhou Inspur Intelligent Technology Co Ltd
Priority date: 2023-07-24
Filing date: 2023-07-24
Publication date: 2023-08-22
Anticipated expiration: 2043-07-24
Also published as: CN116634089B

Abstract

The invention relates to the technical field of video transmission and discloses a video transmission method, a system, a device, equipment and a storage medium; determining a transmission mode of a current image frame in the video based on the non-video function bandwidth duty ratio; processing the current image frame based on the transmission mode to obtain current storage data; and writing the current storage data into a video function storage space in the chip to transmit video through the video function storage space. Therefore, a proper video transmission mode can be selected according to the current bandwidth occupation condition of the chip, and the performance of the chip is ensured while the chip resources are fully utilized.

Description

Video transmission method, device, equipment and storage medium

Technical Field

The present invention relates to the field of video transmission technologies, and in particular, to a video transmission method, apparatus, device, and storage medium.

Background

There are two output formats of the video function in the conventional baseboard management control chip, one is compressed video data, and the other is YUV video data. The compressed video data can reduce the data volume of the video and reduce the data volume of network transmission, but has larger transmission delay, and the video display effect has larger difference with the original video due to the compression of the data; the YUV video data is fast in transmission and good in display effect, but occupies relatively large network bandwidth and storage space. When a user selects a transmission mode of video data, the specific condition of chip operation is not known, and the situation that YUV video data transmission is selected when network bandwidth is occupied in a large amount, so that the performance of the chip is reduced can occur; or the compressed video data transmission is selected when the chip network function is idle, so that the selected video output format cannot fully utilize the chip resources.

Disclosure of Invention

In view of the above, the present invention provides a video transmission method, apparatus, device and storage medium, so as to solve the problem that the chip performance is reduced or the chip resources cannot be fully utilized due to unreasonable selection of video data transmission modes.

In a first aspect, the present invention provides a video transmission method, the method comprising:

acquiring a read parameter of a non-video function storage space in a chip, and determining a non-video function bandwidth ratio based on the read parameter;

determining a transmission mode of a current image frame in the video based on the non-video function bandwidth duty ratio;

processing the current image frame based on the transmission mode to obtain current storage data;

and writing the current storage data into a video function storage space in the chip to transmit video through the video function storage space.

Therefore, a proper video transmission mode can be selected according to the current bandwidth occupation condition of the chip, and the performance of the chip is ensured while the chip resources are fully utilized.

In an alternative embodiment, acquiring the read parameters of the non-video function memory space in the chip and determining the non-video function bandwidth duty cycle based on the read parameters includes:

Acquiring the reading times of a non-video function storage space in a first preset time;

based on the first preset time and the reading times, determining the network bandwidth occupied by the storage space with the non-video function;

and determining the non-video function bandwidth duty ratio based on the network bandwidth occupied by the non-video function storage space and the total network bandwidth.

acquiring a reading parameter every second preset time, and determining a non-video function bandwidth ratio corresponding to the reading parameter to obtain a non-video function bandwidth ratio of preset statistics times;

and calculating an average value of the non-video function bandwidth duty ratio of the preset statistics times, and taking the average value as the non-video function bandwidth duty ratio.

Therefore, the non-video function bandwidth occupation ratio is calculated for a plurality of times and averaged, so that the finally obtained non-video function bandwidth occupation ratio can fully represent the current bandwidth use condition of the chip, and a proper transmission mode can be selected according to the non-video function bandwidth occupation ratio.

In an alternative embodiment, determining a transmission mode of a current image frame in video based on a non-video functional bandwidth duty cycle includes:

When the non-video function bandwidth ratio is larger than a first threshold value, determining that the transmission mode is a compression transmission mode;

and when the non-video function bandwidth duty ratio is smaller than or equal to a first threshold value, determining that the transmission mode is a coding transmission mode.

Therefore, a proper transmission mode can be selected according to the non-video function bandwidth ratio, when the non-video function bandwidth ratio is relatively large, a compression transmission mode is adopted, the chip performance is prevented from being reduced, and when the non-video function bandwidth ratio is relatively small, an encoding transmission mode is adopted, and the chip resources are fully utilized.

In an alternative embodiment, when the non-video function bandwidth duty cycle is less than or equal to a first threshold, determining that the transmission mode is an encoded transmission mode includes:

when the non-video function bandwidth duty ratio is smaller than or equal to a first threshold value and larger than a second threshold value, determining the type of the coding transmission mode as a first coding transmission mode;

when the non-video function bandwidth duty ratio is smaller than or equal to a second threshold value and is larger than a third threshold value, determining the type of the coding transmission mode as a second coding transmission mode; the data duty ratio of the brightness type data in the first coding transmission mode is larger than the data duty ratio of the brightness type data in the second coding transmission mode;

When the non-video function bandwidth duty ratio is smaller than or equal to a third threshold value, determining the type of the coding transmission mode as a third coding transmission mode; the data of the luminance type data in the second encoding transmission mode is larger than the data duty ratio of the luminance type data in the third encoding transmission mode.

In this manner, the type of encoded transmission mode employed may be further determined based on the non-video functional bandwidth ratio.

In an alternative embodiment, processing the current image frame based on the transmission mode to obtain the current stored data includes:

when the transmission mode is a coding transmission mode, determining the type of the coding transmission mode corresponding to the current writing line; the current write line is located in the current image frame;

and processing the current writing line based on the type of the coding transmission mode to obtain the current storage data corresponding to the current writing line.

In an alternative embodiment, determining the type of encoded transmission mode corresponding to the current write line includes:

obtaining the residual storage space of the target storage space; the target storage space is used for storing current storage data;

based on the remaining memory space, a type of encoded transmission mode is determined.

Therefore, the type of the coding transmission mode can be determined according to the residual storage space before each row of data is written, and the written current storage data is determined according to the corresponding type, so that the type of the coding transmission mode is dynamically adjusted to ensure that the current storage data can be completely written.

In an alternative embodiment, determining the current stored data corresponding to the current write line based on the type of the encoded transmission mode includes:

when the type of the coding transmission mode is the first coding transmission mode, determining that the current stored data in even lines and even columns of the current image frame are brightness type data and the first color type data or the second color type data, and determining that the current stored data in non-even lines and even columns of the current image frame are brightness type data; the pixel data includes brightness type data, first color type data, and second color type data; the pixel data is data contained in pixels of an image frame in a video.

In an alternative embodiment, determining the current stored data corresponding to the current write line based on the type of the encoded transmission mode further includes:

when the type of the encoding transmission model is the second encoding transmission mode, determining that the current stored data in the even columns of the current image frame are brightness type data and the first color type data or the second color type data, and determining that the current stored data in the odd columns of the current image frame are brightness type data.

When the type of the encoding transmission mode is the third encoding transmission mode, the pixel data is used as the current storage data.

In an alternative embodiment, the processing is performed on the current image frame based on the transmission mode to obtain the current stored data, and the method further includes:

when the type of the coding transmission mode corresponding to the current writing line is different from the type of the coding transmission mode corresponding to the historical writing line, determining and transmitting type switching information of the current writing line based on the type of the coding transmission mode corresponding to the current writing line and the line number of the current writing line; the type switching information is used for restoring and obtaining the current image frame based on the current stored data.

In this way, the type of the coding transmission mode and the type of the coding transmission mode switched at which rows in the current storage data can be characterized through the type switching information, so that the current storage data can be restored based on the type switching information.

In an alternative embodiment, the processing of the pixel data in the current image frame based on the transmission mode to obtain the current stored data further comprises:

when the transmission mode is a coding transmission mode, dividing the target storage space into a first preset number of sub-storage spaces;

Based on the coding transmission mode, the current storage data is written into the sub storage space corresponding to the current writing line.

In an alternative embodiment, the processing of the current image frame based on the transmission mode to obtain the current stored data further comprises:

and determining the state information of the current writing line based on the line number of the current writing line and the sub storage space corresponding to the current writing line.

In an alternative embodiment, writing the currently stored data to the video function storage space includes:

acquiring state information of a current writing line;

based on the state information, current storage data corresponding to the current writing line is read from the sub storage space corresponding to the current writing line, and is written into the video function storage space.

when the transmission mode is a compression transmission mode, dividing the target storage space into a second preset number of sub-storage spaces;

based on the compressed transmission mode, the brightness type data, the first color type data and the second color type data are respectively written into the corresponding sub-storage spaces.

Based on the compressed transmission mode, respectively reading brightness type data, first color type data and second color type data from the sub-storage space to obtain compressed pixel data;

compressing the compressed pixel data, taking the compressed pixel data as current storage data, and writing the current storage data into a video function storage space.

In an alternative embodiment, the encoded transmission mode and the compressed transmission mode share a target storage space; the method further comprises the steps of:

when the transmission mode is switched from the coding transmission mode to the compression transmission mode, dividing each sub-storage space in the first preset number of sub-storage spaces into a third preset number of sub-storage spaces to obtain a second preset number of sub-storage spaces;

when the transmission mode is switched from the compression transmission mode to the coding transmission mode, every third preset number of sub-storage spaces in the second preset number of sub-storage spaces are used as one sub-storage space, so that the first preset number of sub-storage spaces are obtained.

Therefore, the multiplexing of the target storage space under different transmission modes is realized by repartitioning the sub-storage space in the target storage space, so that the storage space of a chip is saved.

In a second aspect, the present invention provides a video transmission apparatus, comprising:

the non-video function bandwidth duty ratio determining module is used for acquiring the reading parameters of the non-video function storage space in the chip and determining the non-video function bandwidth duty ratio based on the reading parameters;

the transmission mode determining module is used for determining the transmission mode of the current image frame in the video based on the non-video function bandwidth duty ratio;

the current storage data determining module is used for processing the current image frame based on the transmission mode to obtain current storage data;

and the video transmission module is used for writing the current stored data into the video function storage space in the chip so as to transmit video through the video function storage space.

In a third aspect, the present invention provides a computer device comprising: the video transmission system comprises a memory and a processor, wherein the memory and the processor are in communication connection, the memory stores computer instructions, and the processor executes the computer instructions, so that the video transmission method of the first aspect or any implementation mode corresponding to the first aspect is executed.

In a fourth aspect, the present invention provides a computer-readable storage medium having stored thereon computer instructions for causing a computer to perform the video transmission method of the first aspect or any of its corresponding embodiments.

Drawings

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings that are needed in the description of the embodiments or the prior art will be briefly described, and it is obvious that the drawings in the description below are some embodiments of the present invention, and other drawings can be obtained according to the drawings without inventive effort for a person skilled in the art.

Fig. 1 is a flow chart of a video transmission method according to an embodiment of the present invention;

fig. 2 is a flow chart of a video transmission method according to an embodiment of the present invention;

fig. 3 is a flow chart of a video transmission method according to an embodiment of the present invention;

fig. 4 is a flow chart of a video transmission method according to an embodiment of the present invention;

fig. 5 is a flow chart of a video transmission method according to an embodiment of the present invention;

fig. 6 is a schematic structural diagram of a video transmission system according to an embodiment of the present invention;

fig. 7 is a schematic diagram of a data conversion module of a video transmission system according to an embodiment of the present invention;

fig. 8 is a schematic diagram of a related art video transmission system;

fig. 9 is a schematic diagram of a data conversion module of a related art video transmission system;

Fig. 10 is a block diagram of a video transmission apparatus according to an embodiment of the present invention;

FIG. 11 is a schematic diagram of the hardware architecture of a computer device according to an embodiment of the present invention;

reference numerals are further described below:

601-a transmission mode determination module; 602-a data conversion module; 6021-memory space dividing unit; 6022-storage space unit; 6023-read-write control unit; 603-a network module; 604-a video data storage module; 605-video compression module.

Detailed Description

For the purpose of making the objects, technical solutions and advantages of the embodiments of the present invention more apparent, the technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention, and it is apparent that the described embodiments are some embodiments of the present invention, but not all embodiments of the present invention. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.

In the related art, video transmission formats based on the baseboard management control chip generally include two types of compressed video data and YUV video data. The transmission mode based on the compressed video data is that the video data is formed into a displayable video image through a VGA (Video Graphics Array, video graphic array) interface, then the video data is compressed after being subjected to data conversion through a DVI interface (Digital Visual Interface, digital video interface), the compressed video data is written into a memory, then the video data is transmitted to a remote end through a network by an Ethernet module, and software of the remote end firstly performs decompression operation on the received video data and then displays the video data. The transmission mode based on the compressed video data has the advantage of small data volume, but simultaneously has the problems of large delay and poor video display effect caused by the compression and decompression processes due to the compression of the video data. YUV video data is video data based on color coding, in which Y represents luminance, that is, gray values, U and V represent chromaticity, describing the color and saturation of a pixel, that is, defining the color of the pixel; the transmission mode based on YUV video data is that video data in RGB format output by DVI interface is converted into video data in YUV format through color space, and written into memory, and then transmitted to remote end through network by Ethernet module, software of remote end displays received video data directly. The transmission mode based on YUV video data has the advantages of quick transmission and good video display effect, but also has the problems of large data volume, large occupied network bandwidth and large storage space.

Meanwhile, in the related technology, the video transmission mode is often selected by a user, the specific operation condition of the chip is not known when the user selects, so that the video transmission mode has randomness in selection, or the corresponding transmission mode is selected only according to the own requirement of the user, and the operation condition of the chip is ignored, so that the problems of the selection of the video transmission mode and the non-adaptation of the operation condition of the chip are caused, the YUV video data transmission is selected when the network bandwidth of the chip is occupied in a large amount, and the performance of the chip is reduced; or selecting compressed video data for transmission when the network function of the chip is idle, so that the selected video output format cannot fully utilize the chip resources.

Based on the above, the embodiment of the invention provides a video transmission method, which not only can be used for video transmission of a baseboard management controller, but also can be used for video transmission of any other chip. Specifically, the method acquires a read parameter of a non-video function storage space in a chip, and determines a non-video function bandwidth ratio based on the read parameter; determining a transmission mode of a current image frame in the video based on the non-video function bandwidth duty ratio; processing the current image frame based on the transmission mode to obtain current storage data; and writing the current storage data into a video function storage space in the chip to transmit video through the video function storage space. Therefore, a proper video transmission mode can be selected according to the current bandwidth occupation condition of the chip, and the performance of the chip is ensured while the chip resources are fully utilized.

In accordance with an embodiment of the present invention, there is provided a video transmission method embodiment, it being noted that the steps shown in the flowchart of the figures may be performed in a computer system such as a set of computer executable instructions, and, although a logical order is shown in the flowchart, in some cases, the steps shown or described may be performed in an order other than that shown or described herein.

In this embodiment, a video transmission method is provided, which may be used for data transmission of the above chip, and fig. 1 is a flowchart of a video transmission method according to an embodiment of the present invention, as shown in fig. 1, where the flowchart includes the following steps:

step S101, acquiring reading parameters of a non-video function storage space in a video function storage space chip, and determining the non-video function bandwidth ratio based on the reading parameters.

In the embodiment of the invention, the memory space of the chip can be divided into a video function memory space and a non-video function memory space. The video function storage space is a memory which is independently divided from the storage space of the chip and used for storing video data, and the non-video function storage space is a memory which is used for removing the video function storage space from the storage space of the chip and used for storing and processing data of related functions of the non-video function.

In the embodiment of the invention, the read parameters of the non-video function storage space are obtained to determine the non-video function bandwidth ratio, so that the ratio of the network bandwidth occupied by the chip in the non-video data transmission to the total bandwidth is determined, and the network bandwidth ratio which can be allocated to the video data transmission by the chip is determined.

Step S102, based on the non-video function bandwidth duty ratio, determining the transmission mode of the current image frame in the video.

In the embodiment of the invention, the network bandwidth duty ratio which can be allocated to the video data transmission by the chip can be determined based on the non-video function bandwidth duty ratio, so that the transmission mode of the video data can be determined based on the network bandwidth duty ratio which can be allocated to the video data transmission by the chip.

In the embodiment of the invention, since the video is actually composed of multiple frames of pictures, the transmission of the video data is actually the transmission of the picture data in the video. In order to ensure that the transmission mode of each frame of picture can be adapted to the current running condition of the chip in the video transmission process, the transmission mode of the picture is confirmed before each frame of picture is transmitted, namely, the transmission mode of the current image frame in the video is continuously determined in the data transmission process, and the current image frame is the picture which needs to be transmitted currently.

Step S103, processing the current image frame based on the transmission mode to obtain the current storage data.

In the embodiment of the present invention, the transmission modes are divided into a compression transmission mode and a texture transmission mode. The data is compressed in the compressed transmission mode to obtain the current stored data; the texture transmission mode is to convert data into YUV format as the current stored data.

Step S104, the current storage data is written into the video function storage space in the chip to transmit video through the video function storage space.

Different from the related art, the compressed transmission mode and the texture transmission mode adopt different storage spaces to store the processed video data, in the embodiment of the invention, the different transmission modes, namely the compressed transmission mode and the texture transmission mode, adopt the same video function storage space to store the current stored data, thereby realizing the full utilization of the storage space of a chip, and avoiding the condition that the storage space corresponding to one transmission mode is in an idle state when the video is transmitted by adopting the other transmission mode.

According to the video transmission method provided by the embodiment, the proper video transmission mode is selected according to the current bandwidth occupation condition of the chip, so that the selected video data transmission mode is adapted to the running condition of the chip, and the performance of the chip is ensured while the chip resources are fully utilized.

In this embodiment, a video transmission method is provided, which may be used for data transmission of the above chip, and fig. 2 is a flowchart of a video transmission method according to an embodiment of the present invention, as shown in fig. 2, where the flowchart includes the following steps:

step S201, obtaining the read parameter of the non-video function storage space in the chip, and determining the non-video function bandwidth ratio based on the read parameter.

Specifically, step S201 includes:

step 2011, obtaining the number of times of reading the non-video function storage space within a first preset time.

In the embodiment of the invention, the non-video function storage space can be read by using the bus through the network module, so that the reading times of the non-video function storage space in the first preset time are obtained.

Step S2012, determining the network bandwidth occupied by the non-video function storage space based on the first preset time and the number of readings.

In the embodiment of the invention, the total data volume for the non-video function in the first preset time can be obtained by multiplying the reading times of the non-video function storage space and the bit width of the chip bus, and then the total data volume is divided by the first preset time, so that the data volume for the non-video function transmission in the unit time, namely the network bandwidth occupied by the non-video function storage space, can be obtained.

Step S2013, determining the non-video function bandwidth duty ratio based on the network bandwidth occupied by the non-video function storage space and the total network bandwidth.

In the embodiment of the invention, the network bandwidth occupied by the non-video function storage space is divided by the total network bandwidth, so that the non-video function bandwidth duty ratio can be obtained. Typically, the network of baseboard management controllers is a gigabit network, i.e., 1000Mb/s bandwidth.

In an alternative embodiment, in step S201, a process of calculating the non-video function bandwidth ratio for averaging is included multiple times, specifically as follows:

step a1, acquiring a reading parameter every second preset time, and determining a non-video function bandwidth ratio corresponding to the reading parameter to obtain the non-video function bandwidth ratio of the preset statistics.

And a2, calculating an average value of the non-video function bandwidth duty ratio of the preset statistics times, and taking the average value as the non-video function bandwidth duty ratio.

And (c) counting the non-video function bandwidth duty ratio of the preset statistics times, averaging the non-video function bandwidth duty ratio, and taking the average value as the non-video function bandwidth duty ratio, so that the finally obtained non-video function bandwidth duty ratio can fully represent the current bandwidth use condition of the chip, and a proper transmission mode can be selected according to the non-video function bandwidth duty ratio.

Step S202, based on the non-video function bandwidth duty ratio, determining the transmission mode of the current image frame in the video. Please refer to step S102 in the embodiment shown in fig. 1 in detail, which is not described herein.

Step S203, processing the current image frame based on the transmission mode to obtain the current stored data. Please refer to step S103 in the embodiment shown in fig. 1 in detail, which is not described herein.

In step S204, the current stored data is written into the video function storage space in the chip to transmit video through the video function storage space. Please refer to step S104 in the embodiment shown in fig. 1 in detail, which is not described herein.

In this embodiment, a video transmission method is provided, which may be used for data transmission of the above chip, and fig. 3 is a flowchart of a video transmission method according to an embodiment of the present invention, as shown in fig. 3, where the flowchart includes the following steps:

step S301, obtaining the read parameters of the non-video function storage space in the chip, and determining the non-video function bandwidth ratio based on the read parameters. Please refer to step S101 in the embodiment shown in fig. 1 in detail, which is not described herein.

Step S302, determining a transmission mode of a current image frame in the video based on the non-video function bandwidth duty ratio.

Specifically, step S302 includes:

in step S3021, when the non-video function bandwidth ratio is greater than the first threshold, the transmission mode is determined to be the compressed transmission mode.

In the embodiment of the invention, when the bandwidth ratio of the non-video function is larger than the first threshold, the bandwidth allocated to the non-video function by the chip bandwidth is larger, the non-video bandwidth occupies larger network bandwidth, and the chip is not suitable for directly transmitting video data in YUV format, otherwise, the performance of the chip is reduced, so that the compressed video data is selected, namely, the transmission mode is determined to be the compressed transmission mode.

In step S3022, when the non-video function bandwidth duty is less than or equal to the first threshold, the transmission mode is determined to be the encoding transmission mode.

In the embodiment of the invention, when the bandwidth ratio of the non-video function is smaller than or equal to the first threshold value, the bandwidth allocated to the non-video function by the chip bandwidth is indicated to be smaller, and the network bandwidth occupied by the non-video bandwidth is smaller, so that the waste of chip resources and performance can be caused by transmitting compressed video data at the moment, and the video data in YUV format is selected, namely, the transmission mode is determined to be the coding transmission mode, so that the chip resources are fully utilized, and the video display effect is improved.

In an alternative embodiment, in the steps S3021 to S3022, the transmission mode may be determined by further calculating the available bandwidth ratio with the non-video function bandwidth ratio as the parameter for determining the transmission mode. That is, after the non-video function bandwidth duty ratio is obtained by calculation, subtracting the non-video function bandwidth duty ratio from the preset bandwidth duty ratio to obtain an available bandwidth duty ratio, and determining a transmission mode according to the size of the available bandwidth duty ratio; specifically, when the available bandwidth duty ratio is smaller than a certain value, the transmission mode is determined to be a compressed transmission mode, and when the available bandwidth duty ratio is larger than a certain value, the transmission mode is determined to be an encoded transmission mode.

In an alternative embodiment, the preset bandwidth duty cycle is a value less than or equal to 1, and the portion of the duty cycle that is different from 1 may be used as the reserved bandwidth duty cycle, so as to prevent a data transmission burst.

In an alternative embodiment, the coding transmission modes may be further classified into three types, and when the non-video function bandwidth ratio is less than or equal to the first threshold, and the transmission mode is determined to be the coding transmission mode, the type of the coding transmission mode may be further determined according to the size of the non-video function bandwidth ratio, and the specific determination method is as follows:

First case: and when the non-video function bandwidth duty ratio is smaller than or equal to a first threshold value and larger than a second threshold value, determining the type of the coding transmission mode as a first coding transmission mode. The first coding transmission mode is a YUV420 mode, as described above, in the YUV format, Y represents brightness, i.e. a gray value, is brightness type data, U and V represent colors, and are respectively first color type data and second color type data. YUV420 mode, i.e. a set of UV components is shared by 4Y components, i.e. 4 pixels. In three common YUV modes, namely a YUV420 mode, a YUV422 mode and a YUV444 mode, the data volume corresponding to the mode is the smallest, and when the bandwidth ratio of the non-video function is smaller than or equal to a first threshold value and larger than a second threshold value, the mode is selected to achieve a better video display effect with smaller data volume.

Second case: and when the non-video function bandwidth duty ratio is smaller than or equal to the second threshold value and is larger than the third threshold value, determining the type of the coding transmission mode as a second coding transmission mode. The second coding mode is YUV422 mode, i.e. 2Y components share a set of UV components, i.e. 2 pixels share a set of UV components. Compared with the YUV420 mode, the Y component in the YUV422 mode, namely the data duty ratio of the brightness type data is lower, the data volume of the YUV422 mode is larger, the video display effect is better, and the mode can be selected under the condition that the bandwidth duty ratio of the non-video function is smaller than or equal to a second threshold value and larger than a third threshold value and the available bandwidth of the video function is further increased.

And/or, a third case: and when the non-video function bandwidth duty ratio is smaller than or equal to a third threshold value, determining the type of the coding transmission mode as a third coding transmission mode. The third coding transmission mode is a YUV444 mode, that is, the Y component, the U component and the V component of the pixel are fully reserved, and the U component and the V component are not shared between different pixels. The YUV444 mode fully reserves all data of each pixel point, the data proportion of brightness type data in the three types is the lowest, the video display effect is the best, the network bandwidth and the storage space required by the data are the largest, and the mode can be selected under the condition that the non-video function bandwidth proportion is smaller than or equal to a third threshold value.

By the method, the type of the adopted coding transmission mode is further determined according to the non-video function bandwidth ratio, the proper type of the coding transmission mode is selected under the corresponding non-video function bandwidth ratio, and the final video display effect is ensured under the condition that the network bandwidth is enough for video data transmission.

Step S303, processing the current image frame based on the transmission mode to obtain the current storage data. Please refer to step S103 in the embodiment shown in fig. 1 in detail, which is not described herein.

Step S304, the current storage data is written into the video function storage space in the chip to transmit video through the video function storage space. Please refer to step S104 in the embodiment shown in fig. 1 in detail, which is not described herein.

According to the video transmission method provided by the embodiment, a proper transmission mode is selected according to the non-video function bandwidth ratio, when the non-video function bandwidth ratio is relatively large, a compression transmission mode is adopted, the chip performance is prevented from being reduced, and when the non-video function bandwidth ratio is relatively small, an encoding transmission mode is adopted, and the chip resources are fully utilized.

In this embodiment, a video transmission method is provided, which may be used for data transmission of the above chip, and fig. 4 is a flowchart of a video transmission method according to an embodiment of the present invention, as shown in fig. 4, where the flowchart includes the following steps:

Step S401, obtaining the read parameter of the non-video function storage space in the chip, and determining the non-video function bandwidth ratio based on the read parameter. Please refer to step S101 in the embodiment shown in fig. 1 in detail, which is not described herein.

Step S402, determining a transmission mode of a current image frame in the video based on the non-video function bandwidth duty ratio. Please refer to step S102 in the embodiment shown in fig. 1 in detail, which is not described herein.

Step S403, processing the current image frame based on the transmission mode to obtain the current stored data.

Specifically, step S403 includes:

in step S4031, when the transmission mode is the encoding transmission mode, the type of the encoding transmission mode corresponding to the current writing line is determined.

In an alternative embodiment, the step S4031 may include:

and b1, acquiring the residual storage space of the target storage space corresponding to the current writing line.

And b2, determining the type of the coding transmission mode based on the residual storage space.

In the embodiment of the present invention, the current writing line is located in the current image frame. Since video is composed of multiple frames of pictures, video transmission actually transmits the pictures that compose it, and picture transmission transmits the data of the pixels that it contains. In the process of transmitting a picture, a line is generally used as a basic transmission unit, and data of a row of pixels in a frame of picture is transmitted at a time. Therefore, in order to ensure that the data to be written in each time can be written in the target storage space, before the data is written in, the data to be written in currently, that is, the remaining storage space of the target storage space corresponding to the current writing line, is acquired, and the type of the coding transmission mode is determined based on the size of the remaining storage space. Specifically, when the remaining storage space can write all data in the third coding transmission mode, determining the type of the coding transmission mode as the third coding transmission mode; and when the residual storage space cannot be written with all the data in the third coding transmission mode, further judging that the residual storage space can be written with all the data in the second coding transmission mode, if so, determining that the type of the coding transmission mode is the second coding transmission mode, and if not, determining that the type of the coding transmission mode is the first coding transmission mode. Therefore, before each row of data is written, the type of the coding transmission mode is determined according to the residual storage space, and the written current storage data is determined according to the corresponding type, so that the type of the coding transmission mode is dynamically adjusted, and the current storage data can be completely written. That is, after the transmission mode of the current image frame and the type of the transmission mode are determined through the non-video function bandwidth ratio, before writing data of a row of pixels in the data transmission process of the current image frame, the type of the coding transmission mode corresponding to the current writing row is further selected again according to the remaining storage space of the target storage space, and through two decisions, the data in the current image frame is fully reserved under the condition that the performance of the chip is not affected, and the final video display effect is ensured.

Step S4032, based on the type of the encoding transmission mode, the current writing line is processed to obtain the current storage data corresponding to the current writing line.

In the embodiment of the invention, according to different types of coding transmission modes, the current storage data corresponding to the current writing line is also different, and the method is specifically shown as follows; the pixel data is data contained in pixels of an image frame in a video, namely original data of a pixel point in a YUV mode, and the original data comprises brightness type data, first color type data and second color type data, wherein the brightness type data corresponds to data of a Y component, the first color type data corresponds to data of a U component, and the second color type data corresponds to data of a V component:

when the type of the coding transmission mode is the first coding transmission mode, determining the current stored data in even numbered rows and even numbered columns of the current image frame as brightness type data and the first color type data or the second color type data, and determining the current stored data in non-even numbered rows and even numbered columns of the current image frame as brightness type data. The first encoding transmission mode, namely YUV420 mode, has 4Y components sharing one set of UV components, i.e. 4 pixels sharing one set of UV components. Then, in YUV420 mode, the reserved data are all Y components, and the U components or V components located in even rows and even columns in the current image, based on which only the current stored data of even rows and even columns in the current image frame are reserved for components representing colors, i.e. the current stored data of even rows and even columns are luminance type data and first color type data or second color type data, and the current stored data of non-even rows and even columns are reserved for only luminance type data, i.e. the current stored data of non-even rows and even columns are luminance type data.

When the type of the encoding transmission model is the second encoding transmission mode, determining that the current stored data in the even columns of the current image frame are brightness type data and the first color type data or the second color type data, and determining that the current stored data in the odd columns of the current image frame are brightness type data. The second encoding transmission mode, namely YUV422 mode, has 2Y components sharing one set of UV components, i.e. 2 pixels sharing one set of UV components. Then, in YUV422 mode, the retained data is all Y components, and either the U components or Y components located in even columns in the current image. Based on this, only the current stored data of even columns in the current image frame retains the component representing the color, i.e., the current stored data of even columns is luminance type data and either the first color type data or the second color type data, while the current stored data of even columns retains only the luminance type data, i.e., the current stored data of non-even columns is luminance type data.

When the type of the encoding transmission mode is the third encoding transmission mode, the pixel data is used as the current storage data. The third coding transmission mode, namely the YUV444 mode, fully reserves the Y component, the U component and the V component of the pixel, and does not share the U component and the V component among different pixels. Based on this, the currently stored data retains all of the pixel data, i.e., the pixel data as the currently stored data.

As an alternative implementation manner, in order to ensure that the current storage data fully samples the current image frame or the data in the current writing line, so that the finally obtained current storage data can fully embody the color information of the current image frame or the current writing line, when the type of the coding transmission mode is the first coding transmission mode or the second coding transmission mode, the color components reserved in the current storage data, namely the first color type data or the second color type data, are reserved according to the mode of sampling the first color type data and the second color type data at intervals, when the second coding transmission mode is taken as an example, the first current storage data of even columns is the brightness type data and the first color type data, the second current storage data is the brightness type data and the second color type data, the third current storage data is the brightness type data and the first color type data, the fourth current storage data is the brightness type data and the second color type data, and so on, and interval sampling is performed.

In an alternative embodiment, step S403 may further include the following steps:

when the transmission mode is a coding transmission mode, dividing the target storage space into a first preset number of sub-storage spaces; and writing the current storage data into the sub storage space corresponding to the current writing line according to the coding transmission mode.

In an alternative embodiment, step S403 may further include the following steps: and determining the state information of the current writing line based on the line number of the current writing line and the sub storage space corresponding to the current writing line. Therefore, according to the state information, the sub-storage space from which the data needs to be read can be reversely determined, so that the data can be read according to the arrangement sequence of the rows of each frame of picture in the video, and the pictures in the video can be restored. Specifically, the state information may be { Line num, RAM num, data cnt }, where Line num is a Line number of a current writing Line, that is, a Line of the current writing Line in a picture where the Line is located, RAM num is information of a sub-storage space corresponding to the current writing Line, which is used to determine, specifically, which sub-storage space, and data cnt is a total data amount contained in the current writing Line, which is used to determine a data amount to be read when reading the current writing Line.

In an alternative embodiment, step S403 may further include: when the type of the coding transmission mode corresponding to the current writing line is different from the type of the coding transmission mode corresponding to the historical writing line, determining and transmitting the type switching information of the current writing line based on the type of the coding transmission mode corresponding to the current writing line and the line number of the current writing line. The type switching information is used for restoring and obtaining the current image frame based on the current stored data. Since the types of the different encoded transmission modes are different, the method used in the data recovery is also different, so when the type of the encoded transmission mode of the current write line is changed compared with the type of the history write line, a type switching message needs to be generated to indicate that a new data recovery method is used here in the data recovery. Specifically, the type switching information may be a format { FFFF, line num, YUV Mode }, where FFFF is used as a key of the identifier to indicate that the type switching is generated, line num identifies a line number of a currently written line, indicates that the type switching occurs at the line, and YUV Mode identifies the type after the switching, specifically may identify the first coding transmission Mode with 0, identify the second coding transmission Mode with 1, and identify the third coding transmission Mode with 2. Therefore, the type of the coding transmission mode and the type of the coding transmission mode switched at which rows in the current storage data are characterized by the type switching information, so that the current storage data can be restored based on the type switching information.

In an alternative embodiment, when the current storage data is restored, when the current storage data corresponding to the type switching information is restored, the data of the last row corresponding to the row is reserved, and the restoration is performed according to the type of the coding transmission mode indicated by the type switching information. Specifically, when the type of the coding transmission mode indicated by the type switching information is the first coding transmission mode, if the row is an odd row, the first color type data and the second color type data of the previous row corresponding to the row are adopted to supplement the first color type data and the second color type data of the row; if the row is an even row, the data of the row adjacent to the row is used for supplementing the data of the position when the row is restored to the data of the even column, and the data of the row adjacent to the row is used for supplementing the data of the position when the row is restored to the data of the odd column. When the type of the coding transmission mode indicated by the type switching information is the second coding transmission mode, when the data of the odd columns are restored, the data of the even columns adjacent to the position are adopted to supplement the data at the position, and when the data of the even columns are restored, the data of the last row adjacent to the position are adopted to supplement the data at the position.

Step S404, the current storage data is written into the video function storage space in the chip to transmit video through the video function storage space.

Specifically, step S404 includes:

in step S4041, the state information of the current write line is acquired.

According to the embodiment of the invention, according to the state information, which sub-storage space needs to be read data can be reversely determined, so that the data can be read according to the arrangement sequence of the rows of each frame of picture in the video, and the pictures in the video can be restored. Specifically, the state information may be { Line num, RAM num, data cnt }, where Line num is a Line number of a current writing Line, that is, a Line of the current writing Line in a picture where the Line is located, RAM num is information of a sub-storage space corresponding to the current writing Line, which is used to determine, specifically, which sub-storage space, and data cnt is a total data amount contained in the current writing Line, which is used to determine a data amount to be read when reading the current writing Line.

Step S4042, based on the state information, reads the current storage data corresponding to the current writing line from the sub-storage space corresponding to the current writing line, and writes the current storage data into the video function storage space.

According to the embodiment of the invention, according to the state information, the current storage data corresponding to each row are sequentially read from the corresponding sub-storage space according to the sequence of the pictures in the video and the sequence of the rows in the pictures, and written into the video function storage space, so that the network module can conveniently read the current storage data from the video function storage space and send the current storage data to a remote end or a client end.

According to the video transmission method provided by the embodiment, in the encoding transmission mode, the processing mode of the data written in the rows can be dynamically adjusted according to the residual storage space of the storage space, so that the final video display effect is ensured under the condition that the data can be completely written in.

In this embodiment, a video transmission method is provided, which may be used for data transmission of the above chip, and fig. 5 is a flowchart of a video transmission method according to an embodiment of the present invention, as shown in fig. 5, where the flowchart includes the following steps:

step S501, obtaining the read parameters of the non-video function storage space in the chip, and determining the non-video function bandwidth duty ratio based on the read parameters. Please refer to step S101 in the embodiment shown in fig. 1 in detail, which is not described herein.

Step S502, determining a transmission mode of a current image frame in the video based on the non-video function bandwidth duty ratio. Please refer to step S102 in the embodiment shown in fig. 1 in detail, which is not described herein.

Step S503, processing the current image frame based on the transmission mode to obtain the current stored data.

Specifically, step S503 includes:

in step S5031, when the transmission mode is the compressed transmission mode, the target storage space is divided into a second predetermined number of sub-storage spaces.

In the embodiment of the present invention, when the transmission mode is the compression transmission mode, the pixel data in the current image frame needs to be converted into the BLOCK format, i.e. BLOCK compression is performed. In order to realize BLOCK compression, the target storage space is required to be divided into a second preset number of sub-storage spaces, so that pixel data in YUV format is stored separately according to the component type represented by the pixel data, and is convenient to read according to the format sequence of BLOCK compression during reading, and conversion from YUV format to BLOCK format is completed.

In an alternative embodiment, the second preset number may be 48, where 16 sub-storage spaces corresponding to the luminance type data may be denoted as y_ram_0 to y_ram_15, 16 sub-storage spaces corresponding to the first color type data may be denoted as u_ram_0 to u_ram_15, and 16 sub-storage spaces corresponding to the second color type data may be denoted as v_ram_0 to v_ram_15.

Step S5032, based on the compressed transmission mode, writes the brightness type data, the first color type data, and the second color type data into the corresponding sub-storage spaces, respectively.

In the embodiment of the invention, according to the difference of the types of YUV formats adopted by the pixel data, the writing methods of the brightness type data, the first color type data and the second color type data are also different.

When the YUV format adopted by the pixel data is YUV444, the first picture is taken as the pictureBrightness type data of pixels of a row are written in Y_RAM_0, and the +.>Brightness type data of pixels of a row are written in Y_RAM_1, will +.>Brightness type data of pixels of a row are written in y_ram_2, and so on until +.>Brightness type data of pixels of a row are written in Y_RAM_7; let->First color type data of pixels of a row are written in U_RAM_0, the +.>First color type data of pixels of a row are written in U_RAM_1, will +.>The first color type data of the pixels of the row are written into u_ram_2, and so on, until +.>First color type data of pixels of a row are written in U_RAM_7; in the picture (a)The second color type data of the pixels of the row is written into V_RAM_0, the first color type data is written into the second color type data/>Second color type data of pixels of row are written in V_RAM_1, will +.>The second color type data of the pixels of the row are written in v_ram_2 and so on until +.>The second color type data of the pixels of the row is written in v_ram_7.

When the YUV format adopted by the pixel data is YUV422, the first picture is obtainedBrightness type data of pixels of a row are written in Y_RAM_0, and the +.>Brightness type data of pixels of a row are written in Y_RAM_1, will +. >Brightness type data of pixels of a row are written in y_ram_2, and so on until +.>Brightness type data of pixels of a row are written in y_ram_15; let->First color type data of pixels of even columns and rows are written into U_RAM_0, and the first color type data is written into the U_RAM_0>First color type data of pixels of even columns and rows are written into U_RAM_1, and +.>First color type data of pixels of even columns of rows are written in U_RAM_2, and so on, until +.>First color type data of pixels of even columns and rows are written into U_RAM_15; let->The second color type data of the pixels of the even columns and rows are written into V_RAM_0, and the +.>The second color type data of the pixels of the even columns and rows are written into the V_RAM_1Data of the second color type of pixels of even columns of rows are written in v_ram_2 and so on until +.>The second color type data of the pixels of the row even columns is written in v_ram_15.

When the YUV format adopted by the pixel data is YUV420, the first picture is takenBrightness type data of pixels of a row are written in Y_RAM_0, and the +.>Brightness type data of pixels of a row are written in Y_RAM_1, will +.>Brightness type data of pixels of a row are written in y_ram_2, and so on until +. >Brightness type data of pixels of a row are written in y_ram_15; let->First color type data of pixels of even columns and rows are written into U_RAM_0, and the first color type data is written into the U_RAM_0>First color type data of pixels of even columns and rows are written into U_RAM_1, and +.>First color type data of pixels of even columns of rows are written in U_RAM_2, and so on, until +.>First color type data of pixels of even columns and rows are written into U_RAM_15; let->The second color type data of the pixels of the even columns and rows are written into V_RAM_0, and the +.>The second color type data of the pixels of the even columns and rows are written into the V_RAM_1Data of the second color type of pixels of even columns of rows are written in v_ram_2 and so on until +.>The second color type data of the pixels of the row even columns is written in v_ram_15.

In an alternative embodiment, the YUV format type of the pixel data may be determined by means of user configuration.

In an alternative embodiment, the YUV format type of the pixel data may also be determined based on the non-video function bandwidth ratio. Specifically, when the non-video function bandwidth duty ratio is smaller than or equal to the first threshold, that is, when the transmission mode is the coding transmission mode, the YUV format type of the pixel data can be set to YUV444, that is, the third coding transmission mode, so as to keep all information of the pixel data; when the transmission mode is a compressed transmission mode, determining the YUV format type of the pixel data according to the non-video function bandwidth ratio: when the non-video function bandwidth ratio is larger than a fourth threshold value, determining that the YUV format type of the pixel data is YUV420, namely a first coding transmission mode; when the non-video function bandwidth ratio is smaller than or equal to a fourth threshold value and larger than a fifth threshold value, determining that the YUV format type of the pixel data is YUV422, namely a second coding transmission mode; and when the non-video function bandwidth ratio is smaller than or equal to a fifth threshold value and is larger than the first threshold value, determining that the YUV format type of the pixel data is YUV444, namely a third coding transmission mode. Thus, even in the compressed transmission mode, the information in the pixel data is retained as much as possible, thereby ensuring the final video display effect.

In step S504, the current stored data is written into the video function storage space in the chip to transmit video through the video function storage space.

Specifically, step S504 includes:

in step S5041, based on the compressed transmission mode, the luminance type data, the first color type data, and the second color type data are read from the sub-storage space, respectively, to obtain compressed pixel data.

In the embodiment of the invention, according to different YUV format types of pixel data, the ways of reading the brightness type data, the first color type data and the second color type data from the sub-storage space are different. The method comprises the following steps:

when the YUV format type of the pixel data is YUV444, sequentially reading 8 times of data from y_ram_0, y_ram_1, … … and y_ram_7, sequentially reading 8 times of data from u_ram_0, u_ram_1, … … and u_ram_7, and finally sequentially reading 8 times of data from v_ram_0, v_ram_1, … … and v_ram_7, respectively, so as to complete block compression of the pixel data and obtain compressed pixel data.

When the YUV format type of the pixel data is YUV422, sequentially reading 16 times of data from y_ram_0, y_ram_1, … … and y_ram_15, sequentially reading 8 times of data from u_ram_0, u_ram_1, … … and u_ram_15, and finally sequentially reading 8 times of data from v_ram_0, v_ram_1, … … and v_ram_15, respectively, and completing block compression of the pixel data to obtain compressed pixel data.

When the YUV format type of the pixel data is YUV420, sequentially reading 16 times of data from y_ram_0, y_ram_1, … … and y_ram_15, sequentially reading 8 times of data from u_ram_0, u_ram_1, … … and u_ram_7, and finally sequentially reading 8 times of data from v_ram_0, v_ram_1, … … and v_ram_7, respectively, thereby completing block compression of the pixel data and obtaining compressed pixel data.

Step S5042, compressing the compressed pixel data, and writing the compressed pixel data as current storage data into the video function storage space.

In the embodiment of the invention, after compressed pixel data is obtained, the compressed pixel data is compressed, and the compressed pixel data is used as current storage data and written into a video function storage space.

In an alternative embodiment, the encoded transmission mode and the compressed transmission mode share a target memory space. The method further comprises the step of multiplexing the target storage space when the transmission mode is switched, and the specific steps are as follows:

step c1, when the transmission mode is switched from the encoding transmission mode to the compression transmission mode, dividing each sub-storage space in the first preset number of sub-storage spaces into a third preset number of sub-storage spaces to obtain a second preset number of sub-storage spaces.

As described above, when the transmission mode is the compressed transmission mode, the target storage space needs to be divided into a second preset number of sub-storage spaces, namely 48 sub-storage spaces, since the target storage space is used in the form of a first preset number of sub-storage spaces, namely 4 sub-storage spaces, in the encoded transmission mode, each sub-storage space needs to be divided into 12 sub-storage spaces to obtain 48 sub-storage spaces. Specifically, the corresponding relationship between the sub-storage spaces of ram_0 to ram_3 obtained by dividing in the encoding transmission mode and the sub-storage space in the compression transmission mode is as follows: ram_0 is divided into y_ram_0 to y_ram_11, ram_1 is divided into y_ram_12 to y_ram_15 and u_ram_0 to u_ram_7, ram_2 is divided into u_ram_8 to u_ram_15 and v_ram_0 to v_ram_3, and ram_3 is divided into y_ram_4 to y_ram_15.

And c2, when the transmission mode is switched from the compression transmission mode to the coding transmission mode, taking every third preset number of sub-storage spaces in the second preset number of sub-storage spaces as one sub-storage space to obtain the first preset number of sub-storage spaces.

As described above, when the transmission mode is the encoding transmission mode, the target storage space needs to be divided into a first preset number of sub-storage spaces, i.e., 4 sub-storage spaces, since the target storage space is used in the form of a second preset number of sub-storage spaces, i.e., 48 sub-storage spaces, in the compression transmission mode, every twelve sub-storage spaces need to be taken as one sub-storage space to obtain 4 sub-storage spaces. Specifically, the correspondence between the sub-memory spaces of y_ram_0 to y_ram_15, u_ram_0 to u_ram_15, and v_ram_0 to v_ram_15 divided in the compression transmission mode and the sub-memory space in the encoding transmission mode is as follows: Y_RAM_0 to Y_RAM_11 are divided into RAM_0, Y_RAM_12 to Y_RAM_15 and U_RAM_0 to U_RAM_7 are divided into RAM_1, U_RAM_8 to U_RAM_15 and V_RAM_0 to V_RAM_3 are divided into RAM_2, and V_RAM_4 to V_RAM_15 are divided into RAM_3.

There is also provided in this embodiment a video transmission system, as shown in fig. 6, including: the transmission mode determining module 601, the data converting module 602, the network module 603 and the video data storing module 604 are connected in two-by-two communication. The transmission mode determining module 601 obtains a read parameter of the non-video function storage space through the network module 603 to determine a non-video function bandwidth ratio, and determines a transmission mode of a current image frame in the video based on the non-video function bandwidth ratio; the data conversion module 602 processes the current image frame according to the transmission mode to obtain current storage data, and writes the current storage data into the video data storage module 604; the network module 603 transmits the currently stored data in the video data storage module 604 through a network.

In an alternative embodiment, as shown in fig. 7, the data conversion module 602 includes a storage space dividing unit 6021, a storage space unit 6022, and a read-write control unit 6023, and the storage space unit 6022 includes a target storage space. Wherein the read-write control unit 6023 controls writing of pixel data into the storage space unit 6022 to obtain current stored data, and controls reading of the current stored data from the storage space unit 6022; the storage space dividing unit 6021 divides the target storage space of the storage space unit 6022 into a plurality of sub-storage spaces based on the transfer mode.

In an alternative embodiment, when the transmission mode is the encoding transmission mode, the storage space dividing unit 6021 divides the target storage space into a first preset number of sub-storage spaces; when the transmission mode is the compression transmission mode, the storage space dividing unit 6021 divides the target storage space into a second preset number of sub-storage spaces.

In an alternative embodiment, the system further comprises a video compression module 605; the video compression module 605 is respectively in communication connection with the data conversion module 602 and the video data storage module 604; when the transmission mode is the compression transmission mode, the video compression module 605 acquires the current stored data from the data conversion module 602, and compresses the current stored data and transmits the compressed current stored data to the video data storage module 604.

Fig. 8 shows a schematic structural diagram of a video transmission system in the related art, as shown in fig. 8, compared with the related art, the video transmission system provided in this embodiment adds a transmission mode determining module 601 to select a transmission mode, so as to select a suitable video transmission mode according to the current bandwidth occupation situation of a chip, thereby adapting the selected video data transmission mode to the operation situation of the chip, and ensuring the performance of the chip while fully utilizing the chip resources.

Fig. 9 shows a schematic structural diagram of a data conversion module of a video transmission system in the related art, as shown in fig. 9, compared with the related art, in this embodiment, a storage space dividing unit 6021 is added to the data conversion module 602 to implement multiplexing of the storage space unit 6022, and in different transmission modes, a target storage space in the storage space unit 6022 is divided into a corresponding number of sub-storage spaces, so that in the encoding transmission mode, data is not required to be written into an off-chip memory space, and the data can be directly written into the storage space unit 6022, thereby implementing memory space saving.

In this embodiment, a video transmission device is further provided, and the device is used to implement the foregoing embodiments and preferred embodiments, and will not be described in detail. As used below, the terms "module," "unit" may be a combination of software and/or hardware that implements a predetermined function. While the means described in the following embodiments are preferably implemented in software, implementation in hardware, or a combination of software and hardware, is also possible and contemplated.

The present embodiment provides a video transmission apparatus, as shown in fig. 10, including:

The non-video function bandwidth duty ratio determining module 1001 is configured to obtain a read parameter of a non-video function storage space in the chip, and determine a non-video function bandwidth duty ratio based on the read parameter;

a transmission mode determining module 1002, configured to determine a transmission mode of a current image frame in a video based on a non-video function bandwidth duty ratio;

a current stored data determining module 1003, configured to process the current image frame based on the transmission mode, so as to obtain current stored data;

the video transmission module 1004 is configured to write the current stored data into a video function storage space in the chip, so as to transmit video through the video function storage space.

In an alternative embodiment, the non-video functional bandwidth duty cycle determination module 1001 includes:

the reading frequency acquisition unit is used for acquiring the reading frequency of the non-video function storage space in the first preset time;

the network bandwidth determining unit is used for determining the network bandwidth occupied by the non-video function storage space based on the first preset time and the reading times;

and the non-video function bandwidth occupation ratio determining unit is used for determining the non-video function bandwidth occupation ratio based on the network bandwidth occupied by the non-video function storage space and the total network bandwidth.

the preset statistics number calculation unit is used for acquiring the reading parameter once every second preset time and determining the non-video function bandwidth ratio corresponding to the reading parameter so as to obtain the non-video function bandwidth ratio of the preset statistics number;

and the average value calculation unit is used for calculating the average value of the non-video function bandwidth duty ratio of the preset statistics times, and taking the average value as the non-video function bandwidth duty ratio.

In an alternative embodiment, the transmission mode determination module 1002 includes:

the compressed transmission mode determining unit is used for determining that the transmission mode is a compressed transmission mode when the bandwidth ratio of the non-video function is larger than a first threshold value;

and the coding transmission mode determining unit is used for determining that the transmission mode is the coding transmission mode when the bandwidth duty ratio of the non-video function is smaller than or equal to a first threshold value.

In an alternative embodiment, the code transmission mode determining unit is further configured to:

In an alternative embodiment, the currently stored data determination module 1003 includes:

a type determining unit, configured to determine a type of the encoded transmission mode corresponding to the current writing line when the transmission mode is the encoded transmission mode; the current write line is located in the current image frame;

the current storage data determining unit is used for processing the current writing line based on the type of the coding transmission mode to obtain the current storage data corresponding to the current writing line.

In an alternative embodiment, the type determining unit comprises:

a remaining storage space acquiring subunit, configured to acquire a remaining storage space of the target storage space; the target storage space is used for storing current storage data;

And a type determining subunit for determining the type of the encoded transmission mode based on the remaining storage space.

In an alternative embodiment, the currently stored data determining unit is further configured to: when the type of the coding transmission mode is the first coding transmission mode, determining that the current stored data in even lines and even columns of the current image frame are brightness type data and the first color type data or the second color type data, and determining that the current stored data in non-even lines and even columns of the current image frame are brightness type data; the pixel data includes brightness type data, first color type data, and second color type data; the pixel data is data contained in pixels of an image frame in a video.

In an alternative embodiment, the currently stored data determining unit is further configured to: when the type of the encoding transmission model is the second encoding transmission mode, determining that the current stored data in the even columns of the current image frame are brightness type data and the first color type data or the second color type data, and determining that the current stored data in the odd columns of the current image frame are brightness type data.

In an alternative embodiment, the currently stored data determining unit is further configured to: when the type of the encoding transmission mode is the third encoding transmission mode, the pixel data is used as the current storage data.

In an alternative embodiment, the currently stored data determining module 1003 further includes:

a type switching information determining unit, configured to determine and send type switching information of a current writing line based on a type of the coding transmission mode corresponding to the current writing line and a line number of the current writing line when a type of the coding transmission mode corresponding to the current writing line is different from a type of the coding transmission mode corresponding to the history writing line; the type switching information is used for restoring and obtaining the current image frame based on the current stored data.

the target storage space dividing unit is used for dividing the target storage space into a first preset number of sub-storage spaces when the transmission mode is the coding transmission mode;

and the current storage data writing unit is used for writing the current storage data into the sub storage space corresponding to the current writing line based on the coding transmission mode.

and the state information determining unit is used for determining the state information of the current writing line based on the line number of the current writing line and the sub-storage space corresponding to the current writing line.

In an alternative embodiment, video transmission module 1004 includes:

a state information acquisition unit for acquiring state information of a current writing line;

the current storage data reading unit is used for reading the current storage data corresponding to the current writing line from the sub storage space corresponding to the current writing line based on the state information and writing the current storage data into the video function storage space.

the target storage space dividing unit is further used for dividing the target storage space into a second preset number of sub-storage spaces when the transmission mode is the compression transmission mode;

and the pixel data writing unit is used for writing the brightness type data, the first color type data and the second color type data into the corresponding sub-storage spaces respectively based on the compression transmission mode.

In an alternative embodiment, video transmission module 1004 includes:

a compressed pixel data reading unit for respectively reading the brightness type data, the first color type data and the second color type data from the sub-storage space according to the compressed transmission mode to obtain compressed pixel data;

and the compressed pixel data compression unit is used for compressing the compressed pixel data, and writing the compressed pixel data serving as current storage data into the video function storage space.

In an alternative embodiment, the encoded transmission mode and the compressed transmission mode share a target storage space; the apparatus further comprises:

the target storage space dividing module is used for dividing each sub-storage space in the first preset number of sub-storage spaces into a third preset number of sub-storage spaces when the transmission mode is switched from the coding transmission mode to the compression transmission mode so as to obtain a second preset number of sub-storage spaces;

Further functional descriptions of the above respective modules and units are the same as those of the above corresponding embodiments, and are not repeated here.

The video transmission device in this embodiment is presented in the form of functional units, here referred to as ASICs (Application Specific Integrated Circuit, application specific integrated circuits), processors and memories executing one or more software or fixed programs, and/or other devices that can provide the above described functions.

The embodiment of the invention also provides a computer device which is provided with the video transmission device shown in the figure 10.

Referring to fig. 11, fig. 11 is a schematic structural diagram of a computer device according to an alternative embodiment of the present invention, as shown in fig. 11, the computer device includes: one or more processors 10, memory 20, and interfaces for connecting the various components, including high-speed interfaces and low-speed interfaces. The various components are communicatively coupled to each other using different buses and may be mounted on a common motherboard or in other manners as desired. The processor may process instructions executing within the computer device, including instructions stored in or on memory to display graphical information of the GUI on an external input/output device, such as a display device coupled to the interface. In some alternative embodiments, multiple processors and/or multiple buses may be used, if desired, along with multiple memories and multiple memories. Also, multiple computer devices may be connected, each providing a portion of the necessary operations (e.g., as a server array, a set of blade servers, or a multiprocessor system). One processor 10 is illustrated in fig. 11.

The processor 10 may be a central processor, a network processor, or a combination thereof. The processor 10 may further include a hardware chip, among others. The hardware chip may be an application specific integrated circuit, a programmable logic device, or a combination thereof. The programmable logic device may be a complex programmable logic device, a field programmable gate array, a general-purpose array logic, or any combination thereof.

Wherein the memory 20 stores instructions executable by the at least one processor 10 to cause the at least one processor 10 to perform the methods shown in implementing the above embodiments.

The memory 20 may include a storage program area that may store an operating system, at least one application program required for functions, and a storage data area; the storage data area may store data created according to the use of the computer device, etc. In addition, the memory 20 may include high-speed random access memory, and may also include non-transitory memory, such as at least one magnetic disk storage device, flash memory device, or other non-transitory solid-state storage device. In some alternative embodiments, memory 20 may optionally include memory located remotely from processor 10, which may be connected to the computer device via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.

Memory 20 may include volatile memory, such as random access memory; the memory may also include non-volatile memory, such as flash memory, hard disk, or solid state disk; the memory 20 may also comprise a combination of the above types of memories.

The computer device also includes a communication interface 30 for the computer device to communicate with other devices or communication networks.

The embodiments of the present invention also provide a computer readable storage medium, and the method according to the embodiments of the present invention described above may be implemented in hardware, firmware, or as a computer code which may be recorded on a storage medium, or as original stored in a remote storage medium or a non-transitory machine readable storage medium downloaded through a network and to be stored in a local storage medium, so that the method described herein may be stored on such software process on a storage medium using a general purpose computer, a special purpose processor, or programmable or special purpose hardware. The storage medium can be a magnetic disk, an optical disk, a read-only memory, a random access memory, a flash memory, a hard disk, a solid state disk or the like; further, the storage medium may also comprise a combination of memories of the kind described above. It will be appreciated that a computer, processor, microprocessor controller or programmable hardware includes a storage element that can store or receive software or computer code that, when accessed and executed by the computer, processor or hardware, implements the methods illustrated by the above embodiments.

Although embodiments of the present invention have been described in connection with the accompanying drawings, various modifications and variations may be made by those skilled in the art without departing from the spirit and scope of the invention, and such modifications and variations fall within the scope of the invention as defined by the appended claims.

Claims

1. A method of video transmission, the method comprising:

and writing the current storage data into a video function storage space in the chip so as to transmit the video through the video function storage space.

2. The method of claim 1, wherein the obtaining the read parameter of the non-video function memory space in the chip and determining the non-video function bandwidth duty cycle based on the read parameter comprises:

acquiring the reading times of the non-video function storage space in a first preset time;

Determining network bandwidth occupied by the non-video function storage space based on the first preset time and the reading times;

and determining the bandwidth duty ratio of the non-video function based on the network bandwidth occupied by the storage space of the non-video function and the total network bandwidth.

3. The method of claim 1, wherein the obtaining the read parameter of the non-video function memory space in the chip and determining the non-video function bandwidth duty cycle based on the read parameter comprises:

acquiring the reading parameters every second preset time, and determining the non-video function bandwidth ratio corresponding to the reading parameters to obtain the non-video function bandwidth ratio of preset statistics;

4. The method of claim 1, wherein determining the transmission mode of the current image frame in the video based on the non-video functional bandwidth duty cycle comprises:

5. The method of claim 4, wherein determining that the transmission mode is an encoded transmission mode when the non-video functional bandwidth ratio is less than or equal to a first threshold comprises:

when the non-video function bandwidth duty ratio is smaller than or equal to the first threshold value and larger than a second threshold value, determining the type of the coding transmission mode as a first coding transmission mode;

when the non-video function bandwidth duty ratio is smaller than or equal to the second threshold value and is larger than a third threshold value, determining that the type of the coding transmission mode is a second coding transmission mode; the data duty ratio of the brightness type data in the first coding transmission mode is larger than the data duty ratio of the brightness type data in the second coding transmission mode;

when the non-video function bandwidth duty ratio is smaller than or equal to the third threshold value, determining that the type of the coding transmission mode is a third coding transmission mode; the data duty ratio of the brightness type data in the second encoding transmission mode is larger than the data duty ratio of the brightness type data in the third encoding transmission mode.

6. The method of claim 1, wherein processing the current image frame based on the transmission mode to obtain current stored data comprises:

and processing the current writing line based on the type of the coding transmission mode to obtain current storage data corresponding to the current writing line.

7. The method of claim 6, wherein the determining the type of the encoded transmission mode corresponding to the current write line comprises:

obtaining the residual storage space of the target storage space; the target storage space is used for storing the current storage data;

and determining the type of the coding transmission mode based on the residual storage space.

8. The method of claim 6, wherein determining the current stored data corresponding to the current write line based on the type of the encoded transmission mode comprises:

when the type of the coding transmission mode is a first coding transmission mode, determining that currently stored data in even lines and even columns of the current image frame are brightness type data and first color type data or second color type data, and determining that currently stored data in non-even lines and even columns of the current image frame are the brightness type data; the pixel data includes the brightness type data, the first color type data, and the second color type data; the pixel data is data contained by pixels of an image frame in the video.

9. The method of claim 8, wherein determining the current stored data corresponding to the current write line based on the type of the encoded transmission mode further comprises:

when the type of the coding transmission model is the second coding transmission mode, determining that the current stored data in the even columns of the current image frame are the brightness type data and the first color type data or the second color type data, and determining that the current stored data in the odd columns of the current image frame are the brightness type data.

10. The method of claim 8, wherein determining the current stored data corresponding to the current write line based on the type of the encoded transmission mode further comprises:

and when the type of the coding transmission mode is a third coding transmission mode, taking the pixel data as the current storage data.

11. The method of claim 6, wherein processing the current image frame based on the transmission mode results in current stored data, further comprising:

when the type of the coding transmission mode corresponding to the current writing line is different from the type of the coding transmission mode corresponding to the historical writing line, determining and sending type switching information of the current writing line based on the type of the coding transmission mode corresponding to the current writing line and the line number of the current writing line; the type switching information is used for restoring the current image frame based on the current stored data.

12. The method of claim 1, wherein processing pixel data in the current image frame based on the transmission mode results in current stored data, further comprising:

and writing the current storage data into the sub storage space corresponding to the current writing line based on the coding transmission mode.

13. The method of claim 12, wherein the processing the current image frame based on the transmission mode results in current stored data, further comprising:

14. The method of any one of claims 6 to 13, wherein writing the currently stored data into a video function storage space comprises:

acquiring state information of the current writing line;

and based on the state information, reading the current storage data corresponding to the current writing line from the sub storage space corresponding to the current writing line, and writing the current storage data into the video function storage space.

15. The method of claim 1, wherein processing the current image frame based on the transmission mode results in current stored data, comprising:

and writing the brightness type data, the first color type data and the second color type data into the corresponding sub-storage spaces respectively based on the compression transmission mode.

16. The method of claim 15, wherein writing the currently stored data to a video function storage space comprises:

based on the compressed transmission mode, respectively reading the brightness type data, the second color type data and the color type data from the sub-storage space to obtain compressed pixel data;

and compressing the compressed pixel data, and writing the compressed pixel data which is used as the current storage data into the video function storage space.

17. The method according to claim 12 or 15, wherein the target storage space is shared by an encoding transmission mode and a compression transmission mode; the method further comprises the steps of:

When the transmission mode is switched from the coding transmission mode to the compression transmission mode, dividing each sub-storage space in a first preset number of sub-storage spaces into a third preset number of sub-storage spaces to obtain a second preset number of sub-storage spaces;

when the transmission mode is switched from the compressed transmission mode to the encoded transmission mode, each third preset number of sub-storage spaces in the second preset number of sub-storage spaces is used as one sub-storage space, so that the first preset number of sub-storage spaces are obtained.

18. A video transmission apparatus, the apparatus comprising:

a transmission mode determining module, configured to determine a transmission mode of a current image frame in the video based on the non-video functional bandwidth duty ratio;

And the video transmission module is used for writing the current storage data into a video function storage space in the chip so as to transmit the video through the video function storage space.

19. A computer device, comprising:

a memory and a processor in communication with each other, the memory having stored therein computer instructions, the processor executing the computer instructions to perform the video transmission method of any of claims 1 to 17.

20. A computer-readable storage medium having stored thereon computer instructions for causing a computer to perform the video transmission method of any one of claims 1 to 17.