CN117255230A

CN117255230A - Classification adjustment method, device and storage medium for transmission node

Info

Publication number: CN117255230A
Application number: CN202311535681.7A
Authority: CN
Inventors: 魏巍; 金凯
Original assignee: Suzhou HYC Technology Co Ltd
Current assignee: Suzhou HYC Technology Co Ltd
Priority date: 2023-11-17
Filing date: 2023-11-17
Publication date: 2023-12-19
Anticipated expiration: 2043-11-17
Also published as: CN117255230B

Abstract

The disclosure relates to a classification adjustment method, a device and a storage medium of a transmission node. The method is applied to a video source in a video image processing system, the video source is directly or indirectly connected with at least one transmission node, and the method comprises the following steps: determining an adjustment node which needs to be subjected to classification adjustment in the transmission nodes in response to detecting that the throughput in the video image processing system meets a preset condition; performing quality test on the adjustment node, and determining the type of the parameter of the adjustment node; and selecting a matched classification adjustment mode based on the type of the parameters of the adjustment nodes, and performing classification adjustment on the adjustment nodes to instruct the adjustment nodes after classification adjustment to transmit corresponding image data. By adopting the method, the throughput of the video image processing system can not be reduced after the topological connection is established and when different requests exist.

Description

Classification adjustment method, device and storage medium for transmission node

Technical Field

The disclosure relates to the technical field of data transmission, and in particular relates to a classification adjustment method, a classification adjustment device, computer equipment and a storage medium for a transmission node.

Background

Currently, video image processing systems based on FPGA (Field Programmable Gate Array ) and embedded systems, in particular, video image processing systems with VESA (Video Electronics StandardsAssociation, digital video interface standard), MIPI (Mobile Industry Processor Interface, mobile industry processor interface standard), HDMI (High Definition MultimediaInterface, high definition multimedia interface standard) and the like are related to a video image processing system for driving and displaying display panels and terminals such as liquid crystal (LCD, liquid Crystal Display), organic Light-Emitting Diode (OLED), and the like, when supporting multi-channel display, the throughput of the video image processing system is too small due to the fact that parameters of various devices in transmission channels are changed when image data is transmitted through multiple stages of different transmission channels after topology connection is established.

Since different requests, such as retransmission requests, cooperative transmission requests, etc., exist in the video image processing system, the time slot resources for normal image data transmission are reduced, thereby reducing the throughput of the video image processing system.

Disclosure of Invention

In view of the above, it is desirable to provide a method, an apparatus, and a storage medium for classifying and adjusting transmission nodes that do not improve throughput of a video image processing system when there are different requests after establishing a topology connection.

In a first aspect, the present disclosure provides a classification adjustment method of a transmission node, applied to a video source in a video image processing system, where the video source is directly or indirectly connected to at least one transmission node, the method includes:

determining an adjustment node which needs to be subjected to classification adjustment in the transmission nodes in response to detecting that the throughput in the video image processing system meets a preset condition;

performing quality test on the adjustment node, and determining the type of parameters of the adjustment node, wherein the parameters comprise: at least one of link quality and performance parameters of the transmission channel;

based on the type of the parameter of the adjusting node, selecting a matched classification adjusting mode, and performing classification adjustment on the adjusting node to instruct the classification adjusted adjusting node to transmit corresponding image data, wherein the classification adjustment comprises: classifying the adjusting nodes according to the types of the parameters, and distributing the classified adjusting nodes to different topological structures, or adjusting the time slot resources used by the classified adjusting nodes.

In one embodiment, the selecting a matched classification adjustment mode based on the type of the parameter of the adjustment node, and performing classification adjustment on the adjustment node includes:

responding to the type of the parameter of the adjusting node meeting a preset first condition, selecting an adjusting channel from the transmission channels of the video source and the transmission node, and adjusting the link topology of the adjusting node meeting the preset first condition into the adjusting channel;

or selecting an adjustment channel from transmission channels connected with the video source and the transmission nodes, determining an adjustment level in the adjustment channel, and adjusting the link topology of the adjustment node meeting a preset first condition into the adjustment level of the adjustment channel;

wherein the preset first condition includes: and adjusting the link quality of the transmission channel between the nodes and/or the difference of the performance parameters within a preset first range.

and in response to the type of the parameter of the adjustment node meeting a preset second condition, classifying the adjustment node into a first adjustment node and a second adjustment node according to the preset second condition, wherein the second condition comprises: adjusting the link quality of a transmission channel between nodes, and/or enabling the difference of performance parameters to be larger than a preset difference threshold;

Adjusting the link topology of the first adjusting node into a first transmission channel of a transmission channel, and adjusting the link topology of the second adjusting node into a second transmission channel of the transmission channel, wherein the first transmission channel and the second transmission channel are different;

or, adjusting the link topology of the first adjusting node into a first level of a transmission channel, and adjusting the link topology of the second adjusting node into a second level of the transmission channel, wherein the first level and the second level are different.

In one embodiment, the link quality of the transmission channel includes: round trip delay between the video source and the adjustment node; the selecting a matched classification adjustment mode based on the type of the parameter of the adjustment node, and performing classification adjustment on the adjustment node comprises the following steps:

classifying the adjustment node and the transmission channel according to a preset fixed delay step length and the round trip delay in response to the round trip delay being smaller than a preset ending delay threshold;

and adjusting the link topology of the classified adjusting node into the classified transmission channel, or adjusting the link topology of the classified adjusting node into different levels of the classified transmission channel.

In one embodiment, the method further comprises:

and reconfiguring performance parameters of the adjusting node in response to the round trip delay being greater than or equal to a preset end delay threshold until the round trip delay is less than the preset end delay threshold.

In one embodiment, the selecting a matching classification adjustment mode based on the type of the parameter of the adjustment node, and performing classification adjustment on the adjustment node to instruct the adjustment node after classification adjustment to transmit corresponding image data includes:

responding to the type of the parameter of the adjusting node to meet a preset first condition, and distributing a first time slot resource to the adjusting node so as to instruct the adjusting node to transmit corresponding image data by using the first time slot resource;

in response to the existence of a retransmission node with a retransmission request in the adjustment node, allocating a second time slot resource to the adjustment node and the retransmission node so as to instruct the retransmission node to retransmit image data by using the second time slot resource, or instruct the adjustment node to transmit corresponding image data by using the second time slot resource;

responding to the type of the parameter of the adjusting node to meet a preset second condition, classifying the adjusting node into a first adjusting node and a second adjusting node according to the preset second condition, and distributing a third time slot resource to the first adjusting node and the second adjusting node so as to instruct the first adjusting node and the second adjusting node to transmit image data by utilizing the third time slot resource;

And acquiring the image data corresponding to the second adjustment node transmitted by using the third time slot resource, and transmitting the correction image data by using the third time slot resource, wherein the correction image data is used for checking and correcting the image data transmitted by the second adjustment node.

In one embodiment, the method further comprises:

and responding to the plurality of adjustment nodes, wherein the adjustment nodes fail to be classified and adjusted, selecting a matched classification adjustment mode based on the types of parameters of the adjustment nodes fail to be classified and adjusted, and performing classification adjustment on the adjustment nodes fail to be classified and adjusted until the classification adjustment of the adjustment nodes fail to be classified and adjusted is successful.

In one embodiment, the method further comprises: and sending optimization information to the transmission node, wherein the optimization information is used for indicating the transmission node to adjust the performance parameters of the transmission node.

In one embodiment, the video source and the adjustment node communicate with each other by using a preset adjustment frame; the structure of the adjustment frame at least comprises: enabling a time slot, a quality test time slot and a classification adjustment mode to determine the time slot, wherein the structure of the adjustment frame is obtained based on a standard frame structure;

In response to detecting that the throughput in the video image processing system meets a preset condition, starting the enabling time slot, and determining an adjusting node which needs to be subjected to classification adjustment in the transmission nodes by utilizing the structure of the adjusting frame;

performing quality testing on the adjusting node based on the quality testing time slot, and determining the type of parameters of the adjusting node, wherein the parameters comprise: at least one of link quality and performance parameters of the transmission channel;

based on the type of the parameter of the adjusting node, determining a time slot by using the classification adjusting mode, selecting a matched classification adjusting mode, and performing classification adjustment on the adjusting node to instruct the classification adjusted adjusting node to transmit corresponding image data, wherein the classification adjustment comprises: classifying the adjusting nodes according to the types of the parameters, and distributing the classified adjusting nodes to different topological structures, or adjusting the time slot resources used by the classified adjusting nodes.

In one embodiment, the video source and the adjustment node communicate with each other by using preset adjustment signaling; the adjustment signaling includes at least: enabling a field, testing quality, determining a field by a classification adjustment mode;

In response to detecting that the throughput in the video image processing system meets a preset condition, enabling the enabling field, and determining an adjustment node needing classification adjustment in the transmission nodes by utilizing the adjustment signaling;

performing quality testing on the adjusting node based on the quality testing field, and determining the type of parameters of the adjusting node, wherein the parameters comprise: at least one of link quality and performance parameters of the transmission channel;

based on the type of the parameter of the adjustment node, determining a field by using the classification adjustment mode, selecting a matched classification adjustment mode, and performing classification adjustment on the adjustment node to instruct the adjustment node after classification adjustment to transmit corresponding image data, wherein the classification adjustment comprises: classifying the adjusting nodes according to the types of the parameters, and distributing the classified adjusting nodes to different topological structures, or adjusting the time slot resources used by the classified adjusting nodes.

In a second aspect, the present disclosure further provides a classification adjustment device for a transmission node. A video source for use in a video image processing system, the video source being directly or indirectly coupled to at least one transmission node, the apparatus comprising:

The adjusting node determining module is used for determining an adjusting node which needs to be subjected to classified adjustment in the transmission nodes in response to the fact that the throughput in the video image processing system is detected to meet the preset condition;

the quality testing module is used for carrying out quality testing on the adjusting node and determining the type of the parameters of the adjusting node, wherein the parameters comprise: at least one of link quality and performance parameters of the transmission channel;

the classification adjustment module is configured to select a matched classification adjustment mode based on a type of a parameter of the adjustment node, and perform classification adjustment on the adjustment node to instruct the classification-adjusted adjustment node to transmit corresponding image data, where the classification adjustment includes: classifying the adjusting nodes according to the types of the parameters, and distributing the classified adjusting nodes to different topological structures, or adjusting the time slot resources used by the classified adjusting nodes.

In a third aspect, the present disclosure also provides a computer device. The computer device comprises a memory storing a computer program and a processor implementing the steps of any of the method embodiments described above when the processor executes the computer program.

In a fourth aspect, the present disclosure also provides a computer-readable storage medium. The computer readable storage medium has stored thereon a computer program which, when executed by a processor, implements the steps of any of the method embodiments described above.

In a fifth aspect, the present disclosure also provides a computer program product. The computer program product comprises a computer program which, when executed by a processor, implements the steps of any of the method embodiments described above.

In the above embodiments, when the throughput meets the preset condition, the throughput of the video image processing system needs to be adjusted in general, so the video source may determine the adjustment node that needs to perform the classification adjustment. Then, the method comprises the steps of. And carrying out quality test on the adjusting node, and determining the type of the parameter of the adjusting node. In general, the types of parameters are different, and the corresponding classification adjustment modes are also different, so that in order to improve the throughput of the video image processing system as much as possible, a matched classification adjustment mode can be selected based on the type of the parameters of the adjustment node, and the adjustment node is subjected to classification adjustment to instruct the adjustment node after classification adjustment to transmit the corresponding image data. According to the types of different parameters, corresponding adjustment modes are selected, so that different conditions can be adapted, adjustment nodes are classified, and the classified adjustment nodes are distributed to different topological structures, or time slot resources used by the classified adjustment nodes are adjusted. Therefore, after the topology connection is established, the topology structure or the used time slot resources are adjusted, so that the throughput of the video image processing system can be improved.

Drawings

In order to more clearly illustrate the embodiments of the present disclosure or the prior art, the drawings that are required in the detailed description or the prior art will be briefly described, it will be apparent that the drawings in the following description are some embodiments of the present disclosure, and other drawings may be obtained according to the drawings without inventive effort for a person of ordinary skill in the art.

Fig. 1 is a schematic diagram of an application environment of a classification adjustment method of a transmission node in an embodiment;

FIG. 2 is a schematic diagram of a video image processing system in one embodiment;

FIG. 3 is a flow chart illustrating a method of classification adjustment of a transmission node according to one embodiment;

FIG. 4 is a schematic diagram of a topology in one embodiment;

FIG. 5 is a flow chart of a first portion of step S206 in one embodiment;

FIG. 6 is a flow chart of a second portion of step S206 in one embodiment;

FIG. 7 is a flow chart of a third portion of the step S206 in one embodiment;

FIG. 8 is a flow chart of a fourth portion of the step S206 in one embodiment;

FIG. 9 is a schematic diagram of a standard frame structure in one embodiment;

FIG. 10 is a schematic diagram of the structure of an adjustment frame in one embodiment;

FIG. 11 is a block diagram schematically illustrating a structure of a classification adjustment device of a transmission node in one embodiment;

FIG. 12 is a schematic diagram of the internal structure of a computer device in one embodiment.

Detailed Description

In order to make the objects, technical solutions and advantages of the present disclosure more apparent, the present disclosure will be further described in detail with reference to the accompanying drawings and examples. It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the present disclosure.

It should be noted that the terms "first," "second," and the like in the description and claims herein and in the foregoing figures are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged where appropriate such that the embodiments described herein may be capable of operation in sequences other than those illustrated or described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, apparatus, article, or device that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed or inherent to such process, method, article, or device.

In this document, the term "and/or" is merely one association relationship describing the associated object, meaning that three relationships may exist. For example, a and/or B may represent: a exists alone, A and B exist together, and B exists alone. In addition, the character "/" herein generally indicates that the front and rear associated objects are an "or" relationship.

As described in the background art, when image data is transmitted in multiple stages, significant differences, i.e., imbalance, occur in the transmission flow of the image data on different channels due to the change of the Physical Layer (PHY) state of different video links, the transmission loss, the difference of the device and cable configurations on the video links, the change of the transmission distance, and the like, and thus image data transmission congestion or insufficient throughput on the channels is generated. When the video source designates transmission nodes for all levels in the link topology, due to significant differences in transmission power and performance parameters of different transmission nodes, imbalance of transmission throughput of image data on different levels of channels and link topology can occur after the link topology is established, and meanwhile, due to retransmission requests and cooperative transmission requests in the video image processing system, time slot resources for normal video data transmission can be significantly reduced, and the throughput of the video image processing system is further reduced.

Therefore, to solve the above-mentioned problem, the embodiment of the present disclosure provides a classification adjustment method for a transmission node, which can be applied to an application environment as shown in fig. 1. Wherein the video source 102 is directly or indirectly connected to at least one transmission node 104 via a transmission channel. In response to the video source 102 detecting that the throughput in the video image processing system meets a preset condition, the video source 102 determines an adjustment node of the transmission nodes 104 that requires a classification adjustment. Video source 102 may perform quality testing on the adjustment node to determine the type of parameter of the adjustment node. The parameters may include: at least one of link quality and performance parameters of the transmission channel. The video source 102 selects a matching adjustment mode based on the type of the parameter of the adjustment node, and performs classification adjustment on the adjustment node to instruct the adjustment node after classification adjustment to transmit corresponding image data. The classification adjustment includes: classifying the adjusting nodes according to the types of the parameters, and classifying the classified adjusting nodes into different topological structures, or adjusting the time slot resources used by the classified adjusting nodes.

Describing the video image processing system involved in some embodiments of the present disclosure as shown in fig. 2, the video image processing system may include, as shown in fig. 2: the system comprises an embedded control module, an FPGA module, an external storage module, a rapid storage module, a peripheral module, a video interface physical layer realization module and a video transmission link.

The embedded control module can use any embedded chip and system, and is mainly responsible for initiating signaling interaction, such as reading/writing a register, starting/closing a video display module and module, peripheral control, video display module parameter setting and the like. The FPGA module is mainly responsible for realizing the implementation parts which need a large amount of data processing and low round trip delay (latency), such as storage control, peripheral control, video interface IP core implementation and the like. The external storage module is mainly responsible for storing the original data stream of the video image to be displayed in the video image processing system, and storage media such as NandFlash, SSD are applied to the part, but not limited to the part. The fast memory module is used in the implementation process of the FPGA module requiring a large amount of data processing and low round trip delay (latency), and the module for storing the latency for reducing the latency is applied to a fast and low latency physical device, such as DDR3, but not limited thereto. Peripheral modules including, but not limited to, GPIO (General-purpose input/output), UART (UniversalAsynchronous Receiver/Transmitter, universal asynchronous receiver Transmitter), USB (Universal Serial Bus ), network ports, and the like. The video interface physical layer implementation module is mainly responsible for the physical layer implementation required for driving the display module, such as, but not limited to, TX/RX (Transmitter/Receiver) -PHY of DisplayPort, DPHY of MIPI, etc.

Further, the FPGA module comprises a bus interaction module, an MCU (Microcontroller Unit, micro control module) video stream preprocessing module, a video data stream transmission control module, a clock control module, an embedded soft core control module, a bus controller module, an internal storage controller module, an external control module, a display clock generator module, a video time sequence controller module and a video interface IP core module. The bus interaction module is mainly responsible for the functions of selection, decision and the like of all other modules connected to the bus interaction module. The MCU video stream preprocessing module is mainly responsible for preprocessing and converting the video data stream input from the external storage module according to the format and the parameter type set by the system so as to facilitate the processing of the later stage. The video data stream transmission control module is mainly responsible for controlling the time sequence, parameters and the like of the data stream after the data stream pretreatment and conversion. The clock control module is mainly responsible for generating and controlling a global clock in the video image processing system. The embedded soft core control module is a control core of the FPGA module and is mainly responsible for the core functions of time sequence control, parameter configuration, physical process realization and the like of all modules in the FPGA module, and the embedded soft core control module can be used in the realization of the time sequence control, parameter configuration, physical process realization and the like, such as Xilinx MicroBlaze and the like, but is not limited to the realization of the time sequence control, parameter configuration, physical process realization and the like. The bus controller module is mainly responsible for controlling all modules connected with the bus interaction module, but is not limited to the bus interaction module. The video image processing module is mainly responsible for mode conversion, time sequence control and the like of the video image data stream corresponding to the video interface IP core module, but is not limited to the video image processing module. The internal memory controller module is mainly responsible for controlling the flash memory module, including writing/reading of data stream, frame control, etc., but not limited thereto. The peripheral control module is mainly responsible for controlling all peripheral modules, including the starting/closing of peripheral, the control of working mode and the like, but is not limited thereto. The display clock generator module is mainly responsible for time sequence control of all the IP core modules and the physical layer realization modules of the video interface, but is not limited to the time sequence control. The video time sequence controller module is mainly responsible for processing such as data conversion and time sequence control when the data input from the video image processing module is transmitted to the video interface IP core module, but is not limited to the processing.

The video link may include: video source (video transmission source), transmission node (embedded physical repeater, cable with active ID, detachable physical repeater, video receiving end, etc.), but is not limited thereto. In some embodiments of the disclosure, the transmission node may include one or more of a node, a video device, and a video source, depending on the context, and in some embodiments of the disclosure as described below, the transmission node may generally be a node and/or a video device.

In one embodiment, as shown in fig. 3, a classification adjustment method of a transmission node is provided, and the method is applied to a video source in the video image processing system in fig. 1 or fig. 2, for example, where the video source is directly or indirectly connected to at least one transmission node, and includes the following steps:

s202, determining an adjustment node which needs to be subjected to classification adjustment in the transmission nodes in response to the fact that the throughput in the video image processing system is detected to meet the preset condition.

Where throughput refers to the amount of data that passes through a system, device, or network per unit time. Throughput generally refers to the ability of a system or device to process the amount of data per unit time, and is one of the important indicators of system performance. In some embodiments of the present disclosure, the throughput of a video image processing system may represent the data transmission capability, i.e., the amount of data that can be transmitted or received per unit time. The unit of throughput may be the amount of data (e.g., bytes, megabytes, etc.) depending on the characteristics of the system or device being measured. Higher throughput generally means that the system or device can process more data per unit time. The preset condition may typically be a condition that measures whether the throughput is balanced or whether the throughput is too low. Classification adjustment may generally be a way of classifying a transmitting node according to some condition, thereby adjusting the time slot resources used by the transmitting node, topology, data type transmitted, and so forth, in some embodiments of the present disclosure.

In particular, the video source may acquire and detect the throughput of the video image processing system. For example, when the throughput is unbalanced, the throughput is a at a certain moment, the throughput is B at a next moment, and the difference between a and B is large, so that it can be determined that the throughput is unbalanced, and the preset condition is satisfied. Or after a certain time, the throughput becomes C, and C is a smaller value, it can be determined that the throughput is smaller, and the preset condition is also satisfied. It should be noted that, since not all the transmission nodes need to be classified and adjusted, the video source may select one or more transmission nodes from the transmission nodes of the video image processing system as adjustment nodes that need to be classified and adjusted. The selection of which transmission nodes to use as adjustment nodes by a particular video source may be flexibly determined according to the actual application scenario or the topology of the transmission nodes, and is not absolutely limited in some embodiments of the present disclosure.

S204, performing quality test on the adjustment node, and determining the type of parameters of the adjustment node, wherein the parameters comprise: at least one of link quality and performance parameters of the transmission channel.

Quality testing, among other things, may generally be the way to test the performance of the conditioning node, and the video link (link quality of the transmission channel) between the conditioning node and the video source in some embodiments of the present disclosure. The types of parameters may include: the quality of the link quality of the transmission channel, the specific numerical value of the link quality, the size of the performance parameter adjustability, the size of the performance parameter, and the like. For example, the link quality of the transmission channel may be determined using packet loss rate, jitter rate, round trip delay, and the like. For example, a large round trip delay may determine that the link quality of the transmission channel is poor.

Specifically, some test sequences may be used to perform quality testing on the adjustment node to determine the type of link quality of the transmission channel corresponding to the adjustment node.

In some exemplary embodiments, a special link quality test sequence may be used to conduct quality testing of the adjusting node in the multi-channel; the special link quality test Sequence may be a Pseudo-Random Sequence (PRS), a K code, or a Sequence preset by the video source according to a transmission duration period, for example, 6 Random sequences are generated according to a duration period of 1ms, 2ms, 5ms, 10ms, 15ms, and 20ms, when the adjusting node receives these sequences, which duration period Sequence can be correctly received, and then the adjusting node will be recorded as the duration period type by the video source, and determines the link quality of the transmission channel of the adjusting node according to the duration period type, and further determines the type of the link quality of the transmission channel. If the duration period type is 20ms or 30ms, it can be determined that the link quality of the transmission channel is poor.

In addition, the video source generates a particular sequence in terms of a duration of the sequence, e.g., a duration of 1ms, then the length of the sequence is generated in terms of a duration of 1ms, and so on; if a certain adjustment node can simultaneously and correctly receive a sequence with a duration of 1ms/2ms or other duration periods, the duration period type can be flexibly determined to be 1ms or 2ms according to different strategies. For example, the tuning node requires a high performance display (gaming application), which may be 1ms. The adjusting node needs to be able to send video data continuously, which can be chosen to be 2ms. The sequence of specifically determining what duration period the adjusting node selects may be determined according to actual needs, and is not limited in some embodiments of the present disclosure.

S206, based on the type of the parameter of the adjusting node, selecting a matched classification adjusting mode, and performing classification adjustment on the adjusting node to instruct the classification adjusted adjusting node to transmit corresponding image data, wherein the classification adjustment comprises: classifying the adjusting nodes according to the types of the parameters, and distributing the classified adjusting nodes to different topological structures, or adjusting the time slot resources used by the classified adjusting nodes.

The types of parameters of the adjustment nodes are different, and the matched classification adjustment modes are also different, for example, the performance parameters of the adjustment nodes are not greatly different, and at the moment, one mode which is matched can be selected. For another example, the performance parameters between the adjustment nodes may differ significantly, and another way of matching may be selected. It should be noted that in some embodiments of the present disclosure, the adjusting node may have multiple types of parameters at the same time, for example, the adjusting node includes A1, A2, A3, and A4, where the performance parameters of A1 and A2 are not greatly different, and the performance parameters of A3 and A4 are not greatly different, but if the performance parameters of A1 and A3 are greatly different, two different types of parameters may exist. Namely, the types of parameters (A1 and A3, A2 and A4) of the adjustment nodes whose performance parameters are greatly different, and the types of parameters (A1 and A2, A3 and A4) of the adjustment nodes whose performance parameters are not greatly different. How to classify the materials can be selected and determined according to actual conditions. As shown in fig. 4, the topology, transmission channels, hierarchies, etc., involved in some embodiments of the present disclosure are illustrated. The topologies referred to in this disclosure may include the following classes: video source→node 1→video device 1, video device 2, and video device 3. Wherein the video apparatus 3 may also be directly connected to a video source. I.e. video source→video apparatus 3. Video source→node 2→video device 4 and video device 5. Video source→node 3→video device 6, video device 7, video device 8, video device 9, and video device 10. Video source→video device 6. Video source→video apparatus 11. The data transmission process involved in this embodiment may send image data to individual nodes or video devices for a video source. Each node delivers image data to each video device. Each video device or node displays image data. In some embodiments, the transmission node may include one or more of a node, a video device, and a video source. Taking the video device 3 as an example, two topologies of the video device 3 exist, respectively: 1. video source→node 1→video device 3. 2. Video source→video apparatus 3. As shown in fig. 3, for the video apparatus 1, the video apparatus 2, and the video apparatus 3 in the transmission channel 1, the same hierarchy in the same transmission channel, that is, the link topology hierarchy 3, and for the node 1, the node 2, the node 3, and the video apparatus 11, since they are directly connected to the video source, they may be the same hierarchy, that is, the link topology hierarchy 2. Typically, the more levels defined relative to the location of the video source, the longer the link to the video source, i.e., the greater the transmit power and receive power required to reach the transmission node; and vice versa. In addition, the greater the number of transmission nodes in each hierarchy, the greater the transmit power required to transmit image data, and the ability to cover all transmission nodes on that hierarchy, and vice versa. In general, the video source may be a level 1, and on each transmission channel, there are levels 2, 3, etc. from the video source down, but not limited thereto. The time slot resources (time slot resources) refer to available resources that are separated in time for performing a particular task or providing a particular service for a particular period of time. In the field of data transmission technology, time slot resources are generally used for allocating and managing tasks such as data transmission, signaling, scheduling, and the like. The image data may include video data and/or picture data in some embodiments of the present disclosure. The matched classification adjustment modes can be one or more, and if the classification adjustment modes are more than one, the classification adjustment modes can be selected from the plurality of modes. The link topology hierarchy in some embodiments is simply referred to as hierarchy as follows.

Specifically, according to the type of the parameter of the adjustment node, a matched classification adjustment mode can be selected to perform classification adjustment on the adjustment node. For example, the adjustment nodes may be classified into one type and allocated in one or several transmission channels with little difference in performance parameters. Or the link quality difference of the corresponding transmission channels of the adjustment node is not large, the link quality difference of the transmission channels can be classified into one type, and the transmission channels are distributed in one or a plurality of transmission channels, and the like. The video source can uniformly configure the adjusting nodes in the one or more channels to enable the adjusting nodes to transmit or receive the corresponding image data, so that signaling interaction is reduced, and the sending efficiency of the image data is improved. The adjustment nodes with too large link quality difference or too large performance parameter difference can be classified into one type, and the adjustment nodes in the one type use the same time slot resource to transmit the image data.

In the above method for classifying and adjusting transmission nodes, when the throughput meets the preset condition, the throughput of the video image processing system needs to be adjusted in normal cases, so that the video source can determine the adjustment node which needs to be classified and adjusted. Then, the method comprises the steps of. And carrying out quality test on the adjusting node, and determining the type of the parameter of the adjusting node. In general, the types of parameters are different, and the corresponding classification adjustment modes are also different, so that in order to improve the throughput of the video image processing system as much as possible, a matched classification adjustment mode can be selected based on the type of the parameters of the adjustment node, and the adjustment node is subjected to classification adjustment to instruct the adjustment node after classification adjustment to transmit the corresponding image data. According to the types of different parameters, corresponding adjustment modes are selected, so that different conditions can be adapted, adjustment nodes are classified, and the classified adjustment nodes are distributed to different topological structures, or time slot resources used by the classified adjustment nodes are adjusted. After the topology connection is established, the topology structure or the used time slot resources are adjusted, and the throughput of the video image processing system is improved.

In one embodiment, as shown in fig. 5, the selecting a matching classification adjustment mode based on the type of the parameter of the adjustment node, and performing classification adjustment on the adjustment node includes:

s302, responding to the type of the parameter of the adjusting node to meet a preset first condition, selecting an adjusting channel from the transmission channels of the video source and the transmission node, and adjusting the link topology of the adjusting node meeting the preset first condition into the adjusting channel.

Wherein the preset first condition includes: and adjusting the link quality of the transmission channel between the nodes and/or the difference of the performance parameters within a preset first range. I.e. the link quality differences between the adjustment nodes are not large or the performance parameters between the adjustment nodes are not large. The number of the adjusting channels can be one or a plurality of.

Specifically, if there is an adjustment node whose type of parameter satisfies the first preset condition in the adjustment nodes, the adjustment nodes with small link quality difference between the adjustment nodes may be classified into one type according to the type of parameter, and the adjustment nodes with small difference of performance parameter between the adjustment nodes may be classified into another type. And then dividing the adjusting nodes meeting the first condition into one type or two types, and adjusting the link topology of the one type or the two types into an adjusting channel. In general, two types of adjustment nodes are divided, and two types of adjustment channels exist and correspond to each type of adjustment node.

In some exemplary embodiments, for example, the adjustment nodes include adjustment node 1, adjustment node 2, adjustment node 3, adjustment node 4, and adjustment node 5, wherein the performance parameters between adjustment node 1 and adjustment node 5 do not differ significantly, and the link quality of the transmission channel between adjustment node 3 and adjustment node 4 is close. If the determined adjustment channels are adjustment channel 1 and adjustment channel 2, the link topologies of adjustment node 1 and adjustment node 5 can be adjusted to adjustment channel 1, and the link topologies of adjustment node 3 and adjustment node 4 can be adjusted to adjustment channel 2.

Or S304, selecting an adjustment channel from the transmission channels of the video source and the transmission nodes, determining an adjustment level in the adjustment channel, and adjusting the link topology of the adjustment node meeting the preset first condition into the adjustment level of the adjustment channel.

In particular, an adjustment channel may also be selected from the transmission channels, and one or several levels may be selected as adjustment levels in the adjustment channel. And then adjusting the link topology of the adjusting node meeting the preset first condition into an adjusting level of the adjusting channel.

In some exemplary embodiments, for example, the adjustment nodes include an adjustment node 1, an adjustment node 2, an adjustment node 3, an adjustment node 4, and an adjustment node 5, wherein the performance parameters between the adjustment node 1 and the adjustment node 5 are not greatly different, the link quality of the transmission channel between the adjustment node 3 and the adjustment node 4 is close, the determined adjustment channel may include an adjustment channel 1, the adjustment channel 1 may include 4 levels, wherein the levels 2 and 3 are determined as adjustment levels, and then the link topologies of the adjustment node 1 and the adjustment node 5 may be adjusted into the level 2, and the link topologies of the adjustment node 3 and the adjustment node 4 may be adjusted into the level 3.

It should be noted that how to select the adjustment channels and the adjustment levels, and how many adjustment channels and adjustment levels to select may be determined according to the number of adjustment nodes that meet the preset first condition, or according to the number of actual levels and transmission channels, which is not limited in some embodiments of the present disclosure.

In this embodiment, the video source can conveniently control the adjustment nodes without crossing more transmission channels and levels, so that the transmission paths of various signaling, video data and the like are greatly shortened, the transmission delay is remarkably reduced, and meanwhile, the video source can use fewer time slot resources to bear image data and transmit effective video data to as many adjustment nodes as possible in the link topology. Because most of the adjusting nodes are on one or more link topology levels on one or more transmission channels, the video source can more conveniently use a group of signaling to complete the adjustment of the performance parameters and the like of all the adjusting nodes, and the performance of the video image processing system can be maximized under the condition of the least signaling interaction times and signaling cost.

In one embodiment, as shown in fig. 6, the selecting a matching classification adjustment mode based on the type of the parameter of the adjustment node, and performing classification adjustment on the adjustment node includes:

S402, responding to the type of the parameter of the adjusting node to meet a preset second condition, classifying the adjusting node into a first adjusting node and a second adjusting node according to the preset second condition, wherein the second condition comprises the following steps: and adjusting the link quality of the transmission channels between the nodes, and/or enabling the difference of the performance parameters to be larger than a preset difference threshold.

Specifically, when the type of the parameter of the adjustment node satisfies the preset second condition, it may be determined that there are simultaneously an adjustment node with good link quality and an adjustment node with poor link quality of the transmission channel in the adjustment node, and/or there are simultaneously adjustment nodes with large performance parameter and small performance parameter in the adjustment node. At this time, the adjustment node having a good link quality may be classified as a first adjustment node, and the adjustment node having a poor link quality may be classified as a second adjustment node. The adjustment node with the larger performance parameter may be classified as a first adjustment node, and the adjustment node with the smaller performance parameter may be classified as a second adjustment node.

S404, adjusting the link topology of the first adjusting node to a first transmission channel of a transmission channel, and adjusting the link topology of the second adjusting node to a second transmission channel of the transmission channel, wherein the first transmission channel and the second transmission channel are different. The number of the first transmission channels and the second transmission channels may be flexibly determined according to the number of the first adjustment nodes and the second adjustment nodes.

Specifically, the link topology of the first adjustment node with good link quality and/or large performance parameter may be adjusted into the first transmission channel of the transmission channel. The performance parameters of the first adjustment node in the first transmission channel can be adjusted up as much as possible to improve throughput. And the second adjusting node with poor link quality and/or small performance parameter is adjusted to the second transmission channel, and the performance parameter of the second adjusting node in the second transmission channel is adjusted to ensure that the second adjusting node can smoothly and normally transmit video data.

In some exemplary embodiments, for example, the first adjustment node includes A1 and A2, the second adjustment node includes A3 and A4, and the first transmission channel and the second transmission channel may be selected among the transmission channels. For example, the first transmission channel is C1 and C2, the second transmission channel is C3 and C4, and then the link topology of A1 may be adjusted to C1, the link topology of A2 may be adjusted to C2, the link topology of A3 may be adjusted to C3, and the link topology of A4 may be adjusted to C4.

Or S406, adjusting the link topology of the first adjustment node into a first level of the transmission channel, and adjusting the link topology of the second adjustment node into a second level of the transmission channel, where the first level and the second level are different.

Specifically, the link topology of the first adjusting node may be adjusted to the first level of the transmission channel, and the link topology of the second adjusting node may be adjusted to the second level different from the first level of the transmission channel, so as to ensure that the link topologies of different types of adjusting nodes are in different topologies. It should be noted that the transmission channels of the first hierarchy and the second hierarchy may be the same or different.

In some exemplary embodiments, for example, the first adjustment node comprises A1 and A2 and the second adjustment node comprises A3 and A4. If the transmission channel C1 includes six levels, level 1 to level 6, level 2 and level 4 may be selected as the first level, and level 3 and level 6 may be selected as the second level. The link topology of A1 may be adjusted to level 2, the link topology of A2 may be adjusted to level 4, the link topology of A3 may be adjusted to level 3, and A4 may be adjusted to level 6. If the transmission channel includes: transmission channel C1 and transmission channel C2, wherein C1 exists in a layer 1 to a layer 6, C2 exists in a layer 1 to a layer 3, and the link topology of A1 can be adjusted to a layer 2 of transmission channel C1, and the link topology of A2 can be adjusted to a layer 3 of transmission channel C2. The link topology of A3 is adjusted to level 4 of the transmission channel C1, and the link topology of A4 is adjusted to level 5 of the transmission channel C1. It is to be understood that the foregoing is only illustrative.

In this embodiment, the adjustment nodes in the video image system may be allocated to different transmission channels and/or levels according to the principles of this embodiment, and the adjustment nodes may be divided into different channels and/or levels according to the link quality and/or performance parameters, which helps to solve the significant effect of throughput on the video image processing system caused by congestion and/or lack of video data transmission due to significant differences in link quality and/or performance parameters on the transmission channels and/or levels. Meanwhile, the method is favorable for classifying the adjustment nodes with good link quality and/or high performance parameters, so that the classification management of improving the link quality and performance as much as possible is realized. And, for the adjustment node with poor link quality and/or low performance parameter, reliable transmission of the image data is realized as much as possible. In general, when an adjustment node with poor link quality decreases its own performance parameter, the amount of real-time image data transmitted is reduced as much as possible to realize reliable transmission. Note that reliable transmission is based on the ability to ensure that the video source establishes a stable link with the adjustment node, on which the video source may guarantee reliable transmission of image data by means of limited retransmission.

In one embodiment, as shown in fig. 7, the link quality of the transmission channel includes: round trip delay between the video source and the adjustment node; the selecting a matched classification adjustment mode based on the type of the parameter of the adjustment node, and performing classification adjustment on the adjustment node comprises the following steps:

s502, responding to the round trip delay less than a preset ending delay threshold, and classifying the adjusting node and the transmission channel according to a preset fixed delay step length and the round trip delay.

The round trip delay may be typically the delay between the adjusting node and the video source. In the process of establishing the topological structure, the time delay measured by the video source and the numerical value between the round trip nodes are random, and in the process of classifying and adjusting the adjusting nodes, the random time delay measured cannot be applied, so that the complexity of system processing is increased, and the efficiency is further reduced. Therefore, a fixed delay step length can be set to classify the type of the duration period so as to solve the random measurement delay, the round trip delay can be determined according to the determined duration period type of the adjustment node, and the round trip delay and the fixed delay step length are used for processing, so that the complexity can be remarkably reduced. The preset ending time delay threshold can be used for measuring whether the round trip time delay meets the standard of the video image processing system, and the situation that the time delay is too long and the sending efficiency is reduced is avoided.

Specifically, when the round trip delay is less than a preset end delay threshold, it may be determined that the current round trip delay meets the criteria of the video image processing system. The round trip delay may be determined according to the link quality (duration type) of the transmission channel determined in the above embodiment, for example, the duration type is 1ms, and then the round trip delay may be determined to be 1ms, and then the adjustment nodes corresponding to the different round trip delays are classified by using a fixed delay step. And classifying the transmission channels with a fixed delay step.

S504, the link topology of the classified adjusting node is adjusted to the classified transmission channel, or the link topology of the classified adjusting node is adjusted to different levels of the classified transmission channel.

Specifically, since the adjustment nodes and the transmission channels have been classified, the link topology of the classified adjustment nodes can be adjusted to different transmission channels after classification, and the transmission channels after classification are used for transmitting the image data of the adjustment nodes with fixed delays. Alternatively, the link topology of the classified adjustment nodes may be adjusted into different levels of the classified transmission channel, each level being used to transmit image data of the adjustment node of fixed latency. For example, the adjustment nodes may be classified into two categories, one category is classified into 5ms according to a fixed delay step length, and one category is classified into 10ms, and then a similar transmission channel may also be classified into two categories, one category transmits image data of the adjustment node of 5ms, and one category transmits image data of the adjustment node of 10 ms. The link topology of the 5ms adjustment node may be adjusted into a transmission channel transmitting the image data of the 5ms adjustment node, and the link topology of the 10ms adjustment node may be adjusted into a transmission channel transmitting the image data of the 10ms adjustment node. If the transmission channel includes a plurality of levels, the levels of the transmission channel may be classified into transmitting image data of an adjustment node of 5ms and transmitting image data of an adjustment node of 10 ms. For example, level 2 may be used to transmit 5ms of image data of the trim node and level 4 may be used to transmit 10ms of image data of the trim node. The link topology of the 5ms adjustment node is adjusted to level 2 and the link topology of the 10ms adjustment node is adjusted to level 4.

In some exemplary embodiments, the video source presets a fixed delay step, such as a start time of 0ms and a step of 5ms, then the fixed delay step is 0ms, 5ms, 10ms, 15ms, 20ms, and the video source may also set an end delay threshold, such as 50ms. The number of the adjusting nodes is multiple, and the duration period types of each adjusting node are respectively 1ms, 2ms, 7ms and 12ms, so that the adjusting nodes can be divided into 3 types, wherein one type comprises 1ms and 2ms adjusting nodes, one type comprises 7ms adjusting nodes, and one type comprises 12ms adjusting nodes. For example, the video image processing system includes 4 transmission channels, the transmission channels 1-2 are used for short time delay of 0ms, 5ms and 10ms, namely, the time delay is shorter, the link quality is good, in general, the layer 1 in the topological structure is a video source, the layer 2 can be used for 0ms, the layer 3 can be used for 5ms and the layer 4 can be used for 10ms, the performance parameters of the adjustment nodes are improved as much as possible by the video source, so that the sending efficiency of image data is improved, and the throughput of the video image processing system is further improved.

The channel 3 is used for 15ms and 20ms of time delay, the layer 2 is used for 15ms, the layer 3 is used for 20ms, the partial video source reduces the retransmission times of the image data by changing the performance parameters of the adjusting node, improves the sending efficiency of the image data of the adjusting node as much as possible, and achieves the best compromise between the retransmission times and the sending efficiency of the image data, thereby improving the throughput of the video image processing system.

The channel 4 is used for other long delays (delays exceeding 20 ms), i.e. for adjustment nodes with poor link quality, which adjusts as much as possible this type of adjustment node on as few levels as possible to shorten the distance of the transmission path of the image data as much as possible, and the video source keeps the establishment of the topology of such adjustment nodes as much as possible by reducing the performance parameters of the adjustment node, thus achieving efficient transmission of the image data.

S506, in response to the round-trip delay being greater than or equal to a preset end delay threshold, reconfiguring performance parameters of the adjustment node until the round-trip delay is less than the preset end delay threshold.

Specifically, when the round trip delay is greater than or equal to a preset end delay threshold, the following situation occurs for an adjustment node exceeding the end delay threshold: the adjusting node itself fails, the link quality of the adjusting node is over-poor, so that the video source needs more additional resources to establish a link topology for the adjusting node, such as retransmission, cooperation and the like, and under these conditions, the video source will reconfigure the sending power and performance parameters of the adjusting node until the round trip delay of the adjusting node is smaller than the preset end delay threshold, so as to achieve correct and successful link topology adjustment of the adjusting node.

In this embodiment, the video source accurately measures the link quality, explicitly defines and classifies the transmission channel and/or hierarchy, can place the adjustment node at an appropriate position, and then maximizes the image data transmission efficiency in the video image processing system by accurately changing the performance parameter of the adjustment node, thereby maximizing the throughput of the video image processing system.

In one embodiment, as shown in fig. 8, the selecting a matching classification adjustment mode based on the type of the parameter of the adjustment node, and performing classification adjustment on the adjustment node to instruct the classification-adjusted adjustment node to transmit corresponding image data includes:

s602, in response to the type of the parameter of the adjustment node meeting a preset first condition, the adjustment node is allocated with a first time slot resource to instruct the adjustment node to transmit corresponding image data by using the first time slot resource.

Specifically, when the type of the parameter of the existing adjustment node satisfies the preset first condition, the adjustment node satisfying the preset first condition at this time may be a type. The first time slot resources may be allocated to the adjustment nodes satisfying a preset first condition. The class of adjustment nodes use the same first time slot resources to transmit corresponding image data. At this time, the video source allocates less time slot resources, and the time slot resources can be effectively utilized. It should be noted that, the corresponding image data is transmitted using the first time slot resource, where the image data may be the same or different. With the first time slot resources, resource reallocation in other dimensions, such as code division, frequency division, etc., may be performed. If there is no reallocation of resources in other dimensions using the first time slot resources, then the transmitted image data may be identical. If there is reallocation of resources in other dimensions using the first time slot resource, then reallocation of resources may be performed in other dimensions, where sending different image data may be different. Moreover, the adjustment node satisfying the preset first condition may be an adjustment node with a large performance parameter and/or a good link quality, or may be an adjustment node with a small performance parameter and/or a poor link quality.

And S604, in response to the fact that the retransmission node with the retransmission request exists in the adjustment node, the second time slot resource is allocated to the adjustment node and the retransmission node so as to instruct the retransmission node to retransmit the image data by using the second time slot resource, or instruct the adjustment node to transmit the corresponding image data by using the second time slot resource.

Specifically, when there is a retransmission node having a retransmission request among the adjustment nodes, since the retransmission node also needs to retransmit the image data using the slot resources. The video source may allocate the second time slot resource to the retransmission node, or may allocate the second time slot resource to the adjustment node in order to fully utilize the second time slot resource. At this time, the retransmission node may retransmit the image data using the second slot resource, and the adjustment node may normally transmit the image data using the second slot resource. The method not only meets the requirement of the retransmission node for the retransmission request, but also meets the transmission requirement of the adjustment node for normal image data transmission, and uses the same second time slot resource for retransmission and normal image data transmission, thereby reducing the occupation of excessive time slot resources under the condition of the retransmission request and improving the resource utilization rate.

S606, responding to the type of the parameter of the adjusting node to meet a preset second condition, classifying the adjusting node into a first adjusting node and a second adjusting node according to the preset second condition, and distributing a third time slot resource to the first adjusting node and the second adjusting node so as to instruct the first adjusting node and the second adjusting node to transmit image data by using the third time slot resource.

S608, acquiring the image data corresponding to the second adjustment node transmitted by using the third time slot resource, and transmitting the correction image data by using the third time slot resource, wherein the correction image data is used for checking and correcting the image data transmitted by the second adjustment node.

Specifically, when there is an adjustment node whose parameter type satisfies a preset second condition in the adjustment nodes, it may be determined that there are an adjustment node whose link quality of the transmission channel is good and an adjustment node whose link quality is poor in the adjustment nodes at the same time, and/or there are adjustment nodes whose performance parameters are large and small in the adjustment nodes at the same time. At this time, the adjustment node having a good link quality may be classified as a first adjustment node, and the adjustment node having a poor link quality may be classified as a second adjustment node. The third slot resource is then allocated to the first and second adjustment nodes. The first and second adjustment nodes may utilize the third slot resources to transmit image data. The first adjustment node is an adjustment node with good link quality and/or high performance parameter, and in order to meet the performance parameter of the first adjustment node and improve the throughput of the video image processing system, a third time slot resource can be set according to the time slot resource used by the first adjustment node. Since the second adjustment node is typically an adjustment node with poor link quality and/or low performance parameters, the second adjustment node may not be fully utilized when using the third slot resources. The second adjustment node can select its own image data within the image data range specified by the video source by using the third time slot resource. And the extra unused part of the third time slot resource is used for checking the image data of the second adjusting node so as to ensure the correctness of the image data transmitted currently, thereby reducing the retransmission times. The video source can acquire the image data acquired by the second adjusting node by using the third time slot resource, and then correct and check the image data transmitted by the second adjusting node by using the third time slot resource again. If the image data transmitted by the second adjustment node is wrong, the video source can correct the image data transmitted by the second adjustment by utilizing the image data in the third time slot resource, so that the retransmission times are reduced.

In this embodiment, the requirements of different adjustment nodes can be purposefully satisfied according to the real-time requirements of the video image processing system, and meanwhile, the transmission of image data with different purposes, such as the transmission of normal image data, the transmission of retransmission image data, and the like, can be considered.

In one embodiment, the method further comprises: and responding to the plurality of adjustment nodes, wherein the adjustment nodes fail to be classified and adjusted, selecting a matched classification adjustment mode based on the types of parameters of the adjustment nodes fail to be classified and adjusted, and performing classification adjustment on the adjustment nodes fail to be classified and adjusted until the classification adjustment of the adjustment nodes fail to be classified and adjusted is successful.

Specifically, if there are multiple adjustment nodes, the video source needs to perform classification adjustment on each adjustment node in the manner mentioned in the above embodiment, and each adjustment node may feed back the result of classification adjustment. When the video source determines that there is an adjustment node that fails in the classification adjustment, the classification adjustment mode of matching may be selected again based on the type of the parameter of the adjustment node that fails in the classification adjustment. If the classification adjustment modes matched by the adjustment node are multiple, and one of the multiple is selected, the classification adjustment modes can be selected in other modes besides the selected one. If the previous matching classification adjustment mode of the adjustment node is one, the adjustment node can be classified and adjusted again according to the classification adjustment mode until the classification adjustment of the adjustment node with failed classification adjustment is successful.

In some exemplary embodiments, the video source will typically specify an adjustment list that contains a set of one or more classification-adjustable transmission nodes (adjustment nodes) associated with the matching classification adjustment. And establishing matching pairs according to the adjusting nodes and the matched classification adjustment modes, and sequentially attempting classification adjustment in the matching pairs. If the classification adjustment is to be performed as a distribution topology (for example, a distribution topology is described), after the classification adjustment is successful, the link topology establishment attempt is stopped for other adjustment nodes in the matching pair and transmission channels and other levels for establishing the link topology. When the classification adjustment fails, the other adjustment nodes in the matching pair continue to establish the link topology in sequence until the classification adjustment is successful. If all the matched pairs do not successfully establish the link topology, the adjusting node feeds back failure information. After the video source receives the failure information, the adjustment list is reassigned, and new classification adjustment is started until the link topology is successfully established.

In this embodiment, by performing the reclassification adjustment for the reclassification adjustment failure, the throughput of the video image processing system can be effectively improved.

In one embodiment, the method further comprises: and sending optimization information to the adjusting node, wherein the optimization information is used for indicating the adjusting node to adjust the performance parameters of the adjusting node.

Specifically, the video source may send optimization information to the transmission node, where the optimization information instructs the transmission node to perform an optimal configuration on its own link quality and performance parameters, such as, but not limited to, changing the transmission power of the transmission node, the performance parameters of the transmission node, changing the channel and/or link topology level of the transmission node, and so on. By changing the configuration, the video source achieves the highest image data transmission payload for image data transmission of a transmission node on a high-quality channel and/or link topology, and the throughput of the video image processing system is remarkably improved. Meanwhile, for the transmission node with the retransmission request, the retransmission image data and the normal image data are transmitted in the same time slot, so that the normal video transmission of the transmission node with the retransmission and the recovery of the failed image data transmission is simultaneously carried out, the normal image data transmission is completed, the interruption of the normal image data transmission caused by the retransmission request is avoided, and the image data transmission efficiency is obviously improved. In addition, the optimization of the performance parameters of the transmission nodes in the collaborative transmission can be optimized, the image data transmission efficiency is improved as much as possible while the effective image data transmission is completed, and the image data transmission efficiency of the transmission nodes in the video image system is greatly improved as a whole.

In one embodiment, the video source and the adjustment node communicate using a preset adjustment frame; the structure of the adjustment frame is obtained based on a standard frame structure. As shown in fig. 9, a schematic diagram of a standard frame structure provided in an embodiment of the disclosure, where the standard frame structure may include: BS (Blanking Start), VB-ID (Vertical Blanking Identifier, field Blanking flag), mvid (timer value of Video data), naud (timer value of audio data), dummy Video (for Dummy data padding), BE (Blanking End), pixel data (for transmission of image data), FS (Fill Start), fill Video (padding data for padding when data is not sufficient), FE (Fill End). The structure of the adjustment frame may be obtained by adding a new time slot to the standard frame structure, as shown in fig. 10, where the structure of the adjustment frame at least includes: enabling time slots, quality testing time slots and determining time slots by a classification adjustment mode.

The method comprises enabling time slots, wherein the enabling time slots are used for enabling/disabling the classification adjustment method, and when the classification adjustment method is disabled, the standard frame structure is used by default so as to improve the throughput of the video image processing system; when enabled, the adjust frame is used by default. When the video source detects that the throughput in the image processing system meets the preset condition, the enabling time slot can be started, and then the video source utilizes the structure of the adjustment frame to determine the adjustment node which needs to be subjected to classification adjustment in the transmission nodes.

A quality test time slot for performing quality test of the adjustment node in the multi-channel using a special link quality test sequence; the special link quality test Sequence may be a Pseudo-Random Sequence (PRS), a K code, or a Sequence preset by the video source according to a transmission duration period, for example, 6 Random sequences are generated according to a duration period of 1ms, 2ms, 5ms, 10ms, 15ms, and 20ms, when the adjusting node receives these sequences, which duration period Sequence can be correctly received, and then the adjusting node will be recorded as the duration period type by the video source, and determines the link quality of the transmission channel of the adjusting node according to the duration period type, and further determines the type of the link quality of the transmission channel. The video source may perform quality testing on the adjustment node based on the quality test time slot, and determine a type of a parameter of the adjustment node, where the parameter includes: at least one of link quality and performance parameters of the transmission channel.

The classification adjustment mode determines a time slot for the video source to select the classification adjustment mode. The specific classification adjustment manner can be referred to the above embodiments, and repeated descriptions are omitted herein. The video source may determine a time slot by using a classification adjustment mode based on a type of a parameter of an adjustment node, select a matched classification adjustment mode, and perform classification adjustment on the adjustment node to instruct the adjustment node after the classification adjustment to transmit corresponding image data, where the classification adjustment includes: classifying the adjusting nodes according to the types of the parameters, and distributing the classified adjusting nodes to different topological structures, or adjusting the time slot resources used by the classified adjusting nodes.

Furthermore, the structure of the adjustment frame can also comprise a matching time slot, and the video source determines the time slot based on the classification adjustment mode to determine the adjustment node and the matching classification adjustment mode. The video source then specifies an adjustment list using the matching time slots, which contains a set of one or more classification-adjustable transmission nodes (adjustment nodes) associated with the matching classification adjustment. And establishing matching pairs according to the adjusting nodes and the matched classification adjustment modes, and then carrying out classification adjustment on the adjusting nodes based on the sequence of the matching pairs.

The structure of the adjustment frame may further include: and the optimizing time slot is used for sending optimizing information to the transmission node, and the optimizing information is used for indicating the transmission node to adjust the performance parameters of the transmission node.

The structure of the adjustment frame may further include: and the feedback time slot is used for adjusting state confirmation and feedback between the node and the video source.

It should be noted that, for the specific implementation and limitation in this embodiment, reference may be made to the explanation of the foregoing embodiment, and the repeated description is omitted here.

In one embodiment, the video source and the adjustment node communicate using preset adjustment signaling; the adjustment signaling includes at least: enabling a field, testing quality, determining a field by a classification adjustment mode;

The adjusting signaling may further include: a match field, an optimization field, and a feedback field. For specific embodiments of the adjustment signaling, reference may be made to the embodiments of the adjustment frames described above. The enabling field and the enabling time slot have the same function, the quality test field and the quality test time slot have the same function, and the classification adjustment mode determining field and the classification adjustment mode determining time slot have the same function. The matching field and the matching time slot have the same function, the optimizing field and the optimizing time slot have the same function, and the feedback field and the feedback time slot have the same function.

It should be understood that, although the steps in the flowcharts related to the embodiments described above are sequentially shown as indicated by arrows, these steps are not necessarily sequentially performed in the order indicated by the arrows. The steps are not strictly limited to the order of execution unless explicitly recited herein, and the steps may be executed in other orders. Moreover, at least some of the steps in the flowcharts described in the above embodiments may include a plurality of steps or a plurality of stages, which are not necessarily performed at the same time, but may be performed at different times, and the order of the steps or stages is not necessarily performed sequentially, but may be performed alternately or alternately with at least some of the other steps or stages.

Based on the same inventive concept, the embodiments of the present disclosure further provide a classification adjustment device for a transmission node, which is used to implement the above-mentioned classification adjustment method for a transmission node. The implementation of the solution provided by the apparatus is similar to the implementation described in the above method, so the specific limitation in the embodiments of the classification adjustment apparatus for one or more transmission nodes provided below may refer to the limitation of the classification adjustment method for a transmission node in the above description, which is not repeated here.

In one embodiment, as shown in fig. 11, there is provided a classification adjustment device 700 of a transmission node, which is applied to a video source in a video image processing system, the video source being directly or indirectly connected to at least one transmission node, and comprising: an adjustment node determination module 702, a quality test module 704, and a classification adjustment module 706, wherein:

an adjustment node determining module 702 is configured to determine an adjustment node that needs to be subjected to classification adjustment in the transmission nodes in response to detecting that throughput in the video image processing system meets a preset condition.

A quality testing module 704, configured to perform quality testing on the adjustment node, and determine a type of a parameter of the adjustment node, where the parameter includes: at least one of link quality and performance parameters of the transmission channel.

A classification adjustment module 706, configured to select a matched classification adjustment manner based on a type of the parameter of the adjustment node, and perform classification adjustment on the adjustment node to instruct the classification-adjusted adjustment node to transmit corresponding image data, where the classification adjustment includes: classifying the adjusting nodes according to the types of the parameters, and distributing the classified adjusting nodes to different topological structures, or adjusting the time slot resources used by the classified adjusting nodes.

In one embodiment of the apparatus, the classification adjustment module 706 includes: the first adjusting module is used for responding to the type of the parameter of the adjusting node to meet a preset first condition, selecting an adjusting channel from the transmission channels connected with the video source and the transmission node, and adjusting the link topology of the adjusting node meeting the preset first condition into the adjusting channel; or selecting an adjustment channel from transmission channels connected with the video source and the transmission nodes, determining an adjustment level in the adjustment channel, and adjusting the link topology of the adjustment node meeting a preset first condition into the adjustment level of the adjustment channel; wherein the preset first condition includes: and adjusting the link quality of the transmission channel between the nodes and/or the difference of the performance parameters within a preset first range.

In one embodiment of the apparatus, the classification adjustment module 706 includes: the second adjustment module is configured to select a matched classification adjustment mode based on the type of the parameter of the adjustment node, and perform classification adjustment on the adjustment node, where the second adjustment module includes:

and in response to the type of the parameter of the adjustment node meeting a preset second condition, classifying the adjustment node into a first adjustment node and a second adjustment node according to the preset second condition, wherein the second condition comprises: adjusting the link quality of a transmission channel between nodes, and/or enabling the difference of performance parameters to be larger than a preset difference threshold; adjusting the link topology of the first adjusting node into a first transmission channel of a transmission channel, and adjusting the link topology of the second adjusting node into a second transmission channel of the transmission channel, wherein the first transmission channel and the second transmission channel are different; or, adjusting the link topology of the first adjusting node into a first level of a transmission channel, and adjusting the link topology of the second adjusting node into a second level of the transmission channel, wherein the first level and the second level are different.

In an embodiment of the apparatus, the link quality of the transmission channel comprises: round trip delay between the video source and the adjustment node; the classification adjustment module 706 includes: a third adjustment module, configured to classify the adjustment node and the transmission channel according to a preset fixed delay step length and the round trip delay in response to the round trip delay being less than a preset end delay threshold; and adjusting the link topology of the classified adjusting node into the classified transmission channel, or adjusting the link topology of the classified adjusting node into different levels of the classified transmission channel.

In one embodiment of the apparatus, the apparatus further comprises: and the reconfiguration module is used for reconfiguring the performance parameters of the adjustment node until the round-trip delay is smaller than a preset end delay threshold value in response to the round-trip delay being larger than or equal to the preset end delay threshold value.

In one embodiment of the apparatus, the classification adjustment module 706 includes: a fourth adjustment module, configured to allocate a first timeslot resource to an adjustment node in response to a type of a parameter of the adjustment node meeting a preset first condition, so as to instruct the adjustment node to transmit corresponding image data by using the first timeslot resource; in response to the existence of a retransmission node with a retransmission request in the adjustment node, allocating a second time slot resource to the adjustment node and the retransmission node so as to instruct the retransmission node to retransmit image data by using the second time slot resource, or instruct the adjustment node to transmit corresponding image data by using the second time slot resource; responding to the type of the parameter of the adjusting node to meet a preset second condition, classifying the adjusting node into a first adjusting node and a second adjusting node according to the preset second condition, and distributing a third time slot resource to the first adjusting node and the second adjusting node so as to instruct the first adjusting node and the second adjusting node to transmit image data by utilizing the third time slot resource; and acquiring the image data corresponding to the second adjustment node transmitted by using the third time slot resource, and transmitting the correction image data by using the third time slot resource, wherein the correction image data is used for checking and correcting the image data transmitted by the second adjustment node.

In one embodiment of the apparatus, the apparatus further comprises: and the retry module is used for responding to the plurality of adjustment nodes, and if the adjustment nodes which fail in classification adjustment exist, selecting a matched classification adjustment mode based on the types of the parameters of the adjustment nodes which fail in classification adjustment, and carrying out classification adjustment on the adjustment nodes which fail in classification adjustment until the adjustment nodes which fail in classification adjustment succeed in classification adjustment.

In one embodiment of the apparatus, the apparatus further comprises: and the optimizing module is used for sending optimizing information to the transmission node, wherein the optimizing information is used for indicating the transmission node to adjust the performance parameters of the transmission node.

In one embodiment of the apparatus, the apparatus further comprises: the first communication module is used for enabling the video source to communicate with the adjusting node by using a preset adjusting frame; the structure of the adjustment frame at least comprises: enabling a time slot, a quality test time slot and a classification adjustment mode to determine the time slot, wherein the structure of the adjustment frame is obtained based on a standard frame structure;

In one embodiment of the apparatus, the apparatus further comprises: the second communication module is used for enabling the video source to communicate with the adjusting node by using preset adjusting signaling; the adjustment signaling includes at least: enabling a field, testing quality, determining a field by a classification adjustment mode;

The above-mentioned respective modules in the classification adjustment device of the transmission node may be implemented in whole or in part by software, hardware, and combinations thereof. The above modules may be embedded in hardware or may be independent of a processor in the computer device, or may be stored in software in a memory in the computer device, so that the processor may call and execute operations corresponding to the above modules.

In one embodiment, a computer device is provided, which may be a server, and the internal structure of which may be as shown in fig. 12. The computer device includes a processor, a memory, and a network interface connected by a system bus. Wherein the processor of the computer device is configured to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, computer programs, and a database. The internal memory provides an environment for the operation of the operating system and computer programs in the non-volatile storage media. The network interface of the computer device is used for communicating with an external terminal through a network connection. The computer program is executed by a processor to implement a method of classification adjustment of a transmission node.

Those skilled in the art will appreciate that the structures shown in FIG. 12 are only block diagrams of portions of structures associated with the disclosed aspects and are not limiting as to the computer device on which the disclosed aspects may be implemented, and that a particular computer device may include more or less components than those shown, or may combine some of the components, or have a different arrangement of components.

In one embodiment, a computer device is provided, comprising a memory and a processor, the memory having stored therein a computer program, the processor implementing the steps of any of the method embodiments described above when the computer program is executed.

In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored which, when executed by a processor, implements the steps of the method embodiments described above.

In an embodiment, a computer program product is provided comprising a computer program which, when executed by a processor, implements the steps of any of the method embodiments described above.

Those skilled in the art will appreciate that implementing all or part of the above described methods may be accomplished by way of a computer program stored on a non-transitory computer readable storage medium, which when executed, may comprise the steps of the embodiments of the methods described above. Any reference to memory, database, or other medium used in embodiments provided by the present disclosure may include at least one of non-volatile and volatile memory, among others. The nonvolatile Memory may include Read-Only Memory (ROM), magnetic tape, floppy disk, flash Memory, optical Memory, high density embedded nonvolatile Memory, resistive random access Memory (ReRAM), magnetic random access Memory (Magnetoresistive Random Access Memory, MRAM), ferroelectric Memory (Ferroelectric Random Access Memory, FRAM), phase change Memory (Phase Change Memory, PCM), graphene Memory, and the like. Volatile memory can include random access memory (Random Access Memory, RAM) or external cache memory, and the like. By way of illustration, and not limitation, RAM can be in the form of a variety of forms, such as static random access memory (Static Random Access Memory, SRAM) or dynamic random access memory (Dynamic Random Access Memory, DRAM), and the like. The databases referred to in the various embodiments provided by the present disclosure may include at least one of a relational database and a non-relational database. The non-relational database may include, but is not limited to, a blockchain-based distributed database, and the like. The processors involved in the embodiments provided by the present disclosure may be general-purpose processors, central processing units, graphics processors, digital signal processors, programmable logic, quantum computing-based data processing logic, etc., without limitation thereto.

The technical features of the above embodiments may be arbitrarily combined, and all possible combinations of the technical features in the above embodiments are not described for brevity of description, however, as long as there is no contradiction between the combinations of the technical features, they should be considered as the scope of the description.

The foregoing examples have expressed only a few embodiments of the present disclosure, which are described in more detail and detail, but are not to be construed as limiting the scope of the present disclosure. It should be noted that variations and modifications can be made by those skilled in the art without departing from the spirit of the disclosure, which are within the scope of the disclosure. Accordingly, the scope of the present disclosure should be determined from the following claims.

Claims

1. A method for classification adjustment of transmission nodes, applied to a video source in a video image processing system, the video source being directly or indirectly connected to at least one transmission node, the method comprising:

2. The method according to claim 1, wherein selecting a matching classification adjustment mode based on the type of the parameter of the adjustment node, and performing classification adjustment on the adjustment node includes:

3. The method according to claim 1, wherein selecting a matching classification adjustment mode based on the type of the parameter of the adjustment node, and performing classification adjustment on the adjustment node includes:

4. The method of claim 1, wherein the link quality of the transmission channel comprises: round trip delay between the video source and the adjustment node; the selecting a matched classification adjustment mode based on the type of the parameter of the adjustment node, and performing classification adjustment on the adjustment node comprises the following steps:

5. The method according to claim 4, wherein the method further comprises:

6. The method according to claim 1, wherein selecting a matching classification adjustment mode based on the type of the parameter of the adjustment node, and performing classification adjustment on the adjustment node to instruct the classification-adjusted adjustment node to transmit corresponding image data, includes:

7. The method according to any one of claims 1 to 6, further comprising:

8. The method according to any one of claims 1 to 6, further comprising: and sending optimization information to the transmission node, wherein the optimization information is used for indicating the transmission node to adjust the performance parameters of the transmission node.

9. The method according to any one of claims 1 to 6, wherein the video source and the adjustment node communicate using preset adjustment frames; the structure of the adjustment frame at least comprises: enabling a time slot, a quality test time slot and a classification adjustment mode to determine the time slot, wherein the structure of the adjustment frame is obtained based on a standard frame structure;

10. The method according to any one of claims 1 to 6, wherein the video source and the adjustment node communicate using preset adjustment signaling; the adjustment signaling includes at least: enabling a field, testing quality, determining a field by a classification adjustment mode;

11. A classification adjustment device for a transmission node, for use with a video source in a video image processing system, the video source being directly or indirectly coupled to at least one transmission node, the device comprising:

12. A computer readable storage medium, on which a computer program is stored, characterized in that the computer program, when being executed by a processor, implements the steps of the method of any of claims 1 to 10.