CN115150286A

CN115150286A - Transmission node changing method, device, computer equipment and storage medium

Info

Publication number: CN115150286A
Application number: CN202210766408.4A
Authority: CN
Inventors: 魏巍; 殷建东
Original assignee: Suzhou HYC Technology Co Ltd
Current assignee: Suzhou HYC Technology Co Ltd
Priority date: 2022-07-01
Filing date: 2022-07-01
Publication date: 2022-10-04
Anticipated expiration: 2042-07-01
Also published as: CN115150286B

Abstract

The disclosure relates to a transmission node changing method, a transmission node changing device, computer equipment and a storage medium. The method comprises the following steps: determining a transmission node to be changed under the condition that the transmission condition or the topological structure of the transmission link is changed; under the condition that a change enabling time slot in a change frame structure is enabled, adjusting the time slot according to a link topology in the change frame structure, adjusting a transmission link topology of a transmission node to be changed, and adjusting resources occupied by the transmission node to be changed by the change frame structure, wherein the change frame structure is obtained by placing the time slot in a standard data frame structure and adding the newly enabled time slot, and the placing of the time slot comprises: at least one of a time slot, a virtual video time slot and a filling video time slot which are pre-allocated in a standard frame; and determining a change result of the transmission node to be changed according to the change confirmation time slot in the change frame structure. By adopting the method, signaling interaction can be carried out only once, and resources occupied by the nodes and/or the video terminals and the link topology structure can be adjusted.

Description

Transmission node changing method, device, computer equipment and storage medium

Technical Field

The present disclosure relates to the field of data processing technologies, and in particular, to a method and an apparatus for changing a transmission node, a computer device, and a storage medium.

Background

At present, a Video image system, especially a Video image processing system with DisplayPort (DP) of VESA (Video Electronics Standards Association), MIPI (Mobile Industry Processor Interface standard), and HDMI (High Definition Multimedia Interface standard) is used to drive and Display a Display panel and a terminal such as Liquid Crystal Display (LCD), organic Light-Emitting Diode (OLED), etc., when a transmission condition or a topology structure of a Video transmission link changes, a large number of transmission states of nodes and/or Video terminals may change, and further signaling interaction needs to be performed on each node and/or Video terminal for many times, so as to change and adjust resources occupied by each node and/or Video terminal and further increase overhead of the Video image processing system.

Disclosure of Invention

In view of the above, there is a need to provide a method for performing signaling interaction only once, A transmission node changing method, apparatus, computer device, storage medium capable of adjusting resources occupied by a node and/or a video terminal and a link topology.

In a first aspect, the present disclosure provides a transmission node changing method. The method is applied to a video source in a video image processing system, wherein the video source changes a transmission node to be changed by changing a frame structure, and the method comprises the following steps:

determining a transmission node to be changed under the condition that the transmission condition or the topological structure of the transmission link is changed;

when a change enabling time slot in a change frame structure is enabled, adjusting the time slot according to a link topology in the change frame structure, adjusting a transmission link topology of the transmission node to be changed, and adjusting resources occupied by the transmission node to be changed through the change frame structure, wherein the change frame structure is obtained by placing a time slot in a standard data frame structure and adding a newly enabled time slot, and the placing of the time slot comprises: at least one of a time slot pre-allocated in a standard frame, a virtual video time slot and a filling video time slot;

and determining a change result of the transmission node to be changed according to a change confirmation time slot in the change frame structure, wherein the change confirmation time slot is obtained by the feedback of the transmission node to be changed and is used for determining the change result.

In one embodiment, the changing the newly enabled time slot in the frame structure includes: change enable time slot, link topology adjustment time slot, change time slot and change confirm time slot:

the change enabling time slot is used for determining whether to enable the change frame structure;

the link topology adjusting timeslot is used for determining whether to adjust a transmission link topology structure and determining a topology table, where the topology table includes connection relationships of all transmission nodes in the video transmission link;

the change time slot is used for allocating a change allocation table of the transmission node to be changed, and the change allocation table is used for indicating resources used by the transmission node to be changed;

and the change confirmation time slot is used for determining a change result of the transmission node to be changed.

In one embodiment, the obtaining of the modified frame structure includes:

under the condition that the virtual video time slot or the filling video time slot meets the newly started time slot, the placement time slot comprises a virtual video time slot or a filling video time slot, and the newly started time slot is added into the virtual video time slot or the filling video time slot to obtain a changed frame structure;

under the condition that the virtual video time slot or the filling video time slot does not meet the newly started time slot, the placement time slot comprises a virtual video time slot and a filling video time slot, and the newly started time slot is added into the virtual video time slot and the filling video time slot to obtain a changed frame structure;

in the event that the virtual video slots and the filler video slots do not satisfy the newly enabled slots, the put slots include pre-allocated slots in a standard data frame, virtual video slots, and filler video slots, and adding a newly started time slot in the pre-allocated time slot, the virtual video time slot and the filling video time slot to obtain a changed frame structure.

In one embodiment, the adjusting the transmission link topology of the transmission node to be changed according to the link topology adjustment timeslot in the change frame structure includes:

and under the condition of determining to adjust the transmission link topology according to the link topology adjustment time slot, determining the connection relation of the transmission nodes to be changed in the video transmission link, and adjusting the transmission link topology of the transmission nodes to be changed according to the connection relation.

In one embodiment, the determining a transmission node to be changed when the transmission condition or the topology structure of the transmission link changes includes:

determining the transmission state of each transmission node under the condition that the transmission condition or the topological structure of the transmission link changes;

and determining the transmission node to be changed according to the transmission node with the changed transmission state.

In one embodiment, the transmission state includes at least:

the silent state represents that the transmission node does not display the video data and transmits the video data to other transmission nodes;

a physical channel change state, which represents that the number of physical channels used by the transmission node is increased or decreased;

the physical channel grouping state is used for representing that the physical channels used by the transmission nodes are grouped, and the grouped physical channels are respectively used for displaying the video data and transmitting the video data values of other transmission nodes;

caching a transmission state, representing that the transmission node cannot normally display the received video data, displaying the video data by using the cached video data, and transmitting the video data to other transmission nodes;

a normal display state, which represents that the transmission node uses the pre-distributed resources of the video source to normally display the video data;

a dormant state, which represents that the physical link of the transmission node is completely closed;

and the energy-saving state is used for representing that the transmission node normally displays according to the lowest performance index, wherein the performance index comprises the following steps: resolution, frame rate, number of physical channels and link rate;

and in the no video state, the transmission node is used for displaying the cached video data in a preset time.

In one embodiment, the method further comprises: and under the condition that the state of the transmission node is a dormant state or a video-free state or the video source cannot communicate with the transmission node through signaling, communicating with the transmission node through a special sequence field.

In a second aspect, the present disclosure further provides a transmission node changing apparatus. The device is applied to a video source in a video image processing system, the video source changes a transmission node to be changed through a transmission link and a change frame structure, and the device comprises:

the node to be changed determining module is used for determining the transmission node to be changed under the condition that the transmission condition or the topological structure of the transmission link is changed;

a changing module, configured to adjust a transmission link topology of the transmission node to be changed according to a link topology adjustment timeslot in a changed frame structure when a change enabling timeslot in the changed frame structure is enabled, and send video data to the transmission node to be changed through the changed frame structure, where the changed frame structure is obtained by placing a timeslot in a standard data frame structure to fill a newly enabled timeslot, and the placing of the timeslot includes: at least one of a time slot, a virtual video time slot and a filling video time slot which are pre-allocated in a standard frame;

and the feedback module is used for determining a change result of the transmission node to be changed according to a change confirmation time slot in the change frame structure, wherein the change confirmation time slot is obtained by the feedback of the transmission node to be changed and is used for determining the change result.

In a third aspect, the present disclosure also provides a computer device. The computer device comprises a memory storing a computer program and a processor implementing the steps of the above method when executing the computer program.

In a fourth aspect, the present disclosure also provides a computer-readable storage medium. The computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the steps of the above-mentioned method.

In a fifth aspect, the present disclosure also provides a computer program product. The computer program product comprises a computer program which, when executed by a processor, carries out the steps of the above-mentioned method.

In the above embodiments, the transmission node to be changed is determined when the transmission condition or the topology structure of the transmission link changes. Only the transmission node to be changed can be processed without changing all the transmission nodes in the transmission link, the processing speed of the system can be improved, and other transmission nodes cannot be influenced. When a transmission node to be changed needs to be changed, a change frame structure is started, under the condition that a change enabling time slot in the change frame structure is started, the time slot is adjusted according to the link topology in the change frame structure, the transmission link topology of the transmission node to be changed is adjusted, resources occupied by the transmission node to be changed are adjusted through the change frame structure, and the change frame structure is obtained by placing the time slot in a standard data frame structure and adding the newly started time slot. Therefore, extra time slots are not occupied, and the overhead of the system can be reduced. And the video source and the transmission node to be changed carry out signaling interaction only once through changing the frame structure, namely, the transmission is carried out through changing the frame structure. Multiple interactions are not needed, and the overhead of a video image processing system can be reduced.

Drawings

In order to more clearly illustrate the embodiments of the present disclosure or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present disclosure, and other drawings can be obtained by those skilled in the art without creative efforts.

FIG. 1 is a schematic diagram of a video image processing system according to an embodiment;

FIG. 2 is a schematic diagram of a transmission link topology in one embodiment;

FIG. 3 is a flow diagram illustrating a method for transmission node change in one embodiment;

FIG. 4 is a diagram illustrating an alternate frame structure in one embodiment;

FIG. 5 is a diagram of a standard data frame structure in one embodiment;

FIG. 6 is a flow diagram illustrating a process change frame structure in one embodiment;

FIG. 7 is a flowchart illustrating the step S202 according to an embodiment;

fig. 8 is a block diagram schematically illustrating a configuration of a transfer node changing apparatus according to an embodiment;

FIG. 9 is a diagram illustrating an internal structure of a computer device according to an embodiment.

Detailed Description

In order to make the objects, technical solutions and advantages of the present disclosure more clearly understood, the present disclosure is further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the present disclosure and are not intended to limit the present disclosure.

It should be noted that the terms "first," "second," and the like in the description and claims herein and in the above-described drawings are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments herein described are capable of operation in sequences other than those illustrated or described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, apparatus, article, or device that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or device.

In this document, the term "and/or" is only one kind of association relationship describing the associated object, meaning that three kinds of relationships may exist. For example, a and/or B, may represent: a exists alone, A and B exist simultaneously, and B exists alone. In addition, the character "/" herein generally indicates that the former and latter associated objects are in an "or" relationship.

As described in the background art, when nodes and/or video terminals with different capabilities in a multi-channel video data transmission link topology transmit video data and image data, due to changes in transmission conditions or link topology structures, transmission states of a large number of nodes and/or video terminals themselves may change dynamically. The state of the node and/or the video terminal which are dynamically changed can be changed and adjusted by the video source, and the resource (time slot) occupied by the node and/or the video terminal after the state adjustment is updated. However, in the process of adjusting or updating the video source, the overhead of the video image processing system is significantly increased by signaling interaction when the transmission state of the video data changes dynamically, so that the effective load of the system is reduced, and the throughput is further reduced. In general, if a large number of nodes and/or video terminals need to be changed and adjusted, the video source needs to perform signaling interaction once for each node and/or video terminal and complete the change and adjustment, thereby increasing the overhead of the whole video image processing system. Wherein the change of the transmission condition may include: the change of the transmission distance causes the change of the error rate, the performance change of the node and/or the video terminal, the change of the link topology structure and the like. The transmission state may include retransmission, error correction, change in pixel data, and the like Lane number change, link rate change, frame change, etc.

Therefore, to solve the above problem, embodiments of the present disclosure provide a transmission node changing method, apparatus, computer device, and storage medium.

First, as shown in fig. 1, a video image processing system according to the present disclosure is provided. The video image processing system includes: the device comprises an embedded control module, an FPGA module, an external storage module, a fast storage module, a peripheral module, a video interface physical layer realization module and a video transmission link.

The embedded control module can use any embedded chip and system, and is mainly responsible for initiating signaling interaction, such as reading/writing a register, enabling/closing a video display module, peripheral control, parameter setting of the video display module and the like. The FPGA module is mainly responsible for implementing the implementation parts which need a large amount of data processing and low round-trip delay (latency) such as storage control, peripheral control, video interface IP core implementation and the like. The external storage module is mainly responsible for storing original data streams of video images needing to be displayed in the video image processing system, and the part is applied to storage media such as NandFlash, SSD and the like, but is not limited to the storage media. The fast storage module is used in an implementation process that requires a large amount of data processing and low round-trip delay (latency) inside an FPGA module, and in order to reduce the delay and delay storage, the module applies a fast and low-delay physical device, such as DDR3, but is not limited thereto. The peripheral modules include GPIO (General-purpose input/output), UART (Universal Asynchronous Receiver/Transmitter), USB (Universal Serial Bus), network interface, and the like, but are not limited thereto. The video interface physical layer implementation module is mainly responsible for the physical layer implementation required for driving the display module, such as, but not limited to, TX/RX (Transmitter/Receiver) -PHY of DisplayPort, DPHY of MIPI, and the like.

Furthermore, the FPGA module includes a bus interaction module, an MCU (micro controller Unit, micro control module) video stream preprocessing module, a video data stream transmission control module, a clock control module, an embedded soft core control module, a bus controller module, an internal storage controller module, an external control module, a display clock generator module, a video timing controller module, and a video interface IP core module. The bus interaction module is mainly responsible for the functions of selection, decision and the like of all other modules connected to the bus interaction module. The MCU video stream preprocessing module is mainly responsible for preprocessing and converting the video data stream input from the external storage module according to the format and parameter types set by the system so as to facilitate the post-processing. And the video data stream transmission control module is mainly responsible for controlling the time sequence, parameters and the like of the data stream after data stream preprocessing and conversion. And the clock control module is mainly responsible for generating and controlling a global clock in the video image processing system. The embedded soft core control module is a control core of the FPGA module, and is mainly responsible for core functions of timing control, parameter configuration, physical process implementation and the like of all modules inside the FPGA module, and the embedded soft core control module can be used in the implementation of the core functions, such as Xilinx MicroBlaze and the like, but is not limited to the implementation. The bus controller module is mainly responsible for controlling all modules connected with the bus interaction module, but is not limited to the bus controller module. The video pattern processing module is mainly responsible for mode conversion, timing control and the like of a video image data stream corresponding to the video interface IP core module, but is not limited thereto. The internal storage controller module is mainly responsible for controlling the fast storage module, including but not limited to writing/reading of data stream, frame control, and the like. The peripheral control module is mainly responsible for controlling all the peripheral modules, including enabling/shutting down of the peripheral, controlling the working mode, and the like, but not limited thereto. The display clock generator module is mainly responsible for timing control of all modules, including but not limited to the video interface IP core module and the video interface physical layer implementation module. The video timing controller module is mainly responsible for data conversion, timing control and other processing when the data input from the video pattern processing module is transmitted to the video interface IP core module, but is not limited thereto.

The transmission link (video transmission link) comprises: video source (video transmission source), transport node (embedded physical repeater, cable with source ID, detachable physical repeater, video sink, etc.), but is not limited thereto. And the video source changes the transmission node to be changed by changing the frame structure.

Fig. 2 shows a transmission link topology structure diagram of the present disclosure, which includes a video source, and corresponds to a centralized control node. As shown in fig. 2, most of the transmission link topologies to which the present disclosure relates can include the following four categories: video source → node 1 → video device 1, video device 2 and video device 3. The video device 3 can also be connected directly to a video source. I.e. video source → video device 3. Video source → node 2 → video device 4 and video device 5. Video source → node 3 → video device 6, video device 7, video device 8 and video device 9. Video source → video device 6. Video source → node 4 → node 5 → video device 11. The data transmission process involved in this embodiment may be sending video data for a video source to various nodes or video devices. And each node issues video data to each video device. Each video device displays video data. In the embodiment of the present disclosure, the video source may transmit the video data by changing the frame structure in the embodiment of the present disclosure.

In one embodiment, as shown in fig. 3, a transmission node changing method is provided, which is described by taking the method as an example of being applied to a video source in the video image processing system in fig. 1. It can be understood that the method can also be applied to video sources in other video image processing systems, the video source changes the transmission node to be changed by changing the frame structure, and the method comprises the following steps:

s202, under the condition that the transmission condition or the topological structure of the transmission link is changed, the transmission node to be changed is determined.

The transmission conditions may include, among other things, transmission conditions between the video source and each of the transport nodes, and transmission conditions between the individual transport nodes. The transmission node in this embodiment may include: a node and/or a video device. The change in transmission conditions may include: a change in bit error rate due to a change in transmission distance; a change in a performance parameter of the node and/or video device, a performance parameter such as a currently supportable resolution parameter, a refresh rate parameter, etc. Changes in the topology of the transmission link can cause the nodes and/or video devices to change topology throughout the transmission link. For example, the topology of the previous video device a is: video source → node a → video device a. Changing to the following steps: video source → video device a, so that it can be determined that the topology of the video device a changes in the transmission link. The change may include an operation to adjust the resources occupied by the node to be changed, its link topology, or some other state corresponding thereto.

Specifically, in the case that the transmission condition or the topology structure of the transmission link changes, the transmission node that needs to adjust the resource or change the topology structure of the link is determined. The transmitting node may be a transmitting node to be changed. The number of transmission nodes to be changed may be one or more.

S204, when the enabled timeslot is enabled in the frame structure, adjusting the timeslot according to the link topology in the frame structure, adjusting the transmission link topology of the transmission node to be changed, and adjusting the resource occupied by the transmission node to be changed by using the frame structure, where the frame structure is obtained by placing a timeslot in a standard data frame structure and adding a newly enabled timeslot, and the placing of the timeslot includes: at least one of pre-allocated time slots, virtual video time slots, and filler video time slots in the standard frame.

The modified frame structure may be a frame structure used for controlling a transmission node to be modified in the embodiment of the present disclosure. It may be a frame structure obtained by adding various preset time slots for controlling the transmission nodes to be changed in the time slots placed in the standard data frame structure, and the time slots may be newly enabled time slots. The put slots may typically be slots resulting from the addition of newly enabled slots in a standard data frame structure. Which may typically include at least one of pre-allocated slots in a standard frame, virtual video slots, and filler video slots. The virtual Video slots may typically be Dummy Video in a standard data frame structure. The filler Video slots may typically be Fill videos in a standard data frame structure. The resource occupied by the transmission node to be changed may be a resource in the whole transmission link that needs to be occupied by the transmission node to be changed after the change.

Specifically, in the case where the change enabling slot is enabled in the change frame structure, it may be determined that the transmission node to be changed is controlled using the change frame structure. And adjusting the transmission link topology of the transmission node to be changed in the whole transmission link according to the link topology adjusting time slot in the frame structure to be changed, and sending the video data to the transmission node to be changed by changing the frame structure under the condition that the node to be changed needs to receive the video data so as to finish the sending of the video data. And adjusting the resources occupied by the transmission node to be changed through the change frame structure. The resources occupied by the transmission node to be changed can be increased, reduced or no resource is occupied, that is, the transmission node to be changed does not display the occupied resources to be 0.

And S206, determining a change result of the transmission node to be changed according to a change confirmation time slot in the change frame structure, wherein the change confirmation time slot is obtained by the feedback of the transmission node to be changed and is used for determining the change result.

The change result may include a result of receiving the video data by the transmission node to be changed, a result of which transmission state is changed, a result of resources occupied after the transmission state is adjusted, and the like, and may also include other results fed back by the transmission node to be changed, and in this embodiment, a specific change result type is not limited.

Specifically, when the video source changes the transmission node to be changed by changing the frame structure, the transmission node to be changed is changed. Since the transfer node to be changed may not be able to communicate with the video source, the video source cannot determine whether the transfer node to be changed is changed completely, i.e. cannot obtain the change result. Therefore, the transmission node to be changed can feed back the change confirmation time slot to the video source, and the video source determines the change result of the transmission node to be changed according to the received change confirmation time slot. Thereby, whether the transmission node to be changed is changed or not can be determined.

In the above method for changing a transmission node, a transmission node to be changed is determined when a transmission condition or a topology structure of a transmission link changes. Only the transmission node to be changed can be processed without changing all the transmission nodes in the transmission link, the processing speed of the system can be improved, and other transmission nodes cannot be influenced. When a transmission node to be changed needs to be changed, a change frame structure is started, under the condition that a change enabling time slot in the change frame structure is started, the time slot is adjusted according to the link topology in the change frame structure, the transmission link topology of the transmission node to be changed is adjusted, resources occupied by the transmission node to be changed are adjusted through the change frame structure, and the change frame structure is obtained by placing the time slot in a standard data frame structure and adding the newly started time slot. Therefore, extra time slots are not occupied, and the overhead of the system can be reduced. And the video source and the transmission node to be changed only carry out one-time signaling interaction through changing the frame structure, namely, the transmission is carried out through changing the frame structure. Multiple interactions are not needed, and the overhead of a video image processing system can be reduced.

In one embodiment, as shown in fig. 4, the changing of the newly enabled time slot in the frame structure includes: change enable slot, link topology adjustment slot, change slot and change confirm slot:

the change time slot is used for allocating a change allocation table of the transmission node to be changed, and the change allocation table is used for indicating the resource used by the transmission node to be changed;

As shown in fig. 5, fig. 5 shows a schematic diagram of a standard data frame structure, which may include: BS (Blanking Start), VB-ID (Vertical Blanking Identifier), mvid (timer value of Video data), naud (timer value of audio data), dummy Video (for Dummy data padding), BE (Blanking End), pixel data (for transmission of Video data), FS (Fill Start, padding Start), fill Video (padding data, for padding when there is insufficient data), and FE (Fill End).

The modified frame structure may be a frame structure obtained by adding a modification enable slot, a link topology adjustment slot, a modification slot, and a modification confirm slot to a standard data frame structure.

And the change enabling time slot is used for determining whether a change frame structure is enabled, and when the change frame structure is enabled, the change of the transmission node to be changed by using the method disclosed by the disclosure can be determined. When no alteration of the frame structure is enabled, then the standard data frame structure will be employed for video data transmission.

A link topology adjustment timeslot, which may generally include a link topology modification enable field for enabling/disabling adjustment of the transmission link topology; and a link topology adjustment update field for determining the topology table after adjusting the transmission link topology structure. The topology table refers to all transmission node connection relations in all transmission link topology structures determined by the video source; once the video source determines the transmission link topology structure, that is, the connection relationship of the transmission nodes is determined, and then the topology table can be obtained.

And the change time slot is used for allocating a change allocation table of the transmission node to be changed when the transmission node to be changed is changed. The change allocation table refers to the details of the resource (time slot) occupied by the video source for all transmission nodes in the link topology structure, and if the table is not available, the transmission nodes cannot know their own resources (time slots), and cannot acquire their own data from the corresponding pixel data.

And the change confirmation time slot is used for the video source to determine the change result of the transmission node to be changed. When the video source cannot determine the transmission state of the transmission node to be changed, if the transmission node to be changed is closed, or data sent by the video source is not received, at this time, the video source cannot position the final change condition of the transmission node to be changed, and feedback of the video source can be completed only through the time slot.

In this embodiment, the newly enabled time slot is added to the standard data frame structure, and the transmission node to be changed may be changed through the newly enabled time slot. The transmission node to be changed can be changed only by changing the frame structure, and the overhead of the system is reduced.

In an embodiment, as shown in fig. 6, the obtaining process of changing the frame structure includes:

s302, under the condition that the virtual video time slot or the filling video time slot meets the newly enabled time slot, the placement time slot comprises a virtual video time slot or a filling video time slot;

s304, adding a newly started time slot in the virtual video time slot or the filling video time slot to obtain a changed frame structure.

Specifically, in the case where any one of the virtual video slot or the filler video slot can be put into a newly enabled slot. The changed frame structure may be obtained by placing the newly enabled time slot in any of the virtual video time slots or the filler video time slots. When the newly enabled time slot is put into any one of the virtual video time slot or the filling video time slot, the virtual video time slot or the filling video time slot has the remaining time slot, and the remaining time slot can be used as the virtual video time slot or the filling video time slot to ensure the compatibility with the standard data frame structure. Meanwhile, occupation of a single time slot is avoided, the effective load is improved, and the throughput is further improved.

S306, under the condition that the virtual video time slot or the filling video time slot does not meet the newly enabled time slot, the placing time slot comprises a virtual video time slot and a filling video time slot;

and S308, adding a newly started time slot in the virtual video time slot and the filling video time slot to obtain a changed frame structure.

Specifically, under the condition that neither the virtual video timeslot nor the filler video timeslot satisfies the newly enabled timeslot, the newly enabled timeslot is added to the virtual video timeslot and the filler video timeslot in combination with the virtual video timeslot and the filler video timeslot, so as to obtain a changed frame structure.

In some example embodiments, the change enable time slot and the link topology adjustment time slot may be added to the virtual video time slot. A change slot and a change confirm slot may be added to the filler video slot. It is understood that the newly enabled slots mentioned above can be added in the virtual video slots and the filler video slots respectively in any combination, and the combination of the newly enabled slots is not limited in this embodiment.

S310, under the condition that the virtual video time slot and the filling video time slot do not meet the newly enabled time slot, the placing video time slot comprises a time slot, a virtual video time slot and a filling video time slot which are pre-allocated in a standard data frame;

and S312, adding a newly enabled time slot in the pre-allocated time slot, the virtual video time slot and the filling video time slot to obtain a changed frame structure.

Specifically, when the newly enabled time slot is not added after the virtual video time slot and the filler video time slot are combined, for example, any one of the change enabling time slot, the link topology adjusting time slot, the change time slot and the change confirmation time slot is not added into the virtual video time slot and the filler video time slot, a pre-allocated time slot may be set in the standard data frame, and the newly enabled time slot that is not added into the virtual video time slot and the filler video time slot is placed in the pre-allocated time slot. The video source can also dynamically allocate the newly enabled time slot according to the actual situation, and the newly enabled time slot can be placed into the pre-allocated time slot, the virtual video time slot and the filling video time slot. The pre-allocated time slots may include: one or more of an Mvid slot, a Naud slot, a BE slot, a pixel data slot, an FS slot, etc. in a standard data frame structure.

In this embodiment, when adding a newly enabled slot to a virtual video slot and/or the filler video slot, it may be compatible with a standard frame structure to avoid more switching requests; the switching between the two frame structures does not require excessive signaling interaction. And in order to further satisfy the occupation space of the newly enabled time slot, the pre-allocated time slot can be set to satisfy the occupation space requirements of different time slots.

In an embodiment, the adjusting the transmission link topology of the transmission node to be changed according to the link topology adjustment timeslot in the change frame structure includes:

and under the condition of determining to adjust the transmission link topology according to the link topology adjusting time slot, determining the connection relation of the transmission nodes to be changed in the video transmission link, and adjusting the transmission link topology of the transmission nodes to be changed according to the connection relation.

Specifically, after the video source determines the transmission state of the transmission node to be changed, the link topology modification enable field in the link topology adjustment timeslot may be adjusted, so as to adjust the transmission link topology of the transmission node to be changed. The transmission node to be changed can also actively send a request for adjusting the transmission link topology to the video source according to the transmission state of the transmission node to be changed, and the video source adjusts the link topology correction enabling field in the link topology adjusting time slot. And under the condition that the transmission link topology needs to be adjusted according to the link topology correction enabling field, the video source determines the connection relation of the transmission node to be changed in the transmission link, and changes the topology structure of the transmission node to be changed in the transmission link according to the connection relation.

In some exemplary embodiments, a transmission node that needs to adjust the link topology may receive the link topology modification enabling field in general, and other transmission nodes that do not need the adjusted link topology may simply forward the link topology modification enabling field.

In the present embodiment, it can be determined when the link topology of the transmission node to be changed needs to be adjusted according to the link topology modification enable field. And the link topology modification enabling field can be the active modification of a video source or the sending of a signaling to the video source by a transmission node to be modified, so as to indicate the passive modification of the video source. The adjustment of the link topology can be completed according to different requirements.

In an embodiment, as shown in fig. 7, the determining, when the transmission condition or the topology of the transmission link changes, a transmission node to be changed includes:

s402, determining the transmission state of each transmission node under the condition that the transmission condition or the topological structure of the transmission link changes;

s404, determining the transmission node to be changed according to the transmission node with the changed transmission state.

In particular, in the case that transmission conditions or the topology of the transmission link are changed, the transmission states of the respective transmission nodes are usually changed. When the transmission state changes, it may be determined that resources occupied by the transmission node corresponding to the transmission node whose transmission state changes, a topology structure of the transmission node itself, and the like all need to be adjusted.

Wherein the transmission state comprises at least:

and the silent state represents that the transmission node does not display the video data and transmits the video data to other transmission nodes.

Specifically, the silence state may refer to that the transmission node does not display, but may transmit valid video data to other transmission; this state can be used when resources (timeslots) in the topology of the video data transmission link are insufficient, and such transmission node is used as a similar repeater to increase the payload of the system.

specifically, the physical channel change status may refer to increasing and/or decreasing the number of physical channels currently used by the current transmission node to adapt to the performance change of the transmission node.

And the physical channel grouping state is used for representing that the physical channels used by the transmission nodes are grouped, and the grouped physical channels are respectively used for displaying the video data and transmitting the video data values to other transmission nodes.

Specifically, the physical channel grouping status may refer to grouping the physical channels of the current transmission node, respectively for different purposes, i.e., a part is used for the current transmission node to display. Another part is used for transmitting valid video data to other transmission nodes; this state is used for the video source to fully multiplex the physical channel resources to complete the allocation of resources (time slots) without affecting the normal display of such nodes and/or video terminals.

specifically, the buffer transmission state refers to that the current transmission node is not normally displayed, and the video data buffered by the local frame is used for displaying, but the current physical channel and the resources except the resources used by the local buffer display are used for transmitting the normal video data to other transmission nodes. Reasons for not displaying properly may include: the performance parameters of the current transmission node are not matched with the video data, the resources (time slots) distributed by the video source cannot acquire the corresponding video data, the performance of the transmission node is abnormal and the like. The state is used for the video source to fully multiplex the local frame buffer capacity of the transmission node to complete the allocation of resources (time slots), and meanwhile, the normal display of the transmission node is not influenced.

And in the normal display state, representing that the transmission node normally displays video data by using the pre-distributed resources of the video source.

Specifically, the normal display state may refer to that the current transmission node performs normal display using a resource (timeslot) pre-allocated by the video source.

And a dormant state, which represents that the physical link of the transmission node is completely closed.

Specifically, the dormant state refers to that the physical link of the transmission node is completely closed, and the video source considers that such transmission node is not in the current link topology, and does not need to allocate resources (time slots); the dormant state is a relatively ideal method for the video source to adjust the transmission link topology, and the transmission nodes of the type can be enabled or disabled by sending signaling, so that the purpose of flexibly changing the link topology by the video source is achieved, and the current resource (time slot) allocation is flexibly changed.

And the energy-saving state is characterized in that the transmission node is normally displayed according to the lowest performance index, wherein the performance index comprises the following steps: resolution, frame rate, number of physical channels and link rate;

specifically, the energy-saving state means that the transmission node completes normal display with the lowest performance index supported by the transmission node, such as resolution, frame rate, number of physical channels, link rate, and the like, so as to alleviate the power consumption problem of the data transmission link topology; the energy-saving state is a method for flexibly adjusting the current resource (time slot) allocation by a video source, and the resource (time slot) allocation of the transmission node is flexibly changed under the condition of limited influence on the display of the transmission node.

And in a non-video state, the transmission node is used for displaying the cached video data within a preset time.

Specifically, the video data-free state means that the video source does not allocate resources (time slots) to the transmission node within the frame number determined by the video source, and the transmission node can use the local frame buffer to complete normal display, but does not transmit any effective video data to other transmission nodes; the video source temporarily removes the transmission nodes from the current multi-channel video data transmission link topology, but does not influence the normal display of the transmission nodes, so that the video source can simplify the current link topology, and the video source flexibly changes the allocation of resources (time slots).

It is to be understood that the above various transmission states are for illustration, and in practical application, those skilled in the art may set more transmission states to correspond to states of different transmission nodes. Each transmission node can typically only correspond to one of the transmission states described above.

In one embodiment, the method further comprises: and under the condition that the state of the transmission node is a dormant state or a video-free state or the condition that the video source cannot communicate with the transmission node through signaling, communicating with the transmission node through a special sequence field.

In particular, the special sequence field is used for special means that the video source can complete communication with the transmission node in certain specific transmission states, such as a sleep state, a no video state, and the like, or the video source can not complete communication with the node and/or the video terminal through normal signaling.

In this embodiment, when the communication with the transmission node is not possible through normal signaling, the communication may be performed through the signature sequence field, so as to complete the interaction.

In one embodiment, the communication between the video source and the transport node may also interact in the form of read and write fields. For example, the video source may interact with the transmission node by changing signaling, where the changing signaling may include: a link topology modification enable field as described above and a special sequence field as described above, and a change field and a change confirm field.

The change field is used for performing resource allocation on the transmission node to be changed by the video source when the change of the node to be changed is started; note that this part only works for transmission nodes that have changed resources, and only needs to forward this field for transmission nodes that do not need a resource change.

And the change confirmation field is used for determining the change result of the transmission node to be changed. It is understood that the above fields are only used for illustration, and in practical application, those skilled in the art can set various fields to interact with different types of data by the transmission node.

It should be understood that, although the steps in the flowcharts related to the embodiments as described above are sequentially displayed as indicated by arrows, the steps are not necessarily performed sequentially as indicated by the arrows. The steps are not performed in the exact order shown and described, and may be performed in other orders, unless explicitly stated otherwise. Moreover, at least a part of the steps in the flowcharts related to the embodiments described above may include multiple steps or multiple stages, which are not necessarily performed at the same time, but may be performed at different times, and the execution order of the steps or stages is not necessarily sequential, but may be rotated or alternated with other steps or at least a part of the steps or stages in other steps.

Based on the same inventive concept, the disclosed embodiments also provide a transmission node changing apparatus for implementing the above related transmission node changing method. The implementation scheme for solving the problem provided by the apparatus is similar to the implementation scheme described in the method, so specific limitations in one or more embodiments of the apparatus for changing a transmission node provided below may refer to the limitations on the method for changing a transmission node in the foregoing, and details are not described here again.

In one embodiment, as shown in fig. 8, there is provided a transmission node changing apparatus 800, applied to a video source in a video image processing system, where the video source changes a transmission node to be changed through a transmission link and a change frame structure, the apparatus including: a node to be changed determining module 802, a changing module 804 and a feedback module 806, wherein:

a to-be-changed node determining module 802, configured to determine a to-be-changed transmission node when a transmission condition or a topology structure of a transmission link changes;

a changing module 804, configured to adjust a transmission link topology of the transmission node to be changed according to a link topology adjustment timeslot in a changed frame structure under a condition that a change enabling timeslot in the changed frame structure is enabled, and send video data to the transmission node to be changed through the changed frame structure, where the changed frame structure is obtained by placing a timeslot in a standard data frame structure to fill a newly enabled timeslot, and the placing a timeslot includes: at least one of a time slot pre-allocated in a standard frame, a virtual video time slot and a filling video time slot;

a feedback module 806, configured to determine a change result of the transmission node to be changed according to a change confirmation time slot in the change frame structure, where the change confirmation time slot is obtained by the feedback of the transmission node to be changed and is used to determine the change result.

In one embodiment of the apparatus, the changing of the newly enabled slots in the frame structure comprises: change enable slot, link topology adjustment slot, change slot and change confirm slot:

the link topology adjustment timeslot is used for determining whether to adjust a transmission link topology structure and determining a topology table, where the topology table includes connection relationships of all transmission nodes in the video transmission link;

In an embodiment of the apparatus, the changing module 804 includes: a first adding module, configured to add a newly enabled time slot in the virtual video time slot or the filler video time slot to obtain a changed frame structure, where the placement time slot includes the virtual video time slot or the filler video time slot, and the virtual video time slot or the filler video time slot satisfies the newly enabled time slot.

And a second adding module, configured to add a newly enabled time slot to the virtual video time slot and the filler video time slot to obtain a changed frame structure, where the placement time slot includes the virtual video time slot and the filler video time slot, and the virtual video time slot or the filler video time slot does not satisfy the newly enabled time slot.

And a third adding module, configured to, when the virtual video timeslot and the filler video timeslot do not satisfy the newly enabled timeslot, add the newly enabled timeslot in the pre-allocated timeslot, the virtual video timeslot, and the filler video timeslot, where the placement video timeslot includes the timeslot pre-allocated in the standard data frame, the virtual video timeslot, and the filler video timeslot, and obtain a changed frame structure.

In one embodiment of the apparatus, the change module 804 further comprises: and the link topology adjusting module is used for determining the connection relation of the transmission nodes to be changed in the video transmission link under the condition of determining and adjusting the transmission link topology according to the link topology adjusting time slot, and adjusting the transmission link topology of the transmission nodes to be changed according to the connection relation.

In an embodiment of the apparatus, the module 802 for determining a node to be changed includes: and the transmission state determining module is used for determining the transmission state of each transmission node under the condition that the transmission condition or the topological structure of the transmission link changes.

And the change determining module is used for determining the transmission node to be changed according to the transmission node with the changed transmission state.

In one embodiment of the apparatus, the transmission state comprises at least:

the transmission state is cached, the received video data cannot be normally displayed by representing the transmission node, the cached video data is used for displaying, and the video data is transmitted to other transmission nodes;

In one embodiment of the apparatus, the apparatus further comprises: the special communication module is used for communicating with the transmission node through a special sequence field under the condition that the state of the transmission node is a dormant state or a video-free state or the condition that the video source cannot communicate with the transmission node through signaling.

Each module in the above transmission node changing apparatus may be wholly or partially implemented by software, hardware, or a combination thereof. The modules can be embedded in a hardware form or independent of a processor in the computer device, and can also be stored in a memory in the computer device in a software form, so that the processor can call and execute operations corresponding to the modules.

In one embodiment, a computer device is provided, which may be a server, and the internal structure thereof may be as shown in fig. 9. The computer device includes a processor, a memory, and a network interface connected by a system bus. Wherein the processor of the computer device is configured to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program, and a database. The internal memory provides an environment for the operation of an operating system and computer programs in the non-volatile storage medium. The database of the computer device is used for storing video data required to be sent by the video source. The network interface of the computer device is used for communicating with an external terminal through a network connection. The computer program is executed by a processor to implement a transmission node changing method.

Those skilled in the art will appreciate that the configuration shown in fig. 9 is a block diagram of only a portion of the configuration associated with the disclosed aspects and does not constitute a limitation on the computing device to which the disclosed aspects apply, as a particular computing device may include more or less components than those shown, or may combine certain components, or have a different arrangement of components.

In one embodiment, a computer device is provided, comprising a memory and a processor, the memory having stored therein a computer program, the processor implementing the steps of the above-described method embodiments when executing the computer program.

In an embodiment, a computer-readable storage medium is provided, on which a computer program is stored, which computer program, when being executed by a processor, carries out the steps of the above-mentioned method embodiments.

In an embodiment, a computer program product is provided, comprising a computer program which, when being executed by a processor, carries out the steps of the above-mentioned method embodiments.

It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by hardware instructions of a computer program, which can be stored in a non-volatile computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. Any reference to memory, databases, or other media used in the embodiments provided by the present disclosure may include at least one of non-volatile and volatile memory. The nonvolatile Memory may include a Read-Only Memory (ROM), a magnetic tape, a floppy disk, a flash Memory, an optical Memory, a high-density embedded nonvolatile Memory, a resistive Random Access Memory (ReRAM), a Magnetic Random Access Memory (MRAM), a Ferroelectric Random Access Memory (FRAM), a Phase Change Memory (PCM), a graphene Memory, and the like. Volatile Memory can include Random Access Memory (RAM), external cache Memory, and the like. By way of illustration and not limitation, RAM can take many forms, such as Static Random Access Memory (SRAM) or Dynamic Random Access Memory (DRAM), among others. The databases involved in embodiments provided by the present disclosure may include at least one of relational and non-relational databases. The non-relational database may include, but is not limited to, a block chain based distributed database, and the like. The processors referred to in the embodiments provided in this disclosure may be general purpose processors, central processing units, graphics processors, digital signal processors, programmable logic, quantum computing based data processing logic, etc., without limitation.

The technical features of the above embodiments can be arbitrarily combined, and for the sake of brevity, all possible combinations of the technical features in the above embodiments are not described, but should be considered as the scope of the present specification as long as there is no contradiction between the combinations of the technical features.

The above-mentioned embodiments only express several embodiments of the present disclosure, and the description thereof is more specific and detailed, but not construed as limiting the scope of the present disclosure. It should be noted that, for those skilled in the art, various changes and modifications can be made without departing from the concept of the present disclosure, and these changes and modifications are all within the scope of the present disclosure. Therefore, the protection scope of the present disclosure should be subject to the appended claims.

Claims

1. A transmission node changing method is applied to a video source in a video image processing system, wherein the video source changes a transmission node to be changed by changing a frame structure, and the method comprises the following steps:

when a change enabling time slot in a change frame structure is enabled, adjusting the time slot according to a link topology in the change frame structure, adjusting a transmission link topology of the transmission node to be changed, and adjusting resources occupied by the transmission node to be changed through the change frame structure, wherein the change frame structure is obtained by placing a time slot in a standard data frame structure and adding a newly enabled time slot, and the placing of the time slot comprises: at least one of a time slot, a virtual video time slot and a filling video time slot which are pre-allocated in a standard frame;

2. The method of claim 1, wherein changing the newly enabled time slot in the frame structure comprises: change enable slot, link topology adjustment slot, change slot and change confirm slot:

3. The method of claim 1, wherein the modifying the frame structure comprises:

under the condition that the virtual video time slot or the filling video time slot does not meet the newly started time slot, the placing time slot comprises a virtual video time slot and a filling video time slot, and the newly started time slot is added into the virtual video time slot and the filling video time slot to obtain a changed frame structure;

and under the condition that the virtual video time slot and the filling video time slot do not meet the newly enabled time slot, the placement time slot comprises a time slot, a virtual video time slot and a filling video time slot which are pre-allocated in a standard data frame, and the newly enabled time slot is added in the pre-allocated time slot, the virtual video time slot and the filling video time slot to obtain a changed frame structure.

4. The method according to claim 2, wherein said adjusting the transmission link topology of the transmission node to be changed according to the link topology adjustment timeslot in the change frame structure comprises:

5. The method according to claim 1, wherein determining the transmission node to be changed in case of a change in transmission conditions or topology of the transmission link comprises:

in case of changes in the transmission conditions or the topology of the transmission link, determining the transmission state of each transmission node;

6. The method according to claim 5, wherein the transmission state comprises at least:

7. The method of claim 6, further comprising: and under the condition that the state of the transmission node is a dormant state or a video-free state or the video source cannot communicate with the transmission node through signaling, communicating with the transmission node through a special sequence field.

8. A transmission node changing device is applied to a video source in a video image processing system, wherein the video source changes a transmission node to be changed through a transmission link and a change frame structure, and the device comprises:

a changing module, configured to adjust a transmission link topology of the transmission node to be changed according to a link topology adjustment timeslot in a changed frame structure when a change enabling timeslot in the changed frame structure is enabled, and send video data to the transmission node to be changed through the changed frame structure, where the changed frame structure is obtained by placing a timeslot in a standard data frame structure to fill a newly enabled timeslot, and the placing a timeslot includes: at least one of a time slot, a virtual video time slot and a filling video time slot which are pre-allocated in a standard frame;

9. A computer device comprising a memory and a processor, the memory storing a computer program, characterized in that the processor, when executing the computer program, implements the steps of the method of any of claims 1 to 7.

10. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the steps of the method according to any one of claims 1 to 7.