CN115442640A

CN115442640A - Video data transmission method, device and storage medium

Info

Publication number: CN115442640A
Application number: CN202211059850.XA
Authority: CN
Inventors: 魏巍; 金凯
Original assignee: Suzhou HYC Technology Co Ltd
Current assignee: Suzhou HYC Technology Co Ltd
Priority date: 2022-08-30
Filing date: 2022-08-30
Publication date: 2022-12-06
Anticipated expiration: 2042-08-30
Also published as: CN115442640B

Abstract

The disclosure relates to a video data transmission method, a video data transmission device and a storage medium. Applied to a video source, the method comprising: transmitting the source time sequence to each transmission node; the source time sequence is used for configuring parameters when video data are transmitted; responding to the fact that each transmission node cannot normally display video data according to the source time sequence, and determining a video transmission frame according to a received time delay error, wherein the time delay error is determined by each transmission node according to the source time sequence and a local time sequence generated by the transmission node; and transmitting video data to each transmission node by using the video transmission frame. By adopting the method, the influence of the randomness of the time delay on the video source, the node and/or the video terminal when the video data is sent/received can be reduced.

Description

Video data transmission method, device and storage medium

Technical Field

The present disclosure relates to the field of data transmission technologies, and in particular, to a video data transmission method, apparatus, and storage medium.

Background

At present, video image systems, especially Video image processing systems with Display Port (DP) of VESA (Video Electronics Standards Association), MIPI (Mobile Industry Processor Interface standard), HDMI (High Definition Multimedia Interface standard) to drive and Display panels and terminals such as Liquid Crystal Display (LCD), organic Light-Emitting Diode (OLED), etc., may generate a large amount of transmission delay in different link topologies due to different data transmission mechanisms in multiple channels, and the delay has randomness, if image data is transmitted to other nodes and/or Video terminals using the same timing sequence, an error may be generated, such that the nodes and/or Video terminals may not receive the Video image data correctly, and a receiving error may exist.

In addition, due to the existence of random time delay, the video source, the node and/or the video terminal send/receive video data, and the resynchronization after the loss of synchronization, and the error detection and recovery are difficult.

Disclosure of Invention

In view of the foregoing, it is desirable to provide a video data transmission method, device, and storage medium capable of reducing the influence of the randomness of the delay on the transmission/reception of video data by a video source, a node, and/or a video terminal.

In a first aspect, the present disclosure provides a video data transmission method. Applied to a video source, the method transmits a source timing sequence to each transmission node; the source time sequence is used for configuring parameters when video data are transmitted;

responding to the situation that each transmission node cannot normally display video data according to the source time sequence, and determining a video transmission frame according to a received time delay error, wherein the time delay error is determined by each transmission node according to the source time sequence and a local time sequence generated by the transmission node;

and transmitting video data to each transmission node by using the video transmission frame.

In one embodiment, the determining a video transmission frame according to the received delay error includes:

enabling time slots in the video transmission frames in response to the fact that the transmission nodes cannot normally display video data according to the source time sequence, and using the video transmission frames under the condition that the enabling time slots are enabled;

and updating the time slot by using the time delay error in the video transmission frame, and storing the time delay error.

In one embodiment, the transmitting video data to each transmission node using the video transmission frame includes:

transmitting the delay error updating time slot, the first signaling and the video data to each transmission node by using the video transmission frame; and the first signaling is used for instructing each transmission node to adjust the source time sequence according to the delay error in the delay error updating time slot, and receiving and displaying the video data according to the adjusted source time sequence.

In one embodiment, the method further comprises:

in response to the fact that the time delay error is larger than a preset time delay threshold, updating the time delay error in the time slot, the time delay threshold and the source time sequence according to the time delay error fed back by each transmission node to determine a target time sequence;

sending the target timing, the video data, and a second signaling to a target transmission node, the target transmission node comprising: and the second signaling is used for indicating the target transmission node to receive and display the video data by using the target time sequence.

In one embodiment, the method further comprises:

responding to the time delay error larger than a preset time delay threshold value, and acquiring the maximum time delay error in the time delay error updating time slot fed back by each transmission node;

generating an adjusting source time sequence by taking the maximum time delay error as a time sequence starting point;

and sending the adjusting source time sequence, the video data and a third signaling to each transmission node, wherein the third signaling is used for indicating each transmission node to receive and display the video data by using the adjusting source time sequence.

In one embodiment, the video transmission frame further comprises a correction confirmation time slot; the method further comprises the following steps:

receiving a correction confirmation time slot fed back by each transmission node by using the video transmission frame, wherein the correction confirmation time slot represents whether each transmission node correctly receives and displays the video data;

determining that the transmission node correctly receives and displays the video data under the condition that the correction confirmation time slot is confirmed;

sending a fourth signaling to the transmitting node, the fourth signaling being used to instruct the transmitting node to store the delay error;

and sending video data and the source timing sequence to the transmission node by using a standard frame so as to instruct the transmission node to receive and display the video data by using the stored delay error and the source timing sequence.

In a second aspect, the present disclosure further provides a video data transmission method applied to a transmission node, where the method includes:

receiving a source time sequence and video data transmitted by a video source;

responding to the situation that each transmission node cannot normally display video data according to the source time sequence, determining a time delay error according to the source time sequence and the generated local time sequence, and transmitting the time delay error to a video source by using a video transmission frame;

and receiving video data transmitted by a video source by using the video source transmission frame, adjusting the source time sequence according to the time delay error in the video transmission frame, and receiving and displaying the video data according to the adjusted source time sequence.

In one embodiment, the determining the delay error according to the source timing and the generated local timing includes:

determining a first delay error in response to a received source timing sequence advancing the local timing sequence, the first delay error being a positive number;

determining a second latency error in response to the received source timing lagging the local timing, the second latency error being a negative number.

In one embodiment, the method further comprises:

receiving a target time sequence and video data transmitted by the video source in response to the time delay error being greater than a preset time delay threshold;

the target transmission node receives and displays the video data by utilizing the target time sequence;

wherein the target timing is determined by the video source based on a delay error, the delay threshold, and the source timing; the target transmission node comprises: and the delay error is larger than the delay threshold value.

In one embodiment, the method further comprises:

responding to the time delay error larger than a preset time delay threshold value, and receiving an adjusting source time sequence and video data transmitted by the video source;

receiving and displaying the video data by utilizing the adjusting source time sequence;

the source timing sequence is adjusted according to the maximum delay error in the delay error updating time slot fed back by each transmission node acquired by the video source; and generating by taking the maximum time delay error as a time sequence starting point.

utilizing a correction acknowledgement timeslot fed back by the video transmission frame;

storing the delay error under the condition that the fed back correction confirmation time slot is confirmed;

and under the condition of receiving the video data and the source time sequence which are sent by the video source by using the standard frame, receiving the video data by using the stored time delay error and the source time sequence and displaying the video data.

In one embodiment, the method further comprises:

and responding to the situation that each transmission node cannot normally display the video data according to the source time sequence, and displaying by using the video data stored in the local memory by each transmission node.

In a third aspect, the present disclosure also provides a video data transmission apparatus. Applied to a video source, the apparatus comprising:

the time sequence transmission module is used for transmitting the source time sequence to each transmission node; the source time sequence is used for configuring parameters when video data are transmitted;

the video transmission frame determining module is used for responding to the fact that each transmission node cannot normally display video data according to the source time sequence and determining a video transmission frame according to a received time delay error, wherein the time delay error is determined by each transmission node according to the source time sequence and a local time sequence generated by the transmission node;

and the video data transmission module is used for transmitting the video data to each transmission node by using the video transmission frame.

In a fourth aspect, the present disclosure further provides a video data transmission apparatus, applied to a transmission node, where the apparatus includes:

the time sequence receiving module is used for receiving a source time sequence and video data transmitted by a video source;

the time delay error transmission module is used for responding to the situation that each transmission node cannot normally display video data according to the source time sequence, determining a time delay error according to the source time sequence and the generated local time sequence, and transmitting the time delay error to a video source;

and the video data receiving module is used for receiving video data transmitted by a video source by using the video source transmission frame, adjusting the source time sequence according to the time delay error in the video transmission frame, and receiving and displaying the video data according to the adjusted source time sequence.

In a fifth aspect, the present disclosure also provides a computer device. The computer device comprises a memory storing a computer program and a processor implementing the steps of any of the above method embodiments when executing the computer program.

In a sixth aspect, the present disclosure also provides a computer-readable storage medium. The computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the steps of any of the above-mentioned method embodiments.

In a seventh aspect, the present disclosure also provides a computer program product. The computer program product comprising a computer program which, when being executed by a processor, carries out the steps of any of the above-mentioned method embodiments.

In the foregoing embodiments, when a node and/or a video terminal cannot normally display due to a random round-trip delay, a random delay may be determined by a delay error fed back by each transmission node. The video source can use the unified source time sequence and utilize the determined video transmission frame to send the video data according to the time delay error recorded by the node and/or the video terminal, so that the node and/or the video terminal can correctly adjust the source time sequence to complete correct display of the video data. By using the scheme, the nodes and/or the video terminals are not influenced by the randomness of time delay, and the video data can be normally received and displayed when the time delay of the randomness exists.

Drawings

In order to more clearly illustrate the embodiments of the present disclosure or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present disclosure, and other drawings can be obtained by those skilled in the art without creative efforts.

FIG. 1 is a schematic diagram of a video image processing system according to an embodiment;

FIG. 2 is a flow diagram illustrating a method for video data transmission according to one embodiment;

FIG. 3 is a flowchart illustrating step S204 according to an embodiment;

FIG. 4 is a diagram of a standard frame structure in one embodiment;

FIG. 5 is a flow diagram illustrating processing of a target timing sequence in one embodiment;

FIG. 6 is a flow diagram illustrating a process for adjusting source timing in one embodiment;

FIG. 7 is a flow diagram that illustrates a portion of a method for video data transmission in accordance with one embodiment;

FIG. 8 is a diagram of a video transmission frame structure in one embodiment;

FIG. 9 is a flowchart illustrating a video data transmission method according to another embodiment;

FIG. 10 is a block diagram showing the construction of an apparatus for a video data transmission method according to an embodiment;

FIG. 11 is a block diagram schematically showing the construction of an apparatus for a video data transmission method according to another embodiment;

FIG. 12 is a diagram showing an internal configuration of a computer device according to an embodiment.

Detailed Description

In order to make the objects, technical solutions and advantages of the present disclosure more clearly understood, the present disclosure is further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the present disclosure and are not intended to limit the present disclosure.

It should be noted that the terms "first," "second," and the like in the description and claims herein and in the above-described drawings are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments herein described are capable of operation in sequences other than those illustrated or described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, apparatus, article, or device that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or device.

In this document, the term "and/or" is only one kind of association relationship describing the associated object, meaning that three kinds of relationships may exist. For example, a and/or B, may represent: a exists alone, A and B exist simultaneously, and B exists alone. In addition, the character "/" herein generally indicates that the former and latter related objects are in an "or" relationship.

As described in the background art, when a multi-channel link topology is displayed, when nodes and/or video terminals of different standard types exist in the multi-channel link topology for video data transmission, or when nodes and/or video terminals of different video data transmission modes exist in the same channel, or when nodes and/or video terminals use different physical layer transmission mechanisms, a large amount of transmission delay is generated when video data is transmitted on different channels in the multi-channel link topology. At this time, if the video source transmits video data to all nodes and/or video terminals of multiple channels using the same time sequence, due to the transmission delay, an error may exist in the local receiving time sequence of the nodes and/or video terminals, and the nodes and/or video terminals may not normally receive the video data. Or, when the node and/or the video terminal has an error when receiving the video data and the video data needs to be recovered, due to the differences between the standard type, the transmission mode and the physical layer transmission mechanism, there is randomness in transmission delay, which makes it difficult for the video source, the node and/or the video terminal to send/receive video image data, resynchronize after loss of synchronization of the video data, and error detection and video data recovery.

Among them, the standard types may be, for example, VESA DisplayPort v.1.2, 1.4a, hdmi 2.0, 2.1, and the like. The video data transmission method may be Multi-Stream Transport (MST), single-Stream Transport (SST), or the like. The physical layer transport mechanism may be GTH (Gigabit transmitter), USB, etc. Timing refers to a configuration that can correctly transmit video data and signaling, and generally includes: line Front (HFP), line Synchronization (HS), line Back (HBP), field Front (VFP), field Synchronization (VS), field Back (VBP), etc., but is not limited thereto.

Therefore, to solve the above problem, embodiments of the present disclosure provide a video data transmission method, apparatus, computer device, and storage medium.

First, as shown in fig. 1, a video image processing system according to the present disclosure is provided. The video image processing system includes: the device comprises an embedded control module, an FPGA module, an external storage module, a quick storage module, a peripheral module, a video interface physical layer implementation module and a video transmission link.

The embedded control module can use any embedded chip and system, and is mainly responsible for initiating signaling interaction, such as reading/writing a register, enabling/closing a video display module, peripheral control, parameter setting of the video display module and the like. The FPGA module is mainly responsible for implementing the implementation parts which need a large amount of data processing and low round-trip delay (latency) such as storage control, peripheral control, video interface IP core implementation and the like. The external storage module is mainly responsible for storing original data streams of video images needing to be displayed in the video image processing system, and the part is applied to storage media such as NandFlash, SSD and the like, but is not limited to the storage media. The fast storage module is used for a module which needs a large amount of data processing and low round-trip delay (latency) in the implementation process of the FPGA module, and the module uses a fast physical device with low delay, such as DDR3, and the like, but is not limited thereto, in order to reduce delay and delay storage. The peripheral modules include GPIO (General-purpose input/output), UART (Universal Asynchronous Receiver/Transmitter), USB (Universal Serial Bus), network interface, and the like, but are not limited thereto. The video interface physical layer implementation module is mainly responsible for the physical layer implementation required for driving the display module, such as, but not limited to, TX/RX (Transmitter/Receiver) -PHY of DisplayPort, DPHY of MIPI, and the like.

Furthermore, the FPGA module includes a bus interaction module, an MCU (micro controller Unit, micro control module) video stream preprocessing module, a video data stream transmission control module, a clock control module, an embedded soft core control module, a bus controller module, an internal storage controller module, an external control module, a display clock generator module, a video timing controller module, and a video interface IP core module. The bus interaction module is mainly responsible for the functions of selection, decision and the like of all other modules connected to the bus interaction module. The MCU video stream preprocessing module is mainly responsible for preprocessing and converting the video data stream input from the external storage module according to the format and parameter types set by the system so as to facilitate the post-processing. And the video data stream transmission control module is mainly responsible for controlling the time sequence, parameters and the like of the data stream after data stream preprocessing and conversion. And the clock control module is mainly responsible for generating and controlling a global clock in the video image processing system. The embedded soft core control module is a control core of the FPGA module, and is mainly responsible for core functions of timing control, parameter configuration, physical process implementation and the like of all modules inside the FPGA module, and the embedded soft core control module can be used in the implementation of the core functions, such as Xilinx MicroBlaze and the like, but is not limited to the implementation. The bus controller module is mainly responsible for controlling all modules connected with the bus interaction module, but is not limited to the bus controller module. The video pattern processing module is mainly responsible for mode conversion, timing control and the like of a video image data stream corresponding to the video interface IP core module, but is not limited thereto. The internal storage controller module is mainly responsible for controlling the fast storage module, including but not limited to writing/reading of data stream, frame control, and the like. The peripheral control module is mainly responsible for controlling all the peripheral modules, including enabling/shutting down of the peripheral, controlling the working mode, and the like, but not limited thereto. The display clock generator module is mainly responsible for timing control of all modules, including but not limited to the video interface IP core module and the video interface physical layer implementation module. The video timing controller module is mainly responsible for data conversion, timing control and other processing when the data input from the video pattern processing module is transmitted to the video interface IP core module, but is not limited thereto.

The transmission link (video transmission link) comprises: a video source (video transmission source), a transport node (which may include, for example, an embedded physical repeater, a cable with a source ID, a removable physical repeater, a video sink, etc.), but is not so limited. The transmission node in some embodiments of the disclosure may comprise a node and/or a video terminal. Or the transmitting node may also refer to a node and/or video terminal capable of displaying video data. In general, a node may act as a relay for transmissions, and may be capable of both displaying video and transmitting video data to subordinate nodes and/or video terminals. The video terminal can only receive video and display it.

In one embodiment, as shown in fig. 2, a video data transmission method is provided, which is described by taking a video source applied in the video image processing system of fig. 1 as an example, and includes the following steps:

s202, transmitting a source time sequence to each transmission node; the source timing is used to configure parameters when transmitting video data.

The source timing may be a timing transmitted by a video source, and refers to a configuration capable of correctly transmitting video data and signaling. After sending the configuration to each transmission node, each transmission node can receive video data according to the configuration.

And S204, responding to the fact that each transmission node cannot normally display video data according to the source time sequence, and determining a video transmission frame according to the received delay error, wherein the delay error is determined by each transmission node according to the source time sequence and the local time sequence generated by the transmission node.

The local timing sequence may be a timing sequence locally generated by the transmission node, and the timing sequence is usually the timing sequence of the transmission node, but cannot be used for configuring the video source to transmit video data and signaling. The video transmission frame may generally be a data frame used in the present disclosure for transmitting video data and delay errors. In addition, the existing standard frame structure can only transmit video data, and there is no time slot with transmission delay error, so the transmission delay error needs to be performed by using a video transmission frame in the present disclosure.

Specifically, due to the round trip delay in the normal situation, it may cause that the transmission node cannot normally display the video through the configuration of the source timing after receiving the video data. At this time, the transmission nodes can feed back to the video source, and the video source can determine that the transmission nodes cannot normally display video data due to the round-trip delay problem after receiving the feedback. The transmitting node may then calculate the delay error from the received source timing and the locally generated timing, typically by subtracting the source timing from the locally generated timing or by subtracting the locally generated timing from the source timing. The calculated delay error will typically have positive and negative values. The video source receives different delay errors corresponding to each transmission node, which are fed back by each transmission node, and can determine and start a video transmission frame according to the delay errors.

And S206, transmitting the video data to each transmission node by using the video transmission frame.

Specifically, since the video transmission frame is determined according to the delay error, after the video data and the delay error are transmitted by using the video transmission frame, each transmission node may receive the corresponding delay error and video data through the video transmission frame. After each transmission node receives the delay error of the video transmission frame transmission, the source time sequence sent by the video source can be adjusted according to the delay error, so that the video data can be normally displayed. It is to be understood that in some embodiments of the present disclosure, the transmission of video data using video data frames is performed for a transmission node that fails to normally display video data through source timing.

In some exemplary embodiments, a delay error correction table such as table 1 may be used to enable each transmission node to normally receive video data and display the video data.

TABLE 1 time delay error correction TABLE

In the video data transmission method, when the nodes and/or the video terminals cannot normally display due to the random round-trip delay, the random delay can be determined through the delay error fed back by each transmission node. The video source can utilize the determined video transmission frame to send the video data by using the uniform source time sequence and according to the time delay error recorded by the node and/or the video terminal, so that the node and/or the video terminal can correctly adjust the source time sequence to complete correct display of the video data. By using the scheme, the nodes and/or the video terminals are not influenced by the randomness of time delay, and the video data can be normally received and displayed when the time delay of the randomness exists.

In one embodiment, as shown in fig. 3, the determining a video transmission frame according to the received delay error includes:

s302, enabling the enabling time slot in the video transmission frame in response to the fact that the transmission nodes cannot normally display video data according to the source time sequence, and using the video transmission frame under the condition that the enabling time slot is enabled.

And S304, updating the time slot by using the time delay error in the video transmission frame, and storing the time delay error.

Wherein the video transmission frame may be a frame structure adjusted on a standard frame structure in general. As shown in fig. 4, a standard frame structure may be adopted, where fig. 4 shows a schematic diagram of a standard data frame structure, and the standard frame structure may include: BS (Blanking Start), VB-ID (Vertical Blanking Identifier), mvid (timer value of Video data), naud (timer value of audio data), dummy Video (for Dummy data padding), BE (Blanking End), pixel data (for transmission of Video data), FS (Fill Start, padding Start), fill Video (padding data, for padding when there is insufficient data), and FE (Fill End).

Specifically, when any one of the transmission nodes cannot normally display video data according to the source time sequence, the transmission node which cannot normally display the video data can feed back to the video source, the video source starts an enabling time slot in a video transmission frame, and the video transmission frame is used for transmitting the video data and transmitting the delay error under the condition that the enabling time slot is started. The transmission node which can not normally display the video data can calculate the time delay error according to the source time sequence and the local time sequence, and feeds back the time delay error to the video source through the video transmission frame, and the video source updates the time slot by using the time delay error in the video transmission frame and stores the time delay error corresponding to the transmission node. Further, the delay error update time slot is used for comparing the error between the received source timing from the video source and the locally generated timing used for correct video data display when the source timing transmitted by the video source fails to enable the node and/or the video terminal to correctly complete video data reception, and the error is used for coordinating correct reception and display of subsequent video transmission frames between the video source and the node and/or the video terminal.

In this embodiment, by using the video transmission frame, when there is a video data display error, each transmission node may interact with the video source, and then the video source uses the video transmission frame to store a time delay error corresponding to each transmission node, thereby avoiding that random time delay causes the video data to be abnormally displayed by each transmission node.

In one embodiment, as shown in fig. 5, the method further comprises:

s402, judging whether the time delay error is larger than a preset time delay threshold value.

S404, in response to the time delay error being larger than a preset time delay threshold, updating the time delay error in the time slot, the time delay threshold and the source time sequence according to the time delay error fed back by each transmission node to determine a target time sequence.

S406, sending the target timing sequence, the video data, and a second signaling to a target transmission node, where the target transmission node includes: and the second signaling is used for indicating the target transmission node to receive and display the video data by utilizing the target time sequence.

And S408, responding to the time delay error not larger than the preset time delay threshold value, and transmitting the video data to each transmission node by using the video transmission frame.

The delay threshold may be data for determining the delay error. The target timing may be an adjusted timing transmitted to the target transmission node, and is a timing for enabling the target transmission node to normally display the video data.

Specifically, it is determined whether the delay error is greater than a preset delay threshold. If the delay error is larger than the preset delay threshold, the transmission node cannot adjust the source time sequence according to the delay error. The delay error exceeds the adjustable range of the transmission node and exceeds the time of the resource (time slot) of the current transmission node, so that the transmission node cannot be adjusted. Therefore, the video source can determine the target time sequence according to the time delay error fed back by the transmission node, the time delay threshold value and the source time sequence. Further, the delay threshold may be subtracted from the delay error, and the obtained data may be used as the delay of the new source timing (target timing). When the video source generates the target time sequence, the added value of the original source time sequence and the delay error is used as the starting point of the target time sequence. When the time sequence is sent, only the target time sequence is sent to the target transmission node, and the other nodes can still use the source time sequence and the time delay error mode to adjust and correctly receive the video data. And after receiving the target time sequence, the target transmission node receives and displays the video data by utilizing the target time sequence correctly. It will be appreciated that the transmitted video data may be transmitted using standard frames or may be transmitted using data transmission frames.

In this embodiment, only the nodes and/or video terminals that exceed the delay threshold and cannot be adjusted can be updated and corrected for delay, so that the influence of the target timing sequence on all other nodes and/or video terminals is avoided.

In one embodiment, as shown in fig. 6, the method further comprises:

and S502, judging whether the time delay error is larger than a preset time delay threshold value.

S504, in response to the delay error being larger than a preset delay threshold, obtaining the maximum delay error in the delay error updating time slot fed back by each transmission node;

s506, generating an adjusting source time sequence by taking the maximum time delay error as a time sequence starting point;

and S508, sending the adjusted source time sequence, the video data and a third signaling to each transmission node, wherein the third signaling is used for indicating each transmission node to receive and display the video data by using the adjusted source time sequence.

And S510, responding to the time delay error not larger than the preset time delay threshold value, and transmitting the video data to each transmission node by using the video transmission frame.

The adjusted source time sequence is usually a time slot for enabling the transmission node which cannot normally display to normally display the video data according to the adjusted time sequence sent to each transmission node.

Specifically, it is determined whether the delay error is greater than a preset delay threshold. If the delay error is greater than the preset delay threshold, the transmission node cannot adjust the source time sequence according to the delay error. The delay error exceeds the adjustable range of the transmission node and exceeds the time of the resource (time slot) of the current transmission node, so that the transmission node cannot be adjusted. Therefore, the video source can count the delay errors fed back by all the transmission nodes which cannot normally display the video data by using the video transmission frame, and find the maximum delay error. With the maximum delay error as the starting point of the timing sequence, the video source regenerates a new timing sequence, which may be an adjusted source timing sequence. The video source sends the adjusted source timing and video data to each transmission node that fails to display the video data properly. And the transmission node which can not normally display the video data receives and displays the video data by adjusting the source time sequence correctly.

In this embodiment, a new time sequence is generated by using the maximum delay error method and acts on all nodes and/or video terminals, so that it is avoided that a video source uses additional resources to complete the transmission of video data on all nodes and/or video terminals, and because the maximum delay error is used, it can be ensured that each node and/or video terminal can not be affected by the round-trip delay, and video data can be normally displayed.

In an exemplary embodiment, when the delay error is greater than the preset delay threshold, the timing adjustment policy shown in the timing adjustment policy table of table 2 may be adopted to enable each transmission node to normally display.

TABLE 2 timing adjustment policy Table

In an embodiment, as shown in fig. 7, a schematic structural diagram of a video transmission frame is shown, where the video transmission frame further includes: correction confirmation slots and strategy selection slots. As shown in fig. 8, the method further comprises:

s602, receiving a correction confirmation time slot fed back by each transmission node by using the video transmission frame, wherein the correction confirmation time slot represents whether each transmission node correctly receives the video data and displays the video data;

s604, determining that the transmission node correctly receives and displays the video data under the condition that the correction confirmation time slot is confirmed;

s606, sending a fourth signaling to the transmission node, where the fourth signaling is used to instruct the transmission node to store the delay error;

s608, sending video data and the source time sequence to the transmission node by using a standard frame to instruct the transmission node to receive and display the video data by using the stored delay error and the source time sequence.

Specifically, using the policy selection slot to control the video source and each transport node enables each transport node to correctly receive and display video data using the manner as in table 1 or table 2. Specifically, when the method of table 1 is selected, the video source may send a first signaling to each transfer node, and when the method of table 2 is selected, the video source may send a second signaling or a third signaling to each transfer node.

Each transmission node can feed back the results of receiving video and displaying through the correction acknowledgement slots. The video source may determine whether each transmission node correctly received the video data and display it according to the correction acknowledgement slot.

In some exemplary embodiments, for example, where the correction confirmation slot is confirmed, it may be determined that the transmitting node correctly received and displayed the video data. In the case where the correction confirmation slot is not confirmed, it may be determined that the transmission node has not correctly received the video data.

When the transfer node correctly receives and displays the video data, the video source may send a fourth signaling to the transfer node. After receiving the fourth signaling, the transmission nodes may locally store the delay error, and subsequently, when the video source sends video data and a source timing sequence using the standard frame structure shown in fig. 4, each transmission node may adjust the source timing sequence using the stored delay error, and may correctly receive and display the video data using the adjusted source timing sequence.

In the embodiment, after the transmission node utilizes the time delay error to adjust the source time sequence and can correctly display the time delay error, the video data can be transmitted by using the standard frame, and the time delay error is stored locally in the transmission node, so that four newly added time slots in a new frame structure are reduced, the effective load is effectively improved, and the throughput is further increased.

In an embodiment, the processing angles are described by taking a video source as an execution main body, and a transmission node is described as an execution main body below, as shown in fig. 9, an embodiment of the present disclosure further provides a video data transmission method applied to a transmission node, where the method includes:

s702, receiving a source time sequence and video data transmitted by a video source.

S704, responding to the fact that each transmission node cannot normally display video data according to the source time sequence, determining a time delay error according to the source time sequence and the generated local time sequence, and transmitting the time delay error to a video source by using a video transmission frame.

S706, receiving video data transmitted by a video source through the video source transmission frame, adjusting the source time sequence according to the time delay error in the video transmission frame, and receiving and displaying the video data according to the adjusted source time sequence.

Specifically, a transport node receives source timing and video data sent by a video source. And configure itself with various configurations in the source timing and then display the video data. When the transmission node cannot normally receive the video data and cannot normally display the video data, the video data are fed back to the video source, the video source can start a video transmission frame at the moment, and the time delay error can be calculated according to the source time sequence and the local time sequence locally generated by the video source. The transmission node then transmits the delay error to the video source using the video transmission frame. Furthermore, the time slot storage delay error can be updated by using the delay error in the video transmission frame, and the delay error is sent to the video source. And after the video source receives the feedback and starts the video transmission frame, receiving the time delay error sent by the transmission node, and sending the time delay error and the video data to be displayed to the transmission node again by using the video transmission frame. And the transmission node receives video data transmitted by a video source through a video source transmission frame, adjusts the source time sequence according to the time delay error in the video transmission frame, and receives and displays the video data according to the adjusted source time sequence. Specifically, the source timing can be adjusted by using the error + delay error value (note that this value includes sign, i.e. positive and negative) in the current source timing.

In one embodiment, it has been mentioned above that the delay error is positive or negative, so how positive or negative values appear in the present embodiment will be described below. The determining a delay error according to the source timing and the generated local timing comprises:

Specifically, when the delay error is positive, it can be determined that the source timing is ahead of the local timing. The delay error may be denoted as a first delay error. When the delay error is negative, the source timing lag and the local timing can be determined, and the delay error can be marked as a second delay error.

In this embodiment, the source timing can be adjusted more accurately by setting the positive and negative values of the delay error.

In one embodiment, the method further comprises:

wherein the target timing is determined by the video source based on a delay error, the delay threshold, and the source timing; the target transmission node comprises: and the time delay error is larger than the time delay threshold value.

Specifically, when the video source determines that the delay error fed back by the transmission node is greater than a preset delay threshold. The video source may first confirm the destination timing, and see the above embodiments for how to confirm the destination timing. The video source may transmit the target timing and video data to the target transmission node using the video transmission frame. And the target transmission node receives and displays the video data by using the target time sequence.

The method further comprises the following steps:

the adjustment source time sequence is the maximum time delay error in the time delay error updating time slot fed back by each transmission node acquired by the video source; and generating by taking the maximum time delay error as a time sequence starting point.

Specifically, when the video source determines that the delay error fed back by the transmission node is greater than a preset delay threshold. The video source may first confirm the adjusted source timing, and see the above embodiments for how to confirm the adjusted source timing. The video source may transmit the adjusted source timing and video data to the respective transmission nodes using video transmission frames. The transmission node adjusts the source timing and receives and displays video data using the adjusted source timing.

The video transmission frame also comprises a correction confirmation time slot; the method further comprises the following steps:

utilizing a corrected acknowledgement slot fed back by the video transmission frame;

storing the delay error under the condition that the feedback correction confirms that the time slot is confirmed;

and under the condition of receiving video data and source time sequence which are sent by the video source by using standard frames, receiving the video data by using the stored time delay error and the stored source time sequence and displaying the video data.

Specifically, when the transmission node receives video data, the correction acknowledgement slot may be adjusted by using the video transmission frame according to its own display result, and fed back. In case the fed back corrected acknowledgement slot is acknowledged, each transmission node may store the delay error. And under the condition that a subsequent video source uses video data and source time sequence sent by a standard frame, receiving and displaying the video data by using the stored time delay error and the source time sequence.

The method further comprises the following steps:

Specifically, when the transmission node cannot normally display the video data, the video data cached and stored in the local memory may be used for display. The problem that the transmission node which cannot correctly receive the video data cannot display the video data is avoided.

It should be understood that, although the steps in the flowcharts related to the embodiments as described above are sequentially displayed as indicated by arrows, the steps are not necessarily performed sequentially as indicated by the arrows. The steps are not limited to being performed in the exact order illustrated and, unless explicitly stated herein, may be performed in other orders. Moreover, at least a part of the steps in the flowcharts related to the embodiments described above may include multiple steps or multiple stages, which are not necessarily performed at the same time, but may be performed at different times, and the execution order of the steps or stages is not necessarily sequential, but may be performed alternately or alternately with other steps or at least a part of the steps or stages in other steps.

Based on the same inventive concept, the embodiment of the present disclosure further provides a video data transmission apparatus for implementing the above-mentioned video data transmission method. The implementation scheme for solving the problem provided by the apparatus is similar to the implementation scheme described in the above method, so specific limitations in one or more embodiments of the video data transmission apparatus provided below may refer to the limitations on the video data transmission method in the foregoing, and details are not described here again.

In one embodiment, as shown in fig. 10, there is provided a video data transmission apparatus 800 for a video source, comprising: a timing transmission module 802, a video transmission frame determination module 804, and a video data transmission module 806, wherein:

a timing transmission module 802 for transmitting the source timing to each transmission node; the source time sequence is used for configuring parameters when video data are transmitted;

a video transmission frame determining module 804, configured to determine a video transmission frame according to a received delay error in response to that each transmission node cannot normally display video data according to the source timing sequence, where the delay error is determined by each transmission node according to the source timing sequence and a local timing sequence generated by the transmission node;

and a video data transmission module 806, configured to transmit video data to each transmission node by using the video transmission frame.

In an embodiment of the apparatus, the video transmission frame determining module 804 is further configured to enable an enabled timeslot in the video transmission frame in response to that the transmission nodes cannot normally display video data according to the source timing sequence, and use the video transmission frame in a case that the enabled timeslot is enabled; and updating the time slot by using the time delay error in the video transmission frame, and storing the time delay error.

In an embodiment of the apparatus, the video data transmission module 806 is further configured to transmit the delay error update timeslot, the first signaling and the video data to each transmission node by using the video transmission frame; and the first signaling is used for instructing each transmission node to adjust the source time sequence according to the delay error in the delay error updating time slot, and receiving and displaying the video data according to the adjusted source time sequence.

In one embodiment of the apparatus, the apparatus further comprises: and the target time sequence determining module responds to the condition that the time delay error is larger than a preset time delay threshold value, and determines a target time sequence according to the time delay error in the time delay updating time slot fed back by each transmission node, the time delay threshold value and the source time sequence.

A target timing sequence sending module, configured to send the target timing sequence, the video data, and a second signaling to a target transmission node, where the target transmission node includes: and the second signaling is used for indicating the target transmission node to receive and display the video data by utilizing the target time sequence.

In one embodiment of the apparatus, the apparatus further comprises: and the maximum delay error determining module is used for responding to the delay error larger than a preset delay threshold value and acquiring the maximum delay error in the delay error updating time slot fed back by each transmission node.

And the adjusting source time sequence determining module is used for generating the adjusting source time sequence by taking the maximum time delay error as a time sequence starting point.

And the adjusting source time sequence sending module is used for sending the adjusting source time sequence, the video data and a third signaling to each transmission node, and the third signaling is used for indicating each transmission node to receive and display the video data by using the adjusting source time sequence.

In one embodiment of the apparatus, the video transmission frame further comprises a correction acknowledgement slot; the device further comprises: a time slot receiving module, configured to receive a correction confirmation time slot fed back by each transmission node by using the video transmission frame, where the correction confirmation time slot represents whether each transmission node correctly receives and displays the video data;

a time slot confirmation module, configured to determine that the transmission node correctly receives and displays the video data when the correction confirmation time slot is confirmed;

a storage indication module, configured to send a fourth signaling to the transmission node, where the fourth signaling is used to indicate the transmission node to store the delay error;

and the standard frame sending module is used for sending the video data and the source time sequence to the transmission node by using a standard frame so as to instruct the transmission node to receive and display the video data by using the stored delay error and the source time sequence.

An embodiment of the present disclosure further provides a video data transmission apparatus 900, which is applied to a transmission node, and as shown in fig. 11, the apparatus includes:

a timing receiving module 902, configured to receive a source timing and video data transmitted by a video source;

a delay error transmission module 904, configured to determine a delay error according to the source timing sequence and a generated local timing sequence in response to that each transmission node cannot normally display video data according to the source timing sequence, and transmit the delay error to a video source;

a video data receiving module 906, configured to receive video data transmitted by a video source using the video source transmission frame, adjust the source timing according to a delay error in the video transmission frame, and receive and display the video data according to the adjusted source timing.

In one embodiment of the apparatus, the delay error transmission module 904 comprises a delay error determination module that determines a first delay error in response to the received source timing being ahead of the local timing, the first delay error being a positive number; determining a second latency error in response to the received source timing lagging the local timing, the second latency error being a negative number.

In one embodiment of the apparatus, the apparatus further comprises: the target time sequence receiving module is used for responding to the time delay error larger than a preset time delay threshold value and receiving the target time sequence and the video data transmitted by the video source;

the target node display module is used for receiving and displaying the video data by the target transmission node by utilizing the target time sequence;

In one embodiment of the apparatus, the apparatus further comprises: the adjusting source time sequence receiving module is used for responding to the time delay error larger than a preset time delay threshold value and receiving the adjusting source time sequence and the video data transmitted by the video source;

the adjusting source time sequence processing module is used for receiving and displaying the video data by utilizing the adjusting source time sequence;

the source timing sequence is adjusted according to the maximum delay error in the delay error updating time slot fed back by each transmission node acquired by the video source; and generating by taking the maximum delay error as a time sequence starting point.

In one embodiment of the apparatus, the video transmission frame further comprises a correction acknowledgement slot; the device further comprises:

a feedback module for utilizing the corrected confirmation time slot fed back by the video transmission frame;

the storage module is used for storing the time delay error under the condition that the feedback correction confirms that the time slot is confirmed;

and the local error processing module is used for receiving and displaying the video data by utilizing the stored delay error and the source time sequence under the condition of receiving the video data and the source time sequence which are sent by the video source by using a standard frame.

In one embodiment of the apparatus, the apparatus further comprises: and the local display module responds to the fact that the transmission nodes cannot normally display the video data according to the source time sequence, and the transmission nodes display the video data stored in the local memory.

The various modules in the video data transmission apparatus described above may be implemented in whole or in part by software, hardware, and a combination thereof. The modules can be embedded in a hardware form or independent from a processor in the computer device, and can also be stored in a memory in the computer device in a software form, so that the processor can call and execute operations corresponding to the modules.

In one embodiment, a computer device is provided, which may be a terminal, and its internal structure diagram may be as shown in fig. 12. The computer device includes a processor, a memory, a communication interface, a display screen, and an input device connected by a system bus. Wherein the processor of the computer device is configured to provide computing and control capabilities. The memory of the computer device comprises a nonvolatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of an operating system and computer programs in the non-volatile storage medium. The communication interface of the computer device is used for communicating with an external terminal in a wired or wireless manner, and the wireless manner can be realized through WIFI, a mobile cellular network, NFC (near field communication) or other technologies. The computer program is executed by a processor to implement a video data transmission method. The display screen of the computer equipment can be a liquid crystal display screen or an electronic ink display screen, and the input device of the computer equipment can be a touch layer covered on the display screen, a key, a track ball or a touch pad arranged on the shell of the computer equipment, an external keyboard, a touch pad or a mouse and the like.

It will be appreciated by those skilled in the art that the configuration shown in fig. 12 is a block diagram of only a portion of the configuration associated with the disclosed aspects and is not intended to limit the computing devices to which the disclosed aspects apply, as particular computing devices may include more or fewer components than shown, or may combine certain components, or have a different arrangement of components.

In an embodiment, a computer device is provided, comprising a memory in which a computer program is stored and a processor which, when executing the computer program, carries out the steps of any of the above method embodiments.

In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored, which computer program, when being executed by a processor, carries out the steps of any of the above-mentioned method embodiments.

In an embodiment, a computer program product is provided, comprising a computer program which, when executed by a processor, performs the steps of any of the method embodiments described above.

It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by hardware instructions of a computer program, which can be stored in a non-volatile computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. Any reference to memory, databases, or other media used in the embodiments provided by the present disclosure may include at least one of non-volatile and volatile memory. The nonvolatile Memory may include Read-Only Memory (ROM), magnetic tape, floppy disk, flash Memory, optical Memory, high-density embedded nonvolatile Memory, resistive Random Access Memory (ReRAM), magnetic Random Access Memory (MRAM), ferroelectric Random Access Memory (FRAM), phase Change Memory (PCM), graphene Memory, and the like. Volatile Memory can include Random Access Memory (RAM), external cache Memory, and the like. By way of illustration and not limitation, RAM can take many forms, such as Static Random Access Memory (SRAM) or Dynamic Random Access Memory (DRAM), for example. The databases involved in embodiments provided by the present disclosure may include at least one of relational and non-relational databases. The non-relational database may include, but is not limited to, a block chain based distributed database, and the like. The processors referred to in the various embodiments provided in this disclosure may be, without limitation, general purpose processors, central processing units, graphics processors, digital signal processors, programmable logic devices, quantum computing-based data processing logic devices, or the like.

All possible combinations of the technical features in the above embodiments may not be described for the sake of brevity, but should be considered as being within the scope of the present disclosure as long as there is no contradiction between the combinations of the technical features.

The above-mentioned embodiments only express several implementation modes of the present disclosure, and the description thereof is specific and detailed, but not to be understood as limiting the scope of the present disclosure. It should be noted that various changes and modifications can be made by one skilled in the art without departing from the spirit of the disclosure, and these changes and modifications are all within the scope of the disclosure. Therefore, the protection scope of the present disclosure should be subject to the appended claims.

Claims

1. A video data transmission method, applied to a video source, the method comprising:

transmitting the source time sequence to each transmission node; the source time sequence is used for configuring parameters when video data are transmitted;

responding to the fact that each transmission node cannot normally display video data according to the source time sequence, and determining a video transmission frame according to a received time delay error, wherein the time delay error is determined by each transmission node according to the source time sequence and a local time sequence generated by the transmission node;

and transmitting the video data to each transmission node by using the video transmission frame.

2. The method of claim 1, wherein determining a video transmission frame based on the received delay error comprises:

3. The method of claim 2, wherein transmitting video data to each transmission node using the video transmission frame comprises:

transmitting the time delay error updating time slot, a first signaling and the video data to each transmission node by using the video transmission frame; and the first signaling is used for instructing each transmission node to adjust the source time sequence according to the delay error in the delay error updating time slot, and receiving and displaying the video data according to the adjusted source time sequence.

4. The method of claim 3, further comprising:

in response to the time delay error being larger than a preset time delay threshold, updating the time delay error in the time slot, the time delay threshold and the source time sequence according to the time delay error fed back by each transmission node to determine a target time sequence;

transmitting the target timing, the video data, and a second signaling to a target transport node, the target transport node comprising: and the second signaling is used for indicating the target transmission node to receive and display the video data by utilizing the target time sequence.

5. The method of claim 3, further comprising:

6. The method according to claim 1 or 2, characterized in that the video transmission frame further comprises a correction acknowledgement slot; the method further comprises the following steps:

sending a fourth signaling to the transmission node, where the fourth signaling is used to instruct the transmission node to store the delay error;

7. A video data transmission method applied to a transmission node, the method comprising:

receiving a source time sequence and video data transmitted by a video source;

responding to the fact that each transmission node cannot normally display video data according to the source time sequence, determining a time delay error according to the source time sequence and the generated local time sequence, and transmitting the time delay error to a video source by using a video transmission frame;

8. The method of claim 7, wherein determining a delay error based on the source timing and the generated local timing comprises:

9. The method of claim 7, further comprising:

responding to the fact that the time delay error is larger than a preset time delay threshold value, and receiving a target time sequence and video data transmitted by the video source;

10. The method of claim 7, further comprising:

responding to the fact that the time delay error is larger than a preset time delay threshold value, and receiving an adjustment source time sequence and video data transmitted by the video source;

11. The method of claim 7, wherein the video transmission frame further comprises a correction acknowledgement slot; the method further comprises the following steps:

12. The method of claim 7, further comprising:

13. A video data transmission apparatus, applied to a video source, the apparatus comprising:

14. A video data transmission apparatus, applied to a transmission node, the apparatus comprising:

the time sequence receiving module is used for receiving source time sequences and video data transmitted by a video source;

the time delay error transmission module is used for responding that each transmission node cannot normally display video data according to the source time sequence, determining a time delay error according to the source time sequence and a generated local time sequence, and transmitting the time delay error to a video source;

15. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the method of any one of the preceding claims 1 to 6 or 7 to 12.