CN115225775B

CN115225775B - Multichannel delay correction method and device and computer equipment

Info

Publication number: CN115225775B
Application number: CN202211134433.7A
Authority: CN
Inventors: 魏巍; 金凯
Original assignee: Suzhou HYC Technology Co Ltd
Current assignee: Suzhou HYC Technology Co Ltd
Priority date: 2022-09-19
Filing date: 2022-09-19
Publication date: 2022-12-09
Anticipated expiration: 2042-09-19
Also published as: CN115225775A

Abstract

The disclosure relates to a multi-channel delay correction method, a multi-channel delay correction device and computer equipment. Applied to a video source, the method comprising: determining a video source or a delayed transmission node as a non-delayed starting point for each transmission node in a transmission channel; the delayed transmission node includes: a transmission node with a delay between the transmission node and a video source larger than a preset delay threshold value; determining a test sequence according to a non-delay starting point and delay between the non-delay starting point and each transmission node, wherein the test sequence is used for determining the delay condition of the transmission node; and sending the test sequence and the video data to each transmission node, wherein the test sequence is used for indicating each transmission node to carry out delay correction, and the delay correction comprises the following steps: and determining invalid data in the received video data by using the position information marked in the test sequence and the non-delayed starting point, and determining and displaying valid video data by using the invalid data and the video data. By adopting the method, the extra signaling consumption can be reduced when the time delay is corrected.

Description

Multichannel delay correction method and device and computer equipment

Technical Field

The present disclosure relates to the field of data transmission technologies, and in particular, to a method, an apparatus, and a computer device for correcting delay of multiple channels.

Background

At present, video image systems, especially Video image processing systems with Display Ports (DP) of VESA (Video Electronics Standards Association), MIPI (Mobile Industry Processor Interface standard), and HDMI (High Definition Multimedia Interface standard) are used to drive and Display panels and terminals such as Liquid Crystal Display (LCD), organic Light-Emitting Diode (OLED), etc. due to different data transmission mechanisms in multiple channels, a large amount of transmission delay may be generated in different link topologies.

The synchronization of special coded signaling is performed before the video is transmitted, which causes difficulties in synchronization and video data display due to the large transmission delay. When the transmission delay is corrected for all nodes and/or video terminals in a hierarchy, the delay needs to be corrected by means of signaling for each hierarchy. The video source needs at least one signaling to transmit and receive for completing the delay correction of one node and/or video terminal, and for a large number of nodes and/or video terminals, transmission delay exists, so that additional signaling and round-trip delay during signaling transmission are added during correction, and difficulty in correcting the transmission delay is further increased.

Disclosure of Invention

In view of the foregoing, there is a need to provide a multi-channel delay correction method, apparatus, and computer device that can reduce extra signaling consumption when synchronizing or correcting delay and can correct transmission delay.

In a first aspect, the present disclosure provides a multi-pass delay correction method. The method is applied to video sources. The method comprises the following steps:

determining a video source or a delayed transmission node as a non-delayed starting point for each transmission node in a transmission channel; the delayed transmission node includes: a transmission node having a delay with the video source greater than a preset delay threshold;

determining a test sequence according to the starting point without delay and the delay between the starting point without delay and each transmission node, wherein the test sequence is used for determining the delay condition of the transmission node;

sending the test sequence and the video data to each transmission node, wherein the test sequence is used for indicating each transmission node to perform delay correction, and the delay correction comprises: and determining invalid data in the received video data by using the position information marked in the test sequence and the non-delayed starting point, and determining and displaying valid video data by using the invalid data and the video data.

In one embodiment, the test sequence comprises: accumulating test sequences and reusing test sequences, wherein the determining of the test sequences according to the starting point of the non-delay and the delay between each transmission node comprises the following steps:

measuring a delay between each transmission node and the corresponding transmission node;

according to the relation between the delay and the starting point of no delay, adding a delay unit corresponding to the delay before and after the starting point of no delay to obtain an accumulated test sequence;

and/or, determining the transmission length of the reuse test sequence according to a predetermined maximum delay;

within the transmission length range, adding at least one delay unit before and after the starting point without delay to obtain a test sequence to be processed;

and marking a delay unit corresponding to the delay in the test sequence to be processed to obtain the reuse test sequence.

In one embodiment, the adding a delay unit corresponding to the delay before and after the start point of no delay according to the relationship between the delay and the start point of no delay to obtain an accumulated test sequence includes:

in response to the delay being greater than the start of no delay, adding a delay unit corresponding to the delay after the start of no delay to obtain a first test symbol, and marking a transmission node using the first test symbol to obtain the cumulative test sequence;

responding to the delay smaller than the starting point of no delay, adding a delay unit corresponding to the delay before the starting point of no delay to obtain a second test symbol, and marking a transmission node using the second test symbol to obtain the accumulated test sequence;

in response to the delay equaling the start of no delay, marking the transmission node using the delay, resulting in a cumulative test sequence.

In one embodiment, the adding a delay unit corresponding to the delay before and after the start of no delay according to the relationship between the delay and the start of no delay to obtain a cumulative test sequence further includes:

determining at least one standard transmission node in each transmission node, and acquiring a standard delay corresponding to the standard transmission node;

according to the relation between the standard delay and the starting point of the no delay, adding delay units corresponding to the standard delay before and after the starting point of the no delay to obtain a third test symbol, and marking the standard transmission node using the third test symbol to obtain a standard accumulation sequence;

in response to the delay of each transmission node being the same as the standard delay, marking the first transmission node corresponding to the same delay as using the third test symbol to obtain an accumulated test sequence;

and in response to the fact that the delay of each transmission node is not the same as the standard delay, adding or subtracting the delay unit corresponding to the difference value at a third test symbol in the standard cumulative sequence according to the difference value between the delay of each transmission node and the standard delay to obtain a cumulative test sequence.

In one embodiment, the marking a delay unit corresponding to the delay in the test sequence to be processed to obtain the reuse test sequence further includes:

marking a delay unit corresponding to the standard delay in the test sequence to be processed to obtain a standard retransmission sequence;

responding to the delay of each transmission node, wherein the delay is the same as the standard delay, and marking the same delay as the standard delay as a delay unit which is the same as the standard delay to obtain a reuse test sequence;

and responding to the condition that the delay of each transmission node is not the same as the standard delay, and marking a delay unit corresponding to the difference at a delay unit corresponding to the standard delay in the standard retransmission sequence according to the difference between the delay of each transmission node and the standard delay to obtain a reuse test sequence.

In one embodiment, each transmission node in the transmission channel includes any one of the following:

all transmission nodes, all transmission nodes in each transmission channel and each transmission node in each transmission channel.

In one embodiment, the method further comprises: sending the test sequence and the video data to each transmission node by using a pre-established delay correction frame;

the delay correction frame includes: a modification enable slot, the delayed modification frame being used in case the modification enable slot is enabled;

the test sequence marking time slot is used for storing the test sequence, and the test sequence is used for determining the delay condition of the transmission node;

a policy application time slot for confirming a manner of determining a test sequence, the manner of determining a test sequence comprising: according to the relation between the delay and the starting point of no delay, adding a delay unit corresponding to the delay before and after the starting point of no delay to obtain an accumulated test sequence, or marking the delay unit corresponding to the delay in the test sequence to be processed to obtain the reuse test sequence.

In one embodiment, the sending the test sequence and the video data to each transmission node includes:

when the cumulative test sequence is sent each time, adding a corresponding cumulative length indication field in the cumulative test sequence, wherein the length indication field is used for indicating each transmission node to acquire the position of the delay unit in the cumulative test sequence;

when the reuse test sequence is sent for the first time, a corresponding reuse length indication field is added in the reuse test sequence, and the reuse length indication field is used for indicating the transmission length of the reuse test sequence.

In a second aspect, the present disclosure further provides a multi-channel delay correction method, applied to a transmission node, where the method includes: receiving a test sequence and video data sent by a video source;

determining invalid data in the received video data by using the marked position information in the test sequence and the non-delay starting point determined by the video source;

determining valid video data by using the invalid data and the video data and displaying the valid video data; the video source determines a non-delay starting point and a delay between the video source and each transmission node, and the non-delay starting point is determined according to the video source or the delay transmission node; the delayed transmission node includes: and the transmission node has a delay larger than a preset delay threshold value with the video source.

In one embodiment, the test sequence comprises: accumulating test sequences and reusing the test sequences, wherein the determining invalid data in the received video data by using the position information of the mark in the test sequences and the start point without delay comprises the following steps:

when the test sequence is an accumulated test sequence, determining invalid delay time according to the test sequence symbols marked in the accumulated test sequence or the delay;

when the test sequence is a reuse test sequence, determining corresponding invalid delay time according to a delay unit which is marked in the reuse test sequence and corresponds to the delay of the transmission node;

determining the video data received within the invalid delay time as invalid data.

In one embodiment, the method comprises:

and after the effective video data is failed to be displayed, feeding back a failure result of delay correction to a video source.

In a third aspect, the present disclosure also provides a multi-channel delay correction apparatus. Applied to a video source, the apparatus comprising:

the non-delay determining module is used for determining a video source or a delay transmission node as a non-delay starting point aiming at each transmission node in the transmission channel; the delayed transmission node includes: a transmission node having a delay with the video source greater than a preset delay threshold;

a test sequence determining module, configured to determine a test sequence according to the starting point without delay and the delay between the starting point and each transmission node, where the test sequence is used to determine the delay condition of the transmission node;

a data sending module, configured to send the test sequence and the video data to each transmission node, where the test sequence is used to instruct each transmission node to perform delay correction, and the delay correction includes: and determining invalid data in the received video data by using the position information marked in the test sequence and the non-delayed starting point, and determining and displaying valid video data by using the invalid data and the video data.

In a fourth aspect, the present disclosure also provides a multi-channel delay correction apparatus. Applied to a transmission node, the apparatus comprising: the data receiving module is used for receiving the test sequence and the video data sent by the video source;

the invalid data determining module is used for determining invalid data in the received video data by utilizing the marked position information in the test sequence and the non-delay starting point determined by the video source;

the valid data display module is used for determining valid video data by using the invalid data and the video data and displaying the valid video data; the video source determines a non-delay starting point and a delay between the video source and each transmission node, and the non-delay starting point is determined according to the video source or the delay transmission node; the delayed transmission node includes: and the transmission node has a delay larger than a preset delay threshold value with the video source.

In a fifth aspect, the present disclosure also provides a computer device. The computer device comprises a memory storing a computer program and a processor implementing the steps of any of the above method embodiments when executing the computer program.

In a sixth aspect, the present disclosure also provides a computer-readable storage medium. The computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the steps of any of the above-mentioned method embodiments.

In a seventh aspect, the present disclosure also provides a computer program product. The computer program product comprising a computer program that when executed by a processor performs the steps of any of the above-described method embodiments.

In the above embodiments, after determining the start point of no delay, the test sequence is determined according to the delay with each transmission node. When the test sequence is determined, the same clock can be used as a measurement for each transmission node, namely the same symbol field is used, so that the test sequence is obtained, and the precision is high. In addition, the delay is corrected using the test sequence because of the higher accuracy in the test sequence. Therefore, when the transmission node is corrected by using the test sequence, the delay can better determine invalid data. And further effective data can be determined more accurately. And when correcting the time delay, the correction of the time delay can be completed only by sending the test sequence without extra signaling consumption, and the round-trip time delay can be accurately corrected because the precision in the test sequence is higher.

Drawings

In order to more clearly illustrate the embodiments of the present disclosure or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present disclosure, and other drawings can be obtained by those skilled in the art without creative efforts.

Fig. 1 is a schematic diagram of a transmission link topology involved in some embodiments of the present disclosure;

FIG. 2 is a schematic block diagram of a video image processing system involved in some embodiments of the present disclosure;

FIG. 3 is a flow diagram illustrating a multi-pass delay correction method in accordance with one embodiment;

FIG. 4 is a flowchart illustrating the step S104 according to an embodiment;

FIG. 5 is a flowchart illustrating the step S204 according to an embodiment;

FIG. 6 is another flowchart illustrating the step S204 according to an embodiment;

FIG. 7 is a flowchart illustrating the step S210 according to an embodiment;

FIG. 8 is a diagram of a delay correction frame structure in one embodiment;

FIG. 9 is a diagram of a standard frame structure in one embodiment;

FIG. 10 is a flow chart illustrating a multi-channel delay correction method according to another embodiment;

FIG. 11 is a flowchart illustrating a step S106 in another embodiment;

FIG. 12 is a diagram of interaction fields in another embodiment;

FIG. 13 is a block diagram showing a schematic structure of a delay correcting unit of a plurality of channels in one embodiment;

FIG. 14 is a block diagram schematically showing the structure of a delay correcting unit of a plurality of channels in another embodiment;

FIG. 15 is a diagram showing an internal configuration of a computer device according to an embodiment.

Detailed Description

In order to make the objects, technical solutions and advantages of the present disclosure more clearly understood, the present disclosure is further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the disclosure and are not intended to limit the disclosure.

It should be noted that the terms "first," "second," and the like in the description and claims herein and in the above-described drawings are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments herein described are capable of operation in sequences other than those illustrated or described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, apparatus, article, or device that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or device.

In this document, the term "and/or" is only one kind of association relationship describing the associated object, meaning that three kinds of relationships may exist. For example, a and/or B, may represent: a exists alone, A and B exist simultaneously, and B exists alone. In addition, the character "/" herein generally indicates that the former and latter related objects are in an "or" relationship.

As described in the background, a video source needs to synchronize the transmission nodes before sending video data, usually by using some special coded signaling. The synchronization operation means that the video source completes synchronization of all nodes and/or video terminals in each channel. When the video source initiates synchronization, the video source can finish synchronization independently for each layer, and can also finish synchronization of the next layer through the node and/or the video terminal which finish synchronization. In this case, the video source needs at least one signaling transmission and reception for one node to complete synchronization, and the signaling interaction amount is increased significantly for a large number of nodes. And a large amount of resources (time slots) need to be occupied to transmit the signaling, so that the effective load is obviously reduced, and the throughput is further reduced. Meanwhile, due to the existence of transmission delay, difficulties are brought to signaling sending and receiving in the process of synchronizing nodes and/or video terminals of different levels on different channels in a link topology.

Accordingly, to solve the above problems and the problems mentioned in the background, the present disclosure provides a multi-channel delay correction method, apparatus, and computer device.

Fig. 1 shows a network topology according to an embodiment of the present disclosure. Fig. 1 shows a transmission link topology diagram of the present disclosure, which includes a video source, and corresponds to a transmission node that can be centrally controlled. As shown in fig. 1, most of the transmission link topologies referred to in this disclosure can include the following categories: video source → node 1 → video device 1, video device 2 and video device 3. The video device 3 can also be connected directly to a video source. I.e., video source → video device 3. Video source → node 2 → video device 4 and video device 5. Video source → node 3 → video device 6, video device 7, video device 8 and video device 9. Video source → video device 6. Video source → node 4 → node 5 → video device 11. The data transmission process involved in this embodiment may be sending video data to each node or video device for a video source. And each node issues video data to each video device. Each video device or node displays video data. In some embodiments, the transport node may comprise a node and/or a video device. Taking the video device 3 as an example, the video device 3 has two topology structures, which are: video source → node 1 → video device 3 and video source → video device 3. Each node and/or video device may correspond to multiple transmission links and thus multiple topologies.

With continuing reference to fig. 1, and with further reference to the hierarchy, there may be four levels of the topology of fig. 1. Hierarchy refers to the number of nodes and/or video terminals through which different nodes and/or video terminals in each transmission link reach the video source, for example, if the nodes and/or video terminals are directly connected to the video source, then, starting from the video source, the video source can be regarded as hierarchy 1, and the nodes and/or video terminals are at hierarchy 2, such as node 1, node 2, node 3, node 4 and video device 3 in fig. 1; and so on.

Continuing with the description of upstream and downstream as shown in FIG. 1, the video source may be upstream of node 1, node 2, node 3, and node 4. Downstream of node 1 may be video device 1, video device 2, and video device 3. If the video device 3 receives video data transmitted by a video source and does not receive data transmitted by the node 1, the video device 3 may be downstream of the video source. If the video device 3 does not receive the video data transmitted by the video source and receives the video data transmitted by the node 1, the video device 3 may be downstream of the node 1. In addition, the node upstream can be regarded as the previous level, and the node downstream can be regarded as the next level.

Next, a video image processing system according to the following embodiments of the present disclosure is introduced, as shown in fig. 2, including: the device comprises an embedded control module, an FPGA module, an external storage module, a quick storage module, a peripheral module, a video interface physical layer implementation module and a video transmission link.

The embedded control module can use any embedded chip and system, and is mainly responsible for initiating signaling interaction, such as reading/writing a register, enabling/closing a video display module, peripheral control, parameter setting of the video display module and the like. The FPGA module is mainly responsible for implementing the implementation parts which need a large amount of data processing and low round-trip delay (latency) such as storage control, peripheral control, video interface IP core implementation and the like. The external storage module is mainly responsible for storing original data streams of video images needing to be displayed in the video image processing system, and the part is applied to storage media such as NandFlash, SSD and the like, but is not limited to the storage media. The fast storage module is used in an implementation process that requires a large amount of data processing and low round-trip delay (latency) inside an FPGA module, and in order to reduce the delay and delay storage, the module applies a fast and low-delay physical device, such as DDR3, but is not limited thereto. The peripheral modules include GPIO (General-purpose input/output), UART (Universal Asynchronous Receiver/Transmitter), USB (Universal Serial Bus), network interface, and the like, but are not limited thereto. The video interface physical layer implementation module is mainly responsible for the physical layer implementation required for driving the display module, such as, but not limited to, TX/RX (Transmitter/Receiver) -PHY of DisplayPort, DPHY of MIPI, and the like.

Furthermore, the FPGA module includes a bus interaction module, an MCU (micro controller Unit, micro control module) video stream preprocessing module, a video data stream transmission control module, a clock control module, an embedded soft core control module, a bus controller module, an internal storage controller module, an external control module, a display clock generator module, a video timing controller module, and a video interface IP core module. The bus interaction module is mainly responsible for the functions of selection, decision and the like of all other modules connected to the bus interaction module. The MCU video stream preprocessing module is mainly responsible for preprocessing and converting the video data stream input from the external storage module according to the format and parameter types set by the system so as to facilitate the post-processing. And the video data stream transmission control module is mainly responsible for controlling the time sequence, parameters and the like of the data stream after data stream preprocessing and conversion. And the clock control module is mainly responsible for generating and controlling a global clock in the video image processing system. The embedded soft core control module is a control core of the FPGA module, and is mainly responsible for core functions of timing control, parameter configuration, physical process implementation and the like of all modules inside the FPGA module, and the embedded soft core control module can be used in the implementation of the core functions, such as Xilinx MicroBlaze and the like, but is not limited to the implementation. The bus controller module is mainly responsible for controlling all modules connected with the bus interaction module, but is not limited to the bus controller module. The video image processing module is mainly responsible for mode conversion, timing control and the like of video image data streams corresponding to the video interface IP core module, but is not limited to this. The internal storage controller module is mainly responsible for controlling the fast storage module, including but not limited to writing/reading of data stream, frame control, and the like. The peripheral control module is mainly responsible for controlling all the peripheral modules, including enabling/shutting down of the peripheral, controlling the working mode, and the like, but not limited thereto. The display clock generator module is mainly responsible for timing control of all modules, including but not limited to the video interface IP core module and the video interface physical layer implementation module. The video timing controller module is mainly responsible for data conversion, timing control and other processing when data input from the video image processing module is transmitted to the video interface IP core module, but is not limited to this.

The transmission channels (e.g., channel 1, channel 2, channel 3, and channel 4 as shown in fig. 1) include: video source (video transmission source), transport node (embedded physical repeater, cable with source ID, detachable physical repeater, video sink, etc.), but is not limited thereto. In some embodiments of the disclosure, a transmitting node may comprise a node and/or a video device.

In one embodiment, as shown in FIG. 3, a multi-pass delay correction method is provided for use with the video source of the video image processing system of FIG. 2. It is understood that the method can also be applied to other video image processing systems, and the video image processing system shown in fig. 2 is exemplified in the present embodiment. The method comprises the following steps:

s102, aiming at each transmission node in a transmission channel, determining a video source or a delay transmission node as a non-delay starting point; the delayed transmission node includes: and the transmission node has a delay larger than a preset delay threshold value with the video source.

Each transmission node in the transmission channel may include: all transmission nodes in each individual transmission channel, e.g. all transmission nodes in channel 1 in fig. 1, comprise: node 1, video device 2, and video device 3. May also include: each transmission node in each transmission channel. The method can also comprise the following steps: all transmission nodes in all transmission channels. No delay may typically be no delay, typically no delay is present for the video source itself.

In particular, for a transport node in a transport channel, the video source may determine itself to be the starting point of no delay. Or when the video source determines that the delay from a transmission node of a certain hierarchy is too large, i.e., exceeds a preset delay threshold, for simplicity of operation, the video source may designate the transmission node of the hierarchy as the starting point of all transmission nodes of the hierarchy below the transmission node, which may be a delayed transmission node.

In addition, it is understood that the delay involved in the embodiments of the present disclosure is usually an effective delay, i.e., a delay between a transmitting end and a receiving end, and a delay caused by other transmission nodes is invalid for the current delay measurement of the transmitting end and the receiving end. The transmitting end may include: a video source and a transmission node. The receiving end may comprise a transmitting node.

And S104, determining a test sequence according to the starting point without delay and the delay between the starting point without delay and each transmission node, wherein the test sequence is used for determining the delay condition of the transmission node.

The test sequence may be generally represented by a specific symbol sequence, and may be used to determine the delay between each transmission node and the corresponding transmitting end.

Specifically, after the start point of no delay is determined, the delay between the start point of no delay and each transmission node can be measured. The delay is then set or marked as a corresponding symbol field that can determine the delay of the transmitting node and thus the test sequence. The symbol fields used in each transmitting node are typically uniform. It is understood that a person skilled in the art may select other ways to determine the sequence or field according to the starting point of the non-delay and the delay between the transmission node and the transmission node, as long as the delay condition of the transmission node can be determined by testing the sequence.

S106, sending the test sequence and the video data to each transmission node, wherein the test sequence is used for indicating each transmission node to carry out delay correction, and the delay correction comprises the following steps: and determining invalid data in the received video data by using the position information marked in the test sequence and the non-delayed starting point, and determining and displaying valid video data by using the invalid data and the video data.

In particular, the video source may transmit the test sequence and the video data to the respective transmission nodes. After each transmission node receives the video data, due to the existence of delay, the video data can be normally displayed only after the delay needs to be corrected. The transmitting node may thus use the position information of the marker in the test sequence, such as the above-mentioned symbol field, to determine the time of the invalidation delay, during which the received video data is invalid, and receiving all the video data, removing the invalid video data to obtain the valid video data, and displaying the valid video data by the transmission node at the moment.

In addition, aiming at the problems of delay, and difficulty in synchronously transmitting and receiving signaling, the video source can only transmit the test sequence and the signaling to be transmitted to each transmission node. Each transmission node can normally receive signaling in the same manner as the video data.

In the multi-channel delay correction method, after the start point of no delay is determined, the test sequence is determined according to the delay between each transmission node and the test sequence. When the test sequence is determined, the same clock can be used as a meter for each transmission node, namely the same symbol field is used, so that the test sequence is obtained, and the precision is high. In addition, the test sequence is used to correct for delays because of the higher precision in the test sequence. Therefore, the transmission node can better determine invalid data when the transmission node is delayed by correcting the test sequence. And further effective data can be determined more accurately. And when correcting the time delay, the correction of the time delay can be finished only by sending the test sequence without extra signaling consumption, and the round-trip time delay can be corrected accurately because the precision in the test sequence is higher.

In one embodiment, the test sequence comprises: accumulating the test sequence and reusing the test sequence, as shown in fig. 4, the determining the test sequence according to the start point of the no delay and the delay between the start point and each transmission node includes:

s202, delay between the transmission node and each transmission node is measured.

And S204, according to the relation between the delay and the starting point of the non-delay, adding a delay unit corresponding to the delay before and after the starting point of the non-delay to obtain an accumulated test sequence.

Wherein the delay unit may typically be the smallest delay unit, e.g. nanoseconds, microseconds, etc. The relationship between the delayed and non-delayed starting points may include: the delay is greater than the start of no delay, the delay is less than the start of no delay and the delay is equal to the start of no delay.

Specifically, when the non-delayed starting point is a video source, the video source may send a delay test sequence to each transmission node, each transmission node may feed back feedback data to the video source after receiving the delay test sequence, and after receiving the feedback data, the video source calculates to obtain transmission before each transmission node according to time of sending the delay test sequence and time of receiving the feedback data. When the starting point of the non-delay is the delayed transmission node, the delayed transmission node may determine the delay with the transmission node of the lower hierarchy level in the same processing manner as the video source. A delay unit corresponding to the delay may then be added before and after the start of no delay, depending on the relationship between the delay and the start of no delay.

In some exemplary embodiments, the start of no delay may be marked as a special sequence symbol, e.g., 0, 1, etc. It will be appreciated that the particular sequence symbol is not limited in the disclosed embodiments as long as the video source is able to recognize the symbol. For example with a delay of 5ns. The delay is greater than the starting point of no delay with a minimum delay unit of 1ns, denoted by N. The starting point of no delay is 0. The resulting cumulative test sequence may be 0NNNNN. It will be understood that the above description is intended to be illustrative only.

And/or, S206, determining the transmission length of the reuse test sequence according to the predetermined maximum delay.

And S208, in the transmission length range, adding at least one delay unit before and after the start point of the non-delay to obtain a test sequence to be processed.

S210, marking a delay unit corresponding to the delay in the test sequence to be processed to obtain the reuse test sequence.

Where the test sequence to be processed is typically a sequence of only length (delay units) present with no data. For example, a certain length of 3. The test sequence to be processed may be: and (4) X0X. Where X is a delay unit and does not represent data.

Specifically, in general, the video source may determine the transmission length of the reuse test sequence according to the maximum delay that can be supported when the transmission channel is successfully established. After the transmission length is determined, the same number of delay units are added before and after the start point of no delay within the range of the transmission length, and the sequence length obtained after adding the delay units can be equal to the transmission length of the reuse test sequence under the normal condition. Since the corresponding delay unit has been added, the delay unit used by the transmission node can be marked in the sequence subsequently after determining the delay of the transmission node, resulting in a reuse test sequence after marking.

In some exemplary embodiments, the predetermined maximum delay is, for example, 10ns. The maximum delay corresponding to the transmission length of the reuse test sequence may be 10ns. The starting point of no delay is 0. The minimum delay unit is 1ns, denoted by N. The resulting test sequence to be processed may be: NNNNN0NNNNN. In this case, if the measured delay is 5ns, M may be used for marking, and M may also be 1ns. The reuse test sequence nnnnnnn 0MMMMM can be obtained after marking. After marking, the transmission nodes corresponding to the same delay may also use the reuse test sequence.

In this embodiment, by adding the corresponding delay unit to the starting point without delay, the finally obtained cumulative test sequence does not use additional symbols or unit occupied space, so that the resource (time slot) occupied by the length is small, which is beneficial to promoting the payload and further promoting the throughput. And the corresponding delay is marked in the sequence to obtain the reuse test sequence, and because the length of the reuse test sequence is determined and the maximum delay is determined, some transmission nodes cannot be used completely, extra length of resource (time slot) occupation is brought, the resource (time slot) occupied by the effective load is reduced, and further the throughput is reduced. But because its length is deterministic, there is no complexity for the transmitting node to obtain the information therein. In practical application, one skilled in the art can flexibly select to use the cumulative test sequence or the reuse test sequence according to practical situations.

In one embodiment, as shown in fig. 5, the adding a delay unit corresponding to the delay before and after the start point of the no delay according to the relationship between the delay and the start point of the no delay to obtain a cumulative test sequence includes:

s302, judging the relation between the delay and the starting point without delay.

S304, responding to the delay larger than the starting point of no delay, adding a delay unit corresponding to the delay after the starting point of no delay to obtain a first test symbol, and marking a transmission node using the first test symbol to obtain the cumulative test sequence.

S306, responding to the delay smaller than the starting point of the non-delay, adding a delay unit corresponding to the delay before the starting point of the non-delay to obtain a second test symbol, and marking the transmission node using the second test symbol to obtain the cumulative test sequence.

And S308, responding to the starting point of the delay which is equal to the non-delay, marking the transmission nodes using the delay, and obtaining an accumulated test sequence.

Specifically, the relationship between the delay of the transfer node and the front of the start point of no delay is determined. When the transmission node corresponding to the delay is at a level above the starting point of the no-delay, as shown in fig. 1, if the starting point of the no-delay is node 5, the delay of node 4 can be determined to be smaller than the starting point of the no-delay in the normal case. If the starting point of the non-delay is the video source, the delays corresponding to all the transmission nodes connected to the video source, such as node 1, node 2, node 3, etc. in fig. 1, can be determined to be larger than the starting point of the non-delay. If the starting point of no delay is node 5 and the corresponding transmitting node that calculated the delay is also node 5, it can be determined that the delay is equal to the starting point of no delay. When the delay is determined to be larger than the starting point of no delay, a delay unit corresponding to the delay is added after the starting point of no delay, a corresponding first test symbol is obtained after the delay unit is added, the transmission node using the first test symbol is marked, and an accumulated test sequence is obtained after the marking. And when the delay is determined to be smaller than the starting point of no delay, adding a delay unit corresponding to the delay before the starting point of no delay to obtain a second test symbol after the delay unit is added, marking the transmission node using the second test symbol, and obtaining an accumulated test sequence after the marking. When the delay is equal to the starting point of no delay, the transmission node is marked, the transmission node directly uses the delay obtained by the test, and subsequently, when the video data is received, the invalid video data is directly determined according to the delay without using a reuse test sequence or accumulating position information in the test sequence.

In addition, when the delay is less than one delay unit after the delay unit is split, a rounding-up mode is adopted, namely, at least one complete delay unit is used when the delay is insufficient. For example, if the delay is 10.5ns and the delay unit is 1ns, 11 delay units are finally needed to correspond to the delay.

It is to be understood that the marking may be performed by using a special symbol, or may be performed by using other methods, as long as it is determined that the transmission node uses the corresponding test symbol. In addition, the above description is only performed by one transmission node, when there are multiple transmission nodes, a first cumulative test sequence of a first transmission node may be determined first, and then a delay unit of a second transmission node may be added or marked on the basis of the first cumulative test sequence to obtain a final cumulative test sequence. Or may be determining a second cumulative test sequence for a second transmission node. And obtaining a final accumulated test sequence according to the first accumulated test sequence and the second accumulated test sequence.

In this embodiment, the accumulated test sequence is obtained by setting the delay unit corresponding to the delay, the length of the accumulated test sequence can be ensured, and the accuracy of determining the delay can be ensured since the delay unit corresponds to the delay.

In an embodiment, as shown in fig. 6, another way of determining a cumulative test sequence is further provided in the embodiments of the present disclosure, where the adding a delay unit corresponding to the delay before and after the start of the no delay according to a relationship between the delay and the start of the no delay to obtain the cumulative test sequence further includes:

s402, at least one standard transmission node in each transmission node is determined, and the standard delay corresponding to the standard transmission node is obtained.

S404, according to the relation between the standard delay and the starting point of the no delay, adding delay units corresponding to the standard delay before and after the starting point of the no delay to obtain a third test symbol, and marking the standard transmission node using the third test symbol to obtain a standard accumulation sequence.

S406, it is determined whether or not the same delay as the standard delay exists among the delays of the transmission nodes.

And S408, in response to the fact that the delay of each transmission node is the same as the standard delay, marking the first transmission node corresponding to the same delay as the standard delay as using the third test symbol to obtain an accumulated test sequence.

And S410, in response to that the delay of each transmission node does not have the same delay as the standard delay, adding or subtracting the delay unit corresponding to the difference value at a third test symbol in the standard cumulative sequence according to the difference value between the delay of each transmission node and the standard delay to obtain a cumulative test sequence.

The standard transmission node may be a reference transmission node, and may be arbitrarily selected from all transmission nodes in the transmission channel.

Specifically, the video source may determine a standard transmission node in advance, obtain a standard delay corresponding to the standard transmission node in the same manner as in step S202, add a delay unit corresponding to the standard delay before and after the start point of the no delay according to the relationship between the standard delay and the start point of the no delay, obtain a third test symbol, mark the standard transmission node using the third test symbol, and obtain a standard cumulative sequence. Then, it is determined whether the delay corresponding to the transmission node that needs to use the accumulated test sequence is the same as the standard delay. If the two symbols are the same, the transmission node is marked to use the third test symbol, and an accumulated test sequence is obtained. If not, the difference between the delay of the transmission node and the delay before the standard delay can be calculated. A delay unit corresponding to the difference may be added or subtracted at the third test symbol to obtain a fourth test symbol, and the transmission node using the fourth test symbol may be marked to obtain an accumulated test sequence.

In some exemplary embodiments, this is illustrated without the same delay as the standard delay. If the standard delay is 5ns and the delay of the transmission node is 10ns, the corresponding difference is 5ns. The standard cumulative sequence is 0NNNNN, where N represents a delay unit of 1ns. The corresponding difference may be added to the cumulative sequence, followed by 0nnnnnnnn, resulting in a cumulative test sequence. If the delay of the transmission node is 3ns, the corresponding difference is-2 ns, and the corresponding difference can be subtracted from the accumulated sequence to obtain 0NNN, so that the accumulated test sequence is obtained.

It should be understood that the above is only illustrated by one transmission node, and when there are multiple transmission nodes, the cumulative test sequences corresponding to each transmission node may be integrated and added to obtain a cumulative test sequence finally suitable for the multiple transmission nodes.

In addition, one of all the transmission nodes may be selected as a standard node for all the transmission nodes. For all transmission nodes in each transmission channel, one transmission node may be selected as a standard transmission node among all transmission nodes in the transmission channel. For each transmitting node, the scheme is not applicable.

In this embodiment, the delay of the standard transmission node can be used as the difference value, and the accumulated test sequence is obtained through processing. Because it is adjusted by the difference between each transmission node and the standard transmission node, the delay error will be calculated more accurately and the resulting cumulative test sequence will be more accurate.

In an embodiment, as shown in fig. 7, another method for determining a reuse test sequence is further provided in the embodiments of the present disclosure, where marking a delay unit corresponding to the delay in the test sequence to be processed to obtain the reuse test sequence further includes:

s502, marking a delay unit corresponding to the standard delay in the test sequence to be processed to obtain a standard retransmission sequence.

S504, it is determined whether or not the delay of each transfer node is the same as the standard delay.

S506, responding to the delay of each transmission node, wherein the delay is the same as the standard delay, and marking the same delay as a delay unit which is the same as the standard delay to obtain a reuse test sequence;

s508, responding to that the delay of each transmission node does not have the same delay as the standard delay, according to the difference value between the delay of each transmission node and the standard delay, marking the delay unit corresponding to the difference value at the delay unit corresponding to the standard delay in the standard retransmission sequence, and obtaining a reuse test sequence.

Specifically, after the standard delay is obtained, a delay unit corresponding to the standard delay may be marked in the test sequence to be processed, and a standard retransmission sequence may be obtained after the marking. For example, the test sequence to be processed is XX0XX,0 being the starting point of no delay. The standard delay may be marked with M, and the resulting standard retransmission sequence may be XM0XX. And judging whether the delay of the transmission node is the same as the standard delay or not, if so, judging whether the delay of the transmission node is the same as the standard delay or not. A transmission node with the same delay as the standard delay may reuse the flag corresponding to the standard delay for use by a transmission node with the same standard delay, for example, the transmission node may also use XM0XX, i.e., the reuse test sequence is XM0XX. If the delay of each transmission node does not have the same delay as the standard delay, the difference between the delay and the standard delay may be calculated, and the delay unit corresponding to the difference is marked at the corresponding delay unit in the standard retransmission sequence. For example, if the difference is + a, the resulting reuse test sequence may be: MA0XX. If the difference is-A, the resulting reuse test sequence may be X (M-A) 0XX.

It can be understood that, the above is only exemplified by the reuse test sequence of one transmission node, and if there are multiple transmission nodes, the delay or difference corresponding to the multiple transmission nodes may also be marked in the same manner as described above to finally determine the reuse test sequence corresponding to the multiple transmission nodes.

Specifically, when delay correction is performed using the same test sequence (including the accumulated test sequence and the retransmitted test sequence) for all the transmission nodes, the length of the test sequence is increased, but management is facilitated due to the use of the same test sequence. When all transmission nodes in each transmission channel use the same test sequence to perform delay correction, because each transmission channel is independently controlled, the length of the test sequence can be shortened, the occupation of resources (time slots) is obviously reduced, the effective load is increased, and the throughput is further improved. When each transmission node in each transmission channel uses a different test sequence for delay correction, the length of the test sequence is further shortened.

In one embodiment, the above only mentions what data the video source sends to each transport node, and the present embodiment will describe in detail how to send the data. The method further comprises the following steps: sending the test sequence and the video data to each transmission node by using a pre-established delay correction frame;

as shown in fig. 8, the delayed correction frame includes: a modification enable slot, the delayed modification frame being used in case the modification enable slot is enabled;

a policy application time slot for confirming a manner of determining a test sequence, the manner of determining a test sequence including: according to the relation between the delay and the starting point of no delay, adding a delay unit corresponding to the delay before and after the starting point of no delay to obtain an accumulated test sequence, or marking the delay unit corresponding to the delay in the test sequence to be processed to obtain the reuse test sequence.

Specifically, the delayed correction frame may be a frame structure obtained by adjusting a standard frame structure. The delay correction frame includes: the modification enabling time slot may determine to use the delay modification frame in the case that the modification enabling time slot is enabled, and then perform the multi-channel delay modification method mentioned in the embodiments of the present disclosure. In order to be compatible with the standard frame structure as much as possible, the modification enabling time slot may occupy Dummy Video (for Dummy data filling) or Fill Video (for filling when data is insufficient) of the standard frame structure, because the two time slots are mainly used for filling data to meet the Video data transmission requirement, the filled data is invalid data, and therefore, the time slot filled with invalid data may be used as the effective delay modification enabling time slot, and at this time, the time slot used for valid data (including pixel data, control time slot, etc.) in the frame structure is not occupied, so that after the effective delay modification enabling time slot is added, the payload is not reduced, that is, the throughput is not reduced; the method can also be used as a time slot to distinguish two different frame structures, and is suitable for application scenes needing to distinguish the frame structures. Fig. 9 is a schematic diagram of a standard frame structure according to the present disclosure. The standard frame structure may include: BS (Blanking Start), VB-ID (Vertical Blanking Identifier), mvid (timer value of Video data), naud (timer value of audio data), dummy Video (for Dummy data padding), BE (Blanking End), pixel data (for transmission of Video data), FS (Fill Start, padding Start), fill Video (padding data, for padding when there is insufficient data), and FE (Fill End). And the test sequence marking time slot is used for storing the test sequence, and when the test sequence needs to be transmitted by a subsequent video source, the test sequence is stored by using the test sequence marking time slot and is sent to the transmission node. The strategy application time slot is used for enabling the transmission node and the video source to confirm a mode of determining a test sequence in a unified way, and the mode of determining the test sequence comprises the following steps: as in any of the above embodiments S202 to S210, S302 to S308, S402 to S410, and S502 to S508.

In this embodiment, by creating the delay correction frame, the test sequence can be correctly transmitted between the video source and the transmission node, the delay correction can be completed, and since the delay correction frame is obtained by adjusting the standard frame structure, the delay correction can be performed while maintaining compatibility with the standard frame structure, thereby improving the effectiveness and flexibility of use of the transmitted video data.

when the cumulative test sequence is sent each time, adding a corresponding cumulative length indication field in the cumulative test sequence, wherein the cumulative length indication field is used for indicating each transmission node to acquire the position of the delay unit in the cumulative test sequence;

Specifically, when signaling interaction is performed with a transmission node each time, that is, a cumulative test sequence is transmitted, since the cumulative test sequence is random in length, a corresponding cumulative length indication field needs to be added to the sequence at each transmission time. When the transmission node acquires the accumulated length indication field in the accumulated test sequence, the corresponding delay unit can be acquired at the specified position, and then the corresponding delay is acquired. When the reuse test sequence is sent for the first time to interact with the transmission node, a corresponding reuse length indication field is added in the reuse test sequence, and the reuse length indication field is used for indicating the transmission node to determine the transmission length of the reuse test sequence so as to better acquire the delay unit of the mark. When the reuse test sequence is used subsequently, the reuse length indication field can be deleted to improve the effective load and further improve the throughput.

In one embodiment, all are described in terms of a video source, as described below in terms of a transmission node. As shown in fig. 10, the present disclosure provides a multi-channel delay correction method applied to a transmission node, the method including:

s602, receiving a test sequence and video data sent by a video source;

s604, the invalid data in the received video data is determined by using the position information marked in the test sequence and the non-delay starting point determined by the video source.

S606, determining and displaying effective video data by utilizing the invalid data and the video data; the video source determines a non-delay starting point and a delay between the video source and each transmission node, and the non-delay starting point is determined according to the video source or the delay transmission node; the delayed transmission node includes: and the transmission node has a delay larger than a preset delay threshold value with the video source.

Specifically, a transport node receives a test sequence and video data sent by a video source using delayed correction frames. The transmitting node determines invalid data in the received video data using the position information (e.g., the first test symbol, the second test symbol, etc. mentioned in the foregoing embodiments) marked in the test sequence and the non-delayed start point determined by the video source. The video data acquired in the time between the position information and the start point of no delay may be invalid video data, for example. All video data are received, invalid video data are removed, and valid video data are obtained and displayed.

In this embodiment, after receiving the test sequence, the transmission node may obtain effective video data only through the test sequence without multiple signaling transmission interactions, thereby reducing additional signaling interactions and correcting the time delay during video data transmission.

In one embodiment, the test sequence comprises: accumulating test sequences and reusing test sequences, as shown in fig. 11, the determining invalid data in the received video data by using the position information of the mark in the test sequence and the start point without delay includes:

s702, judging that the test sequence is an accumulative test sequence or a reusable test sequence.

S704, when the test sequence is an accumulated test sequence, determining invalid delay time according to the test sequence symbol marked in the accumulated test sequence or the delay;

s706, when the test sequence is a reuse test sequence, determining corresponding invalid delay time according to a delay unit marked in the reuse test sequence and corresponding to the delay of the transmission node;

s708, determining the video data received within the invalid delay time as invalid data.

Specifically, the transmitting node may determine which type of test sequence the received test sequence is. If the test sequence is an accumulated test sequence, the invalid delay time is determined based on a test sequence symbol (e.g., a first test symbol, a second test symbol) marked in the accumulated test sequence or a delay marked in the accumulated test sequence. If the test sequence is a reuse test sequence, determining corresponding invalid delay time according to the delay unit marked corresponding to the delay, determining the video data received in the invalid delay time as invalid data, and ignoring the invalid data. The video received after the null delay time thereafter is valid video data.

In one embodiment, the method further comprises: and after the effective video data is failed to be displayed, feeding back a failure result of delay correction to a video source.

Specifically, the transmission node may feed back an effect delay correction result to the video source by using the feedback field, and in order to reduce an invalid load caused by signaling interaction, the feedback may be performed only when the transmission node cannot complete the delay correction, otherwise, the video source defaults that the transmission node has successfully completed the delay correction.

In one embodiment, the video source and the transport node may interact with each other by signaling, for example, by reading and writing fields. As shown in fig. 12, the read/write field may include, in addition to the feedback field, the accumulated length indication field, and the reuse length indication field mentioned in the above embodiment: a modification enable field, a delayed modification policy field.

The correction enabling field is used for confirming whether effective delay correction is enabled between the video source and all transmission nodes in multiple channels in the link topology; in order to reduce unnecessary signaling interaction, when the correction enabling field is enabled, the video source and all transmission nodes in multiple channels in the link topology enable the delay correction frame structure by default; otherwise, a standard frame structure is used by default.

The valid delay correction policy field is used for the video source to indicate that all transmission nodes apply the delay correction policy, as in any one of the above embodiments S202 to S210, S302 to S308, S402 to S410, and S502 to S508.

It should be understood that, although the steps in the flowcharts related to the embodiments as described above are sequentially displayed as indicated by arrows, the steps are not necessarily performed sequentially as indicated by the arrows. The steps are not limited to being performed in the exact order illustrated and, unless explicitly stated herein, may be performed in other orders. Moreover, at least a part of the steps in the flowcharts related to the embodiments described above may include multiple steps or multiple stages, which are not necessarily performed at the same time, but may be performed at different times, and the execution order of the steps or stages is not necessarily sequential, but may be rotated or alternated with other steps or at least a part of the steps or stages in other steps.

Based on the same inventive concept, the disclosed embodiments also provide a multi-channel delay correction device for implementing the above-mentioned multi-channel delay correction method. The implementation scheme for solving the problem provided by the apparatus is similar to the implementation scheme described in the above method, so specific limitations in one or more embodiments of the multi-channel delay correction apparatus provided below can be referred to the limitations of the above multi-channel delay correction method, and are not described herein again.

In one embodiment, as shown in fig. 13, there is provided a multi-channel delay correction apparatus 800, applied to a video source, including: a no-delay determination module 802, a test sequence determination module 804, and a data transmission module 806, wherein:

a non-delay determining module 802, configured to determine, for each transmission node in the transmission channel, that a video source or a delayed transmission node is a starting point without delay; the delayed transmission node comprises: a transmission node having a delay with the video source greater than a preset delay threshold;

a test sequence determining module 804, configured to determine a test sequence according to the starting point without delay and the delay between the starting point and each transmission node, where the test sequence is used to determine the delay condition of the transmission node;

a data sending module 806, configured to send the test sequence and the video data to each transmission node, where the test sequence is used to instruct each transmission node to perform delay correction, where the delay correction includes: and determining invalid data in the received video data by using the position information marked in the test sequence and the non-delayed starting point, and determining and displaying valid video data by using the invalid data and the video data.

In one embodiment of the apparatus, the test sequence comprises: accumulating test sequences and reusing test sequences, the test sequence determining module 804 includes: and the time delay measuring module is used for measuring the delay between each transmission node and each transmission node.

An accumulative test sequence determining module, configured to add a delay unit corresponding to the delay before and after the start point without delay according to a relationship between the delay and the start point without delay, to obtain an accumulative test sequence;

a transmission length determining module, configured to determine a transmission length of the reuse test sequence according to a predetermined maximum delay.

A delay unit increasing module, configured to increase at least one delay unit before and after the start point without delay in the transmission length range, to obtain a test sequence to be processed;

and a delay unit marking module, configured to mark a delay unit corresponding to the delay in the test sequence to be processed, so as to obtain the reuse test sequence.

In one embodiment of the apparatus, the cumulative test sequence determination module comprises: a first flag processing module, configured to, in response to that the delay is greater than the starting point of no delay, add a delay unit corresponding to the delay after the starting point of no delay to obtain a first test symbol, and flag a transmission node using the first test symbol to obtain the cumulative test sequence;

a second mark processing module, configured to, in response to that the delay is smaller than the starting point of no delay, add a delay unit corresponding to the delay before the starting point of no delay to obtain a second test symbol, and mark a transmission node using the second test symbol to obtain the cumulative test sequence;

and the third mark processing module is used for marking the transmission nodes using the delay to obtain an accumulated test sequence in response to the delay being equal to the starting point of the no delay.

In one embodiment of the apparatus, the cumulative test sequence determination module further comprises: and the standard delay acquisition module is used for determining at least one standard transmission node in each transmission node and acquiring the standard delay corresponding to the standard transmission node.

And the standard cumulative sequence determining module is used for adding delay units corresponding to the standard delay before and after the starting point of the no delay according to the relation between the standard delay and the starting point of the no delay to obtain a third test symbol, and marking the standard transmission node using the third test symbol to obtain a standard cumulative sequence.

And the node marking module is used for responding to the delay which is the same as the standard delay in the delay of each transmission node, marking the first transmission node corresponding to the same delay as the third test symbol, and obtaining an accumulated test sequence.

And the difference value adding module is used for responding to the condition that the delay of each transmission node does not have the delay same as the standard delay, and adding or subtracting the delay unit corresponding to the difference value at a third test symbol in the standard cumulative sequence according to the delay of each transmission node and the difference value of the standard delay to obtain the cumulative test sequence.

In one embodiment of the apparatus, the delay unit tag module includes: and the standard retransmission sequence determining module is used for marking a delay unit corresponding to the standard delay in the test sequence to be processed to obtain a standard retransmission sequence.

And the fourth mark processing module is used for marking the same delay as the standard delay into the same delay unit as the standard delay in response to the delay of each transmission node, so as to obtain a reuse test sequence.

And the fifth mark processing module is used for responding to the condition that the delay of each transmission node does not have the same delay as the standard delay, marking the delay unit corresponding to the difference value at the delay unit corresponding to the standard delay in the standard retransmission sequence according to the difference value between the delay of each transmission node and the standard delay, and obtaining the reuse test sequence.

In one embodiment of the apparatus, each transmission node in the transmission channel comprises any one of the following:

In one embodiment of the apparatus, the apparatus further comprises: and the frame structure transmission module is used for transmitting the test sequence and the video data to each transmission node by using a pre-created delay correction frame.

The delayed correction frame includes: a correction enable slot, the delay correction frame being used in a case where the correction enable slot is enabled;

a policy application time slot for confirming a manner of determining a test sequence, the manner of determining a test sequence comprising: according to the relation between the delay and the non-delay starting point, adding a delay unit corresponding to the delay before and after the non-delay starting point to obtain an accumulated test sequence, or marking the delay unit corresponding to the delay in the test sequence to be processed to obtain the reuse test sequence.

In an embodiment of the apparatus, the data sending module 806 includes: a first indication field sending module, configured to add a corresponding cumulative length indication field in the cumulative test sequence each time the cumulative test sequence is sent, where the length indication field is used to indicate a position where each transmission node acquires the delay unit in the cumulative test sequence.

A second indication field sending module, configured to add a corresponding reuse length indication field in the reuse test sequence when the reuse test sequence is sent for the first time, where the reuse length indication field is used to indicate a transmission length of the reuse test sequence.

In one embodiment, as shown in fig. 14, there is provided a multi-channel delay correction apparatus 900, applied to a transmission node, the apparatus including:

a data receiving module 902, configured to receive a test sequence and video data sent by a video source;

an invalid data determining module 904, configured to determine invalid data in the received video data by using the position information marked in the test sequence and the non-delayed starting point determined by the video source;

a valid data display module 906 configured to determine valid video data using the invalid data and the video data and display the determined valid video data; the video source determines a non-delay starting point and a delay between the video source and each transmission node, and the non-delay starting point is determined according to the video source or the delay transmission node; the delayed transmission node includes: and the transmission node has a delay larger than a preset delay threshold value with the video source.

In one embodiment of the apparatus, the test sequence comprises: accumulate test sequences and reuse test sequences, the invalid data determination module 904 comprising: and the first invalid time determining module is used for determining invalid delay time according to the test sequence symbols marked in the cumulative test sequence or the delay when the test sequence is the cumulative test sequence.

And a second invalid time determining module, configured to determine, when the test sequence is a reuse test sequence, a corresponding invalid delay time according to a delay unit marked in the reuse test sequence and corresponding to the delay of the transmission node.

And the invalid data determining submodule is used for determining the video data received within the invalid delay time as invalid data.

In one embodiment of the apparatus, the apparatus further comprises: and the feedback module is used for feeding back a failure result of delayed correction to the video source after the effective video data fails to be displayed.

The modules in the multi-channel delay correction device can be wholly or partially implemented by software, hardware and a combination thereof. The modules can be embedded in a hardware form or independent of a processor in the computer device, and can also be stored in a memory in the computer device in a software form, so that the processor can call and execute operations corresponding to the modules.

In one embodiment, a computer device is provided, which may be a terminal, and its internal structure diagram may be as shown in fig. 15. The computer device includes a processor, a memory, a communication interface, a display screen, and an input device connected by a system bus. Wherein the processor of the computer device is configured to provide computing and control capabilities. The memory of the computer device comprises a nonvolatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of an operating system and computer programs in the non-volatile storage medium. The communication interface of the computer device is used for carrying out wired or wireless communication with an external terminal, and the wireless communication can be realized through WIFI, a mobile cellular network, NFC (near field communication) or other technologies. The computer program is executed by a processor to implement a multi-pass delay correction method. The display screen of the computer equipment can be a liquid crystal display screen or an electronic ink display screen, and the input device of the computer equipment can be a touch layer covered on the display screen, a key, a track ball or a touch pad arranged on the shell of the computer equipment, an external keyboard, a touch pad or a mouse and the like.

Those skilled in the art will appreciate that the architecture shown in fig. 15 is merely a block diagram of some of the structures associated with the disclosed aspects and is not intended to limit the computing devices to which the disclosed aspects apply, as particular computing devices may include more or less components than those shown, or may combine certain components, or have a different arrangement of components.

In an embodiment, a computer device is provided, comprising a memory in which a computer program is stored and a processor, which when executing the computer program performs the steps of any of the above method embodiments.

In an embodiment, a computer-readable storage medium is provided, on which a computer program is stored, which computer program, when being executed by a processor, carries out the steps of any of the above-mentioned method embodiments.

In an embodiment, a computer program product is provided, comprising a computer program which, when executed by a processor, performs the steps of any of the above-described method embodiments.

It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by hardware instructions of a computer program, which can be stored in a non-volatile computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. Any reference to memory, databases, or other media used in the embodiments provided by the present disclosure may include at least one of non-volatile and volatile memory. The nonvolatile Memory may include Read-Only Memory (ROM), magnetic tape, floppy disk, flash Memory, optical Memory, high-density embedded nonvolatile Memory, resistive Random Access Memory (ReRAM), magnetic Random Access Memory (MRAM), ferroelectric Random Access Memory (FRAM), phase Change Memory (PCM), graphene Memory, and the like. Volatile Memory can include Random Access Memory (RAM), external cache Memory, and the like. By way of illustration and not limitation, RAM can take many forms, such as Static Random Access Memory (SRAM) or Dynamic Random Access Memory (DRAM), for example. The databases involved in embodiments provided by the present disclosure may include at least one of relational and non-relational databases. The non-relational database may include, but is not limited to, a block chain based distributed database, and the like. The processors referred to in the embodiments provided in this disclosure may be general purpose processors, central processing units, graphics processors, digital signal processors, programmable logic, quantum computing based data processing logic, etc., without limitation.

The technical features of the above embodiments can be arbitrarily combined, and for the sake of brevity, all possible combinations of the technical features in the above embodiments are not described, but should be considered as the scope of the present specification as long as there is no contradiction between the combinations of the technical features.

The above-mentioned embodiments only express several embodiments of the present disclosure, and the description thereof is more specific and detailed, but not construed as limiting the scope of the present disclosure. It should be noted that various changes and modifications can be made by one skilled in the art without departing from the spirit of the disclosure, and these changes and modifications are all within the scope of the disclosure. Therefore, the protection scope of the present disclosure should be subject to the appended claims.

Claims

1. A multi-channel delay correction method applied to a video source, the method comprising:

determining a test sequence according to the starting point without delay and the delay between the starting point without delay and each transmission node, wherein the test sequence is used for determining the delay condition of the transmission node; the test sequence includes: accumulating test sequences and reusing test sequences, wherein the determining of the test sequences according to the starting point of the non-delay and the delay between each transmission node comprises the following steps:

marking a delay unit corresponding to the delay in the test sequence to be processed to obtain the reuse test sequence;

2. The method of claim 1, wherein the adding a delay unit corresponding to the delay before and after the start of the no-delay according to the relationship between the delay and the start of the no-delay to obtain a cumulative test sequence comprises:

3. The method of claim 1, wherein the adding a delay unit corresponding to the delay before and after the start of no delay according to the relationship between the delay and the start of no delay to obtain a cumulative test sequence further comprises:

and in response to the fact that the delay which is the same as the standard delay does not exist in the delays of the transmission nodes, adding or subtracting the delay unit corresponding to the difference value at a third test symbol in the standard cumulative sequence according to the difference value between the delay of each transmission node and the standard delay to obtain a cumulative test sequence.

4. The method of claim 3, wherein the marking a delay unit corresponding to the delay in the test sequence to be processed to obtain the reuse test sequence, further comprises:

5. The method of claim 1, wherein each transmission node in the transmission channel comprises any one of:

6. The method of claim 4, further comprising: transmitting the test sequence and the video data to each transmission node by using a pre-established delay correction frame;

7. The method of claim 1, wherein sending the test sequence and video data to each transport node comprises:

8. A multi-channel delay correction method applied to a transmission node, the method comprising:

receiving a test sequence and video data sent by a video source;

determining invalid data in the received video data by using the marked position information in the test sequence and the non-delay starting point determined by the video source; the test sequence includes: accumulating test sequences and reusing the test sequences, wherein the determining of invalid data in the received video data by using the position information of the marks in the test sequences and the start point without delay comprises the following steps:

determining video data received within the invalid delay time as invalid data;

9. The method of claim 8, wherein the method comprises:

10. A multi-channel delay correction apparatus, applied to a video source, the apparatus comprising:

a test sequence determining module, configured to determine a test sequence according to the starting point without delay and the delay between the starting point and each transmission node, where the test sequence is used to determine the delay condition of the transmission node; the test sequence includes: accumulating test sequences and reusing test sequences, the test sequence determination module comprising: the time delay measuring module is used for measuring the delay between each transmission node and each transmission node;

an accumulative test sequence determining module, configured to increase a delay unit corresponding to the delay before and after the start point of no delay according to a relationship between the delay and the start point of no delay, to obtain an accumulative test sequence;

a transmission length determining module, configured to determine a transmission length of the reuse test sequence according to a predetermined maximum delay;

a delay unit marking module, configured to mark a delay unit corresponding to the delay in the test sequence to be processed, to obtain the reuse test sequence;

a data sending module, configured to send the test sequence and the video data to each transmission node, where the test sequence is used to instruct each transmission node to perform delay correction, and the delay correction includes: and determining invalid data in the received video data by using the marked position information in the test sequence and the non-delay starting point, and determining and displaying valid video data by using the invalid data and the video data.

11. The apparatus of claim 10, wherein the cumulative test sequence determination module comprises: a first marking processing module, which responds to the delay being larger than the starting point of no delay, adds a delay unit corresponding to the delay after the starting point of no delay to obtain a first test symbol, and marks a transmission node using the first test symbol to obtain the cumulative test sequence;

12. A multi-channel delay correction apparatus, applied to a transmission node, the apparatus comprising:

the data receiving module is used for receiving the test sequence and the video data sent by the video source;

the test sequence includes: the invalid data determination module comprises: a first invalid time determining module, configured to determine an invalid delay time according to a test sequence symbol marked in the cumulative test sequence or the delay when the test sequence is a cumulative test sequence;

a second invalid time determining module, configured to determine, when the test sequence is a reuse test sequence, a corresponding invalid delay time according to a delay unit marked in the reuse test sequence and corresponding to the delay of the transmission node;

an invalid data determining submodule for determining the video data received within the invalid delay time as invalid data;

the valid data display module is used for determining valid video data by using the invalid data and the video data and displaying the valid video data; the video source determines a non-delay starting point and a delay between the video source and each transmission node, and the non-delay starting point is determined according to the video source or the delay transmission node; the delayed transmission node includes: and the transmission node has the delay between the transmission node and the video source larger than a preset delay threshold value.

13. The apparatus of claim 12, further comprising: and the feedback module is used for feeding back a failure result of delayed correction to the video source after the effective video data fails to be displayed.

14. A computer device comprising a memory and a processor, the memory storing a computer program, characterized in that the processor, when executing the computer program, implements the steps of the method of any one of claims 1 to 7 or claims 8 and 9.