CN115842911A

CN115842911A - Real-time video delay calculation method and device

Info

Publication number: CN115842911A
Application number: CN202211079691.XA
Authority: CN
Inventors: 刘俐君; 张博伟; 刘栋; 涂春虎; 谢楠; 史小露; 代琪
Original assignee: Beijing Machinery Equipment Research Institute
Current assignee: Beijing Machinery Equipment Research Institute
Priority date: 2022-09-05
Filing date: 2022-09-05
Publication date: 2023-03-24

Abstract

The disclosure relates to a real-time video delay calculation method, a real-time video delay calculation device, an electronic device and a storage medium. Wherein, the method comprises the following steps: and the real-time video stream delay signal processing module calculates real-time video delay based on the real-time video stream terminal signal monitoring module and simultaneously displays a timestamp reference picture and a timestamp picture to be detected. According to the method, the universality of engineering application is ensured, the operability of building a delay test system is ensured, the high error of manual intervention is eliminated, and the intuitiveness of a delay data test effect is improved by replacing a manual photographing method with a more intelligent and automatic measuring and calculating scheme.

Description

Real-time video delay calculation method and device

Technical Field

The present disclosure relates to the field of video measurement, and in particular, to a real-time video delay calculation method, device, electronic device, and computer-readable storage medium.

Background

With the changing and development of multimedia technology, the fields of intelligent security and network live broadcast gradually enter into various industries, and the requirements of users on the network video transmission quality are higher and higher. Among factors influencing network video transmission quality, delay is one of the problems influencing the appearance of a user to the greatest extent, and the delay is caused by links of transmission, coding and decoding, transcoding and the like which are experienced in the middle of video stream data from the collection of a camera end to the playing of a client. Therefore, it is necessary to accurately measure the real-time video delay from the video acquisition end to the video playing end.

In prior art solutions, many documents refer to time stamp marking. The timestamp marking method is that timestamp information is embedded into a video stream before a video signal enters a transmission network, and then the timestamp information of an output moment is obtained when the video stream signal is output; and calculating the video delay data by the difference value of the output time stamp and the input time stamp. The method firstly needs the input end and the output end of the video signal to have the same time reference, and simultaneously needs the input end to support embedding millisecond-level time stamp information. However, in the field of security monitoring, most of cameras do not have the function of embedding millisecond-level timestamp information, the consistency of the time reference of the input end and the output end cannot be guaranteed, and the scheme is rarely adopted in the real production environment in the field of security monitoring.

In addition to time stamp marking, stopwatch photographing is now widely used. The stopwatch photographing method refers to running a digital stopwatch on a PC and displaying the stopwatch on a monitor; taking a picture of the PC monitor by using the system to be tested and displaying the picture on another display to be tested; placing the PC monitor and the monitor to be tested side by side, and taking a picture with the same frame by using a test camera; and calculating the difference between the two monitors by using the shooting result so as to calculate the video delay data. The method requires at least two monitors, a video camera, a camera and a human input. The biggest defect is that two monitors need to be continuously photographed by manual intervention, and the difference between input pictures and output pictures at different moments is calculated manually, so that the realization of scenes needing to display delay data in real time is difficult. Another drawback is that the shooting shutter speeds of the cameras used are different, and the display quality of the video stream output images brought by the real-time video stream network transmission device is different, so that the problem of ghosting of the shooting results is easily caused, and the precision of the time delay measuring and calculating results is influenced. It is known that the delay data of a real-time video stream does not remain constant, but varies up and down within a certain range with network fluctuations. Real-time delay data cannot be rapidly calculated by adopting a manual photographing calculation mode.

In order to accurately calculate the video transmission delay, the invention patent CN 113194307A proposes a comparison method of video voltage signals of an oscilloscope. The method comprises the steps of transmitting a video signal generated by a video signal generator into a video device or system to be tested, transmitting an output signal of the video signal generator and an output signal of the signal generator into an oscilloscope at the same time, and comparing voltage waveform differences of the optical field signal and the video signal of the oscilloscope and the signal generator to calculate time delay. Although accurate delay data can be obtained by the method, the tested system is required to have the capability of opening an input interface, and the method is not suitable for most production scenes.

Accordingly, there is a need for one or more methods to address the above-mentioned problems.

It is to be noted that the information disclosed in the above background section is only for enhancement of understanding of the background of the present disclosure, and thus may include information that does not constitute prior art known to those of ordinary skill in the art.

Disclosure of Invention

An object of the present disclosure is to provide a real-time video delay calculation method, apparatus, electronic device, and computer-readable storage medium, which overcome one or more of the problems due to the limitations and disadvantages of the related art, at least to some extent.

According to an aspect of the present disclosure, there is provided a real-time video delay calculation method, including:

generating a time signal based on a digital clock generating module, and sending the clock signal to a real-time video streaming terminal signal monitoring module;

a real-time video stream terminal signal monitoring module receives the time signal sent by the digital clock generating module, and generates and displays a timestamp reference picture based on the time signal;

a real-time video stream signal acquisition module acquires a timestamp reference picture displayed in the real-time video stream terminal signal monitoring module to generate a video signal containing the timestamp reference picture and sends the video signal to a real-time video stream transmission network module;

the real-time video streaming network module receives a video signal which is sent by the real-time video streaming signal acquisition module and contains the timestamp reference picture, performs video streaming processing based on network transmission on the video signal and then sends the video signal to a real-time video streaming terminal signal monitoring module;

the real-time video streaming terminal signal monitoring module receives a video signal which is acquired by the real-time video streaming signal acquisition module and is sent by the real-time video streaming transmission network module after being processed based on a video stream transmitted by a network, and generates and displays a timestamp to-be-detected picture in the same display equipment as the timestamp reference picture based on the video signal;

the real-time video stream delay signal processing module captures a reference picture of a timestamp and a picture to be detected of the timestamp in display equipment of the real-time video stream terminal signal monitoring module based on the screen capture submodule, generates a picture to be processed and sends the picture to be processed to the delay video data storage module for storage;

the real-time video stream delay signal processing module calls the to-be-processed picture from the delay video data storage module, respectively identifies a reference timestamp and a to-be-detected timestamp in the to-be-processed picture based on the character identification submodule, and calculates real-time video delay according to the reference timestamp and the to-be-detected timestamp based on the delay calculation submodule.

In an exemplary embodiment of the present disclosure, the method further comprises:

generating a first time signal based on a first time generation submodule of a digital clock generation module, generating a second time signal based on a second time generation submodule of the digital clock generation module, and sending the first time signal and the second time signal to a real-time video streaming terminal signal monitoring module;

a real-time video stream terminal signal monitoring module receives a first time signal and a second time signal sent by the digital clock generating module, and generates and displays a timestamp reference picture based on the first time signal and the second time signal, wherein the first time signal and the second time signal in the timestamp reference picture are respectively displayed at a first preset position and a second preset position in display equipment;

the real-time video streaming network module receives a video signal which is sent by the real-time video streaming signal acquisition module and contains the timestamp reference picture, and sends the video signal to a real-time video streaming terminal signal monitoring module after video streaming processing based on network transmission is carried out on the video signal;

the real-time video streaming terminal signal monitoring module receives a video signal which is acquired by a real-time video streaming signal acquisition module and is sent after the real-time video streaming transmission network module processes a video stream based on network transmission, generates a timestamp to-be-detected picture based on the video signal and displays the timestamp to-be-detected picture in the same display equipment as the timestamp reference picture, wherein the timestamp to-be-detected picture comprises a first time signal to be detected and a second time signal to be detected, and the first time signal to be detected and the second time signal to be detected are displayed at a third preset position and a fourth preset position in the display equipment;

the real-time video stream delay signal processing module calls the to-be-processed picture from the delay video data storage module, the reference first timestamp, the to-be-detected first timestamp, the reference second timestamp and the to-be-detected second timestamp in the to-be-processed picture are respectively identified based on the character identification submodule, and the real-time video delay is calculated based on the delay calculation submodule according to the reference first timestamp, the to-be-detected first timestamp, the reference second timestamp and the to-be-detected second timestamp.

the method comprises the steps that a stopwatch time generation submodule of a digital clock generation module generates a stopwatch time signal, a millisecond time generation submodule of the digital clock generation module generates a millisecond time signal, and the stopwatch time signal and the millisecond time signal are sent to a real-time video streaming terminal signal monitoring module;

the real-time video streaming terminal signal monitoring module receives a stopwatch time signal and a millisecond time signal which are sent by the digital clock generating module, generates and displays a timestamp reference picture based on the stopwatch time signal and the millisecond time signal, and the stopwatch time signal and the millisecond time signal in the timestamp reference picture are respectively displayed at a first preset position and a second preset position in display equipment;

the real-time video streaming terminal signal monitoring module receives a video signal which is acquired by the real-time video streaming signal acquisition module and is sent after the real-time video streaming transmission network module processes a video stream based on network transmission, generates a picture to be tested of a timestamp based on the video signal and displays the picture to be tested of the timestamp in the same display equipment as the reference picture of the timestamp, wherein the picture to be tested of the timestamp comprises a stopwatch time signal to be tested and a millisecond time signal to be tested, and the stopwatch time signal to be tested and the millisecond time signal to be tested are displayed at a third preset position and a fourth preset position in the display equipment;

the real-time video stream delay signal processing module calls the to-be-processed picture from the delay video data storage module, respectively identifies a reference stopwatch timestamp, a to-be-detected stopwatch timestamp, a reference millisecond timestamp and a to-be-detected millisecond timestamp in the to-be-processed picture based on the character identification submodule, and calculates real-time video delay according to the reference stopwatch timestamp, the to-be-detected stopwatch timestamp, the reference millisecond timestamp and the to-be-detected millisecond timestamp based on the delay calculation submodule.

the real-time video streaming signal acquisition module acquires a timestamp reference picture displayed in the real-time video streaming terminal signal monitoring module based on a preset time interval to generate a video signal containing the timestamp reference picture and sends the video signal to the real-time video streaming transmission network module;

the real-time video stream delay signal processing module calls a preset number of the pictures to be processed from the delay video data storage module, respectively identifies reference timestamps and timestamps to be detected in the preset number of the pictures to be processed based on the character identification submodule, and respectively calculates real-time video delay according to the reference timestamps and the timestamps to be detected based on the delay calculation submodule;

and calculating the average value of the real-time video time delays corresponding to the preset number of the pictures to be processed as a video time delay calculation result.

respectively generating N time signals based on N time generation submodules of a digital clock generation module, and sending the N time signals to a real-time video streaming terminal signal monitoring module, wherein N is a positive integer greater than or equal to 1;

a real-time video stream terminal signal monitoring module receives the N time signals sent by the digital clock generating module, and generates and displays a timestamp reference picture based on the N time signals, wherein the N time signals in the timestamp reference picture are respectively displayed at the 2N-1 preset position in display equipment;

the real-time video streaming terminal signal monitoring module receives a video signal which is acquired by a real-time video streaming signal acquisition module and is sent after the real-time video streaming transmission network module processes a video stream based on network transmission, generates a timestamp to-be-detected picture based on the video signal and displays the timestamp to-be-detected picture in the same display equipment as the timestamp reference picture, wherein the timestamp to-be-detected picture comprises an Nth time signal to be detected, and the N time signals to be detected are displayed at a 2 Nth preset position in the display equipment;

the real-time video stream delay signal processing module calls the to-be-processed picture from the delay video data storage module, respectively identifies a reference Nth timestamp and an Nth timestamp to be detected in the to-be-processed picture based on the character identification submodule, and calculates real-time video delay according to the reference Nth timestamp and the Nth timestamp to be detected based on the delay calculation submodule;

and calculating the average value of real-time video delay calculated based on the reference Nth timestamp and the Nth timestamp to be detected as a video delay calculation result.

the real-time video stream delay signal processing module calls the to-be-processed picture from the delay video data storage module, and respectively identifies a reference Nth timestamp and an Nth timestamp to be detected in the to-be-processed picture based on the character identification submodule;

when the character recognition submodule recognizes that ghost phenomena exist in the reference Nth timestamp and the Nth timestamp to be detected, discarding the reference Nth timestamp/the Nth timestamp to be detected and the corresponding Nth timestamp to be detected/the reference Nth timestamp;

calculating real-time video delay according to the reference Nth timestamp and the Nth timestamp to be detected based on a delay calculation submodule;

and calculating a mode value of real-time video delay calculated based on the reference Nth timestamp and the Nth timestamp to be detected as a video delay calculation result.

In one aspect of the present disclosure, there is provided a real-time video latency calculation apparatus, including:

the digital clock generation module is integrated in the real-time video streaming terminal signal monitoring module and is used for generating a time signal and sending the clock signal to the real-time video streaming terminal signal monitoring module;

the real-time video streaming terminal signal monitoring module is used for receiving the time signal sent by the digital clock generating module and generating and displaying a timestamp reference picture based on the time signal; the real-time video streaming terminal signal monitoring module is also used for receiving a video signal which is acquired by the real-time video streaming signal acquisition module and is sent by the real-time video streaming transmission network module after being processed based on a video stream transmitted by a network, and generating and displaying a timestamp to-be-detected picture in the same display equipment as the timestamp reference picture based on the video signal;

the real-time video streaming terminal signal monitoring module is used for displaying a timestamp reference picture in a real-time video streaming terminal signal monitoring module;

the real-time video streaming network module is used for receiving a video signal which is sent by the real-time video streaming signal acquisition module and contains the timestamp reference picture, processing the video signal by a video stream based on network transmission and sending the video signal to the real-time video streaming terminal signal monitoring module;

the real-time video stream delay signal processing module is used for capturing a timestamp reference picture and a timestamp to-be-detected picture in display equipment of the real-time video stream terminal signal monitoring module based on the screen capture submodule, generating a to-be-processed picture and sending the to-be-processed picture to the delay video data storage module; the real-time video tape casting time signal processing module is also used for calling the picture to be processed from the time delay video data storage module, and respectively identifying a reference timestamp and a timestamp to be detected in the picture to be processed based on the character identification submodule; the real-time video tape-casting time signal processing module is also used for calculating real-time video time delay according to the reference timestamp and the timestamp to be detected based on the time delay calculating submodule;

and the delayed video data storage module is used for receiving and storing the to-be-processed picture sent by the signal processing module during real-time video tape casting.

In one aspect of the present disclosure, there is provided an electronic device including:

a processor; and

a memory having computer readable instructions stored thereon which, when executed by the processor, implement a method according to any of the above.

In an aspect of the disclosure, a computer-readable storage medium is provided, on which a computer program is stored, which computer program, when being executed by a processor, realizes the method according to any one of the above.

In an exemplary embodiment of the present disclosure, a real-time video delay calculation method includes: and the real-time video stream delay signal processing module calculates real-time video delay based on the real-time video stream terminal signal monitoring module and simultaneously displays a timestamp reference picture and a timestamp picture to be detected. According to the method, the universality of engineering application is ensured, the operability of building a delay test system is ensured, the high error of manual intervention is eliminated, and the intuitiveness of a delay data test effect is improved by replacing a manual photographing method with a more intelligent and automatic measuring and calculating scheme.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.

Drawings

The above and other features and advantages of the present disclosure will become more apparent by describing in detail exemplary embodiments thereof with reference to the attached drawings.

Fig. 1 shows a flow chart of a real-time video latency calculation method according to an exemplary embodiment of the present disclosure;

2A-2B illustrate application scenario diagrams of a real-time video latency calculation method according to an exemplary embodiment of the present disclosure;

fig. 3 is a schematic diagram illustrating an application scenario of a real-time video delay calculation method according to an exemplary embodiment of the present disclosure;

FIG. 4 shows a schematic block diagram of a real-time video latency calculation apparatus according to an exemplary embodiment of the present disclosure;

FIG. 5 schematically illustrates a block diagram of an electronic device according to an exemplary embodiment of the present disclosure; and

fig. 6 schematically illustrates a schematic diagram of a computer-readable storage medium according to an exemplary embodiment of the present disclosure.

Detailed Description

Example embodiments will now be described more fully with reference to the accompanying drawings. Example embodiments may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the concept of example embodiments to those skilled in the art. The same reference numerals denote the same or similar parts in the drawings, and thus, a repetitive description thereof will be omitted.

Furthermore, the described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments. In the following description, numerous specific details are provided to give a thorough understanding of embodiments of the disclosure. One skilled in the relevant art will recognize, however, that the embodiments of the disclosure can be practiced without one or more of the specific details, or with other methods, components, materials, devices, steps, and the like. In other instances, well-known structures, methods, devices, implementations, materials, or operations are not shown or described in detail to avoid obscuring aspects of the disclosure.

The block diagrams shown in the figures are functional entities only and do not necessarily correspond to physically separate entities. That is, these functional entities may be implemented in the form of software, or in one or more software-hardened modules, or in different networks and/or processor devices and/or microcontroller devices.

In the present exemplary embodiment, a real-time video delay calculation method is first provided; referring to fig. 1, the real-time video delay calculation method may include the following steps:

step S110, generating a time signal based on a digital clock generating module, and sending the clock signal to a real-time video streaming terminal signal monitoring module;

step S120, a real-time video streaming terminal signal monitoring module receives the time signal sent by the digital clock generating module, and generates and displays a timestamp reference picture based on the time signal;

step S130, a real-time video stream signal acquisition module acquires a timestamp reference picture displayed in the real-time video stream terminal signal monitoring module to generate a video signal containing the timestamp reference picture and sends the video signal to a real-time video stream transmission network module;

step S140, a real-time video streaming network module receives a video signal which is sent by the real-time video streaming signal acquisition module and contains the timestamp reference picture, and sends the video signal to a real-time video streaming terminal signal monitoring module after video streaming processing based on network transmission is carried out on the video signal;

step S150, the real-time video stream terminal signal monitoring module receives a video signal which is acquired by the real-time video stream signal acquisition module and is sent by the real-time video stream transmission network module after being processed based on the video stream transmitted by the network, and generates and displays a timestamp to-be-detected picture in the same display device as the timestamp reference picture based on the video signal;

step S160, the real-time video stream delay signal processing module performs screen capture on a timestamp reference picture and a timestamp to-be-detected picture in display equipment of the real-time video stream terminal signal monitoring module based on the screen capture sub-module, generates a to-be-processed picture and sends the to-be-processed picture to the delay video data storage module for storage;

step S170, the real-time video stream delay signal processing module calls the to-be-processed picture from the delay video data storage module, respectively identifies a reference timestamp and a to-be-detected timestamp in the to-be-processed picture based on the character identification submodule, and calculates real-time video delay according to the reference timestamp and the to-be-detected timestamp based on the delay calculation submodule.

In an exemplary embodiment of the present disclosure, a real-time video delay calculation method includes: and the real-time video stream delay signal processing module calculates the real-time video delay. According to the method, the universality of engineering application is ensured, the operability of building a delay test system is ensured, the high error of manual intervention is eliminated, and the intuitiveness of a delay data test effect is improved by replacing a manual photographing method with a more intelligent and automatic measuring and calculating scheme.

Next, a real-time video delay calculation method in the present exemplary embodiment will be further described.

The first embodiment is as follows:

in step S110, a time signal may be generated based on the digital clock generating module and transmitted to the real-time video streaming terminal signal monitoring module.

In step S120, the real-time video streaming terminal signal monitoring module receives the time signal sent by the digital clock generating module, and generates and displays a timestamp reference picture based on the time signal.

In step S130, a real-time video stream signal acquisition module may acquire the timestamp reference picture displayed in the real-time video stream terminal signal monitoring module to generate a video signal including the timestamp reference picture, and send the video signal to the real-time video stream transmission network module.

In step S140, the real-time video streaming network module may receive the video signal including the timestamp reference picture sent by the real-time video streaming signal acquisition module, perform video streaming processing based on network transmission on the video signal, and send the video signal to the real-time video streaming terminal signal monitoring module.

In step S150, the real-time video streaming terminal signal monitoring module may receive a video signal which is acquired by the real-time video streaming signal acquisition module and transmitted after being processed by the real-time video streaming network module based on the video stream transmitted through the network, and generate and display the timestamp to be detected picture in the same display device as the timestamp reference picture based on the video signal.

In step S160, the signal processing module may capture a reference frame of a timestamp and a frame to be detected of the timestamp in the display device of the real-time video streaming terminal signal monitoring module based on the screen capture sub-module, generate a frame to be processed, and send the frame to the delayed video data storage module for storage.

In step S170, the real-time video stream delay signal processing module may retrieve the to-be-processed picture from the delay video data storage module, respectively identify a reference timestamp and a to-be-detected timestamp in the to-be-processed picture based on the character recognition submodule, and calculate a real-time video delay according to the reference timestamp and the to-be-detected timestamp based on the delay calculation submodule.

In an embodiment of the present example, the method further comprises:

the digital clock generation module is used for generating a stopwatch time signal based on a stopwatch time generation submodule of the digital clock generation module, generating a millisecond time signal based on a millisecond time generation submodule of the digital clock generation module, and sending the stopwatch time signal and the millisecond time signal to the real-time video streaming terminal signal monitoring module;

the real-time video stream delay signal processing module captures a reference picture of a timestamp and a picture to be detected of the timestamp in display equipment of the real-time video stream terminal signal monitoring module based on a screen capture submodule, generates a picture to be processed and sends the picture to be processed to the delay video data storage module for storage;

In an embodiment of the present example, the method further comprises:

in an embodiment of the present example, the method further comprises:

the real-time video stream delay signal processing module calls a preset number of the pictures to be processed from the delay video data storage module, respectively identifies reference timestamps and timestamps to be detected in the preset number of the pictures to be processed on the basis of the character identification submodule, and respectively calculates real-time video delay according to the reference timestamps and the timestamps to be detected on the basis of the delay calculation submodule;

In an embodiment of the present example, the method further comprises:

a real-time video stream terminal signal monitoring module receives N time signals sent by the digital clock generating module, and generates and displays a timestamp reference picture based on the N time signals, wherein the N time signals in the timestamp reference picture are respectively displayed at a 2N-1 preset position in display equipment;

a real-time video stream terminal signal monitoring module receives a video signal which is acquired by a real-time video stream signal acquisition module and is sent by a real-time video stream transmission network module after being processed based on a video stream transmitted by a network, and generates and displays a timestamp to-be-detected picture in the same display equipment as the timestamp reference picture based on the video signal, wherein the timestamp to-be-detected picture comprises an Nth time signal to be detected, and the N time signals to be detected are displayed at a 2 Nth preset position in the display equipment;

In an embodiment of the present example, the method further comprises:

Example two:

the real-time video delay measuring and calculating method provided by the embodiment of the invention starts from a sampling stage of a camera, captures the reference picture by the digital clock signal generating device until the output picture to be measured is displayed on the real-time video monitoring device, wherein the method comprises all stages of video stream transmission, collection, processing, encoding, packaging, transmission, transcoding, distribution, decoding and playing. The reference picture can be regarded as a collected picture viewed from a target scene; the picture to be detected can be regarded as a picture displayed on the real-time video monitoring device after the target scene is coded and decoded by the camera and the real-time video transmission network. In an ideal situation, the two signals have the same digital clock value, i.e. the same timestamp, at the same time, but since the video stream signal is transmitted from the input end to the output end through the above-mentioned complete network transmission flow, network jitter occurs in the process, and a certain time is consumed in the processes of encoding and decoding the video stream, so that a delay is necessarily caused. And according to different performances of the real-time video transmission device or different influences of network transmission performance in the transmission process, the delay result can reach tens of milliseconds to tens of seconds. In order to reflect the real-time feedback of the user watching the real-time video stream, the measurement and calculation of the delay time are necessary. The measuring and calculating method adopted by the embodiment of the invention monitors and calculates the real-time video stream playing process from the first stage real-time video stream acquisition process to the last stage, can ensure that the tested delay data comprises the complete process of real-time video stream transmission, and ensures the accuracy of the measuring and calculating result.

At present, aiming at the application of the shooting method of the stopwatch, the shooting method also focuses on collecting the playing time snapshot of a single digital stopwatch in the same display area, and displaying the snapshot in another display area after transmission, wherein the other display area may be in the same monitor as the digital stopwatch generating device or in a monitor different from the digital stopwatch generating device; after the artificial shooting, due to the reasons that different camera shutter parameter settings are different, and the display effects of the monitor caused by different real-time video stream network transmission devices are different, and the like, the situation that the millisecond single digit at the previous time does not completely disappear when the millisecond single digit at the next time appears may occur, that is, the ghost of the time snapshot occurs. And under the condition of ghost image, performing artificial identification or optical character identification on the reference picture and the picture to be detected, calculating a difference value of the identified results to obtain real-time delay data, and calculating the performance of the real-time video tape casting under the time delay calculating scene to generate certain errors.

In order to improve the accuracy of result measurement and calculation in real-time video tape casting, avoid or at least reduce the influence of a ghost image problem on a real-time delay measurement and calculation result, replace a manual operation mode, and intelligently regulate and control the sampling rate of real-time video stream delay data, the embodiment of the invention provides an intelligent and automatic monitoring system real-time video delay measurement and calculation method. Firstly, a real-time video delay performance measuring and calculating system needs to be built. A computer monitor may be used as the real-time video streaming terminal signal monitoring device, which will be referred to as a PC monitor for ease of description and understanding. A digital clock generating device runs in a PC display, the device displays the current millisecond-level time, the captured picture is called a first reference picture, and the first reference picture can be referenced to a digital clock running on a network with millisecond-level precision. It should be noted that the current time in any time zone does not affect the delay measurement result in the embodiment of the present invention, and therefore the current time in any time zone can be selected as the first reference time. And operating a digital stopwatch generating device, wherein the digital stopwatch generating device is operated to display the millisecond-scale time passed by the current digital stopwatch, and the captured picture is called a second reference picture which can be referred to the digital stopwatch which is operated on the network with millisecond-scale precision. The significance of selecting one digital clock and one digital stopwatch is that the two display different time stamps, and the comparison of the processed delay data is more convenient. As an alternative embodiment, two digital stop watch generating devices may be used to generate the time stamp, and the same effect may be achieved by operating two digital stop watch generating devices separately. A web camera may be used as the real-time video stream capturing device, which will be referred to as a camera for convenience of description and understanding. The camera is directed at the first reference frame and the second reference frame of the PC display. The first reference picture and the second reference picture may adopt the arrangement mode as shown in fig. 2A, or adopt the arrangement mode as shown in fig. 2B, and the obtained first to-be-detected picture and the second to-be-detected picture are correspondingly placed on the other side of the PC according to the arrangement mode of the first reference picture and the second reference picture.

And the camera collects the first reference picture and the second reference picture and transmits the first reference picture and the second reference picture through the real-time video streaming network device, and the first picture to be detected and the second picture to be detected are respectively displayed on the other side of the same PC display after transmission. At this point, 4 timestamp values are obtained on the PC display, respectively: a current time stamp generated by the digital clock generating means, a digital clock time stamp output after transmission, a stopwatch time stamp generated by the digital stopwatch generating means, and a stopwatch time stamp output after transmission. For the convenience and accuracy of the subsequent processing, the display of the timestamp value should have the following two conditions. The first condition is as follows: the 4 timestamp values should have a large color contrast with the background on the PC display, i.e. the timestamp values are sufficiently prominent in the background color, and the similar colors may cause unnecessary recognition and calculation errors for the subsequent processing. And a second condition: on the PC display, except for four timestamp values, other irrelevant character pictures are prevented from being displayed, interference characters except the timestamps are ensured not to be recognized in the subsequent recognition process, and otherwise unnecessary recognition and calculation errors are brought to the time delay measurement result.

And after the four timestamp values are successfully displayed on the PC display, operating a signal processing device and a delay data storage device during real-time video tape casting. The signal processing device comprises two parts, wherein one part is a module for automatically capturing the picture displayed by the PC, the interval time of automatic capturing is adjustable, and a user can input an interval value parameter according to the requirement of the user so as to adjust the interval time of automatic capturing. And when the set interval time is reached, the automatic screenshot module carries out screenshot sampling on the monitoring picture of the PC display, and the screenshot result is fed into the delay data storage device at the first time. The second part of the real-time video stream delay signal processing device is an optical character recognition module, and for convenience of description and understanding, the module is simply referred to as an OCR module hereinafter. And the OCR module performs optical character recognition and character segmentation on the screenshot result taken out from the time delay data storage device. Wherein the latency data storage device is set as a first-in first-out queue, that is: the screenshot sampling result firstly entering the storage device is processed in absolute priority compared with the screenshot sampling result later entering the storage device, so that the sampling sequence and the processing sequence of the reference picture and the picture to be detected are consistent, and the problem that the delay result at the next moment is identified as the delay result at the previous moment is solved.

In the embodiment of the invention, after each time of optical character recognition and character segmentation by the OCR module, four different time stamp values are output and are put into a two-dimensional array for output. According to the following different arrangement manners of the reference picture and the picture to be measured in fig. 2A and 2B, four timestamp values need to be paired. It should be clear that: if the arrangement is performed according to the arrangement shown in fig. 2A, the output two-dimensional array is [ [ first reference picture, second reference picture ], [ first to-be-detected picture, second to-be-detected picture ] ]; if the arrangement is performed according to the arrangement shown in fig. 2B, the output two-dimensional array is [ [ first reference picture, first to-be-detected picture ], [ second reference picture, second to-be-detected picture ] ]. The invention does not limit the arrangement modes of the reference picture and the picture to be detected, only needs to know that for different arrangement modes, the finally output two-dimensional array of the timestamp brings different results, and different values are selected to be paired according to different arrangement modes for subsequent calculation.

After the previous step of identifying and dividing is completed and the timestamp two-dimensional array is output, aiming at the timestamp two-dimensional array a [ [ first reference picture, second reference picture ], [ first to-be-detected picture, second to-be-detected picture ] ] obtained by the arrangement mode shown in fig. 2A, when difference value operation is performed, a [0,0] and a [1,0] are selected as a group to be calculated; selecting A [0,1] and A [1,1] as a group for calculation, namely extracting a [ first reference picture, a first picture to be detected ] as one group and a [ second reference picture, a second picture to be detected ] as the other group; for the time stamp two-dimensional array B [ [ first reference picture, first to-be-measured picture ], [ second reference picture, second to-be-measured picture ] ] obtained by the arrangement shown in fig. 2B, when performing difference calculation, B [0,0] and B [0,1] should be selected as one group for calculation, B [1,0] and B [1,1] should be selected as one group for calculation, and similarly, the [ first reference picture, first to-be-measured picture ] is extracted as one group, and the [ second reference picture, second to-be-measured picture ] is extracted as another group.

In other alternative arrangements included in the embodiments of the present invention, arrangements similar to [ [ first to-be-detected picture, first reference picture ], [ second to-be-detected picture, second reference picture ] ] may occur, and because of the existence of the delay, the timestamp of the to-be-detected picture is delayed from the timestamp of the reference picture, and in this case, a negative value may occur by directly subtracting the former from the latter. To avoid the occurrence of negative delay results and the ambiguity caused to the user, no matter the arrangement mode provided by the embodiment of the present invention is adopted as shown in fig. 2A or fig. 2B, or the alternative arrangement mode provided by the embodiment of the present invention is adopted, the absolute value of the difference value obtained from the reference picture and the picture to be measured is obtained, and the obtained value is the delay result data.

In the measurement and calculation system provided by the embodiment of the invention, even if a better sampling mode for replacing manual shooting is provided, the time stamps generated by the array clock generation device can not generate ghost phenomena, and the different production environments and the different video transmission qualities can still generate the ghost phenomena to different degrees due to different performances of the real-time video streaming transmission network devices. Generally speaking, although the probability of the ghost phenomenon is reduced, the ghost phenomenon still inevitably exists even if a digital clock timestamp generation device is not adopted and other technical schemes such as color block change and the like are adopted. It should be noted that the reason why the ghost phenomenon occurs is that the time stamp value at the previous time does not disappear when the time stamp at the next time is displayed. The timestamp of the later time instant can already be displayed at the instant of sampling, indicating that the current sampling time instant is the later time instant, or closer to the latter time instant. The result of the smaller difference with the true reference time stamp is closer to the current accurate delay time no matter whether the OCR device recognizes the previous time or the next time. Therefore, a smaller value in the difference value between [ the first reference time, the first time to be measured ] and [ the second reference time, the second time to be measured ] is taken as the delay measurement result data in the test, and the error value of the result and the real delay data at the current moment is smaller.

Based on the above embodiment of the present invention, it is first necessary to make clear the concept that the ghost phenomenon is random, and for a scene in which multiple groups of reference pictures and pictures to be detected simultaneously appear on a PC monitor, after the real-time video stream delay signal processing apparatus performs a screen capture sampling operation, if the ghost phenomenon occurs, not all the pictures to be detected will simultaneously generate ghosts, but timestamps in all timestamps of the pictures to be detected, which will randomly generate ghost phenomena, according to the difference in performance of the currently used real-time video stream transmission network apparatus to be detected.

Based on this, in order to further reduce the error value between the delay measurement result and the real delay time, the present invention provides a more preferred embodiment for reference. When a group of (reference picture, picture to be detected) screen capturing results have double images, and a delay measuring and calculating result obtained by calculating the difference value has a large error with real delay data, no corresponding error correcting scheme is used for eliminating or at least reducing the error. It can be ascertained that, whether the digital clock time stamps generated by the digital clock generating means or the digital stop watch time stamps generated by the digital stop watch generating means are used, the time scales recorded by the respective time stamp generating means are absolutely identical during operation, even if all the time stamp generating means are not operated at the same moment. In other words, the time recorded by all the time stamp generating means will pass through the whole second within the time of one second. Therefore, in the same screen capture sampling result, the real delay time of all [ reference picture, picture to be measured ] groups should be completely equal. Therefore, in the first preferred embodiment of the present invention, a plurality of sets of [ reference picture, picture to be measured ] arrangement as shown in fig. 3 can be set. Alternatively, other arrangement modes of multiple sets of [ reference pictures, pictures to be detected ] can be designed, the arrangement modes are not limited in the embodiment of the invention, and only the fact that the dimensionality of the obtained multidimensional arrays is different after the time stamps in different arrangement modes pass through the signal processing device and the delay data storage device during real-time video tape casting is needed to be paid attention to, and the corresponding [ reference pictures, pictures to be detected ] time stamp sets are extracted for calculation during calculation of the difference values.

After the real-time video stream delay calculation system is built, n digital second meter generation devices, for example 20, are sequentially operated on the PC display. Under the condition that the structure of the whole real-time video stream delay computing system is not changed, the 20 digital stopwatch timestamps are transmitted into the real-time video stream transmission network device, and finally, the other part of the display of the PC can display corresponding 20 timestamp pictures to be tested. Similarly, 20 groups of [ reference pictures, pictures to be measured ] are fed into the real-time video stream casting time signal processing device, and 20 real-time video stream delay measurement result values are obtained after automatic screen capture, optical character recognition and difference value calculation modules. According to the theory, the real delay time corresponding to all the delay results should be equal. Therefore, by taking the mode of 20 values, bad values of error results caused by ghost generation can be discarded under the condition of ensuring accurate results, and the delay measurement result with the minimum error with the real delay value can be confirmed.

In this preferred embodiment of the present invention, the number of the designed digital stopwatch generating devices does not have any influence on the performance of the real-time video stream transmission network device to be tested and the delay data storage device, and does not substantially influence the performance of the real-time video stream terminal signal monitoring device and the real-time video stream casting signal processing device. Therefore, the number of the reference pictures can be dynamically designed according to different performances of the real-time video stream transmission network device to be measured in the production environment, so that the accuracy of measurement and calculation in real-time video stream casting can be improved as much as possible.

Based on the technical idea provided by the invention, in an actual production environment, a user or a viewer of a real-time video does not intend to delay real-time changes in the order of milliseconds. In general, the delay time should be dynamically updated within a certain time interval, such as once a second. Therefore, the method can ensure that the user is not easy to generate visual fatigue in the process of viewing the video stream transmission delay in real time, and can display the delay data to the user or a video stream viewer in the first time.

Based on this, the present invention proposes a second more preferred embodiment for reference. Under the condition that the structure of the real-time video casting measuring and calculating system is not changed, the larger the number of known sampling samples is, the closer the average value of the known sampling samples is to the average value of real delay data. According to the technical characteristic that the automatic screen capture frequency of the real-time video tape casting time signal processing device is adjustable, and if the delay time updated every second is displayed to a user finally, in a possible embodiment, the sampling frequency of the automatic screen capture can be set to be screen capture operation every 10 milliseconds, and after the screen capture is successful, the screen capture result is input into the delay data storage device, so that 100 screen capture results can be obtained in one second, then the 100 results are simultaneously taken out from the delay data storage device, and input into an OCR module of the real-time video tape casting time signal processing device to perform optical character recognition and a difference value calculation module to calculate the delay time of each screen capture sampling, and finally 100 delay result data in 1 second can be obtained. The average of the 100 delay result data values is already at its maximum close to the true delay average in this second.

The real time delay data value in the unit time is approached in a mode of averaging sampling samples as much as possible in the unit time, and the influence of ghost phenomena on the accuracy of the time delay measuring and calculating result can be reduced from another angle. The real-time video stream delay result finally displayed to the user or the real-time video viewer not only accords with the watching habit of human eyes, but also can bring more accurate delay result data.

For the real production scenario according to which the second preferred embodiment described above is based, the present invention proposes an alternative embodiment to the second preferred embodiment when updating the real-time video stream delay data once per unit time for the user or video stream viewer, in order to obtain a more accurate delay result. Taking the example of updating the delay data once per second, on the basis of the first embodiment of the present invention, the sources of the first reference picture and the second reference picture are both set as the same digital clock generating device, so as to ensure that the timestamp values of the first reference picture and the second reference picture are completely consistent. Similarly, the reference pictures generated by two identical digital clock generation devices are used, so that the purpose is to obtain the same reference picture timestamp every time of screen capture sampling, and therefore, in this embodiment, no limitation is imposed on the time zones of the digital clock generation devices, and only the time zones of the two digital clock generation devices need to be ensured to be identical.

Assuming that 100 reference pictures and a to-be-detected picture are combined and sampled within one second to play a snapshot, 100 sets of [ reference pictures, to-be-detected pictures ] timestamps within the second can be acquired. The obtaining method has been described in detail above, and is not described herein again. When the timestamps of the first reference picture and the second reference picture are absolutely equal, theoretically, in the same screen capture result, the first to-be-detected picture and the second to-be-detected picture should have the same timestamp value, i.e. the delay values of the [ first reference picture, first to-be-detected picture ] and the [ second reference picture, second to-be-detected picture ] should be equal. If the time delay values are not equal, the double image phenomenon is generated on one or both of the results when the optical character recognition is carried out on the group of results, and the time stamp value with error is recognized. For unequal timestamp values, the discarding process can be performed in the real-time video casting signal processing apparatus, and each delay result should be the real delay result of the corresponding sampling time in the remaining 100 sets of accurate timestamp values. And averaging the values to obtain the real average delay result within the second.

It should be noted that although the various steps of the methods of the present disclosure are depicted in the drawings in a particular order, this does not require or imply that these steps must be performed in this particular order, or that all of the depicted steps must be performed, to achieve desirable results. Additionally or alternatively, certain steps may be omitted, multiple steps combined into one step execution, and/or one step broken down into multiple step executions, etc.

In addition, in the present exemplary embodiment, a real-time video latency calculation apparatus is also provided. Referring to fig. 4, the real-time video delay calculation apparatus 400 may include: the system comprises a digital clock generation module 410, a real-time video stream terminal signal monitoring module 420, a real-time video stream signal acquisition module 430, a real-time video stream transmission network module 440, a real-time video casting time signal processing module 450 and a delayed video data storage module 460. Wherein:

a digital clock generating module 410, which is integrated in the real-time video streaming terminal signal monitoring module, and is configured to generate a time signal and send the clock signal to the real-time video streaming terminal signal monitoring module;

a real-time video stream terminal signal monitoring module 420, configured to receive the time signal sent by the digital clock generating module, and generate and display a timestamp reference picture based on the time signal; the real-time video streaming terminal signal monitoring module is also used for receiving a video signal which is acquired by the real-time video streaming signal acquisition module and is sent by the real-time video streaming transmission network module after being processed based on a video stream transmitted by a network, and generating and displaying a timestamp to-be-detected picture in the same display equipment as the timestamp reference picture based on the video signal;

a real-time video stream signal acquisition module 430, configured to acquire a timestamp reference picture displayed in the real-time video stream terminal signal monitoring module, generate a video signal including the timestamp reference picture, and send the video signal to a real-time video stream transmission network module;

a real-time video streaming network module 440, configured to receive a video signal sent by the real-time video streaming signal acquisition module and including the timestamp reference picture, perform video streaming processing based on network transmission on the video signal, and send the video signal to a real-time video streaming terminal signal monitoring module;

a real-time video stream delayed signal processing module 450, configured to screen capture a reference picture of a timestamp and a to-be-detected picture of the timestamp in a display device of the real-time video stream terminal signal monitoring module based on a screen capture submodule, generate a to-be-processed picture, and send the to-be-processed picture to the delayed video data storage module; the real-time video tape casting time signal processing module is also used for calling the picture to be processed from the time delay video data storage module, and respectively identifying a reference timestamp and a timestamp to be detected in the picture to be processed based on the character identification submodule; the real-time video tape casting time signal processing module is also used for calculating real-time video time delay according to the reference timestamp and the timestamp to be detected based on the time delay calculating submodule;

and a delayed video data storage module 460, configured to receive and store the to-be-processed picture sent by the signal processing module during the real-time video tape casting.

The specific details of each of the real-time video delay calculation device modules are already described in detail in a corresponding real-time video delay calculation method, and therefore are not described herein again.

It should be noted that although several modules or units of a real-time video latency calculation apparatus 400 are mentioned in the above detailed description, such partitioning is not mandatory. Indeed, the features and functions of two or more modules or units described above may be embodied in one module or unit, according to embodiments of the present disclosure. Conversely, the features and functions of one module or unit described above may be further divided into embodiments by a plurality of modules or units.

In addition, in an exemplary embodiment of the present disclosure, an electronic device capable of implementing the above method is also provided.

As will be appreciated by one skilled in the art, aspects of the present invention may be embodied as a system, method or program product. Thus, various aspects of the invention may be embodied in the form of: an entirely hardware embodiment, an entirely software embodiment (including firmware, microcode, etc.) or an embodiment combining hardware and software aspects that may all generally be referred to herein as a "circuit," module "or" system.

An electronic device 500 according to such an embodiment of the invention is described below with reference to fig. 5. The electronic device 500 shown in fig. 5 is only an example and should not bring any limitation to the functions and the scope of use of the embodiments of the present invention.

As shown in fig. 5, the electronic device 500 is embodied in the form of a general purpose computing device. The components of the electronic device 500 may include, but are not limited to: the at least one processing unit 510, the at least one memory unit 520, a bus 530 connecting various system components (including the memory unit 520 and the processing unit 510), and a display unit 540.

Wherein the storage unit stores program code that is executable by the processing unit 510 to cause the processing unit 510 to perform steps according to various exemplary embodiments of the present invention as described in the above section "exemplary methods" of the present specification. For example, the processing unit 510 may perform steps S110 to S170 as shown in fig. 1.

The memory unit 520 may include a readable medium in the form of a volatile memory unit, such as a random access memory unit (RAM) 5201 and/or a cache memory unit 5202, and may further include a read only memory unit (ROM) 5203.

Storage unit 520 may also include a program/utility 5204 having a set (at least one) of program modules 5203, such program modules 5205 including, but not limited to: an operating system, one or more application programs, other program modules, and program data, each of which, or some combination thereof, may comprise an implementation of a network environment.

Bus 550 may be any of several types of bus structures including a memory unit bus or memory unit controller, a peripheral bus, an accelerated graphics port, a processing unit, or a local bus using any of a variety of bus architectures.

The electronic device 500 may also communicate with one or more external devices 570 (e.g., keyboard, pointing device, bluetooth device, etc.), with one or more devices that enable a user to interact with the electronic device 500, and/or with any devices (e.g., router, modem, etc.) that enable the electronic device 500 to communicate with one or more other computing devices. Such communication may occur via input/output (I/O) interfaces 550. Also, the electronic device 500 may communicate with one or more networks (e.g., a Local Area Network (LAN), a Wide Area Network (WAN), and/or a public network, such as the internet) via the network adapter 560. As shown, the network adapter 560 communicates with the other modules of the electronic device 500 over a bus 550. It should be appreciated that although not shown in the figures, other hardware and/or software modules may be used in conjunction with the electronic device 500, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems, among others.

Through the above description of the embodiments, those skilled in the art will readily understand that the exemplary embodiments described herein may be implemented by software, or by software in combination with necessary hardware. Therefore, the technical solution according to the embodiments of the present disclosure may be embodied in the form of a software product, which may be stored in a non-volatile storage medium (which may be a CD-ROM, a usb disk, a removable hard disk, etc.) or on a network, and includes several instructions to enable a computing device (which may be a personal computer, a server, a terminal device, or a network device, etc.) to execute the method according to the embodiments of the present disclosure.

In an exemplary embodiment of the present disclosure, there is also provided a computer-readable storage medium having stored thereon a program product capable of implementing the above-described method of the present specification. In some possible embodiments, aspects of the invention may also be implemented in the form of a program product comprising program code means for causing a terminal device to carry out the steps according to various exemplary embodiments of the invention described in the above-mentioned "exemplary methods" section of the present description, when said program product is run on the terminal device.

Referring to fig. 6, a program product 600 for implementing the above method according to an embodiment of the present invention is described, which may employ a portable compact disc read only memory (CD-ROM) and include program code, and may be run on a terminal device, such as a personal computer. However, the program product of the present invention is not limited in this regard and, in the present document, a readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.

The program product may employ any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. A readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples (a non-exhaustive list) of the readable storage medium include: an electrical connection having one or more wires, a portable disk, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

A computer readable signal medium may include a propagated data signal with readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A readable signal medium may be any readable medium that is not a readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.

Program code embodied on a readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.

Program code for carrying out operations for aspects of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computing device, partly on the user's device, as a stand-alone software package, partly on the user's computing device and partly on a remote computing device, or entirely on the remote computing device or server. In the case of a remote computing device, the remote computing device may be connected to the user computing device through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computing device (e.g., through the internet using an internet service provider).

Furthermore, the above-described figures are merely schematic illustrations of processes involved in methods according to exemplary embodiments of the invention, and are not intended to be limiting. It will be readily understood that the processes shown in the above figures are not intended to indicate or limit the chronological order of the processes. In addition, it is also readily understood that these processes may be performed synchronously or asynchronously, e.g., in multiple modules.

Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.

It will be understood that the present disclosure is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is to be limited only by the terms of the appended claims.

Claims

1. A method for calculating a real-time video delay, the method comprising:

2. The method of claim 1, wherein the method further comprises:

3. The method of claim 2, wherein the method further comprises:

4. The method of claim 1, wherein the method further comprises:

the real-time video stream signal acquisition module acquires a timestamp reference picture displayed in the real-time video stream terminal signal monitoring module based on a preset time interval to generate a video signal containing the timestamp reference picture and sends the video signal to the real-time video stream transmission network module.

5. The method of claim 4, wherein the method further comprises:

6. The method of claim 1, wherein the method further comprises:

and calculating the average value of real-time video delay calculated on the basis of the reference Nth time stamp and the Nth time stamp to be detected as a video delay calculation result.

7. The method of claim 6, wherein the method further comprises:

8. A real-time video latency calculation apparatus, the apparatus comprising:

the digital clock generating module is integrated in the real-time video streaming terminal signal monitoring module and is used for generating a time signal and sending the clock signal to the real-time video streaming terminal signal monitoring module;

the real-time video stream delay signal processing module is used for capturing a timestamp reference picture and a timestamp to-be-detected picture in display equipment of the real-time video stream terminal signal monitoring module based on the screen capture submodule, generating a to-be-processed picture and sending the to-be-processed picture to the delay video data storage module; the real-time video tape casting time signal processing module is also used for calling the picture to be processed from the time delay video data storage module, and respectively identifying a reference timestamp and a timestamp to be detected in the picture to be processed based on the character identification submodule; the real-time video tape casting time signal processing module is also used for calculating real-time video time delay according to the reference timestamp and the timestamp to be detected based on the time delay calculating submodule;

9. An electronic device, comprising

A processor; and

a memory having computer readable instructions stored thereon which, when executed by the processor, implement the method of any of claims 1 to 7.

10. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the method according to any one of claims 1 to 7.