CN113519146B - Streaming media network time delay determining method and device, computer equipment, readable storage medium and remote driving system - Google Patents

Streaming media network time delay determining method and device, computer equipment, readable storage medium and remote driving system Download PDF

Info

Publication number
CN113519146B
CN113519146B CN202080003164.3A CN202080003164A CN113519146B CN 113519146 B CN113519146 B CN 113519146B CN 202080003164 A CN202080003164 A CN 202080003164A CN 113519146 B CN113519146 B CN 113519146B
Authority
CN
China
Prior art keywords
time
ntp
rtp
current frame
ntp time
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202080003164.3A
Other languages
Chinese (zh)
Other versions
CN113519146A (en
Inventor
请求不公布姓名
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
DeepRoute AI Ltd
Original Assignee
DeepRoute AI Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by DeepRoute AI Ltd filed Critical DeepRoute AI Ltd
Publication of CN113519146A publication Critical patent/CN113519146A/en
Application granted granted Critical
Publication of CN113519146B publication Critical patent/CN113519146B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L43/00Arrangements for monitoring or testing data switching networks
    • H04L43/10Active monitoring, e.g. heartbeat, ping or trace-route
    • H04L43/106Active monitoring, e.g. heartbeat, ping or trace-route using time related information in packets, e.g. by adding timestamps
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L43/00Arrangements for monitoring or testing data switching networks
    • H04L43/06Generation of reports
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L43/00Arrangements for monitoring or testing data switching networks
    • H04L43/08Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
    • H04L43/0852Delays
    • H04L43/0858One way delays
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60Network streaming of media packets
    • H04L65/61Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio
    • H04L65/612Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio for unicast
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60Network streaming of media packets
    • H04L65/65Network streaming protocols, e.g. real-time transport protocol [RTP] or real-time control protocol [RTCP]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60Network streaming of media packets
    • H04L65/70Media network packetisation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/80Responding to QoS
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04JMULTIPLEX COMMUNICATION
    • H04J3/00Time-division multiplex systems
    • H04J3/02Details
    • H04J3/06Synchronising arrangements
    • H04J3/0635Clock or time synchronisation in a network
    • H04J3/0638Clock or time synchronisation among nodes; Internode synchronisation
    • H04J3/0658Clock or time synchronisation among packet nodes
    • H04J3/0661Clock or time synchronisation among packet nodes using timestamps
    • H04J3/0667Bidirectional timestamps, e.g. NTP or PTP for compensation of clock drift and for compensation of propagation delays
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L43/00Arrangements for monitoring or testing data switching networks
    • H04L43/16Threshold monitoring

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Health & Medical Sciences (AREA)
  • Cardiology (AREA)
  • General Health & Medical Sciences (AREA)
  • Environmental & Geological Engineering (AREA)
  • Data Exchanges In Wide-Area Networks (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

A method, a device, a computer device, a readable storage medium and a remote driving system for determining the time delay of a streaming media network, wherein the method for determining the time delay of the streaming media network comprises the following steps: acquiring the RTP time for transmitting the current frame of the streaming media; acquiring a report RTP time of any sender report sent before the sending RTP time; determining the transmission NTP time of the current frame according to the transmission RTP time and the reporting RTP time; acquiring the NTP time of the current frame; and determining the network delay of the current frame according to the sending NTP time and the receiving NTP time. The method for determining the time delay of the streaming media network has strong practicability.

Description

Streaming media network time delay determining method and device, computer equipment, readable storage medium and remote driving system
Technical Field
The present disclosure relates to the field of communications technologies, and in particular, to a method and apparatus for determining a streaming media network delay, a computer device, a readable storage medium, and a remote driving system.
Background
RTP (Real-time Transport Protocol ) and RTCP (Real-time Transport Control Protocol, real-time transport control protocol) are two network transport protocols, which are widely used for streaming media transmission.
The RTP protocol packet includes a time-related field, i.e., timestamp. And the RTCP protocol datagram contains two time-related fields, NTP timestamp and RTP timestamp. These three time-dependent fields are used to calculate the position of a frame of audio or image in the entire media stream or to achieve synchronization of multiple streams. However, in practical applications, it is also important to determine the network delay of the media stream in real time, for example: knowing the video transmission quality in real time through the network delay condition of the video; for another example, when remotely controlling an unmanned vehicle, it is necessary to judge the security of the remote operation by network delay of video transmission.
In the related art, a method for calculating the delay of the streaming media network is not specified.
Disclosure of Invention
The embodiment of the application provides a method, a device, computer equipment, a readable storage medium and a remote driving system for determining the network delay of streaming media, which can determine the network delay in streaming media transmission.
A streaming media network delay determination method, the method comprising:
acquiring the transmission RTP time of a current frame of streaming media, wherein the transmission RTP time refers to the transmission time of the current frame acquired according to an RTP protocol data packet;
Acquiring the report RTP time of any sender report sent before the sending RTP time, wherein the report RTP time refers to the RTP time of the sender report acquired according to an RTCP protocol;
determining the transmission NTP time of the current frame according to the transmission RTP time and the reporting RTP time, wherein the transmission NTP time is corresponding to the transmission RTP time and is used for transmitting the current frame;
acquiring the NTP time of the current frame, wherein the NTP time refers to the NTP time of the current frame;
and determining the network delay of the current frame according to the sending NTP time and the receiving NTP time.
A streaming media network delay determination apparatus, the apparatus comprising:
the transmission RTP time acquisition module is used for acquiring the transmission RTP time of the current frame of the streaming media, wherein the transmission RTP time refers to the transmission time of the current frame acquired according to an RTP protocol data packet;
a report RTP time acquisition module, configured to acquire a report RTP time of any one sender report sent before the sending RTP time, where the report RTP time refers to an RTP time of the sender report acquired according to an RTCP protocol;
a sending NTP time determining module, configured to determine, according to the sending RTP time and the reporting RTP time, a sending NTP time of the current frame, where the sending NTP time is an NTP time corresponding to the sending RTP time and used to send the current frame;
A received NTP time determining module, configured to obtain a received NTP time of the current frame, where the received NTP time refers to an NTP time of receiving the current frame;
and the time delay determining module is used for determining the network time delay of the current frame according to the sending NTP time and the receiving NTP time.
A computer readable storage medium having stored thereon a computer program which when executed by a processor performs the steps of the streaming media network delay determination method described above.
A computer device comprising a memory and a processor, wherein the memory stores computer readable instructions that, when executed by the processor, cause the processor to perform the streaming media network delay determination method described above.
A remote driving system, comprising:
the unmanned vehicle is provided with an image acquisition device for acquiring streaming media;
the NTP server is in communication connection with the image acquisition device;
the remote control device is in communication connection with the image acquisition device and the NTP server, and is used for acquiring the transmission RTP time of the current frame of the streaming media, wherein the transmission RTP time refers to the transmission time of the current frame acquired according to an RTP protocol data packet; acquiring the report RTP time of any sender report sent before the sending RTP time, wherein the report RTP time refers to the RTP time of the sender report acquired according to an RTCP protocol; determining the transmission NTP time of the current frame according to the transmission RTP time and the reporting RTP time, wherein the transmission NTP time is corresponding to the transmission RTP time and is used for transmitting the current frame; acquiring the NTP time of the current frame, wherein the NTP time refers to the NTP time of the current frame; and determining the network delay of the current frame according to the sending NTP time and the receiving NTP time.
The method, the device, the computer equipment, the readable storage medium and the remote driving system for determining the time delay of the streaming media network are used for acquiring the transmission RTP time of the current frame of the streaming media and acquiring the reporting RTP time of any sender report transmitted before the transmission RTP time. And determining the sending NTP time of the current frame according to the sending RTP time and the reporting RTP time, and further determining the network time delay according to the sending NTP time and the receiving NTP time. The method, the device, the computer equipment, the readable storage medium and the remote driving system for determining the streaming media network delay can determine the streaming media network delay, and are high in practicability. Meanwhile, based on the relation between RTP and RTCP, according to the sending RTP time of the streaming media and the RTP time reported by the sender, the sending NTP time of the streaming media can be accurately determined, so that the sending time and the receiving time are both based on the same time synchronization protocol, and the determined network time delay is more accurate.
Drawings
Fig. 1 is an application scenario schematic diagram of a method for determining a streaming media network delay according to an embodiment of the present application;
fig. 2 is a flow chart of a method for determining a delay of a streaming media network according to an embodiment of the present application;
Fig. 3 is a flowchart of a method for determining a delay of a streaming media network according to an embodiment of the present application;
fig. 4 is a flowchart of a method for determining a delay of a streaming media network according to an embodiment of the present application;
fig. 5 is a flowchart of a method for determining a delay of a streaming media network according to an embodiment of the present application;
fig. 6 is a flowchart of a method for determining a delay of a streaming media network according to an embodiment of the present application;
fig. 7 is a schematic frame diagram of a streaming media network delay determining device according to an embodiment of the present application;
fig. 8 is a block diagram of a computer device structure according to an embodiment of the present application.
Detailed Description
In order that the invention may be readily understood, a more complete description of the invention will be rendered by reference to the appended drawings. Preferred embodiments of the present invention are shown in the drawings. This invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete.
Referring to fig. 1, the method for determining the delay of the streaming media network provided in the embodiments of the present application may be applied to an application environment as shown in fig. 1, where a sending end 102 and a receiving end 104 are connected through network communication, and an RTP protocol and an RTCP protocol are adopted between the sending end 102 and the receiving end 104 to implement transmission of streaming media data. Both the sender 102 and the receiver 104 are communicatively coupled to an NTP (Network Time Protocol ) server 106 via a network. The NTP server uses the NTP protocol to time synchronize the sender 102 and the receiver 104. The transmitting end 102 may be an image capturing device or the like. The receiving end 104 may be, but is not limited to, various personal computers, notebook computers, smart phones, tablet computers, and portable wearable devices. The NTP server 106 may be implemented as a stand-alone server or as a cluster of servers.
In some embodiments, the method for determining the network delay of the streaming media can be applied to remote control, and the receiving end remotely receives video data or audio data sent by the sending end, so that the network delay is determined due to the requirement of transmission quality or real-time requirement.
In some specific embodiments, the method provided by the present embodiments may be applied to a remote unmanned system. The remote unmanned system comprises an unmanned vehicle, an image acquisition device arranged on the unmanned vehicle, an NTP server 106 and a remote control device. The image capturing device is the transmitting end 102, and the remote control device is the receiving end 104. The remote control device is in communication connection with the unmanned timely vehicle and the image acquisition device.
Referring to fig. 2, an embodiment of the present application provides a method for determining a delay of a streaming media network. The present embodiment is described by taking the receiving end in fig. 1 as an example. The method comprises the following steps:
s10, acquiring the transmission RTP time of the current frame of the streaming media, wherein the transmission RTP time refers to the transmission time of the current frame acquired according to the RTP protocol data packet.
The streaming media may be video data, audio data, or data containing both video and audio. The current frame of the streaming media refers to the video frame or audio frame being transmitted at the current time. The sending end internally comprises a self clock source which provides time information for the RTP protocol and the RTCP data packets. The transmission RTP time refers to the transmission time of the current frame data determined by the clock source of the transmitting end. The transmission RTP time can be determined by a time stamp of the current frame data, which is initialized to an initial value at the start of the session. The unit of RTP time may be base, for example, base may be 9000, then 9000 represents 1s.
S20, acquiring the reporting RTP time of any sender report sent before the sending RTP time, wherein the reporting RTP time refers to the RTP time of the sender report acquired according to the RTCP protocol.
The Sender periodically sends RTCP information to the receiver, where the RTCP information includes Sender Rrport (SR). Each sender report carries two time-related fields: NTP timestamp and RTPtimestamp. The report RTP time refers to an RTP timestamp carried by the sender report and is used for representing the sending moment of the sender report under the self clock source of the sender. The sender report may be selected from any sender report before the sending RTP time, and of course, if the sending RTP time corresponds to exactly one sender report, and at the sending time of the current frame data, exactly one sender report is sent, then the sender report may also be the sender report corresponding to the sending RTP time.
S30, determining the sending NTP time of the current frame according to the sending RTP time and the reporting RTP time, wherein the reporting RTP time refers to the RTP time of the sender report acquired according to an RTCP protocol.
From the reported RTP times, a corresponding NTP time may be determined. And the sending RTP time and the reporting RTP time are both the time under the self clock source of the sending end. Therefore, according to the relation between the sending RTP time and the reporting RTP time, the sending NTP time of the current frame can be determined.
S40, obtaining the NTP time of the current frame, wherein the NTP time refers to the NTP time of the current frame.
The NTP time is used to characterize the NTP time when the receiving end receives the current frame data. The receiving end is in communication connection with the NTP server, the NTP server adopts an NTP protocol to carry out time synchronization on the receiving end, and the time in the receiving end is NTP time. And directly obtaining the moment when the current frame reaches the receiving end, and obtaining the time for receiving the NTP.
In order to better distinguish between the sending RTP time, the sending NTP time, the reporting RTP time and the receiving NTP time, the sources of the respective times are collectively described below:
the transmission RTP time: a timestamp field in the RTP protocol packet;
NTP time of transmission: according to the RTP time and the report RTP time, calculating to obtain the NTP time corresponding to the RTP data packet;
reporting the RTP time: an RTP timestamp field in a sender report data packet of an RTCP protocol;
reception NTP time: the current NTP time obtained when the data receiving end receives the RTP data packet.
S50, determining the network delay of the current frame according to the sending NTP time and the receiving NTP time.
The difference between the received NTP time and the transmitted NTP time can characterize the transmission delay of the current frame data in the network transmission process, namely the network delay of the current frame. The NTP time is adopted for the sending time and the receiving time of the current frame data, so that the calculated network time delay is absolute time delay, and the accuracy is high.
The embodiment provides a method for determining the network delay of the current frame, and when the method is used, the steps S10-S50 are repeated, so that the network delay of each frame of streaming media can be determined, and the network delay of the streaming media can be determined in real time.
In this embodiment, the reporting RTP time is obtained by obtaining the sending RTP time of the current frame of the streaming media and obtaining the RTP time reported by any sender that is sent before the sending RTP time. And determining the sending NTP time of the current frame according to the sending RTP time and the reporting RTP time, and further determining the network time delay according to the sending NTP time and the receiving NTP time. The method provided by the embodiment of the application can realize the determination of the time delay of the streaming media network, and has strong practicability. Meanwhile, based on the relation between RTP and RTCP, according to the sending RTP time of the streaming media and the RTP time reported by the sender, the sending NTP time of the streaming media can be accurately determined, so that the sending time and the receiving time are both based on the same time synchronization protocol, and the determined network time delay is more accurate.
Referring to fig. 3, the present embodiment relates to a possible implementation of determining the transmission NTP time of the current frame according to the transmission RTP time and the reporting RTP time. In one embodiment, S30 includes:
S310, determining the time difference between the sending RTP time and the reporting RTP time to obtain a relative time difference;
s320, acquiring reporting NTP time corresponding to the reporting RTP time, wherein the reporting NTP time refers to NTP time reported by a sender;
s330, determining the sending NTP time according to the reported NTP time and the relative time difference.
The relative time difference is used to characterize the relative difference between the transmit RTP time and the reported RTP time. The reporting NTP time refers to the NTP time of the sender report, which originates from the NTP timestamp field in the RTCP protocol sender report packet. As described above, each sender report carries two time-related fields, one NTP timestamp and one RTP time, both times being used to characterize the sending time of the sender report. Then, the NTP time reported by the sender corresponds to the RTP time uniquely, and according to the correspondence between the NTP time and the RTP time, the NTP time reported by the sender can be determined. Reporting NTP time and relative time difference are known, then the NTP time corresponding to the transmit RTP time of the current frame can be determined. In this embodiment, the relative time difference is obtained by determining the time difference between the sending RTP time and the reporting RTP time, and the relative time difference is obtained by making a difference between two RTP times under the same clock source, so that the method is very accurate. Meanwhile, the NTP time and the RTP time in the sender report are also uniquely corresponding, so that the obtained report NTP time is high in accuracy, and the accuracy of the sent NTP time determined by the relative time difference and the report NTP time is high, so that the accuracy of the determined network delay is high.
Referring to fig. 4, in some embodiments, the implementation of determining the transmission NTP time according to the reported NTP time and the relative time difference includes the following steps, that is, S330 includes:
s331, converting the relative time difference into NTP time to obtain NTP time difference;
s332, calculating the sum of the reported NTP time and the NTP time difference to obtain the transmitted NTP time.
The sending RTP time and the reporting RTP time are directly differenced, and the time difference under the RTP protocol is obtained. And converting the time difference into a time difference under the NTP protocol, and summing the time difference with the reported NTP time to obtain the time for transmitting the NTP.
There are various ways to convert the relative time difference into the NTP time difference, and in one embodiment, the NTP time difference may be obtained by shifting the relative time difference by 32 bits, that is: NTP time difference = (transmit RTP time-report RTP time) < 32/base. In other embodiments, the relative time difference may also be calculated by comparing 2 with 32 And obtaining the NTP time difference, namely: NTP time difference= (transmission RTP time-reporting RTP time) 2 32 Base. By converting the relative time difference into the NTP time difference in the mode, the operation precision can be reserved, and the accuracy of determining the NTP time difference is improved, so that the accuracy of determining the NTP time is further improved, and the accuracy of determining the time delay of the streaming media network is improved.
This embodiment relates to one possible implementation of obtaining a reported RTP time of any sender report sent before the sending RTP time, and in one embodiment, S20 includes:
and acquiring the RTP time reported by one sender closest to the sending RTP time before the sending RTP time, and obtaining the reported RTP time.
The time synchronization of the NTP server to the transmitting end and the receiving end can be periodically performed, and the time synchronization is performed once at intervals so as to improve the accuracy of the time synchronization. Thus, the closer the transmission RTP time is, the more accurate the reporting NTP time corresponding to the reporting RTP time. The sender NTP time accuracy further determined by the RTP time reported by the closest one is high.
The present embodiment relates to a possible implementation manner of determining the network delay of the current frame according to the transmission NTP time and the reception NTP time, and in one embodiment, S50 specifically includes:
and calculating the difference between the time of receiving the NTP and the time of transmitting the NTP to obtain the network delay of the current frame.
Namely: network delay = receive NTP time-transmit NTP time.
Referring to fig. 5, this embodiment relates to a possible implementation manner of obtaining a transmission RTP time of a current frame of streaming media and obtaining a reception NTP time, S10 includes:
S110, acquiring a time stamp of a first data packet in the data packets of the current frame;
s120, according to the time stamp of the first data packet, the RTP time is obtained.
The corresponding S40 includes:
and acquiring the NTP time when all the data packets of the current frame are received, and obtaining the NTP time.
When the transmitting end transmits each frame of streaming media data to the receiving end, the transmitting end packages the data of each frame into a plurality of data packets and sequentially transmits the data packets to the receiving end. The receiving end sequentially receives the data packets, and after receiving all the data packets, the receiving end splices the data packets to form complete video or audio. Each data packet carries a time stamp. The time of the first data packet in the plurality of data packets is taken as the transmission RTP time, and the time when all the data packets are received is taken as the reception NTP time, so that the time when the data packets are transmitted and received one by one is also added into the network delay calculation, and the accuracy of the network delay calculation is further improved.
Referring to fig. 6, in one embodiment, the method further comprises:
s60, if the network time delay of the current frame is greater than a preset threshold, outputting alarm information;
and S70, if the network time delay of the current frame is greater than a preset threshold value, controlling the remote control target to stop working.
Taking the method provided by the embodiment as an example of remote control, if the network delay of the current frame is greater than the preset threshold, it is indicated that the transmission network delay of the current frame of the streaming media does not meet the requirement, and an alarm message can be output to prompt an operator, or the remote control target is further controlled to stop working. Thus, the intelligence of remote control can be improved, and the safety of a remote control target can be improved.
In some embodiments, the remote control target is an unmanned vehicle, and if the network delay of the current frame is greater than a preset threshold, the unmanned vehicle is controlled to stop. When the remote control unmanned vehicle runs, road condition information and the like are required to be judged in real time according to image information acquired by the image acquisition equipment, if the network delay is too large, judgment is not timely, and the running state or direction of the unmanned vehicle is not timely controlled, so that a large danger exists, and when the network delay is larger than a preset threshold value, the unmanned vehicle is timely controlled to stop by the side by judging the network delay of each frame of the streaming media in real time, and the running safety of the remote control unmanned vehicle is greatly improved.
Streaming media includes one of video and audio. In one embodiment, the streaming media includes video and audio, and when the streaming media includes the video and the audio, the video and the audio are respectively packaged and transmitted, and the method provided by the embodiment is referred to for determining the network delay of the video and the audio respectively.
It should be understood that, although the steps in the flowchart are shown in sequence as indicated by the arrows, the steps are not necessarily performed in sequence as indicated by the arrows. The steps are not strictly limited to the order of execution unless explicitly recited herein, and the steps may be executed in other orders. Moreover, at least some of the steps in the figures may include multiple sub-steps or stages that are not necessarily performed at the same time, but may be performed at different times, nor does the order in which the sub-steps or stages are performed necessarily performed in sequence, but may be performed alternately or alternately with at least a portion of other steps or other steps.
Referring to fig. 7, an embodiment of the present application provides a streaming media network delay determining apparatus 10, which includes: a transmit RTP time acquisition module 100, a report RTP time acquisition module 200, a transmit NTP time determination module 300, a receive NTP time determination module 400, and a delay determination module 500. Wherein, the liquid crystal display device comprises a liquid crystal display device,
a sending RTP time obtaining module 100, configured to obtain a sending RTP time of a current frame of a streaming media, where the sending RTP time is a sending time of the current frame obtained according to an RTP protocol data packet;
A report RTP time acquisition module 200, configured to acquire a report RTP time of any one sender report sent before the sending RTP time, where the report RTP time refers to an RTP time of the sender report acquired according to an RTCP protocol;
a sending NTP time determining module 300, configured to determine, according to the sending RTP time and the reporting RTP time, a sending NTP time of the current frame, where the sending NTP time is an NTP time corresponding to the sending RTP time and used for sending the current frame;
a received NTP time determining module 400, configured to obtain a received NTP time of the current frame, where the received NTP time refers to the NTP time of receiving the current frame;
the delay determining module 500 is configured to determine a network delay of the current frame according to the transmission NTP time and the reception NTP time.
In one embodiment, the reporting RTP time acquisition module 200 includes a relative time difference determination unit, a reporting NTP time determination unit, and a transmitting NTP time determination unit. The relative time difference determining unit is used for determining the time difference between the sending RTP time and the reporting RTP time to obtain a relative time difference; a report NTP time determining unit, configured to obtain a report NTP time corresponding to the report RTP time, where the report NTP time refers to an NTP time reported by the sender; and the sending NTP time determining unit is used for determining the sending NTP time according to the reported NTP time and the relative time difference.
In one embodiment, the transmitting NTP time determining unit is configured to convert the relative time difference into NTP time, to obtain an NTP time difference; and calculating the sum of the reported NTP time and the NTP time difference to obtain the transmitted NTP time.
In one embodiment, the transmission NTP time determining unit is configured to shift the relative time difference by 32 bits to obtain the obtained NTP time difference.
In one embodiment, the transmission NTP time determining unit is used for calculating the relative time difference and 2 32 And obtaining the NTP time difference.
In one embodiment, the report RTP time acquisition module 200 is configured to acquire the reported RTP time from a sender that is closest to the sending RTP time before the sending RTP time, and obtain the reported RTP time.
In one embodiment, the delay determining module 500 is configured to calculate a difference between the received NTP time and the transmitted NTP time, so as to obtain a network delay of the current frame.
In one embodiment, the sending RTP time acquisition module 100 is configured to acquire a timestamp of a first packet in the packets of the current frame; and obtaining the RTP time for sending according to the time stamp of the first data packet.
In one embodiment, the NTP time determination module 400 obtains the NTP time when all the packets of the current frame are received, and obtains the NTP time.
With continued reference to fig. 7, in one embodiment, the streaming media network delay determining apparatus 10 further includes an alarm information output module 600, configured to control the remote control target to stop working if the network delay of the current frame is greater than a preset threshold.
In one embodiment, the remote control target is an unmanned vehicle, and the streaming media network delay determining apparatus 10 further includes a control module 700 for controlling the unmanned vehicle to stop.
In one embodiment, the streaming media includes at least one of video and audio.
The implementation principle and technical effects of the streaming media network delay determining device 10 provided in the foregoing embodiment are similar to those of the foregoing method embodiment, and are not described herein again.
The above-mentioned division of the modules in the streaming media network delay determining device 10 is only used for illustration, and in other embodiments, the streaming media network delay determining device 10 may be divided into different modules as needed to complete all or part of the functions of the streaming media network delay determining device 10.
The modules in the streaming media network delay determination apparatus 10 may be implemented in whole or in part by software, hardware, or a combination thereof. The above modules may be embedded in hardware or may be independent of a processor in the computer device, or may be stored in software in a memory in the computer device, so that the processor may call and execute operations corresponding to the above modules.
Referring to FIG. 8, in one embodiment, a schematic diagram of the internal architecture of a computer device is provided. The computer device includes a processor, a memory, and a display screen connected by a system bus. Wherein the processor is operative to provide computing and control capabilities to support operation of the entire computer device. The memory is configured to store data, programs, and/or instruction codes, and the like, and at least one computer program is stored in the memory, and the computer program can be executed by the processor, so as to implement the streaming media network delay determining method suitable for the computer device provided in the embodiment of the application. The Memory may include a nonvolatile storage medium such as a magnetic disk, an optical disk, a Read-Only Memory (ROM), or a Random-Access Memory (RAM). For example, in one embodiment, the memory includes a non-volatile storage medium and an internal memory. The nonvolatile storage medium stores an operating system, a database, and a computer program. The database stores data related to a method for determining a delay of a streaming media network, which is provided by the above embodiments, for example, information such as a name of each process or application may be stored. The computer program may be executed by a processor to implement a method for determining a streaming media network delay according to various embodiments of the present application. The internal memory provides a cached operating environment for the operating system, databases, and computer programs in the non-volatile storage medium. The display screen may be a touch screen, such as a capacitive screen or an electronic screen, and is used for displaying interface information of an application corresponding to a foreground process, and may also be used for detecting a touch operation acting on the display screen, and generating a corresponding instruction, such as a switching instruction of a foreground application and a background application.
It will be appreciated by those skilled in the art that the structure shown in fig. 8 is merely a block diagram of some of the structures associated with the present application and is not limiting of the computer device to which the present application may be applied, and that a particular computer device may include more or fewer components than shown, or may combine certain components, or have a different arrangement of components. The computer device may also include a network interface, such as an ethernet card or a wireless network card, coupled via a system bus, for communicating with an external computer device, such as a server.
In an embodiment of the present application, the computer device includes a processor that executes a computer program stored on a memory to implement the following steps:
acquiring the transmission RTP time of a current frame of streaming media, wherein the transmission RTP time refers to the transmission time of the current frame acquired according to an RTP protocol data packet;
acquiring the report RTP time of any sender report sent before the sending RTP time, wherein the report RTP time refers to the RTP time of the sender report acquired according to an RTCP protocol;
determining the transmission NTP time of the current frame according to the transmission RTP time and the reporting RTP time, wherein the transmission NTP time is corresponding to the transmission RTP time and is used for transmitting the current frame;
Acquiring the NTP time of receiving the current frame, wherein the NTP time refers to the NTP time of receiving the current frame;
and determining the network delay of the current frame according to the sending NTP time and the receiving NTP time.
In one embodiment, the processor when executing the computer program further performs the steps of: determining the time difference between the sending RTP time and the reporting RTP time to obtain a relative time difference; acquiring reporting NTP time corresponding to the reporting RTP time, wherein the reporting NTP time refers to the NTP time reported by the sender; and determining the sending NTP time according to the reporting NTP time and the relative time difference.
In one embodiment, the processor when executing the computer program further performs the steps of: converting the relative time difference into NTP time to obtain an NTP time difference; and calculating the sum of the reported NTP time and the NTP time difference to obtain the transmitted NTP time.
In one embodiment, the processor when executing the computer program further performs the steps of: and shifting the relative time difference by 32 bits to obtain the obtained NTP time difference.
In one embodiment, the processor when executing the computer program further performs the steps of: calculating the relative time difference and 2 32 And obtaining the NTP time difference.
In one embodiment, the processor when executing the computer program further performs the steps of: and before acquiring the sending RTP time, acquiring the RTP time reported by one sender closest to the sending RTP time, and obtaining the reported RTP time.
In one embodiment, the processor when executing the computer program further performs the steps of: and calculating the difference between the received NTP time and the transmitted NTP time to obtain the network time delay of the current frame.
In one embodiment, the processor when executing the computer program further performs the steps of: acquiring a time stamp of a first data packet in the data packets of the current frame; and obtaining the RTP time for sending according to the time stamp of the first data packet.
In one embodiment, the processor when executing the computer program further performs the steps of: and acquiring the NTP time when all the data packets of the current frame are received, and obtaining the NTP time.
In one embodiment, the processor when executing the computer program further performs the steps of: and if the network time delay of the current frame is greater than a preset threshold value, outputting alarm information.
In one embodiment, the processor when executing the computer program further performs the steps of: and if the network time delay of the current frame is greater than the preset threshold, controlling the remote control target to stop working.
In one embodiment, the remote control target is an unmanned vehicle, and the processor when executing the computer program further performs the steps of: and controlling the unmanned vehicle to stop.
In one embodiment, the streaming media includes at least one of video and audio.
The implementation principle and technical effects of the implementation steps when the processor of the computer device executes the computer program provided in the above embodiment are similar to those of the above method embodiment, and are not described herein again.
Embodiments of the present application also provide a computer-readable storage medium. One or more non-transitory computer-readable storage media containing computer-executable instructions that, when executed by one or more processors, cause the processors to perform the steps of a streaming media network latency determination method:
acquiring the transmission RTP time of a current frame of streaming media, wherein the transmission RTP time refers to the transmission time of the current frame acquired according to an RTP protocol data packet;
acquiring the report RTP time of any sender report sent before the sending RTP time, wherein the report RTP time refers to the RTP time of the sender report acquired according to an RTCP protocol;
Determining the transmission NTP time of the current frame according to the transmission RTP time and the reporting RTP time, wherein the transmission NTP time is corresponding to the transmission RTP time and is used for transmitting the current frame;
acquiring the NTP time of the current frame, wherein the NTP time refers to the NTP time of the current frame;
and determining the network delay of the current frame according to the sending NTP time and the receiving NTP time.
In one embodiment, the computer program when executed by the processor further performs the steps of: determining the time difference between the sending RTP time and the reporting RTP time to obtain a relative time difference; acquiring reporting NTP time corresponding to the reporting RTP time, wherein the reporting NTP time refers to the NTP time reported by the sender; and determining the sending NTP time according to the reporting NTP time and the relative time difference.
In one embodiment, the computer program when executed by the processor further performs the steps of: converting the relative time difference into NTP time to obtain an NTP time difference; and calculating the sum of the reported NTP time and the NTP time difference to obtain the transmitted NTP time.
In one embodiment, the computer program when executed by the processor further performs the steps of: and shifting the relative time difference by 32 bits to obtain the obtained NTP time difference.
In one embodiment, the computer program when executed by the processor further performs the steps of: calculating the relative time difference and 2 32 And obtaining the NTP time difference.
In one embodiment, the computer program when executed by the processor further performs the steps of: and before acquiring the sending RTP time, acquiring the RTP time reported by one sender closest to the sending RTP time, and obtaining the reported RTP time.
In one embodiment, the computer program when executed by the processor further performs the steps of: and calculating the difference between the received NTP time and the transmitted NTP time to obtain the network time delay of the current frame.
In one embodiment, the computer program when executed by the processor further performs the steps of: acquiring a time stamp of a first data packet in the data packets of the current frame; and obtaining the RTP time for sending according to the time stamp of the first data packet.
In one embodiment, the computer program when executed by the processor further performs the steps of: and acquiring the NTP time when all the data packets of the current frame are received, and obtaining the NTP time.
In one embodiment, the computer program when executed by the processor further performs the steps of: and if the network time delay of the current frame is greater than a preset threshold value, outputting alarm information.
In one embodiment, the computer program when executed by the processor further performs the steps of: and if the network time delay of the current frame is greater than the preset threshold, controlling the remote control target to stop working.
In one embodiment, the remote control object is an unmanned vehicle, and the computer program when executed by the processor further performs the steps of: and controlling the unmanned vehicle to stop.
In one embodiment, the streaming media includes at least one of video and audio.
The computer readable storage medium provided in the above embodiment has similar principle and technical effects to those of the above method embodiment, and will not be described herein.
One embodiment of the present application also provides a remote driving system including an unmanned vehicle, an NTP server, and a remote control device. The unmanned vehicle is provided with an image acquisition device for acquiring the transmission RTP time of the current frame of the streaming media, wherein the transmission RTP time refers to the transmission time of the current frame acquired according to an RTP protocol data packet; acquiring the report RTP time of any sender report sent before the sending RTP time, wherein the report RTP time refers to the RTP time of the sender report acquired according to an RTCP protocol; determining the transmission NTP time of the current frame according to the transmission RTP time and the reporting RTP time, wherein the transmission NTP time is corresponding to the transmission RTP time and is used for transmitting the current frame; acquiring the NTP time of the current frame, wherein the NTP time refers to the NTP time of the current frame; and determining the network delay of the current frame according to the sending NTP time and the receiving NTP time.
In one embodiment, the remote control device is further configured to control the unmanned vehicle to stop if the network delay of the current frame is greater than a preset threshold.
It should be noted that the remote control device includes a memory and a processor, where the memory stores computer readable instructions that, when executed by the processor, cause the processor to execute the steps of the method for determining a delay of a streaming media network in any of the above embodiments.
The remote driving system provided in the above embodiment has similar implementation principles and technical effects to those of the above method embodiment, and will not be described herein.
Any reference to memory, storage, database, or other medium used herein may include non-volatile and/or volatile memory. Suitable nonvolatile memory can include Read Only Memory (ROM), programmable ROM (PROM), electrically Programmable ROM (EPROM), electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM), which acts as external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms such as Static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDR SDRAM), enhanced SDRAM (ESDRAM), synchronous Link DRAM (SLDRAM), memory bus direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).
The technical features of the above-described embodiments may be arbitrarily combined, and all possible combinations of the technical features in the above-described embodiments are not described for brevity of description, however, as long as there is no contradiction between the combinations of the technical features, they should be considered as the scope of the description.
The above examples illustrate only a few embodiments of the invention, which are described in detail and are not to be construed as limiting the scope of the invention. It should be noted that it will be apparent to those skilled in the art that several variations and modifications can be made without departing from the spirit of the invention, which are all within the scope of the invention. Accordingly, the scope of protection of the present invention is to be determined by the appended claims.

Claims (17)

1. A method for determining a delay of a streaming media network, the method comprising:
acquiring the transmission RTP time of a current frame of streaming media, wherein the transmission RTP time refers to the transmission time of the current frame acquired according to an RTP protocol data packet;
acquiring the report RTP time of any sender report sent before the sending RTP time, wherein the report RTP time refers to the RTP time of the sender report acquired according to an RTCP protocol;
Determining the time difference between the sending RTP time and the reporting RTP time to obtain a relative time difference;
acquiring reporting NTP time corresponding to the reporting RTP time, wherein the reporting NTP time refers to the NTP time reported by the sender;
calculating the relative time difference and 2 32 Obtaining the NTP time difference by the product of the above steps;
calculating the sum of the report NTP time and the NTP time difference to obtain a transmission NTP time, wherein the transmission NTP time is the NTP time corresponding to the transmission RTP time and used for transmitting the current frame;
acquiring the NTP time of the current frame, wherein the NTP time refers to the NTP time of the current frame;
and determining the network delay of the current frame according to the sending NTP time and the receiving NTP time.
2. The method of claim 1, wherein the other way of obtaining the NTP time difference comprises:
and shifting the relative time difference by 32 bits to obtain an NTP time difference.
3. The method according to claim 1, wherein said obtaining a reported RTP time for any sender report sent prior to said sent RTP time comprises:
and before acquiring the sending RTP time, acquiring the RTP time reported by one sender closest to the sending RTP time, and obtaining the reported RTP time.
4. The method of claim 1, wherein said determining the network delay of the current frame from the transmit NTP time and the receive NTP time comprises:
and calculating the difference between the received NTP time and the transmitted NTP time to obtain the network time delay of the current frame.
5. The method according to claim 1, wherein the obtaining the RTP time for transmitting the current frame of the streaming media comprises:
acquiring a time stamp of a first data packet in the data packets of the current frame;
and obtaining the RTP time for sending according to the time stamp of the first data packet.
6. The method of claim 5, wherein the obtaining the NTP time of receipt of the current frame comprises:
and acquiring the NTP time when all the data packets of the current frame are received, and obtaining the NTP time.
7. The method according to claim 1, wherein the method further comprises:
and if the network time delay of the current frame is greater than a preset threshold value, outputting alarm information.
8. The method of claim 7, wherein the method further comprises:
and if the network time delay of the current frame is greater than the preset threshold, controlling the remote control target to stop working.
9. The method of claim 8, wherein the remote control target is an unmanned vehicle, the controlling the remote control target to stop operating, comprising:
and controlling the unmanned vehicle to stop.
10. The method of any one of claims 1 to 9, wherein the streaming media comprises at least one of video and audio.
11. A streaming media network delay determination apparatus, the apparatus comprising:
the transmission RTP time acquisition module is used for acquiring the transmission RTP time of the current frame of the streaming media, wherein the transmission RTP time refers to the transmission time of the current frame acquired according to an RTP protocol data packet;
a report RTP time acquisition module, configured to acquire a report RTP time of any one sender report sent before the sending RTP time, where the report RTP time refers to an RTP time of the sender report acquired according to an RTCP protocol;
a sending NTP time determining module, configured to determine a time difference between the sending RTP time and the reporting RTP time, to obtain a relative time difference; acquiring reporting NTP time corresponding to the reporting RTP time, wherein the reporting NTP time refers to the NTP time reported by the sender; calculating the relative time difference and 2 32 Obtaining the NTP time difference by the product of the above steps; calculating the sum of the report NTP time and the NTP time difference to obtain a transmission NTP time, wherein the transmission NTP time is the NTP time corresponding to the transmission RTP time and used for transmitting the current frame;
a received NTP time determining module, configured to obtain a received NTP time of the current frame, where the received NTP time refers to an NTP time of receiving the current frame;
and the time delay determining module is used for determining the network time delay of the current frame according to the sending NTP time and the receiving NTP time.
12. The apparatus of claim 11, wherein the reporting RTP time acquisition module comprises:
a relative time difference determining unit, configured to determine a time difference between the sending RTP time and the reporting RTP time, to obtain a relative time difference;
a report NTP time determining unit, configured to obtain a report NTP time corresponding to the report RTP time, where the report NTP time refers to an NTP time reported by the sender;
and the sending NTP time determining unit is used for determining the sending NTP time according to the reported NTP time and the relative time difference.
13. The apparatus as recited in claim 12, further comprising:
And the control module is used for controlling the remote control target to stop working if the network time delay of the current frame is greater than a preset threshold value.
14. A computer readable storage medium having stored thereon a computer program, which when executed by a processor implements the steps of the streaming media network delay determination method according to any of claims 1 to 10.
15. A computer device comprising a memory and a processor, wherein the memory has stored therein computer readable instructions that, when executed by the processor, cause the processor to perform the streaming network latency determination method of any of claims 1 to 10.
16. A remote driving system, comprising:
the unmanned vehicle is provided with an image acquisition device for acquiring streaming media;
the NTP server is in communication connection with the image acquisition device;
the remote control device is in communication connection with the image acquisition device and the NTP server, and is used for acquiring the sending RTP time of the current frame of the streaming media, and the sending RTPThe time refers to the sending time of the current frame acquired according to the RTP protocol data packet; acquiring the report RTP time of any sender report sent before the sending RTP time, wherein the report RTP time refers to the RTP time of the sender report acquired according to an RTCP protocol; determining the time difference between the sending RTP time and the reporting RTP time to obtain a relative time difference; acquiring reporting NTP time corresponding to the reporting RTP time, wherein the reporting NTP time refers to the NTP time reported by the sender; calculating the relative time difference and 2 32 Obtaining the NTP time difference by the product of the above steps; calculating the sum of the report NTP time and the NTP time difference to obtain a transmission NTP time, wherein the transmission NTP time is the NTP time corresponding to the transmission RTP time and used for transmitting the current frame; acquiring the NTP time of the current frame, wherein the NTP time refers to the NTP time of the current frame; and determining the network delay of the current frame according to the sending NTP time and the receiving NTP time.
17. The remote driving system of claim 16, wherein the remote control device is further configured to control the unmanned vehicle to park if the network delay of the current frame is greater than a preset threshold.
CN202080003164.3A 2020-02-12 2020-02-12 Streaming media network time delay determining method and device, computer equipment, readable storage medium and remote driving system Active CN113519146B (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2020/074924 WO2021159329A1 (en) 2020-02-12 2020-02-12 Streaming media network latency determination method and apparatus, computer device, readable storage medium, and remote driving system

Publications (2)

Publication Number Publication Date
CN113519146A CN113519146A (en) 2021-10-19
CN113519146B true CN113519146B (en) 2023-06-23

Family

ID=77291923

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202080003164.3A Active CN113519146B (en) 2020-02-12 2020-02-12 Streaming media network time delay determining method and device, computer equipment, readable storage medium and remote driving system

Country Status (2)

Country Link
CN (1) CN113519146B (en)
WO (1) WO2021159329A1 (en)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113965488B (en) * 2021-09-10 2023-05-23 北京百度网讯科技有限公司 Method and device for obtaining delay of data packet, electronic device and storage medium
CN113904959B (en) * 2021-11-02 2023-04-07 广州小鹏自动驾驶科技有限公司 Time delay analysis method and device, vehicle and storage medium
CN115174979B (en) * 2022-06-20 2023-12-29 阿里巴巴(中国)有限公司 Streaming media transmission network, transmission control method, device, equipment and storage medium
CN115333961B (en) * 2022-06-30 2023-10-13 北京邮电大学 Wireless communication network management and control method based on deep reinforcement learning and related equipment

Family Cites Families (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3724779B2 (en) * 1998-12-21 2005-12-07 Jfe炉材株式会社 Circular cross-section lance pipe and method of forming the same
US7639716B2 (en) * 2003-07-04 2009-12-29 University College Dublin, National University Of Ireland, Dublin System and method for determining clock skew in a packet-based telephony session
KR100565333B1 (en) * 2004-06-22 2006-03-30 엘지전자 주식회사 A method and a apparatus of synchronization video signal with audio signal for mobile phone
JP2008167351A (en) * 2007-01-04 2008-07-17 Toshiba Corp Terminal device
JP5074834B2 (en) * 2007-06-29 2012-11-14 沖電気工業株式会社 Audio / video synchronization method, audio / video synchronization system, and audio / video receiving terminal
CN101123611B (en) * 2007-09-25 2012-05-23 中兴通讯股份有限公司 A transmission method for stream media data
CN101282482B (en) * 2008-05-04 2011-05-11 中兴通讯股份有限公司 Apparatus, system and method for synchronously playing video data and audio data
CN102202070A (en) * 2010-03-23 2011-09-28 冯思雅 Fast inter-stream synchronization mechanism for streaming media
CN107453936A (en) * 2016-06-01 2017-12-08 中兴通讯股份有限公司 A kind of method and gateway device for diagnosing voice delay time
EP3591908B9 (en) * 2017-03-23 2022-04-06 Huawei Technologies Co., Ltd. Method and device for lip-speech synchronization among multiple devices
CN109017757B (en) * 2018-08-22 2020-05-19 吉林大学 Automobile remote designated driving method and system
CN109189567B (en) * 2018-08-30 2021-10-08 百度在线网络技术(北京)有限公司 Time delay calculation method, device, equipment and computer readable storage medium
CN109151611B (en) * 2018-09-21 2020-09-08 深圳市璇玑实验室有限公司 HEVC real-time video transmission control method based on RTP/RTCP
CN109286813B (en) * 2018-11-14 2020-06-05 北京奇艺世纪科技有限公司 Video communication quality detection method and device

Also Published As

Publication number Publication date
CN113519146A (en) 2021-10-19
WO2021159329A1 (en) 2021-08-19

Similar Documents

Publication Publication Date Title
CN113519146B (en) Streaming media network time delay determining method and device, computer equipment, readable storage medium and remote driving system
CN113273105B (en) Method for time synchronization of a plurality of auxiliary devices of an autonomous vehicle, computer device and storage medium
CN113259042B (en) Clock reference synchronization method, device, equipment and storage medium between multiple equipment
CN111741276B (en) Method for sending key frame by video equipment, video equipment and storage device
CN101808167B (en) Method for procedure tracking, device and system
US10021182B2 (en) Method and apparatus for data synchronization
US9031679B2 (en) Methods, systems, and computer readable media for utilizing a plurality of pre-encoded payloads to generate a packet stream transmission
CN103701658A (en) Network condition testing method and device for articulated naturality web
CN111343415A (en) Data transmission method and device
CN111148211A (en) Clock synchronization method and device, computer equipment and storage medium
CN105490798A (en) Synchronization method and synchronization system for standard time and fighting time of cross-platform terminals of multiple types
CN107566794B (en) Video data processing method and system and terminal equipment
CN106603518A (en) Time stamp generating method and time stamp generating device of real-time transmission protocol system
CN107395307A (en) A kind of clock synchronizing method and equipment
CN109699068B (en) Base station synchronization method and device
CN112565224A (en) Video processing method and device
KR101044065B1 (en) Method for Synchronizing Time in IPTV Service Network
CN113747208B (en) Audio and video data synchronization method, server side and receiving side
CN112203063B (en) Distributed implementation method and system for video networking and electronic equipment
CN111314629B (en) OSD information superposition method and device
CN113519153B (en) Image acquisition method, image acquisition device, control device, computer equipment, readable storage medium, image acquisition equipment and remote driving system
CN115225775B (en) Multichannel delay correction method and device and computer equipment
US9253744B2 (en) Method for transmitting information to synchronize a use between a mobile telephone and a receiver
CN114124659B (en) Data processing method and device
CN117979112A (en) National standard registration plug flow method, device, system and computer readable storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant