CN114390346B - Media resource processing method and device for converting RTSP (real time streaming protocol) into RTMP (real time streaming protocol) - Google Patents
Media resource processing method and device for converting RTSP (real time streaming protocol) into RTMP (real time streaming protocol) Download PDFInfo
- Publication number
- CN114390346B CN114390346B CN202011122783.2A CN202011122783A CN114390346B CN 114390346 B CN114390346 B CN 114390346B CN 202011122783 A CN202011122783 A CN 202011122783A CN 114390346 B CN114390346 B CN 114390346B
- Authority
- CN
- China
- Prior art keywords
- data frames
- data
- data frame
- sequence
- preset
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 13
- 239000000872 buffer Substances 0.000 claims abstract description 78
- 238000000034 method Methods 0.000 claims abstract description 55
- 238000012545 processing Methods 0.000 claims abstract description 29
- 238000004891 communication Methods 0.000 claims description 3
- 238000000605 extraction Methods 0.000 claims description 2
- 238000012163 sequencing technique Methods 0.000 claims description 2
- 230000008569 process Effects 0.000 abstract description 19
- 238000010586 diagram Methods 0.000 description 7
- 238000006243 chemical reaction Methods 0.000 description 6
- 238000004590 computer program Methods 0.000 description 6
- 230000008901 benefit Effects 0.000 description 4
- 230000005540 biological transmission Effects 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 3
- 230000006870 function Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000004044 response Effects 0.000 description 2
- 230000001960 triggered effect Effects 0.000 description 2
- 230000003139 buffering effect Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
- H04N21/440218—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by transcoding between formats or standards, e.g. from MPEG-2 to MPEG-4
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
- H04L69/08—Protocols for interworking; Protocol conversion
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/85—Assembly of content; Generation of multimedia applications
- H04N21/854—Content authoring
- H04N21/8547—Content authoring involving timestamps for synchronizing content
Abstract
The invention discloses a media resource processing method and a device for converting RTSP into RTMP, which relate to the technical field of video processing and optimize the processing process of converting RTSP into RTMP, and the method comprises the following steps: when streaming video data is acquired through an RTSP protocol, respectively adding decoding time stamps to at least two data frames according to the sequence of the at least two data frames which are continuously received; storing at least two data frames into a preset data frame buffer chain table, wherein the at least two data frames are ordered according to the sequence of the corresponding original time stamps in the preset data frame buffer chain table; determining display time stamps corresponding to the at least two data frames according to the ordering positions corresponding to the at least two data frames; calculating the offset corresponding to the data frame according to the decoding time stamp and the display time stamp corresponding to the data frame, and adding the offset into the message header information of the data frame; and successively extracting the data frames pointed by the head pointers from the preset data frame buffer chain table, and pushing the data frames to a server supporting the RTMP protocol.
Description
Technical Field
The invention relates to the technical field of video processing, in particular to a media resource processing method and device for converting RTSP into RTMP.
Background
In the field of video processing technology, there are real-time streaming protocol (Real Time Streaming Protocol, RTSP) formatted video streams, real-time messaging protocol (Real Time Messaging Protocol, RTMP) formatted video streams. In the development of streaming media, a problem of protocol conversion is often encountered, for example, a video camera often supports an RTSP protocol, but in fact, the RTMP protocol is a protocol supported by a playing end server, so that conversion between protocols is required to achieve better compatibility and consistency of subsequent service flows.
At present, different streaming media protocol conversion is also actually needed. However, the existing RTSP-RTMP protocol process is complicated and complicated, resulting in low processing efficiency, and how to find a specific implementation method for simply and efficiently completing the conversion process is urgent to be further researched and developed.
Disclosure of Invention
In view of this, the present invention provides a method and apparatus for processing media resources from RTSP to RTMP, which is mainly aimed at optimizing the RTSP-to-RTMP process, and obtaining the offset corresponding to each data frame in the streaming video data with simple operation and high efficiency, so as to ensure the correctness of playing the streaming video data at the playing end when the data frames contained in the streaming video data are pushed to the server supporting the RTMP one by one.
In order to achieve the above purpose, the present invention mainly provides the following technical solutions:
in one aspect, the present invention provides a method for processing media resources from RTSP to RTMP, where the method includes:
when streaming video data is acquired through an RTSP protocol, respectively adding decoding time stamps to at least two data frames according to the sequence of the at least two data frames which are continuously received;
storing the at least two data frames into a preset data frame buffer chain table, wherein the at least two data frames are ordered according to the sequence of the corresponding original time stamps in the preset data frame buffer chain table;
determining display time stamps corresponding to the at least two data frames according to the ordering positions corresponding to the at least two data frames;
calculating the offset corresponding to the data frame according to the decoding timestamp and the display timestamp corresponding to the data frame, and adding the offset into the header information of the data frame;
and successively extracting data frames pointed by the head pointers from the preset data frame buffer chain list, and pushing the data frames to a server supporting the RTMP protocol.
Optionally, after the streaming video data is acquired through the RTSP protocol, the method further includes:
Obtaining a frame rate corresponding to the streaming video data by analyzing an image parameter group message corresponding to the streaming video data;
and calculating the time interval between receiving every two adjacent data frames according to the frame rate.
Optionally, the adding decoding time stamps to the at least two data frames according to the sequence of the at least two data frames continuously received respectively includes:
adding sequence numbers N to at least two data frames one by one according to the sequence of receiving the at least two data frames, wherein the initial value of the sequence number N is 0 and an integer;
acquiring the time interval between every two adjacent data frames;
using the product of the time interval and the sequence number N as the decoding time of the data frame corresponding to the sequence number N;
and adding a decoding time stamp to the data frame corresponding to the sequence number N according to the decoding time.
Optionally, the storing the at least two data frames in a preset data frame buffer linked list includes:
acquiring the at least two corresponding original timestamps by analyzing the message header information of the at least two respective data frames;
adding the at least two data frames to a preset data frame buffer chain table;
Determining whether the number of the data frames in the preset data frame buffer chain table reaches a preset threshold value;
and responding to the existing data frame number reaching a preset threshold, and triggering the at least two data frames to be ordered according to the sequence of the corresponding original time stamps by comparing the original time stamps corresponding to the at least two data frames.
Optionally, the triggering the at least two data frames to sort according to the sequence of the corresponding original timestamps by comparing the original timestamps corresponding to the at least two data frames includes:
and according to the sequence of the original timestamps corresponding to the at least two data frames, sequencing the at least two data frames in the preset data frame buffer linked list by using a binary sequence, wherein the original timestamps of the head pointers pointing to the data frames in the preset data frame buffer linked list are earlier than the original timestamps corresponding to other data frames.
Optionally, the determining, according to the ordering positions corresponding to the at least two data frames, display time stamps corresponding to the at least two data frames respectively includes:
respectively adding sequence numbers M to the at least two data frames one by one in a preset data frame buffer chain table by taking the start point of a head pointer to the data frames as the start point, wherein the initial value of the sequence number M is 0 and is an integer;
Acquiring the time interval between every two adjacent data frames;
using the product of the time interval and the sequence number M as the decoding time of the data frame corresponding to the sequence number M;
and adding a display time stamp to the data frame corresponding to the serial number M according to the display time.
On the other hand, the invention also provides a media resource processing device for converting RTSP into RTMP, which comprises:
the adding unit is used for respectively adding decoding time stamps to at least two data frames according to the sequence of the at least two data frames which are continuously received when streaming video data is acquired through an RTSP protocol;
the storage unit is used for storing the at least two data frames into a preset data frame buffer chain table, wherein the at least two data frames are ordered according to the sequence of the corresponding original time stamps in the preset data frame buffer chain table;
the determining unit is used for determining display time stamps corresponding to the at least two data frames respectively according to the ordering positions corresponding to the at least two data frames stored in the storage unit;
a calculating unit, configured to calculate an offset corresponding to the data frame according to the decoding timestamp added by the adding unit corresponding to the data frame and the display timestamp determined by the determining unit;
The adding unit is further configured to add the offset obtained by the calculating unit to header information of the data frame;
the extraction unit is used for successively extracting the data frames pointed by the head pointers from the preset data frame buffer chain list;
and the pushing unit is used for pushing the data frames extracted by the extracting unit to a server supporting the RTMP protocol.
Optionally, the apparatus further includes:
the acquisition unit is used for acquiring the frame rate corresponding to the streaming video data by analyzing the image parameter group message corresponding to the streaming video data;
the calculating unit is further configured to calculate a time interval between receiving every two adjacent data frames according to the frame rate acquired by the acquiring unit.
Optionally, the adding unit includes:
the first adding module is used for adding sequence numbers N to at least two data frames one by one according to the sequence of receiving the at least two data frames, wherein the initial value of the sequence number N is 0 and an integer;
an acquisition module, configured to acquire a time interval between every two adjacent data frames;
the execution module is used for taking the product of the time interval acquired by the acquisition module and the sequence number N added by the first adding module as the decoding time of the data frame corresponding to the sequence number N;
And the second adding module is used for adding a decoding time stamp to the data frame corresponding to the sequence number N according to the decoding time obtained by the executing module.
Optionally, the storage unit includes:
the acquisition module is used for acquiring the at least two corresponding original timestamps by analyzing the message header information of the at least two respective data frames;
the adding module is used for adding the at least two data frames to a preset data frame buffer chain table;
the determining module is used for determining whether the number of the data frames added by the adding module in the preset data frame buffer chain list reaches a preset threshold value;
and the execution module is used for responding to the determination module to determine that the number of the existing data frames reaches a preset threshold value, and triggering the at least two data frames to be ordered according to the sequence of the corresponding original time stamps by comparing the original time stamps corresponding to the at least two data frames.
Optionally, the executing module is further configured to execute sorting on the at least two data frames in the preset data frame buffer linked list by using a binary sorting according to the sequence of the at least two data frames corresponding to the original timestamps, where the original timestamps of the head pointers pointing to the data frames in the preset data frame buffer linked list are earlier than the original timestamps corresponding to other data frames.
Optionally, the determining unit includes:
the first adding module is used for adding sequence numbers M to the at least two data frames one by one in a preset data frame buffer chain table by taking the point of a head pointer to the data frames as the start, wherein the initial value of the sequence number M is 0 and an integer;
an acquisition module, configured to acquire a time interval between every two adjacent data frames;
the execution module is used for taking the product of the time interval acquired by the acquisition module and the sequence number M added by the first adding module as the decoding time of the data frame corresponding to the sequence number M;
and the second adding module is used for adding a display time stamp to the data frame corresponding to the serial number M according to the display time obtained by the executing module.
In still another aspect, the present invention further provides a non-transitory computer readable storage medium, where the storage medium includes a stored program, where when the program runs, the device where the storage medium is controlled to execute a media resource processing method of the RTSP to RTMP protocol as described above.
In yet another aspect, the present invention further provides an electronic device, the device including at least one processor, and at least one memory, bus, connected to the processor;
The processor and the memory complete communication with each other through the bus;
the processor is configured to call the program instructions in the memory to execute the media resource processing method of RTSP to RTMP protocol as described above.
By means of the technical scheme, the technical scheme provided by the invention has at least the following advantages:
when streaming video data is acquired through the RTSP protocol, decoding time stamps are added one by one according to the sequence of continuously receiving at least two data frames, then a preset data frame buffer chain table is utilized to store and reorder the received data frames, and the reordering is carried out according to the sequence of the original time stamp of each data frame, so that the display time stamp corresponding to each data frame is conveniently and efficiently calculated according to the reordering, after the decoding time stamp and the display time stamp corresponding to the data frame are obtained, the offset is added into the data frame header information, and the media resource processing process of the RTSP-RTMP protocol is realized at the streaming terminal. Compared with the prior art, the method and the device solve the technical problems that the existing RTSP-RTMP protocol conversion process is complicated and complicated, and can be operated simply and processed efficiently in the RTSP-RTMP protocol conversion process to acquire the offset corresponding to each data frame in the streaming video data, so that the accuracy of playing the streaming video data by a playing end is ensured when the data frames contained in the streaming video data are pushed to a server supporting the RTMP protocol successively.
The foregoing description is only an overview of the present invention, and is intended to be implemented in accordance with the teachings of the present invention in order that the same may be more clearly understood and to make the same and other objects, features and advantages of the present invention more readily apparent.
Drawings
Various other advantages and benefits will become apparent to those of ordinary skill in the art upon reading the following detailed description of the preferred embodiments. The drawings are only for purposes of illustrating the preferred embodiments and are not to be construed as limiting the invention. Also, like reference numerals are used to designate like parts throughout the figures. In the drawings:
FIG. 1 is a flowchart illustrating a method for processing media resources according to an RTSP-to-RTMP protocol according to one or more embodiments of the present invention;
FIG. 2 is a flowchart illustrating another method for processing media resources according to an RTSP-to-RTMP protocol according to one or more embodiments of the present invention;
FIG. 3 illustrates a pre-set linked list of data frame buffers in accordance with one or more embodiments of the present invention;
FIG. 4 is a block diagram illustrating a media resource handling device for converting RTSP into RTMP according to one or more embodiments of the present invention;
FIG. 5 is a block diagram illustrating another exemplary RTSP-to-RTMP media asset processing device according to one or more embodiments of the present invention;
FIG. 6 is a block diagram of an electronic device for media asset handling in RTSP-to-RTMP protocol according to one or more embodiments of the present invention.
Detailed Description
Exemplary embodiments of the present invention will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the present invention are shown in the drawings, it should be understood that the present invention may be embodied in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art.
One or more embodiments of the present invention provide a method for processing media resources from RTSP to RTMP, as shown in fig. 1, where the method can simply operate and efficiently obtain an offset corresponding to each data frame in streaming video data during the process of processing from RTSP to RTMP, and for this one or more embodiments of the present invention provide the following specific steps:
101. when streaming video data is acquired through an RTSP protocol, decoding time stamps are respectively added to at least two data frames according to the sequence of the at least two data frames which are continuously received.
The method provided by one or more embodiments of the present invention is applied to a push server, and the push server is used as a client to obtain streaming video data through an RTSP protocol, for example, obtain live video data of an infrared camera. During the process of obtaining the streaming video data, that is, a plurality of data frames of the streaming video data, are continuously sent to the push end.
In one or more embodiments of the present invention, during the process of obtaining streaming video data, that is, continuously receiving data frames pushed to a push end, validity detection may be performed on the data frames (H264 data stream needed by RTMP is split), and decoding timestamps (Decode Time Stamp, DTS) are added to the data frames according to the sequence in which the push end receives the plurality of data frames.
102. Storing at least two data frames into a preset data frame buffer chain table, wherein the at least two data frames are ordered according to the sequence of the corresponding original time stamps in the preset data frame buffer chain table.
It should be noted that, for one or more embodiments of the present invention, the client and the push end are equivalent to transmitting a data packet at a data link layer, and for transmitting the data packet, the data frame is randomly transmitted to the push end, that is, the client and the push end cannot form the streaming video data of the complete playing sequence according to the sequence of receiving the data frame by the push end. Therefore, the push end continuously acquires the data frames according to the time sequence, but the data frames need to be reordered to obtain the streaming video data which is suitable for the playing sequence.
In one or more embodiments of the present invention, at the push end, the continuously acquired data frames are stored in a preset data frame buffer linked list, so that according to the characteristics of the linked list structure (i.e., the logic sequence of the data elements is realized by the pointer link sequence in the linked list), the re-ordering of the data frames buffered in the linked list is conveniently realized, and the rule according to which the ordering is performed is that: and executing the sorting according to the sequence of the original time stamps corresponding to the data frames, and further leading the original time stamps of the data frames pointed by the head pointers in the linked list to be earlier than the original time stamps corresponding to other data frames.
It should be noted that the original timestamp corresponds to an identification of each data frame according to the playing order of the streaming video data, and is stored in header information of the data frame. Therefore, after the sorting is performed according to the sequence of the original time stamps, the sorting of the plurality of data frames in the preset data frame buffer chain table is consistent with the playing sequence of the streaming video data.
103. And determining the display time stamp corresponding to each of the at least two data frames according to the ordering positions corresponding to the at least two data frames.
In one or more embodiments of the present invention, a display timestamp (Presentation Time Stamp) corresponding to each data frame is calculated in the preset data frame buffer linked list according to a sorting position corresponding to each data frame, where the display timestamp is used to represent a sequence in which a plurality of data frames in the preset data frame buffer linked list are displayed, and the sequence is consistent with a play sequence of streaming video data.
104. And calculating the offset corresponding to the data frame according to the decoding time stamp and the display time stamp corresponding to the data frame, and adding the offset into the header information of the data frame.
In one or more embodiments of the invention, the offset d=pts-DTS of the data frames, i.e. the offset of each data frame is equal to the difference between its display time stamping time and decoding time stamping time. When the data frame is pushed to the server supporting the RTMP protocol, the server side supporting the RTMP protocol analyzes the header information of the data frame to obtain the offset, and then the corresponding display time can be obtained according to the decoding time marked by the decoding time stamp of the data frame.
105. And successively extracting the data frames pointed by the head pointers from the preset data frame buffer chain table, and pushing the data frames to a server supporting the RTMP protocol.
In one or more embodiments of the present invention, the data frames pointed by the head pointer are extracted from the preset data frame buffer linked list, and accordingly, the preset data frame buffer linked list deletes one data frame, and since the data frames are extracted from the preset data frame buffer linked list successively according to the characteristics of the linked list structure (the logic sequence of the data elements is realized through the pointer link sequence in the linked list), the data frames are extracted one by one according to the order obtained in step 102 in the preset data frame buffer linked list, and are pushed to the server supporting the RTMP protocol. Since the header information of each data frame has been updated to add an offset, the streaming video data can be properly played according to the offset at the server side supporting the RTMP protocol.
One or more embodiments of the present invention provide a media resource processing method for converting RTSP into RTMP protocol, where the one or more embodiments of the present invention are applied to a streaming end, when streaming video data is acquired through RTSP protocol, decoding timestamps are added one by one according to the sequence of continuously receiving at least two data frames, then a preset data frame buffer chain table is used to store and reorder the received multiple data frames, and since the reordering is performed according to the sequence of original timestamps of each data frame, it is convenient to calculate a display timestamp corresponding to each data frame according to the reordering, after the decoding timestamp and the display timestamp corresponding to the data frame are obtained, an offset is conveniently and efficiently calculated, and then the offset is added into the header information of the data frame, so as to implement the media resource processing procedure for converting RTSP into RTMP protocol at the streaming end. Compared with the prior art, the method solves the technical problems that the process of converting the RTSP into the RTMP is complicated and complicated, and one or more embodiments of the invention can be operated simply and processed efficiently to acquire the offset corresponding to each data frame in the streaming video data in the process of converting the RTSP into the RTMP, thereby ensuring the correctness of the streaming video data played by a playing end when the data frames contained in the streaming video data are pushed to a server supporting the RTMP successively.
To make a more detailed description of the above embodiments, one or more embodiments of the present invention further provide another media resource processing method of RTSP to RTMP protocol, as shown in fig. 2, which further states a specific implementation method for efficiently adding a decoding timestamp and a display timestamp to a data frame, so as to obtain a corresponding offset efficiently, where the one or more embodiments of the present invention provide the following specific steps:
201. and obtaining the frame rate corresponding to the streaming video data by analyzing the image parameter set message corresponding to the streaming video data.
In one or more embodiments of the present invention, corresponding to the streaming video data acquired by the streaming end, an image parameter set (Picture Parameter Set, PPS) packet of the streaming video data may be acquired in advance, and the frame rate of the transmission data frame corresponding to the streaming video data may be acquired by parsing the PPS packet.
202. The time interval between receiving every two adjacent data frames is calculated from the frame rate.
In one or more embodiments of the present invention, after the corresponding transmission frame rate of the streaming video data is obtained, a time interval between every two adjacent data frames received can be calculated, for example, the frame rate is R, and the time interval t1=1/R is 1000ms.
203. And respectively adding decoding time stamps to the at least two data frames according to the sequence of the at least two data frames which are continuously received.
In one or more embodiments of the invention, a refinement of this step may include the following:
firstly, according to the sequence of receiving at least two data frames, adding sequence numbers N to the at least two data frames one by one, wherein the initial value of the sequence numbers N is 0 and an integer. The first received data frame is marked with 0, namely the initial addition sequence number is 0 instead of 1, the second data frame which is continuously received is marked with 1, the sequence numbers are increased by 1 according to the sequence number, then the sequence numbers are added one by one according to the received data frames,
next, a time interval between every two adjacent data frames is obtained, where the time interval is already calculated in step 202, and the product of the time interval and the sequence number N is used as a decoding time of the data frame corresponding to the sequence number N, and further, according to the decoding time, a decoding timestamp is added to the data frame corresponding to the sequence number N.
In one or more embodiments of the present invention, the sequence number of the first data frame is equal to the initial value 0 when the sequence number is added to the data frame based on the received first data frame, and the sequence number is added with the sequence number 1 from the second data frame and then sequentially increased by 1, so that the product of the time interval and the sequence number N is utilized, that is, based on the decoding time of the first data frame, and then how many intervals exist between other data frames and the first data frame, the decoding time corresponding to other data frames can be determined efficiently, and thus the decoding time stamp corresponding to other data frames can be determined simply and efficiently.
It should be noted that, in one or more embodiments of the present invention, a buffer queue may be created in advance, for storing data frames that are continuously received, so that it is convenient to add a sequence number to each data frame in the order stored in the buffer queue.
204. Storing at least two data frames into a preset data frame buffer chain table, wherein the at least two data frames are ordered according to the sequence of the corresponding original time stamps in the preset data frame buffer chain table.
In one or more embodiments of the invention, a refinement of this step may include the following:
firstly, at least two corresponding original time stamps are obtained by analyzing the message header information of at least two respective data frames. The original timestamp corresponds to the identification of each data frame according to the playing sequence of the streaming video data, and is stored in the header information of the data frame. Therefore, after the sorting is performed according to the sequence of the original time stamps, the sorting of the plurality of data frames in the preset data frame buffer chain table is consistent with the playing sequence of the streaming video data.
Secondly, at least two data frames are added to a preset data frame buffer chain table, and the characteristics of the chain table structure (namely, the logic sequence of the data elements is realized through the pointer link sequence in the chain table) are utilized to facilitate the storage of the data frames ordered according to the receiving sequence and the subsequent re-ordering of the data frames.
Furthermore, in one or more embodiments of the present invention, a trigger mechanism for performing reordering may be preset for the preset data frame buffer linked list, that is: determining whether the number of the data frames existing in the preset data frame buffer chain table reaches a preset threshold value, and triggering to execute the reordering operation in response to the number of the data frames existing reaching the preset threshold value.
In one or more embodiments of the present invention, by comparing original timestamps corresponding to a plurality of data frames, the plurality of data frames are triggered to be ordered according to the sequence of the corresponding original timestamps, specifically, but not limited to, a binary ordering method is used to perform the ordering operation, and the obtained reordering is: the original time stamp of the head pointer pointing to the data frame in the preset data frame buffer chain table is earlier than the original time stamp corresponding to other data frames.
As illustrated in fig. 3, a "1" in the data frame buffer chain table corresponds to a sequence number N added when a data frame is received, "Timestamp L" is an original Timestamp, and the "L" is a positive integer, which is merely used to represent the number of the measured original timestamps, and the smaller the "L" is, the earlier the original Timestamp is, after reordering is performed, the "RTSP data frame 0" is reordered between the "RTSP data frame 3" and the "RTSP data frame 2" because the original Timestamp "Timestamp3" is ordered between the "Timestamp2" and the "Timestamp 4".
205. And determining the display time stamp corresponding to each of the at least two data frames according to the ordering positions corresponding to the at least two data frames.
In one or more embodiments of the invention, a refinement of this step may include the following:
firstly, starting with a head pointer pointing to a data frame in a preset data frame buffer chain table, adding sequence numbers M to at least two data frames one by one, wherein the initial value of the sequence numbers M is 0 and an integer.
Next, a time interval between every two adjacent data frames is obtained, where the time interval is already calculated in step 202, and the product of the time interval and the sequence number M is used as a display time of the data frame corresponding to the sequence number M, and further, according to the display time, a display timestamp is added to the data frame corresponding to the sequence number M.
It should be noted that, this operation is equivalent to taking the first data frame after reordering as a measurement standard, since the sequence number of the first data frame is 0 as an initial value when the sequence number is added to the data frame, the sequence number is 1 from the second data frame, and then the sequence number is sequentially increased by 1, so that the product of the time interval and the sequence number M is utilized, that is, taking the decoding time of the first data frame as a standard, and then counting how many intervals exist between other data frames and the first data frame, the display time corresponding to other data frames can be determined efficiently, and thus the display time stamp corresponding to other data frames can be determined simply and efficiently.
In connection with steps 203-205 above, a coroutine execution calculation DTS and PTS may be initiated. The steps of executing additionally include: the reordering operation is performed on the ordering of the received data frames. It should be noted that, in order to reduce the time consumption of buffering received data frames and reordering, the upper threshold should be preset for the number of data frames received by the primary buffer of the push end and the number of data frames when reordering is triggered in the preset data buffer chain table, and the threshold should be selected to be as small as possible on the premise of not affecting the processing procedure of the RTSP to RTMP protocol, so as to reduce the processing time delay and help to improve the processing efficiency of the processing procedure of the RTSP to RTMP protocol.
206. And calculating the offset corresponding to the data frame according to the decoding time stamp and the display time stamp corresponding to the data frame, and adding the offset into the header information of the data frame.
In one or more embodiments of the invention, the offset d=pts-DTS of the data frames, i.e. the offset of each data frame is equal to the difference between its display time stamping time and decoding time stamping time. When the data frame is pushed to the server supporting the RTMP protocol, the server side supporting the RTMP protocol analyzes the header information of the data frame to obtain the offset, and then the corresponding display time can be obtained according to the decoding time marked by the decoding time stamp of the data frame.
207. And successively extracting the data frames pointed by the head pointers from the preset data frame buffer chain table, and pushing the data frames to a server supporting the RTMP protocol.
In one or more embodiments of the present invention, the data frames pointed by the head pointer are extracted from the preset data frame buffer linked list, and accordingly, the preset data frame buffer linked list deletes one data frame, and since the data frames are extracted from the preset data frame buffer linked list successively according to the characteristics of the linked list structure (the logic sequence of the data elements is realized through the pointer link sequence in the linked list), the data frames are extracted one by one according to the order obtained in step 204 in the preset data frame buffer linked list, and are pushed to the server supporting the RTMP protocol. Since the header information of each data frame has been updated to add an offset, the streaming video data can be properly played according to the offset at the server side supporting the RTMP protocol.
Further, as an implementation of the methods shown in fig. 1 and fig. 2, one or more embodiments of the present invention provide a media resource processing device that converts RTSP to RTMP protocol. The embodiment of the device corresponds to the embodiment of the method, and for convenience of reading, details of the embodiment of the method are not repeated one by one, but it should be clear that the device in the embodiment can correspondingly realize all the details of the embodiment of the method. The device is applied to a media resource processing process from RTSP to RTMP, and specifically as shown in FIG. 4, the device comprises:
An adding unit 31, configured to, when obtaining streaming video data through an RTSP protocol, respectively add decoding timestamps to at least two data frames according to a sequence of the at least two data frames that are continuously received;
a storage unit 32, configured to store the at least two data frames into a preset data frame buffer linked list, where the at least two data frames are ordered according to the sequence of their corresponding original timestamps;
a determining unit 33, configured to determine display timestamps corresponding to at least two data frames respectively according to ordering positions corresponding to the at least two data frames stored in the storage unit 32;
a calculating unit 34, configured to calculate an offset corresponding to the data frame according to the decoding timestamp added by the adding unit 31 corresponding to the data frame and the display timestamp determined by the determining unit 33;
the adding unit 31 is further configured to add the offset obtained by the calculating unit 34 to header information of the data frame;
an extracting unit 35, configured to extract the data frames pointed by the head pointers from the preset data frame buffer linked list successively;
a pushing unit 36, configured to push the data frame extracted by the extracting unit 35 to a server supporting the RTMP protocol.
Further, as shown in fig. 5, the apparatus further includes:
an obtaining unit 37, configured to obtain a frame rate corresponding to the streaming video data by parsing an image parameter set packet corresponding to the streaming video data;
the calculating unit 34 is further configured to calculate a time interval between receiving every two adjacent data frames according to the frame rate acquired by the acquiring unit 37.
Further, as shown in fig. 5, the adding unit 31 includes:
the first adding module 311 is configured to add, one by one, a sequence number N to at least two data frames according to a sequence of receiving the at least two data frames, where a start value of the sequence number N is 0 and is an integer;
an obtaining module 312, configured to obtain a time interval between every two adjacent data frames;
an execution module 313, configured to use the product of the time interval acquired by the acquisition module and the sequence number N added by the first adding module as a decoding time of a data frame corresponding to the sequence number N;
and a second adding module 314, configured to add a decoding timestamp to the data frame corresponding to the sequence number N according to the decoding time obtained by the executing module 313.
Further, as shown in fig. 5, the storage unit 32 includes:
The obtaining module 321 is configured to obtain the at least two corresponding original timestamps by parsing header information of the at least two respective data frames;
an adding module 322, configured to add the at least two data frames to a preset data frame buffer chain table;
a determining module 323, configured to determine whether the number of data frames added by the adding module 322 in the preset data frame buffer chain table reaches a preset threshold;
an execution module 324, configured to trigger, in response to the determining module 323 determining that the number of existing data frames reaches a preset threshold, the at least two data frames to be ordered according to the sequence of their corresponding original timestamps by comparing the original timestamps corresponding to the at least two data frames.
Further, as shown in fig. 5, the executing module 324 is further configured to execute sorting on the at least two data frames in the preset data frame buffer linked list by using a binary sorting according to the sequence of the at least two data frames corresponding to the original timestamps, where the original timestamps of the head pointers pointing to the data frames in the preset data frame buffer linked list are earlier than the original timestamps corresponding to other data frames.
Further, as shown in fig. 5, the determining unit 33 includes:
the first adding module 331 is configured to add, in a preset data frame buffer chain table, sequence numbers M to the at least two data frames one by one with a start pointer pointing to a data frame as a start, where a start value of the sequence number M is 0 and is an integer;
an acquisition module 332, configured to acquire the time interval between every two adjacent data frames;
an execution module 333, configured to use the product of the time interval acquired by the acquisition module 332 and the sequence number M added by the first adding module 331 as a decoding time of a data frame corresponding to the sequence number M;
the second adding module 334 is configured to add a display timestamp to the data frame corresponding to the sequence number M according to the display time obtained by the executing module 333.
In summary, one or more embodiments of the present invention provide a method and an apparatus for processing media resources of RTSP to RTMP protocol, where one or more embodiments of the present invention are applied to a push streaming end, when streaming video data is acquired through RTSP protocol, decoding timestamps are added one by one according to a sequence of continuously receiving at least two data frames, and then a preset data frame buffer chain table is used to store and reorder the received multiple data frames. Compared with the prior art, the method solves the technical problems that the process of converting the RTSP into the RTMP is complicated and complicated, and one or more embodiments of the invention can be operated simply and processed efficiently to acquire the offset corresponding to each data frame in the streaming video data in the process of converting the RTSP into the RTMP, thereby ensuring the correctness of the streaming video data played by a playing end when the data frames contained in the streaming video data are pushed to a server supporting the RTMP successively.
The media resource processing device for converting RTSP into RTMP comprises a processor and a memory, wherein the adding unit, the storage unit, the determining unit, the calculating unit, the extracting unit, the pushing unit and the like are all stored in the memory as program units, and the processor executes the program units stored in the memory to realize corresponding functions.
The processor includes a kernel, and the kernel fetches the corresponding program unit from the memory. The inner core can be provided with one or more than one, and the process of converting RTSP into RTMP is optimized by adjusting the inner core parameters, so that the offset corresponding to each data frame in the streaming video data can be obtained simply and efficiently in a processing manner, and the accuracy of playing the streaming video data by a playing end is ensured when the data frames contained in the streaming video data are pushed to a server supporting the RTMP one by one.
One or more embodiments of the present invention provide a non-transitory computer readable storage medium having a program stored thereon, which when executed by a processor, implements a media asset processing method of the RTSP to RTMP protocol.
One or more embodiments of the present invention provide a processor, where the processor is configured to run a program, where the program executes the media resource processing method of RTSP to RTMP protocol.
One or more embodiments of the present invention provide an electronic device 40, as shown in FIG. 6, comprising at least one processor 401, and at least one memory 402, bus 403, coupled to the processor 401; wherein, the processor 401 and the memory 402 complete the communication with each other through the bus 403; the processor 401 is configured to call the program instructions in the memory 402 to execute the above-mentioned media resource processing method of RTSP to RTMP protocol.
The device herein may be a server, PC, PAD, cell phone, etc.
The present application also provides a computer program product adapted to perform, when executed on a data processing device, a program initialized with the method steps of: when streaming video data is acquired through an RTSP protocol, respectively adding decoding time stamps to at least two data frames according to the sequence of the at least two data frames which are continuously received; storing the at least two data frames into a preset data frame buffer chain table, wherein the at least two data frames are ordered according to the sequence of the corresponding original time stamps in the preset data frame buffer chain table; determining display time stamps corresponding to the at least two data frames according to the ordering positions corresponding to the at least two data frames; calculating the offset corresponding to the data frame according to the decoding timestamp and the display timestamp corresponding to the data frame, and adding the offset into the header information of the data frame; and successively extracting data frames pointed by the head pointers from the preset data frame buffer chain list, and pushing the data frames to a server supporting the RTMP protocol.
The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
In one typical configuration, the device includes one or more processors (CPUs), memory, and a bus. The device may also include input/output interfaces, network interfaces, and the like.
The memory may include volatile memory, random Access Memory (RAM) and/or nonvolatile memory, such as Read Only Memory (ROM) or flash memory (flashRAM), among other forms in computer readable media, the memory including at least one memory chip. Memory is an example of a computer-readable medium.
Computer readable media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of storage media for a computer include, but are not limited to, phase change memory (PRAM), static Random Access Memory (SRAM), dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), read Only Memory (ROM), electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), digital Versatile Discs (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices, or any other non-transmission medium, which can be used to store information that can be accessed by a computing device. Computer-readable media, as defined herein, does not include transitory computer-readable media (transmission media), such as modulated data signals and carrier waves.
It should also be noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article or apparatus that comprises an element.
It will be appreciated by those skilled in the art that embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The foregoing is merely exemplary of the present application and is not intended to limit the present application. Various modifications and changes may be made to the present application by those skilled in the art. Any modifications, equivalent substitutions, improvements, etc. which are within the spirit and principles of the present application are intended to be included within the scope of the claims of the present application.
Claims (8)
1. A method for processing media resources from RTSP to RTMP, the method comprising:
when streaming video data is acquired through an RTSP protocol, respectively adding decoding time stamps to at least two data frames according to the sequence of the at least two data frames which are continuously received;
after the streaming video data is acquired through the RTSP protocol, acquiring a frame rate corresponding to the streaming video data by analyzing an image parameter group message corresponding to the streaming video data; calculating the time interval between every two adjacent data frames received according to the frame rate;
Storing the at least two data frames into a preset data frame buffer chain table, wherein the at least two data frames are ordered according to the sequence of the corresponding original time stamps in the preset data frame buffer chain table;
determining display time stamps corresponding to the at least two data frames according to the ordering positions corresponding to the at least two data frames, wherein the determining comprises the following steps: respectively adding sequence numbers M to the at least two data frames one by one in a preset data frame buffer chain table by taking the start point of a head pointer to the data frames as the start point, wherein the initial value of the sequence number M is 0 and is an integer; acquiring the time interval between every two adjacent data frames; using the product of the time interval and the sequence number M as the decoding time of the data frame corresponding to the sequence number M; adding a display time stamp to the data frame corresponding to the serial number M according to the display time;
calculating the offset corresponding to the data frame according to the decoding timestamp and the display timestamp corresponding to the data frame, and adding the offset into the header information of the data frame;
and successively extracting data frames pointed by the head pointers from the preset data frame buffer chain list, and pushing the data frames to a server supporting the RTMP protocol.
2. The method according to claim 1, wherein adding decoding time stamps to the at least two data frames in the order of the at least two data frames that are continuously received, respectively, comprises:
adding sequence numbers N to at least two data frames one by one according to the sequence of receiving the at least two data frames, wherein the initial value of the sequence number N is 0 and an integer;
acquiring the time interval between every two adjacent data frames;
using the product of the time interval and the sequence number N as the decoding time of the data frame corresponding to the sequence number N;
and adding a decoding time stamp to the data frame corresponding to the sequence number N according to the decoding time.
3. The method of claim 1, wherein storing the at least two data frames to a preset data frame buffer linked list comprises:
acquiring the at least two corresponding original timestamps by analyzing the message header information of the at least two respective data frames;
adding the at least two data frames to a preset data frame buffer chain table;
determining whether the number of the data frames in the preset data frame buffer chain table reaches a preset threshold value;
And responding to the existing data frame number reaching a preset threshold, and triggering the at least two data frames to be ordered according to the sequence of the corresponding original time stamps by comparing the original time stamps corresponding to the at least two data frames.
4. A method according to claim 3, wherein said triggering the at least two data frames to be ordered in the order of their corresponding original timestamps by comparing the original timestamps corresponding to the at least two data frames comprises:
and according to the sequence of the original timestamps corresponding to the at least two data frames, sequencing the at least two data frames in the preset data frame buffer linked list by using a binary sequence, wherein the original timestamps of the head pointers pointing to the data frames in the preset data frame buffer linked list are earlier than the original timestamps corresponding to other data frames.
5. A media asset processing device for RTSP to RTMP protocol, the device comprising:
the adding unit is used for respectively adding decoding time stamps to at least two data frames according to the sequence of the at least two data frames which are continuously received when streaming video data is acquired through an RTSP protocol;
The acquisition unit is used for acquiring the frame rate corresponding to the streaming video data by analyzing the image parameter group message corresponding to the streaming video data;
the calculating unit is also used for calculating the time interval between every two adjacent data frames according to the frame rate acquired by the acquiring unit;
the storage unit is used for storing the at least two data frames into a preset data frame buffer chain table, wherein the at least two data frames are ordered according to the sequence of the corresponding original time stamps in the preset data frame buffer chain table;
the determining unit is used for determining display time stamps corresponding to the at least two data frames respectively according to the ordering positions corresponding to the at least two data frames stored in the storage unit;
the determination unit includes: the first adding module is used for adding sequence numbers M to the at least two data frames one by one in the preset data frame buffer chain table by taking the start point of the head pointer to the data frames as the start point, wherein the initial value of the sequence number M is 0 and an integer; an acquisition module, configured to acquire a time interval between every two adjacent data frames; the execution module is used for taking the product of the time interval acquired by the acquisition module and the sequence number M added by the first adding module as the decoding time of the data frame corresponding to the sequence number M; the second adding module is used for adding a display time stamp to the data frame corresponding to the serial number M according to the display time obtained by the executing module;
The calculating unit is used for calculating the offset corresponding to the data frame according to the decoding time stamp added by the adding unit corresponding to the data frame and the display time stamp determined by the determining unit;
the adding unit is further configured to add the offset obtained by the calculating unit to header information of the data frame;
the extraction unit is used for successively extracting the data frames pointed by the head pointers from the preset data frame buffer chain list;
and the pushing unit is used for pushing the data frames extracted by the extracting unit to a server supporting the RTMP protocol.
6. The apparatus of claim 5, wherein the storage unit comprises:
the acquisition module is used for acquiring the at least two corresponding original timestamps by analyzing the message header information of the at least two respective data frames;
the adding module is used for adding the at least two data frames to a preset data frame buffer chain table;
the determining module is used for determining whether the number of the data frames added by the adding module in the preset data frame buffer chain list reaches a preset threshold value;
and the execution module is used for responding to the determination module to determine that the number of the existing data frames reaches a preset threshold value, and triggering the at least two data frames to be ordered according to the sequence of the corresponding original time stamps by comparing the original time stamps corresponding to the at least two data frames.
7. A non-transitory computer readable storage medium, wherein the storage medium includes a stored program, wherein the program, when executed, controls a device in which the storage medium is located to perform the media resource processing method of the RTSP to RTMP protocol according to any one of claims 1 to 4.
8. An electronic device comprising at least one processor, and at least one memory, bus, coupled to the processor;
the processor and the memory complete communication with each other through the bus;
the processor is configured to invoke program instructions in the memory to perform the media asset processing method of the RTSP to RTMP protocol as claimed in any of claims 1-4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011122783.2A CN114390346B (en) | 2020-10-20 | 2020-10-20 | Media resource processing method and device for converting RTSP (real time streaming protocol) into RTMP (real time streaming protocol) |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011122783.2A CN114390346B (en) | 2020-10-20 | 2020-10-20 | Media resource processing method and device for converting RTSP (real time streaming protocol) into RTMP (real time streaming protocol) |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114390346A CN114390346A (en) | 2022-04-22 |
| CN114390346B true CN114390346B (en) | 2024-04-12 |
Family
ID=81194177
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011122783.2A Active CN114390346B (en) | 2020-10-20 | 2020-10-20 | Media resource processing method and device for converting RTSP (real time streaming protocol) into RTMP (real time streaming protocol) |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114390346B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116204371B (en) * | 2022-12-13 | 2023-11-24 | 远峰科技股份有限公司 | Monitoring method and device for camera image data stream |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101951312A (en) * | 2010-09-15 | 2011-01-19 | 电信科学技术第五研究所 | E1 link-based bidirectional time-frequency synchronous transmission method and master-slave device |
| CN102123413A (en) * | 2011-03-29 | 2011-07-13 | 杭州电子科技大学 | Network monitoring and protocol analysis system of wireless sensor network |
| CN104660360A (en) * | 2015-02-03 | 2015-05-27 | 电信科学技术第五研究所 | Ethernet data and multi-channel E1 data processing method and system |
| CN105657524A (en) * | 2016-01-13 | 2016-06-08 | 上海视云网络科技有限公司 | Seamless video switching method |
| CN108881958A (en) * | 2017-11-30 | 2018-11-23 | 北京视联动力国际信息技术有限公司 | A kind of multimedia data stream packaging method and device |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7548539B2 (en) * | 2005-03-08 | 2009-06-16 | Audiocodes, Inc. | Method and apparatus for Voice-over-IP call recording |
-
2020
- 2020-10-20 CN CN202011122783.2A patent/CN114390346B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101951312A (en) * | 2010-09-15 | 2011-01-19 | 电信科学技术第五研究所 | E1 link-based bidirectional time-frequency synchronous transmission method and master-slave device |
| CN102123413A (en) * | 2011-03-29 | 2011-07-13 | 杭州电子科技大学 | Network monitoring and protocol analysis system of wireless sensor network |
| CN104660360A (en) * | 2015-02-03 | 2015-05-27 | 电信科学技术第五研究所 | Ethernet data and multi-channel E1 data processing method and system |
| CN105657524A (en) * | 2016-01-13 | 2016-06-08 | 上海视云网络科技有限公司 | Seamless video switching method |
| CN108881958A (en) * | 2017-11-30 | 2018-11-23 | 北京视联动力国际信息技术有限公司 | A kind of multimedia data stream packaging method and device |
Non-Patent Citations (1)
| Title |
|---|
| 基于HLA的转发式数据链仿真平台架构;贾长江;朱承;张维明;;计算机工程(第14期);全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114390346A (en) | 2022-04-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9961398B2 (en) | Method and device for switching video streams | |
| US10984296B2 (en) | Methods and apparatus for identifying objects depicted in a video using extracted video frames in combination with a reverse image search engine | |
| WO2016173279A1 (en) | Image delay detection method and system | |
| CN110832875A (en) | Video processing method, terminal device and machine-readable storage medium | |
| CN112073750B (en) | Remote desktop control method and system | |
| CN108235149B (en) | Method and device for optimizing video playing fluency | |
| CN112261377B (en) | Web edition monitoring video playing method, electronic equipment and storage medium | |
| CN110545472B (en) | Video data processing method and device, electronic equipment and computer readable medium | |
| CN114390346B (en) | Media resource processing method and device for converting RTSP (real time streaming protocol) into RTMP (real time streaming protocol) | |
| CN109511011B (en) | YouTube DASH encrypted video-oriented fingerprint database construction method | |
| CN112261445A (en) | Streaming media playing method, device, equipment and computer readable storage medium | |
| CN113452630B (en) | Data merging method, data splitting method, device, equipment and storage medium | |
| CN114419502A (en) | Data analysis method and device and storage medium | |
| CN112804574A (en) | Multimedia content transmission and playing method and device | |
| CN106201818B (en) | A kind of statistical method and device of application program runing time | |
| CN110471776B (en) | Application data communication method, device and system | |
| CN104469538A (en) | Picture-quality-smaller-loss-oriented RTP video streaming data package recombination method | |
| CN111918142A (en) | Smoothing method, device, equipment and medium for converting national standard video code stream into RTP stream | |
| CN109600563B (en) | Method and apparatus for determining a timestamp | |
| CN115866331A (en) | Video frame extraction analysis method, device, equipment and storage medium | |
| CN113747063B (en) | Video transmission method and device, electronic equipment and readable storage medium | |
| CN113784094A (en) | Video data processing method, gateway, terminal device and storage medium | |
| CN110719496A (en) | Multi-path code stream packaging and playing method, device and system | |
| CN108200481B (en) | RTP-PS stream processing method, device, equipment and storage medium | |
| CN110661751B (en) | Image pickup apparatus and playback apparatus |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |