CN114697303A - Multimedia data processing method and device, electronic equipment and storage medium - Google Patents
Multimedia data processing method and device, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN114697303A CN114697303A CN202210261593.1A CN202210261593A CN114697303A CN 114697303 A CN114697303 A CN 114697303A CN 202210261593 A CN202210261593 A CN 202210261593A CN 114697303 A CN114697303 A CN 114697303A
- Authority
- CN
- China
- Prior art keywords
- time stamp
- streaming media
- frame
- timestamp
- target streaming
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000003672 processing method Methods 0.000 title abstract description 32
- 238000000034 method Methods 0.000 claims abstract description 28
- 238000004590 computer program Methods 0.000 claims description 11
- 230000005856 abnormality Effects 0.000 abstract description 10
- 238000005516 engineering process Methods 0.000 description 5
- 230000005540 biological transmission Effects 0.000 description 4
- 238000010586 diagram Methods 0.000 description 4
- 230000009471 action Effects 0.000 description 3
- 230000008569 process Effects 0.000 description 3
- 108091026890 Coding region Proteins 0.000 description 2
- 230000002159 abnormal effect Effects 0.000 description 2
- 238000003491 array Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/80—Responding to QoS
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
- H04N21/845—Structuring of content, e.g. decomposing content into time segments
- H04N21/8456—Structuring of content, e.g. decomposing content into time segments by decomposing the content in the time domain, e.g. in time segments
Abstract
The embodiment of the invention provides a multimedia data processing method, a device, electronic equipment and a storage medium, wherein the method comprises the following steps: firstly, acquiring a first time stamp in a sequence header of a target streaming media comprising an audio file and/or a video file and a second time stamp of a first frame multimedia frame in a plurality of multimedia frames of the target streaming media; the first timestamp and the second timestamp are then aligned. And because the first time stamp is aligned with the second time stamp, the client can start decoding playing from the first multimedia frame of the streaming media based on the sequence header, so that the problem of playing abnormalities such as playing jam, playing disconnection and the like caused by misalignment of the time stamp of the sequence header of the streaming media and the time stamp of the first multimedia frame of the streaming media in the prior art can be solved, the playing quality of the streaming media of the client can be improved, and the user viewing experience is improved.
Description
Technical Field
The present invention relates to the field of data processing technologies, and in particular, to a multimedia data processing method and apparatus, an electronic device, and a storage medium.
Background
At present, the streaming media transmission technology is widely applied to scenes such as live broadcast, video monitoring and the like, and by using the streaming media transmission technology, the streaming media can be transmitted and played simultaneously, and the playing can be carried out without waiting for the transmission of a multimedia file.
When multimedia is transmitted by using a streaming media transmission technology, a streaming media server typically transmits an AVC (Advanced Audio Coding sequence) sequence header or an AAC (Advanced Audio Coding sequence) sequence header to a client, and then transmits streaming media content. And the client decodes and plays the received streaming media content only after receiving the AVC sequence header or the AAC sequence header.
However, the inventor finds that, in the prior art, when a client decodes and plays streaming media content based on an AVC sequence header or an AAC sequence header transmitted by a streaming media server, problems of playing abnormalities such as playing pause and playing disconnection generally occur, which may reduce the playing quality of the streaming media at the client and affect the viewing experience of the user.
Disclosure of Invention
Embodiments of the present invention provide a multimedia data processing method, an apparatus, an electronic device, and a storage medium, so as to solve the problem of abnormal playing in the prior art, and improve playing quality and user viewing experience. The specific technical scheme is as follows:
in a first aspect, an embodiment of the present invention provides a multimedia data processing method, where the method includes:
acquiring a first time stamp in a sequence header of a target streaming media and a second time stamp of a first frame multimedia frame of the target streaming media, wherein the target streaming media comprises: an audio file and/or a video file;
and aligning the first time stamp and the second time stamp so that the target streaming media is played based on the aligned first time stamp and the aligned second time stamp.
Optionally, obtaining a first timestamp in a sequence header of the target streaming media and a second timestamp of a first frame multimedia frame of the target streaming media includes:
when the target streaming media is not cached in the server, acquiring a sequence head and a first frame multimedia frame from the server in which the target streaming media is cached, and acquiring a first time stamp in the sequence head and a second time stamp of the first frame multimedia frame;
when the target streaming media are cached in the server, acquiring a first time stamp in a sequence header of the target streaming media cached in the server and a second time stamp of a first frame multimedia frame;
aligning the first timestamp and the second timestamp so that the target streaming media is played based on the aligned first timestamp and the aligned second timestamp, comprising:
and aligning the first time stamp and the second time stamp, and sequentially sending the aligned sequence head of the target streaming media and the aligned first frame multimedia frame to the client.
Optionally, after acquiring the sequence header and the first frame multimedia frame from the server in which the target streaming media is cached, and acquiring the first timestamp in the sequence header and the second timestamp of the first frame multimedia frame, the method further includes:
judging whether the first time stamp is the same as the second time stamp;
when the first time stamp is different from the second time stamp, aligning the first time stamp and the second time stamp, and sequentially sending the aligned sequence head of the target streaming media and the aligned first frame multimedia frame to the client;
and when the first time stamp is the same as the second time stamp, sequentially sending the sequence head and the first frame multimedia frame to the client.
Optionally, obtaining a first timestamp in a sequence header of the target streaming media and a second timestamp of a first frame multimedia frame of the target streaming media includes:
acquiring a first time stamp in a sequence header of a target streaming media cached by a client and a second time stamp of a first frame multimedia frame of the target streaming media;
correspondingly, aligning the first timestamp and the second timestamp so that the target streaming media is played based on the aligned first timestamp and the aligned second timestamp, including:
and aligning the first time stamp and the second time stamp, and playing the target streaming media at the client based on the aligned first time stamp and the aligned second time stamp.
Optionally, aligning the first timestamp and the second timestamp, so that the target streaming media is played based on the aligned first timestamp and the aligned second timestamp, including:
modifying a second time stamp of the first frame of multimedia frame into a first time stamp, and modifying the time stamp of each multimedia frame except the first frame of multimedia frame in the plurality of multimedia frames of the target streaming media based on the difference value between the first time stamp and the second time stamp, so that the target streaming media is played based on the plurality of multimedia frames and the sequence header after the time stamps are modified; or
And modifying the first time stamp in the sequence header of the target streaming media into the second time stamp so as to play the target streaming media based on the modified sequence header of the first time stamp and the first frame multimedia frame.
In a second aspect, an embodiment of the present invention provides a multimedia data processing apparatus, including:
an obtaining module, configured to obtain a first timestamp in a sequence header of a target streaming media and a second timestamp of a first frame multimedia frame of the target streaming media, where the target streaming media includes: an audio file and/or a video file;
and the processing module is used for aligning the first time stamp and the second time stamp so as to play the target streaming media based on the aligned first time stamp and the aligned second time stamp.
Optionally, the obtaining module is specifically configured to:
when the target streaming media is not cached in the server, acquiring a sequence head and a first frame multimedia frame from the server in which the target streaming media is cached, and acquiring a first time stamp in the sequence head and a second time stamp of the first frame multimedia frame;
when the target streaming media are cached in the server, acquiring a first time stamp in a sequence header of the target streaming media cached in the server and a second time stamp of a first frame multimedia frame;
the processing module is specifically configured to:
and aligning the first time stamp and the second time stamp, and sequentially sending the aligned sequence header of the target streaming media and the aligned first frame multimedia frame to the client.
Optionally, the apparatus further comprises: the judging module is used for judging whether a first time stamp and a second time stamp of a first frame multimedia frame are the same after acquiring a sequence head and the first frame multimedia frame from a server in which a target streaming media is cached and acquiring the first time stamp in the sequence head and the second time stamp of the first frame multimedia frame;
when the first time stamp is different from the second time stamp, the trigger processing module aligns the first time stamp and the second time stamp and sequentially sends the aligned sequence header of the target streaming media and the aligned first frame multimedia frame to the client;
triggering the sending module when the first time stamp is the same as the second time stamp;
and the sending module is used for sequentially sending the sequence header and the first frame multimedia frame to the client.
Optionally, the obtaining module is specifically configured to:
acquiring a first time stamp in a sequence header of a target streaming media cached by a client and a second time stamp of a first frame multimedia frame of the target streaming media;
the processing module is specifically configured to:
and aligning the first time stamp and the second time stamp, and playing the target streaming media at the client based on the aligned first time stamp and the aligned second time stamp.
Optionally, the processing module is specifically configured to:
modifying a second time stamp of the first frame of multimedia frames into a first time stamp, and modifying the time stamp of each multimedia frame except the first frame of multimedia frames in the plurality of multimedia frames of the target streaming media based on the difference value between the first time stamp and the second time stamp, so that the target streaming media is played based on the plurality of multimedia frames and the sequence head after the time stamps are modified; or
And modifying the first time stamp in the sequence header of the target streaming media into the second time stamp so as to play the target streaming media based on the modified sequence header of the first time stamp and the first frame multimedia frame.
In a third aspect, an embodiment of the present invention further provides an electronic device, including a processor and a machine-readable storage medium, where the machine-readable storage medium stores machine-executable instructions capable of being executed by the processor, and the processor is caused by the machine-executable instructions to: the steps of a multimedia data processing method provided by the above first aspect are implemented.
In a fourth aspect, an embodiment of the present invention further provides a computer-readable storage medium, where a computer program is stored in the computer-readable storage medium, and when the computer program is executed by a processor, the steps of the multimedia data processing method provided in the first aspect are implemented.
In a fifth aspect, embodiments of the present invention further provide a computer program product containing instructions, which when run on a computer, cause the computer to perform the steps of the multimedia data processing method provided in the first aspect.
In a sixth aspect, an embodiment of the present invention further provides a computer program, which, when running on a computer, causes the computer to execute the steps of the multimedia data processing method provided in the first aspect.
According to the multimedia data processing method, the multimedia data processing device, the electronic equipment and the storage medium provided by the embodiment of the invention, a first time stamp in a sequence header of a target streaming media comprising an audio file and/or a video file and a second time stamp of a first frame multimedia frame in a plurality of multimedia frames of the target streaming media can be obtained firstly; the first timestamp and the second timestamp are then aligned. And because the first time stamp is aligned with the second time stamp, the client can start decoding playing from the first multimedia frame of the streaming media based on the sequence header, so that the problem of playing abnormalities such as playing jam, playing disconnection and the like caused by misalignment of the time stamp of the sequence header of the streaming media and the time stamp of the first multimedia frame of the streaming media in the prior art can be solved, the playing quality of the streaming media of the client can be improved, and the user viewing experience is improved. Of course, it is not necessary for any product or method of practicing the invention to achieve all of the above-described advantages at the same time.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
Fig. 1 is a flowchart of a first implementation of a multimedia data processing method according to an embodiment of the present invention;
FIG. 2 is a flowchart illustrating a second exemplary implementation of a method for processing multimedia data according to an embodiment of the present invention;
FIG. 3 is a flowchart illustrating a method for processing multimedia data according to a third embodiment of the present invention;
FIG. 4 is a flowchart illustrating a fourth implementation manner of a multimedia data processing method according to an embodiment of the invention;
FIG. 5 is a block diagram of a multimedia data processing apparatus according to an embodiment of the present invention;
fig. 6 is a schematic structural diagram of an electronic device according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The inventor finds that, in the prior art, when a client decodes and plays streaming media content based on an AVC sequence header or an AAC sequence header transmitted by a streaming media server, generally, due to misalignment between a timestamp in the sequence header and a timestamp of a first frame multimedia frame of the streaming media, the problem of playing abnormality such as pause and disconnection of the streaming media playing may be caused, so that the playing quality of the streaming media at the client may be reduced, and the viewing experience of a user may be affected.
In order to solve the problems in the prior art, embodiments of the present invention provide a multimedia data processing method and apparatus, an electronic device, and a storage medium, so as to reduce false alarms of a gas alarm.
First, a multimedia data processing method according to an embodiment of the present invention is described below, and as shown in fig. 1, a flowchart of a first implementation manner of a multimedia data processing method according to an embodiment of the present invention is shown, where the method may include:
s110, a first time stamp in a sequence header of a target streaming media and a second time stamp of a first frame multimedia frame of the target streaming media are obtained, wherein the target streaming media comprises: an audio file and/or a video file;
and S120, aligning the first time stamp and the second time stamp, so that the target streaming media is played based on the aligned first time stamp and the aligned second time stamp.
In some examples, the target streaming media may be an audio file to be played by the user, a video file to be played by the user, and an audio file played synchronously with the video file.
When a user wants to play a target streaming media, the user can send a play request containing the identification information of the target streaming media to the electronic device to which the multimedia data processing method of the embodiment of the present invention is applied. Therefore, the electronic device may acquire the identification information of the target streaming media, and then acquire the target streaming media based on the identification information of the target streaming media.
When the electronic device acquires the target streaming media, in order to solve the problem in the prior art that playing of the streaming media is abnormal, such as pause and disconnection of playing of the streaming media, due to the fact that the timestamp in the sequence header of the streaming media is not aligned with the timestamp of the first frame multimedia frame of the streaming media, the first timestamp in the sequence header of the target streaming media and the second timestamp of the first frame multimedia frame of the target streaming media can be acquired first. The first timestamp and the second timestamp are then aligned so that the player of the client can play the target streaming media based on the aligned first timestamp and the aligned second timestamp. The first frame multimedia frame may be a first frame image frame or a first frame audio frame, which may be all right.
In some examples, the second timestamp of the first frame multimedia frame may be modified to the first timestamp when the first timestamp is aligned with the second timestamp.
In still other examples, after modifying the second timestamp of the first frame of multimedia frames to the first timestamp, to enable the second to last frames of multimedia frames of the target streaming media to be played in time after the first frame of multimedia frames, and to avoid an excessively long time interval between the second frame of multimedia frames and the first frame of multimedia frames, the timestamp of each multimedia frame of the plurality of multimedia frames of the target streaming media except the first frame of multimedia frames may be modified based on a difference between the first timestamp and the second timestamp. In this way, when the target streaming media is played based on the plurality of multimedia frames and the sequence head after the timestamp is modified, the time difference between every two multimedia frames of the target streaming media remains unchanged, so that the influence of modifying the timestamp of the first multimedia frame on the user viewing experience can be avoided. And the playing quality of the streaming media is ensured.
In some examples, the workload of modifying the timestamp of each multimedia frame of the target streaming media is relatively large, and in order to reduce the time overhead of aligning the first timestamp with the second timestamp, in the embodiment of the present invention, the first timestamp in the sequence header of the target streaming media may be modified into the second timestamp, so that the first timestamp may be aligned with the second timestamp.
The multimedia data processing method provided by the embodiment of the invention can firstly acquire a first time stamp in a sequence header of a target streaming media comprising an audio file and/or a video file and a second time stamp of a first frame multimedia frame in a plurality of multimedia frames of the target streaming media; the first timestamp and the second timestamp are then aligned. And because the first time stamp is aligned with the second time stamp, the client can start decoding playing from the first multimedia frame of the streaming media based on the sequence header, so that the problem of playing abnormalities such as playing jam, playing disconnection and the like caused by misalignment of the time stamp of the sequence header of the streaming media and the time stamp of the first multimedia frame of the streaming media in the prior art can be solved, the playing quality of the streaming media of the client can be improved, and the user viewing experience is improved.
In some examples, a multimedia data processing method according to an embodiment of the present invention may be applied to a server or a client.
When the multimedia data processing method according to the embodiment of the present invention is applied to a server, on the basis of the multimedia data processing method shown in fig. 1, a possible implementation manner is further provided in the embodiment of the present invention, as shown in fig. 2, which is a flowchart of a second implementation manner of the multimedia data processing method according to the embodiment of the present invention, and the method may include:
s210, judging whether the target streaming media is cached in the server, if so, executing the step S220, and if not, executing the step S230; wherein, the target stream media comprises: an audio file and/or a video file;
s220, acquiring a first time stamp in a sequence header of a target streaming media cached in a server and a second time stamp of a first frame multimedia frame;
s230, acquiring a sequence header and a first frame multimedia frame from a server in which a target streaming media is stored, and acquiring a first time stamp in the sequence header and a second time stamp of the first frame multimedia frame;
and S240, aligning the first time stamp and the second time stamp, and sequentially sending the aligned sequence header of the target streaming media and the aligned first frame multimedia frame to the client.
In some examples, the client may display introduction information of multiple streaming media, where the introduction information may include preset pictures related to each streaming media, preset text introduction information, and the like, and a user may select one streaming media based on the introduction information of the streaming media displayed in the client, at this time, the client may acquire identification information of the streaming media selected by the user, then generate an acquisition request based on the identification information of the streaming media selected by the user, and send the acquisition request to the server, and the server may, after acquiring the acquisition request, take the streaming media corresponding to the identification information of the streaming media as a target streaming media.
In still other examples, a user may also search using keywords in a client, which may then send a search request based on the search keywords to a server, which, upon receiving the search request, may search based on the search keywords in the search request. The search results are then returned to the client. So that the user can select a streaming media based on the introductory information in the client that presents the search results.
In some examples, the server may first query whether the target streaming media is cached locally after receiving the acquisition request.
When the target streaming media is cached in the server, step S220 may be executed, that is, a first timestamp in a sequence header of the target streaming media cached in the server and a second timestamp of a first frame multimedia frame are obtained;
when the target streaming media is not cached in the server, step S230 may be executed, that is, the server that caches the target streaming media obtains the sequence header and the first frame multimedia frame of the target streaming media, and obtains the first timestamp in the sequence header and the second timestamp of the first frame multimedia frame.
In some examples, the server may obtain a sequence header and a first frame multimedia frame of the target streaming media from a source station of the target streaming media, and also obtain the sequence header and the first frame multimedia frame of the target streaming media from other servers that cache the target streaming media by using CDN (Content Delivery Network) technology, and obtain a first timestamp in the sequence header and a second timestamp of the first frame multimedia frame.
After obtaining the first timestamp in the sequence header and the second timestamp of the first frame multimedia frame, the server may align the first timestamp and the second timestamp, and then sequentially send the aligned sequence header of the target streaming media and the aligned first frame multimedia frame to the client.
Specifically, the server may first send the aligned sequence header of the target streaming media, and then sequentially send each multimedia frame of the target streaming media according to a time sequence starting from the aligned first frame multimedia frame of the target streaming media.
In some examples, the server may modify the second timestamp of the first frame multimedia frame to the first timestamp when aligning the first timestamp with the second timestamp. Then, the sequence header of the target streaming media is sent to the client, and then the first frame multimedia frame after the modified timestamp of the target streaming media is sent to the client, so that the client can decode the first frame multimedia frame based on the sequence header.
In still other examples, after modifying the second timestamp of the first frame of multimedia frame to the first timestamp, in order to enable the second to last frames of multimedia frames of the target streaming media to be played in time after the first frame of multimedia frame, and avoid an excessively long time interval between the second frame of multimedia frame and the first frame of multimedia frame, the server may modify the timestamp of each multimedia frame, except the first frame of multimedia frame, in the plurality of multimedia frames of the target streaming media based on the difference between the first timestamp and the second timestamp. And then, starting from the second frame of multimedia frames with the modified timestamps, sequentially sending all the multimedia frames with the modified timestamps except the first frame of multimedia frames to the client according to the sequence of the modified timestamps. Therefore, when the client plays the target streaming media based on the plurality of multimedia frames and the sequence head after the time stamp is modified, the time difference between every two frames of multimedia frames of the target streaming media is kept unchanged, and the influence of modifying the time stamp of the first frame of multimedia frame on the watching experience of the user can be avoided. And the playing quality of the streaming media is ensured.
In some examples, the server may modify the first timestamp in the sequence header of the target streaming media to the second timestamp, so as to reduce the time overhead of the server for aligning the first timestamp with the second timestamp, and in an embodiment of the present invention, the server may modify the first timestamp in the sequence header of the target streaming media to the second timestamp, so as to achieve the alignment of the first timestamp with the second timestamp. The server may then send the modified sequence header and the first frame multimedia frame to the client. After receiving the sequence header and the first frame of multimedia frames with the modified first timestamp, the client may start playing the target streaming media based on the sequence header and the first frame of multimedia frames with the modified first timestamp.
In some examples, on the basis of the multimedia data processing method shown in fig. 2, an embodiment of the present invention further provides a possible implementation manner, as shown in fig. 3, which is a flowchart of a third implementation manner of the multimedia data processing method according to the embodiment of the present invention, and the method may include:
s310, judging whether the target streaming media is cached in the server, if so, executing the step S320, and if not, executing the step S330; wherein, the target stream media comprises: an audio file and/or a video file;
s320, acquiring a first time stamp in a sequence header of a target streaming media cached in a server and a second time stamp of a first frame multimedia frame;
s330, acquiring a sequence head and a first frame multimedia frame from a server in which a target streaming media is stored, and acquiring a first time stamp in the sequence head and a second time stamp of the first frame multimedia frame;
s340, judging whether the first time stamp is the same as the second time stamp; if yes, executing step S350, if no, executing step S360;
s350, sequentially sending the sequence header and the first frame multimedia frame to the client;
and S360, aligning the first time stamp and the second time stamp, and sequentially sending the aligned sequence header of the target streaming media and the aligned first frame multimedia frame to the client.
In some examples, after the server acquires the sequence header and the first multimedia frame of the target streaming media from the server storing the target streaming media, a timestamp of the sequence header of the target streaming media and a timestamp of the first multimedia frame may or may not be aligned.
After the server acquires the sequence header and the first frame of multimedia frame of the target streaming media from the server in which the target streaming media is cached, first acquiring a first timestamp in the sequence header and a second timestamp of the first frame of multimedia frame, and then judging whether the first timestamp is the same as the second timestamp;
if the first timestamp is the same as the second timestamp, it indicates that the first timestamp is aligned with the second timestamp, and it is not necessary to perform an alignment operation on the first timestamp and the second timestamp, so that the sequence header of the target streaming media can be directly sent first, then the first frame multimedia frame of the target streaming media can be sent, and after a frame multimedia frame of the target streaming media is sent, the remaining multimedia frames of the target streaming media are sent in sequence according to the time sequence.
If the first timestamp is different from the second timestamp, the first timestamp and the second timestamp need to be aligned, at this time, the first timestamp and the second timestamp can be aligned first, then the sequence header of the target streaming media after being aligned with the timestamp is sent first, then the first frame multimedia frame after being aligned with the timestamp is sent, and after the first frame multimedia frame after being aligned with the timestamp is sent, the rest multimedia frames of the target streaming media are sent in sequence according to the time sequence.
It is understood that steps S310 to S330 and S360 in the embodiment of the present invention are the same as or similar to steps S210 to S240 in the second implementation manner in the embodiment of the present invention, and are not described again here.
In some examples, when a multimedia data processing method according to an embodiment of the present invention is applied to a client, on the basis of the multimedia data processing method shown in fig. 1, an embodiment of the present invention further provides a possible implementation manner, as shown in fig. 4, which is a flowchart of a fourth implementation manner of the multimedia data processing method according to the embodiment of the present invention, and the method may include:
s410, acquiring a first time stamp in a sequence header of a target streaming media cached by a client and a second time stamp of a first frame multimedia frame of the target streaming media; wherein, the target stream media comprises: an audio file and/or a video file;
and S420, aligning the first time stamp and the second time stamp, and playing the target streaming media at the client based on the aligned first time stamp and the aligned second time stamp.
In some examples, the client may also locally cache streaming media, and after the client acquires the identification information of the streaming media selected by the user, the client may first locally query whether to cache the streaming media corresponding to the identification information of the selected streaming media, if so, the client may use the streaming media corresponding to the identification information of the selected streaming media as a target streaming media, and if not, the client may generate an acquisition request based on the identification information of the streaming media selected by the user and send the acquisition request to the server.
When the client uses the streaming media corresponding to the identification information of the selected streaming media as the target streaming media, the client may obtain a first timestamp in a sequence header of the target streaming media cached by the client and a second timestamp of a first frame multimedia frame of the target streaming media, and then align the first timestamp and the second timestamp. After aligning the first timestamp with the second timestamp, the client may play the target streaming media at the client based on the aligned first timestamp and the aligned second timestamp.
In some examples, when aligning the first timestamp with the second timestamp, the client may modify the second timestamp of the first frame of multimedia frame to the first timestamp, and then modify the timestamp of each multimedia frame, except the first frame of multimedia frame, of the plurality of multimedia frames of the target streaming media based on a difference between the first timestamp and the second timestamp, so that when the client plays the target streaming media based on the plurality of multimedia frames after modifying the timestamps and the sequence header, a time difference between every two frames of multimedia frames of the target streaming media remains unchanged, and thus an influence of modifying the timestamp of the first frame of multimedia frame on a viewing experience of a user may be avoided. And the playing quality of the streaming media is ensured.
In still other examples, the workload of the client for modifying the timestamp of each multimedia frame of the target streaming media is relatively large, and in order to reduce the time overhead of the client for aligning the first timestamp with the second timestamp, in an embodiment of the present invention, the client may modify the first timestamp in the sequence header of the target streaming media to the second timestamp, so as to achieve the alignment of the first timestamp with the second timestamp. The client can then play the target streaming media based on the modified sequence header and the first frame multimedia frame after the first time stamp.
Corresponding to the above method embodiment, an embodiment of the present invention further provides a multimedia data processing apparatus, as shown in fig. 5, which is a schematic structural diagram of the multimedia data processing apparatus according to the embodiment of the present invention, and the apparatus may include:
an obtaining module 510, configured to obtain a first timestamp in a sequence header of a target streaming media and a second timestamp of a first frame multimedia frame of the target streaming media, where the target streaming media includes: an audio file and/or a video file;
a processing module 520, configured to align the first timestamp and the second timestamp, so that the target streaming media is played based on the aligned first timestamp and the aligned second timestamp.
The multimedia data processing device provided by the embodiment of the invention can firstly acquire a first time stamp in a sequence header of a target streaming media comprising an audio file and/or a video file and a second time stamp of a first frame multimedia frame in a plurality of multimedia frames of the target streaming media; the first timestamp and the second timestamp are then aligned. And because the first time stamp is aligned with the second time stamp, the client can start decoding playing from the first multimedia frame of the streaming media based on the sequence header, so that the problem of playing abnormalities such as playing jam, playing disconnection and the like caused by misalignment of the time stamp of the sequence header of the streaming media and the time stamp of the first multimedia frame of the streaming media in the prior art can be solved, the playing quality of the streaming media of the client can be improved, and the user viewing experience is improved.
In some examples, the obtaining module 510 is specifically configured to:
when the target streaming media is not cached in the server, acquiring a sequence head and a first frame multimedia frame from the server in which the target streaming media is cached, and acquiring a first time stamp in the sequence head and a second time stamp of the first frame multimedia frame;
when the target streaming media are cached in the server, acquiring a first time stamp in a sequence header of the target streaming media cached in the server and a second time stamp of a first frame multimedia frame;
the processing module 520 is specifically configured to:
and aligning the first time stamp and the second time stamp, and sequentially sending the aligned sequence head of the target streaming media and the aligned first frame multimedia frame to the client.
In some examples, the apparatus further comprises: the judging module is used for judging whether a first time stamp and a second time stamp of a first frame multimedia frame are the same after acquiring a sequence head and the first frame multimedia frame from a server in which a target streaming media is cached and acquiring the first time stamp in the sequence head and the second time stamp of the first frame multimedia frame;
when the first timestamp is different from the second timestamp, the trigger processing module 520 performs the steps of aligning the first timestamp with the second timestamp, and sequentially sending the aligned sequence header of the target streaming media and the aligned first frame multimedia frame to the client;
triggering the sending module when the first time stamp is the same as the second time stamp;
and the sending module is used for sequentially sending the sequence header and the first frame multimedia frame to the client.
In some examples, the obtaining module 510 is specifically configured to:
acquiring a first time stamp in a sequence header of a target streaming media cached by a client and a second time stamp of a first frame multimedia frame of the target streaming media;
the processing module 520 is specifically configured to:
and aligning the first time stamp and the second time stamp, and playing the target streaming media at the client based on the aligned first time stamp and the aligned second time stamp.
In some examples, the processing module 520 is specifically configured to:
modifying a second time stamp of the first frame of multimedia frame into a first time stamp, and modifying the time stamp of each multimedia frame except the first frame of multimedia frame in the plurality of multimedia frames of the target streaming media based on the difference value between the first time stamp and the second time stamp, so that the target streaming media is played based on the plurality of multimedia frames and the sequence header after the time stamps are modified; or
And modifying the first time stamp in the sequence header of the target streaming media into the second time stamp so as to play the target streaming media based on the modified sequence header of the first time stamp and the first frame multimedia frame.
An electronic device is further provided, as shown in fig. 6, and is a schematic structural diagram of the multimedia data processing method applied to the electronic device according to the embodiment of the present invention, where the electronic device may include a processor 601 and a machine-readable storage medium 602, where the machine-readable storage medium 602 stores machine-executable instructions capable of being executed by the processor 601, and the processor 601 is caused by the machine-executable instructions to: the steps of implementing a multimedia data processing method shown in any of the above embodiments may be implemented, for example, as follows:
acquiring a first time stamp in a sequence header of a target streaming media and a second time stamp of a first frame multimedia frame of the target streaming media, wherein the target streaming media comprises: an audio file and/or a video file;
and aligning the first time stamp and the second time stamp so that the target streaming media is played based on the aligned first time stamp and the aligned second time stamp.
The machine-readable storage medium 602 may include a Random Access Memory (RAM) and may also include a Non-Volatile Memory (NVM), such as at least one disk Memory. In some examples, the memory may also be at least one storage device located remotely from the aforementioned processor.
The Processor 601 may be a general-purpose Processor, including a Central Processing Unit (CPU), a Network Processor (NP), and the like; but also Digital Signal Processors (DSPs), Application Specific Integrated Circuits (ASICs), Field Programmable Gate Arrays (FPGAs) or other Programmable logic devices, discrete Gate or transistor logic devices, discrete hardware components.
According to the electronic device provided by the embodiment of the invention, a first time stamp in a sequence header of a target streaming media comprising an audio file and/or a video file and a second time stamp of a first frame multimedia frame in a plurality of multimedia frames of the target streaming media can be obtained; the first timestamp and the second timestamp are then aligned. And because the first time stamp is aligned with the second time stamp, the client can start decoding playing from the first multimedia frame of the streaming media based on the sequence header, so that the problem of playing abnormalities such as playing jam, playing disconnection and the like caused by misalignment of the time stamp of the sequence header of the streaming media and the time stamp of the first multimedia frame of the streaming media in the prior art can be solved, the playing quality of the streaming media of the client can be improved, and the user viewing experience is improved.
An embodiment of the present invention further provides a computer-readable storage medium, where a computer program is stored in the computer-readable storage medium, and when the computer program is executed by a processor, the steps of the multimedia data processing method shown in any of the above embodiments are implemented, for example, the following steps may be implemented:
acquiring a first time stamp in a sequence header of a target streaming media and a second time stamp of a first frame multimedia frame of the target streaming media, wherein the target streaming media comprises: an audio file and/or a video file;
and aligning the first time stamp and the second time stamp so that the target streaming media is played based on the aligned first time stamp and the aligned second time stamp.
A computer-readable storage medium according to an embodiment of the present invention may first obtain a first timestamp in a sequence header of a target streaming media including an audio file and/or a video file and a second timestamp of a first multimedia frame of a plurality of multimedia frames of the target streaming media; the first timestamp and the second timestamp are then aligned. And because the first time stamp is aligned with the second time stamp, the client can start decoding playing from the first multimedia frame of the streaming media based on the sequence header, so that the problem of playing abnormalities such as playing jam, playing disconnection and the like caused by misalignment of the time stamp of the sequence header of the streaming media and the time stamp of the first multimedia frame of the streaming media in the prior art can be solved, the playing quality of the streaming media of the client can be improved, and the user viewing experience is improved.
Embodiments of the present invention further provide a computer program product including instructions, which when run on a computer, cause the computer to perform the steps of a multimedia data processing method shown in any of the above embodiments, for example, the following steps may be performed:
acquiring a first time stamp in a sequence header of a target streaming media and a second time stamp of a first frame multimedia frame of the target streaming media, wherein the target streaming media comprises: an audio file and/or a video file;
and aligning the first time stamp and the second time stamp so that the target streaming media is played based on the aligned first time stamp and the aligned second time stamp.
A computer program product including instructions according to an embodiment of the present invention may first obtain a first timestamp in a sequence header of a target streaming media including an audio file and/or a video file and a second timestamp of a first multimedia frame of a plurality of multimedia frames of the target streaming media; the first timestamp and the second timestamp are then aligned. And because the first time stamp is aligned with the second time stamp, the client can start decoding playing from the first multimedia frame of the streaming media based on the sequence header, so that the problem of playing abnormalities such as playing jam, playing disconnection and the like caused by misalignment of the time stamp of the sequence header of the streaming media and the time stamp of the first multimedia frame of the streaming media in the prior art can be solved, the playing quality of the streaming media of the client can be improved, and the user viewing experience is improved.
An embodiment of the present invention further provides a computer program, which, when running on a computer, enables the computer to execute the steps of the multimedia data processing method shown in any of the foregoing embodiments, for example, the following steps may be executed:
acquiring a first time stamp in a sequence header of a target streaming media and a second time stamp of a first frame multimedia frame of the target streaming media, wherein the target streaming media comprises: an audio file and/or a video file;
and aligning the first time stamp and the second time stamp so that the target streaming media is played based on the aligned first time stamp and the aligned second time stamp.
The computer program provided by the embodiment of the invention can firstly acquire a first time stamp in a sequence header of a target streaming media comprising an audio file and/or a video file and a second time stamp of a first frame multimedia frame in a plurality of multimedia frames of the target streaming media; the first timestamp and the second timestamp are then aligned. And because the first time stamp is aligned with the second time stamp, the client can start decoding playing from the first multimedia frame of the streaming media based on the sequence header, so that the problem of playing abnormalities such as playing jam, playing disconnection and the like caused by misalignment of the time stamp of the sequence header of the streaming media and the time stamp of the first multimedia frame of the streaming media in the prior art can be solved, the playing quality of the streaming media of the client can be improved, and the user viewing experience is improved.
It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
All the embodiments in the present specification are described in a related manner, and the same and similar parts among the embodiments may be referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, for the system embodiment, since it is substantially similar to the method embodiment, the description is simple, and for the relevant points, reference may be made to the partial description of the method embodiment.
The above description is only for the preferred embodiment of the present invention, and is not intended to limit the scope of the present invention. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention shall fall within the protection scope of the present invention.
Claims (10)
1. A method of multimedia data processing, the method comprising:
obtaining a first time stamp in a sequence header of a target streaming media and a second time stamp of a first frame multimedia frame of the target streaming media, wherein the target streaming media comprises: an audio file and/or a video file;
aligning the first timestamp and the second timestamp so that the target streaming media is played based on the aligned first timestamp and the aligned second timestamp.
2. The method of claim 1, wherein obtaining a first timestamp in a sequence header of the target streaming media and a second timestamp of a first frame multimedia frame of the target streaming media comprises:
when the target streaming media is not cached in the server, acquiring the sequence header and the first frame multimedia frame from the server in which the target streaming media is cached, and acquiring a first time stamp in the sequence header and a second time stamp of the first frame multimedia frame;
when the target streaming media is cached in the server, acquiring a first time stamp in a sequence header of the target streaming media cached in the server and a second time stamp of the first frame multimedia frame;
the aligning the first timestamp and the second timestamp to cause the target streaming media to be played based on the aligned first timestamp and the aligned second timestamp comprises:
and aligning the first time stamp and the second time stamp, and sequentially sending the aligned sequence header of the target streaming media and the aligned first frame multimedia frame to a client.
3. The method of claim 2, wherein after the obtaining the sequence header and the first frame multimedia frame from the server storing the target streaming media, and obtaining the first timestamp in the sequence header and the second timestamp of the first frame multimedia frame, the method further comprises:
judging whether the first time stamp is the same as the second time stamp;
when the first time stamp is different from the second time stamp, the step of aligning the first time stamp and the second time stamp is executed, and the aligned sequence header of the target streaming media and the aligned first frame multimedia frame are sequentially sent to a client;
and when the first time stamp is the same as the second time stamp, sequentially sending the sequence header and the first frame multimedia frame to the client.
4. The method of claim 1, wherein obtaining a first timestamp in a sequence header of a target streaming media and a second timestamp of a first multimedia frame of the target streaming media comprises:
acquiring a first time stamp in a sequence header of the target streaming media cached by a client and a second time stamp of a first frame multimedia frame of the target streaming media;
the aligning the first timestamp and the second timestamp so that the target streaming media is played based on the aligned first timestamp and the aligned second timestamp comprises:
and aligning the first time stamp and the second time stamp, and playing the target streaming media at the client based on the aligned first time stamp and the aligned second time stamp.
5. The method of claim 1, wherein aligning the first timestamp and the second timestamp such that the target streaming media is played based on the aligned first timestamp and the aligned second timestamp comprises:
modifying the second time stamp of the first frame of multimedia frame into the first time stamp, and modifying the time stamp of each multimedia frame except the first frame of multimedia frame in the plurality of multimedia frames of the target streaming media based on the difference value between the first time stamp and the second time stamp, so that the target streaming media is played based on the plurality of multimedia frames after the time stamps are modified and the sequence head; or alternatively
And modifying the first time stamp in the sequence header of the target streaming media into the second time stamp, so that the target streaming media is played based on the modified sequence header of the first time stamp and the first frame multimedia frame.
6. A multimedia data processing apparatus, characterized in that the apparatus comprises:
an obtaining module, configured to obtain a first timestamp in a sequence header of a target streaming media and a second timestamp of a first frame multimedia frame of the target streaming media, where the target streaming media includes: an audio file and/or a video file;
and the processing module is used for aligning the first time stamp and the second time stamp so as to play the target streaming media based on the aligned first time stamp and the aligned second time stamp.
7. The apparatus of claim 6, wherein the obtaining module is specifically configured to:
when the target streaming media is not cached in the server, acquiring the sequence header and the first frame multimedia frame from the server in which the target streaming media is cached, and acquiring a first time stamp in the sequence header and a second time stamp of the first frame multimedia frame;
when the target streaming media is cached in the server, acquiring a first time stamp in a sequence header of the target streaming media cached in the server and a second time stamp of the first frame multimedia frame;
the processing module is specifically configured to:
and aligning the first time stamp and the second time stamp, and sequentially sending the aligned sequence header of the target streaming media and the aligned first frame multimedia frame to a client.
8. The apparatus according to claim 6, wherein the obtaining module is configured to:
acquiring a first time stamp in a sequence header of the target streaming media cached by a client and a second time stamp of a first frame multimedia frame of the target streaming media;
the processing module is specifically configured to:
and aligning the first time stamp and the second time stamp, and playing the target streaming media at the client based on the aligned first time stamp and the aligned second time stamp.
9. An electronic device comprising a processor and a machine-readable storage medium storing machine-executable instructions executable by the processor, the processor being caused by the machine-executable instructions to: carrying out the process steps of any one of claims 1 to 5.
10. A computer-readable storage medium, in which a computer program is stored which, when being executed by a processor, carries out the method steps of any one of claims 1 to 5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210261593.1A CN114697303B (en) | 2022-03-16 | 2022-03-16 | Multimedia data processing method and device, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210261593.1A CN114697303B (en) | 2022-03-16 | 2022-03-16 | Multimedia data processing method and device, electronic equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114697303A true CN114697303A (en) | 2022-07-01 |
| CN114697303B CN114697303B (en) | 2023-11-03 |
Family
ID=82139601
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210261593.1A Active CN114697303B (en) | 2022-03-16 | 2022-03-16 | Multimedia data processing method and device, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114697303B (en) |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20120104706A (en) * | 2011-03-14 | 2012-09-24 | 한국방송공사 | System and method for synchronization of 3d broadcasting service using real-time broadcasting and non-real time additional broadcasting data |
| CN107566889A (en) * | 2017-09-15 | 2018-01-09 | 深圳国微技术有限公司 | Audio stream flow rate error processing method, device, computer installation and computer-readable recording medium |
| CN109587497A (en) * | 2018-12-13 | 2019-04-05 | 广州虎牙信息科技有限公司 | The audio data transmission method of FLV stream, device and system |
| CN110475159A (en) * | 2018-05-10 | 2019-11-19 | 中兴通讯股份有限公司 | The transmission method and device of multimedia messages, terminal |
| KR102048685B1 (en) * | 2018-06-15 | 2019-11-26 | 주식회사 다산네트웍스 | Method for judging the time synchronization of a media transmission device in a vehicle avb network |
| WO2020097857A1 (en) * | 2018-11-15 | 2020-05-22 | 北京比特大陆科技有限公司 | Media stream processing method and apparatus, storage medium, and program product |
| CN112492357A (en) * | 2020-11-13 | 2021-03-12 | 北京安博盛赢教育科技有限责任公司 | Method, device, medium and electronic equipment for processing multiple video streams |
| CN113141522A (en) * | 2020-01-17 | 2021-07-20 | 北京达佳互联信息技术有限公司 | Resource transmission method, device, computer equipment and storage medium |
| CN113824970A (en) * | 2020-06-19 | 2021-12-21 | 北京金山云网络技术有限公司 | Live broadcast data processing method and device and electronic equipment |
-
2022
- 2022-03-16 CN CN202210261593.1A patent/CN114697303B/en active Active
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20120104706A (en) * | 2011-03-14 | 2012-09-24 | 한국방송공사 | System and method for synchronization of 3d broadcasting service using real-time broadcasting and non-real time additional broadcasting data |
| CN107566889A (en) * | 2017-09-15 | 2018-01-09 | 深圳国微技术有限公司 | Audio stream flow rate error processing method, device, computer installation and computer-readable recording medium |
| CN110475159A (en) * | 2018-05-10 | 2019-11-19 | 中兴通讯股份有限公司 | The transmission method and device of multimedia messages, terminal |
| KR102048685B1 (en) * | 2018-06-15 | 2019-11-26 | 주식회사 다산네트웍스 | Method for judging the time synchronization of a media transmission device in a vehicle avb network |
| WO2020097857A1 (en) * | 2018-11-15 | 2020-05-22 | 北京比特大陆科技有限公司 | Media stream processing method and apparatus, storage medium, and program product |
| CN109587497A (en) * | 2018-12-13 | 2019-04-05 | 广州虎牙信息科技有限公司 | The audio data transmission method of FLV stream, device and system |
| CN113141522A (en) * | 2020-01-17 | 2021-07-20 | 北京达佳互联信息技术有限公司 | Resource transmission method, device, computer equipment and storage medium |
| US20220060532A1 (en) * | 2020-01-17 | 2022-02-24 | Beijing Dajia Internet Information Technology Co., Ltd. | Method for transmitting resources and electronic device |
| CN113824970A (en) * | 2020-06-19 | 2021-12-21 | 北京金山云网络技术有限公司 | Live broadcast data processing method and device and electronic equipment |
| CN112492357A (en) * | 2020-11-13 | 2021-03-12 | 北京安博盛赢教育科技有限责任公司 | Method, device, medium and electronic equipment for processing multiple video streams |
Non-Patent Citations (2)
| Title |
|---|
| P. BHATTACHARYA: "System level PTS-based AV synchronization strategies for playback chains spanning multiple processor cores", 《2006 DIGEST OF TECHNICAL PAPERS INTERNATIONAL CONFERENCE ON CONSUMER ELECTRONICS》 * |
| 袁阔;曾文俊;吴晓红;路仁杰;苗鑫;: "基于AoIP技术的4K超高清转播车音频系统设计", 影视制作, no. 06 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114697303B (en) | 2023-11-03 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108540819B (en) | Live broadcast data processing method and device, computer equipment and storage medium | |
| US11082468B2 (en) | Anchors for live streams | |
| CN108366278B (en) | User interaction implementation method and device in video playing | |
| KR102058761B1 (en) | Terminal apparatus, server apparatus, information processing method, program, and linking application supply system | |
| JP7313445B2 (en) | Dynamic shortening in replacement content playback to help align the end of replacement content with the end of replaced content | |
| US9578366B2 (en) | Companion device services based on the generation and display of visual codes on a display device | |
| EP3448040A1 (en) | Live broadcast rapid-startup method and system | |
| US10638192B2 (en) | Live streaming quick start method and system | |
| CN109714622B (en) | Video data processing method and device and electronic equipment | |
| WO2012111514A1 (en) | Information processing device, information processing method, and program | |
| CN108989883B (en) | Live broadcast advertisement method, device, equipment and medium | |
| US11632597B2 (en) | Responding to emergency-alert audio tone by abandoning dynamic content modification | |
| CN112752114B (en) | Method and device for generating live broadcast playback interactive message, server and storage medium | |
| US11496781B2 (en) | Advanced preparation for content revision based on expected latency in obtaining new content | |
| US8893166B2 (en) | Method of surveying watching of image content, and broadcast receiving apparatus and server employing the same | |
| US11051057B2 (en) | Use of steganographically-encoded time information as basis to establish a time offset, to facilitate taking content-related action | |
| CN111447455A (en) | Live video stream playback processing method and device and computing equipment | |
| US20200359066A1 (en) | Content-Modification System With Responsive Transmission of Reference Fingerprint Data Feature | |
| US11450110B2 (en) | Content-modification system with use of multiple fingerprint data types feature | |
| US11632598B2 (en) | Content-modification system with responsive transmission of reference fingerprint data feature | |
| CN113242437A (en) | RTSP (real time streaming protocol) video plug-in-free playing method, system, device and storage medium | |
| CN114697303B (en) | Multimedia data processing method and device, electronic equipment and storage medium | |
| US20220385627A1 (en) | Content-modification system with household coordination feature | |
| US11234050B2 (en) | Use of steganographically-encoded data as basis to control dynamic content modification as to at least one modifiable-content segment identified based on fingerprint analysis | |
| CN110798713A (en) | Time-shifted television on-demand method, terminal, server and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |