CN113364767B - Streaming media data display method and device, electronic equipment and storage medium - Google Patents

Streaming media data display method and device, electronic equipment and storage medium Download PDF

Info

Publication number
CN113364767B
CN113364767B CN202110619185.4A CN202110619185A CN113364767B CN 113364767 B CN113364767 B CN 113364767B CN 202110619185 A CN202110619185 A CN 202110619185A CN 113364767 B CN113364767 B CN 113364767B
Authority
CN
China
Prior art keywords
data
streaming media
media data
decoding
time
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202110619185.4A
Other languages
Chinese (zh)
Other versions
CN113364767A (en
Inventor
余振华
吴驹东
沈显超
吴桂洲
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing ByteDance Network Technology Co Ltd
Original Assignee
Beijing ByteDance Network Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing ByteDance Network Technology Co Ltd filed Critical Beijing ByteDance Network Technology Co Ltd
Priority to CN202110619185.4A priority Critical patent/CN113364767B/en
Publication of CN113364767A publication Critical patent/CN113364767A/en
Application granted granted Critical
Publication of CN113364767B publication Critical patent/CN113364767B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60—Network streaming of media packets
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/433—Content storage operation, e.g. storage operation in response to a pause request, caching operations
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
    • H04N21/44012—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving rendering scenes according to scene graphs, e.g. MPEG-4 scene graphs
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/85—Assembly of content; Generation of multimedia applications
    • H04N21/854—Content authoring
    • H04N21/8547—Content authoring involving timestamps for synchronizing content

Abstract

The embodiment of the disclosure discloses a streaming media data display method, a system, a device, an electronic device and a storage medium, wherein the method comprises the following steps: receiving streaming media data and caching the data; when receiving a data decoding synchronization signal, filtering out overdue data in the cached streaming media data, and performing data decoding on unexpired data; and when a vertical synchronizing signal is received, rendering and displaying the decoded streaming media data, wherein the vertical synchronizing signal and the data decoding synchronizing signal have the same period, and the current time difference between the arrival time of the vertical synchronizing signal and the arrival time of the data decoding synchronizing signal is greater than or equal to the data decoding duration of the unexpired data in the cached streaming media data. The technical scheme disclosed by the embodiment of the disclosure solves the problems that the real-time performance of the streaming media data playing needs to be improved and the real-time performance and the fluency of the streaming media data playing cannot be considered at the same time, and can reduce the pause of the streaming media data playing so that the streaming media data can be displayed uniformly and smoothly.

Description

Streaming media data display method and device, electronic equipment and storage medium
Technical Field
The embodiment of the disclosure relates to the technical field of computers, and in particular relates to a streaming media data display method and device, an electronic device and a storage medium.
Background
The streaming media data refers to media data played on the Internet in a streaming transmission manner, and is real-time audio and video stream data capable of being transmitted and played simultaneously. The user can listen to and watch the audio-video content provided by the streaming media source end from the network in real time through the receiving and displaying device. The audio and video data flows from the media source end to the user end for display, and is subjected to encoding of the source end, network transmission and receiving, decoding and displaying of the terminal. The three links all require time and are not strictly stable and unchangeable, so that the real-time performance and the fluency of the streaming media data playing are poor.
At present, it is known that the played picture can be made smooth by caching the acquired streaming media data and then decoding, rendering and playing the streaming media data; however, the first large amount of buffer data may cause poor real-time performance of streaming media data playing, and the real-time performance and the fluency of streaming media data playing cannot be considered at the same time.
Disclosure of Invention
The embodiment of the disclosure provides a streaming media data display method and device, an electronic device and a storage medium, which can reduce the pause of streaming media data playing and enable the streaming media data to be displayed uniformly and smoothly.
In a first aspect, an embodiment of the present disclosure provides a streaming media data display method, including:
receiving streaming media data and caching the data;
when a data decoding synchronization signal is received, filtering out overdue data in cached streaming media data according to the currently set data caching duration and the timestamp of the received streaming media data, and performing data decoding on unexpired data in the cached streaming media data;
and when a vertical synchronizing signal is received, rendering and displaying the decoded streaming media data, wherein the vertical synchronizing signal and the data decoding synchronizing signal are same-period signals, and the current time difference between the arrival time of the vertical synchronizing signal and the arrival time of the data decoding synchronizing signal is greater than or equal to the data decoding duration of unexpired data in the cached streaming media data.
In a second aspect, an embodiment of the present disclosure further provides a streaming media data display apparatus, including:
the data receiving module is used for receiving the streaming media data and caching the data;
the data decoding module is used for filtering out overdue data in the cached streaming media data according to the currently set data caching duration and the timestamp of the received streaming media data when receiving the data decoding synchronization signal, and performing data decoding on unexpired data in the cached streaming media data;
and the data display module is used for rendering and displaying the decoded streaming media data when a vertical synchronization signal is received, wherein the vertical synchronization signal and the data decoding synchronization signal are same-period signals, and the current time difference between the arrival time of the vertical synchronization signal and the arrival time of the data decoding synchronization signal is greater than or equal to the data decoding duration of the unexpired data in the cached streaming media data.
In a third aspect, an embodiment of the present disclosure further provides an electronic device, where the electronic device includes:
one or more processors;
a storage device for storing one or more programs,
when the one or more programs are executed by the one or more processors, the one or more processors implement the streaming media data display method according to any one of the embodiments of the disclosure.
In a fourth aspect, the embodiments of the present disclosure further provide a storage medium containing computer-executable instructions, which when executed by a computer processor, are used to execute the streaming media data display method according to any one of the embodiments of the present disclosure.
According to the technical scheme of the embodiment of the disclosure, the received streaming media data is cached according to the currently set adjustable data caching duration; then, when receiving a data decoding synchronization signal, filtering out overdue data in the cached streaming media data, and performing data decoding on unexpired data in the cached streaming media data; and then, when a vertical synchronizing signal is received, rendering and displaying the decoded streaming media data, wherein the vertical synchronizing signal and the data decoding synchronizing signal are same-period signals, and the current time difference between the arrival time of the vertical synchronizing signal and the arrival time of the data decoding synchronizing signal is greater than or equal to the data decoding duration of the unexpired data in the cached streaming media data, so that all the decoded streaming media data are immediately displayed after being decoded. According to the technical scheme of the embodiment of the disclosure, the problems that the real-time performance of the streaming media data playing needs to be improved and the real-time performance and the fluency of the streaming media data playing cannot be considered are solved, and the pause of the streaming media data playing can be reduced, so that the streaming media data can be displayed uniformly and smoothly.
Drawings
The above and other features, advantages and aspects of various embodiments of the present disclosure will become more apparent by referring to the following detailed description when taken in conjunction with the accompanying drawings. Throughout the drawings, the same or similar reference numbers refer to the same or similar elements. It should be understood that the drawings are schematic and that elements and features are not necessarily drawn to scale.
Fig. 1 is a schematic flowchart illustrating a streaming media data display method according to an embodiment of the disclosure;
FIG. 2 is a timing diagram of a data decoding synchronization signal and a vertical synchronization signal according to a first embodiment of the present disclosure;
fig. 3 is a schematic flowchart of a streaming media data display method according to a second embodiment of the disclosure;
fig. 4 is a timing diagram of the arrival of streaming media data and the arrival of data processing signals according to a second embodiment of the disclosure;
fig. 5 is a schematic flowchart of a streaming media data display method according to a third embodiment of the disclosure;
fig. 6 is a schematic structural diagram of a streaming media data display apparatus according to a fourth embodiment of the disclosure;
fig. 7 is a schematic structural diagram of an electronic device according to a fifth embodiment of the disclosure.
Detailed Description
Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While certain embodiments of the present disclosure are shown in the drawings, it is to be understood that the present disclosure may be embodied in various forms and should not be construed as limited to the embodiments set forth herein, but rather are provided for a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and the embodiments of the disclosure are for illustration purposes only and are not intended to limit the scope of the disclosure.
It should be understood that the various steps recited in the method embodiments of the present disclosure may be performed in a different order, and/or performed in parallel. Moreover, method embodiments may include additional steps and/or omit performing the illustrated steps. The scope of the present disclosure is not limited in this respect.
The term "include" and variations thereof as used herein are open-ended, i.e., "including but not limited to". The term "based on" is "based at least in part on". The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments". Relevant definitions for other terms will be given in the following description.
It should be noted that the terms "first", "second", and the like in the present disclosure are only used for distinguishing different devices, modules or units, and are not used for limiting the order or interdependence relationship of the functions performed by the devices, modules or units.
It is noted that references to "a", "an", and "the" modifications in this disclosure are intended to be illustrative rather than limiting, and that those skilled in the art will recognize that "one or more" may be used unless the context clearly dictates otherwise.
Example one
Fig. 1 is a schematic flow chart of a streaming media data display method provided in an embodiment of the present disclosure, and the embodiment of the present disclosure is suitable for a situation of playing streaming media data in real time, and is particularly suitable for a situation of displaying audio and video data in a live scene. The method may be performed by a streaming media data display apparatus, which may be implemented in the form of software and/or hardware, and may be configured in an electronic device, such as a mobile terminal or a server device.
As shown in fig. 1, the streaming media data display method provided in this embodiment includes:
and S110, receiving the streaming media data and caching the data.
The streaming media refers to a media format played on the Internet in a streaming transmission manner, and the streaming media data is data in the streaming transmission format, and includes audio data and video data. When playing audio and video data, a user can download all data in advance and cache the data, and then play the data; or, a form of broadcasting while transmitting can be selected, and the received data packet is decoded and played while receiving the streaming media data. Especially in a live broadcast scene, if the buffering time after receiving the video is too long, or all the data to be played cannot be decoded during video data display, the video playing effect is not smooth enough because of the phenomenon of blocking in the playing visual effect.
In this embodiment, when receiving streaming media data to be played, the received streaming media data is buffered first to be decoded and played synchronously later. The caching of the streaming media data is performed according to the time sequence, and is not performed according to the size of the memory space occupied by the streaming media data. That is, for the streaming media data, only data within a preset time length needs to be cached, the preset time length is determined according to the time when the streaming media data is received within the historical time period and the time difference between the arrival times of the decoding synchronization signal or the vertical synchronization signal adjacent to the received streaming media data, and the preset time length can be dynamically updated according to the statistical result of the time difference.
And S120, when a data decoding synchronization signal is received, filtering out overdue data in the cached streaming media data according to the currently set data caching duration and the timestamp of the received streaming media data, and performing data decoding on unexpired data in the cached streaming media data.
Specifically, the data decoding synchronization signal is used for performing unified data decoding on the streaming media data cached in the currently set data caching duration before the arrival time of the data decoding synchronization signal to obtain a corresponding audio or video frame and texture information corresponding to the audio or video frame.
The data decoding synchronization signal is determined according to a vertical synchronization signal displayed by terminal hardware, or a synchronization signal (such as an APP vsync signal in an android system) having a fixed time phase relationship with the vertical synchronization signal. For example, the time consumed for completing the data decoding in one data decoding is counted, and the time length consumed for the data decoding is taken as the time difference between the data decoding synchronization signal and the vertical synchronization signal to determine the arrival time of the data decoding synchronization signal. Vertical synchronization (Vsync) is a picture display synchronization signal inherent to a display terminal system.
When receiving the data decoding synchronization signal, filtering the streaming media data during caching, and filtering out overdue data with the caching duration exceeding the currently set data caching duration from the data caching to the time of receiving the data decoding synchronization signal, namely discarding the overdue data and not decoding. Meanwhile, synchronous data decoding is carried out aiming at unexpired streaming media data to obtain corresponding audio or video frames and texture information corresponding to the audio or video frames.
And S130, when the vertical synchronization signal is received, rendering and displaying the decoded streaming media data.
The vertical synchronizing signal and the data decoding synchronizing signal are same-period signals, and the current time difference between the arrival time of the vertical synchronizing signal and the arrival time of the data decoding synchronizing signal is greater than or equal to the data decoding duration of the unexpired data in the cached streaming media data. Therefore, in the time period between the arrival time of the data decoding synchronization signal and the arrival time of the vertical synchronization signal, all the data to be decoded can complete the decoding process, and the closer the time difference between the arrival time of the data decoding synchronization signal and the arrival time of the vertical synchronization signal is to the data decoding duration, the shorter the delay of the streaming media data playing display is.
The timing diagram of the data decoding synchronization signal and the vertical synchronization signal shown in fig. 2 is taken as an example for explanation. Wherein, t0Is the arrival time of the real-time video stream data, where t0Data arriving at time t will bedmThe decoding is triggered at time tdmAnd rendering and displaying at any moment. Due to tvm-tdmThe time interval between can be determined statistically from the decoded data, thus at tvmPreviously, data to be decoded can be decoded completely, so that extremely low decoding display delay is realized.
According to the technical scheme of the embodiment of the disclosure, the received streaming media data can be cached according to the currently set adjustable data caching duration; then, when receiving a data decoding synchronization signal, filtering out overdue data in the cached streaming media data, and performing data decoding on unexpired data in the cached streaming media data; and then, when a vertical synchronizing signal is received, rendering and displaying the decoded streaming media data, wherein the vertical synchronizing signal and the data decoding synchronizing signal are same-period signals, and the current time difference between the arrival time of the vertical synchronizing signal and the arrival time of the data decoding synchronizing signal is greater than or equal to the data decoding duration of the unexpired data in the cached streaming media data, so that all the decoded streaming media data are immediately displayed after being decoded. According to the technical scheme of the embodiment of the disclosure, the problems that the real-time performance of the streaming media data playing needs to be improved and the real-time performance and the fluency of the streaming media data playing cannot be considered are solved, and the pause of the streaming media data playing can be reduced, so that the streaming media data can be displayed uniformly and smoothly.
Example two
The embodiments of the present disclosure and various alternatives in the streaming media data display method provided in the above embodiments may be combined. The streaming media data display method provided by the embodiment further describes a process of determining the currently set data cache duration, and can optimize the rendering effect of the cover page of the preset song recommendation module.
Fig. 3 is a schematic flowchart of a streaming media data display method according to a second embodiment of the disclosure.
As shown in fig. 3, the streaming media data display method provided in this embodiment includes:
s210, calculating a first time difference value between the time when the current streaming media data is received and the arrival time of a data decoding synchronous signal or the arrival time of a vertical synchronous signal corresponding to the current streaming media data.
Specifically, the calculation and statistics process of the first time difference is an operation performed in synchronization with the process of receiving streaming media data, decoding and displaying the received data. And according to the time of receiving the current streaming media data and the time difference between the arrival time of the data decoding synchronous signal or the arrival time of the vertical synchronous signal corresponding to the current streaming media data, the time difference is the first time difference. The first time difference corresponds to the buffering time length of the received streaming media data, and when the data decoding synchronization signal arrives, the buffered data in the just set buffering time length are all decoded, so that the condition of frame loss of the streaming media data can be reduced, the pause is reduced, and the video playing is smoother.
S220, counting the first time difference value and historical first time difference between the time of receiving the streaming media data in the past and the arrival time of the data decoding synchronization signal or the arrival time of the vertical synchronization signal corresponding to the streaming media data received in the past in a preset historical time period before the time of receiving the current streaming media data.
If the current streaming media data is the (m + 1) th received streaming media data packet, the current set data cache duration corresponding to the current streaming media data is a result of statistical determination of the historical first time difference of the previous m streaming media data. And receiving the streaming media data within a set time length in the time period of the arrival time of the streaming media data and the arrival time of the data decoding synchronization signal based on the historical statistical result so as to synchronously decode.
And S230, updating the currently set data cache length according to the statistical distribution result of each first time difference.
In the statistical process of a large amount of historical data, the distribution of the data may take the form of a poisson distribution, gaussian distribution or other distribution, and can be generally determined by calculating the data such as the mean, variance and mean square error of the statistical data. For example, when the statistical distribution result for each first time difference meets the gaussian distribution characteristic, the sum of the mean value of the statistical distribution result for each first time difference and three times of the standard deviation is used as the currently set data buffer length corresponding to the next received streaming media data.
And S240, receiving the next streaming media data packet of the current streaming media data, and performing data caching.
And S250, when a data decoding synchronization signal is received, filtering out overdue data in the cached streaming media data according to the updated currently set data caching duration and the timestamp of the next streaming media data packet, and performing data decoding on unexpired data in the cached streaming media data.
And after the currently set data caching duration is updated, performing data smoothing processing on the received streaming media data according to the updated currently set data caching duration.
In one specific example, reference may be made to the timing diagram shown in FIG. 4. In FIG. 4, t1、t2The time is also the arrival time of the streaming media data, since t1The moment of time has been at t(dm+1)Thereafter, the data decoding can only be delayed until the next data decoding synchronization signal, which is preceded by a time t2The stream media data arriving at the moment is to be discarded t according to the conventional processing rule1Directly decoding the stream media data arriving at the moment and displaying t2The streaming media data arriving at the moment generates frame loss, and the user experience is stuck.
In this embodiment, when the data decoding synchronization signal arrives, the streaming media data in the time sequence of the currently set data buffer duration is decoded. The time sequence length is calculated according to the phase distribution of the vertical synchronizing signal or the data decoding synchronizing signal which is close to the first m streaming media data receiving time of the currently received streaming media data. According to a great deal of data analysis experience, the phase distribution of the arrival time of the streaming media data and the adjacent vertical synchronization signal or data decoding synchronization signal presents a gaussian distribution state in a period of time, and therefore,in this example, the sum of the mean value of the gaussian distribution and the three standard deviations is taken as the length of the time series. Assume that the time series length is T1, as shown in fig. 4. t is tdmBefore only t0Video data arriving at a time, and therefore directly at tdmTime, decoding the video data arriving at time t0, tvmTime of day trigger display at tdmThe data decoded at the time. And t is(dm+2)Before the moment of time t1And t2Two sets of video frame data arriving at the moment due to t(dm+2And t1The time difference therebetween is less than T1; thus, t(dm+2)Time of day trigger t1And t2Decoding of the data arriving at a time and at t(vm+2)Triggering display at t(dm+2)Streaming media data decoded at a time instant, thus avoiding the need to decode at t(vm+2)The user experiences a stuck at a time. Further, in fig. 4, T is a period of the data decoding synchronization signal and the vertical synchronization signal, and the two signals are the same period signals having a certain time phase difference.
And S260, rendering and displaying the decoded streaming media data when the vertical synchronization signal is received.
According to the technical scheme of the embodiment of the disclosure, the time difference between the received streaming media data and the adjacent data decoding synchronization signal or the vertical synchronization signal is counted and used as the time sequence length of the cached data, the time sequence length of the data cache is dynamically updated according to the real-time counting result, and when the streaming media data are received, the received streaming media data are cached according to the updated currently set adjustable data cache duration; then, when receiving a data decoding synchronization signal, filtering out overdue data in the cached streaming media data, and performing data decoding on unexpired data in the cached streaming media data; and then, when a vertical synchronizing signal is received, rendering and displaying the decoded streaming media data, wherein the vertical synchronizing signal and the data decoding synchronizing signal are same-period signals, and the current time difference between the arrival time of the vertical synchronizing signal and the arrival time of the data decoding synchronizing signal is greater than or equal to the data decoding duration of the unexpired data in the cached streaming media data, so that all the decoded streaming media data are immediately displayed after being decoded. According to the technical scheme of the embodiment of the disclosure, the problems that the real-time performance of the streaming media data playing needs to be improved and the real-time performance and the fluency of the streaming media data playing cannot be considered are solved, and the pause of the streaming media data playing can be reduced, so that the streaming media data can be displayed uniformly and smoothly.
EXAMPLE III
The embodiments of the present disclosure and various alternatives in the streaming media data display method provided in the above embodiments may be combined. The streaming media data display method provided in this embodiment further illustrates a specific process of determining a time phase difference between a data decoding synchronization signal and a vertical synchronization signal.
Fig. 5 is a schematic flowchart of a streaming media data display method according to a third embodiment of the disclosure.
As shown in fig. 5, the streaming media data display method provided in this embodiment includes:
s310, calculating the decoding time length of data decoding of unexpired data in the cached streaming media data at the current time and the decoding time length of data decoding performed at previous times in a preset historical time period.
Specifically, the process of counting the decoding duration of the past data is an operation performed synchronously with the process of receiving the streaming media data, decoding and displaying the received data. Due to different contents or formats of the streaming media data, the time length of data decoding can also change in stages, statistics is carried out on the data decoding duration in a set period of historical time, and the time difference between the data decoding synchronization signal and the vertical synchronization signal (or other synchronization signals with fixed time phase difference with the vertical synchronization signal) is updated in time, so that the delay of the streaming media data display can be shortened. For example, before the update, the streaming media data is displayed 0.3 seconds after the data decoding synchronization signal arrives, the time required for decoding the streaming media data is shortened to 0.15 seconds, if the display is performed according to the time difference before the update, unnecessary delay is caused, and the fluency of video playing needs to be improved. If the time difference between the data decoding synchronization signal and the vertical synchronization signal is shortened to 0.16 second according to the data decoding duration counted in real time, the effect of playing the streaming media data is improved to a certain extent.
And S320, updating the current time difference between the arrival time of the vertical synchronizing signal and the arrival time of the data decoding synchronizing signal according to the statistical distribution result of the decoding duration.
In the statistical process of the data of a large number of historical decoding durations, the distribution of the data may take the form of a poisson distribution, a gaussian distribution or other distributions, and can be generally determined by calculating the data such as the mean, the variance and the mean square deviation of the statistical data. Illustratively, when the statistical distribution result conforms to the gaussian distribution characteristic, the sum of the mean value of the statistical distribution result and three times of the standard deviation is used as the time difference between the arrival time of the corresponding data decoding synchronization signal and the arrival time of the vertical synchronization signal in the next data decoding of the unexpired data in the buffered streaming media data at the current time.
S330, receiving the next streaming media data packet of the current decoded streaming media data and performing data caching.
S340, when a data decoding synchronization signal is received, filtering out overdue data in the cached streaming media data according to the currently set data caching duration and the timestamp of the received streaming media data, and performing data decoding on unexpired data in the cached streaming media data.
And S350, when the vertical synchronous signal is received, rendering and displaying the decoded streaming media data.
Here, the vertical synchronization signal and the data decoding synchronization signal received in this step are the same-period signals, and the current time difference between the arrival time of the vertical synchronization signal and the arrival time of the data decoding synchronization signal is the updated time difference.
According to the technical scheme of the embodiment of the disclosure, in the process of decoding and displaying the streaming media data each time, the data decoding duration is counted, the time difference between the arrival time of the data decoding synchronization signal and the arrival time of the vertical synchronization signal is updated according to the counting result, and then the data is decoded and displayed according to the updated time difference in the process of subsequently receiving the streaming media data and performing data decoding and displaying. According to the technical scheme of the embodiment of the disclosure, the problems that the real-time performance of the streaming media data playing needs to be improved and the real-time performance and the fluency of the streaming media data playing cannot be considered are solved, and the pause of the streaming media data playing can be reduced, so that the streaming media data can be displayed uniformly and smoothly. The streaming media data display method provided by the embodiment of the disclosure and the streaming media data display method provided by the embodiment belong to the same disclosure concept, and the technical details that are not described in detail in the embodiment can be referred to the embodiment, and the same technical features have the same beneficial effects in the embodiment and the embodiment.
Example four
Fig. 6 is a schematic structural diagram of a streaming media data display device according to a fourth embodiment of the disclosure. The streaming media data display device provided by the embodiment is suitable for the situation of real-time audio and video data display.
As shown in fig. 6, the streaming media data display device includes: a data receiving module 410, a data decoding module 420 and a data displaying module 430.
The data receiving module 410 is configured to receive streaming media data and perform data caching; a data decoding module 420, configured to, when receiving a data decoding synchronization signal, filter out expired data in cached streaming media data according to a currently set data caching duration and a timestamp of the received streaming media data, and perform data decoding on unexpired data in the cached streaming media data; the data display module 430 is configured to render and display the decoded streaming media data when a vertical synchronization signal is received, where the vertical synchronization signal and the data decoding synchronization signal are same-period signals, and a current time difference between an arrival time of the vertical synchronization signal and an arrival time of the data decoding synchronization signal is greater than or equal to a data decoding duration of unexpired data in the buffered streaming media data.
According to the technical scheme of the embodiment of the disclosure, the received streaming media data is cached according to the currently set adjustable data caching duration; then, when receiving a data decoding synchronization signal, filtering out overdue data in the cached streaming media data, and performing data decoding on unexpired data in the cached streaming media data; and then, when a vertical synchronizing signal is received, rendering and displaying the decoded streaming media data, wherein the vertical synchronizing signal and the data decoding synchronizing signal are same-period signals, and the current time difference between the arrival time of the vertical synchronizing signal and the arrival time of the data decoding synchronizing signal is greater than or equal to the data decoding duration of the unexpired data in the cached streaming media data, so that all the decoded streaming media data are immediately displayed after being decoded. According to the technical scheme of the embodiment of the disclosure, the problems that the real-time performance of the streaming media data playing needs to be improved and the real-time performance and the fluency of the streaming media data playing cannot be considered are solved, and the pause of the streaming media data playing can be reduced, so that the streaming media data can be displayed uniformly and smoothly.
In some optional implementations, the streaming media data display apparatus further includes a data decoding synchronization signal generation module:
the decoding duration for performing data decoding on the unexpired data in the cached streaming media data at the current time and the decoding duration for performing data decoding on the past data in a first preset historical time period are counted; and updating the current time difference according to the statistical distribution result of the decoding duration.
In some optional implementation manners, the data decoding synchronization signal generation module is specifically configured to, when the statistical distribution result meets a gaussian distribution characteristic, use a sum of a mean value of the statistical distribution result and three times of a standard deviation as a next data decoding for data decoding of the unexpired data in the buffered streaming media data at the current time, where a time difference between a corresponding data decoding synchronization signal arrival time and a vertical synchronization signal arrival time is obtained.
In some optional implementation manners, the streaming media data display apparatus further includes a data buffer length updating module, configured to:
calculating a first time difference value between the time of receiving the streaming media data and the arrival time of the data decoding synchronization signal or the arrival time of the vertical synchronization signal;
counting the first time difference value and historical first time difference between the time of receiving the streaming media data in the past in a second preset historical time period before the time of receiving the streaming media data and the arrival time of a data decoding synchronous signal or the arrival time of a vertical synchronous signal corresponding to the streaming media data received in the past;
and updating the currently set data cache length according to the statistical distribution result of each first time difference.
In some optional implementation manners, the data cache length updating module is further specifically configured to, when the statistical distribution result of each first time difference meets the gaussian distribution characteristic, take a sum of a mean value of the statistical distribution result of each first time difference and three times of a standard deviation as a currently set data cache length corresponding to the next received streaming media data.
In some optional implementations, the data decoding module 420 is specifically configured to:
determining the caching duration of each cached streaming media data according to the time when the data decoding synchronization signal is received and the arrival time stamp of each cached streaming media data in the streaming media data caching queue;
and deleting the streaming media data of which the caching duration is longer than the currently set data caching duration in each caching streaming media data as expired data.
In some optional implementations, the data decoding synchronization signal generation module is further configured to: and determining the next data decoding of the current data decoding of the unexpired data in the cached streaming media data according to the statistical distribution result of the decoding duration and the arrival time of the synchronous clock signal with a preset time difference with the vertical synchronous signal, wherein the time difference between the arrival time of the corresponding data decoding synchronous signal and the arrival time of the vertical synchronous signal is the time difference between the current data decoding synchronous signal and the current data decoding synchronous signal.
The streaming media data display device provided by the embodiment of the disclosure can execute the streaming media data display method provided by any embodiment of the disclosure, and has corresponding functional modules and beneficial effects of the execution method.
It should be noted that, the units and modules included in the apparatus are merely divided according to functional logic, but are not limited to the above division as long as the corresponding functions can be implemented; in addition, specific names of the functional units are only used for distinguishing one functional unit from another, and are not used for limiting the protection scope of the embodiments of the present disclosure.
EXAMPLE five
Referring now to fig. 7, a schematic diagram of an electronic device (e.g., the terminal device or the server in fig. 7) 500 suitable for implementing embodiments of the present disclosure is shown. The terminal device in the embodiments of the present disclosure may include, but is not limited to, a mobile terminal such as a mobile phone, a notebook computer, a digital broadcast receiver, a PDA (personal digital assistant), a PAD (tablet computer), a PMP (portable multimedia player), a vehicle terminal (e.g., a car navigation terminal), and the like, and a stationary terminal such as a digital TV, a desktop computer, and the like. The electronic device shown in fig. 7 is only an example, and should not bring any limitation to the functions and the scope of use of the embodiments of the present disclosure.
As shown in fig. 7, the electronic device 500 may include a processing means (e.g., a central processing unit, a graphics processor, etc.) 501 that may perform various appropriate actions and processes according to a program stored in a Read-Only Memory (ROM) 502 or a program loaded from a storage means 506 into a Random Access Memory (RAM) 503. In the RAM503, various programs and data necessary for the operation of the electronic apparatus 500 are also stored. The processing device 501, the ROM502, and the RAM503 are connected to each other through a bus 504. An input/output (I/O) interface 505 is also connected to bus 504.
Generally, the following devices may be connected to the I/O interface 505: input devices 506 including, for example, a touch screen, touch pad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, etc.; output devices 507 including, for example, a Liquid Crystal Display (LCD), speakers, vibrators, and the like; storage devices 508 including, for example, magnetic tape, hard disk, etc.; and a communication device 509. The communication means 509 may allow the electronic device 500 to communicate with other devices wirelessly or by wire to exchange data. While fig. 7 illustrates an electronic device 500 having various means, it is to be understood that not all illustrated means are required to be implemented or provided. More or fewer devices may alternatively be implemented or provided.
In particular, according to an embodiment of the present disclosure, the processes described above with reference to the flowcharts may be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product comprising a computer program carried on a non-transitory computer readable medium, the computer program containing program code for performing the method illustrated by the flow chart. In such an embodiment, the computer program may be downloaded and installed from a network via the communication means 509, or installed from the storage means 506, or installed from the ROM 502. The computer program performs the above-described functions defined in the streaming media data display method of the embodiment of the present disclosure when executed by the processing device 501.
The electronic device provided by the embodiment of the present disclosure and the streaming media data display method provided by the above embodiment belong to the same disclosure concept, and technical details that are not described in detail in the embodiment can be referred to the above embodiment, and the embodiment has the same beneficial effects as the above embodiment.
EXAMPLE six
The embodiment of the present disclosure provides a computer storage medium, on which a computer program is stored, and the program, when executed by a processor, implements the streaming media data display method provided by the above embodiment.
It should be noted that the computer readable medium in the present disclosure can be a computer readable signal medium or a computer readable storage medium or any combination of the two. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples of the computer readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a Read-Only Memory (ROM), an Erasable Programmable Read-Only Memory (EPROM) or FLASH Memory (FLASH), an optical fiber, a portable compact disc Read-Only Memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the present disclosure, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In contrast, in the present disclosure, a computer readable signal medium may comprise a propagated data signal with computer readable program code embodied therein, either in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: electrical wires, optical cables, RF (radio frequency), etc., or any suitable combination of the foregoing.
In some embodiments, the clients, servers may communicate using any currently known or future developed network Protocol, such as HTTP (Hyper Text Transfer Protocol), and may be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), the Internet (e.g., the Internet), and peer-to-peer networks (e.g., ad hoc peer-to-peer networks), as well as any currently known or future developed network.
The computer readable medium may be embodied in the electronic device; or may be separate and not incorporated into the electronic device.
The computer readable medium carries one or more programs which, when executed by the electronic device, cause the electronic device to:
receiving streaming media data and caching the data;
when a data decoding synchronization signal is received, filtering out overdue data in cached streaming media data according to the currently set data caching duration and the timestamp of the received streaming media data, and performing data decoding on unexpired data in the cached streaming media data;
and when a vertical synchronizing signal is received, rendering and displaying the decoded streaming media data, wherein the vertical synchronizing signal and the data decoding synchronizing signal are same-period signals, and the current time difference between the arrival time of the vertical synchronizing signal and the arrival time of the data decoding synchronizing signal is greater than or equal to the data decoding duration of unexpired data in the cached streaming media data.
Computer program code for carrying out operations for the present disclosure may be written in any combination of one or more programming languages, including but not limited to an object oriented programming language such as Java, Smalltalk, C + +, and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider).
The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
The units described in the embodiments of the present disclosure may be implemented by software or hardware. The names of the units and modules do not limit the units and modules in some cases, and for example, the data generation module may be described as a "video data generation module".
The functions described herein above may be performed, at least in part, by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: a Field Programmable Gate Array (FPGA), an Application Specific Integrated Circuit (ASIC), an Application Specific Standard Part (ASSP), a System On Chip (SOC), a Complex Programmable Logic Device (CPLD), and the like.
In the context of this disclosure, a machine-readable medium may be a tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
According to one or more embodiments of the present disclosure, [ example one ] there is provided a streaming media data display method, the method including:
receiving streaming media data and caching the data;
when a data decoding synchronization signal is received, filtering out overdue data in cached streaming media data according to the currently set data caching duration and the timestamp of the received streaming media data, and performing data decoding on unexpired data in the cached streaming media data;
and when a vertical synchronizing signal is received, rendering and displaying the decoded streaming media data, wherein the vertical synchronizing signal and the data decoding synchronizing signal are same-period signals, and the current time difference between the arrival time of the vertical synchronizing signal and the arrival time of the data decoding synchronizing signal is greater than or equal to the data decoding duration of unexpired data in the cached streaming media data.
According to one or more embodiments of the present disclosure, [ example two ] there is provided a streaming media data display method, further comprising:
counting the decoding time length for decoding the unexpired data in the cached streaming media data at the current time and the decoding time length for decoding the data at the previous time in a first preset historical time period;
and updating the current time difference according to the statistical distribution result of the decoding duration.
According to one or more embodiments of the present disclosure, [ example three ] there is provided a streaming media data display method, further comprising:
the updating the current time difference according to the statistical distribution result of the decoding duration includes:
and when the statistical distribution result accords with the Gaussian distribution characteristic, taking the sum of the mean value of the statistical distribution result and three times of the standard deviation as the time difference between the arrival time of the corresponding data decoding synchronization signal and the arrival time of the vertical synchronization signal in the next data decoding of the current data decoding of the unexpired data in the cached streaming media data.
According to one or more embodiments of the present disclosure, [ example four ] there is provided a streaming media data display method, further comprising:
calculating a first time difference value between the time of receiving the streaming media data and the arrival time of the data decoding synchronization signal or the arrival time of the vertical synchronization signal;
counting historical first time difference between the first time difference and the time of receiving the streaming media data in the past in a second preset historical time period before the time of receiving the streaming media data and the arrival time of the data decoding synchronization signal or the arrival time of the vertical synchronization signal corresponding to the streaming media data received in the past;
and updating the currently set data cache length according to the statistical distribution result of each first time difference.
According to one or more embodiments of the present disclosure, [ example five ] there is provided a streaming media data display method, further comprising:
the updating the currently set data cache length according to the statistical distribution result of each first time difference includes:
and when the statistical distribution result of each first time difference accords with the Gaussian distribution characteristic, taking the sum of the mean value of the statistical distribution result of each first time difference and three times of the standard deviation as the currently set data cache length corresponding to the next received streaming media data.
According to one or more embodiments of the present disclosure, [ example six ] there is provided a streaming media data display method, further comprising:
when receiving a data decoding synchronization signal, filtering out outdated data in the cached streaming media data according to the currently set data caching duration and the timestamp of the received streaming media data, wherein the method comprises the following steps:
determining the caching duration of each cached streaming media data according to the time when the data decoding synchronization signal is received and the arrival time stamp of each cached streaming media data in the streaming media data caching queue;
and deleting the streaming media data of which the caching duration is longer than the currently set data caching duration in each caching streaming media data as expired data.
According to one or more embodiments of the present disclosure, [ example seven ] there is provided a streaming media data display method, further comprising:
the updating the current time difference according to the statistical distribution result of the decoding duration further includes:
and determining the next data decoding of the current data decoding of the unexpired data in the cached streaming media data according to the statistical distribution result of the decoding duration and the arrival time of the synchronous clock signal with a preset time difference with the vertical synchronous signal, wherein the time difference between the arrival time of the corresponding data decoding synchronous signal and the arrival time of the vertical synchronous signal is the time difference between the current data decoding synchronous signal and the current data decoding synchronous signal.
According to one or more embodiments of the present disclosure, [ example eight ] there is provided a streaming media data display apparatus including:
the data receiving module is used for receiving the streaming media data and caching the data;
the data decoding module is used for filtering out overdue data in the cached streaming media data according to the currently set data caching duration and the timestamp of the received streaming media data when receiving a data decoding synchronization signal, and performing data decoding on unexpired data in the cached streaming media data;
and the data display module is used for rendering and displaying the decoded streaming media data when a vertical synchronization signal is received, wherein the vertical synchronization signal and the data decoding synchronization signal are same-period signals, and the current time difference between the arrival time of the vertical synchronization signal and the arrival time of the data decoding synchronization signal is greater than or equal to the data decoding duration of the unexpired data in the cached streaming media data.
According to one or more embodiments of the present disclosure, [ example nine ] there is provided a streaming media data display apparatus, further comprising:
the data decoding synchronization signal generation module is used for counting the decoding time for decoding the unexpired data in the cached streaming media data at the current time and the decoding time for decoding the data at the previous time in a first preset historical time period; and updating the current time difference according to the statistical distribution result of the decoding duration.
According to one or more embodiments of the present disclosure, [ example ten ] there is provided a streaming media data display apparatus, further comprising:
the data decoding synchronization signal generation module is specifically configured to, when the statistical distribution result meets the gaussian distribution characteristic, use a sum of a mean value of the statistical distribution result and three times of a standard deviation as a time difference between a time of arrival of a corresponding data decoding synchronization signal and a time of arrival of a vertical synchronization signal in next data decoding of the unexpired data in the cached streaming media data at the present time.
According to one or more embodiments of the present disclosure, [ example eleven ] there is provided a streaming media data display device, further comprising:
a data cache length update module to:
calculating a first time difference value between the time of receiving the streaming media data and the arrival time of the data decoding synchronization signal or the arrival time of the vertical synchronization signal;
counting historical first time difference between the first time difference and the time of receiving the streaming media data in the past in a second preset historical time period before the time of receiving the streaming media data and the arrival time of the data decoding synchronization signal or the arrival time of the vertical synchronization signal corresponding to the streaming media data received in the past;
and updating the currently set data cache length according to the statistical distribution result of each first time difference.
According to one or more embodiments of the present disclosure, [ example twelve ] there is provided a streaming media data display apparatus, further comprising:
the data cache length updating module is further specifically configured to, when the statistical distribution result of each first time difference meets the gaussian distribution characteristic, take a sum of a mean value of the statistical distribution result of each first time difference and three times of a standard deviation as a currently set data cache length corresponding to the next received streaming media data.
According to one or more embodiments of the present disclosure, [ example thirteen ] provides a streaming media data display apparatus, further including:
the data decoding module is specifically configured to:
determining the caching duration of each cached streaming media data according to the time when the data decoding synchronization signal is received and the arrival time stamp of each cached streaming media data in the streaming media data caching queue;
and deleting the streaming media data of which the caching duration is longer than the currently set data caching duration in each caching streaming media data as expired data.
According to one or more embodiments of the present disclosure, [ example fourteen ] there is provided a streaming media data display apparatus, further comprising:
the data decoding synchronization signal generation module is further configured to: and determining the next data decoding of the current data decoding of the unexpired data in the cached streaming media data according to the statistical distribution result of the decoding duration and the arrival time of the synchronous clock signal with a preset time difference with the vertical synchronous signal, wherein the time difference between the arrival time of the corresponding data decoding synchronous signal and the arrival time of the vertical synchronous signal is the time difference between the current data decoding synchronous signal and the current data decoding synchronous signal.
The foregoing description is only exemplary of the preferred embodiments of the disclosure and is illustrative of the principles of the technology employed. It will be appreciated by those skilled in the art that the scope of the disclosure herein is not limited to the particular combination of features described above, but also encompasses other combinations of features described above or equivalents thereof without departing from the spirit of the disclosure. For example, the above features and (but not limited to) the features disclosed in this disclosure having similar functions are replaced with each other to form the technical solution.
Further, while operations are depicted in a particular order, this should not be understood as requiring that such operations be performed in the particular order shown or in sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Likewise, while several specific implementation details are included in the above discussion, these should not be construed as limitations on the scope of the disclosure. Certain features that are described in the context of separate embodiments can also be implemented in combination in a single embodiment. Conversely, various features that are described in the context of a single embodiment can also be implemented in multiple embodiments separately or in any suitable subcombination.
Although the subject matter has been described in language specific to structural features and/or methodological acts, it is to be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are disclosed as example forms of implementing the claims.

Claims (10)

1. A streaming media data display method is characterized by comprising the following steps:
receiving streaming media data and caching the data;
when a data decoding synchronization signal is received, filtering out overdue data in cached streaming media data according to the currently set data caching duration and the timestamp of the received streaming media data, and performing data decoding on unexpired data in the cached streaming media data;
and when a vertical synchronizing signal is received, rendering and displaying the decoded streaming media data, wherein the vertical synchronizing signal and the data decoding synchronizing signal are same-period signals, and the current time difference between the arrival time of the vertical synchronizing signal and the arrival time of the data decoding synchronizing signal is greater than or equal to the data decoding duration of unexpired data in the cached streaming media data.
2. The method of claim 1, further comprising:
counting the decoding time length for decoding the unexpired data in the cached streaming media data at the current time and the decoding time length for decoding the data at the previous time in a first preset historical time period;
and updating the current time difference according to the statistical distribution result of the decoding duration.
3. The method of claim 2, wherein the updating the current time difference according to the statistical distribution of the decoding duration comprises:
and when the statistical distribution result accords with the Gaussian distribution characteristic, taking the sum of the mean value of the statistical distribution result and three times of the standard deviation as the time difference between the arrival time of the corresponding data decoding synchronization signal and the arrival time of the vertical synchronization signal in the next data decoding of the current data decoding of the unexpired data in the cached streaming media data.
4. The method of claim 1, further comprising:
calculating a first time difference value between the time of receiving the streaming media data and the arrival time of the data decoding synchronization signal or the arrival time of the vertical synchronization signal;
counting historical first time difference between the first time difference and the time of receiving the streaming media data in the past in a second preset historical time period before the time of receiving the streaming media data and the arrival time of the data decoding synchronization signal or the arrival time of the vertical synchronization signal corresponding to the streaming media data received in the past;
and updating the currently set data cache length according to the statistical distribution result of each first time difference.
5. The method according to claim 4, wherein the updating the currently set data buffer length according to the statistical distribution result for each first time difference comprises:
and when the statistical distribution result of each first time difference accords with the Gaussian distribution characteristic, taking the sum of the mean value of the statistical distribution result of each first time difference and three times of the standard deviation as the currently set data cache length corresponding to the next received streaming media data.
6. The method of claim 1, wherein filtering out stale data in buffered streaming media data according to a currently set data buffering duration and a timestamp of receiving the streaming media data when receiving a data decoding synchronization signal, comprises:
determining the caching duration of each cached streaming media data according to the time when the data decoding synchronization signal is received and the arrival time stamp of each cached streaming media data in the streaming media data caching queue;
and deleting the streaming media data of which the caching duration is longer than the currently set data caching duration in each caching streaming media data as expired data.
7. The method of claim 2, wherein the updating the current time difference according to the result of the statistical distribution of the decoding durations further comprises:
and determining the next data decoding of the current data decoding of the unexpired data in the cached streaming media data according to the statistical distribution result of the decoding duration and the arrival time of the synchronous clock signal with a preset time difference with the vertical synchronous signal, wherein the time difference between the arrival time of the corresponding data decoding synchronous signal and the arrival time of the vertical synchronous signal is the time difference between the current data decoding synchronous signal and the current data decoding synchronous signal.
8. A streaming media data display device, comprising:
the data receiving module is used for receiving the streaming media data and caching the data;
the data decoding module is used for filtering out overdue data in the cached streaming media data according to the currently set data caching duration and the timestamp of the received streaming media data when receiving a data decoding synchronization signal, and performing data decoding on unexpired data in the cached streaming media data;
and the data display module is used for rendering and displaying the decoded streaming media data when a vertical synchronization signal is received, wherein the vertical synchronization signal and the data decoding synchronization signal are same-period signals, and the current time difference between the arrival time of the vertical synchronization signal and the arrival time of the data decoding synchronization signal is greater than or equal to the data decoding duration of the unexpired data in the cached streaming media data.
9. An electronic device, characterized in that the electronic device comprises:
one or more processors;
a storage device for storing one or more programs,
when executed by the one or more processors, cause the one or more processors to implement a streaming media data display method as recited in any of claims 1-7.
10. A storage medium containing computer-executable instructions for performing the streaming media data display method of any one of claims 1-7 when executed by a computer processor.
CN202110619185.4A 2021-06-03 2021-06-03 Streaming media data display method and device, electronic equipment and storage medium Active CN113364767B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110619185.4A CN113364767B (en) 2021-06-03 2021-06-03 Streaming media data display method and device, electronic equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110619185.4A CN113364767B (en) 2021-06-03 2021-06-03 Streaming media data display method and device, electronic equipment and storage medium

Publications (2)

Publication Number Publication Date
CN113364767A CN113364767A (en) 2021-09-07
CN113364767B true CN113364767B (en) 2022-07-12

Family

ID=77531568

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110619185.4A Active CN113364767B (en) 2021-06-03 2021-06-03 Streaming media data display method and device, electronic equipment and storage medium

Country Status (1)

Country Link
CN (1) CN113364767B (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115550709B (en) * 2022-01-07 2023-09-26 荣耀终端有限公司 Data processing method and electronic equipment
CN115378920B (en) * 2022-10-26 2023-04-14 南京大鱼半导体有限公司 Method and equipment for adjusting audio time delay

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102439974A (en) * 2009-05-22 2012-05-02 株式会社巨晶片 Video playback system and video playback method
CN109474768A (en) * 2017-09-08 2019-03-15 中兴通讯股份有限公司 A kind of method and device improving image fluency
CN110503708A (en) * 2019-07-03 2019-11-26 华为技术有限公司 A kind of image processing method and electronic equipment based on vertical synchronizing signal
CN112153082A (en) * 2020-11-25 2020-12-29 深圳乐播科技有限公司 Method and device for smoothly displaying real-time streaming video picture in android system
WO2020259457A1 (en) * 2019-06-25 2020-12-30 华为技术有限公司 Control method based on vertical synchronizing signal, and electronic device
CN112843676A (en) * 2021-01-12 2021-05-28 腾讯科技（深圳）有限公司 Data processing method, device, terminal, server and storage medium

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2017005611A (en) * 2015-06-15 2017-01-05 富士通株式会社 Dynamic image decoding device and dynamic image decoding method
US20170223382A1 (en) * 2016-02-03 2017-08-03 Sigma Designs, Inc. Method of reducing latency and a video decoder of the same
US10974142B1 (en) * 2019-10-01 2021-04-13 Sony Interactive Entertainment Inc. Synchronization and offset of VSYNC between cloud gaming server and client

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102439974A (en) * 2009-05-22 2012-05-02 株式会社巨晶片 Video playback system and video playback method
CN109474768A (en) * 2017-09-08 2019-03-15 中兴通讯股份有限公司 A kind of method and device improving image fluency
WO2020259457A1 (en) * 2019-06-25 2020-12-30 华为技术有限公司 Control method based on vertical synchronizing signal, and electronic device
CN110503708A (en) * 2019-07-03 2019-11-26 华为技术有限公司 A kind of image processing method and electronic equipment based on vertical synchronizing signal
CN112153082A (en) * 2020-11-25 2020-12-29 深圳乐播科技有限公司 Method and device for smoothly displaying real-time streaming video picture in android system
CN112843676A (en) * 2021-01-12 2021-05-28 腾讯科技（深圳）有限公司 Data processing method, device, terminal, server and storage medium

Also Published As

Publication number Publication date
CN113364767A (en) 2021-09-07

Similar Documents

Publication Publication Date Title
CN113364767B (en) Streaming media data display method and device, electronic equipment and storage medium
CN111064987B (en) Information display method and device and electronic equipment
CN110049361B (en) Display control method and device, screen projection equipment and computer readable medium
CN112954354B (en) Video transcoding method, device, equipment and medium
CN110290398B (en) Video issuing method and device, storage medium and electronic equipment
CN112199174A (en) Message sending control method and device, electronic equipment and computer readable storage medium
CN113891132A (en) Audio and video synchronization monitoring method and device, electronic equipment and storage medium
CN114095671A (en) Cloud conference live broadcast system, method, device, equipment and medium
CN113794942B (en) Method, apparatus, system, device and medium for switching view angle of free view angle video
CN110910469A (en) Method, device, medium and electronic equipment for drawing handwriting
CN113542856A (en) Reverse playing method, device, equipment and computer readable medium for online video
CN113242446B (en) Video frame caching method, video frame forwarding method, communication server and program product
CN112153322B (en) Data distribution method, device, equipment and storage medium
CN114630170A (en) Audio and video synchronization method and device, electronic equipment and storage medium
CN114630157A (en) Live broadcast starting method, equipment and program product
CN114979762A (en) Video downloading and transmission method, device, terminal equipment, server and medium
CN112887742B (en) Live stream processing method, device, equipment and storage medium
CN113115074B (en) Video jamming processing method and device
CN113495712A (en) Automatic volume adjustment method, apparatus, medium, and device
CN112995780B (en) Network state evaluation method, device, equipment and storage medium
WO2022188688A1 (en) Information sending method and apparatus, electronic device, and computer-readable storage medium
CN112653691B (en) Data processing method, device, equipment and storage medium
CN115623267A (en) Dynamic picture display method and device, electronic equipment and storage medium
CN115798492A (en) Audio playing method and equipment
CN114979712A (en) Video playing starting method, device, equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant