CN115665466A - Multimedia data processing method and device, electronic equipment and storage medium - Google Patents

Abstract

The present disclosure relates to a multimedia data processing method and apparatus, an electronic device, and a storage medium, wherein the multimedia data processing method includes: receiving configuration information which is sent by a server and is about multimedia data pre-caching; sending a multimedia data request to a server to request to receive recommended multimedia data from the server; and on the basis of the configuration information, under the condition that a first preset condition is met, locally acquiring pre-cached multimedia data and outputting the pre-cached multimedia data, wherein the first preset condition is used for determining that the current receiving condition of the recommended multimedia data is not good. By receiving the configuration information which is sent by the server and contains the first preset condition, the receiving condition of the recommended multimedia data can be identified according to the first preset condition, and the local pre-cached multimedia data can be output when the condition is not good, so that loading waiting and loading failure are reduced, and the reliable and continuous output of the multimedia data is facilitated.

Description

Multimedia data processing method and device, electronic equipment and storage medium

Technical Field

The present disclosure relates to the field of network transmission technologies, and in particular, to a multimedia data processing method and apparatus, an electronic device, and a storage medium.

Background

The improvement of the internet data transmission rate enables people to browse multimedia contents in various forms, such as pictures, music, short videos, live broadcasts, videos and the like, on line through mobile phones. But this also presents a potential problem. The high network speed improves the volume of online browsing contents, for example, short videos are often different from 5M to 30M, and a user often browses a plurality of short videos continuously, which means that once the network environment is poor, the multimedia contents with large volume are difficult to load smoothly, and the reliability and continuity of multimedia content output are affected.

Disclosure of Invention

The present disclosure provides a multimedia data processing method and apparatus, an electronic device, and a storage medium, to solve at least the problems of how to guarantee reliability and continuity of multimedia content output in the related art, and may not solve any of the above problems.

According to a first aspect of the present disclosure, there is provided a multimedia data processing method, including: receiving configuration information about multimedia data pre-caching sent by a server; sending a multimedia data request to the server to request to receive recommended multimedia data from the server; based on the configuration information, under the condition that a first preset condition is met, obtaining pre-cached multimedia data from a local place and outputting the pre-cached multimedia data, wherein the first preset condition is used for determining that the current receiving condition of the recommended multimedia data is not good.

Optionally, before the sending the multimedia data request to the server, the multimedia data processing method further includes: and downloading multimedia data from the server under the condition of meeting a second preset condition based on the configuration information, and obtaining the pre-cached multimedia data to store the pre-cached multimedia data to the local, wherein the second preset condition is used for limiting the downloading time of the multimedia data.

Optionally, the configuration information includes a preset buffer amount, where the downloading the multimedia data from the server includes: and downloading multimedia data according to the preset buffer memory amount so as to obtain the pre-buffer multimedia data of the preset buffer memory amount.

Optionally, the configuration information includes a preset effective duration, where the outputting the pre-cached multimedia data includes: and outputting the pre-cached multimedia data under the condition that the local storage time length of the pre-cached multimedia data is less than or equal to the preset effective time length.

Optionally, the configuration information includes a preset number, where the locally acquiring the pre-cached multimedia data includes: and locally acquiring the preset amount of the pre-cached multimedia data.

Optionally, the outputting the pre-buffered multimedia data includes: outputting the pre-cached multimedia data of the preset quantity; in the process of outputting the preset number of the pre-cached multimedia data, if the recommended multimedia data is received, after the output of the current one of the pre-cached multimedia data is finished, the output of the remaining pre-cached multimedia data is stopped, and the recommended multimedia data is output, or in the process of outputting the preset number of the pre-cached multimedia data, if the recommended multimedia data is received, after the output of the preset number of the pre-cached multimedia data is finished, the recommended multimedia data is output.

Optionally, the first preset condition includes at least one of: the multimedia data request fails, the multimedia data request does not respond when overtime, and the multimedia data request is currently in a network-free environment and a weak network environment.

Optionally, the configuration information includes at least one of a preset response duration, a preset query period, and a weak network threshold; determining that the multimedia data request is overtime and not responded under the condition that the multimedia data request is not responded after a preset response time length; in the process of receiving the recommended multimedia data, inquiring the current network environment according to the preset inquiry period to determine whether the current network environment is in a wireless environment; and under the condition that the current environment is not in the network-free environment, acquiring a current network quality value, and under the condition that the current network quality value is less than or equal to the weak network threshold value, determining that the current environment is in the weak network environment.

Optionally, the second preset condition comprises at least one of: the application program is in a background running state, reaches a preset downloading period, is currently in a preset time period, is currently in a Wi-Fi environment, and can output the pre-cached multimedia data with an amount smaller than a preset amount; the configuration information includes at least one of the preset download cycle, the preset time period, network environment indication information and the preset amount, wherein the network environment indication information is used for indicating whether the second preset condition includes that the current Wi-Fi environment is included.

Optionally, the configuration information further includes a preset effective duration, and the outputtable pre-cached multimedia data includes pre-cached multimedia data whose local storage duration is less than or equal to the preset effective duration and has not been output yet.

Optionally, the configuration information is determined by the server according to reference data, where the reference data includes at least one of: historical user behavior data, historical network quality data.

According to a second aspect of the present disclosure, there is provided a multimedia data processing apparatus comprising: the receiving unit is configured to execute configuration information about multimedia data pre-caching issued by a receiving server; a request unit configured to perform a multimedia data transmission request to the server to request reception of recommended multimedia data from the server; and the processing unit is configured to execute acquiring pre-cached multimedia data from the local and outputting the pre-cached multimedia data under the condition that a first preset condition is met based on the configuration information, wherein the first preset condition is used for determining that the current receiving condition of the recommended multimedia data is not good.

Optionally, the processing unit is further configured to download multimedia data from the server based on the configuration information and obtain the pre-cached multimedia data to be stored locally, where a second preset condition is satisfied, and the second preset condition is used to limit a download opportunity of the multimedia data.

Optionally, the configuration information includes a preset buffer amount, and the processing unit is further configured to execute downloading multimedia data according to the preset buffer amount to obtain the preset buffer multimedia data of the preset buffer amount.

Optionally, the configuration information includes a preset effective duration, and the processing unit is further configured to execute outputting the pre-cached multimedia data, including: and outputting the pre-cached multimedia data under the condition that the local storage time length of the pre-cached multimedia data is less than or equal to the preset effective time length.

Optionally, the configuration information includes a preset number, and the processing unit is further configured to locally acquire the preset number of the pre-cached multimedia data.

Optionally, the processing unit is further configured to output the preset number of the pre-buffered multimedia data; in the process of outputting the preset number of the pre-cached multimedia data, if the recommended multimedia data is received, after the output of the current one of the pre-cached multimedia data is finished, the output of the remaining pre-cached multimedia data is stopped, and the recommended multimedia data is output, or in the process of outputting the preset number of the pre-cached multimedia data, if the recommended multimedia data is received, after the output of the preset number of the pre-cached multimedia data is finished, the recommended multimedia data is output.

Optionally, the first preset condition includes at least one of: the multimedia data request fails, the multimedia data request is overtime and not responded, and the multimedia data request is currently in a network-free environment and a weak network environment.

Optionally, the configuration information includes at least one of a preset response duration, a preset query period, and a weak network threshold; determining that the multimedia data request is overtime and not responded under the condition that the multimedia data request is not responded after a preset response time length; in the process of receiving the recommended multimedia data, inquiring the current network environment according to the preset inquiry period to determine whether the current network environment is in a wireless environment or not; and under the condition that the current environment is not in the network-free environment, acquiring a current network quality value, and under the condition that the current network quality value is less than or equal to the weak network threshold value, determining that the current environment is in the weak network environment.

Optionally, the second preset condition comprises at least one of: the application program is in a background running state, reaches a preset downloading period, is currently in a preset time period, is currently in a Wi-Fi environment, and can output the pre-cached multimedia data with an amount smaller than a preset amount; the configuration information includes at least one of the preset download cycle, the preset time period, network environment indication information and the preset amount, wherein the network environment indication information is used for indicating whether the second preset condition includes that the current Wi-Fi environment is included.

Optionally, the configuration information further includes a preset effective duration, and the outputtable pre-cached multimedia data includes pre-cached multimedia data whose local storage duration is less than or equal to the preset effective duration and has not been output yet.

Optionally, the configuration information is determined by the server according to reference data, where the reference data includes at least one of: historical user behavior data and historical network quality data.

According to a third aspect of the present disclosure, there is provided an electronic device comprising: at least one processor; at least one memory storing computer-executable instructions, wherein the computer-executable instructions, when executed by the at least one processor, cause the at least one processor to perform a multimedia data processing method according to the present disclosure.

According to a fourth aspect of the present disclosure, there is provided a computer-readable storage medium, wherein instructions, when executed by at least one processor, cause the at least one processor to perform a multimedia data processing method according to the present disclosure.

According to a fifth aspect of the present disclosure, there is provided a computer program product comprising computer instructions which, when executed by at least one processor, implement a multimedia data processing method according to the present disclosure.

The technical scheme provided by the embodiment of the disclosure at least brings the following beneficial effects:

according to the multimedia data processing method and the multimedia data processing device, the configuration information which is sent by the server and contains the first preset condition is received, the receiving condition of the recommended multimedia data can be identified according to the first preset condition, and the local pre-cached multimedia data is output in bad conditions, so that loading waiting and loading failure are reduced, and the reliable and continuous output of the multimedia data is facilitated.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the disclosure and are not to be construed as limiting the disclosure.

Fig. 1 is a flowchart illustrating a multimedia data processing method according to an exemplary embodiment of the present disclosure;

FIG. 2 is a schematic diagram illustrating a pre-caching phase flow according to a specific embodiment of the present disclosure;

FIG. 3 is a flow chart illustrating a consumption phase according to a specific embodiment of the present disclosure;

FIG. 4 is a schematic diagram illustrating a user interface in accordance with a specific embodiment of the present disclosure;

FIG. 5 is a schematic diagram illustrating another user interface operation according to a specific embodiment of the present disclosure;

fig. 6 is a block diagram illustrating a multimedia data processing apparatus according to an exemplary embodiment of the present disclosure.

Fig. 7 is a block diagram illustrating an electronic device according to an exemplary embodiment of the present disclosure.

Detailed Description

In order to make the technical solutions of the present disclosure better understood by those of ordinary skill in the art, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below with reference to the accompanying drawings.

It should be noted that the terms "first," "second," and the like in the description and claims of the present disclosure and in the above-described drawings are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the disclosure described herein are capable of operation in sequences other than those illustrated or otherwise described herein. The embodiments described in the following examples do not represent all embodiments consistent with the present disclosure. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the disclosure, as detailed in the appended claims.

In this case, the expression "at least one of the items" in the present disclosure means a case where three types of parallel expressions "any one of the items", "a combination of any plural ones of the items", and "the entirety of the items" are included. For example, "including at least one of a and B" includes the following three cases in parallel: (1) comprises A; (2) comprises B; and (3) comprises A and B. For another example, "at least one of the first step and the second step is performed", which means that the following three cases are juxtaposed: (1) executing the step one; (2) executing the step two; and (3) executing the step one and the step two.

It should be noted that the user information (including, but not limited to, user device information, user personal information, etc.) referred to in the present disclosure is information authorized by the user or sufficiently authorized by each party.

The improvement of the internet data transmission rate enables people to browse multimedia contents in various forms, such as pictures, music, short videos, live broadcasts, videos and the like, on line through mobile phones. But this also presents a potential hazard. The high network speed increases the volume of online browsing contents, for example, short videos are often different from 5M to 30M, and a user often browses a plurality of short videos continuously, which means that once the network environment is poor, the multimedia contents with large volume are difficult to load smoothly. When the existing content supply software encounters a poor network environment, an animation of "loading" usually appears, and when the loading fails, a prompt box pops up to inform a user that the network encounters a problem and retries the user at a later time. If the user network cannot be restored to normal immediately, the user operation cannot be restored after retries, which not only affects the reliability and continuity of multimedia content output, but also affects the browsing experience of the user due to waiting for loading and retries.

According to the multimedia data processing method and device disclosed by the exemplary embodiment of the disclosure, by receiving the configuration information which is sent by the server and contains the first preset condition, the receiving condition of the recommended multimedia data can be identified according to the first preset condition, and the local pre-cached multimedia data is output in bad conditions, so that the loading waiting and loading failure are reduced, and the reliable and continuous output of the multimedia data is facilitated.

Hereinafter, a multimedia data processing method and a multimedia data processing apparatus according to exemplary embodiments of the present disclosure will be described in detail with reference to fig. 1 to 4.

Fig. 1 is a flowchart illustrating a multimedia data processing method according to an exemplary embodiment of the present disclosure. It should be understood that the multimedia data processing method according to the exemplary embodiment of the present disclosure may be implemented in a terminal device such as a smart phone, a tablet computer, a Personal Computer (PC), or may be implemented in a device such as a server.

Referring to fig. 1, in step 101, configuration information about multimedia data pre-caching sent by a server is received. The configuration information is stored in the server, so that the occupied local storage space can be reduced, the server can conveniently manage and update the configuration information in a unified manner, and the configuration can be optimized in time. Accordingly, by receiving the configuration information issued by the server, the subsequent operation can be performed based on the configuration information, and the reliable performance of the subsequent operation is ensured.

Optionally, the configuration information is determined by the server according to reference data, and the reference data includes at least one of: historical user behavior data and historical network quality data. By combining at least one of the historical behavior data and the historical network quality data of the user, the configuration information more suitable for the current user can be determined, namely, the pre-caching scheme more suitable for the current user is determined, the configuration of thousands of people is realized, and the reasonable processing of multimedia data is facilitated. How the configuration information is determined from the reference data will be described later in connection with specific configuration information. It should be appreciated that the configuration information may be updated periodically, with the update determining the configuration information based on the then most recent reference data.

At step 102, a multimedia data request is sent to the server requesting to receive recommended multimedia data from the server.

In step 103, based on the configuration information, the pre-buffered multimedia data is locally obtained and output if a first preset condition is satisfied, where the first preset condition is used to determine that a current receiving condition of the recommended multimedia data is not good. By identifying the receiving condition of the recommended multimedia data according to the first preset condition and outputting the local pre-cached multimedia data in bad conditions, the loading waiting and loading failure are reduced, and the reliable and continuous output of the multimedia data is facilitated. It should be noted that, when determining whether the first preset condition is satisfied, the determination is often performed based on a local judgment policy, but some preset parameters may be involved, and these preset parameters may be obtained from the configuration information. That is, it may be necessary to determine whether the first preset condition is satisfied in conjunction with the configuration information, or it may be possible to directly determine whether the first preset condition is satisfied without using the configuration information. Similarly, when the pre-cached multimedia data is subsequently acquired and output, the configuration information is needed or not needed, and the content of the configuration information and the strategy for acquiring and outputting the pre-cached multimedia data can be adjusted according to actual requirements. The present disclosure is not so limited.

To implement the pre-buffering of the multimedia data, optionally before the step 102, the multimedia data processing method according to the exemplary embodiment of the present disclosure further includes: and downloading the multimedia data from the server under the condition of meeting a second preset condition based on the configuration information, and obtaining pre-cached multimedia data to store the pre-cached multimedia data to the local, wherein the second preset condition is used for limiting the downloading time of the multimedia data. Whether the pre-caching operation of the multimedia data is performed or not is determined according to the second preset condition, so that the reliable acquisition of the pre-cached multimedia data can be ensured, data support is provided for the subsequent execution of the step 103, the pre-caching operation can be executed at a reasonable time, and the comprehensive operation efficiency is ensured. It should be understood that, like the first preset condition, it may be necessary to determine whether the second preset condition is satisfied in combination with the configuration information, or it may be possible to directly determine whether the second preset condition is satisfied without using the configuration information, which is not limited by the present disclosure.

Exemplary embodiments of the present disclosure are described in detail in stages below in connection with configuration information.

In the pre-buffering stage, in terms of timing, optionally, the second preset condition includes at least one of: the application program is in a background running state, reaches a preset downloading period, is currently in a preset time period, is currently in a Wi-Fi environment, and can output the pre-cached multimedia data with an amount smaller than a preset amount; the configuration information includes at least one of a preset download cycle, a preset time period, network environment indication information and a preset amount, wherein the network environment indication information is used for indicating whether the second preset condition includes that the current Wi-Fi environment is present. By configuring the second preset condition, the pre-caching operation can be guaranteed to be performed at a reasonable time, so that the pre-caching is guaranteed to be realized, and the occupation of network resources and computing resources can be reduced. It should be understood that, since the above conditions reflect the situations that can occur simultaneously, when the second preset condition includes at least two of the above conditions, the conditions may exist in the form of "and", that is, they need to be satisfied simultaneously, to be considered that the second preset condition is satisfied, or may exist in the form of "or", that is, as long as one of the conditions is satisfied, to be considered that the second preset condition is satisfied, and set as needed. In addition, when the second preset condition includes a specific condition, the parameters required for determining the specific condition should be included in the configuration information.

Specifically, when the application program is in the background running state, indicating that the application program is currently in an idle time, the idle network resource and computing resource can be used for executing the pre-caching operation.

By configuring the preset downloading period in the configuration information, the time length of at least the interval period of the two times of pre-caching operation can be ensured, and the reasonable control of the operation frequency is facilitated.

By configuring the preset amount, the pre-caching operation can be executed when the amount of the output pre-cached multimedia data is insufficient, otherwise, the stock is considered to be sufficient, the operation is not needed, and the whole operation can be reduced. Optionally, the preset amount comprises at least one of a preset number and a preset size. For the predetermined amount, the data corresponding to a complete multimedia content is regarded as a whole, such as, but not limited to, a short video, a picture, and a song. And for the preset size, the occupation of the data on the storage space can be visually displayed.

Optionally, the configuration information further includes a preset effective duration, and the output pre-cached multimedia data includes pre-cached multimedia data whose local storage duration is less than or equal to the preset effective duration and which has not been output yet. The timeliness of the data can be guaranteed by requiring that the storage time for outputting the pre-cached multimedia data is short enough. Optionally, for different users, the preset effective duration may adopt a uniform value to ensure timeliness, and may also be determined by combining with reference data, which is not limited by the present disclosure. By requiring that the pre-buffered multimedia data can be output without being output, the risk of repeatedly outputting the same data can be reduced, and both the pre-buffered multimedia data and the multimedia data can ensure the reliable output of the multimedia data. For example, the output pre-cached multimedia data can be deleted from the local, which not only saves the storage space, but also can default that the existing pre-cached multimedia data in the local is not output yet, thereby simplifying the calculation amount when confirming that the pre-cached multimedia data can be output and saving the calculation resources.

For the relation between the reference data and the preset download period, the preset amount and the preset effective duration, as an example, the user historical behavior data in the reference data may adopt a continuous browsing duration statistical value and a browsing interval duration statistical value, the longer the continuous browsing duration statistical value is, the shorter the browsing interval duration statistical value is, the shorter the preset download period may be, the more the preset amount may be, the longer the preset effective duration may be, so as to ensure sufficient amount of the pre-cached multimedia data, and vice versa. The historical network quality data can be overall evaluation data, and is positively correlated with the preset download period, negatively correlated with the preset amount and negatively correlated with the preset effective duration. Specifically, if the overall network quality of the user is low, it indicates that the user has a high demand for pre-caching multimedia data, and a smaller preset download period, a larger preset amount, and a longer preset effective duration may be selected.

By configuring the preset time period in the configuration information, the pre-caching operation can be performed only in a reasonable time period. Optionally, to account for bandwidth cost issues, pre-caching may be disabled for a certain period of time, such as, but not limited to, early-late peak hours, which helps to save bandwidth costs. It should be understood that the period other than the forbidden period is an open period, and the open period is used as a preset period in the configuration information, and in particular practice, the preset period may be configured by configuring the forbidden period or the open period, and the two are different in form and the same in nature, and all fall within the protection scope of the present disclosure. Alternatively, the preset period may be determined based on the reference data. As an example, the historical behavior data of the user in the reference data may be a high frequency browsing period or a low frequency browsing period of the user obtained by statistics, and a period other than the high frequency period may be a preset period, or the low frequency period may be the preset period. For example, but not limited to, a day may be divided into several time intervals, and the browsing frequency of the user in each time interval is counted in a selected period, and the time intervals with the highest frequency are used as the high-frequency time intervals, and the time intervals with the lowest frequency are used as the low-frequency time intervals. The historical network quality data in the reference data may be time-interval evaluation data, and a time interval with better network quality is taken as a preset time interval.

By limiting the execution of the pre-caching operation only in the Wi-Fi environment, the consumption of network data flow can be reduced, and the benefit of a user is guaranteed.

As for the pre-caching operation, optionally, the configuration information includes a preset pre-caching amount, where downloading the multimedia data from the server in the pre-caching operation includes: and downloading the multimedia data according to the preset buffer memory amount to obtain the pre-buffer multimedia data of the preset buffer memory amount. By configuring the reasonable preset buffer amount, not only can enough pre-buffer data for output in the subsequent step 103 be ensured, but also the use of the local storage space can be reasonably planned, and the comprehensive performance is improved. Specifically, the multimedia data of the preset buffer amount may be downloaded each time, or the difference may be made up by downloading the multimedia data when the existing pre-buffered multimedia data is less than the preset buffer amount, with reference to the foregoing, with the pre-buffered multimedia data in which the preset buffer amount is stored as a target. Further, the outputtable pre-buffered multimedia data stored with the preset pre-buffered amount may be used as a target, and in case that the existing outputtable pre-buffered multimedia data is less than the preset pre-buffered amount, the difference is made up by downloading the multimedia data, and at this time, the preset pre-buffered amount may be the same as the preset amount. Optionally, the preset buffer amount includes at least one of a preset buffer amount and a preset buffer size, and a relationship between the preset buffer amount and the reference data is similar to the preset amount, but an actual value may be different, and is not described herein again.

In the multimedia data consumption phase, that is, the multimedia data acquisition and consumption phase, the first preset condition optionally includes at least one of the following: the multimedia data request fails, the multimedia data request is overtime and not responded, and the multimedia data request is currently in a non-network environment and a weak network environment. Under the conditions, the recommended multimedia data can not be normally received, and at least one of the recommended multimedia data is configured as a first preset condition, so that the pre-cached multimedia data can be consumed in time when the recommended multimedia data can not be normally received, and the reliability and continuity of multimedia data output are guaranteed. It should be understood that, since these conditions reflect the situation that cannot occur simultaneously, when the first preset condition includes the above at least two conditions, these conditions exist in the form of "or", that is, as long as one of the conditions is satisfied, the first preset condition is considered to be satisfied.

Correspondingly, the configuration information includes at least one of a preset response time length, a preset query period and a weak network threshold. Under the condition that the multimedia data request is not responded after the preset response time length, the multimedia data request is determined to be overtime and not responded, and a clear judgment standard can be established for 'overtime'. In the process of receiving the recommended multimedia data, the current network environment is inquired according to the preset inquiry period so as to determine whether the current network environment is in the wireless environment or not. The method comprises the steps of obtaining a current network quality value under the condition that the current network is not in a non-network environment, determining that the current network is in a weak network environment under the condition that the current network quality value is smaller than or equal to a weak network threshold value, realizing weak network detection by combining the current network quality value and the weak network threshold value, and establishing a clear judgment standard for the weak network. It should be understood that when the first preset condition includes a specific condition, the parameters required for determining the specific condition should be included in the configuration information.

For the determination of the preset response time, the preset query period and the weak network threshold, since the preset response time and the weak network threshold can be objectively determined and the demand difference between different users is small, a uniform value can be adopted. The preset query period may be determined based on the reference data, for example, the user historical behavior data in the reference data may adopt the aforementioned continuous browsing duration statistical value, and the longer the continuous browsing duration statistical value is, the shorter the preset query period may be, to ensure that the network environment is determined in time, and the user historical behavior data may further adopt the aforementioned high-frequency browsing period and low-frequency browsing period, so as to shorten the preset query period in the high-frequency browsing period, and lengthen the preset query period in the low-frequency browsing period.

In terms of consumption operations, optionally, the configuration information includes a preset number, wherein locally retrieving the pre-cached multimedia data includes: and acquiring a preset amount of pre-cached multimedia data from the local. With reference to the above description, the data of the complete multimedia content is regarded as a whole, and the quantitative acquisition is performed, so that the stable acquisition of the pre-cached multimedia data can be conveniently realized. Optionally, the preset number takes on a uniform value between different users, such as, but not limited to, 1, 2, 5.

Accordingly, outputting the pre-buffered multimedia data comprises: outputting a preset number of pre-cached multimedia data; in addition, in the process of outputting the preset number of pre-cached multimedia data, if the recommended multimedia data is received, after the output of the current one of the pre-cached multimedia data is finished, the output of the remaining pre-cached multimedia data is stopped, and the recommended multimedia data is output, or in the process of outputting the preset number of pre-cached multimedia data, if the recommended multimedia data is received, after the output of the preset number of pre-cached multimedia data is finished, the recommended multimedia data is output. By outputting the received recommended multimedia data in time in the process of outputting the pre-cached multimedia data, the conventional multimedia data browsing process can be recovered, and the reliability and the continuity of the multimedia data output are realized. Specifically, the recommended multimedia data can be output after the current pre-cached multimedia data is output, so that the consumption of the pre-cached multimedia data is saved; the method can also output all the acquired pre-cached multimedia data, and at this time, the data can be considered to be output when the pre-cached multimedia data is acquired, and for the data which is acquired but is not output when the recommended multimedia data is received, because the data can be output continuously, the consumption state of the data does not need to be determined again, namely the acquisition state and the output state of the data do not need to be distinguished, the data are uniformly considered to be consumed, and the data processing strategy can be simplified.

Optionally, the configuration information includes a preset effective duration, wherein outputting the pre-cached multimedia data includes: and outputting the pre-cached multimedia data under the condition that the local storage time length of the pre-cached multimedia data is less than or equal to the preset effective time length. By comparing the local storage time length and the preset effective time length of the acquired pre-cached multimedia data, whether the acquired pre-cached multimedia data is invalid or remains effective can be determined, effective data can be output, and timeliness of output contents is guaranteed. The preset valid duration here is the same as the preset valid duration referred to when the second preset condition is introduced, and is not described herein again.

It should be understood that, the above describes the relationship between the multiple parameters in the configuration information and the reference data, and it is not limited that each parameter must be determined according to the reference data, in practical applications, only at least one of the parameters may be related to the reference data, other parameters may adopt a uniform value, or the uniform configuration information may be configured for all users as an initial value, and then at least one of the parameters is adjusted according to the reference data of each user, which is also an implementation manner of the present disclosure and falls within the protection scope of the present disclosure.

Next, a specific embodiment of the present disclosure will be described by taking a short video recommendation scenario as an example.

In the specific embodiment, first, when a user starts a short video recommendation application program, configuration information needs to be requested from a server, analysis is performed, and then a pre-caching operation and a consuming operation are respectively executed when a second preset condition and a first preset condition are met. Wherein, the second preset condition comprises 4 conditions that need to be satisfied simultaneously: the application program is in a background running state, reaches a preset downloading period, is currently in a preset time period, and can output the pre-cached multimedia data with the quantity less than the preset quantity; the first preset condition includes that only any one of 4 conditions needs to be satisfied: the multimedia data request fails, the multimedia data request is overtime and not responded, and the multimedia data request is currently in a non-network environment and a weak network environment. Correspondingly, the configuration information includes a preset download cycle, a preset time period, network environment indication information, a preset number of caches, and a preset cache size related to the second preset condition, and the preset time period is defined in the form of a forbidden time period, specifically, other time periods except 20 to 23 points, and the network environment indication information indicates that the second preset condition does not include the current Wi-Fi environment. The configuration information further includes a preset response time length, a preset query period, a weak network threshold value, a preset number and a preset effective time length, wherein the preset response time length is related to the first preset condition, and the preset effective time length is related to both the first preset condition and the second preset condition.

Fig. 2 is a schematic diagram illustrating a pre-caching phase flow according to a specific embodiment of the present disclosure.

Referring to fig. 2, in the pre-caching stage, after the application program runs, the operation behavior of the user is monitored, and when the user places the application program in the background, that is, it is determined that the application program is in the background running state, the current application program may be considered to be idle, and the trigger time is basically reached, and the current time is recorded as the trigger time for subsequent use. And then, detecting whether the configuration information is empty or not, and loading the configuration information under the condition of determining that the configuration information is not empty to obtain a preset downloading cycle, a preset time period, network environment indication information, a preset cache number and a preset cache size for subsequent processes. If the configuration information is empty, ending the process, after the configuration information is loaded, judging whether a second preset condition is met, specifically, judging whether the current time is in a forbidden time period or not, if the current time is not in the forbidden time period, then checking whether the locally existing pre-cached video data with the storage duration less than or equal to the preset effective duration is sufficient or not, specifically, whether the pre-cached video data reaches the preset pre-cached number or not, if the pre-cached video data is insufficient, considering that the second preset condition is met, formally triggering the downloading process, and if the pre-cached video data does not meet the second preset condition, ending the process.

The formal downloading process is that a video data pre-caching request is sent to the server to request the server to recommend video data, the server can recommend a plurality of video data, the specific number of the recommendation is controlled by the preset cache number in the configuration information, and the data list returns to the corresponding data list, and the data list does not directly contain the video data, but contains the data required for downloading the corresponding video data. If the request is not returned normally, that is, the returned data list is not received, the process is ended. If a normal range is requested, that is, a returned data list is received, whether the data list is empty or not is firstly confirmed, if the data list is empty, the flow is ended, if the data list is not empty, the data are stored, downloading of video data corresponding to each data is triggered, specifically, the data in the data list are transmitted to a data downloader one by one, the video data are downloaded until all the video data corresponding to the data in the data list are downloaded, and the total downloading size is controlled by the preset cache size in the configuration information. Where N shown in fig. 2 indicates the sequence number of the currently processed data in the data list, N starts from 0, and N = N +1 indicates that the next data is the currently processed data, so as to implement the one-by-one processing of the data.

FIG. 3 is a flow chart illustrating a consumption phase according to a specific embodiment of the present disclosure; FIG. 4 is a schematic diagram illustrating a user interface in accordance with a specific embodiment of the present disclosure; FIG. 5 is a schematic diagram illustrating another user interface operation according to a specific embodiment of the present disclosure.

Referring to fig. 3 to 5, in the consumption phase, after an application program is started and enters a double-column display page as shown in fig. 4 or a single-column display page as shown in fig. 5, a data request (for requesting data required for displaying the page) is initiated to a server, and if the request fails, the pre-cached video data is directly used for displaying to the page; and if the request fails not to be explicitly requested yet, but the request exceeds the preset response time length in the configuration information, the server is not waited to return data, and the pre-cached video data is directly displayed to the page. If the request is successful within the preset response time, the process is finished without using the pre-cached video data, and the normally downloaded video data is displayed on the page. When the pre-cached video data is determined to be displayed, several pre-cached video data are specifically acquired and controlled by the preset number in the configuration information, where the preset number may specifically be related to the display style of the page, for example, for a double-row display page shown in fig. 4, the preset number needs to be a multiple of 2, such as 2, 4, and 6, and for a single-row display page shown in fig. 5, the preset number may be a positive integer, such as 1, 2, and 3.

Except for the condition of initiating a request during starting, in the process that a user uses an application program, the current network environment can be inquired according to a preset inquiry period in configuration information, if no network or weak network exists (namely the network quality value is smaller than a weak network threshold value in the configuration information, the pre-cached video data is displayed on a page, and otherwise, the normally downloaded video data is displayed on the page.

The specific method for displaying the pre-cached video data to the page is to determine whether the pre-cached data exists or not, if not, the pre-cached data cannot be used, and then the process is ended. If the video data is valid, taking out the pre-cached video data with the preset quantity, checking the validity period, if the storage time length of the obtained pre-cached video data exceeds the preset valid time length in the configuration information, considering that the storage time length exceeds the validity period, discarding the storage time length, and continuously finding out the next valid pre-cached video data for use. Whether the obtained pre-cached video data exceeds the validity period or not, the corresponding log can be reported so as to record the service condition of the pre-cached video data. In use, referring to fig. 4 and 5, according to the presentation style of the page, a corresponding amount of valid pre-cached video data is inserted behind the current page, which is, as an example, two pre-cached video data, namely a pre-cached video a and a pre-cached video B, in the double-column presentation page shown in fig. 4, the two pre-cached video data can be simultaneously inserted at one time, and in the single-column presentation page shown in fig. 5, only one pre-cached video data is inserted at one time. The user can trigger the output of the pre-cached video data by the upslide operation, that is, the pre-cached video data is entered into the current page. Thereafter, if the user's network is continuously dead or weak, the pre-cached video data is continuously inserted backwards while the user slides the page to continuously consume downwards until the pre-cached video data is completely consumed or the server recovers the return data. For the latter, after the data is returned, the returned data is added behind the pre-buffered video data.

Fig. 6 is a block diagram illustrating a multimedia data processing apparatus according to an exemplary embodiment of the present disclosure. It should be understood that the multimedia data processing apparatus according to the exemplary embodiments of the present disclosure may be implemented in a terminal device such as a smartphone, a tablet computer, a Personal Computer (PC) in a software, hardware, or a combination of software and hardware, and may also be implemented in a device such as a server.

Referring to fig. 6, the multimedia data processing apparatus 600 includes a receiving unit 601, a requesting unit 602, and a processing unit 603.

The receiving unit 601 may receive configuration information about pre-caching of multimedia data sent by a server.

Optionally, the configuration information is determined by the server according to reference data, and the reference data includes at least one of: historical user behavior data, historical network quality data.

The requesting unit 602 may send a multimedia data request to the server to request to receive recommended multimedia data from the server.

The processing unit 603 may locally acquire the pre-buffered multimedia data and output the pre-buffered multimedia data if a first predetermined condition is satisfied based on the configuration information, where the first predetermined condition is used to determine that a current receiving condition of the recommended multimedia data is not good.

Optionally, the first preset condition comprises at least one of: the multimedia data request fails, the multimedia data request is overtime and not responded, and the multimedia data request is currently in a non-network environment and a weak network environment.

Optionally, the configuration information includes at least one of a preset response duration, a preset query period, and a weak network threshold; under the condition that the multimedia data request is not responded after the preset response time length, determining that the multimedia data request is overtime and not responded; in the process of receiving the recommended multimedia data, inquiring the current network environment according to a preset inquiry period to determine whether the current network environment is in a wireless environment or not; and under the condition that the current environment is not in the network-free environment, acquiring a current network quality value, and under the condition that the current network quality value is less than or equal to a weak network threshold value, determining that the current environment is in the weak network environment.

Optionally, the processing unit 603 may further download the multimedia data from the server and obtain the pre-cached multimedia data to be stored locally, where the second preset condition is satisfied, and the second preset condition is used to limit a download time of the multimedia data.

Optionally, the second preset condition comprises at least one of: the application program is in a background running state, reaches a preset downloading period, is currently in a preset time period, is currently in a Wi-Fi environment, and can output the amount of the pre-cached multimedia data smaller than a preset amount; the configuration information comprises at least one of a preset downloading cycle, a preset time period, network environment indication information and a preset amount, wherein the network environment indication information is used for indicating whether the second preset condition includes that the current Wi-Fi environment is located.

Optionally, the configuration information further includes a preset effective duration, and the output pre-cached multimedia data includes pre-cached multimedia data whose local storage duration is less than or equal to the preset effective duration and which has not been output yet.

Optionally, the configuration information includes a preset pre-buffer amount, and the processing unit 603 may further download the multimedia data according to the preset pre-buffer amount to obtain the pre-buffer multimedia data of the preset pre-buffer amount.

Optionally, the configuration information includes a preset effective duration, and the processing unit 603 may further output pre-buffered multimedia data, including: and outputting the pre-cached multimedia data under the condition that the local storage time length of the pre-cached multimedia data is less than or equal to the preset effective time length.

Optionally, the configuration information includes a preset number, and the processing unit 603 may further locally obtain the preset number of pre-cached multimedia data.

Optionally, the processing unit 603 may further output a preset number of pre-buffered multimedia data; in the process of outputting the preset number of pre-cached multimedia data, if the recommended multimedia data is received, after the output of the current one of the pre-cached multimedia data is finished, the output of the rest of the pre-cached multimedia data is stopped, and the recommended multimedia data is output, or in the process of outputting the preset number of pre-cached multimedia data, if the recommended multimedia data is received, after the output of the preset number of pre-cached multimedia data is finished, the recommended multimedia data is output.

With regard to the apparatus in the above-described embodiment, the specific manner in which each unit performs the operation has been described in detail in the embodiment related to the method, and will not be described in detail here.

Fig. 7 is a block diagram of an electronic device according to an example embodiment of the present disclosure.

Referring to fig. 7, the electronic device 700 includes at least one memory 701 and at least one processor 702, the at least one memory 701 having stored therein a set of computer-executable instructions that, when executed by the at least one processor 702, perform a multimedia data processing method according to an exemplary embodiment of the present disclosure.

By way of example, the electronic device 700 may be a PC computer, tablet device, personal digital assistant, smartphone, or other device capable of executing the set of instructions described above. Here, the electronic device 700 need not be a single electronic device, but can be any collection of devices or circuits that can execute the above instructions (or sets of instructions) either individually or in combination. The electronic device 700 may also be part of an integrated control system or system manager, or may be configured as a portable electronic device that interfaces with local or remote (e.g., via wireless transmission).

In the electronic device 700, the processor 702 may include a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), a programmable logic device, a special purpose processor system, a microcontroller, or a microprocessor. By way of example, and not limitation, processors may also include analog processors, digital processors, microprocessors, multi-core processors, processor arrays, network processors, and the like.

The processor 702 may execute instructions or code stored in the memory 701, wherein the memory 701 may also store data. The instructions and data may also be transmitted or received over a network via the network interface device, which may employ any known transmission protocol.

The memory 701 may be integrated with the processor 702, for example, with RAM or flash memory disposed within an integrated circuit microprocessor or the like. Further, memory 701 may comprise a stand-alone device, such as an external disk drive, storage array, or other storage device usable by any database system. The memory 701 and the processor 702 may be operatively coupled, or may communicate with each other, such as through I/O ports, network connections, etc., to enable the processor 702 to read files stored in the memory.

In addition, the electronic device 700 may also include a video display (such as a liquid crystal display) and a user interaction interface (such as a keyboard, mouse, touch input device, etc.). All components of the electronic device 700 may be connected to each other via a bus and/or a network.

According to an exemplary embodiment of the present disclosure, there may also be provided a computer-readable storage medium, in which instructions, when executed by at least one processor, cause the at least one processor to perform a multimedia data processing method according to an exemplary embodiment of the present disclosure. Examples of computer-readable storage media herein include: read-only memory (ROM), random-access programmable read-only memory (PROM), electrically erasable programmable read-only memory (EEPROM), random-access memory (RAM), dynamic random-access memory (DRAM), static random-access memory (SRAM), flash memory, non-volatile memory, CD-ROM, CD-R, CD + R, CD-RW, CD + RW, DVD-ROM, DVD-R, DVD-RW, DVD + RW, DVD-RAM, BD-ROM, BD-R LTH, BD-RE, blu-ray or optical disk memory, hard Disk Drive (HDD), solid State Disk (SSD), card memory (such as a multimedia card, a Secure Digital (SD) card or an extreme digital (XD) card), magnetic tape, a floppy disk, a magneto-optical data storage device, an optical data storage device, a hard disk, a solid state disk, and any other device configured to store and provide computer programs and any associated data, data files and data structures in a non-transitory manner to a computer processor or computer such that the computer programs and any associated data processors are executed or computer programs. The computer program in the computer-readable storage medium described above can be run in an environment deployed in a computer apparatus, such as a client, a host, a proxy device, a server, and the like, and further, in one example, the computer program and any associated data, data files, and data structures are distributed across a networked computer system such that the computer program and any associated data, data files, and data structures are stored, accessed, and executed in a distributed fashion by one or more processors or computers.

According to an exemplary embodiment of the present disclosure, there may also be provided a computer program product including computer instructions which, when executed by at least one processor, cause the at least one processor to perform a multimedia data processing method according to an exemplary embodiment of the present disclosure.

According to the multimedia data processing method and device, the electronic device and the storage medium of the exemplary embodiment of the disclosure, by receiving the configuration information which is sent by the server and contains the first preset condition, the receiving condition of the recommended multimedia data can be identified according to the first preset condition, and the local pre-cached multimedia data is output when the condition is not good, so that the loading waiting and the loading failure are reduced, and the reliable and continuous output of the multimedia data is facilitated.

Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.

It will be understood that the present disclosure is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims (14)

1. A method for processing multimedia data, comprising:

receiving configuration information which is sent by a server and is about multimedia data pre-caching;

sending a multimedia data request to the server to request reception of recommended multimedia data from the server;

based on the configuration information, under the condition that a first preset condition is met, locally acquiring pre-cached multimedia data and outputting the pre-cached multimedia data, wherein the first preset condition is used for determining that the current receiving condition of the recommended multimedia data is not good.

2. The multimedia data processing method of claim 1, wherein prior to said sending the multimedia data request to the server, the multimedia data processing method further comprises:

and downloading multimedia data from the server under the condition of meeting a second preset condition based on the configuration information, and obtaining the pre-cached multimedia data to store the pre-cached multimedia data to the local, wherein the second preset condition is used for limiting the downloading time of the multimedia data.

3. The method of claim 2, wherein the configuration information includes a preset amount of buffering, and wherein the downloading the multimedia data from the server includes:

and downloading multimedia data according to the preset buffer memory amount so as to obtain the pre-buffer multimedia data of the preset buffer memory amount.

4. The method for processing multimedia data according to claim 1, wherein the configuration information comprises a preset validity period, and wherein the outputting the pre-buffered multimedia data comprises:

and outputting the pre-cached multimedia data under the condition that the local storage time length of the pre-cached multimedia data is less than or equal to the preset effective time length.

5. The method of claim 1, wherein the configuration information comprises a preset number, and wherein the locally retrieving the pre-cached multimedia data comprises:

and locally acquiring the preset amount of the pre-cached multimedia data.

6. The method of multimedia data processing according to claim 5, wherein said outputting the pre-buffered multimedia data comprises:

outputting the pre-cached multimedia data of the preset quantity;

in the process of outputting the preset number of the pre-cached multimedia data, if the recommended multimedia data is received, after the output of the current one of the pre-cached multimedia data is finished, the output of the rest of the pre-cached multimedia data is stopped, and the recommended multimedia data is output, or

And in the process of outputting the preset number of the pre-cached multimedia data, if the recommended multimedia data is received, outputting the recommended multimedia data after the preset number of the pre-cached multimedia data is output.

7. The multimedia data processing method of claim 1, wherein the first preset condition comprises at least one of: the multimedia data request fails, the multimedia data request does not respond when overtime, and the multimedia data request is currently in a network-free environment and a weak network environment.

8. The multimedia data processing method of claim 7, wherein the configuration information includes at least one of a preset response duration, a preset query period, and a weak network threshold;

under the condition that the multimedia data request is not responded after a preset response time length, determining that the multimedia data request is overtime and not responded;

in the process of receiving the recommended multimedia data, inquiring the current network environment according to the preset inquiry period to determine whether the current network environment is in a wireless environment;

and under the condition that the current environment is not in the network-free environment, acquiring a current network quality value, and under the condition that the current network quality value is less than or equal to the weak network threshold, determining that the current environment is in the weak network environment.

9. The multimedia data processing method of claim 2,

the second preset condition includes at least one of: the application program is in a background running state, reaches a preset downloading period, is currently in a preset time period, is currently in a Wi-Fi environment, and can output the pre-cached multimedia data with an amount smaller than a preset amount;

the configuration information includes at least one of the preset download cycle, the preset time period, network environment indication information and the preset amount, wherein the network environment indication information is used for indicating whether the second preset condition includes that the current Wi-Fi environment is included.

10. The method as claimed in claim 9, wherein the configuration information further includes a preset validity period, and the outputtable pre-buffered multimedia data includes pre-buffered multimedia data which has a local storage period less than or equal to the preset validity period and has not been output yet.

11. A method of processing multimedia data according to any of claims 1 to 10, wherein the configuration information is determined by the server from reference data comprising at least one of: historical user behavior data, historical network quality data.

12. A multimedia data processing apparatus, comprising:

the receiving unit is configured to execute configuration information about multimedia data pre-caching issued by a receiving server;

a request unit configured to perform a multimedia data transmission request to the server to request reception of recommended multimedia data from the server;

and the processing unit is configured to execute acquiring pre-cached multimedia data from the local and outputting the pre-cached multimedia data under the condition that a first preset condition is met based on the configuration information, wherein the first preset condition is used for determining that the current receiving condition of the recommended multimedia data is not good.

13. An electronic device, comprising:

at least one processor;

at least one memory storing computer-executable instructions,

wherein the computer-executable instructions, when executed by the at least one processor, cause the at least one processor to perform the method of multimedia data processing according to any of claims 1 to 11.

14. A computer-readable storage medium, wherein instructions in the computer-readable storage medium, when executed by at least one processor, cause the at least one processor to perform the method of multimedia data processing according to any of claims 1 to 11.

Images