CN114339364A

CN114339364A - Multimedia data processing method and device, electronic equipment and storage medium

Info

Publication number: CN114339364A
Application number: CN202111575743.8A
Authority: CN
Inventors: 姚可奇; 潘朋飞; 刘嘉星
Original assignee: Beijing Dajia Internet Information Technology Co Ltd
Current assignee: Beijing Dajia Internet Information Technology Co Ltd
Priority date: 2021-12-21
Filing date: 2021-12-21
Publication date: 2022-04-12

Abstract

The disclosure relates to a multimedia data processing method, a multimedia data processing device, electronic equipment and a storage medium, and relates to the technical field of internet. The embodiment of the disclosure at least solves the problem that in the related art, the live data stream which is already closed in the preloaded live data stream cannot be updated in time. The method comprises the following steps: acquiring a first data stream corresponding to a resource preview page, wherein the first data stream comprises a first number of pre-loaded live data streams; if detecting that a second number of closed live data streams exist in the first data stream, sending first request information for pulling the live data streams; acquiring a second data stream sent in response to the first request information; the second data stream comprises a third number of live data streams which are in live broadcast except the first number of live data streams; and responding to a request for opening a resource preview page, and rendering and displaying a resource preview interface according to the live data stream and the second data stream which are not closed in the first data stream.

Description

Multimedia data processing method and device, electronic equipment and storage medium

Technical Field

The present disclosure relates to the field of internet technologies, and in particular, to a multimedia data processing method and apparatus, an electronic device, and a storage medium.

Background

In a scene of preloading Feed stream data, the Feed stream data helps a user to continuously acquire Feed content subscribed by the user, wherein the Feed content comprises short videos and live broadcasts. Illustratively, in the page a of the video application, the user subscribes to the fitness related message, and feeds data such as fitness motions, fitness recipes, fitness equipment and the like are loaded in a preloading mode.

Specifically, the live broadcast resources in Feed stream data are preloaded, and the live broadcast resources have certain timeliness, and can be closed by the anchor at any time, so that live broadcast is likely to be closed by the live broadcast resources, but a live broadcast inlet corresponding to the live broadcast resources is also displayed on a user interface, so that a user cannot display the corresponding live broadcast resources after entering the live broadcast through the live broadcast inlet, and the user experience is poor.

Disclosure of Invention

The disclosure provides a multimedia data processing method, a multimedia data processing device, an electronic device and a storage medium, which are used for at least solving the problem that in the related art, a preloaded live data stream is closed and cannot be updated in time. The technical scheme of the disclosure is as follows:

according to a first aspect of the embodiments of the present disclosure, there is provided a multimedia data processing method applied to a client, including: acquiring a first data stream corresponding to a resource preview page, wherein the first data stream comprises a first number of pre-loaded live data streams; if detecting that a second number of closed live data streams exist in the first data stream, sending first request information for pulling the live data streams; acquiring a second data stream sent in response to the first request information; the second data stream comprises a third number of live data streams which are live except the first number of live data streams, and the third number is equal to the second number; and responding to a request for opening a resource preview page, and rendering and displaying a resource preview interface according to the live data stream and the second data stream which are not closed in the first data stream.

Optionally, the obtaining the first data stream corresponding to the resource preview page includes: starting a target application program, and sending a second request message, wherein the target application program can display a resource preview page after being started, the second request message is used for requesting to judge whether the resource preview page needs to be preloaded, and the second request message comprises a target object account of the target application program; acquiring pre-loading configuration information corresponding to the second request message; under the condition that the preloading configuration information indicates that the resource preview page needs preloading, sending a third request message, wherein the third request message is used for requesting to pull a first data stream corresponding to the resource preview page; the first data stream transmitted in response to the third request information is acquired.

Optionally, the multimedia data processing method further includes: after the first data stream corresponding to the resource preview page is obtained, if the request for opening the resource preview page is not detected within the effective loading duration, deleting the first data stream, and stopping detecting whether a second number of closed live data streams exist in the first data stream.

Optionally, the multimedia data processing method further includes: and responding to a request for opening a resource preview page, if the first data stream does not exist, rendering and displaying the resource preview page according to local multimedia data corresponding to the resource preview page, wherein the local multimedia data refers to prestored multimedia data.

Optionally, the multimedia data processing method further includes: after a first data stream corresponding to a resource preview page is obtained, starting a polling thread, and polling a background interface of each live data stream in the first data stream according to preset polling time; and if the background interface does not receive the live broadcast data stream, determining that the live broadcast data stream corresponding to the background interface is a closed live broadcast data stream.

Optionally, the "rendering and displaying a resource preview interface according to the live data stream and the second data stream that are not closed in the first data stream" includes: sequentially updating the data stream positions of a second number of closed live data streams in the first data stream to a third number of live data streams in the second data stream to generate data streams to be rendered; and rendering and displaying the resource preview interface according to the data stream to be rendered.

Optionally, in the multimedia data processing method, the first data stream further includes a data stream of a preloaded fourth number of short video resources, where the fourth number is greater than or equal to 1.

According to a second aspect of the embodiments of the present disclosure, there is provided a multimedia data processing method applied to a server, including: sending a first data stream corresponding to the resource preview page; the first data stream comprises a preloaded first number of live data streams; responding to a first request message for pulling the live data streams, and acquiring second data streams, wherein the second data streams comprise a third number of live data streams which are live except the first number of live data streams, and the third number is equal to the second number; and sending the second data stream, so that in response to a request for opening the resource preview page, rendering and displaying a resource preview interface according to the data stream of the live broadcast resource which is not closed in the first data stream and the second data stream.

Optionally, the multimedia data processing method further includes: before sending a first data stream corresponding to a resource preview page, acquiring a second request message sent by a client, wherein the second request message is used for requesting to judge whether the resource preview page needs to be preloaded or not, the second request message comprises a target object account of a target application program, and the target application program can display the resource preview page after being started; according to the historical behavior data corresponding to the target object account, counting the starting probability of the resource preview page, wherein the starting probability is as follows: the probability of starting a resource preview page after a client starts a target application program; generating preloading configuration information according to a comparison result of the starting probability and the preset probability, wherein the preloading configuration information is used for indicating whether the resource preview page needs preloading or not; and sending the preloading configuration information to the client.

Optionally, the "generating the preloaded configuration information according to the comparison result between the starting probability and the preset probability" includes: acquiring the starting probability of a resource preview page according to historical behavior data corresponding to a target object account; under the condition that the starting probability is greater than the preset probability, determining that the preloading configuration information indicates that the resource preview page needs preloading; and under the condition that the starting probability is less than or equal to the preset probability, determining that the preloading configuration information indicates that the resource preview page does not need preloading.

Optionally, the multimedia data processing method further includes: before a first data stream corresponding to a resource preview page is sent, counting a starting interval duration according to historical behavior data corresponding to a target object account, wherein the starting interval duration is a time difference between starting time and opening time, and the starting time is as follows: the client starts the target application program, and the opening time is the time for opening a resource preview page after the target application program is started currently; obtaining the effective loading time length of the first data stream according to the starting interval time length; and sending the effective loading duration to the client.

Optionally, the sending the first data stream corresponding to the resource preview page includes: acquiring a third request message, wherein the third request message is used for requesting to pull the first data stream under the condition that the preloading configuration indicates that the resource preview page needs to be preloaded; and responding to the third request information, and pulling the first data stream of the resource preview page according to the preloading information.

Optionally, in the multimedia data processing method, the first data stream further includes a data stream of a fourth number of pre-loaded short video resources, where the third number is greater than or equal to 1.

Optionally, in the multimedia data processing method, the preloading information includes at least one of the following: a recommendation topic, a recommendation type, and a recommendation policy.

According to a third aspect of the embodiments of the present disclosure, there is provided a multimedia data processing apparatus applied to a client, including: the device comprises an acquisition unit, a sending unit and a display unit; the resource preview page processing device comprises an acquisition unit, a processing unit and a display unit, wherein the acquisition unit is used for acquiring a first data stream corresponding to a resource preview page, and the first data stream comprises a first number of pre-loaded live broadcast data streams; a sending unit, configured to send first request information for pulling a live data stream if it is detected that a second number of closed live data streams exist in the first data stream; the acquisition unit is also used for acquiring a second data stream sent in response to the first request information; the second data stream comprises a third number of live data streams which are live except the first number of live data streams, and the third number is equal to the second number; and the display unit is used for responding to a request for opening the resource preview page, and rendering and displaying a resource preview interface according to the live data stream which is not closed in the first data stream and the second data stream.

Optionally, the obtaining unit is configured to: starting a target application program, and sending a second request message, wherein the target application program can display a resource preview page after being started, the second request message is used for requesting to judge whether the resource preview page needs to be preloaded, and the second request message comprises a target object account of the target application program; acquiring pre-loading configuration information corresponding to the second request message; under the condition that the preloading configuration information indicates that the resource preview page needs preloading, sending a third request message, wherein the third request message is used for requesting to pull a first data stream corresponding to the resource preview page; the first data stream transmitted in response to the third request information is acquired.

Optionally, the multimedia data processing apparatus further includes: a processing unit; and the processing unit is used for deleting the first data stream and stopping detecting whether a second number of closed live data streams exist in the first data stream after the first data stream corresponding to the resource preview page is acquired and if the request for opening the resource preview page is not detected within the effective loading duration.

Optionally, the multimedia data processing apparatus further includes: and the processing unit is used for responding to a request for opening the resource preview page, and rendering and displaying the resource preview page according to local multimedia data corresponding to the resource preview page if the first data stream does not exist, wherein the local multimedia data refers to multimedia data stored in advance.

Optionally, the multimedia data processing apparatus further includes: a polling unit and a determination unit; a polling unit configured to: after a first data stream corresponding to a resource preview page is obtained, starting a polling thread, and polling a background interface of each live data stream in the first data stream according to preset polling time; and the determining unit is used for determining that the live data stream corresponding to the background interface is the closed live data stream if the background interface does not receive the live data stream.

Optionally, the display unit is specifically configured to: sequentially updating the data stream positions of a second number of closed live data streams in the first data stream to a third number of live data streams in the second data stream to generate data streams to be rendered; and rendering and displaying the resource preview interface according to the data stream to be rendered.

Optionally, in the multimedia data processing apparatus, the first data stream further includes a data stream of a fourth number of pre-loaded short video resources, where the fourth number is greater than or equal to 1.

According to a fourth aspect of the embodiments of the present disclosure, there is provided a multimedia data processing apparatus applied to a server, including: a transmitting unit and an acquiring unit; the sending unit is used for sending a first data stream corresponding to the resource preview page; the first data stream comprises a preloaded first number of live data streams; the device comprises an acquisition unit, a processing unit and a processing unit, wherein the acquisition unit is used for responding to a first request message for pulling live broadcast data streams, acquiring a second data stream, the second data stream comprises a third number of live broadcast data streams which are live broadcast except for the first number of live broadcast data streams, and the third number is equal to the second number; and the sending unit is further used for sending the second data stream so as to render and display the resource preview interface according to the data stream of the live broadcast resource which is not closed in the first data stream and the second data stream in response to the request for opening the resource preview page.

Optionally, the multimedia data processing apparatus further includes: a statistic unit and a generating unit; the acquiring unit is further configured to acquire a second request message sent by the client before sending the first data stream corresponding to the resource preview page, where the second request message is used to request to determine whether the resource preview page needs to be preloaded, the second request message includes a target object account of the target application program, and the target application program can display the resource preview page after being started; the statistical unit is used for counting the starting probability of the resource preview page according to the historical behavior data corresponding to the target object account, wherein the starting probability is as follows: the probability of starting a resource preview page after a client starts a target application program; the generating unit is used for generating pre-loading configuration information according to the comparison result of the starting probability and the preset probability, and the pre-loading configuration information is used for indicating whether the resource preview page needs to be pre-loaded or not; and the sending unit is also used for sending the preloading configuration information to the client.

Optionally, the generating unit is specifically configured to: acquiring the starting probability of a resource preview page according to historical behavior data corresponding to a target object account; under the condition that the starting probability is greater than the preset probability, determining that the preloading configuration information indicates that the resource preview page needs preloading; and under the condition that the starting probability is less than or equal to the preset probability, determining that the preloading configuration information indicates that the resource preview page does not need preloading.

Optionally, the multimedia data processing apparatus further includes: the counting unit is further configured to count a start interval duration according to the historical behavior data corresponding to the target object account before sending the first data stream corresponding to the resource preview page, where the start interval duration is a time difference between start time and open time, and the start time is: the client starts the target application program, and the opening time is the time for opening a resource preview page after the target application program is started currently; the acquisition unit is used for acquiring the effective loading duration of the first data stream according to the starting interval duration; and the sending unit is used for sending the effective loading duration to the client.

Optionally, the sending unit is specifically configured to: acquiring a third request message, wherein the third request message is used for requesting to pull the first data stream under the condition that the preloading configuration indicates that the resource preview page needs to be preloaded; and responding to the third request information, and pulling the first data stream of the resource preview page according to the preloading information.

Optionally, in the multimedia data processing apparatus, the preloading information includes at least one of: a recommendation topic, a recommendation type, and a recommendation policy.

According to a fifth aspect of the embodiments of the present disclosure, there is provided a client, including: a processor, a memory, and a program or instructions stored on the memory and executable on the processor; wherein the program or instructions, when executed by the processor, implement a method of multimedia data processing as provided in the first or second aspect and any of its possible designs.

According to a sixth aspect of the embodiments of the present disclosure, there is provided a readable storage medium on which a program or instructions are stored, the program or instructions, when executed by a processor, implementing the multimedia data processing method as provided in the first aspect or the second aspect and any one of the possible design manners thereof.

According to a seventh aspect of embodiments of the present disclosure, there is provided a computer program product stored in a non-volatile storage medium, which when executed by at least one processor implements a multimedia data processing method as provided by the first or second aspect and any one of its possible designs.

The technical scheme provided by the disclosure at least brings the following beneficial effects: firstly, a first data stream corresponding to a resource preview page is obtained, wherein the first data stream comprises a first number of pre-loaded live data streams; if detecting that a second number of closed live data streams exist in the first data stream, sending first request information for pulling the live data streams; acquiring a second data stream sent in response to the first request information; the second data stream comprises a third number of live data streams which are live except the first number of live data streams, and the third number is equal to the second number; and responding to a request for opening a resource preview page, and rendering and displaying a resource preview interface according to the live data stream and the second data stream which are not closed in the first data stream. Therefore, whether the closed live broadcast data stream exists in the first data stream or not is detected, so that the sending opportunity of the first request information of the second number of live broadcast resources can be obtained in time, the second number of closed live broadcast data streams in the first data stream are replaced by the second data stream in time, on one hand, the first data stream can be updated in time, and on the other hand, the rendered and displayed live broadcast resources in the resource preview interface can be all live broadcast resources.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the disclosure and are not to be construed as limiting the disclosure.

FIG. 1 is a schematic diagram illustrating a multimedia data processing system architecture in accordance with an exemplary embodiment;

FIG. 2 is one of the flow diagrams of a method for multimedia data processing according to an exemplary embodiment;

FIG. 3 is a second flowchart illustrating a method for processing multimedia data according to an exemplary embodiment;

FIG. 4 is a third flowchart illustrating a method of processing multimedia data according to an exemplary embodiment;

FIG. 5 is a flowchart illustrating background thread logic in accordance with an exemplary embodiment;

FIG. 6 is a fourth flowchart illustrating a method of processing multimedia data according to an exemplary embodiment;

FIG. 7 is a fifth flowchart illustrating a method of processing multimedia data according to an exemplary embodiment;

FIG. 8 is a sixth flowchart illustrating a method of processing multimedia data according to an exemplary embodiment;

FIG. 9 is a seventh illustrative flow chart of a method for processing multimedia data in accordance with an exemplary embodiment;

FIG. 10 is an eighth flowchart illustrating a method of processing multimedia data according to an exemplary embodiment;

FIG. 11 is one of the schematic structural diagrams of a multimedia data processing apparatus according to an exemplary embodiment;

FIG. 12 is a second schematic diagram of a multimedia data processing apparatus according to an exemplary embodiment;

FIG. 13 is a diagram illustrating a multimedia data processing system information interaction, according to an illustrative embodiment;

fig. 14 is a schematic diagram illustrating a client or server according to an example embodiment.

Detailed Description

In order to make the technical solutions of the present disclosure better understood by those of ordinary skill in the art, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below with reference to the accompanying drawings.

It should be noted that the terms "first," "second," and the like in the description and claims of the present disclosure and in the above-described drawings are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the disclosure described herein are capable of operation in sequences other than those illustrated or otherwise described herein. The implementations described in the exemplary embodiments below are not intended to represent all implementations consistent with the present disclosure. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present disclosure, as detailed in the appended claims.

In addition, in the description of the embodiments of the present disclosure, "/" indicates an OR meaning, for example, A/B may indicate A or B, unless otherwise specified. "and/or" herein is merely an association describing an associated object, and means that there may be three relationships, e.g., a and/or B, which may mean: a exists alone, A and B exist simultaneously, and B exists alone. In addition, in the description of the embodiments of the present disclosure, "a plurality" means two or more than two.

Generally, a plurality of user interfaces, such as a recommendation page, a focus page, a city page, and the like, may be set in a video application, and after a user starts the video application, one or more of the user interfaces may be opened. If only one user interface can be displayed at the same time after the video application program is started, and for other user interfaces which cannot be displayed temporarily, the preloaded multimedia data stream is cached, so that the media information corresponding to the multimedia data stream can be displayed in a quick response mode after the user interface is opened, and a user can watch the media information displayed on the user interface without waiting. If all the user interfaces in the plurality of user interfaces are loaded with corresponding multimedia data streams, more network resources and system resources are required to be occupied, and therefore, the corresponding multimedia data streams are usually loaded for part of the user interfaces according to actual needs.

Due to the pre-loaded multimedia data stream, with a certain timeliness, the live data stream may be closed by the main broadcast at any time. Under the condition that the live data stream is closed, a live entry corresponding to the live data stream can be reserved on a user interface, the live data stream can be prompted to stop playing after entering the live data stream through the live entry, and user experience is poor.

Based on this, a multimedia data processing method provided by the embodiments of the present disclosure may be applied to a multimedia data processing system. Fig. 1 shows a schematic diagram of a multimedia data processing system. As shown in fig. 1, the multimedia data processing system is used to solve the problem that, in the related art, a live data stream that has been closed in a preloaded live data stream cannot be updated in time. The multimedia data processing system comprises: a client 11 and a server 12. In the embodiment of the present disclosure, the client 11 and the server 12 are connected. The client 11 may perform data interaction with the server 12, for example, the client 11 may send a request message to the server 12 and receive a multimedia data stream sent by the server 12.

In the embodiment of the present disclosure, the client 11 may further include or be connected to a database, and the multimedia data stream may be stored in the database. The client 11 may perform an access operation to the multimedia data stream in the database. In the embodiment of the present disclosure, the client 11 may be a personal intelligent device such as a mobile phone, a smart watch, a tablet computer, an Augmented Reality (AR), a Virtual Reality (VR), or an electronic device such as a notebook computer, a desktop computer, a television, or another electronic device that can display multimedia data stream, where the device form of the client 11 is not limited.

In the disclosed embodiment, the server 12 is an electronic device with high-speed CPU computing capability, long-time reliable operation, powerful I/O external data throughput capability, and better extensibility. The server 12 is used to provide services to the client 11. The server 12 may be a data server of an internet platform such as a short video application service platform, a news service platform, a live broadcast service platform, a shopping service platform, a takeout service platform, a sharing service platform, and a functional website.

Alternatively, the client 11 and the server 12 may be connected by wire or wirelessly. For example, the Wireless communication protocol used between the client 11 and the server 12 may be a Wireless Fidelity (Wi-Fi) protocol, a Bluetooth (Bluetooth) protocol, a ZigBee protocol, a short-range Wireless communication protocol, various cellular network protocols, and the like, and is not limited herein.

It should be noted that the client 11 and the server 12 may be independent devices or may be integrated in the same device, and the present invention is not limited to this. When the client 11 and the server 12 are integrated in the same device, the communication mode between the client 11 and the server 12 is the communication between the internal modules of the device, and the communication flow between the client 11 and the server 12 is the same as the communication flow between the client 11 and the server 12 when they are independent of each other.

If in practical application, the multimedia data processing method provided by the embodiment of the present disclosure is applied to the client 11, the following describes the multimedia data processing method provided by the embodiment of the present disclosure with reference to the drawings, and the following takes an execution subject as a multimedia data processing apparatus as an example to exemplarily describe the method. As shown in fig. 2, the multimedia data processing method provided by the embodiment of the present disclosure includes the following steps 201 to 204.

Step 201, the multimedia data processing apparatus obtains a first data stream corresponding to the resource preview page.

In an embodiment of the present disclosure, the first data stream comprises a preloaded first number of live data streams. The method comprises the steps that a first number of live broadcast data streams in a resource preview page correspond to a first number of live broadcast entries, and the live broadcast entries corresponding to Q live broadcast data streams are displayed in the resource preview page according to the preset window size and the arrangement rule, wherein Q is smaller than or equal to the first number.

In one example, a user performs a target operation on any displayed live entry, can enter the live data stream, and after the live data stream is displayed, continuously receives the live data stream and continues to watch live content corresponding to the live data stream. It is to be understood that the target operation may be any of: the method comprises the steps of clicking a live broadcast inlet on a screen, double clicking the live broadcast inlet on the screen, clicking the live broadcast inlet on a key, double clicking the live broadcast inlet on the key and indicating to enter any live broadcast inlet by voice.

In another example, if the live data stream is viewed through a live entry from a resource preview page, the next live data stream can also be entered through a swipe operation.

Optionally, in this embodiment of the present disclosure, the first data stream further includes a data stream of a preloaded fourth number of short video resources, where the fourth number is greater than or equal to 1. It should be noted that, the first data stream may include both a live data stream corresponding to the resource preview page and a data stream of the short video resource corresponding to the resource preview page, but the effective time of the short video resource is usually longer, and therefore, for the preloaded first data stream, the problem that the live data stream cannot be updated in time due to short-time video failure does not need to be considered.

It can be understood that, if the first data stream includes both the live resources and the short video resources, the live resources and the short video resources may be sequentially arranged in the first data stream according to an acquisition order, a distribution time order, a sequence of interest degrees of the clients from large to small, and the like.

The technical scheme provided by the disclosure at least brings the following beneficial effects: the acquired first data stream comprises both live broadcast resources and short video resources, and diversity of the first data stream can be increased, so that the requirement of a user on video diversity is better met. Due to the limitation of the number of live data streams in the first data stream, that is, the buffer space reserved for the first data stream needs to be considered, and the client resources that need to be consumed for subsequently detecting whether the live data streams close the live data streams need to be considered, if the first data stream further includes short video resources, the resource consumption of the client can be reduced.

In the embodiment of the disclosure, the first data stream is acquired when the user opens the resource preview page through a possible client. It should be noted that the client has installed a target application program, and the target application program includes a resource preview page. After the target application program is started, the user may open the resource preview page through the client, and therefore, after the target application program is started, the multimedia data processing apparatus obtains the first data stream corresponding to the resource preview page.

Illustratively, the target application may be at least one of: short video applications, news applications, live applications, shopping applications, take-away applications, and sharing applications. Illustratively, the target application may be launched by at least one of: the intelligent wearable device comprises a keyboard, a display screen, keys and an intelligent wearable device, wherein the keyboard, the display screen and the keys of the client are connected with the client, and the intelligent wearable device can be connected in an infrared mode, a blue mode or a wireless network mode.

Step 202, if the multimedia data processing apparatus detects that a second number of closed live data streams exist in the first data stream, the multimedia data processing apparatus sends first request information for pulling the live data streams.

In the embodiment of the disclosure, when a resource preview page is opened, if a closed live data stream exists in a first data stream displayed on the resource preview page, after the live data stream enters the first data stream, a continuous data content corresponding to the live data stream is not obtained, and the closed live data stream can be found. Therefore, the first data stream needs to be detected. Detecting that the live data stream has been closed.

Optionally, in this embodiment of the disclosure, after the first data stream is acquired, the first data stream may be periodically detected, as shown in fig. 3, this step 202 may be implemented by the following steps 301 to 302.

Step 301, the multimedia data processing apparatus starts a polling thread, and polls a background interface of each live data stream in the first data stream according to a preset polling time.

Step 302, if the background interface does not receive the live data stream, the multimedia data processing apparatus determines that the live data stream corresponding to the background interface is a closed live data stream.

In the disclosed embodiment, a sleep function (containing a preset polling time) may be used to put the polling thread to sleep. And after the dormancy is finished, the polling thread enters a ready state from a blocking state and polls a background interface of each live data stream in the first data stream. It should be noted that, the sleep function makes the polling thread enter the "ready state" periodically according to the preset polling time.

In the embodiment of the present disclosure, each live data stream in the first data stream is continuously sent to the background interface of the client, the live data stream is not acquired when the live data stream is not entered through the client, and the live data stream is acquired when the live data stream is entered through the client, so as to display the live data stream. Therefore, whether the live data stream corresponding to the background interface is the closed live data stream can be determined by detecting the background interface of the live data stream.

The technical scheme provided by the disclosure at least brings the following beneficial effects: and polling a background interface of each live data stream in the first data stream according to preset polling time by starting a polling thread, and determining that the live data stream corresponding to the background interface is a closed live data stream under the condition that the background interface does not receive the live data stream. Therefore, real-time monitoring on the live data stream can be realized, and the invalid live data stream in the first data stream can be found in time.

In the embodiment of the present disclosure, if it is detected that a second number of closed live data streams exist in the first data stream, first request information for pulling the live data streams is sent to the server. The second quantity is included in the first request message.

In step 203, the multimedia data processing apparatus obtains the second data stream transmitted in response to the first request message.

In an embodiment of the present disclosure, the second data stream includes a third number of live data streams, other than the first number of live data streams, and being live, the third number being equal to the second number. It should be noted that the detection of the second number of closed live data streams is detected at the same detection time. Thereafter, a third number of live data streams of the same number is obtained according to the number of closed live data streams that have been detected. In an embodiment of the present disclosure, the third number of live data streams are other live data streams that are live in addition to the first data stream.

In the embodiment of the disclosure, the server can obtain the second data stream in response to the first request information and send the second data stream to the client, and the second data stream can be directly obtained at the client.

And step 204, the multimedia data processing device responds to the request for opening the resource preview page, and renders and displays a resource preview interface according to the live data stream and the second data stream which are not closed in the first data stream.

Optionally, in this embodiment of the present disclosure, before displaying the resource preview interface: and the multimedia data processing device sequentially updates the data stream positions of the second number of closed live data streams in the first data stream into a third number of live data streams.

In this embodiment of the present disclosure, a first number of live data streams in a first data stream are cached at a client according to a certain order, and the first number of live data streams are all cached at corresponding data stream positions. For example, the first number of live data streams may be ordered in any one of the following manners: and loading a successful time sequence, the distance between the live data stream positioning position and the client positioning position and the probability of entering the live data stream.

In the embodiment of the present disclosure, the multimedia data processing apparatus replaces the second number of closed live data streams with the third number of live data streams in a one-to-one replacement manner. In the replacement process, the second number of live data streams may be arranged according to the sorting manner of the first number of live data streams, and then each live resource in the second number of live data streams is sequentially updated to the position of the second number of closed live data streams in the first number of live data streams.

And sequentially updating the positions of the second number of closed live data streams in the first data without re-dividing the cache space for the updated second number of live data streams, so that the steps of caching the second number of live data streams can be reduced, and the cache speed is increased. In addition, in order to display the resource preview page, the data stream position needs to be written into the resource preview page to call the first data process, and a mode of updating at the position of the second number of closed live data streams is adopted, so that the resource preview page does not need to be modified to call the first data process, and the response time from the acquisition of the second number of live data streams to the display of the second number of live data streams can be reduced.

In the embodiment of the present disclosure, the request for opening the resource preview page may be generated through a screen of the client, a key of the client, and an external device of the client, or may be obtained through other electronic devices connected to the client.

In an embodiment of the disclosure, each live data stream in the first data stream may include at least one of: the method comprises the steps of directly broadcasting the live resources, wherein the live resources comprise network link addresses, live resource labels, live resource positioning positions, live resource attention numbers and live broadcast entrance display pictures, and the display pictures can be single pictures or dynamic group pictures formed by multiple pictures.

In the embodiment of the present disclosure, rendering and displaying the resource preview page specifically includes extracting information in the first data stream according to a display rule set in the resource preview page, generating a corresponding live entry control, and displaying the live entry control.

In the embodiment of the disclosure, once a request for opening the resource preview page is responded, the resource preview page is rendered and displayed according to the first data stream, so that the resource preview page can be displayed without waiting for real-time loading, and instant display of the resource preview page is realized. After the resource preview page is displayed, other multimedia data streams may be loaded in real-time.

Optionally, since the first data stream is called only when the request for opening the resource preview page is obtained, in order to avoid waste of client resources due to that the first data stream may not be called, as shown in fig. 4, obtaining the first data stream corresponding to the resource preview page in step 201 may be implemented through the following steps 401 to 403.

Step 401, the multimedia data processing apparatus starts the target application and sends a second request message.

Step 402, the multimedia data processing apparatus obtains the pre-loading configuration information corresponding to the second request message.

Step 403, the multimedia data processing apparatus sends a third request message when the preloading configuration information indicates that the resource preview page needs preloading.

In the embodiment of the disclosure, the target application program can display the resource preview page after being started, the second request message is used for requesting to judge whether the resource preview page needs to be preloaded, the second request message includes a target object account of the target application program, and the third request message is used for requesting to pull the first data stream corresponding to the resource preview page.

In the embodiment of the present disclosure, in order to save the client resources consumed by the target application program after the target application program is started, a second request message may be sent to the server, and the server determines whether the resource preview page needs to be preloaded in response to the second request message. It will be appreciated that the resource preview page is not the page that is first displayed after the target application is launched.

It should be noted that, the server determines whether the resource preview page needs to be preloaded, and may use the target object account corresponding to the client and other user account numbers as a determination basis in the determination process, so as to improve the accuracy of determining whether the resource preview page needs to be preloaded in response to the second request message.

In the embodiment of the present disclosure, the multimedia data processing apparatus may obtain the pre-loading configuration information by receiving the pre-loading configuration information sent by the server. It will be appreciated that the preload configuration information may indicate that the resource preview page needs to be preloaded, and may also indicate that the resource preview page does not need to be preloaded.

In one possible embodiment, in case the pre-loading configuration information indicates that the resource preview page does not need pre-loading, the multimedia data processing apparatus ignores the loading configuration information. In another possible embodiment, in case that the preloading configuration information indicates that the resource preview page needs preloading, the multimedia data processing apparatus sends a third request message in order to request to pull the first data stream.

The technical scheme provided by the disclosure at least brings the following beneficial effects: and sending a second request message while starting the target application program, judging whether to send a third request message according to the preloading configuration information corresponding to the second request message, and requesting to pull the first data stream under the condition that the resource preview page needs to be preloaded so as to avoid the waste of network resources caused by obtaining the first data stream under the condition that the resource preview page does not need to be preloaded.

Optionally, in this embodiment of the present disclosure, after the first data stream corresponding to the resource preview page is obtained in step 201, the method for processing multimedia data provided in this embodiment of the present disclosure further includes: if the request for opening the resource preview page is not detected within the effective loading duration, the multimedia data processing device deletes the first data stream and stops detecting whether a second number of closed live data streams exist in the first data stream.

In an embodiment of the present disclosure, the source of the payload length may be at least one of: preset, obtained in response to user input and obtained from a server. If the request for opening the resource preview page is not received after the effective loading duration is exceeded, the probability of opening the resource preview page is low after the target application program is started, and therefore the first data stream can be deleted at the client.

As can be appreciated. If the first data stream is not rendered and displayed on the resource preview page, the first data stream still needs to occupy the storage space of the client, and in order to balance the influence of the storage space of the client on the performance of the client and the waiting time for rendering and displaying the resource preview page, if the request for opening the resource preview page is not detected within the effective loading duration, the first data stream is deleted. It should be noted that the effective loading duration may be calculated from the application program to which the resource preview page belongs.

In the embodiment of the present disclosure, after the first data stream is deleted, the detection object is deleted, in this case, the live broadcast resource that has been closed does not exist in the first data stream, and if detection is performed, system resources of the client are wasted. Thus, in this case, the detection of whether a closed live data stream is present in the first data stream is stopped.

For example, as shown in fig. 5, for a client, in a case that a resource preview page is included in a target application program, after the target program is started, the background thread logic specifically includes: recording system time when a thread of a target application program is started, judging whether a time difference between current time and the system time is smaller than an effective loading duration, if so, appointing detection time (such as 1 minute) according to a sleep function, judging whether a first data stream comprises closed live broadcast data streams, if not, judging whether the time difference between the current time and the system time is smaller than the effective loading duration again, then repeating the process, if so, acquiring a second number of live broadcast data streams, returning a number parameter indicating that the number of live broadcast data streams in the first data stream is insufficient, and then sequentially updating the live broadcast data streams into the second number of live broadcast data streams according to the data stream positions of the closed live broadcast data streams. After the second data stream is obtained, whether the time difference between the current time and the system time is smaller than the effective loading duration is judged again, and then the process is repeated.

The technical scheme provided by the disclosure at least brings the following beneficial effects: and if the request for opening the resource preview page is not detected within the effective loading duration, deleting the first data stream so as to balance the influence of the storage space of the client on the performance of the client and the waiting time for rendering and displaying the resource preview page. Meanwhile, whether the closed live data stream exists in the first data stream or not is stopped to detect, so that waste of system resources of the client is avoided.

Optionally, if the first data stream is deleted or the first data stream is not acquired, after the target application is started, the multimedia data processing method provided in the embodiment of the present disclosure includes: the multimedia data processing device responds to a request for opening a resource preview page, and if the first data stream does not exist, local multimedia data corresponding to the resource preview page are obtained, and the resource preview page is rendered and displayed.

In the embodiment of the present disclosure, the local multimedia data refers to multimedia data stored in advance. It is understood that the local multimedia data refers to multimedia data that can be rendered and displayed on the resource preview page. The local multimedia data may be downloaded in response to a user operation before responding to a request for opening a resource preview page, may be cached before responding to a request for opening a resource preview page, may be photographed and stored by an external device, or may be transmitted to the client terminal for storage by means of bluetooth, infrared, wireless network or limited network.

In this embodiment of the present disclosure, the first data stream does not exist, which may be because a request for opening a resource preview page is not detected within an effective loading duration, so that the first data stream is deleted, or may be because the preloading configuration information corresponding to the first request indicates that the resource preview page does not need to be preloaded. In the embodiment of the present disclosure, rendering and displaying of the local multimedia data and the preloaded multimedia data stream are similar, and details thereof are not repeated.

In the embodiment of the disclosure, when rendering and displaying the resource preview page, the preset number of multimedia data may be obtained each time according to the preset number of multimedia data that can be displayed each time by the display of the client, and a real-time loading request is sent to the server at the same time.

The technical scheme provided by the disclosure at least brings the following beneficial effects: and if the first data stream does not exist, obtaining local multimedia data corresponding to the resource preview page, and rendering and displaying the resource preview page. Therefore, even if the first data stream does not exist, the opening request of the resource preview page can be responded without increasing the waiting time, so that the requirement of the user on the waiting time is met.

If in practical application, the multimedia data processing method provided by the embodiment of the present disclosure is applied to the server 12, the following describes the multimedia data processing method provided by the embodiment of the present disclosure with reference to the drawings, and the following exemplifies the method by taking an execution subject as a multimedia data processing device. As shown in fig. 6, which is a schematic flow chart of a multimedia data processing method provided by an embodiment of the present disclosure, the multimedia data processing method provided by the embodiment of the present disclosure includes the following steps 601 to 603.

Step 601, the multimedia data processing apparatus sends a first data stream corresponding to the resource preview page.

Step 602, the multimedia data processing apparatus responds to the first request message for pulling the live data stream, and acquires the second data stream.

Step 603, the multimedia data processing apparatus sends the second data stream, so that in response to the request for opening the resource preview page, the resource preview interface is rendered and displayed according to the data stream of the live resource which is not closed in the first data stream and the second data stream.

In an embodiment of the present disclosure, the second data stream includes a third number of live data streams, other than the first number of live data streams, and being live, the third number being equal to the second number.

Optionally, as shown in fig. 7, in the embodiment of the present disclosure, step 601 may be specifically implemented by the following step 701 and step 702.

Step 701, the multimedia data processing apparatus obtains the third request message.

Step 702, the multimedia data processing apparatus responds to the third request information, and pulls the multimedia data stream preloaded on the resource preview page according to the preloading information.

In an embodiment of the present disclosure, the third request message is used to request to pull the first data stream if the preloading configuration indicates that the resource preview page needs to be preloaded. It should be noted that the third request message may be sent by the client, or sent by a third party for the client. The technical scheme provided by the disclosure at least brings the following beneficial effects: and responding to the third request information, and pulling the first data stream corresponding to the resource preview page according to the preloading information, so that the first data stream is pulled for the resource preview page according to actual requirements, and resource waste of the server caused by multiple pulling can be avoided.

In an embodiment of the disclosure, the pre-loaded information comprises at least one of: a recommendation topic, a recommendation type, and a recommendation policy. It should be noted that the preloaded information may correspond to a server or a client.

In one case, each server sets a piece of preloading information, and as long as the third request message is received, no matter what client side sends the second request message, the multimedia data stream is pulled according to the same piece of preloading information.

In another case, a piece of pre-loading information is set for a target object account corresponding to each client or resource preview page, and as long as a third request message is received, the pre-loading information corresponding to the client or the target object account needs to be acquired, and the first data stream is pulled according to the respective pre-loading information.

In the disclosed embodiment, the recommendation subject or recommendation type in the pre-loading information is a classification identifier of the first data stream, and the first data stream is rapidly screened according to the recommendation subject or recommendation type, so as to improve the speed of pulling the first data stream.

In the disclosed embodiment, the recommendation policy possibly included in the preloaded information is a pull rule for pulling the first data stream, and the recommendation policy may set a logical relationship between multiple recommendation subjects or recommendation types.

The technical scheme provided by the disclosure at least brings the following beneficial effects: and screening the first data stream corresponding to the pull resource preview page through a recommendation subject, a recommendation type or a recommendation strategy so as to improve the probability that the client enters the live data stream through a corresponding live entry in the first data stream, namely the effectiveness of the first data stream.

In the embodiment of the disclosure, the multimedia data processing apparatus first obtains a multimedia data stream in a preset range, and then performs re-screening according to the pre-loading information to obtain a first data stream corresponding to the pre-loading information. It is to be understood that the preset range may be any one of: the method comprises the steps of starting time range of live broadcast data stream, positioning position range of the live broadcast data stream and online people number range corresponding to the live broadcast data stream.

Optionally, in this embodiment of the present disclosure, the first data stream further includes data streams of a fourth number of short video resources corresponding to the resource preview page, where the fourth number is greater than or equal to 1. It should be noted that the first data stream may include both the live resources corresponding to the resource preview page and the short video resources corresponding to the resource preview page. It can be understood that the short video resource is also obtained according to the above-mentioned pre-loading information.

The technical scheme provided by the disclosure at least brings the following beneficial effects: the acquired first data stream comprises live broadcast resources and short video resources, and the diversity of the first data stream can be increased, so that the requirement of a user on the diversity of videos can be better met.

In the embodiment of the present disclosure, pulling the first data stream pre-corresponding to the resource preview page is similar to pulling the second number of live data streams, and the pulling manner is the same and is not described again. The specific differences are as follows:

in a first aspect, the number of first data streams corresponding to the resource preview page is pulled to be a first number, and the number of second number of live data streams is pulled to be a second number. In a second aspect, the resource type of the first data stream corresponding to the resource preview page is pulled to be a live broadcast resource, or a live broadcast resource and a short video resource, and the resource type of the second number of live broadcast data streams is pulled to be a live broadcast resource. In a third aspect, the resource range of the first data stream corresponding to the pull resource preview page includes all resources, and the resource range of the second number of live data streams does not include the first data stream.

The technical scheme provided by the disclosure at least brings the following beneficial effects: and pulling and sending a first data stream and a second data stream corresponding to the resource preview page according to the preloading information so as to facilitate the rendering and display of the resource preview page by the client.

Optionally, in this embodiment of the present disclosure, as shown in fig. 8, before the first data stream corresponding to the resource preview page is sent in step 601, the multimedia data processing method provided in this embodiment of the present disclosure further includes the following steps 801 to 804.

Step 801, the multimedia data processing apparatus obtains a second request message sent by the client.

In the embodiment of the present disclosure, the second request message is used to request to determine whether the resource preview page needs to be preloaded, where the second request message includes a target object account of the target application program, and the target application program can display the resource preview page after being started.

Step 802, the multimedia data processing device counts the starting probability of the resource preview page according to the historical behavior data corresponding to the target object account.

In the embodiment of the present disclosure, the start probability is: and the probability of starting the resource preview page after the client starts the target application program.

In the disclosed embodiment, the multimedia data processing apparatus may acquire the historical behavior data from a log stored by the server. It should be noted that, it may also be defined to obtain historical behavior data from a server log in a specific time period.

Further optionally, in this disclosed embodiment, the multimedia data processing apparatus first screens the historical behavior data for a target event: starting a target application program and opening a resource preview page, then counting the program starting times of the starting target application program, and counting the page opening times of the resource preview page between the starting target application program and the closing target application program (if the resource preview page is opened for multiple times between the starting target application program and the closing target application program at the same time, the page opening times are recorded as one time), and calculating the ratio of the page opening times and the program starting times to obtain the starting probability.

And step 803, the multimedia data processing device generates the pre-loading configuration information according to the comparison result of the starting probability and the preset probability.

In the embodiment of the present disclosure, the preloading configuration information is used to indicate whether the resource preview page needs preloading. The preloading configuration information indicates that the resource preview page needs preloading or indicates that the resource preview page does not need preloading.

Further optionally, as shown in fig. 9, in the embodiment of the present disclosure, step 803 may be specifically implemented by step 901 to step 903.

Step 901, the multimedia data processing device obtains the starting probability of the resource preview page according to the historical behavior data corresponding to the target object account.

And step 902, in case that the starting probability is greater than the preset probability, the multimedia data processing apparatus determines that the preloading configuration information indicates that the resource preview page needs preloading.

And step 903, in the case that the starting probability is less than or equal to the preset probability, the multimedia data processing apparatus determines that the preloading configuration information indicates that the resource preview page does not need preloading.

Illustratively, when the starting probability is greater than the preset probability, the target object account carried in the first request information is a high-activity user, when the starting probability is 1, the target object account carried in the first request information is a full-activity user, and when the target object account is a high-activity user or a full-activity user, the preloading configuration information indicates that the resource preview page needs to be preloaded.

Illustratively, under the condition that the starting probability is less than or equal to the preset probability, the target object account carried in the first request information is not a high-activity user or a full-activity user, and the preloading configuration information indicates that the resource preview page does not need preloading.

The technical scheme provided by the disclosure at least brings the following beneficial effects: and determining whether the preset loading configuration information indicates that the resource preview page needs to be preloaded or not through the comparison result of the starting probability and the preset probability, in other words, if the probability that the client opens the resource preview page is higher, indicating that the resource preview page needs to be preloaded, otherwise, indicating that the resource preview page does not need to be preloaded. Therefore, if the probability that the resource preview page is opened is low, even the resource preview page may not be opened, the first data stream corresponding to the resource preview page needs to occupy network resources of the server and storage resources of the device, which affects the performance of the server.

Step 804, the multimedia data processing apparatus sends the pre-loading configuration information to the client.

In the embodiment of the present disclosure, the multimedia data processing apparatus may actively send the pre-loading configuration information to the client, may also send the pre-loading configuration information according to the request of the client, and may also send the pre-loading configuration information according to the instruction or the request of the third party.

The technical scheme provided by the disclosure at least brings the following beneficial effects: the method comprises the steps of firstly, acquiring a second request message sent by a client, then counting the starting probability of a resource preview page according to historical behavior data, then generating loading configuration information according to the comparison result of the starting probability and the preset probability, and finally sending the loading configuration information to the client. Therefore, the loading configuration information can be prepared to reflect whether the resource preview page in the target application program of the client needs to be preloaded, so that the client can determine whether to send the first data stream corresponding to the resource preview page according to the preloading information, the probability that the first data stream is rendered and displayed is improved, and the waste of server resources is avoided.

Optionally, as shown in fig. 10, in the embodiment of the present disclosure, before the step 601 sends the multimedia data, the method for processing multimedia data provided in the embodiment of the present disclosure further includes the following steps 1001 to 1003.

Step 1001, the multimedia data processing device counts the starting interval duration according to the historical behavior data corresponding to the target object account.

Step 1002, the multimedia data processing apparatus obtains an effective loading duration of the multimedia data stream according to the start interval duration.

Step 1003, the multimedia data processing device sends the effective loading duration to the client.

In the embodiment of the present disclosure, the number of the start interval durations may be 1 or more, which is not limited in the embodiment of the present disclosure. The start interval duration is the time difference between the start time and the open time, and the start time is as follows: and the client starts the target application program, wherein the opening time is the time for opening the resource preview page after the target application program is started currently.

In an embodiment of the present disclosure, the effective loading duration is used to indicate a maximum time for the first data stream to be stored at the client. If the request for opening the resource preview page is not received after the effective loading duration is exceeded, the probability of opening the resource preview page is low after the target application program is started, and therefore the first data stream can be deleted at the client.

Further optionally, in this embodiment of the present disclosure, the counting of the start interval duration by the multimedia data processing apparatus specifically includes: firstly, under the condition that historical behavior data does not include a screening target event (including starting a target application program and opening a resource preview page), a preset time length can be determined as a starting interval time length, and an average value of the starting interval time lengths of other clients can be obtained, wherein the historical behavior data includes the screening target event: under the conditions of starting the target application program and opening the resource preview page, counting the starting time of the starting target application program, counting the opening time of the resource preview page between the starting target application program and the closing target application program corresponding to the starting time (if the resource preview page is opened for multiple times between the starting target application program and the closing target application program at the same time, the opening time of the resource preview page at each time is recorded), calculating the time difference between the starting time and the opening time (if the resource preview page is opened for multiple times corresponding to the starting time, the time difference for multiple times is calculated), and obtaining the starting interval duration.

In the embodiment of the present disclosure, in the case that the number of the start interval durations is 1, the effective loading duration may be the start interval duration, or a product of the start interval duration and a preset coefficient. When the number of the start interval durations is multiple, the effective correction duration may be any one of the multiple start interval durations, an average value of the multiple start interval durations, or an expected value of the multiple start interval durations.

In this embodiment of the present disclosure, sending the effective loading duration to the client may be any of the following: and responding to the client request, sending the effective loading duration to the client immediately after the effective loading duration is obtained, and sending the effective loading duration to the client when sending the first data stream or preloading configuration information.

The technical scheme provided by the disclosure at least brings the following beneficial effects: the method comprises the steps of counting starting interval duration through historical behavior data of a target object account, obtaining effective loading duration of a multimedia data stream according to starting interval trial production, and finally sending the effective loading duration to a client, so that the client determines the time for deleting a first data stream according to the effective loading duration, and the aims of balancing the influence of a storage space of the client on the performance of the client and rendering and displaying the waiting time of a resource preview page can be achieved.

The above description has presented the embodiments of the present application primarily from a method perspective. It is to be understood that the multimedia data processing apparatus includes at least one of a hardware structure and a software module corresponding to each function in order to implement the above-described functions. Those of skill in the art would readily appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as hardware or combinations of hardware and computer software. Whether a function is performed as hardware or computer software drives hardware depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.

The disclosed embodiments may perform the division of the functional units for the multimedia data processing apparatus according to the above method examples, for example, each functional unit may be divided corresponding to each function, or two or more functions may be integrated into one processing unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit. It should be noted that the division of the unit in the embodiment of the present application is schematic, and is only a logic function division, and there may be another division manner in actual implementation.

Fig. 11 is a schematic diagram illustrating a structure of a multimedia data processing apparatus according to an exemplary embodiment. Referring to fig. 11, a multimedia data processing apparatus provided in an embodiment of the present disclosure is applied to a client, and includes: an acquisition unit 1101, a transmission unit 1102, and a display unit 1103; an obtaining unit 1101, configured to obtain a first data stream corresponding to a resource preview page, where the first data stream includes a first number of pre-loaded live data streams; for example, as shown in fig. 2, the obtaining unit 1101 may be configured to perform step 201. A sending unit 1102, configured to send first request information for pulling a live data stream if it is detected that a second number of closed live data streams exist in the first data stream; for example, as shown in fig. 2, the sending unit 1102 may be configured to perform step 202. An obtaining unit 1101, configured to obtain a second data stream sent in response to the first request information; the second data stream comprises a third number of live data streams which are live except the first number of live data streams, and the third number is equal to the second number; for example, as shown in fig. 2, the obtaining unit 1101 may be configured to perform step 203. A display unit 1103, configured to render and display a resource preview interface according to the live data stream and the second data stream that are not closed in the first data stream in response to a request for opening a resource preview page. For example, as shown in fig. 2, a display unit 1103 may be used to perform step 204.

Optionally, as shown in fig. 11, the obtaining unit 1101 is configured to: starting a target application program, and sending a second request message, wherein the target application program can display a resource preview page after being started, the second request message is used for requesting to judge whether the resource preview page needs to be preloaded, and the second request message comprises a target object account of the target application program; acquiring pre-loading configuration information corresponding to the second request message; under the condition that the preloading configuration information indicates that the resource preview page needs preloading, sending a third request message, wherein the third request message is used for requesting to pull a first data stream corresponding to the resource preview page; the first data stream transmitted in response to the third request information is acquired. For example, as shown in fig. 4, the obtaining unit 1101 may be configured to perform steps 401 to 403.

Optionally, as shown in fig. 11, the multimedia data processing apparatus provided in the embodiment of the present disclosure further includes: a processing unit 1104; after the first data stream corresponding to the resource preview page is acquired, if a request for opening the resource preview page is not detected within the effective loading duration, the processing unit 1004 is configured to delete the first data stream, and stop detecting whether a second number of closed live data streams exist in the first data stream.

Optionally, as shown in fig. 11, the multimedia data processing apparatus further includes: the processing unit 1104 is configured to, in response to a request for opening a resource preview page, if there is no first data stream, render and display the resource preview page according to local multimedia data corresponding to the resource preview page, where the local multimedia data is pre-stored multimedia data.

Optionally, as shown in fig. 11, the multimedia data processing apparatus further includes: a polling unit 1105 and a determination unit 1106; a polling unit 1105 configured to: after a first data stream corresponding to a resource preview page is obtained, starting a polling thread, and polling a background interface of each live data stream in the first data stream according to preset polling time; for example, as shown in fig. 3, a polling unit 1105 may be used to perform step 301. A determining unit 1106, configured to determine, if the background interface does not receive the live data stream, that the live data stream corresponding to the background interface is a closed live data stream. For example, as shown in fig. 3, the determining unit 1106 may be used to perform step 302.

Optionally, as shown in fig. 11, the display unit is specifically configured to: sequentially updating the data stream positions of a second number of closed live data streams in the first data stream to a third number of live data streams in the second data stream to generate data streams to be rendered; and rendering and displaying the resource preview interface according to the data stream to be rendered.

Fig. 12 is a schematic diagram illustrating a structure of a multimedia data processing apparatus according to an exemplary embodiment. Referring to fig. 12, a multimedia data processing apparatus provided in an embodiment of the present disclosure is applied to a server, and includes: a transmission unit 1201 and an acquisition unit 1202; a sending unit 1201, configured to send a first data stream corresponding to a resource preview page; the first data stream comprises a preloaded first number of live data streams; for example, as shown in fig. 6, the sending unit 1201 may be configured to execute step 601. An obtaining unit 1202, configured to obtain, in response to a first request message for pulling a live data stream, a second data stream, where the second data stream includes a third number of live data streams that are live in addition to the first number of live data streams, and the third number is equal to the second number; for example, as shown in fig. 6, the obtaining unit 1202 may be configured to perform step 602. The sending unit 1201 is further configured to send the second data stream, so that in response to a request for opening the resource preview page, a resource preview interface is rendered and displayed according to the data stream of the live resource that is not closed in the first data stream and the second data stream. For example, as shown in fig. 6, the sending unit 1201 may be configured to execute step 603.

Optionally, as shown in fig. 12, the multimedia data processing apparatus further includes: a counting unit 1203 and a generating unit 1204; the obtaining unit 1202 is further configured to obtain, before sending the first data stream corresponding to the resource preview page, a second request message sent by the client, where the second request message is used to request to determine whether the resource preview page needs to be preloaded, and the second request message includes a target object account of the target application program, and the target application program can display the resource preview page after being started; for example, as shown in fig. 8, the above-mentioned obtaining unit 1202 may be used to execute step 801. A counting unit 1203, configured to count, according to historical behavior data corresponding to the target object account, a starting probability of the resource preview page, where the starting probability is: the probability of starting a resource preview page after a client starts a target application program; for example, as shown in fig. 8, the above-mentioned statistical unit 1203 may be used for executing step 802. A generating unit 1204, configured to generate pre-loading configuration information according to a comparison result between the starting probability and the preset probability, where the pre-loading configuration information is used to indicate whether a resource preview page needs to be pre-loaded; for example, as shown in fig. 8, the generating unit 1204 may be configured to perform step 803. The sending unit 1201 is further configured to send the pre-loading configuration information to the client. For example, as shown in fig. 8, the sending unit 1201 may be configured to execute step 804.

Optionally, the generating unit 1204 is specifically configured to: acquiring the starting probability of a resource preview page according to historical behavior data corresponding to a target object account; under the condition that the starting probability is greater than the preset probability, determining that the preloading configuration information indicates that the resource preview page needs preloading; and under the condition that the starting probability is less than or equal to the preset probability, determining that the preloading configuration information indicates that the resource preview page does not need preloading. For example, as shown in fig. 9, the generating unit 1204 may be configured to perform steps 901 to 903.

Optionally, as shown in fig. 12, the multimedia data processing apparatus further includes: the counting unit 1203 is further configured to count, before sending the first data stream corresponding to the resource preview page, a start interval duration according to the historical behavior data corresponding to the target object account, where the start interval duration is a time difference between start time and open time, and the start time is: the client starts the target application program, and the opening time is the time for opening a resource preview page after the target application program is started currently; for example, as shown in fig. 10, the above-mentioned counting unit 1203 may be used for executing step 1001. An obtaining unit 1202, configured to obtain an effective loading duration of the first data stream according to the start interval duration; for example, as shown in fig. 10, the obtaining unit 1202 may be configured to perform step 1002. A sending unit 1201, configured to send the effective loading duration to the client. For example, as shown in fig. 10, the sending unit 1201 may be configured to execute step 1003.

Optionally, the sending unit 1201 is specifically configured to: acquiring a third request message, wherein the third request message is used for requesting to pull the first data stream under the condition that the preloading configuration indicates that the resource preview page needs to be preloaded; and responding to the third request information, and pulling the first data stream of the resource preview page according to the preloading information. For example, as shown in fig. 7, the sending unit 1201 may be configured to perform step 701 and step 702.

With regard to the apparatus in the above-described embodiment, the specific manner in which each unit performs the operation has been described in detail in the embodiment related to the method, and will not be described in detail here.

On the basis that the multimedia data processing method provided by the embodiment of the present disclosure is applied to the client and the server, as shown in fig. 13, the embodiment of the present disclosure provides a multimedia data processing system including: a client 11 and a server 12;

the server 12 sends a first data stream corresponding to the resource preview page;

the client 11 acquires a first data stream corresponding to the resource preview page from the server 12, wherein the first data stream comprises a first number of pre-loaded live data streams;

if the client 11 detects that a second number of closed live data streams exist in the first data stream, sending first request information for pulling the live data streams;

the server 12 responds to the first request message for pulling the live data streams, and acquires second data streams, where the second data streams include a third number of live data streams, which are live in the live broadcast and are different from the first number of live data streams, and the third number is equal to the second number;

the server 12 sends the second data stream, so that in response to a request for opening a resource preview page, a resource preview interface is rendered and displayed according to the data stream of the live broadcast resource which is not closed in the first data stream and the second data stream;

the client 11 acquires the second data stream sent in response to the first request information; the second data stream comprises a third number of live data streams which are live except the first number of live data streams, and the third number is equal to the second number;

the client 11 responds to the request for opening the resource preview page, and renders and displays a resource preview interface according to the live data stream and the second data stream which are not closed in the first data stream.

Optionally, as shown in fig. 13, the multimedia data processing system further includes the methods in fig. 2 to fig. 10. With regard to the system in the above-described embodiment, the specific manner in which the operations are performed has been described in detail in the embodiment related to the method, and will not be described in detail here.

Therefore, the first data stream is obtained and sent through the server 12, whether the closed live data stream exists in the first data stream is detected through the client 11, so that the sending opportunity of the first request information of the second number of live resources can be obtained in time, the second number of live data streams are obtained and sent through the server 12, then the client 11 replaces the second number of closed live data streams in the first data stream with the second data stream, on one hand, the first data stream can be updated in time, and on the other hand, the rendered and displayed live resources in the resource preview interface are all live resources which are being live.

Fig. 14 is a schematic structural diagram of a client or a server provided by the present disclosure. As in fig. 14, the electronic device may include a processor 1401, a memory 1402, and programs or instructions stored on the memory 1402 and executable on the processor 1401; wherein the programs or instructions, when executed by the processor 1401, implement the multimedia data processing method in the above-described embodiments. In addition, the electronic device may further comprise a communication bus 1403 and at least one communication interface 1404.

Processor 1401 may be a central processing unit, a micro-processing unit, an application specific integrated circuit, or one or more integrated circuits for controlling the execution of programs in accordance with the present disclosure. Communication bus 1403 is a signal path for communicating information between the above components. Communication interface 1404, using any transceiver or the like, is used for communicating with other devices or communication networks, such as ethernet, wireless access networks, wireless local area networks, etc.

Memory 1402 may be, but is not limited to, a read-only memory or other type of static storage device that may store static information and instructions, a random access memory or other type of dynamic storage device that may store information and instructions, an electrically erasable programmable read-only memory, a read-only optical disk or other optical disk storage, optical disk storage (including compact disk, laser disk, optical disk, digital versatile disk, blu-ray disk, etc.), a magnetic disk storage medium or other magnetic storage device, or any other medium that can be used to carry or store desired program code in the form of instructions or data structures and that can be accessed by a computer. The memory 1402 may be separate and coupled to the processor 1401 via a communication bus 1404. Memory 1402 may also be integrated with processor 1401.

The memory 1402 is used to store instructions for performing the disclosed aspects and is controlled by the processor 1401. The processor 1401 is used to execute programs or instructions stored in the memory 1402 to implement the functions in the disclosed methods.

As an example, in conjunction with fig. 11, the functions implemented by the acquisition unit 1101, the transmission unit 1102, and the display unit 1103 in the multimedia data processing apparatus are the same as those of the processor 1401 in fig. 14.

As an example, in conjunction with fig. 12, the transmitting unit 1201 and the acquiring unit 1202 in the multimedia data processing apparatus implement the same functions as the processor 1401 in fig. 14.

In particular implementations, processor 1401 may include one or more CPUs such as CPU0 and CPU1 in fig. 14 as an example. In a particular implementation, an electronic device may include multiple processors 1401, each of which processors 1401 may be a single core processor or a multi-core processor. A processor herein may refer to one or more devices, circuits, and/or processing cores for processing data (e.g., computer program instructions).

In particular implementations, the electronic device may also include an output device 1405 and an input device 1406, as one embodiment. Output device 1405 is in communication with processor 1401, which may display information in a variety of ways. For example, the output device 1405 may be a liquid crystal display, a light emitting diode display device, a cathode ray tube display device, a projector, or the like. The input device 1406 is in communication with the processor 1401 and can accept input from a user in a variety of ways. For example, the input device 1406 may be a mouse, a keyboard, a touch screen device, a sensing device, or the like.

Those skilled in the art will appreciate that the configuration shown in fig. 14 does not constitute a limitation of the electronic device, and may include more or fewer components than those shown, or combine certain components, or employ a different arrangement of components. The electronic device in fig. 14 may be a server, a client, or other devices.

In addition, the present disclosure also provides a readable storage medium on which a program or instructions are stored, which, when executed by a processor, enables an electronic device to perform the multimedia data processing method provided as the above embodiment.

In addition, the present disclosure also provides a computer program product, which is stored in a non-volatile storage medium, and when being executed by at least one processor, causes an electronic device to execute the multimedia data processing method provided in the above embodiment.

Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This disclosure is intended to cover any variations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.

Claims

1. A multimedia data processing method is applied to a client and comprises the following steps:

acquiring a first data stream corresponding to a resource preview page, wherein the first data stream comprises a first number of pre-loaded live data streams;

if detecting that a second number of closed live data streams exist in the first data stream, sending first request information for pulling the live data streams;

acquiring a second data stream sent in response to the first request information; the second data stream comprises a third number of live data streams, which are live in addition to the first number of live data streams, and the third number is equal to the second number;

and responding to a request for opening the resource preview page, and rendering and displaying the resource preview interface according to the live data stream which is not closed in the first data stream and the second data stream.

2. The method of claim 1, wherein the obtaining the first data stream corresponding to the resource preview page comprises:

starting a target application program, and sending a second request message, wherein the target application program can display the resource preview page after being started, the second request message is used for requesting to judge whether the resource preview page needs to be preloaded, and the second request message comprises a target object account of the target application program;

acquiring pre-loading configuration information corresponding to the second request message;

sending a third request message under the condition that the preloading configuration information indicates that the resource preview page needs preloading, wherein the third request message is used for requesting to pull a first data stream corresponding to the resource preview page;

and acquiring the first data stream sent in response to the third request message.

3. The method for processing multimedia data according to claim 1, wherein after the obtaining the first data stream corresponding to the resource preview page, the method further comprises:

and if the request for opening the resource preview page is not detected within the effective loading duration, deleting the first data stream, and stopping detecting whether a second number of closed live broadcast data streams exist in the first data stream.

4. A multimedia data processing method is applied to a server and comprises the following steps:

sending a first data stream corresponding to the resource preview page; the first data stream comprises a preloaded first number of live data streams;

responding to a first request message for pulling live data streams, and acquiring a second data stream, wherein the second data stream comprises a third number of live data streams which are live except the first number of live data streams, and the third number is equal to the second number;

and sending the second data stream, so that in response to a request for opening the resource preview page, the resource preview interface is rendered and displayed according to the data stream of the live resource which is not closed in the first data stream and the second data stream.

5. The method of claim 4, wherein before the sending the first data stream corresponding to the resource preview page, the method further comprises:

acquiring a second request message sent by the client, wherein the second request message is used for requesting to judge whether the resource preview page needs to be preloaded, the second request message comprises a target object account of the target application program, and the target application program can display the resource preview page after being started;

according to the historical behavior data corresponding to the target object account, counting the starting probability of the resource preview page, wherein the starting probability is as follows: the probability of starting the resource preview page after the client starts the target application program;

generating preloading configuration information according to a comparison result of the starting probability and a preset probability, wherein the preloading configuration information is used for indicating whether the resource preview page needs preloading or not;

and sending the preloading configuration information to the client.

6. A multimedia data processing apparatus, applied to a client, comprising: the device comprises an acquisition unit, a sending unit and a display unit;

the acquiring unit is used for acquiring a first data stream corresponding to a resource preview page, wherein the first data stream comprises a first number of pre-loaded live data streams;

the sending unit is configured to send first request information for pulling a live data stream if it is detected that a second number of closed live data streams exist in the first data stream;

the obtaining unit is further configured to obtain a second data stream sent in response to the first request information; the second data stream comprises a third number of live data streams, which are live in addition to the first number of live data streams, and the third number is equal to the second number;

and the display unit is used for responding to a request for opening the resource preview page, and rendering and displaying the resource preview interface according to the live data stream which is not closed in the first data stream and the second data stream.

7. A multimedia data processing apparatus, applied to a server, comprising: a transmitting unit and an acquiring unit;

the sending unit is used for sending a first data stream corresponding to the resource preview page; the first data stream comprises a preloaded first number of live data streams;

the obtaining unit is configured to obtain a second data stream in response to a first request message for pulling a live data stream, where the second data stream includes a third number of live data streams that are live in addition to the first number of live data streams, and the third number is equal to the second number;

the sending unit is further configured to send the second data stream, so that in response to a request for opening the resource preview page, the resource preview interface is rendered and displayed according to the data stream of the live broadcast resource that is not closed in the first data stream and the second data stream.

8. An electronic device, comprising: a processor, a memory, and a program or instructions stored on the memory and executable on the processor; wherein the program or instructions, when executed by the processor, implement the multimedia data processing method of any of claims 1-3, or the multimedia data processing method of any of claims 4-5.

9. A readable storage medium, characterized in that a program or instructions are stored thereon, which when executed by a processor implement the multimedia data processing method of any of claims 1-3, or the multimedia data processing method of any of claims 4-5.

10. A computer program product comprising instructions, characterized in that the computer program product is stored in a non-volatile storage medium, the computer program product realizing the multimedia data processing method according to any of claims 1-3, or the multimedia data processing method according to any of claims 4-5, when executed by at least one processor.