CN110807106B - Multimedia data processing method and device, computer equipment and storage medium - Google Patents

Multimedia data processing method and device, computer equipment and storage medium Download PDF

Info

Publication number
CN110807106B
CN110807106B CN201911052247.7A CN201911052247A CN110807106B CN 110807106 B CN110807106 B CN 110807106B CN 201911052247 A CN201911052247 A CN 201911052247A CN 110807106 B CN110807106 B CN 110807106B
Authority
CN
China
Prior art keywords
multimedia data
time
weight
time threshold
length
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201911052247.7A
Other languages
Chinese (zh)
Other versions
CN110807106A (en
Inventor
刘清
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangzhou Wangxing Information Technology Co ltd
Original Assignee
Guangzhou Wangxing Information Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangzhou Wangxing Information Technology Co ltd filed Critical Guangzhou Wangxing Information Technology Co ltd
Priority to CN201911052247.7A priority Critical patent/CN110807106B/en
Publication of CN110807106A publication Critical patent/CN110807106A/en
Application granted granted Critical
Publication of CN110807106B publication Critical patent/CN110807106B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/40—Information retrieval; Database structures therefor; File system structures therefor of multimedia data, e.g. slideshows comprising image and additional audio data
    • G06F16/43—Querying
    • G06F16/435—Filtering based on additional data, e.g. user or group profiles
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/40—Information retrieval; Database structures therefor; File system structures therefor of multimedia data, e.g. slideshows comprising image and additional audio data
    • G06F16/43—Querying
    • G06F16/438—Presentation of query results
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/40—Information retrieval; Database structures therefor; File system structures therefor of multimedia data, e.g. slideshows comprising image and additional audio data
    • G06F16/44—Browsing; Visualisation therefor
    • G06F16/447—Temporal browsing, e.g. timeline

Abstract

The embodiment of the invention discloses a method, a device, a computer device and a storage medium for processing multimedia data, wherein the method comprises the following steps: buffering the multimedia data; if the multimedia data is in a played state, detecting an operation acting on the multimedia data; determining a first time threshold according to the operation; determining a first time length of multimedia data to be played; if the first time length is greater than the first time threshold, suspending buffering the multimedia data. The method ensures that the volume of the buffered multimedia data is proper, reduces the waste of the buffered multimedia data, reduces the waste of the bandwidth of the server for distributing the multimedia data and reduces the bandwidth cost of the server for distributing the multimedia data under the condition that a user skips or directly closes the multimedia data.

Description

Multimedia data processing method and device, computer equipment and storage medium
Technical Field
Embodiments of the present invention relate to multimedia processing technologies, and in particular, to a method, an apparatus, a computer device, and a storage medium for processing multimedia data.
Background
The online playing is a video playing mode which can buffer part of the multimedia data before playing the multimedia data, so that the multimedia data can be played while being transmitted, and further, a user can directly watch the multimedia data online, and the downloading waiting time and the storage space are saved.
In order to ensure the fluency of online playing, a buffer technology is mostly adopted, and certain stream data is buffered when the bandwidth condition is good, so that the situation of playing freezing when the bandwidth is poor is avoided.
The use of buffering involves setting the size of a buffer, which limits the volume of buffered multimedia data within the size of the buffer, and at present, the following two ways are used to set the size of the buffer:
1. fixed arrangement
A value is empirically set in advance, and the size of the buffer is fixed to the value.
2. Setting according to bandwidth conditions
And setting a value according to the current bandwidth condition, setting the size of the buffer zone as the value, wherein the value is larger under the condition of better bandwidth condition, so as to buffer more multimedia data, and smaller under the condition of worse bandwidth condition, so as to reduce the clamping.
However, with the development of network technologies, especially the popularization of technologies such as optical fiber and 5G (fifth generation mobile communication system), bandwidth conditions will be greatly improved, and problems such as network jitter will be greatly improved, in which case buffered multimedia data will easily reach an upper limit, and users may skip or directly close the multimedia data, wasting buffered multimedia data, wasting bandwidth of a server distributing the multimedia data, resulting in higher bandwidth cost of the server distributing the multimedia data.
Disclosure of Invention
The embodiment of the invention provides a processing method, a processing device, computer equipment and a storage medium of multimedia data, which are used for solving the problem that resources are wasted and the bandwidth cost of a server for distributing the multimedia data is higher because the multimedia data is skipped or directly closed.
In a first aspect, an embodiment of the present invention provides a method for processing multimedia data, including:
Buffering the multimedia data;
if the multimedia data is in a played state, detecting an operation acting on the multimedia data;
determining a first time threshold according to the operation;
Determining a first time length of multimedia data to be played;
if the first time length is greater than the first time threshold, suspending buffering the multimedia data.
In a second aspect, an embodiment of the present invention further provides a method for processing multimedia data, including:
Displaying a playing interface;
Displaying a picture of the multimedia data and a playing progress bar on the playing interface;
an operation for receiving the multimedia data;
and displaying an area on the playing progress bar, wherein the area is used for representing the time length of the multimedia data to be played, and the length of the area is related to the operation.
In a third aspect, an embodiment of the present invention further provides a processing apparatus for multimedia data, including:
the buffer module is used for buffering the multimedia data;
the operation detection module is used for detecting the operation acting on the multimedia data if the multimedia data is in a played state;
A time threshold determining module for determining a first time threshold according to the operation;
the time length determining module is used for determining a first time length of the multimedia data to be played;
And the buffering and suspending module is used for suspending buffering the multimedia data if the first time length is greater than the first time threshold.
In a fourth aspect, an embodiment of the present invention further provides a processing apparatus for multimedia data, including:
the playing interface display module is used for displaying a playing interface;
The interface element display module is used for displaying pictures of the multimedia data and a playing progress bar on the playing interface;
an operation receiving module for receiving an operation acting on the multimedia data;
and the area display module is used for displaying an area on the playing progress bar, wherein the area is used for representing the time length of the multimedia data to be played, and the length of the area is related to the operation.
In a fifth aspect, embodiments of the present invention further provide a computer device, where the computer device includes a display screen and an interactor;
the display screen is used for displaying a playing interface, and displaying pictures of the multimedia data and a playing progress bar on the playing interface;
The interactor is used for receiving operations acting on the multimedia data;
the display screen is further configured to display an area on the playing progress bar, where the area is used to represent a time length of the multimedia data to be played, and the length of the area is related to the operation.
In a sixth aspect, an embodiment of the present invention further provides a computer apparatus, including:
One or more processors;
A memory for storing one or more programs;
the one or more programs, when executed by the one or more processors, cause the one or more processors to implement the method of processing multimedia data as in any of the first or second aspects.
In a seventh aspect, an embodiment of the present invention further provides a computer readable storage medium having stored thereon a computer program which, when executed by a processor, implements a method for processing multimedia data according to any of the first or second aspects.
In this embodiment, a playing interface is displayed, a picture of multimedia data and a playing progress bar are displayed on the playing interface, an operation acting on the multimedia data is received, an area is displayed on the playing progress bar, the area is used for representing the time length of the multimedia data to be played, the length of the area is related to the operation, the operation triggered by a user and acting on the multimedia data is an active action, the interest degree of the user on the multimedia data can be reflected to a certain extent, an adaptive first time threshold value is determined according to the interest degree of the user on the multimedia data, the size of a buffer area is used as the size, the interest degree of the user on the multimedia data is higher, the multimedia data expected to be watched or listened is higher, the interest degree of the user on the multimedia data is lower, the multimedia data expected to be watched or listened is lower, the size of the buffer area can be adapted to the user's expectation on the multimedia data, the buffered multimedia data can easily reach the upper limit of the buffer area under the condition of better bandwidth condition, the buffered multimedia data can be ensured to be suitable, the user can skip or directly shut down the multimedia data, the waste of the multimedia data of the server is reduced, and the bandwidth of the server for distributing the multimedia data of the multimedia data is reduced.
Drawings
Fig. 1 is a flowchart of a method for processing multimedia data according to a first embodiment of the present invention;
fig. 2 is a flowchart of a method for processing multimedia data according to a second embodiment of the present invention;
Fig. 3 is a flowchart of a method for processing multimedia data according to a third embodiment of the present invention;
FIG. 4 is a diagram illustrating a playback interface according to a third embodiment of the present invention;
Fig. 5 is a schematic structural diagram of a multimedia data processing apparatus according to a fourth embodiment of the present invention;
fig. 6 is a schematic structural diagram of a multimedia data processing apparatus according to a fifth embodiment of the present invention;
fig. 7 is a schematic structural diagram of a computer device according to a sixth embodiment of the present invention;
Fig. 8 is a schematic structural diagram of a computer device according to a seventh embodiment of the present invention.
Detailed Description
The invention is described in further detail below with reference to the drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the invention and are not limiting thereof. It should be further noted that, for convenience of description, only some, but not all of the structures related to the present invention are shown in the drawings. It should be noted that, without conflict, the embodiments of the present invention and features of the embodiments may be combined with each other.
Example 1
Fig. 1 is a flowchart of a method for processing multimedia data according to an embodiment of the present invention, where the method may be applicable to a case of dynamically adjusting a size of a buffer according to a user's interest in currently played multimedia data, and the method may be performed by a processing device for multimedia data, where the processing device for multimedia data may be implemented by software and/or hardware, and may be configured in a computer device, for example, a personal computer, a mobile terminal (such as a mobile phone, a tablet computer, etc.), an intelligent interaction tablet, a wearable device (such as a smart watch, a smart glasses, etc.), a television, etc., and the method specifically includes the following steps:
S101, buffering multimedia data.
In this embodiment, the operating system of the computer device includes windows, android (android), iOS, hong mo, and the like, and an application program supporting online playing of multimedia data, such as a player, an instant messenger, a browser, and the like, is installed in the operating system.
Wherein the type of multimedia data includes video data, audio data, and the like.
If the multimedia data is Video data, the format of the multimedia data is mostly streaming data, such as MP4 (Moving Picture Experts Group, fourth edition of moving picture experts group), FLV (Flash Video, streaming format), and the like.
The multimedia data is stored in a server, and the server and the computer device can transfer the multimedia data through protocols such as RTSP (REAL TIME STREAMING Protocol, real-time streaming Protocol), RTMP (REAL TIME MESSAGING Protocol, real-time messaging Protocol), HLS (HTTP LIVE STREAMING, HTTP (Hyper Text Transport Protocol, hypertext transfer Protocol) based streaming media transmission Protocol), and the like.
In addition, the form of the multimedia data includes short videos, dramas, movies, electronic books, songs, and the like.
In the computer device, a Buffer area (Buffer) may be set, where the Buffer area refers to an area reserved in the memory, and is used to temporarily store data of an I/O (input/output port), so that the actual number of physical read/write operations may be reduced, the Buffer area is allocated to the memory during creation, and the area of the memory is reused all the time, so that the number of times of dynamically allocating and recovering the memory may be reduced.
And storing the data packet of the multimedia data transmitted by the server in the buffer area to realize buffering.
S102, if the multimedia data is in a played state, detecting an operation acting on the multimedia data.
In this embodiment, if the multimedia data is in a played state, a user-triggered operation acting on the multimedia data may be detected.
The played state may refer to a behavior of viewing the multimedia data that is actively triggered by the user, that is, a situation that the user actively triggers to play the multimedia data, and the multimedia data is viewable such as being on the top, and the multimedia data is not in a pause state, cannot be played due to insufficient buffering, is blocked by other windows, and the like.
The operations acting on the multimedia data may include operations of controlling pictures of the multimedia data, such as fast forward, backward, adjusting definition, dragging a progress bar, etc., and operations of controlling pictures of the multimedia data, such as bulleting, praying, collecting, sharing, etc.
In addition, since the computer devices have different structures, the manner of operating the multimedia data is also different, which is not limited in this embodiment.
For example, a plurality of controls are provided on a playing interface for playing the multimedia data, different controls are used for triggering different operations, and when one or more controls are detected to receive clicking operations, the operations on the multimedia data are determined to be received.
For a computer device providing touch operation for a mobile terminal, a wearable device, an intelligent interaction tablet and the like, a user can click an element by using a finger or a touch pen in a touch manner, so that the computer device receives an operation acting on multimedia data.
Aiming at computer equipment such as intelligent televisions and personal computers and the like for providing key operation, a user can click a control in a key control mode through external equipment connected with the computer equipment so that the computer equipment receives operation acting on multimedia data. The external device includes, but is not limited to, a mouse and the like.
For another example, the computer device supports standard or custom keys that, when signals of one or more keys are received, determine that an operation is received that is to be performed on the multimedia data.
The keys include, but are not limited to, keys configured by the computer device (such as volume keys), keys in the keyboard (such as direction keys "≡", "→"), and keys in the remote controller (such as fast forward keys).
S103, determining a first time threshold according to the operation.
In practical application, the user-triggered operation acting on the multimedia data may reflect to a certain extent the interest degree of the user in the multimedia data.
For example, if the multimedia data is a television show or a movie, the scenario is relatively flat in a certain period of time, the user has a low interest level in the multimedia data, and may be doing other things at the same time, fast forward or pause is frequent, and the scenario is skipped quickly on the basis of substantially knowing the scenario.
For another example, if the multimedia data is a short video, the duration is short, the whole is more wonderful, the user's interest in the multimedia data is high, and the user may fast forward, and quickly skip the scenario on the basis of knowing the scenario.
In this embodiment, the first time threshold adapted to the user's interest level in the multimedia data may be generated as the size of the buffer by referring to the user-triggered operation acting on the multimedia data.
S104, determining a first time length of the multimedia data to be played.
By multimedia data to be played, also referred to as playable multimedia data, it is meant that multimedia data that has been buffered and is located after the multimedia data currently being played does not contain multimedia data that has been buffered and is located before the multimedia data currently being played.
In this embodiment, the first time length of the multimedia data to be played can be counted, so as to adjust the buffering operation.
S105, if the first time length is greater than the first time threshold, suspending buffering the multimedia data.
The first time length is compared with a first time threshold, and in the event that the first time length is greater than the first time threshold, buffered multimedia data reaches a limit of the buffer.
Further, in the case that the user triggers a back operation, the speed of buffering the multimedia data is greater than the speed of playing the multimedia data, etc., the buffered multimedia data reaches the limit of the buffer.
If the current computer device is buffering the multimedia data, a pause notification may be sent to the server, which in response thereto pauses the sending of the multimedia data, thereby stopping the buffering of the multimedia data.
If the current computer device has paused the buffered multimedia data, the pause in the buffered multimedia data may continue to be maintained.
In this embodiment, the operation on the multimedia data is detected if the multimedia data is in a played state, a first time threshold is determined according to the operation, a first time length of the multimedia data to be played is determined, if the first time length is greater than the first time threshold, the buffering of the multimedia data is paused, the operation triggered by the user and acting on the multimedia data is an active action, the interest degree of the user on the multimedia data can be reflected to a certain extent, the adaptive first time threshold is determined according to the interest degree of the user on the multimedia data, the buffer area is used as the size, the interest degree of the user on the multimedia data is higher, the multimedia data expected to be watched or listened is more, the interest degree of the user on the multimedia data is lower, the multimedia data expected to be watched or listened is less, the size of the buffer area can be adapted to the user's expectation on the multimedia data, the buffered multimedia data can easily reach the upper limit of the buffer area under the condition of better bandwidth condition, the buffered multimedia data can be ensured to be suitable, the user can skip or directly shut down the multimedia data, the waste of the multimedia data of the buffer server is reduced, and the bandwidth of the multimedia server is reduced.
Example two
Fig. 2 is a flowchart of a processing method of multimedia data according to a second embodiment of the present invention, where the processing operations of calculating a first time threshold, maintaining buffering, and not playing are further added based on the foregoing embodiments, and the method specifically includes the following steps:
S201, buffering the multimedia data.
S202, if the multimedia data is in a played state, detecting an operation acting on the multimedia data.
In this embodiment, operations that act on multimedia data in a past time period may be counted every certain time, for example, 5 seconds, so that the statistics operations are reduced, and the resource consumption of the computer device is reduced.
In a specific implementation, a Timer may be set, where the Timer is used to count a specified time, such as 5 seconds.
During the continuous timing of the Timer, for example, 5 minutes, when an operation acting on the multimedia data is detected, relevant information of the operation, such as type, time and the like, is recorded.
If the Timer finishes counting, determining the operation which is detected during the counting period of the Timer and acts on the multimedia data, returning to set the Timer and carrying out counting again.
In this embodiment, the trigger interval of the timer and the statistics window of the user operation are independent of each other, for example, the timer start statistics are triggered every 5 seconds, but the statistics are not just the operations of the user for the past 5 seconds, but the total number of operations for the past 5 minutes or more.
S203, calculating the weight for the operation.
In this embodiment, the operations are converted into weights, also called scores, interest values, etc., to represent the user's interest level in the multimedia data.
In a specific implementation, the user-triggered operations on multimedia data can be distinguished into at least two types:
1. Negative direction operation
By negative operation is meant an operation that indicates a negative interest of the user in the multimedia data, e.g. fast forward, pause, etc.
2. Operation in the forward direction
By forward operation, it is meant an operation that represents a forward interest of the user in the multimedia data, such as posting a barrage, praying, collecting, sharing, and so forth.
Different rule calculation weights may be set for different types of operations, which the present embodiment does not limit.
In one example, if the operation is a negative operation, the frequency of the operation is counted as the weight.
Of course, the manner of calculating the weights described above is merely an example, and in implementing the present embodiment, other manners of calculating the weights may be set according to actual situations, for example, different scores may be configured according to different types of operations, products of the scores and frequencies thereof may be calculated for the same operation, a sum of the products of the different operations may be calculated as the weights, and the present embodiment is not limited thereto. In addition, in addition to the above-mentioned manner of calculating the weight, those skilled in the art may also adopt other manners of calculating the weight according to actual needs, which is not limited in this embodiment.
S204, determining a first time threshold based on the weight.
In this embodiment, the first time threshold may be calculated using weights accordingly, depending on the type of operation.
If the operation is negative, the first time threshold is inversely related to the weight, that is, the larger the weight is, the smaller the first time threshold is, otherwise, the smaller the weight is, and the larger the first time threshold is.
If the operation is a forward operation, the first time threshold is positively correlated with the weight, i.e. the smaller the weight is, the larger the first time threshold is, otherwise, the larger the weight is, and the smaller the first time threshold is.
In one example, the weight threshold is preset, and a time upper limit value, a time lower limit value, which is greater than the time lower limit value, is preset.
In this example, the weight is compared with a preset weight upper limit value.
If the weight is greater than the preset weight upper limit value, the first time threshold value is set to be the preset time lower limit value.
Or alternatively
If the weight is smaller than or equal to the preset weight upper limit value, calculating the ratio of the time difference value to the weight upper limit value, wherein the time difference value is the difference value between the preset time upper limit value and the preset time lower limit value.
And (5) configuring the ratio of the weights to obtain a target value.
And adding the target value on the basis of the time lower limit value to obtain a first time threshold.
In this example, the formula is:
Where n is a first time threshold, s is a weight of the operation, st is a weight threshold, n max is a time upper limit, and n min is a time lower limit.
Further, the number of types of operations may be considered in weight configuration ratios.
If the type of the operation is one, the product between the weight and the ratio of the operation is calculated to obtain the target value.
If the types of the operations are two or more, calculating the sum of the weights of the operations, and calculating the product between the sum of the weights and the ratio to obtain the target value.
For example, assuming operation is fast forward, weights are expressed in terms of their frequency, the above formula can be expressed as:
Where n is a first time threshold, sc is the frequency of fast forward, st is a weight threshold, n max is a time upper limit, and n min is a time lower limit.
For another example, assuming operation as fast forward and pause, the above formula can be expressed as:
Where n is a first time threshold, sc is the frequency of fast forward, sp is the frequency of pause, st is a weight threshold, n max is a time upper limit, and n min is a time lower limit.
In another example, a weight upper limit value, a weight lower limit value, which is larger than the weight lower limit value, are set in advance.
And presetting an upper time limit value, a middle time value and a lower time limit value, wherein the upper time limit value is larger than the middle time value, and the middle time value is larger than the lower time limit value.
In this example, the first time threshold may be calculated in a direct mapped manner.
If the weight is greater than the preset weight upper limit value, the first time threshold value is set to be the preset time lower limit value.
Or alternatively
If the weight is greater than or equal to the preset weight lower limit value and less than or equal to the preset weight upper limit value, the first time threshold is set as a preset time middle limit value.
Or alternatively
If the weight is smaller than the preset weight lower limit value, the first time threshold value is set to be a preset time upper limit value.
In this example, the formula is:
Where n is a first time threshold, s is the weight of the operation, st max is the upper weight limit, st min is the lower weight limit, n max is the upper time limit, n min is the intermediate time value, and n min is the lower time limit.
Of course, the above-described manner of calculating the first time threshold is merely an example, and in the implementation of the present embodiment, other manners of calculating the first time threshold may be set according to actual situations, for example, if the operation is a forward operation, the weight is multiplied by a specified coefficient, as the first time threshold, and the like, which is not limited in this embodiment. In addition, in addition to the above-mentioned manner of calculating the first time threshold, those skilled in the art may also use other manners of calculating the first time threshold according to actual needs, which is not limited in this embodiment.
S205, determining a first time length of the multimedia data to be played.
S206, if the first time length is greater than the first time threshold, suspending buffering the multimedia data.
S207, if the first time length is less than or equal to the first time threshold, the multimedia data is kept buffered.
And comparing the first time length with a first time threshold, wherein the buffered multimedia data does not reach the limit of the buffer area under the condition that the first time length is smaller than or equal to the first time threshold.
If the first time length is equal to the first time threshold, considering the situation that the multimedia data continues to be played, the multimedia data is maintained to continue to be buffered.
If the current computer device has paused buffering the multimedia data, a start notification may be sent to the server, which in response to the start notification, continues to send the multimedia data, thereby maintaining the buffering of the multimedia data.
If the multimedia data is currently being buffered by the computer device, the buffered multimedia data may continue to be maintained.
And S208, if the multimedia data is in an unplayed state, determining a second time length of the multimedia data to be played.
S209, if the second time length is greater than or equal to a preset second time threshold, playing the multimedia data.
When the multimedia data is in a played state, the conditions of poor bandwidth condition, dragging by a user and the like exist, and the currently buffered multimedia data is insufficient, so that the multimedia data is in an unrepeated state.
In this case, the playback of the multimedia data is temporarily stopped, and the multimedia data is shifted to an unplayed state.
Therefore, the unplayed state in this embodiment refers to the pause of playing due to the environment trigger during the playing process, and not to the active trigger of the user to pause the playing.
At this time, the second time length of the multimedia data to be played can be counted, and if the second time length is greater than or equal to the preset second time threshold, the multimedia data is read from the buffer area, and the multimedia data is played.
Example III
Fig. 3 is a flowchart of a method for processing multimedia data according to an embodiment of the present invention, where the method may be applicable to a case of adjusting a playing progress bar according to a user operation on currently played multimedia data, and the method may be performed by a processing device for multimedia data, where the processing device for multimedia data may be implemented by software and/or hardware, and may be configured in a computer device, for example, a personal computer, a mobile terminal (such as a mobile phone, a tablet computer, etc.), an intelligent interaction tablet, a wearable device (such as a smart watch, a smart glasses, etc.), a television, etc., and the method specifically includes the following steps:
s301, displaying a playing interface.
In this embodiment, the operating system of the computer device includes windows, android (android), iOS, hong mo, and the like, and an application program supporting online playing of multimedia data, such as a player, an instant messenger, a browser, and the like, is installed in the operating system.
Wherein the type of multimedia data includes video data, audio data, and the like.
If the multimedia data is video data, the format of the multimedia data is mostly streaming data, such as MP4, FLV, etc.
The multimedia data is stored in a server, and the server and the computer device can transmit the multimedia data through RTSP, RTMP, HLS protocols and the like.
In addition, the form of the multimedia data includes short videos, dramas, movies, electronic books, songs, and the like.
In this embodiment, the user may trigger an operation of playing the multimedia data online, and the application program displays a playing interface thereof in response to the operation of playing the multimedia data online.
The playing Interface belongs to a UI (User Interface) and is used for displaying pictures of multimedia data, and of course, the playing Interface can also be used for displaying other elements, such as a control, a barrage, a playing progress bar, and the like, besides the multimedia data.
Here, for video data, the picture of the multimedia data may refer to image data or the like, and for audio data, the picture of the multimedia data may refer to cover data or the like.
S302, displaying a picture of the multimedia data and a playing progress bar on the playing interface.
The application program requests the server to download the multimedia data in response to an operation of playing the multimedia data on line, and the server transmits a packet of the multimedia data to the application program in response to the request.
In the computer device, a Buffer area (Buffer) may be set, where the Buffer area refers to an area reserved in the memory, and is used to temporarily store data of an I/O (input/output port), so that the actual number of physical read/write operations may be reduced, the Buffer area is allocated to the memory during creation, and the area of the memory is reused all the time, so that the number of times of dynamically allocating and recovering the memory may be reduced.
The application program stores the data packet of the multimedia data transmitted by the server in the buffer area to realize buffering.
When a certain condition is met, if the time length of the multimedia data to be played is greater than a preset time threshold, the application program can read the multimedia data from the buffer area, and after decoding, the multimedia data is displayed on the playing interface.
Taking video data as an example, as shown in fig. 4, a picture of the video data is displayed in an area 410 of the playback interface 400.
Meanwhile, a playing progress bar is displayed on the playing interface, and the playing progress bar is used for representing the playing state of the multimedia data.
S303, receiving the operation acting on the multimedia data.
In this embodiment, if the multimedia data is in a played state, a user-triggered operation acting on the multimedia data may be detected.
The played state may refer to a behavior of viewing the multimedia data that is actively triggered by the user, that is, a situation that the user actively triggers to play the multimedia data, and the multimedia data is viewable such as being on the top, and the multimedia data is not in a pause state, cannot be played due to insufficient buffering, is blocked by other windows, and the like.
The operations acting on the multimedia data may include operations of controlling pictures of the multimedia data, such as fast forward, backward, adjusting definition, dragging a progress bar, etc., and operations of controlling pictures of the multimedia data, such as bulleting, praying, collecting, sharing, etc.
In addition, since the computer devices have different structures, the manner of operating the multimedia data is also different, which is not limited in this embodiment.
For example, a plurality of controls are provided on a playing interface for playing the multimedia data, different controls are used for triggering different operations, and when one or more controls are detected to receive clicking operations, the operations on the multimedia data are determined to be received.
For a computer device providing touch operation for a mobile terminal, a wearable device, an intelligent interaction tablet and the like, a user can click an element by using a finger or a touch pen in a touch manner, so that the computer device receives an operation acting on multimedia data.
Aiming at computer equipment such as intelligent televisions and personal computers and the like for providing key operation, a user can click a control in a key control mode through external equipment connected with the computer equipment so that the computer equipment receives operation acting on multimedia data. The external device includes, but is not limited to, a mouse and the like.
For another example, the computer device supports standard or custom keys that, when signals of one or more keys are received, determine that an operation is received that is to be performed on the multimedia data.
The keys include, but are not limited to, keys configured by the computer device (such as volume keys), keys in the keyboard (such as direction keys "≡", "→"), and keys in the remote controller (such as fast forward keys).
In this embodiment, operations that act on multimedia data in a past time period may be counted every certain time, for example, 5 seconds, so that the statistics operations are reduced, and the resource consumption of the computer device is reduced.
In a specific implementation, a Timer may be set, where the Timer is used to count a specified time, such as 5 seconds.
During the continuous timing of the Timer, for example, 5 minutes, when an operation acting on the multimedia data is detected, relevant information of the operation, such as type, time and the like, is recorded.
If the Timer finishes counting, determining the operation which is detected during the counting period of the Timer and acts on the multimedia data, returning to set the Timer and carrying out counting again.
S304, displaying an area on the playing progress bar.
As shown in fig. 4, the playback progress bar 420 generally has an area 421, a cursor 422, an area 423, and an area 424.
Wherein the area 421 is located before the cursor 422 and is used for indicating the time length of the played and skipped multimedia data.
The cursor 422 is used to represent the position of the multimedia data currently being played.
The area 423 is located behind the cursor 422 and represents the length of time for which the multimedia data is to be played.
By multimedia data to be played, also referred to as playable multimedia data, it is meant that multimedia data that has been buffered and is located after the multimedia data currently being played does not contain multimedia data that has been buffered and is located before the multimedia data currently being played.
An area 424 is located after the area 423 for indicating the length of time that unbuffered multimedia data remains.
In the present embodiment, the length of the area 423 is related to an operation, that is, the length of the area 423 is determined according to the operation, and the area 423 is displayed on the play progress bar according to the length.
Further, user-triggered operations on multimedia data can be distinguished into at least two types:
1. Negative direction operation
By negative operation is meant an operation that indicates a negative interest of the user in the multimedia data, e.g. fast forward, pause, etc.
2. Operation in the forward direction
By forward operation, it is meant an operation that represents a forward interest of the user in the multimedia data, such as posting a barrage, praying, collecting, sharing, and so forth.
In one example, if the operation is a negative operation, the length of the region 423 is inversely related to the frequency of the operation, i.e., the greater the frequency of the operation, the smaller the length of the region 423 and, conversely, the lesser the frequency of the operation, the greater the length of the region 423.
If the operation is a forward operation, the length of the region is positively correlated with the frequency of the operation, that is, the greater the frequency of the operation, the greater the length of the region 423 in a certain period of time, whereas the smaller the frequency of the operation, the smaller the length of the region 423.
In a specific implementation, a first time threshold may be determined according to an operation, and a first time length of the multimedia data to be played may be determined, at this time, a ratio between the first time length and a total duration of the multimedia data may be calculated, the ratio is taken on the total length of the playing progress bar 420, as a length of the area 423, and the area 423 is displayed on the playing progress bar according to the length.
At this time, if the first time length is greater than the first time threshold, buffering of the multimedia data is suspended.
In addition, if the first time length is less than or equal to the first time threshold, the buffered multimedia data is maintained.
Optionally, determining the first time threshold according to the operation includes:
calculating weights for the operations;
And determining a first time threshold based on the weight, wherein the first time threshold is inversely related to the weight if the operation is a negative operation, and the first time threshold is positively related to the weight if the operation is a positive operation.
Optionally, calculating the weight for the operation includes:
if the operation is negative, counting the frequency of the operation as the weight.
In one example, determining the first time threshold based on the weight includes:
if the weight is greater than a preset weight threshold, setting the first time threshold as a preset time lower limit value;
Or alternatively
If the weight is smaller than or equal to a preset weight threshold, calculating the ratio of a time difference value to an upper limit value of the weight, wherein the time difference value is the difference value between a preset upper limit value of time and a preset lower limit value of time, and the upper limit value of time is larger than the lower limit value of time;
The weight is configured into a ratio to obtain a target value;
and adding the target value on the basis of the time lower limit value to obtain a first time threshold.
Further, configuring the weight ratio to obtain a target value includes:
if the type of the operation is one, calculating the product between the weight and the ratio of the operation to obtain a target value;
Or alternatively
If the types of the operations are two or more, calculating the sum of the weights of the operations;
And calculating the product between the sum of the weights and the ratio to obtain a target value.
Optionally, determining the first time threshold based on the frequency includes:
If the weight is greater than the preset weight upper limit value, setting the first time threshold value as a preset time lower limit value;
Or alternatively
If the weight is greater than or equal to a preset weight lower limit value and less than or equal to a preset weight upper limit value, setting the first time threshold value as a preset time middle limit value;
Or alternatively
If the weight is smaller than the preset weight lower limit value, setting the first time threshold value as a preset time upper limit value;
Wherein the upper time limit is greater than the middle time limit, and the middle time limit is greater than the lower time limit.
Optionally, if the multimedia data is in an unplayed state, determining a second time length of the multimedia data to be played;
And if the second time length is greater than or equal to a preset second time threshold value, playing the multimedia data.
In this embodiment, since the calculation of the first time threshold and the maintenance or suspension of the buffering of the multimedia data are basically similar to those of the first and second embodiments, the description is relatively simple, and the relevant points are only referred to in the description of the first and second embodiments, and the embodiments of the present invention are not described in detail herein.
In this embodiment, a playing interface is displayed, a picture of multimedia data and a playing progress bar are displayed on the playing interface, an operation acting on the multimedia data is received, an area is displayed on the playing progress bar, the area is used for representing the time length of the multimedia data to be played, the length of the area is related to the operation, the operation triggered by a user and acting on the multimedia data is an active action, the interest degree of the user on the multimedia data can be reflected to a certain extent, an adaptive first time threshold value is determined according to the interest degree of the user on the multimedia data, the size of a buffer area is used as the size, the interest degree of the user on the multimedia data is higher, the multimedia data expected to be watched or listened is higher, the interest degree of the user on the multimedia data is lower, the multimedia data expected to be watched or listened is lower, the size of the buffer area can be adapted to the user's expectation on the multimedia data, the buffered multimedia data can easily reach the upper limit of the buffer area under the condition of better bandwidth condition, the buffered multimedia data can be ensured to be suitable, the user can skip or directly shut down the multimedia data, the waste of the multimedia data of the server is reduced, and the bandwidth of the server for distributing the multimedia data of the multimedia data is reduced.
Example IV
Fig. 5 is a schematic structural diagram of a multimedia data processing apparatus according to a fourth embodiment of the present invention, where the apparatus may specifically include the following modules:
A buffer module 501 for buffering multimedia data;
an operation detection module 502, configured to detect an operation acting on the multimedia data if the multimedia data is in a played state;
A time threshold determining module 503, configured to determine a first time threshold according to the operation;
a time length determining module 504, configured to determine a first time length of the multimedia data to be played;
A buffer suspension module 505, configured to suspend buffering the multimedia data if the first time length is greater than the first time threshold.
In one embodiment of the present invention, further comprising:
And the buffer maintaining module is used for maintaining the buffer of the multimedia data if the first time length is smaller than or equal to the first time threshold value.
In one embodiment of the present invention, the operation detection module 502 includes:
A timer setting sub-module for setting a timer;
And the operation determining submodule is used for determining the operation which is detected during the timing of the timer and acts on the multimedia data and returning to the timer setting submodule if the timer finishes timing.
In one embodiment of the present invention, the time threshold determining module 503 includes:
The weight calculation sub-module is used for calculating the weight for the operation;
And the weight configuration sub-module is used for determining a first time threshold based on the weight, wherein the first time threshold is inversely related to the weight if the operation is negative operation, and the first time threshold is positively related to the weight if the operation is positive operation.
In one embodiment of the present invention, the weight calculation submodule includes:
and the frequency counting unit is used for counting the frequency of the operation as a weight if the operation is negative.
In one example of an embodiment of the present invention, the weight configuration submodule includes:
The weight presetting unit is used for setting the first time threshold value as a preset time lower limit value if the weight is larger than a preset weight threshold value;
Or alternatively
The ratio calculating unit is used for calculating the ratio between the time difference value and the weight upper limit value if the weight is smaller than or equal to a preset weight threshold value, wherein the time difference value is the difference value between a preset time upper limit value and a preset time lower limit value, and the time upper limit value is larger than the time lower limit value;
The ratio configuration unit is used for configuring the weight to the ratio to obtain a target value;
And the summing unit is used for adding the target value on the basis of the time lower limit value to obtain a first time threshold.
Further, the ratio configuration unit includes:
a first product calculating subunit, configured to calculate a product between the weight of the operation and the ratio if the type of the operation is one, and obtain a target value;
Or alternatively
A weight and calculation subunit, configured to calculate a sum of weights of the operations if the types of the operations are two or more;
and the second product calculating subunit is used for calculating the product between the sum of the weights and the ratio to obtain a target value.
In one example of an embodiment of the present invention, the weight configuration submodule includes:
The first setting unit is used for setting the first time threshold value as a preset time lower limit value if the weight is larger than a preset weight upper limit value;
Or alternatively
The second setting unit is used for setting the first time threshold value as a preset time middle limit value if the weight is larger than or equal to a preset weight lower limit value and smaller than or equal to a preset weight upper limit value;
Or alternatively
A third setting unit, configured to set the first time threshold as a preset time upper limit value if the weight is smaller than a preset weight lower limit value;
wherein the time upper limit is greater than the time middle limit, and the time middle limit is greater than the time lower limit.
In one embodiment of the present invention, further comprising:
the to-be-played duration determining module is used for determining a second time length of the to-be-played multimedia data if the multimedia data are in an unplayed state;
and the multimedia data playing module is used for playing the multimedia data if the second time length is greater than or equal to a preset second time threshold value.
The multimedia data processing device provided by the embodiment of the invention can execute the multimedia data processing method provided by any embodiment of the invention, and has the corresponding functional modules and beneficial effects of the execution method.
Example five
Fig. 6 is a schematic structural diagram of a multimedia data processing apparatus according to a fifth embodiment of the present invention, where the apparatus may specifically include the following modules:
A playing interface display module 601, configured to display a playing interface;
an interface element display module 602, configured to display a picture of the multimedia data and a playing progress bar on the playing interface;
An operation receiving module 603 for receiving an operation acting on the multimedia data;
and the area display module 604 is configured to display an area on the playing progress bar, where the area is used to represent a time length of the multimedia data to be played, and the length of the area is related to the operation.
Alternatively, the process may be carried out in a single-stage,
If the operation is a negative operation, the length of the region is inversely related to the frequency of the operation;
If the operation is a forward operation, the length of the region is positively correlated with the frequency of the operation.
In one embodiment of the present invention, the area display module 604 includes:
A time threshold determining module for determining a first time threshold according to the operation;
the time length determining module is used for determining a first time length of the multimedia data to be played;
A time length ratio calculating module, configured to calculate a ratio between the first time length and a total time length of the multimedia data;
The length determining module is used for taking the ratio on the total length of the playing progress bar as the length of the area;
and the length display module is used for displaying the area on the playing progress bar according to the length.
In one embodiment of the present invention, further comprising:
And the buffering and suspending module is used for suspending buffering the multimedia data if the first time length is greater than the first time threshold.
In one embodiment of the present invention, further comprising:
And the buffer maintaining module is used for maintaining the buffer of the multimedia data if the first time length is smaller than or equal to the first time threshold value.
In one embodiment of the present invention, the operation receiving module 603 includes:
A timer setting sub-module for setting a timer;
And the operation determining submodule is used for determining the operation which is detected during the timing of the timer and acts on the multimedia data and returning to the timer setting submodule if the timer finishes timing.
In one embodiment of the invention, the time threshold determination module comprises:
The weight calculation sub-module is used for calculating the weight for the operation;
And the weight configuration sub-module is used for determining a first time threshold based on the weight, wherein the first time threshold is inversely related to the weight if the operation is negative operation, and the first time threshold is positively related to the weight if the operation is positive operation.
In one embodiment of the present invention, the weight calculation submodule includes:
and the frequency counting unit is used for counting the frequency of the operation as a weight if the operation is negative.
In one example of an embodiment of the present invention, the weight configuration submodule includes:
The weight presetting unit is used for setting the first time threshold value as a preset time lower limit value if the weight is larger than a preset weight threshold value;
Or alternatively
The ratio calculating unit is used for calculating the ratio between the time difference value and the weight upper limit value if the weight is smaller than or equal to a preset weight threshold value, wherein the time difference value is the difference value between a preset time upper limit value and a preset time lower limit value, and the time upper limit value is larger than the time lower limit value;
The ratio configuration unit is used for configuring the weight to the ratio to obtain a target value;
And the summing unit is used for adding the target value on the basis of the time lower limit value to obtain a first time threshold.
Further, the ratio configuration unit includes:
a first product calculating subunit, configured to calculate a product between the weight of the operation and the ratio if the type of the operation is one, and obtain a target value;
Or alternatively
A weight and calculation subunit, configured to calculate a sum of weights of the operations if the types of the operations are two or more;
and the second product calculating subunit is used for calculating the product between the sum of the weights and the ratio to obtain a target value.
In one example of an embodiment of the present invention, the weight configuration submodule includes:
The first setting unit is used for setting the first time threshold value as a preset time lower limit value if the weight is larger than a preset weight upper limit value;
Or alternatively
The second setting unit is used for setting the first time threshold value as a preset time middle limit value if the weight is larger than or equal to a preset weight lower limit value and smaller than or equal to a preset weight upper limit value;
Or alternatively
A third setting unit, configured to set the first time threshold as a preset time upper limit value if the weight is smaller than a preset weight lower limit value;
wherein the time upper limit is greater than the time middle limit, and the time middle limit is greater than the time lower limit.
In one embodiment of the present invention, further comprising:
the to-be-played duration determining module is used for determining a second time length of the to-be-played multimedia data if the multimedia data are in an unplayed state;
and the multimedia data playing module is used for playing the multimedia data if the second time length is greater than or equal to a preset second time threshold value.
The multimedia data processing device provided by the embodiment of the invention can execute the multimedia data processing method provided by any embodiment of the invention, and has the corresponding functional modules and beneficial effects of the execution method.
Example six
Fig. 7 is a schematic structural diagram of a computer device according to a sixth embodiment of the present invention, where the computer device includes a display 710 and an interactor 720;
the display screen 710 is configured to display a playing interface, and display a picture of the multimedia data and a playing progress bar on the playing interface;
The interactor 720 is configured to receive an operation acting on the multimedia data;
the display 710 is further configured to display an area on the playing progress bar, where the area is used to represent a time length of the multimedia data to be played, and the length of the area is related to the operation.
In a specific implementation, the interactor comprises at least one of:
touch-sensitive screen, button, keyboard, mouse, remote controller.
In practical application, if the operation is a negative operation, the length of the region is inversely related to the frequency of the operation;
If the operation is a forward operation, the length of the region is positively correlated with the frequency of the operation.
The computer equipment provided by the embodiment of the invention can execute the multimedia data processing method provided by any embodiment of the invention, and has the corresponding functional modules and beneficial effects of the execution method.
Example seven
Fig. 8 is a schematic structural diagram of a computer device according to a seventh embodiment of the present invention. As shown in fig. 8, the computer apparatus includes a processor 800, a memory 801, a communication module 802, an input device 803, and an output device 804; the number of processors 800 in the computer device may be one or more, one processor 800 being taken as an example in fig. 8; the processor 800, the memory 801, the communication module 802, the input means 803 and the output means 804 in the computer device may be connected by a bus or other means, in fig. 8 by way of example.
The memory 801 is a computer-readable storage medium, and can be used to store a software program, a computer-executable program, and modules corresponding to a processing method of multimedia data in this embodiment (for example, a buffer module 501, an operation detection module 502, a time threshold determination module 503, a time length determination module 504, and a buffer suspension module 505 in a processing apparatus of multimedia data as shown in fig. 5, or a playback interface display module 601, an interface element display module 602, an operation reception module 603, and a region display module 604 in a processing apparatus of multimedia data as shown in fig. 6). The processor 800 executes various functional applications of the computer device and data processing, i.e., implements the above-described processing method of multimedia data, by running software programs, instructions, and modules stored in the memory 801.
The memory 801 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, at least one application program required for functions; the storage data area may store data created according to the use of the computer device, etc. In addition, the memory 801 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid-state storage device. In some examples, memory 801 may further include memory remotely located relative to processor 800, which may be connected to a computer device via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
And the communication module 802 is used for establishing connection with the display screen and realizing data interaction with the display screen. The input means 803 may be used to receive entered numeric or character information and to generate key signal inputs related to user settings and function control of the computer device.
The computer device provided in this embodiment may execute the multimedia data processing method provided in any one of the embodiments of the present invention, and specifically, the corresponding functions and beneficial effects.
Example eight
An eighth embodiment of the present invention also provides a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, implements a method of processing multimedia data.
In one case, the method includes:
Buffering the multimedia data;
if the multimedia data is in a played state, detecting an operation acting on the multimedia data;
determining a first time threshold according to the operation;
Determining a first time length of multimedia data to be played;
if the first time length is greater than the first time threshold, suspending buffering the multimedia data.
In another case, the method includes:
Displaying a playing interface;
Displaying a picture of the multimedia data and a playing progress bar on the playing interface;
an operation for receiving the multimedia data;
and displaying an area on the playing progress bar, wherein the area is used for representing the time length of the multimedia data to be played, and the length of the area is related to the operation.
Of course, the computer readable storage medium provided by the embodiments of the present invention, the computer program thereof is not limited to the method operations described above, and related operations in the multimedia data processing method provided by any embodiment of the present invention may also be performed.
From the above description of embodiments, it will be clear to a person skilled in the art that the present invention may be implemented by means of software and necessary general purpose hardware, but of course also by means of hardware, although in many cases the former is a preferred embodiment. Based on such understanding, the technical solution of the present invention may be embodied essentially or in a part contributing to the prior art in the form of a software product, which may be stored in a computer readable storage medium, such as a floppy disk, a Read-Only Memory (ROM), a random access Memory (Random Access Memory, RAM), a FLASH Memory (FLASH), a hard disk, or an optical disk of a computer, etc., and include several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the method according to the embodiments of the present invention.
It should be noted that, in the embodiment of the processing apparatus for multimedia data, each unit and module included are only divided according to the functional logic, but not limited to the above-mentioned division, so long as the corresponding functions can be implemented; in addition, the specific names of the functional units are also only for distinguishing from each other, and are not used to limit the protection scope of the present invention.
Note that the above is only a preferred embodiment of the present invention and the technical principle applied. It will be understood by those skilled in the art that the present invention is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the invention. Therefore, while the invention has been described in connection with the above embodiments, the invention is not limited to the embodiments, but may be embodied in many other equivalent forms without departing from the spirit or scope of the invention, which is set forth in the following claims.

Claims (15)

1. A method for processing multimedia data, comprising:
Buffering the multimedia data;
If the multimedia data is in a played state, detecting an operation acting on the multimedia data, wherein the operation comprises a negative operation and a positive operation; wherein the negative operation represents an operation of negative interest of the user in the multimedia data, including fast forward or pause; the forward operation represents the operation of forward interest of the user on the multimedia data, including bullet screen publishing, praying, collection or sharing;
determining a first time threshold according to the operation;
Determining a first time length of multimedia data to be played;
If the first time length is greater than the first time threshold, suspending buffering the multimedia data;
the determining a first time threshold according to the operation includes:
calculating weights for the operations;
And determining a first time threshold based on the weight, wherein the first time threshold is inversely related to the weight if the operation is a negative operation, and the first time threshold is positively related to the weight if the operation is a positive operation.
2. The method as recited in claim 1, further comprising:
And if the first time length is less than or equal to the first time threshold value, maintaining buffering the multimedia data.
3. The method of claim 1, wherein the detecting the operation on the multimedia data comprises:
setting a timer;
And if the timer finishes counting, determining the operation which is detected during the counting period of the timer and acts on the multimedia data, and returning to the timer setting.
4. The method of claim 1, wherein said calculating weights for said operations comprises:
if the operation is negative, counting the frequency of the operation as a weight.
5. The method of claim 1, wherein the determining a first time threshold based on the weights comprises:
If the weight is greater than a preset weight threshold, setting the first time threshold as a preset time lower limit value;
Or alternatively
If the weight is smaller than or equal to a preset weight threshold, calculating a ratio between a time difference value and a preset weight upper limit value, wherein the time difference value is a difference value between a preset time upper limit value and a preset time lower limit value, and the time upper limit value is larger than the time lower limit value;
configuring the weight to the ratio to obtain a target value;
And adding the target value on the basis of the time lower limit value to obtain a first time threshold.
6. The method of claim 5, wherein configuring the weights to the ratios to obtain a target value comprises:
If the type of the operation is one, calculating the product between the weight of the operation and the ratio to obtain a target value;
Or alternatively
If the types of the operations are two or more, calculating the sum of the weights of the operations;
and calculating the product between the sum of the weights and the ratio to obtain a target value.
7. The method of claim 1, wherein the determining a first time threshold based on the weights comprises:
if the weight is greater than a preset weight upper limit value, setting the first time threshold value as a preset time lower limit value;
Or alternatively
If the weight is greater than or equal to a preset weight lower limit value and less than or equal to a preset weight upper limit value, setting the first time threshold value as a preset time middle limit value;
Or alternatively
If the weight is smaller than a preset weight lower limit value, setting the first time threshold value as a preset time upper limit value;
wherein the time upper limit is greater than the time middle limit, and the time middle limit is greater than the time lower limit.
8. The method as recited in claim 1, further comprising:
If the multimedia data is in an unplayed state, determining a second time length of the multimedia data to be played;
And if the second time length is greater than or equal to a preset second time threshold value, playing the multimedia data.
9. A method for processing multimedia data, comprising:
Displaying a playing interface;
Displaying a picture of the multimedia data and a playing progress bar on the playing interface;
Receiving an operation acting on the multimedia data, the operation including a negative operation and a positive operation; wherein the negative operation represents an operation of negative interest of the user in the multimedia data, including fast forward or pause; the forward operation represents the operation of forward interest of the user on the multimedia data, including bullet screen publishing, praying, collection or sharing;
Displaying an area on the playing progress bar, wherein the area is used for representing the time length of the multimedia data to be played, and the length of the area is related to the operation;
If the operation is a negative operation, the length of the region is inversely related to the frequency of the operation;
If the operation is a forward operation, the length of the region is positively correlated with the frequency of the operation.
10. A processing apparatus for multimedia data, comprising:
the buffer module is used for buffering the multimedia data;
The operation detection module is used for detecting operations acting on the multimedia data if the multimedia data are in a played state, wherein the operations comprise negative operations and positive operations; wherein the negative operation represents an operation of negative interest of the user in the multimedia data, including fast forward or pause; the forward operation represents the operation of forward interest of the user on the multimedia data, including bullet screen publishing, praying, collection or sharing;
A time threshold determining module for determining a first time threshold according to the operation;
the time length determining module is used for determining a first time length of the multimedia data to be played;
A buffer suspending module, configured to suspend buffering the multimedia data if the first time length is greater than the first time threshold;
the time threshold determination module includes:
The weight calculation sub-module is used for calculating the weight for the operation;
And the weight configuration sub-module is used for determining a first time threshold based on the weight, wherein the first time threshold is inversely related to the weight if the operation is negative operation, and the first time threshold is positively related to the weight if the operation is positive operation.
11. A processing apparatus for multimedia data, comprising:
the playing interface display module is used for displaying a playing interface;
The interface element display module is used for displaying pictures of the multimedia data and a playing progress bar on the playing interface;
An operation receiving module, configured to receive an operation acting on the multimedia data, where the operation includes a negative operation and a positive operation; wherein the negative operation represents an operation of negative interest of the user in the multimedia data, including fast forward or pause; the forward operation represents the operation of forward interest of the user on the multimedia data, including bullet screen publishing, praying, collection or sharing;
the area display module is used for displaying an area on the playing progress bar, wherein the area is used for representing the time length of the multimedia data to be played, and the length of the area is related to the operation;
If the operation is a negative operation, the length of the region is inversely related to the frequency of the operation;
If the operation is a forward operation, the length of the region is positively correlated with the frequency of the operation.
12. A computer device, the computer device comprising a display screen and an interactor;
the display screen is used for displaying a playing interface, and displaying pictures of the multimedia data and a playing progress bar on the playing interface;
the interactor is used for receiving operations acting on the multimedia data, wherein the operations comprise negative operations and positive operations; wherein the negative operation represents an operation of negative interest of the user in the multimedia data, including fast forward or pause; the forward operation represents the operation of forward interest of the user on the multimedia data, including bullet screen publishing, praying, collection or sharing;
the display screen is further used for displaying an area on the playing progress bar, the area is used for representing the time length of the multimedia data to be played, and the length of the area is related to the operation;
If the operation is a negative operation, the length of the region is inversely related to the frequency of the operation;
If the operation is a forward operation, the length of the region is positively correlated with the frequency of the operation.
13. The computer device of claim 12, wherein the interactors comprise at least one of:
touch-sensitive screen, button, keyboard, mouse, remote controller.
14. A computer device, the computer device comprising:
One or more processors;
A memory for storing one or more programs;
when the one or more programs are executed by the one or more processors, the one or more processors are caused to implement the method of processing multimedia data as claimed in any one of claims 1-9.
15. A computer-readable storage medium, on which a computer program is stored, characterized in that the computer program, when being executed by a processor, implements a method of processing multimedia data according to any one of claims 1-9.
CN201911052247.7A 2019-10-31 2019-10-31 Multimedia data processing method and device, computer equipment and storage medium Active CN110807106B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201911052247.7A CN110807106B (en) 2019-10-31 2019-10-31 Multimedia data processing method and device, computer equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201911052247.7A CN110807106B (en) 2019-10-31 2019-10-31 Multimedia data processing method and device, computer equipment and storage medium

Publications (2)

Publication Number Publication Date
CN110807106A CN110807106A (en) 2020-02-18
CN110807106B true CN110807106B (en) 2024-04-26

Family

ID=69489782

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201911052247.7A Active CN110807106B (en) 2019-10-31 2019-10-31 Multimedia data processing method and device, computer equipment and storage medium

Country Status (1)

Country Link
CN (1) CN110807106B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113810969B (en) * 2021-10-20 2023-06-06 广州通达汽车电气股份有限公司 Base station switching method and device, multimedia equipment and storage medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6314466B1 (en) * 1998-10-06 2001-11-06 Realnetworks, Inc. System and method for providing random access to a multimedia object over a network
CN104284249A (en) * 2013-07-11 2015-01-14 腾讯科技（深圳）有限公司 Video playing method and device
CN106658067A (en) * 2016-12-31 2017-05-10 中国移动通信集团江苏有限公司 Cache setting method and apparatus
CN109561347A (en) * 2017-09-27 2019-04-02 中国移动通信集团山东有限公司 A kind of internet video play quality determination method and system
CN110312156A (en) * 2018-03-27 2019-10-08 腾讯科技（深圳）有限公司 A kind of video cache method, apparatus and readable storage medium storing program for executing

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040133657A1 (en) * 2003-01-03 2004-07-08 Broadq, Llc Digital media system and method therefor

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6314466B1 (en) * 1998-10-06 2001-11-06 Realnetworks, Inc. System and method for providing random access to a multimedia object over a network
CN104284249A (en) * 2013-07-11 2015-01-14 腾讯科技（深圳）有限公司 Video playing method and device
CN106658067A (en) * 2016-12-31 2017-05-10 中国移动通信集团江苏有限公司 Cache setting method and apparatus
CN109561347A (en) * 2017-09-27 2019-04-02 中国移动通信集团山东有限公司 A kind of internet video play quality determination method and system
CN110312156A (en) * 2018-03-27 2019-10-08 腾讯科技（深圳）有限公司 A kind of video cache method, apparatus and readable storage medium storing program for executing

Also Published As

Publication number Publication date
CN110807106A (en) 2020-02-18

Similar Documents

Publication Publication Date Title
US11457088B2 (en) Adaptive transfer rate for retrieving content from a server
CN113423018B (en) Game data processing method, device and storage medium
US10045055B1 (en) Correlating video quality with video playback view
US10666699B2 (en) Live edge detection during video playback
WO2018000624A1 (en) Video playing control method and device
US20150201237A1 (en) Tracking and Responding to Distracting Events
US10887646B2 (en) Live streaming with multiple remote commentators
CN107396171A (en) Live network broadcast method, device and storage medium
US9232249B1 (en) Video presentation using repeated video frames
EP3304924A1 (en) Techniques for seamless media content switching during fixed-duration breaks
CN111787415B (en) Video interaction method and device, electronic equipment and storage medium
CN110753098B (en) Download request execution method and device, server and storage medium
US20160360262A1 (en) Preloading and switching streaming videos
CN108881931B (en) Data buffering method and network equipment
US20150134846A1 (en) Method and apparatus for media segment request retry control
WO2016150273A1 (en) Video playing method, mobile terminal and system
CN110740374B (en) Multimedia data processing method and device, computer equipment and storage medium
CN110807106B (en) Multimedia data processing method and device, computer equipment and storage medium
WO2017005098A1 (en) Method and device for realizing the fast-forward or fast-backward of video stream
EP4014480A1 (en) Prediction-based dropped frame handling logic in video playback
US20150244772A1 (en) Fast rendering of content using a mobile user device
US10506071B2 (en) Method and apparatus for playing multimedia contents in a communication
US20140099040A1 (en) Image processing device and image processing method
WO2023179401A1 (en) Method, apparatus and device for preloading livestreaming room in video stream, and storage medium
JP7162019B2 (en) DATA STREAMING METHOD, DATA STREAMING DEVICE, AND COMPUTER PROGRAM

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant