CN110807106A - Multimedia data processing method and device, computer equipment and storage medium - Google Patents
Multimedia data processing method and device, computer equipment and storage medium Download PDFInfo
- Publication number
- CN110807106A CN110807106A CN201911052247.7A CN201911052247A CN110807106A CN 110807106 A CN110807106 A CN 110807106A CN 201911052247 A CN201911052247 A CN 201911052247A CN 110807106 A CN110807106 A CN 110807106A
- Authority
- CN
- China
- Prior art keywords
- multimedia data
- time
- weight
- limit value
- time threshold
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000003672 processing method Methods 0.000 title description 12
- 238000000034 method Methods 0.000 claims abstract description 41
- 238000012545 processing Methods 0.000 claims abstract description 35
- 230000003139 buffering effect Effects 0.000 claims abstract description 34
- 230000002596 correlated effect Effects 0.000 claims description 14
- 238000004590 computer program Methods 0.000 claims description 6
- 238000001514 detection method Methods 0.000 claims description 5
- 239000002699 waste material Substances 0.000 abstract description 9
- 230000001960 triggered effect Effects 0.000 description 11
- 238000004364 calculation method Methods 0.000 description 10
- 238000010586 diagram Methods 0.000 description 9
- 230000000875 corresponding effect Effects 0.000 description 6
- 230000006399 behavior Effects 0.000 description 5
- 238000005516 engineering process Methods 0.000 description 5
- 230000001276 controlling effect Effects 0.000 description 4
- 230000006870 function Effects 0.000 description 4
- 230000002452 interceptive effect Effects 0.000 description 4
- 230000003044 adaptive effect Effects 0.000 description 3
- 230000009286 beneficial effect Effects 0.000 description 3
- 238000004891 communication Methods 0.000 description 3
- 230000004044 response Effects 0.000 description 3
- 238000010295 mobile communication Methods 0.000 description 2
- 238000004064 recycling Methods 0.000 description 2
- 239000004984 smart glass Substances 0.000 description 2
- 238000013500 data storage Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 230000008707 rearrangement Effects 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 239000000725 suspension Substances 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/40—Information retrieval; Database structures therefor; File system structures therefor of multimedia data, e.g. slideshows comprising image and additional audio data
- G06F16/43—Querying
- G06F16/435—Filtering based on additional data, e.g. user or group profiles
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/40—Information retrieval; Database structures therefor; File system structures therefor of multimedia data, e.g. slideshows comprising image and additional audio data
- G06F16/43—Querying
- G06F16/438—Presentation of query results
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/40—Information retrieval; Database structures therefor; File system structures therefor of multimedia data, e.g. slideshows comprising image and additional audio data
- G06F16/44—Browsing; Visualisation therefor
- G06F16/447—Temporal browsing, e.g. timeline
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Multimedia (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The embodiment of the invention discloses a method and a device for processing multimedia data, computer equipment and a storage medium, wherein the method comprises the following steps: buffering the multimedia data; if the multimedia data is in a played state, detecting an operation acting on the multimedia data; determining a first time threshold in accordance with the operation; determining a first time length of multimedia data to be played; and if the first time length is greater than the first time threshold, suspending the buffering of the multimedia data. The volume of the buffered multimedia data is ensured to be proper, the waste of the buffered multimedia data is reduced under the condition that a user skips or directly closes the multimedia data, the waste of the bandwidth of a server distributing the multimedia data is reduced, and the bandwidth cost of the server distributing the multimedia data is reduced.
Description
Technical Field
The present invention relates to multimedia processing technologies, and in particular, to a method and an apparatus for processing multimedia data, a computer device, and a storage medium.
Background
The online playing is a video playing mode which enables the multimedia data to be transmitted and played simultaneously by caching partial multimedia data before the multimedia data is played, so that a user can directly watch the multimedia data online, and the downloading waiting time and the storage space are saved.
In order to ensure the fluency of online playing, a buffering technology is mostly adopted, and certain stream data is buffered when the bandwidth condition is good, so that the condition that the playing is frozen when the bandwidth is poor is avoided.
Using the buffering technology, the setting is the size of the buffer area, and the volume of the buffered multimedia data is limited within the size range of the buffer area, at present, the size of the buffer area is set in two ways:
1. fixed setting
A value is set in advance empirically, and the size of the buffer is fixed to the value.
2. According to bandwidth condition setting
Setting a value according to the current bandwidth condition, and setting the size of the buffer area as the value, wherein the value is larger under the condition of better bandwidth condition so as to buffer more multimedia data, and the value is smaller under the condition of poorer bandwidth condition so as to reduce the pause.
However, with the development of network technologies, especially the popularization of technologies such as optical fiber and 5G (fifth generation mobile communication system), bandwidth conditions will be greatly improved, and problems such as network jitter will also be greatly improved.
Disclosure of Invention
Embodiments of the present invention provide a method and an apparatus for processing multimedia data, a computer device, and a storage medium, so as to solve the problem that skipping or directly closing multimedia data wastes resources, which results in a higher bandwidth cost of a server that distributes the multimedia data.
In a first aspect, an embodiment of the present invention provides a method for processing multimedia data, including:
buffering the multimedia data;
if the multimedia data is in a played state, detecting an operation acting on the multimedia data;
determining a first time threshold in accordance with the operation;
determining a first time length of multimedia data to be played;
and if the first time length is greater than the first time threshold, suspending the buffering of the multimedia data.
In a second aspect, an embodiment of the present invention further provides a method for processing multimedia data, including:
displaying a playing interface;
displaying a picture and a playing progress bar of the multimedia data on the playing interface;
receiving an operation acting on the multimedia data;
and displaying an area on the playing progress bar, wherein the area is used for representing the time length of the multimedia data to be played, and the length of the area is related to the operation.
In a third aspect, an embodiment of the present invention further provides a device for processing multimedia data, including:
the buffer module is used for buffering the multimedia data;
an operation detection module for detecting an operation acting on the multimedia data if the multimedia data is in a played state;
a time threshold determination module for determining a first time threshold according to the operation;
the time length determining module is used for determining a first time length of the multimedia data to be played;
and the buffer pause module is used for pausing the buffering of the multimedia data if the first time length is greater than the first time threshold.
In a fourth aspect, an embodiment of the present invention further provides a device for processing multimedia data, including:
the playing interface display module is used for displaying a playing interface;
the interface element display module is used for displaying the picture of the multimedia data and the playing progress bar on the playing interface;
an operation receiving module for receiving an operation acting on the multimedia data;
and the area display module is used for displaying an area on the playing progress bar, wherein the area is used for representing the time length of the multimedia data to be played, and the length of the area is related to the operation.
In a fifth aspect, an embodiment of the present invention further provides a computer device, where the computer device includes a display screen and an interactor;
the display screen is used for displaying a playing interface and displaying a picture of multimedia data and a playing progress bar on the playing interface;
the interactor is used for receiving operation acting on the multimedia data;
the display screen is further configured to display an area on the play progress bar, where the area is used to indicate a time length of the multimedia data to be played, and the length of the area is related to the operation.
In a sixth aspect, an embodiment of the present invention further provides a computer device, where the computer device includes:
one or more processors;
a memory for storing one or more programs;
when executed by the one or more processors, cause the one or more processors to implement the method for processing multimedia data according to any one of the first aspect or the second aspect.
In a seventh aspect, the present invention further provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements the method for processing multimedia data according to any one of the first aspect and the second aspect.
In this embodiment, a playing interface is displayed, a frame of multimedia data and a playing progress bar are displayed on the playing interface, an operation acting on the multimedia data is received, an area is displayed on the playing progress bar, the area is used for representing the time length of the multimedia data to be played, the length of the area is related to the operation, the operation which is triggered by a user and acts on the multimedia data is an active behavior, the interest degree of the user on the multimedia data can be reflected to a certain degree, an adaptive first time threshold value is determined according to the interest degree of the user on the multimedia data, the size of a buffer area is used, the higher the interest degree of the user on the multimedia data is, the more multimedia data is expected to be watched or listened, the lower the interest degree of the user on the multimedia data is, the less multimedia data is expected to be watched or listened, and the size of the buffer area can be adapted to the expectation of the, under the condition of better bandwidth condition, the buffered multimedia data can easily reach the upper limit of the buffer area, the volume of the buffered multimedia data is ensured to be proper, and under the condition that a user skips or directly closes the multimedia data, the waste of the buffered multimedia data is reduced, the waste of the bandwidth of a server for distributing the multimedia data is reduced, and the bandwidth cost of the server for distributing the multimedia data is reduced.
Drawings
Fig. 1 is a flowchart of a method for processing multimedia data according to an embodiment of the present invention;
fig. 2 is a flowchart of a multimedia data processing method according to a second embodiment of the present invention;
fig. 3 is a flowchart of a method for processing multimedia data according to a third embodiment of the present invention;
fig. 4 is an exemplary diagram of a playing interface provided in the third embodiment of the present invention;
fig. 5 is a schematic structural diagram of a multimedia data processing apparatus according to a fourth embodiment of the present invention;
fig. 6 is a schematic structural diagram of a multimedia data processing apparatus according to a fifth embodiment of the present invention;
fig. 7 is a schematic structural diagram of a computer device according to a sixth embodiment of the present invention;
fig. 8 is a schematic structural diagram of a computer device according to a seventh embodiment of the present invention.
Detailed Description
The present invention will be described in further detail with reference to the accompanying drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the invention and are not limiting of the invention. It should be further noted that, for the convenience of description, only some of the structures related to the present invention are shown in the drawings, not all of the structures. It should be noted that the embodiments and features of the embodiments may be combined with each other without conflict.
Example one
Fig. 1 is a flowchart of a multimedia data processing method according to an embodiment of the present invention, where the method is applicable to a situation where a size of a buffer is dynamically adjusted according to a user's interest in currently played multimedia data, and the method may be executed by a multimedia data processing apparatus, where the multimedia data processing apparatus may be implemented by software and/or hardware, and may be configured in a computer device, for example, a personal computer, a mobile terminal (e.g., a mobile phone, a tablet computer, etc.), an intelligent interactive tablet, a wearable device (e.g., a smart watch, smart glasses, etc.), a television, and the method specifically includes the following steps:
s101, buffering multimedia data.
In this embodiment, the operating system of the computer device includes windows, Android (Android), iOS, hong meng, and the like, and an application program supporting online playing of multimedia data, such as a player, an instant messaging tool, a browser, and the like, is installed in the operating system.
The types of multimedia data include video data, audio data, and the like.
If the multimedia data is Video data, the format of the multimedia data is mostly streaming data, such as MP4(Moving Picture Experts Group 4, fourth edition of motion Picture Experts Group), FLV (Flash Video, streaming media format), and so on.
Multimedia data is stored in a server, and the server and the computer device can transmit the multimedia data through RTSP (Real Time Streaming Protocol), RTMP (Real Time Messaging Protocol), HLS (HTTP Live Streaming, Streaming media Transport Protocol based on HTTP (Hyper Text transfer Protocol)), and other protocols.
In addition, the form of the multimedia data includes short videos, dramas, movies, electronic books, songs, and the like.
In a computer device, a Buffer (Buffer) may be set, where the Buffer is a region reserved in a memory and is used to temporarily store data of an input/output (I/O) port, so that the actual physical read/write frequency may be reduced, the Buffer is allocated to the memory when being created, and the region of the memory is reused all the time, thereby reducing the frequency of dynamically allocating and recycling the memory.
And storing the data packet of the multimedia data transmitted by the server in the buffer area to realize buffering.
S102, if the multimedia data is in a played state, detecting an operation acting on the multimedia data.
In this embodiment, if the multimedia data is in a played state, an operation that is triggered by the user and acts on the multimedia data may be detected.
It should be noted that the played state may refer to a behavior of the user actively triggering to view the multimedia data, that is, the user actively triggers to play the multimedia data and the multimedia data is on top, and the multimedia data is not in a state of pause, cannot be played due to insufficient buffering, and is blocked by other windows.
The operation applied to the multimedia data may include operations for controlling a picture of the multimedia data, such as fast forwarding, rewinding, adjusting definition, dragging a progress bar, and the like, and may also include operations for controlling a picture of the multimedia data, such as pop-up, praise, collection, sharing, and the like.
In addition, since the structure of the computer device is different, the way of operating the multimedia data is also different, and this embodiment does not limit this.
For example, a plurality of controls are provided on a playing interface for playing multimedia data, different controls are used for triggering different operations, and when it is detected that one or more controls receive a click operation, it is determined that an operation acting on the multimedia data is received.
For computer devices providing touch operations such as mobile terminals, wearable devices, smart interactive tablets and the like, a user can click an element by using a finger or a stylus in a touch manner, so that the computer devices receive operations acting on multimedia data.
For computer equipment such as an intelligent television and a personal computer which provides key operation, a user can click a control in a key control mode through external equipment connected with the computer equipment, so that the computer equipment receives operation acting on multimedia data. The external device includes, but is not limited to, a mouse, etc.
As another example, the computer device supports standard or custom keys that determine that an operation has been received to act on the multimedia data when a signal from one or more keys is received.
The keys include, but are not limited to, keys configured in a computer device (e.g., volume key), keys in a keyboard (e.g., direction keys "←", "→"), and keys in a remote controller (e.g., fast forward keys).
S103, determining a first time threshold according to the operation.
In practical applications, the user-triggered operations acting on the multimedia data may reflect the user's interest level in the multimedia data to some extent.
For example, if the multimedia data is a tv show or a movie, the scenario during a certain time is relatively flat, the user has a low interest level in the multimedia data, and may be doing other things at the same time, fast forward or pause is relatively frequent, and the scenario is skipped quickly based on the general knowledge of the scenario.
For another example, if the multimedia data is a short video, the duration is short, the whole multimedia data is wonderful, the user has a high interest level in the multimedia data, and may continuously and quickly skip the scenario on the basis of generally knowing the scenario.
In this embodiment, the first time threshold adapted to the interest level of the user in the multimedia data may be generated as the size of the buffer by referring to the operation triggered by the user and acting on the multimedia data.
S104, determining a first time length of the multimedia data to be played.
The multimedia data to be played, also referred to as playable multimedia data, refers to multimedia data that has been buffered and is located after the currently playing multimedia data, and does not include multimedia data that has been buffered and is located before the currently playing multimedia data.
In this embodiment, the first time length of the multimedia data to be played can be counted so as to adjust the buffering operation.
S105, if the first time length is larger than the first time threshold, the multimedia data is suspended from being buffered.
The first time duration is compared to a first time threshold, and the buffered multimedia data reaches a limit of the buffer if the first time duration is greater than the first time threshold.
Further, in the case where the user triggers a back operation, the speed of buffering the multimedia data is greater than the speed of playing the multimedia data, or the like, the buffered multimedia data reaches the limit of the buffer area.
If the current computer device is buffering multimedia data, a pause notification may be sent to the server, and the server pauses sending multimedia data in response to the pause notification, thereby stopping buffering the multimedia data.
If the current computer device has paused buffering of multimedia data, the paused buffering of multimedia data may continue to be maintained.
In this embodiment, the multimedia data is buffered, if the multimedia data is in a played state, an operation acting on the multimedia data is detected, a first time threshold is determined according to the operation, a first time length of the multimedia data to be played is determined, if the first time length is greater than the first time threshold, the multimedia data is buffered, the operation triggered by the user and acting on the multimedia data is suspended, the operation is an active behavior, the interest level of the user in the multimedia data can be reflected to a certain extent, the adaptive first time threshold is determined according to the interest level of the user in the multimedia data, as the size of the buffer area, the higher the interest level of the user in the multimedia data is, the more the multimedia data is expected to be watched or listened, the lower the interest level of the user in the multimedia data is, the less the multimedia data is expected to be watched or listened, and the size of the buffer area can be adapted to the expectation of, under the condition of better bandwidth condition, the buffered multimedia data can easily reach the upper limit of the buffer area, the volume of the buffered multimedia data is ensured to be proper, and under the condition that a user skips or directly closes the multimedia data, the waste of the buffered multimedia data is reduced, the waste of the bandwidth of a server for distributing the multimedia data is reduced, and the bandwidth cost of the server for distributing the multimedia data is reduced.
Example two
Fig. 2 is a flowchart of a multimedia data processing method according to a second embodiment of the present invention, which further includes operations of calculating a first time threshold, maintaining buffering, processing when not playing, and the like based on the foregoing embodiments, and the method specifically includes the following steps:
s201, buffering multimedia data.
S202, if the multimedia data is in a played state, detecting an operation acting on the multimedia data.
In this embodiment, the operations that have been applied to the multimedia data in the past time period may be counted at certain intervals, for example, 5 seconds, so as to reduce the counting operations and reduce the resource consumption of the computer device.
In a specific implementation, a Timer may be set, and the Timer is used to time a specified time, such as 5 seconds.
During the duration of the Timer, e.g. 5 minutes, when an operation on multimedia data is detected, relevant information of the operation, e.g. type, time, etc., is recorded.
And if the Timer finishes timing, determining the operation which is detected during the timing period of the Timer and acts on the multimedia data, returning to set the Timer, and timing again.
It should be noted that, in the present embodiment, the trigger interval of the timer and the statistical window of the user operation are independent from each other, for example, the timer is triggered every 5 seconds to start statistics, but the statistics is not only the user operation in the past 5 seconds, but also the total number of operations in the past 5 minutes or more.
And S203, calculating the weight of the operation.
In this embodiment, the operation is converted into a weight, which is also called a score, an interest value, and the like, and the weight represents the interest level of the user in the multimedia data.
In a specific implementation, the user-triggered operations that act on the multimedia data can be distinguished into at least two types:
1. operation in the negative direction
By negative operations, it is meant operations that indicate a user's negative interest in the multimedia data, such as fast-forwarding, pausing, and the like.
2. Operation in the forward direction
The negative operation means an operation indicating a positive interest of the user in the multimedia data, such as posting a pop-up screen, holding up a favorite, collecting a favorite, and sharing a favorite.
For different types of operations, different rule calculation weights may be set, which is not limited in this embodiment.
In one example, if the operation is a negative operation, the frequency of the operation is counted as a weight.
Of course, the above-mentioned manner of calculating the weight is only an example, and when the embodiment is implemented, other manners of calculating the weight may be set according to actual situations, for example, different scores are configured according to different types of operations, products of the scores and the frequencies thereof are calculated for the same operation, and a sum of products of different operations is calculated as a weight, and the like, which is not limited in this embodiment. In addition to the above-mentioned way of calculating the weight, those skilled in the art may also adopt other ways of calculating the weight according to actual needs, and this embodiment is not limited to this.
And S204, determining a first time threshold value based on the weight.
In this embodiment, the first time threshold may be calculated using the weight accordingly according to the type of operation.
If the operation is a negative operation, the first time threshold is negatively correlated with the weight, that is, the larger the weight is, the smaller the first time threshold is, and otherwise, the smaller the weight is, the larger the first time threshold is.
If the operation is a forward operation, the first time threshold is positively correlated with the weight, that is, the smaller the weight is, the larger the first time threshold is, and conversely, the larger the weight is, the smaller the first time threshold is.
In one example, a weight threshold is set in advance, and a time upper limit value and a time lower limit value are set in advance, the time upper limit value being greater than the time lower limit value.
In this example, the weight is compared with a preset weight upper limit value.
And if the weight is greater than the preset weight upper limit value, setting the first time threshold value as a preset time lower limit value.
Alternatively, the first and second electrodes may be,
and if the weight is less than or equal to the preset weight upper limit value, calculating the ratio of the time difference value to the weight upper limit value, wherein the time difference value is the difference value between the preset time upper limit value and the preset time lower limit value.
And configuring the weight ratio to obtain the target value.
And adding the target value on the basis of the time lower limit value to obtain a first time threshold value.
In this example, it is formulated as:
where n is a first time threshold, s is a weight of the operation, st is a weight threshold, nmaxIs an upper time limit value, nminThe lower time limit.
Further, the number of types of operations may be considered in weight configuration ratio.
If the type of operation is one, the product between the weight of the operation and the ratio is calculated to obtain the target value.
If the types of the operation are two or more, calculating the sum of the weights of the operation, and calculating the product of the sum of the weights and the ratio to obtain the target value.
For example, assuming that the operation is fast forward, and the weight is expressed in terms of its frequency, the above formula can be expressed as:
wherein n is a first time threshold, sc is the frequency of fast forward, st is a weight threshold, n is a first time threshold, sc is the frequency of fast forward, and st is a second time thresholdmaxIs an upper time limit value, nminThe lower time limit.
For another example, assuming the operations are fast forward and pause, the above formula can be expressed as:
wherein n is a first time threshold, sc is the frequency of fast forwarding, sp is the frequency of pausing, st is a weight threshold, n is a weight thresholdmaxIs an upper time limit value, nminThe lower time limit.
In another example, a weight upper limit value and a weight lower limit value are preset, and the weight upper limit value is larger than the weight lower limit value.
And presetting a time upper limit value, a time middle value and a time lower limit value, wherein the time upper limit value is greater than the time middle value, and the time middle value is greater than the time lower limit value.
In this example, the first time threshold may be calculated in a direct mapping manner.
And if the weight is greater than the preset weight upper limit value, setting the first time threshold value as a preset time lower limit value.
Alternatively, the first and second electrodes may be,
and if the weight is greater than or equal to the preset weight lower limit value and less than or equal to the preset weight upper limit value, setting the first time threshold value as a preset time middle limit value.
Alternatively, the first and second electrodes may be,
and if the weight is smaller than the preset weight lower limit value, setting the first time threshold value as a preset time upper limit value.
In this example, it is formulated as:
where n is a first time threshold, s is a weight of the operation, stmaxAs an upper value of the weight, stminIs a weight lower limit value, nmaxIs an upper time limit value, nminIs a time intermediate value, nminThe lower time limit.
Of course, the above-mentioned manner of calculating the first time threshold is only an example, and when the embodiment is implemented, another manner of calculating the first time threshold may be set according to actual situations, for example, if the operation is a forward operation, the weight is multiplied by a specified coefficient to be used as the first time threshold, and the like, which is not limited in this embodiment. In addition, besides the above-mentioned manner of calculating the first time threshold, a person skilled in the art may also adopt other manners of calculating the first time threshold according to actual needs, and this embodiment is not limited to this.
S205, determining a first time length of the multimedia data to be played.
S206, if the first time length is larger than the first time threshold, the multimedia data is suspended from being buffered.
S207, if the first time length is smaller than or equal to the first time threshold, maintaining the buffering of the multimedia data.
And comparing the first time length with a first time threshold, wherein the buffered multimedia data does not reach the limit of the buffer area under the condition that the first time length is less than or equal to the first time threshold.
If the first time length is equal to the first time threshold, the multimedia data is kept to be buffered continuously in consideration of the situation that the multimedia data is continuously played.
If the current computer device has suspended buffering of the multimedia data, a start notification may be sent to the server, and the server continues to send the multimedia data in response to the start notification, thereby maintaining the buffered multimedia data.
If the current computer device is buffering multimedia data, the buffered multimedia data may continue to be maintained.
S208, if the multimedia data is in an unplayed state, determining a second time length of the multimedia data to be played.
S209, if the second time length is greater than or equal to a preset second time threshold, playing the multimedia data.
When the multimedia data is in a played state, the conditions of poor bandwidth condition, user dragging and the like exist, and the currently buffered multimedia data is insufficient, so that the multimedia data is in an unplayed state.
In this case, the playback of the multimedia data is temporarily stopped, and the multimedia data is transferred to an unplayed state.
Therefore, the unplayed state referred to in this embodiment refers to the pause playback triggered by the environment during the playback process, and does not refer to the user actively triggering the pause playback.
At this time, a second time length of the multimedia data to be played may be counted, and if the second time length is greater than or equal to a preset second time threshold, the multimedia data is read from the buffer and played.
EXAMPLE III
Fig. 3 is a flowchart of a multimedia data processing method according to an embodiment of the present invention, where the method is applicable to a situation where a play progress bar is adjusted according to a user operation on currently played multimedia data, and the method may be executed by a multimedia data processing apparatus, and the multimedia data processing apparatus may be implemented by software and/or hardware, and may be configured in a computer device, for example, a personal computer, a mobile terminal (e.g., a mobile phone, a tablet computer, etc.), an intelligent interactive tablet, a wearable device (e.g., a smart watch, smart glasses, etc.), a television, and the method specifically includes the following steps:
s301, displaying a playing interface.
In this embodiment, the operating system of the computer device includes windows, Android (Android), iOS, hong meng, and the like, and an application program supporting online playing of multimedia data, such as a player, an instant messaging tool, a browser, and the like, is installed in the operating system.
The types of multimedia data include video data, audio data, and the like.
If the multimedia data is video data, the format of the multimedia data is mostly streaming data, such as MP4, FLV, etc.
The multimedia data is stored in a server, and the multimedia data can be transmitted between the server and the computer equipment through RTSP, RTMP, HLS and other protocols.
In addition, the form of the multimedia data includes short videos, dramas, movies, electronic books, songs, and the like.
In this embodiment, the user may trigger an operation of playing the multimedia data online, and the application program displays a playing interface thereof in response to the operation of playing the multimedia data online.
The playing Interface belongs to a User Interface (UI) and is used for displaying a picture of multimedia data, and of course, besides the multimedia data, the playing Interface may also be used for displaying other elements, such as a control, a bullet screen, a playing progress bar, and the like.
Among them, for video data, the picture of the multimedia data may refer to image data or the like, and for audio data, the picture of the multimedia data may refer to cover data or the like.
S302, displaying the picture of the multimedia data and the playing progress bar on the playing interface.
The application program responds to the operation of playing the multimedia data on line, requests the server to download the multimedia data, and the server responds to the request and transmits the data packet of the multimedia data to the application program.
In a computer device, a Buffer (Buffer) may be set, where the Buffer is a region reserved in a memory and is used to temporarily store data of an input/output (I/O) port, so that the actual physical read/write frequency may be reduced, the Buffer is allocated to the memory when being created, and the region of the memory is reused all the time, thereby reducing the frequency of dynamically allocating and recycling the memory.
The application program stores the data packet of the multimedia data transmitted by the server in the buffer area to realize buffering.
And under a certain condition, if the time length of the multimedia data to be played is greater than a preset time threshold, the application program can read the multimedia data from the buffer area, and the multimedia data is decoded and displayed on a playing interface.
Taking video data as an example, as shown in fig. 4, a picture of the video data is displayed in an area 410 of the playing interface 400.
Meanwhile, displaying a playing progress bar on the playing interface, wherein the playing progress bar is used for representing the playing state of the multimedia data.
S303, receiving the operation acted on the multimedia data.
In this embodiment, if the multimedia data is in a played state, an operation that is triggered by the user and acts on the multimedia data may be detected.
It should be noted that the played state may refer to a behavior of the user actively triggering to view the multimedia data, that is, the user actively triggers to play the multimedia data and the multimedia data is on top, and the multimedia data is not in a state of pause, cannot be played due to insufficient buffering, and is blocked by other windows.
The operation applied to the multimedia data may include operations for controlling a picture of the multimedia data, such as fast forwarding, rewinding, adjusting definition, dragging a progress bar, and the like, and may also include operations for controlling a picture of the multimedia data, such as pop-up, praise, collection, sharing, and the like.
In addition, since the structure of the computer device is different, the way of operating the multimedia data is also different, and this embodiment does not limit this.
For example, a plurality of controls are provided on a playing interface for playing multimedia data, different controls are used for triggering different operations, and when it is detected that one or more controls receive a click operation, it is determined that an operation acting on the multimedia data is received.
For computer devices providing touch operations such as mobile terminals, wearable devices, smart interactive tablets and the like, a user can click an element by using a finger or a stylus in a touch manner, so that the computer devices receive operations acting on multimedia data.
For computer equipment such as an intelligent television and a personal computer which provides key operation, a user can click a control in a key control mode through external equipment connected with the computer equipment, so that the computer equipment receives operation acting on multimedia data. The external device includes, but is not limited to, a mouse, etc.
As another example, the computer device supports standard or custom keys that determine that an operation has been received to act on the multimedia data when a signal from one or more keys is received.
The keys include, but are not limited to, keys configured in a computer device (e.g., volume key), keys in a keyboard (e.g., direction keys "←", "→"), and keys in a remote controller (e.g., fast forward keys).
In this embodiment, the operations that have been applied to the multimedia data in the past time period may be counted at certain intervals, for example, 5 seconds, so as to reduce the counting operations and reduce the resource consumption of the computer device.
In a specific implementation, a Timer may be set, and the Timer is used to time a specified time, such as 5 seconds.
During the duration of the Timer, e.g. 5 minutes, when an operation on multimedia data is detected, relevant information of the operation, e.g. type, time, etc., is recorded.
And if the Timer finishes timing, determining the operation which is detected during the timing period of the Timer and acts on the multimedia data, returning to set the Timer, and timing again.
S304, displaying an area on the playing progress bar.
As shown in fig. 4, the play progress bar 420 generally has a region 421, a cursor 422, a region 423, and a region 424.
Wherein the region 421 is located before the cursor 422 for indicating the time length of the played and skipped multimedia data.
The cursor 422 is used to indicate the position of the multimedia data currently being played.
A region 423 is located behind the cursor 422 for representing the length of time of the multimedia data to be played.
The multimedia data to be played, also referred to as playable multimedia data, refers to multimedia data that has been buffered and is located after the currently playing multimedia data, and does not include multimedia data that has been buffered and is located before the currently playing multimedia data.
The area 424 is located after the area 423 for indicating the time length of the remaining unbuffered multimedia data.
In the present embodiment, the length of the region 423 is related to the operation, i.e., the region 423 is displayed by the length on the play progress bar according to the length of the operation determination region 423.
Further, user-triggered operations on multimedia data can be distinguished into at least two types:
1. operation in the negative direction
By negative operations, it is meant operations that indicate a user's negative interest in the multimedia data, such as fast-forwarding, pausing, and the like.
2. Operation in the forward direction
The negative operation means an operation indicating a positive interest of the user in the multimedia data, such as posting a pop-up screen, holding up a favorite, collecting a favorite, and sharing a favorite.
In one example, if the operation is a negative operation, the length of the region 423 is inversely related to the frequency of the operation, that is, the length of the region 423 is smaller the greater the frequency of the operation in a certain time, and conversely, the length of the region 423 is larger the smaller the frequency of the operation.
If the operation is a forward operation, the length of the region is positively correlated with the frequency of the operation, that is, the length of the region 423 is larger when the frequency of the operation is larger, and conversely, the length of the region 423 is smaller when the frequency of the operation is smaller.
In a specific implementation, the first time threshold may be determined according to an operation, the first time length of the multimedia data to be played is determined, at this time, a ratio between the first time length and the total duration of the multimedia data may be calculated, the ratio is taken from the total length of the play progress bar 420 as the length of the region 423, and the region 423 is displayed on the play progress bar according to the length.
At this time, if the first time length is greater than the first time threshold, the buffering of the multimedia data is suspended.
In addition, if the first time length is less than or equal to the first time threshold, the buffered multimedia data is maintained.
Optionally, determining the first time threshold according to an operation includes:
calculating a weight for the operation;
determining a first time threshold based on the weight, wherein the first time threshold is negatively correlated with the weight if the operation is a negative operation, and positively correlated with the weight if the operation is a positive operation.
Optionally, calculating weights for the operations comprises:
and if the operation is negative operation, counting the frequency of the operation as the weight.
In one example, determining the first time threshold based on the weight includes:
if the weight is larger than a preset weight threshold value, setting a first time threshold value as a preset time lower limit value;
alternatively, the first and second electrodes may be,
if the weight is less than or equal to a preset weight threshold value, calculating a ratio between a time difference value and a weight upper limit value, wherein the time difference value is a difference value between the preset time upper limit value and a preset time lower limit value, and the time upper limit value is greater than the time lower limit value;
configuring the weight ratio to obtain a target value;
the target value is added on the basis of the time lower limit value to obtain a first time threshold value.
Further, configuring the weight to be a ratio to obtain a target value, including:
if the type of the operation is one, calculating the product between the weight of the operation and the ratio to obtain a target value;
alternatively, the first and second electrodes may be,
if the types of the operations are two or more, calculating the sum of the weights of the operations;
and calculating the product between the sum of the weights and the ratio to obtain the target value.
Optionally, determining the first time threshold based on the frequency comprises:
if the weight is greater than the preset weight upper limit value, setting the first time threshold value as a preset time lower limit value;
alternatively, the first and second electrodes may be,
if the weight is greater than or equal to the preset weight lower limit value and less than or equal to the preset weight upper limit value, setting the first time threshold value as a preset time middle limit value;
alternatively, the first and second electrodes may be,
if the weight is smaller than a preset weight lower limit value, setting a first time threshold value as a preset time upper limit value;
the time upper limit value is larger than the time middle limit value, and the time middle limit value is larger than the time lower limit value.
Optionally, if the multimedia data is in an unplayed state, determining a second time length of the multimedia data to be played;
and if the second time length is greater than or equal to a preset second time threshold, playing the multimedia data.
In the present embodiment, since the calculation of the first time threshold and the maintaining or suspending of the buffered multimedia data are substantially similar to the application of the first and second embodiments, the description is relatively simple, and reference may be made to the partial description of the first and second embodiments for relevant points, which is not described in detail herein.
In this embodiment, a playing interface is displayed, a frame of multimedia data and a playing progress bar are displayed on the playing interface, an operation acting on the multimedia data is received, an area is displayed on the playing progress bar, the area is used for representing the time length of the multimedia data to be played, the length of the area is related to the operation, the operation which is triggered by a user and acts on the multimedia data is an active behavior, the interest degree of the user on the multimedia data can be reflected to a certain degree, an adaptive first time threshold value is determined according to the interest degree of the user on the multimedia data, the size of a buffer area is used, the higher the interest degree of the user on the multimedia data is, the more multimedia data is expected to be watched or listened, the lower the interest degree of the user on the multimedia data is, the less multimedia data is expected to be watched or listened, and the size of the buffer area can be adapted to the expectation of the, under the condition of better bandwidth condition, the buffered multimedia data can easily reach the upper limit of the buffer area, the volume of the buffered multimedia data is ensured to be proper, and under the condition that a user skips or directly closes the multimedia data, the waste of the buffered multimedia data is reduced, the waste of the bandwidth of a server for distributing the multimedia data is reduced, and the bandwidth cost of the server for distributing the multimedia data is reduced.
Example four
Fig. 5 is a schematic structural diagram of a multimedia data processing apparatus according to a fourth embodiment of the present invention, where the apparatus may specifically include the following modules:
a buffering module 501, configured to buffer multimedia data;
an operation detection module 502, configured to detect an operation acting on the multimedia data if the multimedia data is in a played state;
a time threshold determination module 503, configured to determine a first time threshold according to the operation;
a time length determining module 504, configured to determine a first time length of the multimedia data to be played;
a buffer suspension module 505, configured to suspend buffering the multimedia data if the first time duration is greater than the first time threshold.
In one embodiment of the present invention, further comprising:
and the buffer maintaining module is used for maintaining the buffer of the multimedia data if the first time length is less than or equal to the first time threshold.
In one embodiment of the present invention, the operation detection module 502 comprises:
the timer setting submodule is used for setting a timer;
and the operation determining submodule is used for determining the operation which is detected during the timing period of the timer and acts on the multimedia data if the timer finishes timing, and returning to the timer setting submodule.
In one embodiment of the present invention, the time threshold determination module 503 includes:
the weight calculation submodule is used for calculating the weight of the operation;
a weight configuration submodule configured to determine a first time threshold based on the weight, wherein the first time threshold is negatively correlated with the weight if the operation is a negative operation, and the first time threshold is positively correlated with the weight if the operation is a positive operation.
In one embodiment of the present invention, the weight calculation submodule includes:
and the frequency counting unit is used for counting the frequency of the operation as the weight if the operation is the negative operation.
In an example of the embodiment of the present invention, the weight configuration sub-module includes:
the weight presetting unit is used for setting the first time threshold value as a preset time lower limit value if the weight is greater than a preset weight threshold value;
alternatively, the first and second electrodes may be,
a ratio calculation unit, configured to calculate a ratio between a time difference and the upper weight limit if the weight is less than or equal to a preset weight threshold, where the time difference is a difference between a preset upper time limit and a preset lower time limit, and the upper time limit is greater than the lower time limit;
a ratio configuration unit, configured to configure the weight with the ratio to obtain a target value;
and the summing unit is used for adding the target value on the basis of the time lower limit value to obtain a first time threshold value.
Further, the ratio configuration unit includes:
a first product calculating subunit, configured to calculate a product between the weight of the operation and the ratio to obtain a target value if the type of the operation is one;
alternatively, the first and second electrodes may be,
a weight sum calculating subunit, configured to calculate a sum of weights of the operations if the types of the operations are two or more;
and the second product calculation subunit is used for calculating the product between the sum of the weights and the ratio to obtain a target value.
In an example of the embodiment of the present invention, the weight configuration sub-module includes:
the first setting unit is used for setting the first time threshold value as a preset time lower limit value if the weight is greater than a preset weight upper limit value;
alternatively, the first and second electrodes may be,
a second setting unit, configured to set the first time threshold as a preset time middle limit if the weight is greater than or equal to a preset weight lower limit and less than or equal to a preset weight upper limit;
alternatively, the first and second electrodes may be,
a third setting unit, configured to set the first time threshold as a preset upper time limit if the weight is smaller than a preset lower weight limit;
the time upper limit value is greater than the time middle limit value, and the time middle limit value is greater than the time lower limit value.
In one embodiment of the present invention, further comprising:
a to-be-played time length determining module, configured to determine a second time length of the multimedia data to be played if the multimedia data is in an unplayed state;
and the multimedia data playing module is used for playing the multimedia data if the second time length is greater than or equal to a preset second time threshold.
The multimedia data processing device provided by the embodiment of the invention can execute the multimedia data processing method provided by any embodiment of the invention, and has the corresponding functional modules and beneficial effects of the execution method.
EXAMPLE five
Fig. 6 is a schematic structural diagram of a multimedia data processing apparatus according to a fifth embodiment of the present invention, where the apparatus may specifically include the following modules:
a playing interface display module 601, configured to display a playing interface;
an interface element display module 602, configured to display a frame and a play progress bar of multimedia data on the play interface;
an operation receiving module 603 configured to receive an operation applied to the multimedia data;
a region displaying module 604, configured to display a region on the playing progress bar, where the region is used to indicate a time length of the multimedia data to be played, and the length of the region is related to the operation.
Alternatively,
if the operation is a negative operation, the length of the region is inversely related to the frequency of the operation;
if the operation is a forward operation, the length of the region is positively correlated with the frequency of the operation.
In one embodiment of the present invention, the area display module 604 comprises:
a time threshold determination module for determining a first time threshold according to the operation;
the time length determining module is used for determining a first time length of the multimedia data to be played;
the time length ratio calculating module is used for calculating the ratio of the first time length to the total time length of the multimedia data;
a length determining module, configured to take the ratio of the total length of the playing progress bar as a length of the region;
and the length display module is used for displaying the area on the playing progress bar according to the length.
In one embodiment of the present invention, further comprising:
and the buffer pause module is used for pausing the buffering of the multimedia data if the first time length is greater than the first time threshold.
In one embodiment of the present invention, further comprising:
and the buffer maintaining module is used for maintaining the buffer of the multimedia data if the first time length is less than or equal to the first time threshold.
In one embodiment of the present invention, the operation receiving module 603 includes:
the timer setting submodule is used for setting a timer;
and the operation determining submodule is used for determining the operation which is detected during the timing period of the timer and acts on the multimedia data if the timer finishes timing, and returning to the timer setting submodule.
In one embodiment of the invention, the time threshold determination module comprises:
the weight calculation submodule is used for calculating the weight of the operation;
a weight configuration submodule configured to determine a first time threshold based on the weight, wherein the first time threshold is negatively correlated with the weight if the operation is a negative operation, and the first time threshold is positively correlated with the weight if the operation is a positive operation.
In one embodiment of the present invention, the weight calculation submodule includes:
and the frequency counting unit is used for counting the frequency of the operation as the weight if the operation is the negative operation.
In an example of the embodiment of the present invention, the weight configuration sub-module includes:
the weight presetting unit is used for setting the first time threshold value as a preset time lower limit value if the weight is greater than a preset weight threshold value;
alternatively, the first and second electrodes may be,
a ratio calculation unit, configured to calculate a ratio between a time difference and the upper weight limit if the weight is less than or equal to a preset weight threshold, where the time difference is a difference between a preset upper time limit and a preset lower time limit, and the upper time limit is greater than the lower time limit;
a ratio configuration unit, configured to configure the weight with the ratio to obtain a target value;
and the summing unit is used for adding the target value on the basis of the time lower limit value to obtain a first time threshold value.
Further, the ratio configuration unit includes:
a first product calculating subunit, configured to calculate a product between the weight of the operation and the ratio to obtain a target value if the type of the operation is one;
alternatively, the first and second electrodes may be,
a weight sum calculating subunit, configured to calculate a sum of weights of the operations if the types of the operations are two or more;
and the second product calculation subunit is used for calculating the product between the sum of the weights and the ratio to obtain a target value.
In an example of the embodiment of the present invention, the weight configuration sub-module includes:
the first setting unit is used for setting the first time threshold value as a preset time lower limit value if the weight is greater than a preset weight upper limit value;
alternatively, the first and second electrodes may be,
a second setting unit, configured to set the first time threshold as a preset time middle limit if the weight is greater than or equal to a preset weight lower limit and less than or equal to a preset weight upper limit;
alternatively, the first and second electrodes may be,
a third setting unit, configured to set the first time threshold as a preset upper time limit if the weight is smaller than a preset lower weight limit;
the time upper limit value is greater than the time middle limit value, and the time middle limit value is greater than the time lower limit value.
In one embodiment of the present invention, further comprising:
a to-be-played time length determining module, configured to determine a second time length of the multimedia data to be played if the multimedia data is in an unplayed state;
and the multimedia data playing module is used for playing the multimedia data if the second time length is greater than or equal to a preset second time threshold.
The multimedia data processing device provided by the embodiment of the invention can execute the multimedia data processing method provided by any embodiment of the invention, and has the corresponding functional modules and beneficial effects of the execution method.
EXAMPLE six
Fig. 7 is a schematic structural diagram of a computer device according to a sixth embodiment of the present invention, where the computer device includes a display screen 710 and an interactor 720;
the display screen 710 is configured to display a playing interface, and display a picture of multimedia data and a playing progress bar on the playing interface;
the interactor 720 is used for receiving operations acted on the multimedia data;
the display screen 710 is further configured to display an area on the play progress bar, where the area is used to indicate a time length of the multimedia data to be played, and the length of the area is related to the operation.
In a specific implementation, the interactor comprises at least one of:
touch-sensitive screen, button, keyboard, mouse, remote controller.
In practical application, if the operation is a negative operation, the length of the region is inversely related to the frequency of the operation;
if the operation is a forward operation, the length of the region is positively correlated with the frequency of the operation.
The computer device provided by the embodiment of the invention can execute the multimedia data processing method provided by any embodiment of the invention, and has the corresponding functional modules and beneficial effects of the execution method.
EXAMPLE seven
Fig. 8 is a schematic structural diagram of a computer device according to a seventh embodiment of the present invention. As shown in fig. 8, the computer apparatus includes a processor 800, a memory 801, a communication module 802, an input device 803, and an output device 804; the number of the processors 800 in the computer device may be one or more, and one processor 800 is taken as an example in fig. 8; the processor 800, the memory 801, the communication module 802, the input device 803 and the output device 804 in the computer apparatus may be connected by a bus or other means, and fig. 8 illustrates an example of connection by a bus.
The memory 801 may be used as a computer-readable storage medium for storing software programs, computer-executable programs, and modules corresponding to the processing method of multimedia data in the present embodiment (for example, the buffer module 501, the operation detection module 502, the time threshold determination module 503, the time length determination module 504, and the buffer pause module 505 in the processing apparatus of multimedia data as shown in fig. 5, or the play interface display module 601, the interface element display module 602, the operation reception module 603, and the region display module 604 in the processing apparatus of multimedia data as shown in fig. 6). The processor 800 executes various functional applications of the computer device and data processing, i.e., implements the above-described processing method of multimedia data, by executing software programs, instructions, and modules stored in the memory 801.
The memory 801 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application program required for at least one function; the storage data area may store data created according to use of the computer device, and the like. Further, the memory 801 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid state storage device. In some examples, memory 801 may further include memory located remotely from processor 800, which may be connected to a computer device through a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
And the communication module 802 is configured to establish a connection with the display screen and implement data interaction with the display screen. The input unit 803 may be used to receive input numeric or character information and generate key signal inputs related to user settings and function control of the computer apparatus.
The computer device provided in this embodiment may execute the method for processing multimedia data provided in any embodiment of the present invention, and its corresponding functions and advantages are described in detail.
Example eight
An eighth embodiment of the present invention further provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements a method for processing multimedia data.
In one case, the method includes:
buffering the multimedia data;
if the multimedia data is in a played state, detecting an operation acting on the multimedia data;
determining a first time threshold in accordance with the operation;
determining a first time length of multimedia data to be played;
and if the first time length is greater than the first time threshold, suspending the buffering of the multimedia data.
In another aspect, the method includes:
displaying a playing interface;
displaying a picture and a playing progress bar of the multimedia data on the playing interface;
receiving an operation acting on the multimedia data;
and displaying an area on the playing progress bar, wherein the area is used for representing the time length of the multimedia data to be played, and the length of the area is related to the operation.
Of course, the computer program of the computer-readable storage medium provided in the embodiments of the present invention is not limited to the method operations described above, and may also perform related operations in the multimedia data processing method provided in any embodiment of the present invention.
From the above description of the embodiments, it is obvious for those skilled in the art that the present invention can be implemented by software and necessary general hardware, and certainly, can also be implemented by hardware, but the former is a better embodiment in many cases. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which may be stored in a computer-readable storage medium, such as a floppy disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a FLASH Memory (FLASH), a hard disk or an optical disk of a computer, and includes several instructions for enabling a computer device (which may be a personal computer, a server, or a network device) to execute the methods according to the embodiments of the present invention.
It should be noted that, in the embodiment of the processing apparatus for multimedia data, the units and modules included in the embodiment are only divided according to functional logic, but are not limited to the above division as long as the corresponding functions can be implemented; in addition, specific names of the functional units are only for convenience of distinguishing from each other, and are not used for limiting the protection scope of the present invention.
It is to be noted that the foregoing is only illustrative of the preferred embodiments of the present invention and the technical principles employed. It will be understood by those skilled in the art that the present invention is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the invention. Therefore, although the present invention has been described in greater detail by the above embodiments, the present invention is not limited to the above embodiments, and may include other equivalent embodiments without departing from the spirit of the present invention, and the scope of the present invention is determined by the scope of the appended claims.
Claims (17)
1. A method for processing multimedia data, comprising:
buffering the multimedia data;
if the multimedia data is in a played state, detecting an operation acting on the multimedia data;
determining a first time threshold in accordance with the operation;
determining a first time length of multimedia data to be played;
and if the first time length is greater than the first time threshold, suspending the buffering of the multimedia data.
2. The method of claim 1, further comprising:
if the first time length is less than or equal to the first time threshold, the multimedia data is kept buffered.
3. The method of claim 1, wherein the detecting an operation acting on the multimedia data comprises:
setting a timer;
and if the timer finishes timing, determining the operation which is detected during the timing period of the timer and acts on the multimedia data, and returning to the set timer.
4. The method of any of claims 1-3, wherein determining the first time threshold based on the operation comprises:
calculating a weight for the operation;
determining a first time threshold based on the weight, wherein the first time threshold is negatively correlated to the weight if the operation is a negative operation, and positively correlated to the weight if the operation is a positive operation.
5. The method of claim 4, wherein the calculating weights for the operations comprises:
and if the operation is negative operation, counting the frequency of the operation as weight.
6. The method of claim 4, wherein determining the first time threshold based on the weight comprises:
if the weight is larger than a preset weight threshold value, setting the first time threshold value as a preset time lower limit value;
alternatively, the first and second electrodes may be,
if the weight is less than or equal to a preset weight threshold value, calculating a ratio between a time difference value and the weight upper limit value, wherein the time difference value is a difference value between a preset time upper limit value and a preset time lower limit value, and the time upper limit value is greater than the time lower limit value;
configuring the weight with the ratio to obtain a target value;
and adding the target value on the basis of the time lower limit value to obtain a first time threshold value.
7. The method of claim 6, wherein configuring the weight to the ratio to obtain a target value comprises:
if the type of the operation is one, calculating the product between the weight of the operation and the ratio to obtain a target value;
alternatively, the first and second electrodes may be,
if the types of the operations are two or more, calculating the sum of the weights of the operations;
and calculating the product of the sum of the weights and the ratio to obtain a target value.
8. The method of claim 4, wherein determining the first time threshold based on the frequency comprises:
if the weight is larger than a preset weight upper limit value, setting the first time threshold value as a preset time lower limit value;
alternatively, the first and second electrodes may be,
if the weight is greater than or equal to a preset weight lower limit value and less than or equal to a preset weight upper limit value, setting the first time threshold value as a preset time middle limit value;
alternatively, the first and second electrodes may be,
if the weight is smaller than a preset weight lower limit value, setting the first time threshold value as a preset time upper limit value;
the time upper limit value is greater than the time middle limit value, and the time middle limit value is greater than the time lower limit value.
9. The method of claim 1, further comprising:
if the multimedia data is in an unplayed state, determining a second time length of the multimedia data to be played;
and if the second time length is greater than or equal to a preset second time threshold, playing the multimedia data.
10. A method for processing multimedia data, comprising:
displaying a playing interface;
displaying a picture and a playing progress bar of the multimedia data on the playing interface;
receiving an operation acting on the multimedia data;
and displaying an area on the playing progress bar, wherein the area is used for representing the time length of the multimedia data to be played, and the length of the area is related to the operation.
11. The method of claim 10,
if the operation is a negative operation, the length of the region is inversely related to the frequency of the operation;
if the operation is a forward operation, the length of the region is positively correlated with the frequency of the operation.
12. An apparatus for processing multimedia data, comprising:
the buffer module is used for buffering the multimedia data;
an operation detection module for detecting an operation acting on the multimedia data if the multimedia data is in a played state;
a time threshold determination module for determining a first time threshold according to the operation;
the time length determining module is used for determining a first time length of the multimedia data to be played;
and the buffer pause module is used for pausing the buffering of the multimedia data if the first time length is greater than the first time threshold.
13. An apparatus for processing multimedia data, comprising:
the playing interface display module is used for displaying a playing interface;
the interface element display module is used for displaying the picture of the multimedia data and the playing progress bar on the playing interface;
an operation receiving module for receiving an operation acting on the multimedia data;
and the area display module is used for displaying an area on the playing progress bar, wherein the area is used for representing the time length of the multimedia data to be played, and the length of the area is related to the operation.
14. A computer device, wherein the computer device comprises a display screen and an interactor;
the display screen is used for displaying a playing interface and displaying a picture of multimedia data and a playing progress bar on the playing interface;
the interactor is used for receiving operation acting on the multimedia data;
the display screen is further configured to display an area on the play progress bar, where the area is used to indicate a time length of the multimedia data to be played, and the length of the area is related to the operation.
15. The method of claim 14, wherein the interactor comprises at least one of:
touch-sensitive screen, button, keyboard, mouse, remote controller.
16. A computer device, characterized in that the computer device comprises:
one or more processors;
a memory for storing one or more programs;
when executed by the one or more processors, cause the one or more processors to implement a method of processing multimedia data as claimed in any one of claims 1-11.
17. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out a method of processing multimedia data according to any one of claims 1 to 11.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911052247.7A CN110807106B (en) | 2019-10-31 | 2019-10-31 | Multimedia data processing method and device, computer equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911052247.7A CN110807106B (en) | 2019-10-31 | 2019-10-31 | Multimedia data processing method and device, computer equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110807106A true CN110807106A (en) | 2020-02-18 |
| CN110807106B CN110807106B (en) | 2024-04-26 |
Family
ID=69489782
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911052247.7A Active CN110807106B (en) | 2019-10-31 | 2019-10-31 | Multimedia data processing method and device, computer equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110807106B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113810969A (en) * | 2021-10-20 | 2021-12-17 | 广州通达汽车电气股份有限公司 | Base station switching method and device, multimedia equipment and storage medium |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6314466B1 (en) * | 1998-10-06 | 2001-11-06 | Realnetworks, Inc. | System and method for providing random access to a multimedia object over a network |
| US20040133657A1 (en) * | 2003-01-03 | 2004-07-08 | Broadq, Llc | Digital media system and method therefor |
| CN104284249A (en) * | 2013-07-11 | 2015-01-14 | 腾讯科技（深圳）有限公司 | Video playing method and device |
| CN106658067A (en) * | 2016-12-31 | 2017-05-10 | 中国移动通信集团江苏有限公司 | Cache setting method and apparatus |
| CN109561347A (en) * | 2017-09-27 | 2019-04-02 | 中国移动通信集团山东有限公司 | A kind of internet video play quality determination method and system |
| CN110312156A (en) * | 2018-03-27 | 2019-10-08 | 腾讯科技（深圳）有限公司 | A kind of video cache method, apparatus and readable storage medium storing program for executing |
-
2019
- 2019-10-31 CN CN201911052247.7A patent/CN110807106B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6314466B1 (en) * | 1998-10-06 | 2001-11-06 | Realnetworks, Inc. | System and method for providing random access to a multimedia object over a network |
| US20040133657A1 (en) * | 2003-01-03 | 2004-07-08 | Broadq, Llc | Digital media system and method therefor |
| CN104284249A (en) * | 2013-07-11 | 2015-01-14 | 腾讯科技（深圳）有限公司 | Video playing method and device |
| CN106658067A (en) * | 2016-12-31 | 2017-05-10 | 中国移动通信集团江苏有限公司 | Cache setting method and apparatus |
| CN109561347A (en) * | 2017-09-27 | 2019-04-02 | 中国移动通信集团山东有限公司 | A kind of internet video play quality determination method and system |
| CN110312156A (en) * | 2018-03-27 | 2019-10-08 | 腾讯科技（深圳）有限公司 | A kind of video cache method, apparatus and readable storage medium storing program for executing |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113810969A (en) * | 2021-10-20 | 2021-12-17 | 广州通达汽车电气股份有限公司 | Base station switching method and device, multimedia equipment and storage medium |
| CN113810969B (en) * | 2021-10-20 | 2023-06-06 | 广州通达汽车电气股份有限公司 | Base station switching method and device, multimedia equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110807106B (en) | 2024-04-26 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109413483B (en) | Live content preview method, device, equipment and medium | |
| US10531152B2 (en) | Tracking and responding to distracting events | |
| US10992999B2 (en) | Techniques for seamless media content switching during fixed-duration breaks | |
| WO2018000624A1 (en) | Video playing control method and device | |
| CN107360458B (en) | Play control method, device, storage medium and terminal | |
| CN108566561B (en) | Video playing method, device and storage medium | |
| JP2018505504A (en) | Advertisement push system, apparatus and method | |
| WO2020029935A1 (en) | Video live-broadcast processing method, apparatus and terminal | |
| CN107396171A (en) | Live network broadcast method, device and storage medium | |
| CN103166941A (en) | Data sharing method and device | |
| US20170324998A1 (en) | Method for playing video, client, and computer storage medium | |
| CN105828213A (en) | Method and apparatus for decreasing presentation latency | |
| WO2022052624A1 (en) | Video data processing method and apparatus, computer device and storage medium | |
| US10887646B2 (en) | Live streaming with multiple remote commentators | |
| WO2007037913A1 (en) | Provision of applications across a network | |
| WO2022017204A1 (en) | Video interaction method and device, electronic device and storage medium | |
| WO2016150273A1 (en) | Video playing method, mobile terminal and system | |
| US11284165B1 (en) | Copyright compliant trick playback modes in a service provider network | |
| CN110913257A (en) | Video data playing method, device, equipment and storage medium | |
| CN110740374B (en) | Multimedia data processing method and device, computer equipment and storage medium | |
| JP2019504517A (en) | Method, system, and medium for presenting content items while buffering video | |
| CN111327956A (en) | Video playing method and device and electronic equipment | |
| CN110807106B (en) | Multimedia data processing method and device, computer equipment and storage medium | |
| US20140099040A1 (en) | Image processing device and image processing method | |
| KR102280065B1 (en) | Method and apparatus for playing multimedia contents in a communication |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |