CN112614516A - Progress bar adjusting method and device, terminal and storage medium - Google Patents
Progress bar adjusting method and device, terminal and storage medium Download PDFInfo
- Publication number
- CN112614516A CN112614516A CN202011455481.7A CN202011455481A CN112614516A CN 112614516 A CN112614516 A CN 112614516A CN 202011455481 A CN202011455481 A CN 202011455481A CN 112614516 A CN112614516 A CN 112614516A
- Authority
- CN
- China
- Prior art keywords
- pitch
- progress bar
- target user
- adjusting
- variation trend
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 57
- 230000008569 process Effects 0.000 claims abstract description 14
- 230000008859 change Effects 0.000 claims description 15
- 230000000630 rising effect Effects 0.000 claims description 12
- 230000009467 reduction Effects 0.000 claims description 9
- 230000001174 ascending effect Effects 0.000 claims description 6
- 238000000605 extraction Methods 0.000 claims description 3
- 238000012545 processing Methods 0.000 description 8
- 230000002093 peripheral effect Effects 0.000 description 6
- 230000006835 compression Effects 0.000 description 4
- 238000007906 compression Methods 0.000 description 4
- 239000000284 extract Substances 0.000 description 4
- 238000010586 diagram Methods 0.000 description 3
- 230000004044 response Effects 0.000 description 3
- 238000005070 sampling Methods 0.000 description 3
- 238000013473 artificial intelligence Methods 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 238000012552 review Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000010801 machine learning Methods 0.000 description 1
- 230000005055 memory storage Effects 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000001105 regulatory effect Effects 0.000 description 1
- 238000009877 rendering Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
- G10L25/90—Pitch determination of speech signals
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
- G10L25/48—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
- H04N21/47217—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for controlling playback functions for recorded or on-demand content, e.g. using progress bars, mode or play-point indicators or bookmarks
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Human Computer Interaction (AREA)
- Multimedia (AREA)
- Computational Linguistics (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Databases & Information Systems (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The disclosure provides a method and a device for adjusting a progress bar, a terminal and a storage medium, and belongs to the technical field of electronics. The method comprises the following steps: collecting audio data of a target user in the playing process of the multimedia file; extracting pitch data from the audio data; determining the pitch variation trend of the target user according to the pitch data; and adjusting the progress bar of the multimedia file according to the tone variation trend of the target user. The present disclosure adjusts the progress bar of the multimedia file based on the pitch variation trend. In the acoustic field, the tone is usually used for representing the height of the sound frequency, a user does not need to speak specific voice content, only needs to send out simple audio, and for users of different languages, a grammar database corresponding to different languages does not need to be constructed, so that the adjustment cost of the progress bar is greatly reduced.
Description
Technical Field
The present disclosure relates to the field of electronic technologies, and in particular, to a method and an apparatus for adjusting a progress bar, a terminal, and a storage medium.
Background
In the process of playing the multimedia file, if the user wants to review the previously played content or view the content which is not played later, the progress bar needs to be adjusted.
At present, when the related art adjusts the progress bar, the following method is mainly adopted: receiving a voice signal sent by a user; analyzing the voice signal to obtain corresponding text content; searching a regulating instruction corresponding to the text content from a grammar database; and adjusting the progress bar based on the adjusting instruction.
However, considering the difference between different languages, in order to implement the adjustment of the progress bar, a grammar database of different languages needs to be constructed, which increases the adjustment cost of the progress bar.
Disclosure of Invention
The embodiment of the disclosure provides a method, a device, a terminal and a storage medium for adjusting a progress bar, which can reduce the adjustment cost of the progress bar. The technical scheme is as follows:
according to a first aspect of the embodiments of the present disclosure, there is provided a method for adjusting a progress bar, the method including:
collecting audio data of a target user in the playing process of the multimedia file;
extracting pitch data from the audio data;
determining a pitch variation trend of the target user according to the pitch data;
and adjusting the progress bar of the multimedia file according to the tone variation trend of the target user.
In another possible implementation manner, the determining a pitch variation trend of the target user according to the pitch data includes:
drawing a tone curve according to the tone value and the acquisition time in the tone data;
and determining the pitch variation trend of the target user according to the instantaneous tangent slope of the pitch curve.
In another possible implementation manner, the determining the pitch variation trend of the target user according to the instantaneous tangent slope of the pitch curve includes:
if the instantaneous tangent slope is a positive value, determining the pitch change trend of the target user to be rising pitch;
and if the instantaneous tangent slope is a negative value, determining the pitch variation trend of the target user to be pitch reduction.
In another possible implementation manner, the adjusting the progress bar of the multimedia file according to the pitch variation trend of the target user includes:
if the pitch variation trend of the target user is rising, adjusting the progress bar to a first direction, wherein the first direction is a direction for skipping the currently played content on the progress bar to the unplayed content;
and if the pitch variation trend of the target user is pitch reduction, adjusting the progress bar to a second direction, wherein the second direction is a direction for skipping the currently played content on the progress bar to the played content.
In another possible implementation manner, after the adjusting the progress bar of the multimedia file according to the pitch variation trend of the target user, the method further includes:
if the pitch variation trend of the target user is changed from rising pitch to falling pitch, switching the adjustment direction of the progress bar from the first direction to the second direction;
and if the pitch variation trend of the target user is changed from descending pitch to ascending pitch, switching the adjustment direction of the progress bar from the second direction to the first direction.
In another possible implementation manner, the method further includes:
determining an adjustment ratio of the progress bar;
and adjusting the progress bar according to the adjusting proportion.
In another possible implementation manner, the determining an adjustment ratio of the progress bar includes:
and determining the adjustment distance of the progress bar according to the absolute value of the slope of the instantaneous tangent.
In another possible implementation manner, the determining an adjustment ratio of the progress bar includes:
and determining the adjustment proportion of the progress bar according to the volume value corresponding to the tone data.
According to a second aspect of the embodiments of the present disclosure, there is provided an adjusting apparatus of a progress bar, the apparatus including:
the acquisition module is used for acquiring audio data of a target user in the playing process of the multimedia file;
an extraction module for extracting tonal data from the audio data;
the determining module is used for determining the pitch variation trend of the target user according to the pitch data;
and the adjusting module is used for adjusting the progress bar of the multimedia file according to the tone variation trend of the target user.
In another possible implementation manner, the determining module is configured to draw a pitch curve according to the pitch value and the acquisition time in the pitch data; and determining the pitch variation trend of the target user according to the instantaneous tangent slope of the pitch curve.
In another possible implementation manner, the determining module is configured to determine that the pitch variation trend of the target user is an ascending pitch if the instantaneous tangent slope is a positive value; and if the instantaneous tangent slope is a negative value, determining the pitch variation trend of the target user to be pitch reduction.
In another possible implementation manner, the adjusting module is configured to adjust the progress bar in a first direction if the pitch variation trend of the target user is a rising pitch, where the first direction is a direction in which currently played content on the progress bar jumps to unplayed content; and if the pitch variation trend of the target user is pitch reduction, adjusting the progress bar to a second direction, wherein the second direction is a direction for skipping the currently played content on the progress bar to the played content.
In another possible implementation manner, the apparatus further includes:
the switching module is used for switching the adjusting direction of the progress bar from the first direction to the second direction if the pitch variation trend of the target user is changed from rising pitch to falling pitch;
the switching module is further configured to switch the adjustment direction of the progress bar from the second direction to the first direction if the pitch variation trend of the target user changes from a down pitch to an up pitch.
In another possible implementation form of the method,
the determining module is further used for determining the adjusting proportion of the progress bar;
the adjusting module is further used for adjusting the progress bar according to the adjusting proportion.
In another possible implementation manner, the determining module is configured to determine the adjustment distance of the progress bar according to an absolute value of the instantaneous tangent slope.
In another possible implementation manner, the determining module is configured to determine an adjustment ratio of the progress bar according to a volume value corresponding to the tone data.
According to a third aspect of the embodiments of the present disclosure, there is provided a terminal, the terminal includes a processor and a memory, the memory stores at least one program code, and the at least one program code is loaded and executed by the processor, so as to implement the method for adjusting a progress bar according to the first aspect.
According to a fourth aspect of the embodiments of the present disclosure, there is provided a computer-readable storage medium having at least one program code stored therein, the at least one program code being loaded and executed by a processor to implement the method for adjusting a progress bar according to the first aspect.
The technical scheme provided by the embodiment of the disclosure has the following beneficial effects:
and adjusting the progress bar of the multimedia file based on the tone variation trend. In the acoustic field, the tone is usually used for representing the height of the sound frequency, a user does not need to speak specific voice content, only needs to send out simple audio, and for users of different languages, a grammar database corresponding to different languages does not need to be constructed, so that the adjustment cost of the progress bar is greatly reduced.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present disclosure, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present disclosure, and it is obvious for those skilled in the art to obtain other drawings based on the drawings without creative efforts.
Fig. 1 is an implementation environment related to a method for adjusting a progress bar according to an embodiment of the present disclosure;
fig. 2 is a flowchart of a method for adjusting a progress bar according to an embodiment of the disclosure;
fig. 3 is a flowchart of a method for adjusting a progress bar according to an embodiment of the disclosure;
fig. 4 is a schematic structural diagram of an adjusting device of a progress bar according to an embodiment of the disclosure;
fig. 5 shows a block diagram of a terminal according to an exemplary embodiment of the present disclosure.
Detailed Description
To make the objects, technical solutions and advantages of the present disclosure more apparent, embodiments of the present disclosure will be described in detail with reference to the accompanying drawings.
It is to be understood that the terms "each," "a plurality," and "any" and the like, as used in the embodiments of the present disclosure, are intended to encompass two or more, each referring to each of the corresponding plurality, and any referring to any one of the corresponding plurality. For example, the plurality of words includes 10 words, and each word refers to each of the 10 words, and any word refers to any one of the 10 words.
Referring to fig. 1, an implementation environment related to a method for adjusting a progress bar provided by an embodiment of the present disclosure is shown, where the implementation environment includes: a terminal 101 and a server 102.
The terminal 101 may be a smart phone, a tablet computer, a notebook computer, an MP3(Moving Picture Experts Group Audio Layer III, motion video Experts compression standard Audio Layer 3), an MP4(Moving Picture Experts Group Audio Layer IV, motion video Experts compression standard Audio Layer 4), and the like. A playback application of the multimedia file is installed in the terminal 101, and the terminal 101 can play the multimedia file based on the installed playback application of the multimedia file. During the playing process of the multimedia file, the terminal 101 may display the playing progress of the multimedia file, so that the user knows the playing condition of the multimedia file. The terminal 101 may also collect audio data of a user, extract tone data from the audio data, and then adjust the progress bar of the multimedia file according to the tone variation trend.
The server 102 is a background server of a playing application of the multimedia file installed in the terminal 101, and the server 102 can provide a playing service of the multimedia file. The server 102 may be an independent physical server, or may be a server cluster or a distributed system formed by a plurality of physical servers, and the embodiment of the present disclosure does not specifically limit the type of the server 102.
The terminal 101 and the server 102 may be directly or indirectly connected through wired or wireless communication, and the present disclosure is not limited thereto.
Based on the implementation environment shown in fig. 1, an embodiment of the present disclosure provides a method for adjusting a progress bar, and referring to fig. 2, a flow of the method for adjusting a progress bar includes:
201. and in the playing process of the multimedia file, acquiring audio data of a target user.
The multimedia files include audio files, video files, picture files, text files or other types of files. The target user is a user who is watching the multimedia file at present, in the playing process of the multimedia file, when the target user wants to adjust the playing progress, the target user can send out simple audio such as 'Eyah', and the like, and the terminal collects audio data sent out by the target user through equipment such as a microphone.
202. Tone data is extracted from the audio data.
The pitch is the frequency of the sound, and is one of subjective attributes of the sound. The pitch is mainly determined by the frequency of the sound, and a higher frequency of the sound indicates a higher pitch, and a lower frequency of the sound indicates a lower pitch.
203. And determining the pitch variation trend of the target user according to the pitch data.
The pitch variation trend includes pitch rising, pitch falling, and the like.
204. And adjusting the progress bar of the multimedia file according to the tone variation trend of the target user.
The progress bar of the multimedia file is used for representing the processing progress of the multimedia file, and the played proportion, the current playing position, the non-played proportion and the like of the multimedia file can be obtained based on the progress bar.
The method provided by the embodiment of the disclosure adjusts the progress bar of the multimedia file based on the pitch variation trend. In the acoustic field, the tone is usually used for representing the height of the sound frequency, a user does not need to speak specific voice content, only needs to send out simple audio, and for users of different languages, a grammar database corresponding to different languages does not need to be constructed, so that the adjustment cost of the progress bar is greatly reduced.
All the above optional technical solutions may be combined arbitrarily to form the optional embodiments of the present disclosure, and are not described herein again.
Based on the implementation environment shown in fig. 1, an embodiment of the present disclosure provides a method for adjusting a progress bar, taking a terminal to execute the embodiment of the present disclosure as an example, referring to fig. 3, a flow of the method for adjusting a progress bar includes:
301. and the terminal plays the multimedia file.
In the embodiment of the present disclosure, a playing application of a multimedia file is installed in the terminal, and the terminal plays the multimedia file based on the installed playing application of the multimedia file. The playing application of the multimedia file can be any one of an audio playing application, a video playing application, an image playing application and the like.
In the process of playing the multimedia file, in order to facilitate the user to obtain the current playing progress, the terminal may display a progress bar of the multimedia file on the playing interface. The progress bar of the multimedia file can be displayed in the whole process of playing the multimedia file, and can also be displayed when the triggering operation of a user is detected, and the progress bar is in a hidden state at other time.
302. And in the playing process of the multimedia file, the terminal acquires the audio data of the target user.
In the process of playing the multimedia file, if the target user wants to review the previously played content or view the content which is not played at the back, the target user can send babble, phi, or other simple audio data, the terminal collects the audio data sent by the target user through a microphone or other equipment, and then the progress bar of the multimedia file is adjusted based on the collected audio data. When the terminal collects the audio data of the target user, the audio data can be collected every first preset time period, and the audio data can also be collected in real time. Wherein, the first preset time period may be 1 second, 2 seconds, etc.
Considering that there may be multiple users in the playing scene of the multimedia file, the terminal may collect audio data sent by a target user, audio data sent by other users, and audio data of the played multimedia file, and the audio data of the multimedia file and the audio data sent by other users are noise data for the terminal, and are not effective data for adjusting the progress bar. In order to eliminate the interference generated by these data, in one possible implementation, when the target user wants to adjust the progress bar, the terminal may prompt the user to wear the earphone device, and in the case that the target user wears the earphone device, the terminal collects the audio data of the target user. In another possible implementation manner, the terminal may collect audio data of a target user in advance, extract audio features of the target user from the collected audio data, and further store the audio features of the target user. In a multimedia file playing scene, a terminal collects audio data of at least one user, extracts at least one audio feature from the collected audio data, further matches the extracted at least one audio feature with stored audio features respectively, and if any audio feature is matched with the stored audio features, the user corresponding to the matched audio feature is taken as a target user and continues to collect the audio data of the target user.
Further, when the terminal collects the audio data of the target user, the volume of the audio data can be obtained, so that the adjustment proportion of the progress bar can be determined according to the volume of the audio data in the subsequent steps, and the progress bar can be adjusted according to the adjustment proportion.
303. The terminal extracts tone data from the audio data.
And analyzing the audio data by the terminal based on the acquired audio data to obtain tone data. The pitch data includes pitch value, acquisition time, and the like. Wherein, the pitch value can be represented by F, and the acquisition time can be represented by t.
304. And the terminal determines the pitch variation trend of the target user according to the pitch data.
In one embodiment of the present disclosure, the terminal may determine a pitch variation trend of the target user based on the pitch value size. If the pitch value at the previous time is less than the pitch value at the subsequent time, it may be determined that the pitch variation tendency of the target user is an ascending pitch, and if the pitch value at the previous time is greater than the pitch value at the subsequent time, it may be determined that the pitch variation tendency of the target user is a descending pitch. For example, if the pitch value of the pitch data extracted from the collected audio data by the terminal at the initial time is 20 and the pitch value of the pitch data extracted from the collected audio data by the terminal at 1 second is 30, it is possible to determine that the pitch variation tendency of the target user is an up-pitch.
In addition, in consideration of the fact that the audio data may suddenly change due to external interference or other factors, so that the tone may suddenly change at a certain time, in order to improve the accuracy of the adjustment result, the method provided by the embodiment of the disclosure may count the change trend of the tone in the second preset time period, and further take the change trend in the second preset time period as the tone change trend of the target user. The second preset time period may be 1 second, 2 seconds, and the like, and the second preset time period is not specifically limited in the embodiments of the present disclosure.
In another embodiment of the present disclosure, the terminal may construct a rectangular coordinate system with the pitch value as a vertical coordinate and the collection time as a horizontal coordinate according to the pitch value and the collection time in the pitch data collected every first preset time period, draw a pitch curve in the constructed rectangular coordinate system, and further determine a pitch variation trend of the target user according to an instantaneous tangential slope of the pitch curve. For the instantaneous tangent slope of the pitch curve, the terminal can calculate the pitch value and the acquisition time of two adjacent sampling points, calculate the tangent slope of the two adjacent sampling points, and then take the slope of the two adjacent sampling points as the instantaneous tangent slope. If the instantaneous tangential slope is a positive value, the pitch change tendency of the target user may be determined as rising pitch, and if the instantaneous tangential slope is a negative value, the pitch change tendency of the target user may be determined as falling pitch.
305. And the terminal adjusts the progress bar of the multimedia file according to the tone variation trend of the target user.
And the terminal determines the adjustment direction of the progress bar of the multimedia according to the tone variation trend of the target user, and then adjusts the progress bar according to the adjustment direction. The adjusting direction comprises a first direction and a second direction, the first direction is a direction for skipping the currently played content on the progress bar to the unplayed content, and the second direction is a direction for skipping the currently played content on the progress bar to the played content. The first direction and the second direction are determined according to the display position of the progress bar on the playing interface, and if the display direction of the progress bar is a horizontal direction, for example, the display direction is displayed on the upper side or the lower side of the playing interface, the first direction may be rightward, and the second direction may be leftward; if the display direction of the progress bar is a vertical direction, for example, the progress bar is displayed on the left or right side of the playing interface, the first direction is downward, and the second direction is upward. Specifically, if the pitch variation trend of the target user is rising, the terminal slides an icon on the progress bar for indicating the current playing position to a first direction; and if the tone variation trend of the target user is pitch reduction, the terminal slides the icon used for indicating the current playing position on the progress bar to a second direction.
In another embodiment of the present disclosure, as the acquisition time increases, the pitch data of the target user may change, and as the pitch data changes, the pitch trend will change, and accordingly, the adjustment direction will change. For example, if the pitch variation tendency of the target user is changed from an up-pitch to a down-pitch, the terminal switches the adjustment direction of the progress bar from the first direction to the second direction in response to the change of the pitch; if the pitch variation tendency of the target user is changed from a down pitch to an up pitch, the terminal switches the adjustment direction of the progress bar from the second direction to the first direction in response to the change of the pitch.
In another embodiment of the present disclosure, the terminal determines an adjustment direction of the progress bar, determines an adjustment ratio of the progress bar, and adjusts the progress bar according to the determined adjustment direction and adjustment ratio. For example, the terminal determines that the adjustment direction is a right direction and the adjustment ratio is 5% of the length of the progress bar, and then according to the determined adjustment direction and adjustment ratio, the terminal moves the icon for indicating the current play position to the right by 5% of the length of the progress bar, thereby adjusting the progress bar.
When the terminal determines the adjustment ratio of the progress bar, the method includes, but is not limited to, the following modes:
in a possible implementation manner, the terminal determines the adjustment proportion of the progress bar according to the absolute value of the slope of the instantaneous tangent. The terminal can preset the corresponding relation between the absolute value of the instantaneous tangent slope and the adjustment proportion, and based on the set corresponding relation, when the absolute value of the instantaneous tangent slope is obtained, the terminal obtains the adjustment proportion corresponding to the absolute value of the instantaneous tangent slope. Generally, the larger the absolute value of the slope of the instantaneous tangent line, the larger the adjustment proportion of the progress bar; the smaller the absolute value of the instantaneous tangent slope, the smaller the adjustment ratio of the progress bar. If the absolute value of the instantaneous tangent slope is 0, the pitch at this time is a flat pitch, and the adjustment ratio of the progress bar is also 0. In response to the adjustment ratio of the progress bar being 0, the progress bar will stop sliding.
In another possible implementation manner, the terminal determines the adjustment proportion of the progress bar according to the volume value corresponding to the tone data. The terminal may preset a correspondence between the volume value and the adjustment ratio, and based on the set correspondence, when the volume value corresponding to the tone data is obtained, the terminal obtains the adjustment ratio corresponding to the volume value.
According to the method provided by the embodiment of the disclosure, the user sends out simple audio data in real time, and the tone data is extracted, so that the progress bar is adjusted. If the user stops sending the audio data, the terminal cannot acquire the audio data, the tone curve is cut off, and the progress bar stops sliding.
In another embodiment of the present disclosure, in adjusting the progress bar, if an icon on the progress bar for indicating the current progress of playing has slid to an end position on either side of the progress bar, the currently playing multimedia file is switched to the previous multimedia file or the next multimedia file. For example, if the icon on the progress bar for indicating the current playing progress has slid to the left side to the starting position, the currently playing multimedia file is switched to the previous multimedia file. For another example, if the icon on the progress bar indicating the current playing progress has been slid to the right to the end position, the currently playing multimedia file is switched to the next multimedia file.
The method provided by the embodiment of the disclosure adjusts the progress bar of the multimedia file based on the pitch variation trend. In the acoustic field, the tone is usually used for representing the height of the sound frequency, a user does not need to speak specific voice content, only needs to send out simple audio, and for users of different languages, a grammar database corresponding to different languages does not need to be constructed, so that the adjustment cost of the progress bar is greatly reduced.
The embodiment of the present disclosure provides a device for adjusting a progress bar, and referring to fig. 4, a flow of a method for adjusting a progress bar includes:
the acquisition module 401 is configured to acquire audio data of a target user during a playing process of a multimedia file;
an extraction module 402 for extracting tonal data from the audio data;
a determining module 403, configured to determine a pitch variation trend of the target user according to the pitch data;
and the adjusting module 404 is configured to adjust the progress bar of the multimedia file according to the pitch variation trend of the target user.
In another possible implementation manner, the determining module 403 is configured to draw a pitch curve according to the pitch value and the acquisition time in the pitch data; and determining the pitch variation trend of the target user according to the instantaneous tangent slope of the pitch curve.
In another possible implementation manner, the determining module 403 is configured to determine that the pitch variation trend of the target user is an ascending pitch if the instantaneous tangent slope is a positive value; and if the instantaneous tangent slope is a negative value, determining the pitch change trend of the target user to be pitch reduction.
In another possible implementation manner, the adjusting module 404 is configured to adjust the progress bar in a first direction if the pitch variation trend of the target user is pitch increase, where the first direction is a direction in which currently played content on the progress bar jumps to unplayed content; and if the pitch variation trend of the target user is pitch reduction, adjusting the progress bar in a second direction, wherein the second direction is a direction for skipping the currently played content on the progress bar to the played content.
In another possible implementation manner, the apparatus further includes:
the switching module is used for switching the adjusting direction of the progress bar from a first direction to a second direction if the pitch variation trend of the target user is changed from rising pitch to falling pitch;
and the switching module is further used for switching the adjusting direction of the progress bar from the second direction to the first direction if the pitch variation trend of the target user is changed from descending pitch to ascending pitch.
In another possible implementation form of the method,
a determining module 403, configured to determine an adjustment ratio of the progress bar;
the adjusting module 404 is further configured to adjust the progress bar according to the adjustment ratio.
In another possible implementation manner, the determining module 403 is configured to determine the adjustment distance to the progress bar according to an absolute value of the instantaneous tangent slope.
In another possible implementation manner, the determining module 403 is configured to determine an adjustment ratio of the progress bar according to a volume value corresponding to the tone data.
The device provided by the embodiment of the disclosure adjusts the progress bar of the multimedia file based on the tone variation trend. In the acoustic field, the tone is usually used for representing the height of the sound frequency, a user does not need to speak specific voice content, only needs to send out simple audio, and for users of different languages, a grammar database corresponding to different languages does not need to be constructed, so that the adjustment cost of the progress bar is greatly reduced.
Fig. 5 shows a block diagram of a terminal 500 according to an exemplary embodiment of the present disclosure. The terminal 500 may be: a smart phone, a tablet computer, an MP3 player (Moving Picture Experts Group Audio Layer III, motion video Experts compression standard Audio Layer 3), an MP4 player (Moving Picture Experts Group Audio Layer IV, motion video Experts compression standard Audio Layer 4), a notebook computer, or a desktop computer. Terminal 500 may also be referred to by other names such as user equipment, portable terminal, laptop terminal, desktop terminal, and the like.
In general, the terminal 500 includes: a processor 501 and a memory 502.
The processor 501 may include one or more processing cores, such as a 4-core processor, an 8-core processor, and so on. The processor 501 may be implemented in at least one hardware form of a DSP (Digital Signal Processing), an FPGA (Field-Programmable Gate Array), and a PLA (Programmable Logic Array). The processor 501 may also include a main processor and a coprocessor, where the main processor is a processor for Processing data in an awake state, and is also called a Central Processing Unit (CPU); a coprocessor is a low power processor for processing data in a standby state. In some embodiments, the processor 501 may be integrated with a GPU (Graphics Processing Unit), which is responsible for rendering and drawing the content required to be displayed by the display screen. In some embodiments, processor 501 may also include an AI (Artificial Intelligence) processor for processing computational operations related to machine learning.
In some embodiments, the terminal 500 may further optionally include: a peripheral interface 503 and at least one peripheral. The processor 501, memory 502 and peripheral interface 503 may be connected by a bus or signal lines. Each peripheral may be connected to the peripheral interface 503 by a bus, signal line, or circuit board. Specifically, the peripheral device includes: at least one of radio frequency circuitry 504, display screen 505, camera assembly 506, audio circuitry 507, positioning assembly 508, and power supply 509.
Those skilled in the art will appreciate that the configuration shown in fig. 5 is not intended to be limiting of terminal 500 and may include more or fewer components than those shown, or some components may be combined, or a different arrangement of components may be used.
The embodiment of the present disclosure provides a computer-readable storage medium, in which at least one program code is stored, and the at least one program code is loaded and executed by a processor to implement the method for adjusting a progress bar as shown in fig. 2 or fig. 3. The computer readable storage medium may be non-transitory. For example, the computer-readable storage medium may be a Read-Only Memory (ROM), a Random Access Memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.
It will be understood by those skilled in the art that all or part of the steps for implementing the above embodiments may be implemented by hardware, or may be implemented by a program instructing relevant hardware, where the program may be stored in a computer-readable storage medium, and the above-mentioned storage medium may be a read-only memory, a magnetic disk or an optical disk, etc.
The above description is intended to be exemplary only and not to limit the present disclosure, and any modification, equivalent replacement, or improvement made without departing from the spirit and scope of the present disclosure is to be considered as the same as the present disclosure.
Claims (11)
1. A method of adjusting a progress bar, the method comprising:
collecting audio data of a target user in the playing process of the multimedia file;
extracting pitch data from the audio data;
determining a pitch variation trend of the target user according to the pitch data;
and adjusting the progress bar of the multimedia file according to the tone variation trend of the target user.
2. The method of claim 1, wherein determining a pitch trend of the target user from the pitch data comprises:
drawing a tone curve according to the tone value and the acquisition time in the tone data;
and determining the pitch variation trend of the target user according to the instantaneous tangent slope of the pitch curve.
3. The method of claim 2, wherein said determining a pitch trend of said target user based on an instantaneous tangent slope of said pitch curve comprises:
if the instantaneous tangent slope is a positive value, determining the pitch change trend of the target user to be rising pitch;
and if the instantaneous tangent slope is a negative value, determining the pitch variation trend of the target user to be pitch reduction.
4. The method of claim 1, wherein the adjusting the progress bar of the multimedia file according to the pitch variation trend of the target user comprises:
if the pitch variation trend of the target user is rising, adjusting the progress bar to a first direction, wherein the first direction is a direction for skipping the currently played content on the progress bar to the unplayed content;
and if the pitch variation trend of the target user is pitch reduction, adjusting the progress bar to a second direction, wherein the second direction is a direction for skipping the currently played content on the progress bar to the played content.
5. The method of claim 4, wherein after the adjusting the progress bar of the multimedia file according to the pitch variation trend of the target user, further comprising:
if the pitch variation trend of the target user is changed from rising pitch to falling pitch, switching the adjustment direction of the progress bar from the first direction to the second direction;
and if the pitch variation trend of the target user is changed from descending pitch to ascending pitch, switching the adjustment direction of the progress bar from the second direction to the first direction.
6. The method according to any one of claims 2 to 5, further comprising:
determining an adjustment ratio of the progress bar;
and adjusting the progress bar according to the adjusting proportion.
7. The method of claim 6, wherein the determining the adjustment ratio to the progress bar comprises:
and determining the adjustment distance of the progress bar according to the absolute value of the slope of the instantaneous tangent.
8. The method of claim 6, wherein the determining the adjustment ratio to the progress bar comprises:
and determining the adjustment proportion of the progress bar according to the volume value corresponding to the tone data.
9. An apparatus for adjusting a progress bar, the apparatus comprising:
the acquisition module is used for acquiring audio data of a target user in the playing process of the multimedia file;
an extraction module for extracting tonal data from the audio data;
the determining module is used for determining the pitch variation trend of the target user according to the pitch data;
and the adjusting module is used for adjusting the progress bar of the multimedia file according to the tone variation trend of the target user.
10. A terminal characterized in that it comprises a processor and a memory, in which at least one program code is stored, which is loaded and executed by the processor to implement the method of adjustment of a progress bar according to any one of claims 1 to 8.
11. A computer-readable storage medium, wherein at least one program code is stored in the storage medium, and the at least one program code is loaded and executed by a processor to implement the method of adjusting a progress bar according to any one of claims 1 to 8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011455481.7A CN112614516B (en) | 2020-12-10 | 2020-12-10 | Method and device for adjusting progress bar, terminal and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011455481.7A CN112614516B (en) | 2020-12-10 | 2020-12-10 | Method and device for adjusting progress bar, terminal and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112614516A true CN112614516A (en) | 2021-04-06 |
| CN112614516B CN112614516B (en) | 2023-12-08 |
Family
ID=75233225
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011455481.7A Active CN112614516B (en) | 2020-12-10 | 2020-12-10 | Method and device for adjusting progress bar, terminal and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112614516B (en) |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104918121A (en) * | 2014-03-13 | 2015-09-16 | 阿里巴巴集团控股有限公司 | Media stream play control method and client |
| US20160089028A1 (en) * | 2014-09-25 | 2016-03-31 | Harman International Industries, Inc. | Media player automated control based on detected physiological parameters of a user |
| CN105933751A (en) * | 2016-04-28 | 2016-09-07 | 北京小米移动软件有限公司 | Method and device for adjusting play progress of media file |
| CN106412706A (en) * | 2016-09-28 | 2017-02-15 | 北京小米移动软件有限公司 | Video playing control, apparatus and device |
| CN106792212A (en) * | 2016-12-02 | 2017-05-31 | 乐视控股（北京）有限公司 | A kind of video progress adjusting method, device and electronic equipment |
| US20180060430A1 (en) * | 2009-05-27 | 2018-03-01 | Hon Hai Precision Industry Co., Ltd. | Voice command processing method and electronic device utilizing the same |
| CN110035301A (en) * | 2019-04-15 | 2019-07-19 | 钟俊强 | A kind of playback progress adjusting method based on voice control |
| CN110837333A (en) * | 2019-11-13 | 2020-02-25 | 北京无限光场科技有限公司 | Method, device, terminal and storage medium for adjusting playing progress of multimedia file |
-
2020
- 2020-12-10 CN CN202011455481.7A patent/CN112614516B/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20180060430A1 (en) * | 2009-05-27 | 2018-03-01 | Hon Hai Precision Industry Co., Ltd. | Voice command processing method and electronic device utilizing the same |
| CN104918121A (en) * | 2014-03-13 | 2015-09-16 | 阿里巴巴集团控股有限公司 | Media stream play control method and client |
| US20160089028A1 (en) * | 2014-09-25 | 2016-03-31 | Harman International Industries, Inc. | Media player automated control based on detected physiological parameters of a user |
| CN105933751A (en) * | 2016-04-28 | 2016-09-07 | 北京小米移动软件有限公司 | Method and device for adjusting play progress of media file |
| CN106412706A (en) * | 2016-09-28 | 2017-02-15 | 北京小米移动软件有限公司 | Video playing control, apparatus and device |
| CN106792212A (en) * | 2016-12-02 | 2017-05-31 | 乐视控股（北京）有限公司 | A kind of video progress adjusting method, device and electronic equipment |
| CN110035301A (en) * | 2019-04-15 | 2019-07-19 | 钟俊强 | A kind of playback progress adjusting method based on voice control |
| CN110837333A (en) * | 2019-11-13 | 2020-02-25 | 北京无限光场科技有限公司 | Method, device, terminal and storage medium for adjusting playing progress of multimedia file |
Non-Patent Citations (1)
| Title |
|---|
| 成童等: "《人机交互中的系统反应时间研究》", 《人类工效学》, vol. 23, no. 5, pages 69 - 74 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112614516B (en) | 2023-12-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109388367B (en) | Sound effect adjusting method and device, electronic equipment and storage medium | |
| CN110460872B (en) | Information display method, device and equipment for live video and storage medium | |
| JP2019212308A (en) | Video service providing method and service server using the same | |
| JP4920395B2 (en) | Video summary automatic creation apparatus, method, and computer program | |
| CN101444092A (en) | Video reproduction device, video reproduction method, and video reproduction program | |
| CN108509107A (en) | Application function method for information display, device and terminal device | |
| EP3916538B1 (en) | Creating a cinematic storytelling experience using network-addressable devices | |
| US20210168460A1 (en) | Electronic device and subtitle expression method thereof | |
| CN109240641B (en) | Sound effect adjusting method and device, electronic equipment and storage medium | |
| US11511200B2 (en) | Game playing method and system based on a multimedia file | |
| CN110035318B (en) | Video playing method and device and multimedia data playing method | |
| US20210304776A1 (en) | Method and apparatus for filtering out background audio signal and storage medium | |
| CN110688518A (en) | Rhythm point determining method, device, equipment and storage medium | |
| CN104091596A (en) | Music identifying method, system and device | |
| CN111046226B (en) | Tuning method and device for music | |
| EP4184310A1 (en) | Volume recommendation method and apparatus, device and storage medium | |
| US8868419B2 (en) | Generalizing text content summary from speech content | |
| CN113301372A (en) | Live broadcast method, device, terminal and storage medium | |
| AU2024203420A1 (en) | Audio Processing For Extraction Of Variable Length Disjoint Segments From Audiovisual Content | |
| CN108491178A (en) | Information browsing method, browser and server | |
| CN105005612B (en) | A kind of acquisition methods and mobile terminal of music file | |
| CN112614516B (en) | Method and device for adjusting progress bar, terminal and storage medium | |
| CN112423019A (en) | Method and device for adjusting audio playing speed, electronic equipment and storage medium | |
| CN114786030A (en) | Anchor picture display method and device, electronic equipment and storage medium | |
| CN113535116A (en) | Audio file playing method and device, terminal and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |