CN112614516B - Method and device for adjusting progress bar, terminal and storage medium - Google Patents
Method and device for adjusting progress bar, terminal and storage medium Download PDFInfo
- Publication number
- CN112614516B CN112614516B CN202011455481.7A CN202011455481A CN112614516B CN 112614516 B CN112614516 B CN 112614516B CN 202011455481 A CN202011455481 A CN 202011455481A CN 112614516 B CN112614516 B CN 112614516B
- Authority
- CN
- China
- Prior art keywords
- tone
- progress bar
- target user
- adjusting
- determining
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 53
- 230000008859 change Effects 0.000 claims abstract description 45
- 230000008569 process Effects 0.000 claims abstract description 13
- 230000000630 rising effect Effects 0.000 claims description 10
- 230000009191 jumping Effects 0.000 claims description 8
- 230000001174 ascending effect Effects 0.000 claims description 6
- 238000000605 extraction Methods 0.000 claims description 3
- 238000012545 processing Methods 0.000 description 8
- 230000002093 peripheral effect Effects 0.000 description 6
- 230000006835 compression Effects 0.000 description 4
- 238000007906 compression Methods 0.000 description 4
- 239000000284 extract Substances 0.000 description 4
- 238000010586 diagram Methods 0.000 description 3
- 230000004044 response Effects 0.000 description 3
- 238000005070 sampling Methods 0.000 description 3
- 238000013473 artificial intelligence Methods 0.000 description 2
- 230000003247 decreasing effect Effects 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 238000009877 rendering Methods 0.000 description 2
- 238000012552 review Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 238000010801 machine learning Methods 0.000 description 1
- 230000005055 memory storage Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 230000001105 regulatory effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
- G10L25/90—Pitch determination of speech signals
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
- G10L25/48—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
- H04N21/47217—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for controlling playback functions for recorded or on-demand content, e.g. using progress bars, mode or play-point indicators or bookmarks
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Human Computer Interaction (AREA)
- Multimedia (AREA)
- Computational Linguistics (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Databases & Information Systems (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The disclosure provides a method, a device, a terminal and a storage medium for adjusting a progress bar, and belongs to the technical field of electronics. The method comprises the following steps: collecting audio data of a target user in the playing process of the multimedia file; extracting tone data from the audio data; according to the tone data, determining the tone change trend of the target user; and adjusting the progress bar of the multimedia file according to the tone change trend of the target user. The present disclosure adjusts progress bars of multimedia files based on pitch variation trends. In the acoustic field, the tone is usually used for representing the sound frequency, a user does not need to say specific voice content, only needs to send out simple audio, and for users in different languages, grammar databases corresponding to different languages do not need to be constructed, so that the adjustment cost of a progress bar is greatly reduced.
Description
Technical Field
The disclosure relates to the field of electronic technology, and in particular, to a method, a device, a terminal and a storage medium for adjusting a progress bar.
Background
During the playing of the multimedia file, if the user wants to review the previously played content, or view the later un-played content, adjustments to the progress bar are required.
At present, when the related technology adjusts the progress bar, the following method is mainly adopted: receiving a voice signal sent by a user; analyzing the voice signal to obtain corresponding text content; searching a regulating instruction corresponding to the text content from a grammar database; the progress bar is adjusted based on the adjustment instruction.
However, considering that there are differences between different languages, in order to implement adjustment of the progress bar, grammar databases of different languages need to be constructed, which increases adjustment cost of the progress bar.
Disclosure of Invention
The embodiment of the disclosure provides a method, a device, a terminal and a storage medium for adjusting a progress bar, which can reduce the adjustment cost of the progress bar. The technical scheme is as follows:
according to a first aspect of embodiments of the present disclosure, there is provided a method for adjusting a progress bar, the method including:
collecting audio data of a target user in the playing process of the multimedia file;
extracting tonal data from the audio data;
according to the tone data, determining the tone change trend of the target user;
and adjusting the progress bar of the multimedia file according to the tone change trend of the target user.
In another possible implementation manner, the determining the tone variation trend of the target user according to the tone data includes:
according to the tone value and the acquisition time in the tone data, a tone curve is drawn;
and determining the tone variation trend of the target user according to the instantaneous tangent slope of the tone curve.
In another possible implementation manner, the determining the pitch variation trend of the target user according to the instantaneous tangential slope of the pitch curve includes:
if the instantaneous tangent slope is a positive value, determining that the tone variation trend of the target user is an ascending tone;
and if the instantaneous tangent slope is a negative value, determining that the tone change trend of the target user is a descending tone.
In another possible implementation manner, the adjusting the progress bar of the multimedia file according to the tone variation trend of the target user includes:
if the tone change trend of the target user is rising, adjusting the progress bar in a first direction, wherein the first direction is a direction for jumping the current playing content on the progress bar to the non-playing content;
and if the tone change trend of the target user is tone decrease, adjusting the progress bar in a second direction, wherein the second direction is a direction for jumping the currently played content on the progress bar to the played content.
In another possible implementation manner, after the adjusting the progress bar of the multimedia file according to the tone variation trend of the target user, the method further includes:
if the tone change trend of the target user is changed from rising tone to falling tone, switching the adjustment direction of the progress bar from the first direction to the second direction;
and if the tone change trend of the target user is changed from descending tone to ascending tone, switching the adjusting direction of the progress bar from the second direction to the first direction.
In another possible implementation, the method further includes:
determining an adjustment ratio of the progress bar;
and adjusting the progress bar according to the adjustment proportion.
In another possible implementation manner, the determining the adjustment ratio of the progress bar includes:
and determining the adjustment distance of the progress bar according to the absolute value of the instantaneous tangent slope.
In another possible implementation manner, the determining the adjustment ratio of the progress bar includes:
and determining the adjustment proportion of the progress bar according to the volume value corresponding to the tone data.
According to a second aspect of embodiments of the present disclosure, there is provided an adjustment device for a progress bar, the device including:
the acquisition module is used for acquiring the audio data of the target user in the playing process of the multimedia file;
an extraction module for extracting tonal data from the audio data;
the determining module is used for determining the tone change trend of the target user according to the tone data;
and the adjusting module is used for adjusting the progress bar of the multimedia file according to the tone change trend of the target user.
In another possible implementation manner, the determining module is configured to draw a pitch curve according to a pitch value and an acquisition time in the pitch data; and determining the tone variation trend of the target user according to the instantaneous tangent slope of the tone curve.
In another possible implementation manner, the determining module is configured to determine that the pitch variation trend of the target user is an up-tone if the instantaneous tangential slope is a positive value; and if the instantaneous tangent slope is a negative value, determining that the tone change trend of the target user is a descending tone.
In another possible implementation manner, the adjusting module is configured to adjust the progress bar to a first direction if the pitch variation trend of the target user is rising, where the first direction is a direction in which the currently played content on the progress bar is jumped to the unreflected content; and if the tone change trend of the target user is tone decrease, adjusting the progress bar in a second direction, wherein the second direction is a direction for jumping the currently played content on the progress bar to the played content.
In another possible implementation, the apparatus further includes:
a switching module, configured to switch an adjustment direction of the progress bar from the first direction to the second direction if a tone change trend of the target user changes from an up tone to a down tone;
the switching module is further configured to switch the adjustment direction of the progress bar from the second direction to the first direction if the tone change trend of the target user changes from a decreasing tone to an increasing tone.
In another possible implementation form of the present application,
the determining module is further used for determining the adjustment proportion of the progress bar;
the adjusting module is further used for adjusting the progress bar according to the adjusting proportion.
In another possible implementation manner, the determining module is configured to determine the adjustment distance to the progress bar according to the absolute value of the instantaneous tangential slope.
In another possible implementation manner, the determining module is configured to determine an adjustment ratio of the progress bar according to a volume value size corresponding to the tone data.
According to a third aspect of embodiments of the present disclosure, there is provided a terminal, the terminal including a processor and a memory, the memory storing at least one program code, the at least one program code being loaded and executed by the processor to implement the method for adjusting a progress bar according to the first aspect.
According to a fourth aspect of embodiments of the present disclosure, there is provided a computer readable storage medium having stored therein at least one program code loaded and executed by a processor to implement the method for adjusting a progress bar according to the first aspect.
The technical scheme provided by the embodiment of the disclosure has the beneficial effects that:
the progress bar of the multimedia file is adjusted based on the tone variation trend. In the acoustic field, the tone is usually used for representing the sound frequency, a user does not need to say specific voice content, only needs to send out simple audio, and for users in different languages, grammar databases corresponding to different languages do not need to be constructed, so that the adjustment cost of a progress bar is greatly reduced.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present disclosure, the drawings required for the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present disclosure, and other drawings may be obtained according to these drawings without inventive effort for a person of ordinary skill in the art.
FIG. 1 is an implementation environment for a method of adjusting a progress bar provided by embodiments of the present disclosure;
FIG. 2 is a flow chart of a method for adjusting a progress bar provided by an embodiment of the present disclosure;
FIG. 3 is a flow chart of a method for adjusting a progress bar provided by an embodiment of the present disclosure;
fig. 4 is a schematic structural diagram of an adjusting device for a progress bar according to an embodiment of the present disclosure;
fig. 5 shows a block diagram of a terminal provided by an exemplary embodiment of the present disclosure.
Detailed Description
For the purposes of clarity, technical solutions and advantages of the present disclosure, the following further details the embodiments of the present disclosure with reference to the accompanying drawings.
It will be understood that the terms "each," "plurality," and "any" as used in this disclosure, including two or more, each refer to each of the corresponding plurality, and any one refers to any one of the corresponding plurality. For example, the plurality of words includes 10 words, and each word refers to each of the 10 words, and any word refers to any one of the 10 words.
Referring to fig. 1, an implementation environment related to a method for adjusting a progress bar according to an embodiment of the disclosure is shown, where the implementation environment includes: a terminal 101 and a server 102.
The terminal 101 may be a smart phone, a tablet computer, a notebook computer, MP3 (Moving Picture Experts Group Audio Layer III, moving picture experts compression standard audio layer 3), MP4 (Moving Picture Experts Group Audio Layer IV, moving picture experts compression standard audio layer 4), etc. The terminal 101 has a multimedia file playing application installed therein, and the terminal 101 is capable of playing the multimedia file based on the installed multimedia file playing application. In the process of playing the multimedia file, the terminal 101 may display the playing progress of the multimedia file, so that the user knows the playing condition of the multimedia file. The terminal 101 may also collect audio data of the user, and extract tone data from the audio data, so as to implement adjustment of a progress bar of the multimedia file according to a tone variation trend.
The server 102 is a background server of a play application of the multimedia file installed in the terminal 101, and the server 102 may provide a play service of the multimedia file. The server 102 may be an independent physical server, or may be a server cluster or a distributed system formed by a plurality of physical servers, and the type of the server 102 is not specifically limited in the embodiments of the present disclosure.
The terminal 101 and the server 102 may be directly or indirectly connected through wired or wireless communication, which is not specifically limited in the implementation of the present disclosure.
Based on the implementation environment shown in fig. 1, an embodiment of the present disclosure provides a method for adjusting a progress bar, referring to fig. 2, a flow of the method for adjusting a progress bar includes:
201. and collecting the audio data of the target user in the playing process of the multimedia file.
Wherein the multimedia files include audio files, video files, picture files, text files, or other types of files. The target user is a user currently watching the multimedia file, and in the playing process of the multimedia file, when the target user wants to adjust the playing progress, the target user can send out simple audio such as Eyao, and the terminal collects audio data sent by the target user through a microphone and other devices.
202. Tone data is extracted from the audio data.
The tone refers to the frequency of the sound, and is one of subjective attributes of the sound. The pitch is mainly determined by the frequency of the sound, the higher the pitch, the lower the frequency of the sound, the lower the pitch.
203. And determining the tone variation trend of the target user according to the tone data.
Wherein, the tone variation trend comprises rising tone, falling tone and the like.
204. And adjusting the progress bar of the multimedia file according to the tone change trend of the target user.
The progress bar of the multimedia file is used for indicating the processing progress of the multimedia file, and based on the progress bar, the played proportion, the current playing position, the un-played proportion and the like of the multimedia file can be known.
The method provided by the embodiment of the disclosure adjusts the progress bar of the multimedia file based on the tone variation trend. In the acoustic field, the tone is usually used for representing the sound frequency, a user does not need to say specific voice content, only needs to send out simple audio, and for users in different languages, grammar databases corresponding to different languages do not need to be constructed, so that the adjustment cost of a progress bar is greatly reduced.
Any combination of the above-mentioned optional solutions may be adopted to form an optional embodiment of the present disclosure, which is not described herein in detail.
Based on the implementation environment shown in fig. 1, the embodiment of the present disclosure provides a method for adjusting a progress bar, taking a terminal executing the embodiment of the present disclosure as an example, referring to fig. 3, the flow of the method for adjusting a progress bar includes:
301. the terminal plays the multimedia file.
In the embodiment of the disclosure, a playing application of the multimedia file is installed in the terminal, and the terminal plays the multimedia file based on the installed playing application of the multimedia file. The playing application of the multimedia file may be any one of an audio playing application, a video playing application, an image playing application, and the like.
In the playing process of the multimedia file, in order to facilitate the user to obtain the current playing progress, the terminal may display a progress bar of the multimedia file on the playing interface. The progress bar of the multimedia file can be displayed in the whole process of playing the multimedia file, and can also be displayed when the triggering operation of a user is detected, and other time is in a hidden state, wherein the triggering operation can be click operation, long-press operation, touch operation and the like on a designated area, and the designated area is a preset area for triggering the progress bar to display.
302. In the playing process of the multimedia file, the terminal collects audio data of a target user.
In the playing process of the multimedia file, if the target user wants to review the content which is played before or watch the content which is not played after, the target user can send out simple audio data such as Eyama, amara and the like, the terminal collects the audio data sent by the target user through a microphone and other equipment, and then based on the collected audio data, the adjustment of the progress bar of the multimedia file is achieved. The terminal can collect the audio data of the target user at intervals of a first preset time period and can also collect the audio data in real time. The first preset time period may be 1 second, 2 seconds, or the like.
In consideration of the fact that a plurality of users possibly exist in a playing scene of the multimedia file, the terminal can collect audio data sent by a target user, can collect audio data sent by other users, and can collect audio data of the played multimedia file. In order to eliminate the interference caused by these data, in one possible implementation, when the target user wants to adjust the progress bar, the terminal may prompt the user to wear the earphone device, where the terminal collects the audio data of the target user. In another possible implementation manner, the terminal may collect audio data of the target user in advance, extract audio features of the target user from the collected audio data, and store the audio features of the target user. In a playing scene of the multimedia file, the terminal collects audio data of at least one user, extracts at least one audio feature from the collected audio data, further respectively matches the extracted at least one audio feature with stored audio features, and if any audio feature is matched with the stored audio feature, takes the user corresponding to the matched audio feature as a target user, and continues to collect the audio data of the target user.
Further, when the terminal collects the audio data of the target user, the terminal can acquire the volume of the audio data, so that in the subsequent step, the adjustment proportion of the progress bar can be determined according to the volume of the audio data, and the progress bar is adjusted according to the adjustment proportion.
303. The terminal extracts tone data from the audio data.
Based on the acquired audio data, the terminal analyzes the audio data to obtain tone data. The tone data includes a tone value, an acquisition time, and the like. Wherein, the pitch value can be represented by F, and the acquisition time can be represented by t.
304. And the terminal determines the tone change trend of the target user according to the tone data.
In one embodiment of the present disclosure, the terminal may determine a pitch variation trend of the target user based on the pitch value size. If the pitch value of the previous time is smaller than the pitch value of the next time, the pitch change trend of the target user may be determined as an up-tone, and if the pitch value of the previous time is larger than the pitch value of the next time, the pitch change trend of the target user may be determined as a down-tone. For example, when the pitch value of the pitch data extracted from the collected audio data by the terminal at the initial time is 20 and the pitch value of the pitch data extracted from the collected audio data by the terminal at 1 second is 30, it can be determined that the pitch change tendency of the target user is rising.
In addition, considering that the audio data may be suddenly changed due to external interference or other factors, so that the tone may be suddenly changed at a certain moment, in order to improve accuracy of the adjustment result, the method provided by the embodiment of the disclosure may count a change trend of the tone in a second preset time period, and further take the change trend in the second preset time period as a tone change trend of the target user. The second preset time period may be 1 second, 2 seconds, or the like, and the embodiment of the disclosure does not specifically limit the second preset time period.
In another embodiment of the present disclosure, the terminal may construct a rectangular coordinate system with the tone value as an ordinate and the acquisition time as an abscissa according to the tone value and the acquisition time in the tone data acquired every first preset time period, and draw a tone curve in the constructed rectangular coordinate system, so as to determine a tone variation trend of the target user according to an instantaneous tangential slope of the tone curve. For the instantaneous tangent slope of the pitch curve, the terminal can calculate the pitch value and the acquisition time of two adjacent sampling points, calculate the tangent slope of the two adjacent sampling points, and then take the slope of the two adjacent sampling points as the instantaneous tangent slope. If the instantaneous tangent slope is positive, the tone variation trend of the target user can be determined to be an ascending tone, and if the instantaneous tangent slope is negative, the tone variation trend of the target user can be determined to be a descending tone.
305. And the terminal adjusts the progress bar of the multimedia file according to the tone change trend of the target user.
And the terminal determines the adjustment direction of the progress bar of the multimedia according to the tone change trend of the target user, and adjusts the progress bar according to the adjustment direction. The adjusting direction comprises a first direction and a second direction, wherein the first direction refers to a direction for jumping the current playing content on the progress bar to the non-playing content, and the second direction refers to a direction for jumping the current playing content on the progress bar to the played content. The first direction and the second direction are determined according to the display position of the progress bar on the playing interface, if the display direction of the progress bar is a horizontal direction, for example, the progress bar is displayed on the upper side or the lower side of the playing interface, the first direction may be rightward, and the second direction may be leftward; if the display direction of the progress bar is a vertical direction, for example, displayed on the left or right side of the play interface, the first direction is downward and the second direction is upward. Specifically, if the tone variation trend of the target user is rising tone, the terminal slides an icon for indicating the current playing position on the progress bar to a first direction; and if the tone change trend of the target user is tone reduction, the terminal slides an icon for indicating the current playing position on the progress bar towards a second direction.
In another embodiment of the present disclosure, as the acquisition time increases, the target user's tone data may change, and as the tone data changes, the tone trend will also change, and accordingly, the direction of adjustment will also change. For example, if the tone variation trend of the target user is changed from an up tone to a down tone, the terminal switches the adjustment direction of the progress bar from the first direction to the second direction in response to the change of the tone; if the tone variation trend of the target user is changed from a decreasing tone to an increasing tone, the terminal switches the adjustment direction of the progress bar from the second direction to the first direction in response to the change of the tone.
In another embodiment of the present disclosure, the terminal determines an adjustment ratio to the progress bar in addition to the adjustment direction to the progress bar, and adjusts the progress bar according to the determined adjustment direction and adjustment ratio. For example, if the terminal determines that the adjustment direction is the right direction and the adjustment ratio is 5% of the length of the progress bar, the terminal moves the icon for indicating the current playing position to the right by 5% of the length of the progress bar according to the determined adjustment direction and adjustment ratio, thereby realizing adjustment of the progress bar.
The terminal determines the adjustment ratio of the progress bar, including but not limited to the following ways:
in one possible implementation, the terminal determines the adjustment ratio to the progress bar according to the absolute value of the instantaneous tangential slope. The terminal can preset the corresponding relation between the absolute value of the instantaneous tangent slope and the adjusting proportion, and based on the set corresponding relation, when the absolute value of the instantaneous tangent slope is obtained, the terminal obtains the adjusting proportion corresponding to the absolute value of the instantaneous tangent slope. Generally, the larger the absolute value of the instantaneous tangent slope is, the larger the adjustment proportion of the progress bar is; the smaller the absolute value of the instantaneous tangent slope, the smaller the adjustment ratio of the progress bar. If the absolute value of the instantaneous tangential slope is 0, the pitch at this time is a flat pitch, and the adjustment ratio of the progress bar is also 0. In response to the adjustment ratio of the progress bar being 0, the progress bar will stop sliding.
In another possible implementation manner, the terminal determines the adjustment proportion of the progress bar according to the volume value corresponding to the tone data. The terminal may preset a correspondence between the volume value and the adjustment ratio, and based on the set correspondence, when acquiring the volume value corresponding to the tone data, the terminal acquires the adjustment ratio corresponding to the volume value.
According to the method provided by the embodiment of the disclosure, the user sends out simple audio data in real time, and the tone data are extracted, so that the adjustment of the progress bar is realized. If the user stops sending out audio data, the terminal cannot collect the audio data, the tone curve is truncated, and the progress bar stops sliding.
In another embodiment of the present disclosure, when the progress bar is adjusted, if an icon on the progress bar for indicating the current playing progress has been slid to an end point position on either side of the progress bar, the currently played multimedia file is switched to the last multimedia file or the next multimedia file. For example, if the icon on the progress bar for indicating the current playing progress has been slid to the left to the start position, the currently played multimedia file is switched to the last multimedia file. For another example, if the icon on the progress bar for indicating the current playing progress has been slid to the right to the end position, the currently played multimedia file is switched to the next multimedia file.
The method provided by the embodiment of the disclosure adjusts the progress bar of the multimedia file based on the tone variation trend. In the acoustic field, the tone is usually used for representing the sound frequency, a user does not need to say specific voice content, only needs to send out simple audio, and for users in different languages, grammar databases corresponding to different languages do not need to be constructed, so that the adjustment cost of a progress bar is greatly reduced.
The embodiment of the disclosure provides a device for adjusting a progress bar, referring to fig. 4, a flow of a method for adjusting the progress bar includes:
the acquisition module 401 is configured to acquire audio data of a target user during a playing process of the multimedia file;
an extraction module 402 for extracting tonal data from the audio data;
a determining module 403, configured to determine a tone variation trend of the target user according to the tone data;
and the adjusting module 404 is configured to adjust the progress bar of the multimedia file according to the tone variation trend of the target user.
In another possible implementation, the determining module 403 is configured to draw a pitch curve according to the pitch value and the acquisition time in the pitch data; and determining the tone variation trend of the target user according to the instantaneous tangent slope of the tone curve.
In another possible implementation manner, the determining module 403 is configured to determine that the pitch variation trend of the target user is an up-tone if the instantaneous tangential slope is a positive value; and if the instantaneous tangent slope is a negative value, determining that the tone change trend of the target user is a tone decrease.
In another possible implementation manner, the adjusting module 404 is configured to adjust the progress bar to a first direction if the tone variation trend of the target user is rising, where the first direction is a direction of skipping the currently played content on the progress bar to the unrevealed content; and if the tone change trend of the target user is tone decrease, adjusting the progress bar in a second direction, wherein the second direction is the direction for jumping the currently played content on the progress bar to the played content.
In another possible implementation, the apparatus further includes:
the switching module is used for switching the adjusting direction of the progress bar from the first direction to the second direction if the tone change trend of the target user is changed from rising tone to falling tone;
and the switching module is also used for switching the adjusting direction of the progress bar from the second direction to the first direction if the tone change trend of the target user is changed from the descending tone to the ascending tone.
In another possible implementation form of the present application,
a determining module 403, configured to determine an adjustment ratio of the progress bar;
the adjusting module 404 is further configured to adjust the progress bar according to the adjustment ratio.
In another possible implementation, the determining module 403 is configured to determine the adjustment distance to the progress bar according to the absolute value of the instantaneous tangential slope.
In another possible implementation manner, the determining module 403 is configured to determine the adjustment ratio of the progress bar according to the volume value size corresponding to the tone data.
The device provided by the embodiment of the disclosure adjusts the progress bar of the multimedia file based on the tone variation trend. In the acoustic field, the tone is usually used for representing the sound frequency, a user does not need to say specific voice content, only needs to send out simple audio, and for users in different languages, grammar databases corresponding to different languages do not need to be constructed, so that the adjustment cost of a progress bar is greatly reduced.
Fig. 5 shows a block diagram of a terminal 500 provided in an exemplary embodiment of the present disclosure. The terminal 500 may be: a smart phone, a tablet computer, an MP3 player (Moving Picture Experts Group Audio Layer III, motion picture expert compression standard audio plane 3), an MP4 (Moving Picture Experts Group Audio Layer IV, motion picture expert compression standard audio plane 4) player, a notebook computer, or a desktop computer. The terminal 500 may also be referred to by other names of user devices, portable terminals, laptop terminals, desktop terminals, etc.
In general, the terminal 500 includes: a processor 501 and a memory 502.
Processor 501 may include one or more processing cores, such as a 4-core processor, an 8-core processor, and the like. The processor 501 may be implemented in at least one hardware form of DSP (Digital Signal Processing ), FPGA (Field-Programmable Gate Array, field programmable gate array), PLA (Programmable Logic Array ). The processor 501 may also include a main processor and a coprocessor, the main processor being a processor for processing data in an awake state, also referred to as a CPU (Central Processing Unit ); a coprocessor is a low-power processor for processing data in a standby state. In some embodiments, the processor 501 may be integrated with a GPU (Graphics Processing Unit, image processor) for taking care of rendering and rendering of content that the display screen is required to display. In some embodiments, the processor 501 may also include an AI (Artificial Intelligence ) processor for processing computing operations related to machine learning.
Memory 502 may include one or more computer-readable storage media, which may be non-transitory. Memory 502 may also include high-speed random access memory, as well as non-volatile memory, such as one or more magnetic disk storage devices, flash memory storage devices. In some embodiments, a non-transitory computer readable storage medium in memory 502 is used to store at least one instruction for execution by processor 501 to implement the method of adjusting a progress bar provided by a method embodiment of the present application.
In some embodiments, the terminal 500 may further optionally include: a peripheral interface 503 and at least one peripheral. The processor 501, memory 502, and peripheral interface 503 may be connected by buses or signal lines. The individual peripheral devices may be connected to the peripheral device interface 503 by buses, signal lines or circuit boards. Specifically, the peripheral device includes: at least one of radio frequency circuitry 504, a display 505, a camera assembly 506, audio circuitry 507, a positioning assembly 508, and a power supply 509.
Those skilled in the art will appreciate that the structure shown in fig. 5 is not limiting and that more or fewer components than shown may be included or certain components may be combined or a different arrangement of components may be employed.
Embodiments of the present disclosure provide a computer readable storage medium having at least one program code stored therein, the at least one program code loaded and executed by a processor to implement a method of adjusting a progress bar as shown in fig. 2 or 3. The computer readable storage medium may be non-transitory. For example, the computer readable storage medium may be Read-Only Memory (ROM), random-access Memory (Random Access Memory, RAM), CD-ROM, magnetic tape, floppy disk, optical data storage device, etc.
It will be understood by those skilled in the art that all or part of the steps for implementing the above embodiments may be implemented by hardware, or may be implemented by a program for instructing relevant hardware, where the program may be stored in a computer readable storage medium, and the storage medium may be a read-only memory, a magnetic disk or an optical disk, etc.
The foregoing description of the preferred embodiments of the present disclosure is provided for the purpose of illustration only, and is not intended to limit the disclosure to the particular embodiments disclosed, but on the contrary, the intention is to cover all modifications, equivalents, alternatives, and alternatives falling within the spirit and principles of the disclosure.
Claims (11)
1. A method for adjusting a progress bar, the method comprising:
collecting audio data of a target user in the playing process of the multimedia file;
extracting tonal data from the audio data;
according to the tone data, determining the tone change trend of the target user;
and adjusting the progress bar of the multimedia file according to the tone change trend of the target user.
2. The method of claim 1, wherein said determining a trend of tone change for said target user based on said tone data comprises:
according to the tone value and the acquisition time in the tone data, a tone curve is drawn;
and determining the tone variation trend of the target user according to the instantaneous tangent slope of the tone curve.
3. The method of claim 2, wherein said determining a pitch trend of said target user based on an instantaneous tangential slope of said pitch curve comprises:
if the instantaneous tangent slope is a positive value, determining that the tone variation trend of the target user is an ascending tone;
and if the instantaneous tangent slope is a negative value, determining that the tone change trend of the target user is a descending tone.
4. The method of claim 1, wherein adjusting the progress bar of the multimedia file according to the pitch variation trend of the target user comprises:
if the tone change trend of the target user is rising, adjusting the progress bar in a first direction, wherein the first direction is a direction for jumping the current playing content on the progress bar to the non-playing content;
and if the tone change trend of the target user is tone decrease, adjusting the progress bar in a second direction, wherein the second direction is a direction for jumping the currently played content on the progress bar to the played content.
5. The method of claim 4, wherein after adjusting the progress bar of the multimedia file according to the pitch variation trend of the target user, further comprising:
if the tone change trend of the target user is changed from rising tone to falling tone, switching the adjustment direction of the progress bar from the first direction to the second direction;
and if the tone change trend of the target user is changed from descending tone to ascending tone, switching the adjusting direction of the progress bar from the second direction to the first direction.
6. The method according to any one of claims 2 to 5, further comprising:
determining an adjustment ratio of the progress bar;
and adjusting the progress bar according to the adjustment proportion.
7. The method of claim 6, wherein the determining the adjustment ratio to the progress bar comprises:
and determining the adjustment distance of the progress bar according to the absolute value of the instantaneous tangent slope.
8. The method of claim 6, wherein the determining the adjustment ratio to the progress bar comprises:
and determining the adjustment proportion of the progress bar according to the volume value corresponding to the tone data.
9. An adjustment device for a progress bar, the device comprising:
the acquisition module is used for acquiring the audio data of the target user in the playing process of the multimedia file;
an extraction module for extracting tonal data from the audio data;
the determining module is used for determining the tone change trend of the target user according to the tone data;
and the adjusting module is used for adjusting the progress bar of the multimedia file according to the tone change trend of the target user.
10. A terminal comprising a processor and a memory, wherein the memory has stored therein at least one program code that is loaded and executed by the processor to implement the method of adjusting a progress bar according to any of claims 1 to 8.
11. A computer readable storage medium, characterized in that at least one program code is stored in the storage medium, which is loaded and executed by a processor to implement the method of adjusting a progress bar according to any of claims 1 to 8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011455481.7A CN112614516B (en) | 2020-12-10 | 2020-12-10 | Method and device for adjusting progress bar, terminal and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011455481.7A CN112614516B (en) | 2020-12-10 | 2020-12-10 | Method and device for adjusting progress bar, terminal and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112614516A CN112614516A (en) | 2021-04-06 |
| CN112614516B true CN112614516B (en) | 2023-12-08 |
Family
ID=75233225
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011455481.7A Active CN112614516B (en) | 2020-12-10 | 2020-12-10 | Method and device for adjusting progress bar, terminal and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112614516B (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104918121A (en) * | 2014-03-13 | 2015-09-16 | 阿里巴巴集团控股有限公司 | Media stream play control method and client |
| CN105933751A (en) * | 2016-04-28 | 2016-09-07 | 北京小米移动软件有限公司 | Method and device for adjusting play progress of media file |
| CN106412706A (en) * | 2016-09-28 | 2017-02-15 | 北京小米移动软件有限公司 | Video playing control, apparatus and device |
| CN106792212A (en) * | 2016-12-02 | 2017-05-31 | 乐视控股（北京）有限公司 | A kind of video progress adjusting method, device and electronic equipment |
| CN110035301A (en) * | 2019-04-15 | 2019-07-19 | 钟俊强 | A kind of playback progress adjusting method based on voice control |
| CN110837333A (en) * | 2019-11-13 | 2020-02-25 | 北京无限光场科技有限公司 | Method, device, terminal and storage medium for adjusting playing progress of multimedia file |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20180060430A1 (en) * | 2009-05-27 | 2018-03-01 | Hon Hai Precision Industry Co., Ltd. | Voice command processing method and electronic device utilizing the same |
| US20160089028A1 (en) * | 2014-09-25 | 2016-03-31 | Harman International Industries, Inc. | Media player automated control based on detected physiological parameters of a user |
-
2020
- 2020-12-10 CN CN202011455481.7A patent/CN112614516B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104918121A (en) * | 2014-03-13 | 2015-09-16 | 阿里巴巴集团控股有限公司 | Media stream play control method and client |
| CN105933751A (en) * | 2016-04-28 | 2016-09-07 | 北京小米移动软件有限公司 | Method and device for adjusting play progress of media file |
| CN106412706A (en) * | 2016-09-28 | 2017-02-15 | 北京小米移动软件有限公司 | Video playing control, apparatus and device |
| CN106792212A (en) * | 2016-12-02 | 2017-05-31 | 乐视控股（北京）有限公司 | A kind of video progress adjusting method, device and electronic equipment |
| CN110035301A (en) * | 2019-04-15 | 2019-07-19 | 钟俊强 | A kind of playback progress adjusting method based on voice control |
| CN110837333A (en) * | 2019-11-13 | 2020-02-25 | 北京无限光场科技有限公司 | Method, device, terminal and storage medium for adjusting playing progress of multimedia file |
Non-Patent Citations (1)
| Title |
|---|
| 《人机交互中的系统反应时间研究》;成童等;《人类工效学》;第23卷(第5期);69-74 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112614516A (en) | 2021-04-06 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106782600B (en) | Scoring method and device for audio files | |
| CN112040263A (en) | Video processing method, video playing method, video processing device, video playing device, storage medium and equipment | |
| JP5948671B2 (en) | Multimedia information retrieval method and electronic device | |
| CN109147818A (en) | Acoustic feature extracting method, device, storage medium and terminal device | |
| US20210168460A1 (en) | Electronic device and subtitle expression method thereof | |
| US11511200B2 (en) | Game playing method and system based on a multimedia file | |
| CN110602624B (en) | Audio testing method and device, storage medium and electronic equipment | |
| US10783884B2 (en) | Electronic device-awakening method and apparatus, device and computer-readable storage medium | |
| EP3279809A1 (en) | Control device, control method, computer and program | |
| CN109240641B (en) | Sound effect adjusting method and device, electronic equipment and storage medium | |
| CN113485617B (en) | Animation display method and device, electronic equipment and storage medium | |
| US9563704B1 (en) | Methods, systems, and media for presenting suggestions of related media content | |
| US20210304776A1 (en) | Method and apparatus for filtering out background audio signal and storage medium | |
| CN110688518A (en) | Rhythm point determining method, device, equipment and storage medium | |
| US8868419B2 (en) | Generalizing text content summary from speech content | |
| CN113301372A (en) | Live broadcast method, device, terminal and storage medium | |
| US11775070B2 (en) | Vibration control method and system for computer device | |
| CN112752149B (en) | Live broadcast method, live broadcast device, terminal and storage medium | |
| CN114845152B (en) | Display method and device of play control, electronic equipment and storage medium | |
| CN105005612B (en) | A kind of acquisition methods and mobile terminal of music file | |
| CN112435641B (en) | Audio processing method, device, computer equipment and storage medium | |
| CN112614516B (en) | Method and device for adjusting progress bar, terminal and storage medium | |
| CN113992972A (en) | Subtitle display method and device, electronic equipment and readable storage medium | |
| CN109948155B (en) | Multi-intention selection method and device and terminal equipment | |
| CN110660376B (en) | Audio processing method, device and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |