WO2021098698A1

WO2021098698A1 - Audio playback method and terminal device

Info

Publication number: WO2021098698A1
Application number: PCT/CN2020/129628
Authority: WO
Inventors: 贾杰
Original assignee: 维沃移动通信有限公司
Priority date: 2019-11-20
Filing date: 2020-11-18
Publication date: 2021-05-27
Also published as: CN111049972B; CN111049972A

Abstract

An audio playback method and a terminal device. The method comprises: determining a volume state of the current playback content; where the volume state is an abnormal volume state, if a volume component of a terminal device has been adjusted to the maximum volume, receiving a first input from a user; in response to the first input, amplifying the audio energy of a sound signal corresponding to the playback content; and outputting a sound signal with the audio energy amplified to a loudspeaker for playing.

Description

Audio playing method and terminal equipment

Cross-references to related applications

This disclosure claims the priority of Chinese Patent Application No. 201911144547.8 filed in China on November 20, 2019, the entire content of which is incorporated herein by reference.

Technical field

The present disclosure relates to the technical field of terminal equipment, and in particular to an audio playback method and terminal equipment.

Background technique

When the terminal device plays an audio file, if the user feels that the volume is low, the volume increase button of the terminal device is used to increase the volume of the terminal device.

In related technologies, the volume increase button of the terminal device is based on the audio signal carried by the video file, audio file, etc., and is output to the speaker. Based on the audio signal and the volume level set by the user, the terminal device controls the power input to the speaker, thereby controlling the playback To adjust the volume.

However, the inventor found in the process of research that for some files with abnormal sound, such as some old video files and audio files, the sound data may be abnormal. Even after the volume component of the terminal device is adjusted to the maximum value, the sound may still be It is relatively small, which may make the user unable to hear clearly.

Summary of the invention

The embodiments of the present disclosure provide an audio playback method and terminal device to solve the problem that when the terminal device is playing an abnormal audio file in the prior art, even when the volume is adjusted to the maximum value, the sound of the played file is still too small, which may make the user unable to listen. The problem of clearing.

In order to solve the above technical problems, the present disclosure is implemented as follows:

In the first aspect, embodiments of the present disclosure also provide an audio playback method, which is applied to a terminal device, and the method includes:

Determine the volume status of the current playback content;

In the case that the volume state is the abnormal volume state, if the volume component of the terminal device has been adjusted to the maximum volume, receiving the user's first input;

In response to the first input, amplify the audio energy of the sound signal corresponding to the playback content;

The sound signal that amplifies the audio energy is output to the speaker for playback.

In the second aspect, the embodiments of the present disclosure also provide a terminal device, the terminal device including:

The determination module is used to determine the current volume status of the content being played;

A receiving module, configured to receive a user's first input if the volume component of the terminal device has been adjusted to the maximum volume when the volume state is an abnormal volume state;

An adjustment module, configured to amplify the audio energy of the sound signal corresponding to the playback content in response to the first input;

The playback module is used to output the sound signal of the amplified audio energy to the speaker for playback.

In a third aspect, the embodiments of the present disclosure also provide a terminal device. The terminal device includes a processor, a memory, and a computer program stored on the memory and capable of running on the processor. The computer program is The steps of the audio playback method described in the present disclosure are realized when the processor is executed.

In a fourth aspect, the embodiments of the present disclosure also provide a computer-readable storage medium, the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the above-mentioned audio playback method are implemented.

In the embodiment of the present disclosure, the volume state of the current playback content is determined; in the case that the volume state is the abnormal volume state, if the volume component of the terminal device has been adjusted to the maximum volume, the user's first input is received In response to the first input, the audio energy of the sound signal corresponding to the playback content is amplified; the sound signal of the amplified audio energy is output to the speaker for playback, and the volume state of the current playback content is determined to be at the volume In abnormal state and the volume component has been adjusted to the maximum volume, it can amplify the audio energy of the sound signal of the file with abnormal audio content and then input it into the speaker to increase the intensity of the sound signal input to the speaker, so that the speaker can play The sound becomes louder, which makes the user hear louder. It can gain the audio energy input to the speaker according to the user’s first input, thereby further increasing the output volume of the terminal device and satisfying the user’s need for the terminal device. Need for large output volume.

Description of the drawings

In order to explain the technical solutions of the embodiments of the present disclosure more clearly, the following will briefly introduce the drawings that need to be used in the description of the embodiments of the present disclosure. Obviously, the drawings in the following description are only some embodiments of the present disclosure. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative labor.

Figure 1 shows a flow chart of the steps of an audio playback method provided by an embodiment of the present disclosure;

Figure 2 shows a flowchart of another audio playback method provided by an embodiment of the present disclosure;

FIG. 3 shows a schematic diagram of a volume mode display interface of a terminal device according to an embodiment of the present disclosure;

FIG. 4 shows a schematic diagram of a display interface for exiting the intelligent multi-level mode provided by an embodiment of the present disclosure;

FIG. 5 shows a schematic diagram of a display interface of an equal interval upward adjustment mode provided by an embodiment of the present disclosure;

FIG. 6 shows a schematic structural diagram of a terminal device provided by an embodiment of the present disclosure;

FIG. 7 shows a flowchart of steps of a method for determining a second amplification factor provided by an embodiment of the present disclosure;

FIG. 8 shows a schematic diagram of a display interface of an adaptive up-regulation mode provided by an embodiment of the present disclosure;

FIG. 9 shows a structural block diagram of a terminal device provided by an embodiment of the present disclosure;

FIG. 10 shows a schematic diagram of the hardware structure of a terminal device provided by an embodiment of the present disclosure.

Detailed ways

The technical solutions in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the accompanying drawings in the embodiments of the present disclosure. Obviously, the described embodiments are part of the embodiments of the present disclosure, rather than all of the embodiments. Based on the embodiments in the present disclosure, all other embodiments obtained by those of ordinary skill in the art without creative work shall fall within the protection scope of the present disclosure.

It should be understood that “one embodiment” or “an embodiment” mentioned throughout the specification means that a specific feature, structure, or characteristic related to the embodiment is included in at least one embodiment of the present disclosure. Therefore, the appearances of "in one embodiment" or "in an embodiment" in various places throughout the specification do not necessarily refer to the same embodiment. In addition, these specific features, structures or characteristics can be combined in one or more embodiments in any suitable manner.

In the various embodiments of the present disclosure, it should be understood that the size of the sequence number of the following processes does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not be implemented in the present disclosure. The implementation process of the example constitutes any limitation.

Referring to FIG. 1, an embodiment of the present disclosure provides an audio playback method, which is applied to a terminal device, and the method includes:

Step 101: Determine the current volume state of the content being played.

In the embodiments of the present disclosure, due to the old file of the content to be played, the terminal device plays the audio and video data in a timely manner. Even if the volume of the playback component is adjusted to the maximum, the volume output by the speaker in the terminal device still cannot meet the actual needs of the user. . Specifically, the volume state is used to describe whether the actual playback effect of the audio file played by the terminal device achieves the expected effect. Specifically, the audio energy can be input according to the speaker input of the terminal device when the normal audio file is played and the target audio is played. The speaker input audio energy in the file determines whether the actual playback effect of the current terminal device reaches the expected effect. When the actual playback effect reaches the expected effect, it is determined that the volume state of the current playback content is the normal volume state. When the effect does not reach the expected effect, it is determined that the volume status of the current playback content is an abnormal volume status. The volume state can be the energy of the sound output by the speaker when the terminal device is playing audio content. It should be noted that when determining whether the actual playback effect achieves the expected effect, the audio energy of the ambient noise collected by the microphone can be further integrated, so that the determined volume state can take into account the environmental factors of the terminal device.

It should be noted that the current playback content may be the playback content after the audio file is played, it may also be the content after the video file is played, or the content after other files with audio data are played.

Step 102: When the volume state is the abnormal volume state, if the volume component of the terminal device has been adjusted to the maximum volume, receive a first input from the user.

In the embodiments of the present disclosure, when the audio and video data of the terminal device is generally played, the speaker output effect does not meet the needs of the user. It may be that the audio and video data files are too long, so that the player's output audio energy after reading is lower than Expected, resulting in too small speaker input. Therefore, when judging the volume terminal, it is possible to compare the speaker input audio energy when playing a normal audio file with the speaker input audio energy when playing the target audio file to determine whether the playback status of the target audio file is abnormal in volume. Or it can be determined whether the playback status of the target audio file is an abnormal volume state by comparing the audio energy input from the speaker when the target audio file is played with the audio energy of the ambient noise collected by the microphone on the terminal device.

In practical applications, if the user thinks that the playback volume of the terminal device does not meet their own needs, they will adjust the volume by adjusting the volume component of the terminal device. However, if the volume component is adjusted to the maximum, the user's needs are still not met. The first input of the user can be received through the terminal device to activate the intelligent multi-level function for volume compensation in the terminal device. Specifically, the intelligent multi-level function may specifically include an equal interval upward adjustment mode and an adaptive upward adjustment mode. When the user performs the first input in the equal-interval up-regulation mode, the volume component of the terminal device can be further increased by a fixed increment until it meets its own needs. When the user performs the first input in the adaptive up-regulation mode, the volume component of the terminal device can be further adjusted dynamically and incrementally according to the audio energy of the ambient noise. It can be understood that the first input may be in an equal interval up-regulation mode or an adaptive up-regulation mode, which is adapted to different up-regulation modes, and the actual adjusted volume value of the first input may be different. The equal-interval up-regulation mode is suitable for users to adjust the volume when the environmental noise is small, and the adaptive up-regulation mode is suitable for the environmental noises and allows the user to quickly adjust the volume to a volume that adapts to the environmental noise.

It should be noted that when the volume state is the normal volume state, the user's normal volume increase or volume decrease input is received, and the power of the speaker of the control terminal device is correspondingly increased or decreased.

Step 103: In response to the first input, amplify the audio energy of the sound signal corresponding to the playback content.

In the embodiment of the present disclosure, the user can generate a first input by performing a preset operation on the volume component, and the terminal device will add a sound signal corresponding to the playback content corresponding to the first input according to the first input of the user. Gain, so that the audio energy value of the sound information input to the speaker is further increased on the basis of the original maximum volume value of the volume component.

Step 104: Output the sound signal of the amplified audio energy to the speaker for playback.

In the embodiment of the present disclosure, the terminal device inputs audio energy to the speaker according to the sound signal that amplifies the audio energy for the playback content according to the first input of the user, so that the speaker outputs a larger volume of sound to meet the user's volume. demand.

In the embodiments of the present disclosure, when it is determined that the volume state of the current playback content is in the abnormal volume state and the volume component has been adjusted to the maximum volume, it is possible to amplify the audio energy of the sound signal of the file with abnormal audio content. Input to the speaker increases the strength of the sound signal input to the speaker, thereby increasing the sound played by the speaker, and the sound heard by the user, which meets the user's demand for a larger output volume of the terminal device.

2, an embodiment of the present disclosure provides another audio playback method, which is applied to a terminal device, and the method includes:

Step 201: Obtain a first energy value of environmental noise through the microphone of the terminal device.

In the embodiment of the present disclosure, if the terminal device is equipped with a microphone, the environmental noise of the surrounding environment of the terminal device can be collected through the microphone for a preset period of time, such as 1s or other time length collection, so as to start from the collection to the Analyze the average value of the audio energy of the collected noise audio to obtain the first energy value E1 of the noise audio.

Step 202: Obtain a second energy value of the sound signal input to the speaker.

In the embodiment of the present disclosure, while the terminal device collects environmental noise, the mean value of the audio energy input to the speaker of the terminal device is obtained, thereby obtaining the second energy value E2. It should be noted that the noise audio is different from the The sound signals are collected at the same time, and the collection time period is the same, so as to ensure the accuracy of subsequent processing.

Step 203: In a case where the ratio of the first energy value to the second energy value is greater than a preset first threshold, determine that the volume state of the playback content is an abnormal volume state.

In the embodiment of the present disclosure, the first threshold T1 can be obtained through experiments, such as using a terminal device to play sample audio files according to different input audio energy under different noise audio energy environments, and the user determines it according to the actual auditory effect. The input audio energy when the audio content of the sample audio file can be clearly identified, so that the T1 is determined according to the ratio of the current noise audio energy in the environment to the current input audio energy. If the ratio of the first energy value E1 to the second energy value E2 of the terminal device in the current environment is greater than the first threshold T1, it is determined that the user cannot clearly recognize the audio of the playback content in the current noisy environment, then it is determined The volume state of the playback content is an abnormal volume state. If the ratio of the first energy value E1 to the second energy value E2 of the terminal device in the current environment is less than or equal to the first threshold T1, it is determined that the user can clearly recognize the audio of the playback content in the current noisy environment, Then, it is determined that the volume state of the playback content is a normal volume state, and no volume gain is required.

The sample audio file may be a normal volume audio file, and the normal volume audio file is a file that meets the needs of the user when the volume of the terminal device is adjusted to the maximum when being played in a set scene.

It should be noted that steps 201 to 203 are a method of determining the abnormal volume state according to the embodiments of the present disclosure. The ratio of the environmental noise collected by the microphone of the terminal device and the energy of the sound input to the speaker can be compared with the preset first. The comparison result of a threshold determines whether the volume state of the currently played content is an abnormal volume state or an abnormal volume state.

Step 204: Obtain a first energy average value of the sound signal in a first preset time period.

Step 205: Obtain a second energy mean value of the sound signal in a second preset time period, where the end time of the second preset time period is the current time, and the second preset time period is the first preset time period. A time period after the time period, and the second preset time period and the first preset time period are adjacent time periods.

Step 206: If the ratio of the second energy average value to the target value is greater than a preset second threshold, determine that the volume state of the playback content is an abnormal volume state; wherein the target value is the first energy value And the second energy value.

In the embodiment of the present disclosure, the lengths of the first preset time period t1 and the second preset time period t2 can be set according to actual needs, such as 2s or other time lengths. The second time period t2 is the first time period after t1, for example, the first time period is 0-2s, and the second time period is 2s-4s.

It should be noted that, in the embodiment of the present disclosure, in the first time period of file playback, since there is no time period before this time period, the first preset time period when the file is played can be set to be empty. , The second time period is the first preset time period mentioned above. For example, the playing time of the file is 5 minutes and the time period is 2s, then the time period of the 0-2s playback progress is regarded as the aforementioned second preset time period, and the first preset time period corresponding to 0-2s is set to empty . The energy average value Eb of the audio energy input to the speaker is collected in the second preset time period 0-2s, and the first energy average value of the first preset time period corresponding to 0-2s is the initial energy value B0, and the initial energy value B0 is It is obtained by pre-playing normal volume audio files of different audio formats in different scenes, and then statistics.

After the playback progress reaches the second time period, such as 2-4s, the second preset time period is 2-4s, and the first preset time period is 0-2s. Then, at this time, the second energy average value of the sound signal within 2-4 s can be obtained, and the first energy average value of the sound signal within the first preset time period can also be obtained. It should be noted that the first energy average value can be determined according to the preset initial energy value B0, so as to ensure that the volume state determination process is more accurate.

In the embodiment of the present disclosure, the preset second threshold T2 can be obtained through experiments. For example, T2 can be used to play sample audio files under different input audio energies, and the sample audio files can be identified according to the user's actual hearing sense. Determined by the ratio between the audio energy and the first energy mean of the sample audio file. If the ratio between the second energy average value and the target value is greater than the preset second threshold, it is determined that the playback content is an old file, and its playback effect does not meet the user's hearing needs, then the playback content is determined The volume status of is an abnormal volume status. If the ratio between the second energy mean value and the target value is less than or equal to the preset second threshold, it is determined that the playback effect of the playback content can meet the user's hearing needs, and then it is determined that the volume state of the playback content is volume Normal state, no need for volume gain.

Wherein, the ratio between the second energy average value and the target value can be calculated by using the following formula (1):

B1=Eb/(B0+Eb) (1)

Wherein, B1 is the ratio between the second energy average value and the target value, and the target value is (B0+Eb).

If B1 is greater than T2, the aforementioned volume state is an abnormal volume state, and if B1 is less than or equal to T2, the aforementioned volume state is a normal volume state.

Step 207: If the ratio of the second energy average value to the target value is less than or equal to the preset second threshold value, determine a third energy average value according to the first energy average value and the second energy average value, and In the case that the second preset time period is changed to a third preset time period, the third energy average value is used as the target energy average value of the third preset time period, and the third preset time period Is a time period after the second preset time period, and the third preset time period and the second preset time period are adjacent time periods.

In the embodiment of the present disclosure, the first energy average value may also be dynamically updated during the use of the terminal device, so as to adapt to the change of the playing content. Specifically, when the ratio between the second average energy value and the target value is less than or equal to the preset second threshold, the first average energy value may be updated with reference to the following formula (2):

B0_new=c*B0_old+(1-c)*Eb, where 0<c<1 (2)

The B0_old refers to the first average value of energy in the first time period, the Eb refers to the second average value of energy, the B0_new refers to the updated first average value of energy, and the c is an audio energy adjustment parameter, which can be adjusted according to actual conditions. Demand setting.

For example, the second preset time period is 0-2s, the second energy average value thereof is Eb, and the first energy average value of the first preset time period corresponding to 0-2s is the initial energy value B0. Then, if B1 is calculated to be less than or equal to T2 in 0-2s, it means that the audio volume of the playback content is normal, and B0 needs to be updated according to formula (2) to obtain the above B0_new, and then use B0_new as B0 for 0-2s. After the second preset time period is changed to 2-4s, an Eb within 2-4s is obtained, and the corresponding first energy average value of the first preset time period is B0 of 0-2s after the above-mentioned update, continue the above In the calculation of formula (1), if the calculated B1 is less than or equal to T2, continue to update B0 according to formula (2).

In the case where the ratio of the second energy average value to the target value is greater than the preset second threshold value, the first energy average value in the first preset time period is continued to be used as the second energy value in the second preset time period. The first average value of energy.

As in the foregoing example, for the second preset time period of 0-2s, if the calculated B1 is greater than T2, B0 is not updated, and the initial energy value B0 continues to be the first energy average value of 0-2s. For the second preset time period of 2-4s, if the calculated B1 is greater than T2, then B0 is not updated, and the first energy mean value B0 corresponding to the first preset time period of 0-2s continues to be the first energy value B0 corresponding to 2-4s A mean value of energy. Other situations can be deduced by analogy.

It can be found that the first energy average value is not necessarily fixed, and it can be dynamically updated in real time according to different playback contents played by the user. The second energy mean value is not necessarily fixed, and it can be dynamically updated in real time according to different playback contents played by the user. Then for a file with audio data, the audio volume of some audio segments may be normal, while the audio volume of some audio segments is abnormal. Then the sound signal of the audio segment with abnormal audio volume can be compensated to make the adjustment more convenient. Accurately target abnormal audio segments in audio content.

Step 208: In the case that the volume state is the abnormal volume state and the volume component of the terminal device has been adjusted to the maximum volume, if the user triggers the volume up button, two up-regulation modes are displayed, where , The two up-regulation modes include a first up-regulation mode and a second up-regulation mode, and in the case of receiving a selection operation for any one of the two up-regulation modes, each time a volume increase button is received If the trigger operation is performed, it is determined that the first input is received.

In an embodiment of the present disclosure, referring to FIG. 3, a schematic diagram of a volume mode display interface of a terminal device is shown. When the user clicks the volume component on the outside of the terminal device to the maximum, the volume can be increased by increasing the volume of the volume component. Long press the button for a preset period of time to activate the intelligent multi-level mode for volume adjustment. The display interface of the terminal device will display the upward mode selection options including equal interval upward mode and adaptive upward mode for users to choose. After selecting any one of the up-regulation modes, the user may click the volume component of the terminal device again to perform a first input, and the first input may be a single click operation of the user or a long press operation of the user. Of course, there may be only one up-regulation mode. At this time, the user does not need to perform a selection operation for the up-regulation mode to directly determine the first input.

Further, referring to FIG. 4, if the user wants to exit the smart multi-level mode, he can click the volume down button of the volume component, so that the selection options of the smart multi-level function in the display interface are gradually exited to exit the smart multi-level mode. The intelligent multi-level function, at this time, adjust the speaker input audio volume of the terminal device back to the original maximum volume of the audio component. When the user continues to click the volume down button of the volume component, the power of the speaker is reduced to lower the speaker The volume of the playback.

Step 209: In a case where the selection operation for the first up-regulation mode is received, and a trigger operation for the volume increase button is received, the audio energy is increased according to a preset amplitude.

In the embodiment of the present disclosure, the first upward adjustment mode is an equal interval upward adjustment mode. Referring to FIG. 5, after the user selects the equal interval upward adjustment mode, each time the user clicks the volume increase button in the volume component, the speaker can be The input audio energy is increased by a fixed amount. For example, each time you click the volume increase button, you can increase the volume by 3db (decibel) or 6db. It should be noted that, in this case, every time a user clicks on the volume increase button is received, the sound signal to be input to the speaker can be gained, and the amplitude of the gain is subject to an increase of 3db or 6db.

The equal interval upward adjustment mode of the embodiment of the present disclosure has a simple adjustment strategy, and can complete the adjustment of the intensity of the sound signal of the audio data under the condition that the terminal device avoids a large amount of calculation.

Step 210: If the terminal device includes a first microphone and a second microphone, in the case of receiving a selection operation for the second up-regulation mode and receiving a trigger operation for a volume increase button, pass the first microphone The first energy value of the environmental noise is acquired, and the second energy value of the environmental noise and the audio energy value of the sound signal are acquired through the second microphone.

In the embodiment of the present disclosure, referring to FIG. 6, a schematic structural diagram of a terminal device is shown. The lower right side of the terminal device is provided with a microphone mic1, the upper left side is provided with a microphone mic2, and the lower left side is provided with a speaker. If the user selects the second up-regulation mode, that is, the adaptive up-regulation mode, collect the first energy value of the ambient noise through mic1, collect the second energy value of the ambient noise through mic2, and collect the audio of the sound signal input to the speaker energy.

Step 211: Determine a second amplification factor according to the first energy value, the second energy value, the audio energy value, and the preset first amplification factor. Wherein, the first amplification factor is an amplification factor of a volume component of the terminal device from a minimum volume to a maximum volume.

In the embodiment of the present disclosure, the second amplification factor h for gaining the input audio energy of the playback content can be specifically obtained by the following formula (3):

h=An*E1/E2 (3)

The An refers to the first amplification factor that the terminal device is adjusted up from the smallest to the largest, the E1 refers to the first energy value of mic1, the E2 refers to the second energy value of mic2, and the h refers to The updated second magnification factor. According to each first input of the user, the sound signal of the playback content is gained through the above-determined amplification coefficient.

Optionally, referring to FIG. 7, the step 211 includes:

Step 2111: Determine a first value corresponding to the first microphone according to the first energy value, the first amplification factor, and the audio energy value.

Step 2112: Determine a second value corresponding to the second microphone according to the second energy value, the first amplification factor, the audio energy value, and the preset energy attenuation factor, where the preset energy attenuation factor is the When the sound signal played by the loudspeaker reaches the second microphone, it is relative to the energy attenuation factor when the sound signal played by the loudspeaker reaches the first microphone.

Step 2113: Determine the second amplification factor according to the first value, the second value, and the first amplification factor.

In the embodiment of the present disclosure, considering that the speaker in the terminal device is playing audio, it will interfere with the audio energy of the actual environmental noise collected by the first microphone and the second microphone, so it is necessary to interfere with the first microphone and the second microphone. The energy value is corrected with the second energy value. Specifically, the first energy value can be corrected by the following formula (4) to obtain the first value, and the second energy can be corrected by the following formula (5). The value is corrected to get the second value:

e1=N+An*E (4)

e2=N+An*E*(1--a),0<a<1 (5)

The e1 refers to the first value, the e2 refers to the second value, the N refers to the audio energy value collected from environmental noise, the An is the first amplification factor, and the E refers to the input to the speaker Enter the audio energy value. The a refers to the energy attenuation factor of the sound played by the speaker reaching mic2 relative to the energy reaching mic1.

Due to the use of two microphones, the energy attenuation law of the sound signal played by the loudspeaker reaching the two microphones is utilized, and the audio amplification coefficient is calculated, which can more quickly and effectively adjust the subsequent sound to meet the needs of the user.

Step 212: Amplify the audio energy corresponding to the audio energy value according to the second amplification factor.

In the embodiment of the present disclosure, each time the user clicks the volume increase button, it is recorded as the first input, and the second amplification factor determined by the above formula (2) is used to dynamically gain the sound signal of the playback content. Specifically, referring to Figure 8, a schematic diagram of an adaptive up-regulation mode of a terminal device is shown. Each time the user clicks the volume up button in the volume component on the side of the terminal device, the volume increased by the user will recursively follow the current volume level. The form increases the volume, so that the user can quickly adjust the volume to the desired volume.

Step 213: Output the sound signal of the amplified audio energy to the speaker for playback.

For this step, please refer to the detailed description of step 104, which will not be repeated here.

In an audio playback method in an embodiment of the present disclosure, when the user has adjusted the volume component of the terminal device to the maximum volume, according to the user's click operation on the volume increase button of the volume component, the user can select the equal interval upward adjustment mode or self-adjustment. Adapt to the up-regulation mode, so as to further increase the sound signal input to the speaker according to the environmental noise according to the user's selection operation of the up-regulation mode, thereby satisfying the user's demand for greater volume. In addition, when playing a file with audio data, the embodiment of the present disclosure may perform the adjustment process of the embodiment of the present disclosure on the part of the file with abnormal volume, and the adjustment is more accurate.

The audio playback method provided by the embodiments of the present disclosure has been introduced above, and the terminal equipment provided by the embodiments of the present disclosure will be described below with reference to the accompanying drawings.

Referring to FIG. 9, an embodiment of the present disclosure also provides a terminal device 30, the terminal device including:

The determining module 301 is used to determine the current volume state of the content being played.

Optionally, the determining module 301 includes:

The first obtaining submodule 3011 is configured to obtain the first energy value of the environmental noise through the microphone of the terminal device.

The second acquiring sub-module 3012 is used to acquire the second energy value of the sound signal input to the speaker.

The first determining submodule 3013 is configured to determine that the volume state of the playback content is an abnormal volume state when the ratio of the first energy value to the second energy value is greater than a preset first threshold.

Optionally, the determining module 301 includes:

The third acquiring submodule 3014 is configured to acquire the first energy average value of the sound signal in the first preset time period.

The fourth acquiring sub-module 3015 is configured to acquire the second energy average value of the sound signal in the second preset time period. The end time of the second preset time period is the current time, the second preset time period is the time period after the first preset time period, and the second preset time period is the same as the first preset time period. A preset time period is an adjacent time period.

The second determining sub-module 3016 is configured to determine that the volume state of the playback content is an abnormal volume state if the ratio of the second energy average value to the target value is greater than a preset second threshold value. Wherein, the target value is the sum of the first energy value and the second energy value.

Optionally, the determining module 301 further includes:

The update sub-module 3017 is configured to determine a third average energy value based on the first average energy value and the second average energy value when the ratio of the second average energy value to the target value is less than or equal to a preset second threshold value. Energy average value, and when the second preset time period is changed to a third preset time period, the third energy average value is used as the target energy average value of the third preset time period, and the third The preset time period is a time period after the second preset time period, and the third preset time period and the second preset time period are adjacent time periods.

Optionally, the terminal device 30 further includes:

The display module 305 is configured to display two kinds of up-regulation if the user's trigger operation on the volume up button is received when the volume state is the abnormal volume state and the volume component of the terminal device has been adjusted to the maximum volume Mode, wherein the two up-regulation modes include a first up-regulation mode and a second up-regulation mode.

The receiving module 302 is configured to receive the user's first input if the volume component of the terminal device has been adjusted to the maximum volume when the volume state is an abnormal volume state.

The receiving module 302 includes:

The receiving sub-module 3021 is configured to, in the case of receiving a selection operation for any one of the two up-regulation modes, each time a trigger operation on the volume up button is received, it is determined that the first enter.

The adjustment module 303 is configured to amplify the audio energy of the sound signal corresponding to the playback content in response to the first input.

Optionally, the adjustment module 303 includes:

The first adjustment sub-module 3031 is configured to increase the audio energy according to a preset amplitude when a selection operation on the first up-regulation mode is received and a trigger operation on the volume increase button is received.

Optionally, the terminal device includes a first microphone and a second microphone, and the adjustment module 303 includes:

The obtaining sub-module 3032 is configured to obtain the first energy value of the environmental noise through the first microphone in the case that the selection operation of the second up-regulation mode is received, and a trigger operation of the volume increase button is received , And obtaining the second energy value of the environmental noise and the audio energy value of the sound signal through the second microphone.

The calculation sub-module 3033 is configured to determine the second amplification factor according to the first energy value, the second energy value, the audio energy value and the preset first amplification factor. Wherein, the first amplification factor is an amplification factor of a volume component of the terminal device from a minimum volume to a maximum volume.

The second adjustment sub-module 3034 is configured to amplify the audio energy corresponding to the audio energy value according to the second amplification coefficient.

Optionally, the calculation sub-module 3033 includes:

The first calculation unit 30331 is configured to determine the first value corresponding to the first microphone according to the first energy value, the first amplification factor, and the audio energy value.

The second calculation unit 30332 is configured to determine a second value corresponding to the second microphone according to the second energy value, the first amplification factor, the audio energy value, and the preset energy attenuation factor, wherein the preset energy The attenuation factor is the energy attenuation factor when the sound signal played by the loudspeaker reaches the second microphone, relative to the energy attenuation factor when the sound signal played by the loudspeaker reaches the first microphone.

The third calculation unit 30333 is configured to determine the second amplification factor according to the first value, the second value, and the first amplification factor.

The playing module 304 is used for outputting the sound signal of the amplified audio energy to the speaker for playing.

The terminal device 30 provided by the embodiment of the present disclosure can implement the various processes implemented by the terminal device in the method embodiments of FIG. 1 to FIG. 8. In order to avoid repetition, details are not described herein again.

In an embodiment of the present disclosure, a terminal device is provided. The terminal device includes: a determining module for determining the volume state of the current content to be played; a receiving module for determining the volume state of an abnormal volume state If the volume component of the terminal device has been adjusted to the maximum volume, receiving a first input from the user; an adjustment module for amplifying the audio energy of the sound signal corresponding to the playback content in response to the first input ; The playback module is used to output the sound signal of the amplified audio energy to the speaker for playback. By confirming that the volume status of the current playback content is in the abnormal volume state and the volume component has been adjusted to the maximum volume, it is possible to amplify the audio energy of the sound signal of the file with abnormal audio content and then input it into the speaker to make the input The sound signal strength of the loudspeaker increases, so that the sound played by the loudspeaker becomes louder, and the sound heard by the user becomes louder, which meets the user's demand for a larger output volume of the terminal device.

FIG. 10 is a schematic diagram of the hardware structure of a terminal device that implements various embodiments of the present disclosure;

The terminal device 400 includes, but is not limited to: a radio frequency unit 401, a network module 402, an audio output unit 403, an input unit 404, a sensor 405, a display unit 406, a user input unit 407, an interface unit 408, a memory 409, a processor 410, and Power supply 411 and other components. Those skilled in the art can understand that the structure of the terminal device shown in FIG. 10 does not constitute a limitation on the terminal device, and the terminal device may include more or less components than those shown in the figure, or a combination of certain components, or different components. Layout. In the embodiments of the present disclosure, terminal devices include, but are not limited to, mobile phones, tablet computers, notebook computers, palmtop computers, vehicle-mounted terminals, wearable devices, and pedometers.

Wherein, the processor 410 is configured to determine the volume status of the current content to be played; if the volume status is the abnormal volume status, if the volume component of the terminal device has been adjusted to the maximum volume, then the user’s first volume status is received. Input; in response to the first input, amplify the audio energy of the sound signal corresponding to the playback content; output the sound signal of the amplified audio energy to the speaker for playback.

In the embodiments of the present disclosure, when it is determined that the volume state of the current playback content is in the abnormal volume state and the volume component has been adjusted to the maximum volume, it is possible to amplify the audio energy of the sound signal of the file with abnormal audio content before inputting it. In the speaker, the strength of the sound signal input to the speaker is increased, so that the sound played by the speaker is also increased, and the sound heard by the user is also increased, which meets the user's demand for a larger output volume of the terminal device.

It should be understood that, in the embodiment of the present disclosure, the radio frequency unit 401 can be used for receiving and sending signals in the process of sending and receiving information or talking. Specifically, the downlink data from the base station is received and processed by the processor 410; in addition, Uplink data is sent to the base station. Generally, the radio frequency unit 401 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like. In addition, the radio frequency unit 401 can also communicate with the network and other devices through a wireless communication system.

The terminal device provides users with wireless broadband Internet access through the network module 402, such as helping users to send and receive emails, browse web pages, and access streaming media.

The audio output unit 403 may convert the audio data received by the radio frequency unit 401 or the network module 402 or stored in the memory 409 into an audio signal and output it as sound. Moreover, the audio output unit 403 may also provide audio output related to a specific function performed by the terminal device 400 (for example, call signal reception sound, message reception sound, etc.). The audio output unit 403 includes a speaker, a buzzer, a receiver, and the like.

The input unit 404 is used to receive audio or video signals. The input unit 404 may include a graphics processing unit (GPU) 4041 and a microphone 4042. The graphics processor 4041 is configured to monitor images of still pictures or videos obtained by an image capture device (such as a camera) in a video capture mode or an image capture mode. The data is processed. The processed image frame can be displayed on the display unit 406. The image frame processed by the graphics processor 4041 may be stored in the memory 409 (or other storage medium) or sent via the radio frequency unit 401 or the network module 402. The microphone 4042 can receive sound, and can process such sound into audio data. The processed audio data can be converted into a format that can be sent to a mobile communication base station via the radio frequency unit 401 in the case of a telephone call mode for output.

The terminal device 400 also includes at least one sensor 405, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor includes an ambient light sensor and a proximity sensor. The ambient light sensor can adjust the brightness of the display panel 4061 according to the brightness of the ambient light. The proximity sensor can close the display panel 4061 and the display panel 4061 when the terminal device 400 is moved to the ear. / Or backlight. As a kind of motion sensor, the accelerometer sensor can detect the magnitude of acceleration in various directions (usually three-axis), and can detect the magnitude and direction of gravity when stationary, and can be used to identify the posture of the terminal device (such as horizontal and vertical screen switching, related games) , Magnetometer attitude calibration), vibration recognition related functions (such as pedometer, percussion), etc.; sensor 405 can also include fingerprint sensors, pressure sensors, iris sensors, molecular sensors, gyroscopes, barometers, hygrometers, thermometers, Infrared sensors, etc., will not be repeated here.

The display unit 406 is used to display information input by the user or information provided to the user. The display unit 606 may include a display panel 4061, and the display panel 4061 may be configured in the form of a liquid crystal display (LCD), an organic light-emitting diode (OLED), etc.

The user input unit 407 may be used to receive inputted numeric or character information, and generate key signal input related to user settings and function control of the terminal device. Specifically, the user input unit 407 includes a touch panel 4071 and other input devices 4072. The touch panel 4071, also called a touch screen, can collect the user's touch operations on or near it (for example, the user uses any suitable objects or accessories such as fingers, stylus, etc.) on the touch panel 4071 or near the touch panel 4071. operating). The touch panel 4071 may include two parts: a touch detection device and a touch controller. Among them, the touch detection device detects the user's touch position, detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into contact coordinates, and then sends it To the processor 410, the command sent by the processor 410 is received and executed. In addition, the touch panel 4071 can be implemented in multiple types such as resistive, capacitive, infrared, and surface acoustic wave. In addition to the touch panel 4071, the user input unit 407 may also include other input devices 4072. Specifically, other input devices 4072 may include, but are not limited to, a physical keyboard, function keys (such as volume control buttons, switch buttons, etc.), trackball, mouse, and joystick, which will not be repeated here.

Further, the touch panel 4071 can be overlaid on the display panel 4061. When the touch panel 6071 detects a touch operation on or near it, it transmits it to the processor 410 to determine the type of the touch event, and then the processor 410 determines the type of the touch event according to the touch. The type of event provides corresponding visual output on the display panel 4061. Although in FIG. 10, the touch panel 4071 and the display panel 4061 are used as two independent components to implement the input and output functions of the terminal device, in some embodiments, the touch panel 4071 and the display panel 4061 can be integrated The implementation of the input and output functions of the terminal device is not specifically limited here.

The interface unit 408 is an interface for connecting an external device with the terminal device 400. For example, the external device may include a wired or wireless headset port, an external power source (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device with an identification module, audio input/output (I/O) port, video I/O port, headphone port, etc. The interface unit 408 may be used to receive input (for example, data information, power, etc.) from an external device and transmit the received input to one or more elements in the terminal device 400 or may be used to connect to the terminal device 400 and an external device. Transfer data between devices.

The memory 409 can be used to store software programs and various data. The memory 409 may mainly include a storage program area and a storage data area. The storage program area may store an operating system, an application program required by at least one function (such as a sound playback function, an image playback function, etc.), etc.; Data created by the use of mobile phones (such as audio data, phone book, etc.), etc. In addition, the memory 409 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, or other volatile solid-state storage devices.

The processor 410 is the control center of the terminal device. It uses various interfaces and lines to connect the various parts of the entire terminal device, runs or executes software programs and/or modules stored in the memory 409, and calls data stored in the memory 409 , Perform various functions of the terminal equipment and process data, so as to monitor the terminal equipment as a whole. The processor 410 may include one or more processing units; preferably, the processor 410 may integrate an application processor and a modem processor, where the application processor mainly processes the operating system, user interface and application programs, etc., the modem The processor mainly deals with wireless communication. It can be understood that the foregoing modem processor may not be integrated into the processor 410.

The terminal device 400 may also include a power source 411 (such as a battery) for supplying power to various components. Preferably, the power source 611 may be logically connected to the processor 410 through a power management system, so as to manage charging, discharging, and power consumption management through the power management system. And other functions.

In addition, the terminal device 400 includes some functional modules not shown, which will not be repeated here.

Preferably, the embodiment of the present disclosure further provides a terminal device, including a processor 410, a memory 409, and a computer program stored on the memory 409 and running on the processor 410. When the computer program is executed by the processor 410, Each process of the foregoing audio playback method embodiment is implemented, and the same technical effect can be achieved. To avoid repetition, details are not repeated here.

The embodiments of the present disclosure also provide a computer-readable storage medium, and a computer program is stored on the computer-readable storage medium. When the computer program is executed by a processor, each process of the above-mentioned audio playback method embodiment is realized, and the same technology can be achieved. The effect, in order to avoid repetition, will not be repeated here. Wherein, the computer-readable storage medium, such as read-only memory (Read-Only Memory, ROM for short), random access memory (Random Access Memory, RAM for short), magnetic disk, or optical disk, etc.

It should be noted that in this article, the terms "include", "include" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements not only includes those elements, It also includes other elements not explicitly listed, or elements inherent to the process, method, article, or device. If there are no more restrictions, the element defined by the sentence "including a..." does not exclude the existence of other identical elements in the process, method, article, or device that includes the element.

Through the description of the above implementation manners, those skilled in the art can clearly understand that the above-mentioned embodiment method can be implemented by means of software plus the necessary general hardware platform, of course, it can also be implemented by hardware, but in many cases the former is better.的实施方式。 Based on this understanding, the technical solution of the present disclosure essentially or the part that contributes to the related technology can be embodied in the form of a software product, and the computer software product is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk). ) Includes several instructions to make a terminal (which can be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) execute the methods described in the various embodiments of the present disclosure.

The embodiments of the present disclosure are described above with reference to the accompanying drawings, but the present disclosure is not limited to the above-mentioned specific embodiments. The above-mentioned specific embodiments are only illustrative and not restrictive. Those of ordinary skill in the art are Under the enlightenment of the present disclosure, without departing from the purpose of the present disclosure and the scope of protection of the claims, many forms can be made, all of which fall within the protection of the present disclosure.

Claims

An audio playback method, applied to a terminal device, the method including:

Determine the volume status of the current playback content;

In the case that the volume state is the abnormal volume state, if the volume component of the terminal device has been adjusted to the maximum volume, receiving the first input of the user;

In response to the first input, amplify the audio energy of the sound signal corresponding to the playback content;

The sound signal that amplifies the audio energy is output to the speaker for playback.
The method according to claim 1, wherein said determining the current volume state of the content being played comprises:

Acquiring the first energy value of the environmental noise through the microphone of the terminal device;

Acquiring the second energy value of the sound signal input to the speaker;

In a case where the ratio of the first energy value to the second energy value is greater than the preset first threshold, it is determined that the volume state of the playback content is an abnormal volume state.
The method according to claim 1, wherein said determining the current volume state of the content being played comprises:

Acquiring the first energy average value of the sound signal in the first preset time period;

Acquire the second energy mean value of the sound signal in the second preset time period; the end time of the second preset time period is the current moment, and the second preset time period is after the first preset time period The second preset time period and the first preset time period are adjacent time periods;

If the ratio of the second energy average value to the target value is greater than the preset second threshold value, it is determined that the volume state of the playback content is an abnormal volume state; wherein the target value is the first energy value and the The sum of the second energy value.
The method according to claim 3, further comprising:

In the case where the ratio of the second energy average value to the target value is less than or equal to the preset second threshold value, a third energy average value is determined according to the first energy average value and the second energy average value, and the third energy average value is determined in the When the second preset time period is changed to the third preset time period, the third energy average value is used as the target energy average value of the third preset time period, and the third preset time period is the A time period after the second preset time period, and the third preset time period and the second preset time period are adjacent time periods.
The method according to claim 1, wherein before the receiving the first input from the user, the method further comprises:

In the case that the volume state is the abnormal volume state and the volume component of the terminal device has been adjusted to the maximum volume, if a user's trigger operation on the volume increase button is received, two upward adjustment modes are displayed, wherein the The two up-regulation modes include the first up-regulation mode and the second up-regulation mode;

The receiving the first input of the user includes:

In the case of receiving a selection operation for any one of the two up-regulation modes, it is determined that the first input is received every time a trigger operation on the volume up button is received.
The method according to claim 5, wherein the amplifying the audio energy of the sound signal corresponding to the playback content comprises:

In a case where a selection operation for the first up-regulation mode is received, and a trigger operation for a volume increase button is received, the audio energy is increased according to a preset amplitude.
The method according to claim 5, wherein the terminal device comprises a first microphone and a second microphone, and said amplifying the audio energy of the sound signal corresponding to the playback content comprises:

In the case that the selection operation of the second up-regulation mode is received, and a trigger operation of the volume up button is received, the first energy value of the environmental noise is obtained through the first microphone, and the second energy value is obtained through the second The microphone acquires the second energy value of the environmental noise and the audio energy value of the sound signal;

According to the first energy value, the second energy value, the audio energy value and the preset first amplification factor, the second amplification factor is determined; wherein, the first amplification factor is the minimum volume of the volume component of the terminal device. Amplification factor to the maximum volume;

According to the second amplification factor, the audio energy corresponding to the audio energy value is amplified.
The method according to claim 7, wherein the determining the second amplification factor according to the first energy value, the second energy value, the audio energy value, and a preset first amplification factor comprises:

Determine the first value corresponding to the first microphone according to the first energy value, the first amplification factor, and the audio energy value;

According to the second energy value, the first amplification factor, the audio energy value, and the preset energy attenuation factor, the second value corresponding to the second microphone is determined, wherein the preset energy attenuation factor is played by the speaker When the sound signal reaches the second microphone, it is relative to the energy attenuation factor when the sound signal played by the speaker reaches the first microphone;

The second amplification factor is determined according to the first value, the second value, and the first amplification factor.
A terminal device, the terminal device includes:

The determination module is used to determine the current volume status of the content being played;

A receiving module, configured to receive a user's first input if the volume component of the terminal device has been adjusted to the maximum volume when the volume state is an abnormal volume state;

An adjustment module, configured to amplify the audio energy of the sound signal corresponding to the playback content in response to the first input;

The playback module is used to output the sound signal of the amplified audio energy to the speaker for playback.
The terminal device according to claim 9, wherein the determining module comprises:

The first obtaining submodule is configured to obtain the first energy value of the environmental noise through the microphone of the terminal device;

The second acquisition sub-module is used to acquire the second energy value of the sound signal input to the speaker;

The first determining sub-module is configured to determine that the volume state of the playback content is an abnormal volume state when the ratio of the first energy value to the second energy value is greater than a preset first threshold value.
The terminal device according to claim 9, wherein the determining module comprises:

The third acquisition sub-module is configured to acquire the first energy average value of the sound signal in the first preset time period;

The fourth acquisition sub-module is configured to acquire the second energy mean value of the sound signal in the second preset time period; the end time of the second preset time period is the current time, and the second preset time period is the current time. A time period after the first preset time period, and the second preset time period and the first preset time period are adjacent time periods;

The second determining sub-module is configured to determine that the volume state of the playback content is an abnormal volume state if the ratio of the second energy average value to the target value is greater than the preset second threshold; wherein, the target value is The sum of the first energy value and the second energy value.
A terminal device, the terminal device comprising a processor, a memory, and a computer program stored on the memory and running on the processor, and the computer program is executed by the processor to achieve as claimed in claim 1. -8 steps of the audio playback method described in any one of them.
A computer-readable storage medium on which a computer program is stored, and when the computer program is executed by a processor, the steps of the audio playback method according to any one of claims 1-8 are realized.