CN110211552B - Audio processing method and device - Google Patents

Abstract

The present disclosure discloses an audio processing method and device, including: for the audio signal to be processed in the audio processing chip, obtaining the gain information applicable to the audio processing of each audio frequency point in the audio processing chip at each level of the audio processing chip ; According to the gain information and the initial amplitude of each frequency point audio, determine the super-amplitude frequency point audio in the audio signal; according to the initial amplitude of the super-amplitude frequency point audio and the corresponding gain information for each frequency point audio in the audio signal Correspondingly determine the adjustment gain so that the audio at each frequency point is processed according to the gain indicated by the corresponding gain information and the corresponding adjusted gain does not exceed the amplitude threshold; Gain preprocesses the audio at each frequency point. The method realizes dynamically determining and adjusting the gain for the audio signal, and avoids clipping and distortion of the audio signal in all levels of audio processing of the audio chip.

Description

Audio processing method and device

technical field

The present disclosure relates to the technical field of audio processing, in particular to an audio processing method and device.

Background technique

Audio processing chips are composed of integrated circuit circuits. Due to the limitations of the electronic components and circuit structure of the integrated circuit, the amplitude of the signal that can pass through the integrated circuit is limited. If the amplitude of the signal in the integrated circuit exceeds the allowable range of the integrated circuit, that is, the amplitude threshold, the signal cannot be passed. It passes through smoothly, and part of its waveform will be cut off, resulting in clipping distortion. Therefore, if the amplitude of the audio signal exceeds the amplitude threshold of the audio processing chip during audio processing, clipping distortion will occur. However, the clipped and distorted audio signal will cause the sound to be fuzzy and unclear, making the audio signal unsatisfactory after it is broadcast, resulting in poor user experience.

Therefore, in the prior art, due to the structure of the audio processing chip itself, the problem of clipping and distortion of the audio signal passing through the audio processing chip needs to be solved urgently.

Contents of the invention

In order to solve the problems existing in related technologies, the present disclosure provides an audio processing method and device.

In a first aspect, an audio processing method, the method comprising:

For the audio signal to be processed in the audio processing chip, obtain the gain information applicable to the audio processing at each level of the audio processing chip for each frequency point in the audio signal;

According to the gain information and the initial amplitude of each frequency point audio, determine the super-amplitude frequency point audio in the audio signal, and the super-amplitude frequency point audio is determined according to the gain information in the audio signal After indicating the gain processing, the frequency point audio whose amplitude exceeds the amplitude threshold of the audio processing chip;

According to the initial amplitude of the super-amplitude frequency point audio and the corresponding gain information, an adjustment gain is correspondingly determined for each frequency point audio in the audio signal, so that the each frequency point audio is in accordance with the corresponding The gain indicated by the gain information and the processed amplitude corresponding to the adjusted gain do not exceed the amplitude threshold;

Before performing the audio processing at all levels on the audio signal, the audio of each frequency point is pre-processed according to the corresponding adjustment gain.

In a second aspect, an audio processing device, the device comprising:

The gain information acquisition module is configured to: acquire, for the audio signal to be audio processed in the audio processing chip, the gain information applicable to audio processing at each level of the audio processing chip for each frequency point in the audio signal;

The super-amplitude frequency point audio determination module is configured to: determine the super-amplitude frequency point audio in the audio signal according to the gain information and the initial amplitude of each frequency point audio, and the super-amplitude frequency point audio It is the frequency point audio whose amplitude exceeds the amplitude threshold of the audio processing chip after the gain processing indicated by the gain information in the audio signal;

The adjustment gain determination module is configured to: determine the adjustment gain for each frequency point audio in the audio signal according to the initial amplitude value of the super-amplitude frequency point audio, the corresponding gain information, and the amplitude threshold so that the amplitude of the audio at each frequency point processed according to the gain indicated by the corresponding gain information and the corresponding adjusted gain does not exceed the amplitude threshold;

The preprocessing module is configured to: perform preprocessing on the audio at each frequency point according to the corresponding adjustment gain before performing the audio processing at each level on the audio signal.

The technical solutions provided by the embodiments of the present disclosure may include the following beneficial effects:

According to the initial amplitude of each frequency point audio in the audio signal and the gain information applicable to each frequency point audio in the audio processing of the audio processing chip to determine the adjustment gain for the audio signal correspondingly, so as to adjust the gain according to the Preprocessing is done before the audio signal goes through various stages of audio processing.

On the one hand, it ensures that the amplitude of the audio signal will not exceed the amplitude threshold of the audio processing chip after the preprocessing enters the audio processing at all levels, effectively avoiding the clipping distortion of the audio signal in the audio processing chip.

On the other hand, in each audio signal to be subjected to various levels of audio processing, the frequency point audio included in the audio signal is different, and the amplitude of the included frequency point audio is also different. Therefore, in the technical solution of the present disclosure, according to the initial amplitude of each frequency point audio in the audio signal, and the gain information applicable to each frequency point audio in all levels of audio processing, the adjustment is correspondingly determined for the audio signal The gain realizes dynamically determining the adjustment gain for each audio signal in combination with the actual situation of each audio signal, so as to ensure that the determined adjustment gain is applicable to the audio signal.

It is to be understood that both the foregoing general description and the following detailed description are exemplary only and are not restrictive of the present disclosure.

Description of drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and together with the description serve to explain the principles of the invention.

Fig. 1 is a flowchart of an audio processing method shown according to an exemplary embodiment;

2 is a schematic diagram of audio signal buffering performed by an audio processing chip in an application scenario;

Fig. 3 is the flow chart that carries out all levels of audio processing in the audio processing chip of television set;

FIG. 4 is a flow chart of audio processing for the scene in FIG. 3 according to the technical solution of the present disclosure;

FIG. 5 is a flowchart of step S110 in an embodiment corresponding to the embodiment in FIG. 1;

FIG. 6 is a flowchart of step S115 in an embodiment corresponding to the embodiment in FIG. 4;

FIG. 7 is a flowchart of step S130 in an embodiment corresponding to the embodiment in FIG. 1;

FIG. 8 is a flowchart of step S150 in an embodiment corresponding to the embodiment in FIG. 1;

Fig. 9 is a flowchart of an audio processing method according to another embodiment;

Fig. 10 is a flowchart of audio processing according to the technical solution in Fig. 9 in an application scenario;

Fig. 11 is a block diagram of an audio processing device according to an embodiment;

Fig. 12 is a block diagram of an audio processing device according to another embodiment.

Through the above drawings, specific embodiments of the present invention have been shown and will be described in more detail below. These drawings and text description are not intended to limit the scope of the inventive concept in any way, but by reference to specific embodiments. The concepts of the present invention are explained to those skilled in the art.

Detailed ways

Reference will now be made in detail to exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, the same numerals in different drawings refer to the same or similar elements unless otherwise indicated. The implementations described in the following exemplary examples do not represent all implementations consistent with the present invention. Rather, they are merely examples of apparatuses and methods consistent with aspects of the invention as recited in the appended claims.

The physical carrier of an audio processing chip is an integrated circuit. Due to the limitations of the integrated circuit's own structure (that is, the electronic circuit), there is a limit to the amplitude of the signal that can pass through the integrated circuit. If the amplitude of the signal in the integrated circuit exceeds the allowable range of the integrated circuit, that is, the amplitude threshold, the signal's If it cannot pass smoothly, and part of its waveform will be cut off, clipping distortion will occur. The clipped and distorted audio signal will cause the sound to be fuzzy and unclear, making the audio signal unsound after it is broadcast.

In view of this, in order to avoid clipping and distortion of the audio signal in the audio processing performed by the audio processing chip, the technical solution of the present disclosure is proposed.

Fig. 1 is a flow chart showing an audio processing method according to an exemplary embodiment. The audio processing method is applicable to a terminal integrated with an audio processing chip and capable of implementing audio processing, such as a TV, a computer, a music player, etc., and is not specifically limited here. As shown in Fig. 1, the audio processing method may include the following steps.

Step S110, for the audio signal to be processed in the audio processing chip, obtain the gain information applicable to the audio processing at each level of the audio processing chip for each frequency point in the audio signal.

For the audio signal to be processed in the audio processing chip, the audio signal can be buffered at the upper level of the audio processing chip, so as to input the buffered audio signal to the audio processing chip to perform audio processing at all levels, then the audio processing The audio signal buffered by the upper level of the chip is the audio signal to be processed in the audio processing chip; it is also possible to configure a buffer module for audio signal buffering in the audio processing chip, so that the buffered audio signal in the buffer module The audio signal serves as an audio signal to be subjected to audio processing.

In a specific embodiment, a buffer space for audio signal buffering is configured in the audio processing chip, and the buffered audio signals in the buffer space are input to the corresponding audio processing module in the audio processing chip in turn, thereby realizing audio processing. Audio processing and playback of signals. As shown in Figure 2, 8 buffers are set, namely b1-8, so that the audio signal of buffer1->2->3->4->5->6->7->8->1 is output sequentially , perform audio processing and playback after audio processing. In this embodiment, an audio signal of 512 samples can be cached in each buffer, calculated according to a sample rate of 48000 sample/s, the audio signal in each buffer needs 10.667ms to output from the corresponding buffer, Therefore, the output time of the audio signal in the previous buffer can be used to determine the adjustment gain for the audio signal in the next buffer according to the technical solution of the present disclosure, and preprocessing is performed according to the corresponding adjustment gain after outputting the buffer.

In the audio processing chip, all levels of audio processing are set. In the technical solution of the present disclosure, the audio processing refers to the processing that changes the amplitude of the audio at the middle frequency point of the audio signal, such as performing the audio processing at the middle frequency point of the audio signal. Amplitude attenuation or amplitude amplification.

In a specific embodiment, the audio processing process shown in FIG. 3 is an audio processing process performed by an audio processing chip in an existing television.

In the audio processing flow corresponding to Figure 3, the audio processing chip is configured with a buffer for audio signal buffering as shown in Figure 2, so that the audio signal output in each buffer is prescaled in turn, and the subsequent basic sound effect processing and Advanced sound processing.

For the TV, there are multiple signal interfaces on the TV, such as ATV, DTV, HDMI, DMP, AV, and the user can select the signal interface through the remote control, the touch screen of the TV, or the buttons on the TV. , thus, the audio signal input to the audio processing chip is the signal from the signal interface with the selected pass. In the TV, since the amplitudes of the audio from different signal interfaces are quite different, in order to facilitate processing in the audio processing chip, the audio processing chip pre-sets the initial adjustment gain for the signals from different signal interfaces. For example, the initial adjustment gain set for the audio signal from the ATV signal interface is 1dB, and the initial adjustment gain set for the audio signal from the DTV signal interface is 2dB. Therefore, according to the corresponding initial adjustment gain, the amplitude adjustment is uniformly performed for the audio signal from the signal interface, that is, the prescale processing in FIG. 3 . Then perform basic sound effect processing and advanced sound effect processing on the prescale-processed audio signal. During the process of prescale processing, basic sound effect processing and advanced sound effect processing, the amplitude of audio at the mid-frequency point of the audio signal will be changed. Therefore, the amplitude of audio at the mid-frequency point of the audio signal may be caused by prescale processing, basic sound effect processing and advanced sound effect processing. The value exceeds the amplitude threshold of the audio processing chip, resulting in clipping distortion.

The audio signal includes at least one frequency of audio, and the audio of each frequency in the audio signal is called a frequency point audio, in other words, the audio signal includes at least one frequency point audio. Because in the audio processing process at all levels, there may be a corresponding setting of the gain in the audio processing process according to the frequency, for example, in the sound effect processing process, thus, combining the frequency point audio contained in the audio signal and the audio frequency at each level Gain information set for the audio at each frequency during the processing, so as to obtain corresponding gain information applicable to audio processing at each level of audio at each frequency point in the audio signal. The gain information indicates the total gain of the amplitude change of the corresponding frequency point audio during audio processing at various levels.

Step S130, according to the gain information and the initial amplitude of each frequency point audio, determine the super-amplitude frequency point audio in the audio signal, the super-amplitude frequency point audio is the audio signal whose amplitude exceeds the audio Process the frequency point audio of the amplitude threshold of the chip.

The initial amplitude of the audio at each frequency point is the amplitude of the audio at the frequency point before performing audio processing at various levels in the audio chip.

Therefore, according to the gain information corresponding to each frequency point audio and the initial amplitude of each frequency point audio, the super-amplitude frequency point audio in the audio signal can be determined, that is, in the audio processing at all levels of the audio processing chip, there will be Audio at frequencies where clipping occurs. Specifically, the super-amplitude frequency audio in the audio signal refers to the frequency audio in the audio signal whose amplitude exceeds the amplitude threshold of the audio processing chip after being amplified or attenuated according to the gain indicated by the corresponding gain information.

Step S150, according to the initial amplitude of the super-amplitude frequency point audio and the corresponding gain information, determine the adjustment gain for each frequency point audio in the audio signal, so that each frequency point audio follows the gain indicated by the corresponding gain information and the corresponding gain information The amplitude after adjusting the gain processing does not exceed the amplitude threshold.

The amplitude of the frequency point audio after all levels of audio processing depends on the initial amplitude of the frequency point audio and the gain indicated by the corresponding gain information. The gain information determines the adjusted gain for the audio signal, so as to ensure that the audio amplitude of each frequency point in the audio signal after being processed according to the gain indicated by the corresponding gain information and the corresponding adjusted gain does not exceed the amplitude threshold.

The determination of the adjustment gain for the audio signal is to determine the adjustment gain for each frequency point in the audio signal. Certainly, the determined adjustment gain may be 0 dB, that is, the amplitude of the audio at the frequency point is not changed, or it may be other adjustment gains other than 0 dB. The adjustment gains determined for each audio frequency point may be all the same, some of them may be the same, or all of them may be different, which is not specifically limited here.

In order to determine the adjustment gain for each frequency point in the audio signal, a setting rule for the adjustment gain can also be preset. For example, the same adjustment gain is set for each frequency point in the audio signal, or a determination rule for adjusting the gain is set in advance according to the frequency segment.

For the determination rules of pre-setting the gain according to the frequency band, for example, the pre-set frequency bands are: low frequency: ≤300Hz;

1. When there is an ultra-amplitude frequency point audio at a low frequency in the audio signal, set the adjustment gain of each frequency point audio at a low frequency in the audio signal (or only the ultra-amplitude frequency point audio at a low frequency) to the same ;

2. When there is a super-amplitude frequency point audio at the intermediate frequency in the audio signal, the adjustment gain of each frequency point audio at the intermediate frequency (or only the super-amplitude frequency point audio at the intermediate frequency) in the audio signal is set to the same ;

3. When there is an ultra-amplitude frequency point audio at a high frequency in the audio signal, the adjustment gain setting of each frequency point audio at a low frequency (or only the ultra-amplitude frequency point audio at a high frequency) in the audio signal for the same.

Therefore, the adjustment gain is determined for each frequency point audio by combining the gain information corresponding to each frequency point audio in the audio signal, the initial amplitude of each frequency point audio, and the preset adjustment gain determination rule. According to the above-mentioned determination rules for adjusting the gain, for example, when there is an ultra-amplitude frequency point audio with a frequency of 250Hz in the audio signal, the adjustment of each frequency point audio at a low frequency (or an ultra-amplitude frequency point audio at a low frequency) in the audio signal The gain is determined to be the same. Of course, the value of the adjusted gain is still determined according to the general principle that the audio frequency of each frequency point is determined according to the gain indicated by the corresponding gain information and the amplitude after processing the corresponding adjusted gain does not exceed the amplitude threshold.

Of course, the above are only exemplary examples, and should not be considered as limitations on the scope of application of the present disclosure. In other embodiments, other adjustment rules for adjusting the gain can also be preset to determine the adjustment gain in combination.

Step S170, before performing audio processing at various levels on the audio signal, perform preprocessing on the audio at each frequency point according to the corresponding adjusted gain.

In the technical solution of the present disclosure, the audio signal is preprocessed according to the determined adjustment gain, so that the amplitude of the preprocessed audio signal after each level of audio processing in the audio processing chip does not exceed the audio processing chip Amplitude threshold, so as to avoid clipping distortion of the audio signal in the audio processing chip.

The preprocessing is to reduce the amplitude of the corresponding frequency point audio according to the corresponding adjustment gain, so as to ensure that the amplitude of the audio signal after the amplitude reduction in the preprocessing does not exceed the audio processing level of the audio processing chip. The amplitude threshold of the audio processing chip, so as to avoid the clipping distortion of the audio signal in the audio processing chip.

By preprocessing the audio signal according to the determined adjustment gain, it is ensured that the amplitude of the audio signal to be processed in the audio chip will not exceed the amplitude threshold of the audio processing chip after the preprocessing enters all levels of audio processing , effectively avoiding clipping and distortion of the audio signal in the audio processing chip.

Because in each audio signal to be subjected to audio processing at various levels, the frequency point audio included in the audio signal is different, and the amplitude of the included frequency point audio is also different. Therefore, in the technical solution of the present disclosure, before the audio signal enters the audio processing at all levels of the audio processing chip, the gain information and The initial amplitude of each frequency point audio in the frequency point audio is used to determine the adjustment gain for the audio signal correspondingly, which realizes dynamically determining the adjustment gain for each audio signal, and correspondingly adjusts the audio frequency according to the determined adjustment gain. The signal is preprocessed to avoid clipping and distortion of the audio signal in the audio chip.

For the audio processing process carried out by the audio chip corresponding to Fig. 3, according to the technical solution of the corresponding embodiment in Fig. 1, the audio processing flow for avoiding clipping distortion in the audio processing chip is as shown in Fig. 4, namely After the audio signal is output to the buffer and before the presale process is performed, the audio of each frequency point in the audio signal is preprocessed according to the determined adjustment gain. The pre-processing may be performed outside the audio processing chip or in the audio processing chip, which is not specifically limited here.

In one embodiment, audio processing at all levels includes initial audio processing and sound effect processing, as shown in FIG. 5, step S110 includes:

Step S111 , according to the signal interface from which the audio signal comes, acquire the initial adjustment gain set by the audio processing chip for the signal from the signal interface. as well as

Step S113, obtaining the sound effect gain set for each frequency point audio in the sound effect mode selected for audio playback.

Step S115, according to the initial adjustment gain and the sound effect gain corresponding to each frequency point audio, gain information applicable to each frequency point audio in audio processing at each level is obtained.

In the technical solution of this embodiment, the audio processing chip can perform initial audio processing on audio signals from sources and different signal interfaces, and the audio processing chip also integrates a module for sound effect processing, such as the TV corresponding to Figure 3 above Audio processing chip in.

The signal interface to determine the source of the audio signal can be determined by the user's operation, for example, the user selects the signal interface of the strobe through the remote control panel, the touch panel of the terminal, the buttons arranged on the terminal and other manipulable devices, so that , the signal interface from which the audio signal comes from is the signal interface selected by the user. Accordingly, the initial adjustment gain set by the audio processing chip for the signal from the signal interface is correspondingly obtained.

For a signal from a certain signal interface, the initial adjustment gains set for audio at different frequencies may be the same (for example, FIG. 3 corresponds to precale processing) or different, which are not specifically limited here.

At the same time, in the audio processing chip, a variety of sound effect modes are preset for the user to choose, so that the selected sound effect mode is presented when the audio is played. The realization of the sound effect mode is to present the corresponding sound effect by adjusting the gain value of the audio in each frequency band.

In the prior art, by configuring an equalizer in the audio processing chip, a user can select a sound effect mode, or the user can customize a sound effect mode, thereby presenting different sound effects. The sound mode is such as the set standard, movie, music, news, etc., and is further subdivided, such as standard, rock, pop, stage, classical, soft, etc. In a specific embodiment, the user can also set the sound effect gain for the frequency point audio of each frequency, so as to realize the custom sound effect mode.

Therefore, according to the sound effect mode selected by the user for audio playback, the corresponding gain set by the audio processing chip for each frequency point audio in the audio signal in the sound effect mode is correspondingly obtained, that is, the sound effect gain of the frequency point audio. Furthermore, according to the obtained initial adjustment gain and the obtained sound effect gain, the gain information applicable to each audio frequency point in audio processing at various levels, ie initial audio processing and sound effect processing, can be obtained.

For example, in the initial audio processing stage, the initial adjustment gain set for each frequency point audio in the audio signal from the ATV signal interface is 1dB. In a certain sound effect mode selected by the user for audio playback: the sound effect gain set for 50Hz frequency point audio is -10dB, the sound effect gain set for 200Hz frequency point audio is -6dB, and the sound effect gain set for 1KHz frequency point audio is -10dB. The sound effect gain set for point audio is 6dB, the sound effect gain set for 3KHz frequency point audio is 9dB, and the sound effect gain set for 14KHz frequency point audio is 3dB. Wherein, the audio signals to be processed at various levels of audio and sound effects include audio at five frequency points with frequencies of 60 Hz, 100 Hz, 200 Hz, 500 Hz, and 1 KHz. Thus, the corresponding total gain of each frequency point audio in the audio signal in the initial audio processing and sound effect processing is shown in the following table (wherein, for the frequency point audio in the audio signal, if it is not the frequency point audio in the sound effect mode Set the sound effect gain, the default is not to change the amplitude of the frequency point audio in the sound effect processing, that is, the default sound effect gain is 0dB):

The calculated total gain of each frequency point audio in the audio signal in the initial audio processing and sound effect processing is used as the gain information of each frequency point audio in all levels of audio processing.

In one embodiment, the sound effect mode includes a basic sound effect mode and an advanced sound effect mode, as shown in FIG. 6, step S115 includes:

Step S210, according to the selected basic sound effect mode and the selected advanced sound effect mode for audio playback, obtain the first gain set for each frequency point audio in the basic sound effect mode, and obtain the first gain set for each frequency point audio in the advanced sound effect mode The second gain set for each frequency point audio.

Step S230, calculating the sound effect gain corresponding to each frequency point audio according to the corresponding first gain and the corresponding second gain of each frequency point audio.

As users have higher and higher requirements for audio playback effects, more sound effect modes have emerged, for example, Dolby Atmos (Dolby Atmos, ATMOS), Digital Theater System (Digital Theater System, DTS), etc. The sound effect mode of the device to construct the sound effect. The sound effect mode achieved through the equalizer is called the basic sound effect mode, and the other sound effect modes that are different from the sound effect mode realized by the equalizer are called the advanced sound effect mode, in which the basic sound effect mode and the advanced sound effect mode can be selected at the same time Yes, that is to select a basic sound effect mode and an advanced sound effect mode at the same time. Of course, only a basic sound effect mode or an advanced sound effect mode can be selected.

The selected sound effect mode can be selected by the user according to the needs, or can be pre-set in the terminal integrated with the audio chip, which is not specifically limited here.

Similar to the basic sound effect mode, in the advanced sound effect mode, there is also a gain value corresponding to the frequency point audio setting of the specified frequency in each advanced sound effect mode. The gain value set for each frequency point audio in the audio signal in the basic sound effect mode is called the first gain, and the gain value set for each frequency point audio in the audio signal in the advanced sound effect mode is called second gain. Therefore, according to the selected basic sound effect mode and advanced sound effect mode selected for audio playback, the first gain and the second gain of each frequency point audio in the audio signal are correspondingly obtained, and then according to the first gain corresponding to each frequency point audio The gain and the corresponding second gain are calculated to obtain the sound effect gain of the audio at each frequency point. For example, when the gain is in units of dB, the sound effect gain of the frequency point audio is obtained by adding the first gain and the second gain of the frequency point audio.

In a specific embodiment, in a TV set integrated with an audio processing chip, for the basic sound effect mode, the user is provided with four basic sound effect modes of standard, movie, music and news, and corresponding adjustment knobs are provided. , for users to customize the basic sound effect mode, in which the adjustment knob configured at the specified frequency point can support the user to adjust in the range of -10dB ~ 10dB, and the adjustment knob can support 5 terminals (5 options), 7 terminals, 9 terminals One of the terminal adjustments. For the advanced sound effect mode, DTS sound effect mode and/or ATMOS sound effect mode are pre-built, and a selection switch is provided for the user to choose whether to enable the DTS sound effect mode or the ATMOS sound effect mode.

Of course, in other embodiments, more basic sound effect modes and advanced sound effect modes can be provided for the user to choose from in the terminal integrated with the audio processing chip, or the basic sound effect mode and the advanced sound effect mode can be selected in other ways. Selected, not specifically limited here.

In one embodiment, as shown in FIG. 7, step S130 includes:

Step S131 , according to the initial amplitude of each frequency point audio, calculate the first amplitude value of each frequency point audio after gain processing indicated by the corresponding gain information.

Step S135, determining the frequency point audio corresponding to the first amplitude value exceeding the amplitude threshold in the audio signal as super-amplitude frequency point audio.

So far, by calculating the first amplitude of each frequency point audio in the audio signal, and comparing the calculated first amplitude value with the amplitude threshold of the audio processing chip, the super-amplitude frequency point audio in the audio signal can be determined.

In one embodiment, as shown in FIG. 8, step S150 includes:

Step S151, according to the first amplitude value corresponding to each super-amplitude frequency point audio, determine the maximum value among the first amplitude values as the reference amplitude value.

In step S153, the same adjustment gain is determined for each audio frequency point according to the reference amplitude and the amplitude threshold.

In this embodiment, the adjustment gain determined for each frequency point audio in the audio signal is the same, that is to say, when the audio signal is preprocessed, each frequency point in the audio signal is adjusted according to the determined adjustment gain. The audio at one frequency is all reduced according to the adjusted gain to ensure that after preprocessing and audio processing at all levels, the audio amplitude of each frequency in the audio signal does not exceed the amplitude threshold of the audio processing chip.

Therefore, it is necessary to determine the adjustment gain in combination with the maximum value of the first amplitude calculated for each frequency point audio in the audio chip as a reference amplitude, thus, as long as the determined adjustment gain makes the first amplitude If the frequency point audio with the largest value satisfies the amplitude value after preprocessing and audio processing at all levels does not exceed the amplitude threshold, then the amplitude value of other frequency point audio in the audio signal after preprocessing and audio processing at all levels will not exceed the amplitude threshold .

In another embodiment, step S150 includes:

Determine the adjustment gain for the corresponding super-amplitude frequency point audio according to the first amplitude corresponding to each super-amplitude frequency point audio; and

The adjustment gain of audio frequency points other than the super-amplitude frequency point audio in the audio signal is determined to be 0dB.

In this embodiment, the adjustment gain of audio frequency points other than the super-amplitude frequency point in the audio signal is determined to be 0dB, and the corresponding first amplitude value of the audio frequency point of the super-amplitude frequency point corresponds to each super-amplitude frequency point Audio OK adjusts the gain. That is to say, in the preprocessing stage, the amplitude of the audio signal actually changes, that is, the amplitude is attenuated. The magnitude is practically unchanged during the preprocessing stage.

Only the amplitude of the super-amplitude frequency point audio in the audio signal is changed in the preprocessing stage, and the amplitude of other audio frequencies in the audio signal except the superamplitude frequency point remains unchanged in the preprocessing stage, thereby avoiding In the preprocessing process, the amplitude of the non-excess frequency point audio in the audio signal is changed, thereby reducing unnecessary changes to the audio signal caused by the preprocessing.

In one embodiment, adjusting the gain is used to attenuate the audio frequency at the corresponding frequency point. As shown in FIG. 9, the audio processing method further includes:

Step S180, determine the compensation gain for each frequency point audio according to the initial amplitude of the super-amplitude frequency point audio, the corresponding gain information and the amplitude threshold, and the compensation gain is used to amplify the amplitude of the corresponding frequency point audio, so that each frequency point The amplitude of the point audio after being processed according to the gain indicated by the corresponding gain information, the corresponding adjustment gain and the corresponding compensation gain does not exceed the amplitude threshold.

In this embodiment, after step S170, the audio processing method further includes:

Step S190, after completing the audio processing at all levels, perform compensation processing on the audio at each frequency point according to the corresponding compensation gain.

In order to avoid excessive attenuation of the amplitude of the audio signal by preprocessing, generally when determining the adjustment gain, it is determined based on the principle that the amplitude of the frequency point audio after preprocessing and audio processing at all levels in the audio chip does not exceed the amplitude threshold In addition to adjusting the gain, the amplitude of the audio signal is also specifically limited when the audio signal is output to the audio chip after being processed by various stages of the audio chip, for example, the amplitude of the output audio chip is not lower than the third amplitude threshold (of course, the third amplitude threshold is less than Amplitude threshold), so as to avoid excessive attenuation of the audio frequency of each frequency point in the audio signal in the preprocessing, resulting in excessive adjustment of the audio signal.

In other words, it is equivalent to limiting the range of options for adjusting the gain. Therefore, if the range is too small, in practice, even if theoretically based on the initial amplitude of the audio at the middle frequency point of the audio signal, the corresponding adjustment gain and the corresponding gain information The amplitude after the indicated gain processing does not exceed the amplitude threshold. Due to the influence of other conditions, the audio signal may also be clipped and distorted in the actual audio processing at all levels of the audio processing chip. Therefore, in this case, the technical solution of this embodiment can be adopted, and by setting the compensation gain, the optional range of the adjustment gain can be broadened, for example, the determined adjustment gain can be increased and attenuated during the preprocessing process. To avoid clipping distortion caused by other conditions during the audio processing at all levels, and then through the set compensation gain, the audio signal after audio processing at all levels of the audio chip is processed according to the compensation gain Amplifying, so as to ensure that the amplitude of the audio signal output from the audio chip is not lower than the third amplitude threshold and does not exceed the amplitude threshold of the audio chip.

By determining the adjustment gain and compensation gain for each frequency point audio in the audio signal, and performing amplitude attenuation on the corresponding frequency point audio in the preprocessing process according to the adjustment gain, and according to the compensation gain in the compensation process for the corresponding frequency point audio The amplitude of the frequency point audio is amplified, thereby improving the fault tolerance in the audio processing process. Specifically, on the one hand, by performing compensation processing according to the determined compensation gain, amplitude compensation, that is, amplitude amplification, can be performed on the frequency point audio with a large amplitude attenuation in the preprocessing, thereby providing more information for the determination of the adjustment gain. Large selection interval; on the other hand, since there may be attenuation of the amplitude of the non-excessive frequency point audio in the audio signal in the preprocessing stage, the amplitude of the non-excessive frequency point audio can be adjusted in the compensation processing stage Compensation to compensate for the amplitude attenuation of non-overrange frequency audio in the preprocessing stage.

For the audio processing process performed by the audio chip corresponding to Figure 3, according to the technical solution of the embodiment corresponding to Figure 9, the audio processing process performed by the audio processing chip is shown in Figure 10, that is, before presale processing, according to The determined adjustment gain preprocesses the audio of each frequency point in the audio signal. After completing all levels of audio processing, that is, after completing the advanced sound effect processing, the audio signal is compensated according to the determined compensation gain, and then the compensation process The final audio signal is played through the loudspeaker.

In one embodiment, step S150 includes:

The adjustment gain of each frequency point audio is determined according to the initial amplitude of the super-amplitude frequency point audio, the corresponding gain information and the second amplitude threshold of the audio processing chip, so that each frequency point audio is adjusted according to the corresponding adjustment gain and the corresponding gain The amplitude after gain processing indicated by the information does not exceed the second amplitude threshold, and the second amplitude threshold is smaller than the amplitude threshold.

In this embodiment, the adjustment gain is determined for each frequency point audio in the audio signal by setting a second amplitude threshold smaller than the amplitude threshold for the audio processing chip, thereby facilitating the determination of the adjustment gain and the compensation gain respectively, and It can be guaranteed that the audio amplitude of each frequency point does not exceed the amplitude threshold of the audio processing chip after preprocessing is performed according to the determined adjustment gain, the corresponding gain information indicates the gain and the determined corresponding compensation gain is compensated.

In an embodiment, the compensation gain of the frequency point audio whose adjusted gain is 0 dB in the audio signal is determined to be 0 dB.

In this embodiment, during the compensation process, only the frequency point audio whose amplitude actually changes during the preprocessing process is actually amplified. In this way, it is avoided to amplify the audio amplitude of frequency points in the audio signal that do not need to be compensated during the compensation process.

The following is an embodiment of the device disclosed in the present disclosure, which can be used to execute the embodiment of the audio processing method performed by the above-mentioned audio playback terminal in the present disclosure. For details not disclosed in the embodiment of the device disclosed in the present disclosure, please refer to the embodiment of the audio processing method disclosed in the present disclosure.

Fig. 11 is a block diagram of an audio processing device according to an exemplary embodiment, the audio processing device is configured in a terminal integrated with an audio processing chip, and executes all or part of the steps of any one of the audio processing methods shown above. As shown in Figure 11, the audio processing device includes but is not limited to:

The gain information acquiring module 110 is configured to: for the audio signal to be processed in the audio processing chip, acquire the gain information applicable to the audio processing at each level of the audio processing chip for each frequency point in the audio signal.

The super-amplitude frequency point audio determination module 130 is configured to: determine the super-amplitude frequency point audio in the audio signal according to the gain information and the initial amplitude of each frequency point audio, and the super-amplitude frequency point audio is in the audio signal according to the gain information After the indicated gain processing, the frequency point audio whose amplitude exceeds the amplitude threshold of the audio processing chip.

The adjustment gain determination module 150 is configured to: determine the adjustment gain for each frequency point audio in the audio signal according to the initial amplitude of the super-amplitude frequency point audio and the corresponding gain information, so that each frequency point audio frequency is adjusted according to the corresponding gain The processed amplitude of the gain indicated by the information and the corresponding adjusted gain does not exceed the amplitude threshold.

The preprocessing module 170 is configured to preprocess the audio at each frequency point according to the corresponding adjusted gain before performing audio processing at various levels on the audio signal.

For the implementation process of the functions and functions of each module in the above device, please refer to the implementation process of the corresponding steps in the above audio processing method for details, and will not be repeated here.

It can be understood that these modules can be implemented by hardware, software, or a combination of both. When implemented in hardware, these modules may be implemented as one or more hardware modules, such as one or more application specific integrated circuits. When implemented in software, the modules may be implemented as one or more computer programs executing on one or more processors, such as a program stored in memory executed by a processor of an audio processing chip.

In one embodiment, audio processing at all levels includes initial audio processing and sound effect processing, and the gain information acquisition module 110 includes:

The initial adjustment gain acquisition unit is configured to: acquire the initial adjustment gain set by the audio processing chip for the signal from the signal interface according to the signal interface from which the audio signal originates. as well as

The sound effect gain acquiring unit is configured to: acquire the sound effect gain set for each frequency point audio in the sound effect mode selected for audio playback.

The gain information acquisition unit is configured to: obtain the gain information applicable to each frequency point audio in audio processing at each level according to the initial adjustment gain and the sound effect gain corresponding to each frequency point audio.

In one embodiment, the sound effect mode includes a basic sound effect mode and an advanced sound effect mode, and the sound effect gain acquisition unit includes:

The gain obtaining unit is configured to: obtain the first gain set for each frequency point audio in the basic sound effect mode according to the selected basic sound effect mode and the selected advanced sound effect mode for audio playback, and obtain The second gain set for each frequency point audio in the advanced sound effect mode.

The sound effect gain calculation unit is configured to: calculate and obtain the sound effect gain corresponding to each frequency point audio according to the corresponding first gain and the corresponding second gain of each frequency point audio.

In one embodiment, the super-amplitude frequency point audio determination module 130 includes:

The first amplitude value calculation unit is configured to: calculate the first amplitude value of each frequency point audio after gain processing according to the gain indicated by the corresponding gain information according to the initial amplitude value of each frequency point audio.

The super-amplitude frequency point audio determination unit is configured to: determine the frequency point audio corresponding to the first amplitude exceeding the amplitude threshold in the audio signal as the super-amplitude frequency point audio.

In one embodiment, the adjustment gain determination module 150 includes:

The reference amplitude determination unit is configured to: determine the maximum value of the first amplitudes as the reference amplitude according to the first amplitude corresponding to each super-amplitude frequency point audio.

The adjustment gain determination unit is configured to: determine the same adjustment gain for each frequency point audio according to the reference amplitude and the amplitude threshold.

In another embodiment, the adjustment gain determination module 150 includes:

The first adjustment gain determining unit is configured to: determine the adjustment gain for the corresponding super-frequency audio according to the first amplitude corresponding to each super-frequency audio. as well as

The second adjustment gain determination unit is configured to: determine the adjustment gains of audio at other frequency points in the audio signal except the audio at super-amplitude frequency points as 0 dB.

In one embodiment, adjusting the gain is used to attenuate the audio frequency of the corresponding frequency point, and the audio processing device also includes:

The compensation gain determination module is configured to: determine the adjustment gain of each frequency point audio according to the initial amplitude of the super-amplitude frequency point audio, the corresponding gain information and the second amplitude threshold of the audio processing chip, so that each frequency point audio The amplitude processed according to the corresponding adjusted gain and the gain indicated by the corresponding gain information does not exceed the second amplitude threshold, and the second amplitude threshold is smaller than the amplitude threshold.

In this embodiment, the audio processing device also includes:

The compensation processing module is configured to perform compensation processing on the audio at each frequency point according to the corresponding compensation gain after completing the audio processing at all levels.

In one embodiment, the adjustment gain determination module 150 includes:

The third adjustment gain determination unit is configured to: determine the adjustment gain of each frequency point audio according to the initial amplitude of the super-amplitude frequency point audio, the corresponding gain information, and the second amplitude threshold of the audio processing chip, so that each frequency The amplitude of the point audio processed according to the corresponding adjusted gain and the gain indicated by the corresponding gain information does not exceed the second amplitude threshold, and the second amplitude threshold is smaller than the amplitude threshold.

In an embodiment, the compensation gain of the frequency point audio whose adjusted gain is 0 dB in the audio signal is determined to be 0 dB.

For the implementation process of the functions and functions of each module/unit in the above device, please refer to the implementation process of the corresponding steps in the above audio processing method for details, and will not be repeated here.

Optionally, the present disclosure further provides an audio processing device, which can be used in a terminal integrated with an audio processing chip to execute all or part of the steps in any one of the audio processing methods shown above. As shown in FIG. 12 , the audio processing device includes but not limited to: a processor 1001 and a memory 1002 .

Wherein, the memory 1002 stores computer-readable instructions, and when the computer-readable instructions are executed by the processor 1001, the method in any one of the above method implementations is realized.

Wherein, when the executable instruction is executed by the processor 1001, the method in any of the above embodiments is implemented. The executable instructions are, for example, computer readable instructions. When the processor 1001 executes, the processor reads the computer readable instructions stored in the memory through the communication line/bus 1003 connected to the memory.

The specific manner in which the processor in this embodiment performs operations has been described in detail in the embodiment of the audio processing method, and will not be described in detail here.

In an exemplary embodiment, there is also provided a storage medium, which is a computer-readable storage medium, such as a transitory and non-transitory computer-readable storage medium including instructions. A computer program is stored thereon, and when the computer program is executed by the processor, the method in any one of the above method embodiments is implemented. The storage medium includes, but is not limited to, a memory for instructions, which can be executed by a processor to complete the above audio processing method.

The specific manner in which the processor in this embodiment performs operations has been described in detail in the embodiment of the audio processing method, and will not be described in detail here.

It should be understood that the present invention is not limited to the precise constructions which have been described above and shown in the accompanying drawings, and various modifications and changes may be made without departing from the scope thereof. The scope of the invention is limited only by the appended claims.

Claims (10)

1. An audio processing method, characterized in that the method comprises: For the audio signal to be processed in the audio processing chip, obtain the gain information applicable to the audio processing at each level of the audio processing chip for each frequency point in the audio signal; According to the gain information and the initial amplitude of each frequency point audio, determine the super-amplitude frequency point audio in the audio signal, and the super-amplitude frequency point audio is determined according to the gain information in the audio signal After indicating the gain processing, the frequency point audio whose amplitude exceeds the amplitude threshold of the audio processing chip; According to the initial amplitude of the super-amplitude frequency point audio and the corresponding gain information, an adjustment gain is correspondingly determined for each frequency point audio in the audio signal, so that the each frequency point audio is in accordance with the corresponding The gain indicated by the gain information and the processed amplitude corresponding to the adjusted gain do not exceed the amplitude threshold; Before performing the audio processing at all levels on the audio signal, the audio of each frequency point is pre-processed according to the corresponding adjustment gain. 2. The method according to claim 1, wherein the audio processing at all levels includes initial audio processing and sound effect processing, and obtaining the audio signal in the audio signal for the audio signal to be processed in the audio processing chip The gain information applicable to the audio processing of each frequency point audio at all levels of the audio processing chip, including: According to the signal interface from which the audio signal originates, obtain the initial adjustment gain set by the audio processing chip for the signal originating from the signal interface; and Obtain the sound effect gain set for each frequency point audio in the sound effect mode selected for audio playback; According to the initial adjustment gain and the sound effect gain corresponding to each frequency point audio, the gain information applicable to each frequency point audio in the audio processing at each level is obtained. 3. The method according to claim 2, wherein the sound effect mode includes a basic sound effect mode and an advanced sound effect mode, and the sound effect mode selected for audio playback is selected for each frequency point audio in the acquisition. Set the sound effect gain, including: According to the selected basic sound effect mode and the selected advanced sound effect mode for audio playback, obtain the first gain set for each frequency point audio in the basic sound effect mode, and obtain the advanced sound effect The second gain set for each frequency point audio in the mode; The sound effect gain corresponding to each frequency point audio is calculated according to the first gain corresponding to each frequency point audio and the corresponding second gain. 4. The method according to claim 1, characterized in that, determining the super-amplitude frequency point audio in the audio signal according to the gain information and the initial amplitude of each frequency point audio, comprising: Calculate the first amplitude value of each frequency point audio according to the gain processing indicated by the corresponding gain information according to the initial amplitude value of each frequency point audio; Determining the frequency point audio corresponding to the first amplitude in the audio signal exceeding the amplitude threshold as super-amplitude frequency point audio. 5. The method according to claim 4, wherein the initial amplitude and the corresponding gain information according to the super-amplitude frequency point audio are corresponding to each frequency point audio in the audio signal Determine tuning gains, including: According to the first amplitude value corresponding to each of the super-amplitude frequency point audio, the maximum value of the first amplitude value is determined as a reference amplitude value; Determine the same adjustment gain for the audio at each frequency point according to the reference amplitude and the amplitude threshold. 6. The method according to claim 4, wherein the initial amplitude and the corresponding gain information according to the superamplitude frequency point audio are corresponding to each frequency point audio in the audio signal Determine tuning gains, including: Determine the adjustment gain for the corresponding super-amplitude frequency point audio according to the first amplitude corresponding to each of the super-amplitude frequency point audio; and The adjustment gains of other frequency point audios in the audio signal except the superamplitude frequency point audio are determined as 0 dB. 7. The method according to claim 1, wherein the adjusting gain is used to attenuate the amplitude of the corresponding frequency point audio, and the method further comprises: Determine a compensation gain for each frequency point audio according to the initial amplitude of the super-amplitude frequency point audio, the corresponding gain information, and the amplitude threshold, and the compensation gain is used for the corresponding frequency point audio Amplifying the amplitude so that the audio at each frequency point is processed according to the gain indicated by the corresponding gain information, the corresponding adjusted gain, and the corresponding compensation gain, so that the amplitude value after processing does not exceed the amplitude threshold; Before performing the various levels of audio processing on the audio signal, after preprocessing the audio at each frequency point according to the corresponding adjusted gain, the method further includes: After the audio processing at each level is completed, the audio at each frequency point is compensated according to the corresponding compensation gain. 8. The method according to claim 7, wherein the determining the adjustment gain for the audio signal according to the initial amplitude of the super-amplitude frequency point audio and the corresponding gain information comprises: Determine the adjusted gain of each frequency point audio according to the initial amplitude of the super-amplitude frequency point audio, the corresponding gain information, and the second amplitude threshold of the audio processing chip, so that each The amplitude of the frequency point audio processed according to the corresponding adjusted gain and the gain indicated by the corresponding gain information does not exceed the second amplitude threshold, and the second amplitude threshold is smaller than the amplitude threshold. 9. The method according to claim 7, characterized in that the compensation gain of the frequency point audio whose adjusted gain is 0dB in the audio signal is determined as 0dB. 10. An audio processing device, characterized in that the device comprises: The gain information acquisition module is configured to: acquire, for the audio signal to be audio processed in the audio processing chip, the gain information applicable to audio processing at each level of the audio processing chip for each frequency point in the audio signal; The super-amplitude frequency point audio determination module is configured to: determine the super-amplitude frequency point audio in the audio signal according to the gain information and the initial amplitude of each frequency point audio, and the super-amplitude frequency point audio It is the frequency point audio whose amplitude exceeds the amplitude threshold of the audio processing chip after the gain processing indicated by the gain information in the audio signal; The adjustment gain determination module is configured to: determine the adjustment gain for each frequency point audio in the audio signal according to the initial amplitude value of the super-amplitude frequency point audio, the corresponding gain information, and the amplitude threshold so that the amplitude of the audio at each frequency point processed according to the gain indicated by the corresponding gain information and the corresponding adjusted gain does not exceed the amplitude threshold; The preprocessing module is configured to: perform preprocessing on the audio at each frequency point according to the corresponding adjustment gain before performing the audio processing at each level on the audio signal.

Images