CN113990345A

CN113990345A - Audio processing method and device, electronic equipment and storage medium

Info

Publication number: CN113990345A
Application number: CN202111194534.9A
Authority: CN
Inventors: 钟楠
Original assignee: Guangdong Oppo Mobile Telecommunications Corp Ltd
Current assignee: Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date: 2021-10-13
Filing date: 2021-10-13
Publication date: 2022-01-28

Abstract

The application discloses an audio processing method, an audio processing device, electronic equipment and a storage medium. The method comprises the following steps: acquiring a first parameter of first audio data; the first parameter is used for describing sound characteristics corresponding to the first audio data; stopping processing the first audio data when the first parameter meets a first set condition; wherein, the first set condition represents that the sound pressure level and/or the frequency corresponding to the audio data are/is out of the auditory response range of human ears.

Description

Audio processing method and device, electronic equipment and storage medium

Technical Field

The present application relates to the field of software, and in particular, to an audio processing method and apparatus, an electronic device, and a storage medium.

Background

In the related art, in the process of audio playing, continuous data processing needs to be performed on audio data, which increases the power consumption of the electronic device and reduces the duration of the electronic device.

Disclosure of Invention

In view of this, embodiments of the present application provide an audio processing method, an apparatus, an electronic device, and a storage medium, so as to at least solve the problems that power consumption of the electronic device is increased and duration of the electronic device is reduced due to continuous processing of audio by the electronic device in the related art.

The technical scheme of the embodiment of the application is realized as follows:

the embodiment of the application provides an audio processing method, which comprises the following steps:

acquiring a first parameter of first audio data; the first parameter is used for describing sound characteristics corresponding to the first audio data;

stopping processing the first audio data when the first parameter meets a first set condition; wherein the content of the first and second substances,

the first set condition represents that the sound pressure level and/or the frequency corresponding to the audio data are/is out of the auditory response range of human ears.

In the foregoing solution, the obtaining the first parameter of the first audio data includes:

under the condition that an application is detected to call a first service process, acquiring a first parameter of the first audio data transmitted to the first service process; wherein the content of the first and second substances,

the first service process characterizes a service process for performing audio playback.

In the foregoing solution, the stopping the processing of the first audio data when the first parameter satisfies a first setting condition includes:

and stopping processing the first audio data under the condition that the duration of the first parameter meeting a first set condition is greater than a set threshold.

In the foregoing solution, the stopping the processing of the first audio data includes:

closing the first service process; or the like, or, alternatively,

and controlling the first service process to be in a dormant state.

controlling the first service process to stop performing algorithm processing on the first audio data; and/or the presence of a gas in the gas,

and controlling the first service process to stop transmitting the first audio data to a driving layer.

In the above scheme, the method further comprises:

power to the audio output device and/or the audio processing chip is stopped.

An embodiment of the present application further provides an audio processing apparatus, including:

an acquisition unit configured to acquire a first parameter of first audio data; the first parameter is used for describing sound characteristics corresponding to the first audio data;

the processing unit is used for stopping processing the first audio data under the condition that the first parameter meets a first set condition; wherein the content of the first and second substances,

An embodiment of the present application further provides an electronic device, including: a processor and a memory for storing a computer program capable of running on the processor,

wherein the processor is configured to perform the steps of any of the above methods when running the computer program.

Embodiments of the present application also provide a storage medium having a computer program stored thereon, where the computer program is executed by a processor to implement the steps of any one of the above methods.

In the embodiment of the application, the audio data outside the hearing range of human ears is stopped being processed by analyzing the sound characteristics of the audio data, so that the power consumption of the electronic equipment can be reduced under the condition of not influencing the playing of the audio data.

Drawings

Fig. 1 is a schematic flow chart illustrating an implementation of an audio processing method according to an embodiment of the present application;

FIG. 2 is a graphical illustration of the range of auditory responses of a human ear provided by an embodiment of the present application;

fig. 3 is a schematic flow chart illustrating an implementation of an audio processing method according to an embodiment of the present application;

fig. 4 is a schematic structural diagram of an audio processing apparatus according to an embodiment of the present application;

fig. 5 is a schematic diagram of a hardware component structure of an electronic device according to an embodiment of the present application.

Detailed Description

The present application will be described in further detail with reference to the following drawings and specific embodiments.

In the following description, for purposes of explanation and not limitation, specific details are set forth, such as particular system structures, techniques, etc. in order to provide a thorough understanding of the embodiments of the present application. It will be apparent, however, to one skilled in the art that the present application may be practiced in other embodiments that depart from these specific details. In other instances, detailed descriptions of well-known systems, devices, and methods are omitted so as not to obscure the description of the present application with unnecessary detail.

The technical means described in the embodiments of the present application may be arbitrarily combined without conflict.

In addition, in the embodiments of the present application, "first", "second", and the like are used for distinguishing similar objects, and are not necessarily used for describing a specific order or a sequential order.

In addition, the term "at least one" herein means any combination of at least two of any one or more of a plurality, for example, including at least one of A, B, C, and may mean including any one or more elements selected from the group consisting of A, B and C.

Fig. 1 is a schematic flow chart of an audio processing method according to an embodiment of the present application, and as shown in fig. 1, the method includes:

s101: acquiring a first parameter of first audio data; the first parameter is used for describing a sound characteristic corresponding to the first audio data.

Here, when there is a situation that an application needs to play audio data, for example, in a process that a video playing application executes a playing task, the audio playing application outputs audio data and video data, and the audio data generated by the application needs to be subjected to corresponding audio processing to generate final output audio data.

In an embodiment, the obtaining the first parameter of the first audio data includes:

Here, the first service process is a service process capable of performing audio playing, for example, processing audio data, and outputting the audio data through a playing interface after the audio data is processed to implement audio playing, so that when an application needs to play the audio data, the application may be a local application, for example, a local music playing application equipped in an electronic device, or may be a third-party application downloaded and installed, for example, a third-party video playing application, which needs to invoke the first service process and transmit the first audio data to be played to the first service process, and the first audio data transmitted to the first service process is transmitted to an audio service layer, so that the first audio data may be analyzed in terms of sound characteristics at the audio service layer to obtain a first parameter of the first audio data.

S102: stopping processing the first audio data when the first parameter meets a first set condition; wherein the content of the first and second substances,

Here, the first parameter of the first audio data is used to describe a corresponding sound characteristic of the first audio data, and therefore, it may be determined whether to process the first audio data based on the sound characteristic of the first audio data, that is, whether to process the audio data according to sound characteristics of different audio data generated by different applications on the electronic device, and it is not limited that the electronic device stops processing the audio data in a mute playing mode, and an applicable scenario of power saving may be increased, which is more beneficial to reducing power consumption of the electronic device.

In this embodiment, when the sound pressure level and/or frequency corresponding to the first audio data is outside the auditory response range of the human ear, the processing of the first audio data is stopped, that is, when the first audio data cannot be heard by the user, the processing of the first audio data is stopped.

As shown in fig. 2, fig. 2 shows a schematic diagram of the range of auditory responses of a human ear. The auditory response range of the human ear depends not only on the sound pressure level, but also on the frequency of the sound, since the human ear feels different for different frequencies at the same sound pressure level, which is different from the sound pressure level

Wherein p represents the sound pressure to be measured, and p (ref) represents the reference sound pressure. The audible sound pressure level range of human ears is about 0 dB-120 dB, and the audible sound frequency range of human ears is about 20 Hz-20000 Hz, so that the audible sound pressure level range and the audible sound frequency range of human ears jointly form the audible response range of human ears, when the sound pressure level of the first audio data is within the range of 0 dB-120 dB and the frequency of the first audio data is within the range of 20 Hz-20000 Hz, the first audio data can be determined to be audible by human ears, the first audio data can be processed, and finally the first audio data is output.

In practical applications, the sound pressure level or the frequency in the first parameter of the first audio data may be detected first, and for example, when the sound pressure level of the first audio data is outside the range of 0dB to 120dB or the frequency of the first audio data is outside the range of 20Hz to 20000Hz, it may be determined that the first audio data cannot be heard by the human ear, and the processing of the first audio data may be stopped. When the sound pressure level of the first audio data is within the range of 0dB to 120dB, it is further determined whether the frequency of the first audio data is within the range of 20Hz to 20000Hz, or, when the frequency of the first audio data is within the range of 20Hz to 20000Hz, it is further determined whether the sound pressure level of the first audio data is within the range of 0dB to 120 dB. For example, during the video call between the user a and the user B, audio data and video data are generated, when the user B turns off the microphone, the volume of the audio data transmitted to the user a is 0, that is, the audio data transmitted to the user a is out of the range of the auditory response of the human ear, and after receiving the audio data, the audio data is not processed, and only the received video data is processed.

In practical applications, stopping processing the first audio data can reduce power consumption of the electronic device, and can improve cruising ability of the electronic device compared to a scenario in which other processing is performed on the audio data, as shown in table 1, where table 1 shows currents required in different scenarios.

TABLE 1

Scene	Scene current	Saved current
			Mute externally playing music	45mA	0mA
Mute music playing and audio output equipment power supply turning off	37mA	8mA
			Ceasing processing of audio data	32mA	13mA

As can be seen from table 1, when the processing of the first audio data is stopped, the power consumption current of the electronic device can be optimized to the maximum, and compared with the scheme of simply turning off the audio output device, the power consumption current of the electronic device can be optimized by about 5mA, so that the power consumption current optimization method has a good energy-saving effect.

In an embodiment, the stopping the processing of the first audio data in the case that the first parameter satisfies a first set condition includes:

Here, in a case where there may be a pause audio segment in the first audio data, such that a corresponding first parameter of the first audio data in a certain section is outside an auditory response range of human ears, but the proportion of such audio segment in the entire first audio data is not large, the first audio data is still valid audio data and can be heard by human ears, in order to avoid determining to stop processing the first audio data due to a partial silence segment in the first audio data, when it is determined that the first parameter satisfies a first setting condition, it is further determined that a duration of the first parameter satisfying the first setting condition is long, and when an audio data segment of the first audio data outside the response range of human ears is long enough, it is determined that none of the first audio data can be heard by human ears. In this embodiment, the setting threshold may be set to 1 minute, that is, the duration in which the first parameter of the first audio data satisfies the first setting condition is longer than 1 minute, and it may be assumed that the first audio data is not audible to the human ear, and the processing of the first audio data is stopped.

In one embodiment, the stopping the processing of the first audio data comprises:

closing the first service process; or the like, or, alternatively,

and controlling the first service process to be in a dormant state.

Here, since the first audio data is audio-processed in the first service process, when the processing of the first audio data is stopped, the first service process may be closed or controlled to be in a sleep state, and when the first service process is closed or in the sleep state, the power consumption of the electronic device may be reduced. In one case, when the first service process is closed, the first service process stops any processing on the audio data, and when the first service process is in a dormant state, the first service process can simply process other audio data, so that when no other audio data exists, the first service process can be preferentially selected to be closed, thereby achieving a better energy-saving effect, and when other audio data exists, the first service process can be preferentially controlled to be in the dormant state, thereby reducing the power consumption of the electronic device under the condition of maintaining normal playing of other audio data.

Here, when the first service process normally processes the audio data, the first service process performs algorithm processing on the audio data, writes the processed audio data into the driver layer, and plays the audio data through the driver layer. The algorithm processing may include sound effect algorithm processing, for example, dolby sound effect algorithm processing, and in the process of performing the algorithm processing on the audio data, consumption of resources of the electronic device is too large, so that the first service process may stop performing the algorithm processing on the first audio data when the first audio data is not required to be processed. The first audio data is out of the auditory response range of human ears, so the first audio data does not need to be output and played, and further, the first service process is controlled to stop transmitting the first audio data to the driving layer.

In an embodiment, the method further comprises:

power to the audio output device and/or the audio processing chip is stopped.

Here, for the audio data processed in the first service process, after the first service process writes the audio data into the driver layer, the audio driver thread of the first service process opens the corresponding physical device channel through the driver control, and the audio hardware abstraction layer writes the audio data into the audio processing chip and finally outputs the audio data to the audio output device for playing. Since the first audio data does not need to be processed by the algorithm, the first service process is controlled to stop processing the first audio data by the algorithm, and meanwhile, the power supply to the audio processing chip can be stopped. Further, the power supply to the audio output device, for example, the power supply to the speaker, the earphone, and the like, may also be stopped, so that the power consumption of the electronic device can be reduced.

In an embodiment, the method further comprises:

and stopping the audio processing of the first audio under the condition that the play mode is the mute mode.

Here, when the play mode of the electronic device is the mute mode, the audio output device on the electronic device does not output the first audio data if the first audio data is located within the hearing response range of the human ear, and in this case, the audio processing on the first audio data can be directly stopped, and it is not necessary to judge whether the first audio data is located within the hearing response range of the human ear, so that the processing efficiency of the audio data can be improved.

In the embodiment of the invention, whether the audio data is in the auditory response range of human ears is judged according to the sound characteristics of the audio data, so that whether the audio data needs to be processed is determined, the power-saving applicable scene of the electronic equipment can be further expanded, the energy consumption of the electronic equipment is reduced, and the cruising ability of the electronic equipment is improved.

The application also provides an application embodiment, as shown in fig. 3, fig. 3 shows a schematic diagram of an audio processing flow.

S301: and acquiring the sound characteristics of the audio data transmitted to the audio playing service thread under the condition that the application calls the audio playing service thread.

S302: it is detected whether the audio data is within a hearing response range of the human ear.

S303: and if the audio data is out of the hearing response range of the human ear, closing the audio playing service thread and stopping writing the audio data into the audio driver.

S304: and if the audio data are positioned in the hearing response range of the human ear, the audio playing service thread continues to process the audio data and writes the audio data into the driving layer.

S305: and starting an audio driving playing thread, wherein the audio driving playing thread can open a corresponding physical device channel through a driving control, and writes audio data into an audio processing chip through a hardware abstraction layer.

S306: and powering on the audio output equipment, and playing the audio data through the audio output equipment.

To implement the method according to the embodiment of the present application, an audio processing apparatus is further provided in the embodiment of the present application, fig. 4 is a schematic structural diagram of the audio processing apparatus according to the embodiment of the present application, please refer to fig. 4, where the apparatus includes:

an obtaining unit 401, configured to obtain a first parameter of first audio data; the first parameter is used for describing sound characteristics corresponding to the first audio data;

a processing unit 402, configured to stop processing the first audio data when the first parameter satisfies a first setting condition; wherein the content of the first and second substances,

In an embodiment, when acquiring the first parameter of the first audio data, the acquiring unit 401 is further configured to: under the condition that an application is detected to call a first service process, acquiring a first parameter of the first audio data transmitted to the first service process; wherein the content of the first and second substances,

In an embodiment, when the processing unit 402 stops processing the first audio data when the first parameter satisfies a first setting condition, the processing unit is further configured to:

In an embodiment, when stopping processing the first audio data, the processing unit 402 is further configured to:

closing the first service process; or the like, or, alternatively,

and controlling the first service process to be in a dormant state.

In an embodiment, the apparatus is further configured to:

power to the audio output device and/or the audio processing chip is stopped.

In an embodiment, the apparatus is further configured to:

In practical applications, the obtaining unit 401 and the processing unit 402 may be implemented by a processor in an audio processing device. Of course, the processor needs to run the program stored in the memory to realize the functions of the above-described program modules.

It should be noted that, when the audio processing apparatus provided in the embodiment of fig. 4 performs audio processing, only the division of the program modules is illustrated, and in practical applications, the processing may be distributed to different program modules according to needs, that is, the internal structure of the apparatus may be divided into different program modules to complete all or part of the processing described above. In addition, the audio processing apparatus and the audio processing method provided by the above embodiments belong to the same concept, and specific implementation processes thereof are described in the method embodiments and are not described herein again.

Based on the hardware implementation of the program module, and in order to implement the method according to the embodiment of the present application, an embodiment of the present application further provides an electronic device, and fig. 5 is a schematic diagram of a hardware composition structure of the electronic device according to the embodiment of the present application, and as shown in fig. 5, the electronic device includes:

a communication interface 1 capable of information interaction with other devices such as network devices and the like;

and the processor 2 is connected with the communication interface 1 to realize information interaction with other equipment, and is used for executing the audio processing method provided by one or more technical schemes when running a computer program. And the computer program is stored on the memory 3.

In practice, of course, the various components in the electronic device are coupled together by the bus system 4. It will be appreciated that the bus system 4 is used to enable connection communication between these components. The bus system 4 comprises, in addition to a data bus, a power bus, a control bus and a status signal bus. For the sake of clarity, however, the various buses are labeled as bus system 4 in fig. 5.

The memory 3 in the embodiment of the present application is used to store various types of data to support the operation of the electronic device. Examples of such data include: any computer program for operating on an electronic device.

It will be appreciated that the memory 3 may be either volatile memory or nonvolatile memory, and may include both volatile and nonvolatile memory. Among them, the nonvolatile Memory may be a Read Only Memory (ROM), a Programmable Read Only Memory (PROM), an Erasable Programmable Read-Only Memory (EPROM), an Electrically Erasable Programmable Read-Only Memory (EEPROM), a magnetic random access Memory (FRAM), a Flash Memory (Flash Memory), a magnetic surface Memory, an optical disk, or a Compact Disc Read-Only Memory (CD-ROM); the magnetic surface storage may be disk storage or tape storage. Volatile Memory can be Random Access Memory (RAM), which acts as external cache Memory. By way of illustration and not limitation, many forms of RAM are available, such as Static Random Access Memory (SRAM), Synchronous Static Random Access Memory (SSRAM), Dynamic Random Access Memory (DRAM), Synchronous Dynamic Random Access Memory (SDRAM), Double Data Rate Synchronous Dynamic Random Access Memory (DDRSDRAM), Enhanced Synchronous Dynamic Random Access Memory (ESDRAM), Enhanced Synchronous Dynamic Random Access Memory (Enhanced DRAM), Synchronous Dynamic Random Access Memory (SLDRAM), Direct Memory (DRmb Access), and Random Access Memory (DRAM). The memory 3 described in the embodiments of the present application is intended to comprise, without being limited to, these and any other suitable types of memory.

The method disclosed in the above embodiment of the present application may be applied to the processor 2, or implemented by the processor 2. The processor 2 may be an integrated circuit chip having signal processing capabilities. In implementation, the steps of the above method may be performed by integrated logic circuits of hardware or instructions in the form of software in the processor 2. The processor 2 described above may be a general purpose processor, a DSP, or other programmable logic device, discrete gate or transistor logic device, discrete hardware components, or the like. The processor 2 may implement or perform the methods, steps and logic blocks disclosed in the embodiments of the present application. A general purpose processor may be a microprocessor or any conventional processor or the like. The steps of the method disclosed in the embodiments of the present application may be directly implemented by a hardware decoding processor, or implemented by a combination of hardware and software modules in the decoding processor. The software modules may be located in a storage medium located in the memory 3, and the processor 2 reads the program in the memory 3 and in combination with its hardware performs the steps of the aforementioned method.

When the processor 2 executes the program, the corresponding processes in the methods according to the embodiments of the present application are realized, and for brevity, are not described herein again.

In an exemplary embodiment, the present application further provides a storage medium, i.e. a computer storage medium, specifically a computer readable storage medium, for example, including a memory 3 storing a computer program, which can be executed by a processor 2 to implement the steps of the foregoing method. The computer readable storage medium may be Memory such as FRAM, ROM, PROM, EPROM, EEPROM, Flash Memory, magnetic surface Memory, optical disk, or CD-ROM.

In the several embodiments provided in the present application, it should be understood that the disclosed apparatus, terminal and method may be implemented in other manners. The above-described device embodiments are only illustrative, for example, the division of the unit is only one logical function division, and there may be other division ways in actual implementation, such as: multiple units or components may be combined, or may be integrated into another system, or some features may be omitted, or not implemented. In addition, the coupling, direct coupling or communication connection between the components shown or discussed may be through some interfaces, and the indirect coupling or communication connection between the devices or units may be electrical, mechanical or other forms.

The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed on a plurality of network units; some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, all functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may be separately regarded as one unit, or two or more units may be integrated into one unit; the integrated unit can be realized in a form of hardware, or in a form of hardware plus a software functional unit.

Those of ordinary skill in the art will understand that: all or part of the steps for implementing the method embodiments may be implemented by hardware related to program instructions, and the program may be stored in a computer readable storage medium, and when executed, the program performs the steps including the method embodiments; and the aforementioned storage medium includes: a removable storage device, a ROM, a RAM, a magnetic or optical disk, or various other media that can store program code.

Alternatively, the integrated units described above in the present application may be stored in a computer-readable storage medium if they are implemented in the form of software functional modules and sold or used as independent products. Based on such understanding, the technical solutions of the embodiments of the present application may be essentially implemented or portions thereof that contribute to the prior art may be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for enabling an electronic device (which may be a personal computer, a server, or a network device) to execute all or part of the methods described in the embodiments of the present application. And the aforementioned storage medium includes: a removable storage device, a ROM, a RAM, a magnetic or optical disk, or various other media that can store program code.

The above description is only for the specific embodiments of the present application, but the scope of the present application is not limited thereto, and any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present application, and shall be covered by the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims

1. An audio processing method, comprising:

2. The method of claim 1, wherein obtaining the first parameter of the first audio data comprises:

3. The method according to claim 1, wherein stopping processing of the first audio data in the case that the first parameter satisfies a first set condition comprises:

4. The method of claim 1, wherein the stopping the processing of the first audio data comprises:

closing the first service process; or the like, or, alternatively,

and controlling the first service process to be in a dormant state.

5. The method of claim 1, wherein the stopping the processing of the first audio data comprises:

6. The method according to claim 4 or 5, characterized in that the method further comprises:

power to the audio output device and/or the audio processing chip is stopped.

7. The method of claim 1, further comprising:

8. An audio processing apparatus, comprising:

9. An electronic device, comprising: a processor and a memory for storing a computer program capable of running on the processor,

wherein the processor is adapted to perform the steps of the method of any one of claims 1 to 7 when running the computer program.

10. A storage medium having a computer program stored thereon, the computer program, when being executed by a processor, performing the steps of the method of any one of claims 1 to 7.