CN115373624A

CN115373624A - Audio signal processing method and device, terminal equipment and storage medium

Info

Publication number: CN115373624A
Application number: CN202110553062.5A
Authority: CN
Inventors: 苏荣津; 欧阳浔; 林春德
Original assignee: Guangdong Oppo Mobile Telecommunications Corp Ltd
Current assignee: Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date: 2021-05-20
Filing date: 2021-05-20
Publication date: 2022-11-22

Abstract

An audio signal processing method and apparatus, a terminal device, and a storage medium are provided, where the method is applied to a terminal device, the terminal device includes a first processing core and a second processing core, the first processing core is used to run a first operating system, the second processing core is used to run a second operating system, the first processing core is provided with a DSP module, and the method includes: and under the condition that the first operating system is in an idle state, the second operating system responds to an audio processing instruction and controls the DSP module to process the audio signal to be processed through a signal transmission channel established between the second operating system and the DSP module. By implementing the embodiment of the application, the second operating system of the terminal equipment can directly control the DSP module corresponding to the first operating system to process the audio signal under the condition that the first operating system is not awakened, so that the power consumption of the terminal equipment is reduced, and the efficiency of processing the audio signal by the terminal equipment is improved.

Description

Audio signal processing method and device, terminal equipment and storage medium

Technical Field

The present application relates to the field of electronic devices, and in particular, to an audio signal processing method and apparatus, a terminal device, and a storage medium.

Background

Currently, a plurality of processor cores may be provided on a terminal device (e.g., a mobile phone, a tablet computer, a smart wearable device, etc.), so that a plurality of operating systems may be installed. However, in practice, it is found that only a main operating system in the terminal device is usually provided with a Digital Signal Processing (DSP) module and is controlled by the main operating system to process data such as audio signals, and the power consumption of the main operating system of the terminal device is often very large, such an audio Signal Processing manner needs to wake up the main operating system frequently, which not only causes a large waste of power consumption, but also reduces the efficiency of the terminal device in Processing audio signals.

Disclosure of Invention

The embodiment of the application discloses an audio signal processing method and device, a terminal device and a storage medium, wherein a second operating system of the terminal device can directly control a DSP module corresponding to a first operating system to process audio signals under the condition that the first operating system is not awakened, so that the power consumption of the terminal device is reduced, and the efficiency of the terminal device for processing audio signals is improved.

A first aspect of the present embodiment discloses an audio signal processing method applied to a terminal device, where the terminal device includes a first processing core and a second processing core, the first processing core is configured to run a first operating system, the second processing core is configured to run a second operating system, the first processing core is provided with a DSP module, and the method includes:

and under the condition that the first operating system is in an idle state, the second operating system responds to an audio processing instruction and controls the DSP module to process the audio signal to be processed through a signal transmission channel established between the second operating system and the DSP module.

A second aspect of the embodiment of the present application discloses an audio signal processing apparatus, which is applied to a terminal device, where the terminal device includes a first processing core and a second processing core, the first processing core is used to run a first operating system, the second processing core is used to run a second operating system, the first processing core is provided with a DSP module, and the audio signal processing apparatus includes:

and the signal processing unit is used for responding to an audio processing instruction by the second operating system under the condition that the first operating system is in an idle state, and controlling the DSP module to process the audio signal to be processed through a signal transmission channel established between the second operating system and the DSP module.

A third aspect of the embodiments of the present application discloses a terminal device, which includes a memory and a processor, where the memory stores a computer program, and when the computer program is executed by the processor, the processor is enabled to implement all or part of the steps in any one of the audio signal processing methods disclosed in the first aspect of the embodiments of the present application.

A fourth aspect of the embodiments of the present application discloses a computer-readable storage medium, on which a computer program is stored, wherein the computer program, when executed by a processor, implements all or part of the steps in any one of the audio signal processing methods disclosed in the first aspect of the embodiments of the present application.

Compared with the related art, the embodiment of the application has the following beneficial effects:

in this embodiment, the terminal device may include a first processing core and a second processing core, where the first processing core may be configured to run a first operating system, the second processing core may be configured to run a second operating system, and the first processing core may further be provided with a digital signal processing DSP module. And under the condition that the first operating system is in an idle state, the second operating system can respond to an audio processing instruction and control the DSP module to process the audio signal to be processed. Therefore, by implementing the embodiment of the application, a signal transmission channel can be established between the second processing core and the DSP module of the first processing core in the terminal device, the second operating system in the awakening state can directly call the DSP module through the signal transmission channel and control the DSP module to process the audio signal to be processed, the first operating system does not need to be awakened, so that the phenomenon that the first operating system is frequently awakened to consume a large amount of power is avoided, and the reduction of the power consumption of the terminal device is facilitated; and the time consumed by awakening and switching to the first operating system can be saved, so that the terminal equipment can process the audio signal to be processed in time, the delay of the terminal equipment in processing the audio signal is greatly reduced, and the efficiency of the terminal equipment in processing the audio signal is effectively improved.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art that other drawings can be obtained according to the drawings without creative efforts.

Fig. 1 is a schematic view of an application scenario of an audio signal processing method disclosed in an embodiment of the present application;

fig. 2 is a schematic block diagram of a terminal device disclosed in an embodiment of the present application;

fig. 3A is a schematic connection relationship diagram of a terminal device in the related art disclosed in the embodiment of the present application;

fig. 3B is a schematic diagram of a connection relationship of another terminal device in the related art disclosed in the embodiment of the present application;

FIG. 4 is a flowchart illustrating an audio signal processing method according to an embodiment of the disclosure;

FIG. 5 is a schematic flow chart diagram of another audio signal processing method disclosed in the embodiments of the present application;

fig. 6A is a schematic connection relationship diagram of a first terminal device disclosed in an embodiment of the present application;

fig. 6B is a schematic connection relationship diagram of a second terminal device disclosed in the embodiment of the present application;

FIG. 7 is a schematic flow chart diagram illustrating a further audio signal processing method disclosed in an embodiment of the present application;

fig. 8A is a schematic connection relationship diagram of a third terminal device disclosed in the embodiment of the present application;

fig. 8B is a schematic diagram of a connection relationship of a fourth terminal device disclosed in the embodiment of the present application;

fig. 9 is a schematic diagram of another connection relationship of a terminal device disclosed in the embodiment of the present application;

FIG. 10 is a block diagram of an audio signal processing apparatus according to an embodiment of the disclosure;

fig. 11 is a schematic block diagram of another terminal device disclosed in an embodiment of the present application.

Detailed Description

The technical solutions in the embodiments of the present application will be described clearly and completely with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

It should be noted that the terms "comprises" and "comprising," and any variations thereof, in the embodiments of the present application, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.

The embodiment of the application discloses an audio signal processing method and device, a terminal device and a storage medium, wherein a second operating system of the terminal device can directly control a DSP module corresponding to a first operating system to process an audio signal under the condition that the first operating system is not awakened, so that the power consumption of the terminal device is reduced, and the efficiency of processing the audio signal by the terminal device is improved.

The following detailed description is made with reference to the accompanying drawings.

Referring to fig. 1, fig. 1 is a schematic view of an application scenario of an audio signal processing method disclosed in an embodiment of the present application, and includes a terminal device 100 and a user 200, where the terminal device 100 may detect an audio processing instruction issued by the user 200 and process an audio signal to be processed in response to the audio processing instruction. Alternatively, the audio processing instruction may be from the terminal device 100 itself (e.g., a processor, a processing core, etc. built in the terminal device 100) or an audio input device, an audio output device, etc. (not shown) connected to the terminal device 100, so that the terminal device 100 may automatically process the audio signal to be processed without the user 200 participating in the audio processing instruction from the source.

For example, the terminal device 100 may include various devices or systems having an audio signal processing function, such as a mobile phone, a smart wearable device, an in-vehicle terminal, a tablet Computer, a PC (Personal Computer), a PDA (Personal Digital Assistant), and the like, which is not particularly limited in this embodiment. It should be noted that the terminal device 100 shown in fig. 1 is a watch, which is only an example and does not constitute a limitation on the device type of the terminal device 100 in the embodiment of the present application.

Referring to fig. 2, fig. 2 is a schematic block diagram of a terminal device according to an embodiment of the present disclosure. As shown in fig. 2, the terminal device 100 may include a first processing core 110 and a second processing core 120, where the first processing core 110 may be configured to run a first operating system, and the second processing core 120 may be configured to run a second operating system (the first operating system and the second operating system are not shown). In order to implement an audio Signal Processing function, a Digital Signal Processing (DSP) module 111 may be disposed on the first Processing core 110 of the terminal device 100, and the DSP module 111 may be configured to process an audio Signal to be processed in the form of a Digital Signal (for example, a series of discretely-varying voltage signals, which is distinguished from an analog Signal in which a voltage value varies continuously), including performing coding and decoding, format conversion, filtering, equalization, gain increase or gain decrease, and the like on the audio Signal to be processed.

In the related art, if the first operating system of the terminal device is in an idle state and the second operating system is in an awake state, the second operating system often needs to wake up the first operating system first to call the DSP module disposed in the first processing core through the first operating system in order to process the audio signal to be processed. Illustratively, referring to fig. 3A, fig. 3A is a schematic diagram illustrating a connection relationship of the terminal device 100 employed in the related art. As shown in fig. 3A, a signal transmission channel is disposed between the first processing core 110 and the second processing core 120 of the terminal device 100, so that if the first operating system is in an idle state, if the second operating system needs to process an audio signal, the first operating system can only be woken up through the signal transmission channel. After the first operating system is woken up, the first operating system can control its corresponding DSP module 111 to process the audio signal to be processed (e.g., an audio signal collected by a microphone 130 connected to the DSP module 111, an audio signal transmitted to the first operating system by the second operating system, etc.). Therefore, such an audio signal processing mode can be implemented only after the first operating system is awakened to be switched from the idle state to the awakening state, which is relatively high in power consumption and low in efficiency, and is not beneficial to timely processing the audio signal to be processed.

As another scheme in the related art, as shown in fig. 3B, in addition to the first DSP module 111 disposed in the first processing core 110, the terminal device 100 further includes a second DSP module 121 disposed in the second processing core 120, so that when the first operating system is in an idle state, the second operating system can control the corresponding second DSP module 121 to process an audio signal to be processed (e.g., an audio signal collected by a microphone 130 connected to the second DSP module 121, an audio signal stored locally in the second processing core 120, etc.). However, such an audio signal processing method requires that the terminal device is provided with the DSP module in the first processing core, and the DSP module is also repeatedly provided in the second processing core, which not only wastes processor resources, but also increases the cost of processing the audio signal by the terminal device.

In order to solve the above problems, in this embodiment, when the first operating system of the terminal device 100 is in an idle state, the second operating system of the terminal device may respond to the audio processing instruction and control the DSP module 111 in the first processing core 110 corresponding to the first operating system to perform audio signal processing. Because the DSP module 111 is disposed in the first processing core 110, if the first operating system running on the first processing core 110 is in the wake-up state, the first operating system may directly invoke the DSP module 111 to control the DSP module 111 to process the audio signal to be processed. If the first operating system is in an idle state, the second operating system running on the second processing core 120 may also respond to the audio processing instruction, but does not wake up the first operating system, and directly obtain the control right of the DSP module 111 through a signal transmission channel between the second processing core 120 and the DSP module 111, so as to directly call the DSP module 111, and further control the DSP module 111 to process an audio signal.

Illustratively, the signal transmission channel may include a control channel and a data transmission channel (as shown in fig. 2), wherein the control channel may be used for the second operating system to send a control signal to the DSP module 111, and the data transmission channel may be used for transmitting an audio signal to be processed or having been processed between the second processing core 120 where the second operating system is located and the DSP module 111. By implementing the method, the problem that the first operating system must be awakened first to call the DSP module 111 in the related art can be solved, so that the first operating system is prevented from being frequently awakened to consume a large amount of power, and the power consumption of the terminal device 100 is reduced; and the time consumed by awakening and switching to the first operating system can be saved, so that the terminal device 100 can process the audio signal to be processed in time, the delay of the terminal device 100 in processing the audio signal is greatly reduced, and the efficiency of the terminal device 100 in processing the audio signal is effectively improved.

It should be noted that, in this embodiment of the application, the terminal device 100 may only have two processing cores (i.e., processor cores), and the two processing cores may be respectively disposed on two processors, or may be disposed on the same processor (i.e., a multi-core processor) to respectively run two operating systems. Optionally, as shown in fig. 2, when the terminal device 100 includes the first processing core 110 and the second processing core 120, a connection path may be provided between the first processing core 110 and the second processing core 120, so that a first operating system running on the first processing core 110 may establish a communication connection with a second operating system running on the second processing core 120.

The first processing core 110 may be a large core (i.e., a processor core with relatively rich functional modules and relatively strong computing power), and is configured to run a first operating system that implements various high-performance functions (including web browsing, audio/video call, and using all functions of an application program); the second processing core 120 may be a small core (i.e., a processor core with relatively simple support function and relatively weak computational capability), and is configured to run a second operating system that implements various basic functions (including network connection, collecting sensor data, using background functions of an application part, and the like). By constructing a framework of a double-operation system by large and small cores, the operation resources of the processor can be distributed according to different functional requirements, so that the terminal equipment can simultaneously keep good performance and power consumption.

In some embodiments, the terminal device 100 may also have more than two processing cores, and one of the processing cores may be provided with a DSP module, so that more than two operating systems may be installed, and in a manner similar to the dual operating system, an operating system running on a processing core that is not provided with a DSP module may directly control the DSP module to perform audio signal processing, so as to meet the requirement of the terminal device with multiple operating systems to implement audio signal processing.

Referring to fig. 4, fig. 4 is a flowchart illustrating an audio signal processing method disclosed in an embodiment of the present application, where the audio signal processing method may be applied to the terminal device, and the terminal device may include a first processing core and a second processing core, where the first processing core is used to run a first operating system, the second processing core is used to run a second operating system, and the first processing core is further provided with a digital signal processing DSP module. As shown in fig. 4, the audio signal processing method may include the steps of:

402. and under the condition that the first operating system is in an idle state, the second operating system responds to the audio processing instruction and controls the DSP module to process the audio signal to be processed through a signal transmission channel established between the DSP module and the DSP module corresponding to the first operating system.

The first operating system is in an idle state, which means that a first processing core for running the first operating system is not powered on, so that the first operating system is in an un-awakened state. Because the DSP module is disposed in the first processing core, the terminal device cannot call the DSP module to process the audio signal to be processed through the first operating system when the first operating system is in an idle state. On this basis, through a signal transmission channel between the second processing core of the terminal device and the DSP module, the second operating system running on the second processing core can directly control the DSP module, thereby implementing processing of the audio signal to be processed.

In some embodiments, the second operating system may obtain the control right of the DSP module by waking up the DSP module, so as to implement subsequent control operation on the DSP module. For example, when the first operating system is in an idle state, the second operating system may send a module wake-up instruction to the DSP module in response to the audio processing instruction, where the module wake-up instruction is used to wake up the DSP module and trigger the DSP module to be powered on. The module wake-up instruction may include a voltage signal with a certain amplitude, such as a high level signal (e.g., 3.3V, 5V, etc.), a low level signal (e.g., 0V, 0.1V, etc.), a voltage signal with a certain variation rule (e.g., a pulse signal, a square wave signal, etc.), and the like.

Specifically, for example, when receiving an audio processing instruction, the second operating system may generate a module wake-up instruction for the DSP module in response to the audio processing instruction, where the module wake-up instruction may include a voltage signal with a continuously high level. The second operating system may send the module wake-up instruction to the DSP module, for example, transmit the above-mentioned continuous high-level voltage signal through a connection path between the second processing core and a power Source terminal (Source), an Enable terminal (Enable), or other ports or pins of the DSP module, so that the DSP module may be triggered to power on by the voltage signal to wake up the DSP module.

After the DSP module is woken up, the second operating system may send a control signal to the DSP module through a control channel in the signal transmission channel, where the control signal may be used to control the woken-up DSP module to process the audio signal to be processed. For example, the second operating system may generate a corresponding control signal for configuring the DSP module according to the audio processing instruction, and then may send the control signal to the DSP module, so as to configure the DSP module according to the control signal, and perform a corresponding processing operation on the audio signal to be processed. For example, if the audio processing instruction corresponds to a control signal of "play audio", the second operating system may configure the DSP module as a decoder to decode an audio file stored in the terminal device, and then may subsequently output the decoded audio file through an audio output device such as a speaker, an earphone, or a sound box. For another example, if the audio processing instruction corresponds to a control signal of "playing soft music", the second operating system may configure the DSP module as an equalizer and a decoder to decode music files stored in the terminal device, and equalize the decoded music files according to the style of the soft music, so that the processed music files may be subsequently output through the audio output device. For another example, if the audio processing instruction corresponds to a control signal of "acquiring a recording", the second operating system may configure the DSP module as an encoder to encode a recording audio acquired by the terminal device through an audio input device such as a microphone, and then subsequently store the encoded recording audio file, or decode and play the encoded recording audio file again.

Illustratively, the audio processing instruction may include an audio processing instruction issued by a user, and may also include an audio processing instruction issued by the terminal device itself (e.g., a processor, a processing core, etc. built in the terminal device) or an audio input device, an audio output device, etc. connected to the terminal device.

Specifically, in one embodiment, the terminal device may detect an audio processing instruction issued by a user, where the audio processing instruction may include a touch operation, a key operation, a voice operation, and the like of the user for the terminal device. For example, when the first operating system of the terminal device is in an idle state and the second operating system is in an awake state, if the terminal device detects a touch operation such as a click or a swipe of a touch screen of the terminal device by a user, the second operating system may determine the touch operation to determine whether an audio processing instruction sent by the user is detected. For example, if the terminal device detects a touch operation such as a user clicking a "record" button and swiping music to be played, the second operating system may determine that an audio processing instruction issued by the user is detected. On this basis, the second operating system may control the DSP module to process a corresponding audio signal to be processed (e.g., a corresponding recorded audio, music to be played, etc.) according to the audio processing instruction.

In another embodiment, the terminal device may also obtain an audio processing instruction sent by the terminal device itself, where the audio processing instruction may include an audio processing instruction (such as alarm clock ringing, background music playing, and the like) automatically sent by the second operating system of the terminal device when running. For example, when the first operating system of the terminal device is in an idle state and the second operating system is in an awake state, the second operating system may further obtain the to-be-processed audio signal (e.g., a corresponding alarm clock ring, music to be played, etc.) corresponding to the audio processing instruction after obtaining the audio processing instruction, and may further process the to-be-processed audio signal according to the audio processing instruction.

It should be noted that the first operating system may include an upper operating system, such as an Android operating system and an iOS operating system, for running and implementing various high-performance functions (including web browsing, audio/video call, and using all functions of an application program); the second operating system may include a bottom operating system, such as an embedded operating system on the terminal device, for running and implementing various basic functions (including network connection, collecting sensor data, using background functions of application parts, and the like). Optionally, the second Operating System may adopt a Real Time Operating System (RTOS), so as to improve timeliness and reliability of a response of the second Operating System.

It is worth noting that, in some embodiments, the power consumption of the second operating system during operation may be lower than that of the first operating system during operation, and the terminal device controls the DSP module to perform audio signal processing through the second operating system, so that the time required for actually operating the first operating system may be reduced, that is, only the second operating system needs to be operated in a partial scene, and meanwhile, the frequency of switching the terminal device from the second operating system to the first operating system is further reduced, thereby greatly reducing the overall power consumption of the terminal device.

It can be seen that, with the method for processing audio signals described in the foregoing embodiment, the second operating system of the terminal device can directly control the DSP module corresponding to the first operating system to perform audio signal processing without waking up the first operating system, which not only avoids consuming a large amount of power due to frequently waking up the first operating system, but also is beneficial to reducing power consumption of the terminal device; and the time consumed by awakening and switching to the first operating system can be saved, so that the terminal equipment can process the audio signal to be processed in time, the delay of the terminal equipment in processing the audio signal is greatly reduced, and the efficiency of the terminal equipment in processing the audio signal is effectively improved.

Referring to fig. 5, fig. 5 is a flowchart illustrating another audio signal processing method disclosed in the embodiment of the present application, where the audio signal processing method may be applied to the terminal device, and the terminal device may include a first processing core and a second processing core, where the first processing core is used to run a first operating system, the second processing core is used to run a second operating system, and the first processing core is further provided with a digital signal processing DSP module. The audio processing instruction may specifically include an audio receiving instruction. The signal transmission channel may include a control channel and a data transmission channel. As shown in fig. 5, the audio signal processing method may include the steps of:

502. under the condition that the first operating system is in an idle state, the second operating system responds to the audio receiving instruction, and controls the DSP module corresponding to the first operating system to process the acquired audio signal to be processed through the control channel to obtain a processed first audio signal.

In this embodiment, when the audio processing instruction obtained by the terminal device is an audio receiving instruction, the second operating system may control, in response to the audio receiving instruction, the DSP module (i.e., the DSP module corresponding to the first operating system) disposed in the first processing core to process the to-be-processed audio signal obtained by the first processing core. Illustratively, the audio signal acquired by the DSP module may include an audio signal collected from the outside by the terminal device through its audio input device (e.g. a microphone built in the terminal device, a microphone peripheral connected to the terminal device, etc.), or may include an audio signal stored locally in the terminal device (e.g. a memory built in the terminal device, etc.). On this basis, the second operating system may use the audio signal acquired by the DSP module as an audio signal to be processed, and may further control the DSP module to process the audio signal to be processed.

Specifically, when the first operating system of the terminal device is in an idle state, the second operating system may directly wake up the DSP module without waking up the first operating system. Further, after the DSP module obtains the audio signal to be processed, the second operating system may send a control signal to the DSP module through the control channel to control the DSP module to perform corresponding processing on the audio signal to be processed. According to the difference of the source, the processing purpose and the like of the audio signal to be processed, the second operating system can adopt different processing measures, so that targeted audio signal processing can be realized, and the effectiveness and the reliability of the audio signal processing are improved.

As an optional implementation manner, if the audio signal to be processed is an audio signal acquired by the terminal device from the outside, the second operating system may first control the DSP module to acquire the acquired audio signal, and then may process the acquired audio signal to obtain a corresponding first audio signal. It can be understood that the terminal device may collect an external audio signal through an audio input device (such as a microphone, etc.), and the audio input device may be built in the terminal device or may be connected to the terminal device as an external device. The audio input device can comprise a built-in sound-electricity conversion module and an analog-to-digital conversion module, wherein the sound-electricity conversion module can be used for converting sound waves collected by the audio input device into audio signals in an electric signal form, and the analog-to-digital conversion module can be used for converting the audio signals in an analog signal form into a digital signal form so as to process the audio signals in the digital signal form through the DSP module.

For example, please refer to fig. 6A and fig. 6B together, and fig. 6A and fig. 6B are schematic diagrams of different connection relationships of the terminal device according to an embodiment of the present disclosure. As shown in fig. 6A, the terminal device 100 may further include a microphone 130 in addition to the first processing core 110 provided with the DSP module 111 and the second processing core 120 not provided with the DSP module, and the DSP module 111 may be connected to the microphone 130. On this basis, the second operating system running on the second processing core 120 may respond to the audio receiving instruction, control the DSP module 111 to acquire the audio signal acquired by the microphone 130, and then continue to control the DSP module 111 to process the audio signal acquired by the microphone 130, so as to obtain the first audio signal.

In some embodiments, as shown in fig. 6B, the terminal device 100 may not include an internal microphone, but may be connected to an external microphone 130. Specifically, the microphone 130 may be connected to the DSP module 111 in the first processing core 110 of the terminal device 100, so that the audio signal collected by the microphone 130 may be directly transmitted to the DSP module 111, so that the second operating system may control the DSP module 111 to process the audio signal collected by the microphone 130, and obtain a corresponding first audio signal.

For the audio signal collected by the microphone, the processing measure of the second operating system may include one or more of the measures of encoding and decoding, filtering, equalizing, gain adjusting, and the like, so that the first audio signal corresponding to the audio processing instruction may be obtained according to an actual requirement. Specifically, for example, the second operating system may control the DSP module to perform low-pass filtering on the audio signal collected by the microphone to filter out low-frequency noise, and then may encode the audio signal into a suitable storage format (e.g., mp3 format, aac format, etc.) for storage. On this basis, the second operating system may also control the DSP module to decode the encoded audio signal, and adjust the decoded audio signal to a gain range suitable for playing, so that the audio signal may be played through the audio output device of the terminal device. By implementing the method, the terminal equipment can flexibly control the DSP module by utilizing the second operating system, so that necessary processing can be carried out on the audio signal acquired by the microphone in real time, subsequent storage and calling are facilitated, and the efficiency of the terminal equipment for processing the audio signal is effectively improved.

As another optional implementation manner, if the audio signal to be processed is an audio signal stored locally in the terminal device, the second operating system may first control the DSP module to call the stored audio signal from a local memory of the terminal device, and then process the stored audio signal to obtain a corresponding first audio signal. Specifically, for example, when the first operating system is in an idle state, the second operating system may control to turn on (enable) a connection path between the DSP module and a local memory of the terminal device in response to an audio processing instruction for a stored audio signal, and then the second operating system may control the DSP module to obtain the stored audio signal from the memory, and further control the DSP module to process the stored audio signal, so as to obtain the first audio signal.

For example, regarding the stored audio signal, the processing measure of the second operating system may also include one or more of coding, decoding, filtering, equalizing, and adjusting gain, so as to obtain the first audio signal corresponding to the audio processing instruction, which is not described herein again.

504. And the second operating system receives a first audio signal sent by the DSP module through the data transmission channel.

Specifically, the second operating system may receive the first audio signal obtained through the processing by the DSP module through a connection path (i.e., the data transmission channel) between the second processing core of the terminal device and the DSP module. By implementing the method, the terminal equipment can directly control the DSP module corresponding to the first operating system to process the audio signal under the condition of not waking up the first operating system, thereby not only avoiding consuming a large amount of power caused by frequently waking up the first operating system, but also saving the time consumed by waking up and switching to the first operating system, enabling the terminal equipment to process the audio signal to be processed in time, and greatly reducing the delay of the terminal equipment in processing the audio signal.

As can be seen, with the implementation of the audio signal processing method described in the foregoing embodiment, the second operating system of the terminal device can directly control the DSP module corresponding to the first operating system to perform audio signal processing without waking up the first operating system, which is beneficial to reducing power consumption of the terminal device and improving efficiency of the terminal device for processing audio signals; in addition, necessary processing can be carried out on the audio signals collected by the microphone in real time, so that subsequent storage and calling are facilitated, and the efficiency of the terminal equipment for processing the audio signals is effectively improved.

Referring to fig. 7, fig. 7 is a flowchart illustrating a further audio signal processing method disclosed in an embodiment of the present application, where the audio signal processing method may be applied to the terminal device, and the terminal device may include a first processing core and a second processing core, where the first processing core is used to run a first operating system, the second processing core is used to run a second operating system, and the first processing core is further provided with a digital signal processing DSP module. The audio processing instruction may specifically include an audio sending instruction. The signal transmission channel may include a control channel and a data transmission channel. As shown in fig. 7, the audio signal processing method may include the steps of:

702. and the second operating system responds to the audio sending instruction and transmits the audio signal to be sent to the DSP module corresponding to the first operating system through the data transmission channel.

In this embodiment of the application, when the audio processing instruction acquired by the terminal device is an audio sending instruction, the second operating system may respond to the audio sending instruction, and transmit the audio signal to be sent to the DSP module through a connection path (i.e., the data transmission channel) between the second processing core of the terminal device and the DSP module in the first processing core (i.e., the DSP module corresponding to the first operating system), so as to process and send the audio signal to be sent through the DSP module in a subsequent step.

704. The second operating system controls the DSP module to process the audio signal to be sent through the control channel to obtain a processed second audio signal, and controls the DSP module to transmit the second audio signal to the audio output device so as to output the second audio signal through the audio output device.

Specifically, when the first operating system of the terminal device is in an idle state, the second operating system may directly wake up the DSP module instead of waking up the first operating system, so that the second operating system may replace the first operating system to control the DSP module. On this basis, after the DSP module obtains the to-be-sent audio signal transmitted by the second operating system, the second operating system may send a control signal to the DSP module through a control channel to control the DSP module to perform corresponding processing on the to-be-sent audio signal, and then control the DSP module to transmit the second audio signal to an audio output device (e.g., a speaker built in the terminal device, an earphone or a sound box connected to the terminal device, etc.) to output the second audio signal through the audio output device.

For example, please refer to fig. 8A, where fig. 8A is a schematic diagram of a connection relationship between another terminal device disclosed in the embodiment of the present application. As shown in fig. 8A, the terminal device 100 may further include an audio output device 140 in addition to the first processing core 110 provided with the DSP module 111 and the second processing core 120 not provided with the DSP module, and the DSP module 111 may be connected to the audio output device 140. In this embodiment of the application, the second operating system running on the second processing core 120 may respond to the audio sending instruction, and control the DSP module 111 to process the audio signal transmitted by the second processing core 120, so as to obtain a second audio signal; furthermore, the second operating system can also control the DSP module 111 to transmit the second audio signal to the audio output device 140, so that the audio output device 140 can output the second audio signal.

In some embodiments, the terminal device 100 may not include an internal audio output device, but directly connect to an external audio output device (not shown). Specifically, the external audio output device may be connected to the DSP module 111 in the first processing core 110 of the terminal device 100, so that the second audio signal transmitted by the DSP module 111 may be directly output after being received.

Referring to fig. 8B, fig. 8B is a schematic diagram of a connection relationship of another terminal device improved on the connection relationship of the terminal device shown in fig. 8A. As shown in fig. 8B, in some embodiments, the terminal device 100 may further include a microphone 130 in addition to the audio output device 140, and the microphone 130 and the audio output device 140 may be respectively connected to the DSP module 111. Based on this, the second operating system can process the audio signal collected by the microphone 130 by controlling the DSP module 111, so as to be subsequently stored and called; and in turn, process the audio signal to be transmitted for output by the audio output device 140. Therefore, by using the terminal device 100, the audio signal can be transmitted and received simultaneously, and the convenience and efficiency of processing the audio signal by the terminal device are greatly improved.

Alternatively, the microphone 130 and the audio output device 140 may not be built in the terminal device 100, but the external microphone 130 and the external audio output device 140 are respectively connected to the terminal device 100, so that the audio signal transceiving processing of the terminal device 100 can be implemented in a similar manner.

In other embodiments, as shown in fig. 9, the terminal device 100 may further include a bluetooth module 150, and the DSP module 111 of the terminal device 100 disposed on the first processing core 110 may be connected to the bluetooth module 150, so that the terminal device 100 may establish a communication connection with the external audio output device 140 through the bluetooth module 150. On this basis, when the second operating system running on the second processing core 120 needs to control the DSP module 111 to transmit the processed second audio signal to the audio output device 140, the DSP module 111 may be controlled to transmit the second audio signal to the bluetooth module 150, so that the bluetooth module 150 transmits the second audio signal to the audio output device 140 communicatively connected thereto, and the audio output device 140 may be configured to output the second audio signal received from the bluetooth module 150.

Specifically, in the case where the terminal device 100 establishes a communication connection with the audio output device 140 through the bluetooth module 150 thereof, the second operating system may control to turn on (enable) the data transmission path between the DSP module 111 and the bluetooth module 150. On this basis, the second operating system can drive the audio data to be sent to be transmitted from the second operating system to the DSP module 111, and after the second audio signal is obtained through the processing of the DSP module 111, the second operating system can further control the DSP module 111 to transmit the second audio signal to the bluetooth module 150 through the data transmission path, so that the bluetooth module 150 can further transmit the second audio signal to the audio output device 140, thereby implementing the output of the audio signal by the terminal device 100. By implementing the method, the processed audio signal can be conveniently output through the audio output device 140, which is beneficial to timely feeding back the audio processing condition to the user, so as to further improve the effect of processing the audio signal by the terminal device according to the feedback condition.

For example, the audio output device may include various devices or systems that can establish a communication connection with the terminal device through a bluetooth module built in the terminal device, such as a bluetooth headset and a bluetooth speaker, which is not specifically limited in this embodiment of the application.

In some embodiments, the second operating system may control the DSP module to take different processing measures to perform different processing on the audio signal to be processed according to different audio processing instructions to which the second operating system responds. Illustratively, the audio processing instructions may include audio information that may include at least one or more of audio format information (e.g., in formats such as. Mp3,. Acc,. Sbc, etc.), audio style information (e.g., music styles such as metal, rock, etc.), audio effect messages (e.g., effects such as noise reduction, equalization, etc.). According to the audio information, the second operating system can control the DSP module to perform corresponding processing to obtain a processed audio signal matched with the audio information.

Under the condition that the first operating system of the terminal equipment is in an idle state, the second operating system can respond to the audio processing instruction and control the DSP module to decode the audio signal to be processed to obtain a decoded audio signal. On this basis, the second operating system may further control the DSP module to process the decoded audio signal according to the audio information included in the audio processing instruction, so as to re-encode the decoded audio signal to obtain a processed audio signal corresponding to the audio information.

For example, if the audio information includes audio format information, the audio format information may indicate a corresponding audio processing instruction for instructing the second operating system to convert an audio signal to be processed (e.g., an audio signal stored in mp3 format) into an audio signal in a specified format (e.g., sbc format that can be transmitted via bluetooth), the second operating system may control the DSP module to decode the audio signal to be processed and re-encode the audio signal in the specified format, so as to obtain an audio signal in the specified format corresponding to the audio information.

For another example, if the audio information includes an audio effect message, and the audio effect message may indicate that a corresponding audio processing instruction is used to instruct the second operating system to perform noise reduction on an audio signal to be processed (such as a recorded audio), the second operating system may control the DSP module to decode the audio signal to be processed, perform noise reduction processing on the decoded audio signal to perform re-encoding, so as to obtain a noise-reduced audio signal corresponding to the audio information.

By implementing the method, the audio signal to be processed can be processed in a targeted manner according to different audio information included in the audio processing instruction, so that the accuracy and the effectiveness of the terminal equipment for processing the audio signal can be improved.

As can be seen, with the implementation of the audio signal processing method described in the foregoing embodiment, the second operating system of the terminal device can directly control the DSP module corresponding to the first operating system to perform audio signal processing without waking up the first operating system, which is beneficial to reducing power consumption of the terminal device and improving efficiency of the terminal device for processing audio signals; in addition, the processed audio signal can be conveniently output through the audio output device, so that the audio processing condition can be fed back to a user in time, and the effect of processing the audio signal by the terminal equipment can be further improved according to the feedback condition; in addition, according to the difference of the audio information included in the audio processing instruction, the audio signal to be processed can be processed in a targeted manner, so that the accuracy and the effectiveness of the audio signal processing of the terminal equipment can be improved, and the audio signal processing effect of the terminal equipment can be further improved.

Referring to fig. 10, fig. 10 is a schematic block diagram of an audio signal processing apparatus, which can be applied to the terminal device and includes a first processing core and a second processing core, where the first processing core is used to run a first operating system, the second processing core is used to run a second operating system, and the first processing core is further provided with a DSP module. As shown in fig. 10, the audio signal processing apparatus may include a signal processing unit 1101, in which:

the signal processing unit 1101 is configured to, when the first operating system is in an idle state, respond to the audio processing instruction by the second operating system, and control the DSP module to process the audio signal to be processed through a signal transmission channel established between the second operating system and the DSP module.

By adopting the audio signal processing apparatus described in the above embodiment, the second operating system of the terminal device can directly control the DSP module corresponding to the first operating system to perform audio signal processing without waking up the first operating system, which not only avoids consuming a large amount of power due to frequently waking up the first operating system, but also is beneficial to reducing the power consumption of the terminal device; and the time consumed by awakening and switching to the first operating system can be saved, so that the terminal equipment can process the audio signal to be processed in time, the delay of the terminal equipment in processing the audio signal is greatly reduced, and the efficiency of the terminal equipment in processing the audio signal is effectively improved.

In an embodiment, the signal transmission channel includes a control channel, and the signal processing unit 1101 may include a module wake-up subunit and a control processing subunit, not shown in the drawings, wherein:

the module awakening subunit is used for responding to the audio processing instruction by the second operating system and sending a module awakening instruction to the DSP module under the condition that the first operating system is in an idle state, wherein the module awakening instruction is used for awakening the DSP module;

and the control processing subunit is used for generating a control signal according to the audio processing instruction by the second operating system and sending the control signal to the DSP module through a control channel, wherein the control signal is used for controlling the awakened DSP module to process the audio signal to be processed.

With the audio signal processing apparatus described in the foregoing embodiment, the second operating system may obtain the control right of the DSP module in a manner of waking up the DSP module, so as to implement subsequent control operation on the DSP module.

In an embodiment, the audio processing instruction may specifically include an audio receiving instruction, the signal transmission channel may further include a data transmission channel, and the signal processing unit 1101 may also include a first control subunit and a first transmission subunit, which are not shown in the drawing, where:

the first control subunit is used for responding to the audio receiving instruction by the second operating system, and controlling the DSP module to process the acquired audio signal to be processed through the control channel to obtain a processed first audio signal;

and the first transmission subunit is used for receiving the first audio signal sent by the DSP module through the data transmission channel by the second operating system.

In an embodiment, the terminal device may further include a microphone, the DSP module may be connected to the microphone, and the first control subunit may be specifically configured to control the DSP module to acquire an audio signal acquired by the microphone through a control channel in response to an audio receiving instruction by the second operating system, and control the DSP module to process the audio signal acquired by the microphone, so as to obtain the first audio signal.

By adopting the audio signal processing device described in the above embodiment, necessary processing can be performed on the audio signal collected by the microphone in real time, so that subsequent storage and calling are facilitated, and the efficiency of the terminal device in processing the audio signal is effectively improved.

In an embodiment, the audio processing instruction may specifically include an audio sending instruction, and the signal processing unit 1101 may also include a second transmission subunit and a second control subunit, which are not shown in the drawing, where:

the second transmission subunit is used for responding to the audio sending instruction by the second operating system and transmitting the audio signal to be sent to the DSP module through the data transmission channel;

and the second control subunit is used for controlling the DSP module to process the audio signal to be sent by the second operating system through the control channel to obtain a processed second audio signal, and controlling the DSP module to transmit the second audio signal to the audio output device so as to output the second audio signal through the audio output device.

In an embodiment, the terminal device may further include a bluetooth module, the DSP module may be connected to the bluetooth module, the terminal device may establish a communication connection with the audio output device through the bluetooth module, and when the second control subunit controls the DSP module to transmit the second audio signal to the audio output device, the second control subunit may specifically be configured to control the DSP module to transmit the second audio signal to the bluetooth module by the second operating system, so that the bluetooth module transmits the second audio signal to the audio output device, and the audio output device is configured to output the second audio signal received from the bluetooth module.

In an embodiment, the signal processing unit 1101 may further include a connection subunit, not shown in the drawing, where the connection subunit is configured to control the DSP module to conduct a data transmission path with the bluetooth module when the terminal device establishes a communication connection with the audio output device through the bluetooth module before the second control subunit controls the DSP module to transmit the second audio signal to the bluetooth module;

the second control subunit may be specifically configured to control, by the second operating system, the DSP module to transmit the second audio signal to the bluetooth module through the data transmission path.

By adopting the audio signal processing device described in the above embodiment, the processed audio signal can be conveniently output through the audio output device, which is beneficial to timely feeding back the audio processing condition to the user, so as to further improve the effect of processing the audio signal by the terminal device according to the feedback condition.

In an embodiment, the audio processing instruction may include audio information, the audio information may include at least one or more of audio format information, audio style information, and an audio effect message, and the signal processing unit 1101 may also include a decoding subunit and an encoding subunit, not shown in the drawings, where:

the decoding subunit is used for responding to the audio processing instruction by the second operating system, and controlling the DSP module to decode the audio signal to be processed through the signal transmission channel established between the second operating system and the DSP module to obtain a decoded audio signal;

and the decoding subunit is used for controlling the DSP module to recode the decoded audio signal according to the audio information by the second operating system to obtain a processed audio signal corresponding to the audio information.

It can be seen that, with the audio signal processing apparatus described in the foregoing embodiment, the second operating system of the terminal device can directly control the DSP module corresponding to the first operating system to perform audio signal processing without waking up the first operating system, which is beneficial to reducing power consumption of the terminal device and improving efficiency of the terminal device in processing audio signals; in addition, according to the difference of the audio information included in the audio processing instruction, the audio signal to be processed can be processed in a targeted manner, so that the accuracy and the effectiveness of the audio signal processing of the terminal equipment can be improved, and the audio signal processing effect of the terminal equipment can be further improved.

Referring to fig. 11, fig. 11 is a schematic block diagram of a terminal device according to an embodiment of the present disclosure. As shown in fig. 11, the terminal device may include a memory 1101 and a processor 1102, wherein the memory 1101 stores a computer program, and when the computer program is executed by the processor 1102, the processor 1102 may implement all or part of the steps of any one of the audio signal processing methods described in the foregoing embodiments.

Furthermore, the present application further discloses a computer-readable storage medium storing a computer program for electronic data exchange, wherein the computer program, when executed by a processor, enables the processor to implement all or part of the steps of any one of the audio signal processing methods described in the above embodiments.

In addition, the embodiments of the present application further disclose a computer program product, which, when running on a computer, enables the computer to implement all or part of the steps of any one of the audio signal processing methods described in the above embodiments.

It will be understood by those skilled in the art that all or part of the steps of the methods of the above embodiments may be implemented by program instructions associated with hardware, and the program may be stored in a computer-readable storage medium, which includes Read-Only Memory (ROM), random Access Memory (RAM), programmable Read-Only Memory (PROM), erasable Programmable Read-Only Memory (EPROM), one-time Programmable Read-Only Memory (OTPROM), electrically Erasable Programmable Read-Only Memory (EEPROM), an optical Disc-Read-Only Memory (CD-ROM) or other storage medium, a magnetic tape, or any other medium capable of storing data for a computer or other computer.

The foregoing describes in detail an audio signal processing method and apparatus, a terminal device, and a storage medium disclosed in the embodiments of the present application, and specific examples are applied herein to explain the principles and implementations of the present application, and the descriptions of the foregoing embodiments are only used to help understand the method and core ideas of the present application; meanwhile, for a person skilled in the art, according to the idea of the present application, the specific implementation manner and the application scope may be changed, and in summary, the content of the present specification should not be construed as a limitation to the present application.

Claims

1. An audio signal processing method is applied to a terminal device, the terminal device includes a first processing core and a second processing core, the first processing core is used for running a first operating system, the second processing core is used for running a second operating system, the first processing core is provided with a DSP module, and the method includes:

2. The method of claim 1, wherein the signal transmission channel comprises a control channel, and the controlling, by the second operating system in response to the audio processing instruction, the DSP module to process the audio signal to be processed through the signal transmission channel established between the second operating system and the DSP module in the case that the first operating system is in the idle state comprises:

under the condition that the first operating system is in an idle state, the second operating system responds to an audio processing instruction and sends a module awakening instruction to the DSP module, wherein the module awakening instruction is used for awakening the DSP module; and

and the second operating system generates a control signal according to the audio processing instruction, and sends the control signal to the DSP module through the control channel, wherein the control signal is used for controlling the powered DSP module to process the audio signal to be processed.

3. The method of claim 1, wherein the audio processing instruction comprises an audio receiving instruction, the signal transmission channel comprises a control channel and a data transmission channel, and the second operating system controls the DSP module to process the audio signal to be processed through the signal transmission channel established with the DSP module in response to the audio processing instruction, and comprises:

the second operating system responds to the audio receiving instruction and controls the DSP module to process the acquired audio signal to be processed through the control channel to obtain a processed first audio signal;

and the second operating system receives the first audio signal sent by the DSP module through the data transmission channel.

4. The method according to claim 3, wherein the terminal device further includes a microphone, the DSP module is connected to the microphone, and the second operating system controls, in response to the audio receiving instruction, the DSP module to process the acquired audio signal to be processed through the control channel to obtain a processed first audio signal, including:

and the second operating system responds to the audio receiving instruction, controls the DSP module to acquire the audio signals acquired by the microphone through the control channel, and controls the DSP module to process the audio signals acquired by the microphone to obtain a processed first audio signal.

5. The method of claim 1, wherein the audio processing instruction comprises an audio sending instruction, the signal transmission channel comprises a control channel and a data transmission channel, and the second operating system controls the DSP module to process the audio signal to be processed through the signal transmission channel established between the second operating system and the DSP module in response to the audio processing instruction, and the method comprises:

the second operating system responds to the audio sending instruction and transmits an audio signal to be sent to the DSP module through the data transmission channel;

and the second operating system controls the DSP module to process the audio signal to be sent through the control channel to obtain a processed second audio signal, and controls the DSP module to transmit the second audio signal to an audio output device so as to output the second audio signal through the audio output device.

6. The method of claim 5, wherein the terminal device further comprises a bluetooth module, wherein the DSP module is connected to the bluetooth module, wherein the terminal device establishes a communication connection with the audio output device through the bluetooth module, and wherein the controlling the DSP module to transmit the second audio signal to an audio output device for outputting the second audio signal through the audio output device comprises:

the second operating system controls the DSP module to transmit the second audio signal to the Bluetooth module, so that the Bluetooth module transmits the second audio signal to the audio output device, and the audio output device is used for outputting the second audio signal received from the Bluetooth module.

7. The method of claim 6, wherein before the second operating system controls the DSP module to transmit the second audio signal to the Bluetooth module, the method further comprises:

under the condition that the terminal equipment establishes communication connection with the audio output equipment through the Bluetooth module, the second operating system controls the DSP module to be conducted with a data transmission channel between the DSP module and the Bluetooth module;

the second operating system controls the DSP module to transmit the second audio signal to the bluetooth module, including:

and the second operating system controls the DSP module to transmit the second audio signal to the Bluetooth module through the data transmission channel.

8. The method as claimed in any one of claims 1 to 7, wherein the audio processing instruction comprises audio information, the audio information comprises at least one or more of audio format information, audio style information, and audio effect message, and the second operating system controls the DSP module to process the audio signal to be processed through a signal transmission channel established with the DSP module in response to the audio processing instruction, including:

the second operating system responds to an audio processing instruction, and controls the DSP module to decode the audio signal to be processed through a signal transmission channel established between the second operating system and the DSP module to obtain a decoded audio signal;

and the second operating system controls the DSP module to recode the decoded audio signal according to the audio information to obtain a processed audio signal corresponding to the audio information.

9. The method of any one of claims 1 to 7, wherein the terminal device comprises a wearable device, and wherein the first processing core is a large core and the second processing core is a small core.

10. The audio signal processing device is applied to a terminal device, the terminal device includes a first processing core and a second processing core, the first processing core is used for operating a first operating system, the second processing core is used for operating a second operating system, the first processing core is provided with a DSP module, and the audio signal processing device includes:

and the signal processing unit is used for responding to an audio processing instruction by the second operating system and controlling the DSP module to process the audio signal to be processed under the condition that the first operating system is in an idle state.

11. A terminal device comprising a memory and a processor, the memory having stored thereon a computer program which, when executed by the processor, causes the processor to carry out the method of any one of claims 1 to 9.

12. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the method according to any one of claims 1 to 9.