WO2020124541A1

WO2020124541A1 - Audio processing method and apparatus, computer readable storage medium, and electronic device

Info

Publication number: WO2020124541A1
Application number: PCT/CN2018/122613
Authority: WO
Inventors: 李亚军; 彭德良; 冷文华; 胡小朋
Original assignee: 深圳市欢太科技有限公司; Oppo广东移动通信有限公司
Priority date: 2018-12-21
Filing date: 2018-12-21
Publication date: 2020-06-25
Also published as: CN113168303A

Abstract

An audio processing method and apparatus, a computer readable storage medium, and an electronic device. The audio processing method is applied to the electronic device having multiple audio output channels. The audio processing method comprises: when a target application runs, obtaining first audio behavior information set in audio service, the first audio behavior information being parameter information of playing audio data (302); when the target application plays the audio data, obtaining second audio behavior information for the electronic device to play the audio data (304); identifying, according to the first audio behavior information and the second audio behavior information, whether playback of the audio data is abnormal (306); and when the playback of the audio data is abnormal, correcting the second audio behavior information to repair the abnormal playback (308).

Description

Audio processing method and device, computer readable storage medium, electronic equipment

Technical field

The present application relates to the technical field of electronic equipment, in particular to audio processing methods and apparatuses, electronic equipment, and computer-readable storage media.

Background technique

With the wide application of electronic equipment and its increasingly rich functions, electronic equipment has become an indispensable part of people's daily life. Among them, the applications installed on electronic devices are more diverse. In the process of using the application, when the application plays audio data, the audio behavior information of the audio data can be set.

However, during the use of the application program, the electronic device cannot systematically monitor the audio behavior information of the audio data, and an abnormal call of the audio behavior information may occur, which makes the playback of the audio data abnormal.

Summary of the invention

Embodiments of the present application provide an audio processing method and apparatus, a computer-readable storage medium, and an electronic device, which can monitor abnormalities of audio data playback, and enable normal playback of audio data, enhance the stability of audio data output, and improve user experience.

An audio processing method applied to electronic equipment, the method includes:

When the target application is running, obtain first audio behavior information set in an audio service, where the first audio behavior information is parameter information for playing the audio data;

When the target application plays the audio data, obtain second audio behavior information of the electronic device playing the audio data;

Identifying whether the playback of the audio data is abnormal according to the first audio behavior information and the second audio behavior information;

When the playback of the audio data is abnormal, the second audio behavior information is corrected to repair the abnormal playback.

An audio processing device is applied to electronic equipment. The device includes:

The information collection module is used to obtain first audio behavior information set in the audio service when the target application is running, wherein the first audio behavior information is parameter information for playing the audio data;

An information obtaining module, configured to obtain second audio behavior information of the electronic device playing the audio data when the target application plays the audio data;

An abnormality interpretation module, configured to identify whether the playback of the audio data is abnormal according to the first audio behavior information and the second audio behavior information; and

The abnormality correction module is configured to correct the second audio behavior information to repair abnormal playback when the playback of the audio data is abnormal.

A computer-readable storage medium on which a computer program is stored, which when executed by a processor implements the steps of the audio processing method described above.

An electronic device includes a memory and a processor. The memory stores computer-readable instructions, and when the instructions are executed by the processor, the processor is caused to perform the audio processing method according to the claims.

The above audio processing method and apparatus, computer-readable storage medium, and electronic device can obtain the first audio behavior information set in the audio service when the target application is running; when the target application plays audio data, the electronic device plays audio The second audio behavior information of the data; identify whether the playback of the audio data is abnormal according to the first audio behavior information and the second audio behavior information; when the playback of the audio data is abnormal, correct the second audio behavior information to repair the abnormal playback, you can monitor the audio The abnormal situation of data playback, and make the audio data play normally, enhance the stability of the audio data output, and improve the user experience.

BRIEF DESCRIPTION

In order to more clearly explain the embodiments of the present invention or the technical solutions in the prior art, the following will briefly introduce the drawings required in the embodiments or the description of the prior art. Obviously, the drawings in the following description are only These are some embodiments of the present invention. For those of ordinary skill in the art, without paying any creative work, drawings of other embodiments can be obtained based on these drawings.

1 is a schematic diagram of the internal structure of an electronic device in an embodiment;

2 is a schematic diagram of a part of the architecture of an Android audio system in an embodiment;

3 is a schematic flowchart of an audio processing method in an embodiment;

FIG. 4 is a schematic flowchart of a process for controlling a monitoring module to collect first audio behavior information used for setting audio data playback in an audio service when a target application is running in an embodiment;

5 is a schematic flowchart of identifying whether the playback of audio data is abnormal according to the first audio behavior information and the second audio behavior information in an embodiment;

6 is a schematic flow chart of correcting second audio behavior information to repair abnormal playback when audio data playback is abnormal in an embodiment;

7 is a schematic flowchart of an audio processing method in another embodiment;

8 is a schematic flowchart of an audio processing method in yet another embodiment;

9 is a schematic diagram of an audio processing device in an embodiment;

10 is a block diagram of a partial structure of a mobile phone related to an electronic device provided by an embodiment of the present application.

detailed description

In order to facilitate understanding of the present invention, the present invention will be described more fully below with reference to related drawings. The drawings show preferred embodiments of the invention. However, the present invention can be implemented in many different forms and is not limited to the embodiments described herein. On the contrary, the purpose of providing these embodiments is to make the understanding of the disclosure of the present invention more thorough and comprehensive.

In one embodiment, as shown in FIG. 1, a schematic diagram of an internal structure of an electronic device is provided. The electronic device includes a processor, memory, and display screen connected by a system bus. Among them, the processor is used to provide computing and control capabilities to support the operation of the entire electronic device. The memory is used to store data, programs, and/or instruction codes, etc. At least one computer program is stored on the memory, and the computer program can be executed by the processor to implement the audio processing method for electronic devices provided in the embodiments of the present application. The memory may include a non-volatile storage medium such as a magnetic disk, an optical disk, a read-only memory (Read-Only Memory, ROM), or a random-access memory (Random-Access-Memory, RAM). For example, in one embodiment, the memory includes a non-volatile storage medium and internal memory. The non-volatile storage medium stores an operating system, a database, and a computer program. The database stores data related to an audio processing method provided by the above embodiments, for example, information such as the name of each process or application may be stored. The computer program may be executed by the processor to implement an audio processing method provided by various embodiments of the present application. The internal memory provides a cached operating environment for operating systems, databases, and computer programs in non-volatile storage media. The display screen can be a touch screen, such as a capacitive screen or an electronic screen, which is used to display interface information of applications corresponding to the foreground process, and can also be used to detect a touch operation acting on the display screen and generate corresponding instructions, such as performing front and background Application switching instructions, etc.

Those skilled in the art may understand that the structure shown in FIG. 1 is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the electronic device to which the solution of the present application is applied. The specific electronic device may It includes more or fewer components than shown in the figure, or some components are combined, or have a different component arrangement. For example, the electronic device further includes a network interface connected through a system bus. The network interface may be an Ethernet card or a wireless network card, etc., and is used for communication with external electronic devices, for example, for communication with a server.

In one embodiment, as shown in FIG. 2, an Atlas partial architecture diagram of an Android audio system is provided. The Atlas architecture system of the Android audio system includes a kernel space layer 210, a local layer 220, a framework layer 230, and a client layer 240.

The Atlas architecture can integrate multiple existing APKs of multimedia into Atlas, making it an APK, saving some resources; that is, the Atlas architecture system can integrate Dirac sound effects APK, smart volume APK, smart headset APK, GiFT process, Guardian system services and other features are integrated into Atlas APK.

The Kernel space layer 210 may include an Audio driver module 211, where the Audio driver module interacts with the hardware and implements the local layer interface for the upper layer to call normally. Here, ALSA, OSS, and a custom audio driver can be selected. The local layer 220 includes an AtlasService_Jni module 221, an AtlasService Interface module 223, and an AtlasService module 225. The framework layer 230 includes an AtlasManager module 231 and an AtlasService module 233. Among them, the AtlasManager module 231 is provided with a conventional interface and a registration callback interface. The AtlasService module 225 in the local layer 220 and the AtlasService module 233 in the framework layer 230 are used for event reception and processing, information collection, abnormal feedback, and log collection, where the information collection may include the collection of display information and the collection of audio information. Among them, the audio information includes playback information (audio output channels, volume, sound effects, etc.), recording information, audio mode setting information, and so on. Because the AtlasService module is set up in the system-level framework layer, it can facilitate interaction with other system services without worrying about permissions during system calls. Through the above-mentioned architecture, the audio processing methods in various embodiments of the present application can be implemented.

In one embodiment, as shown in FIG. 3, an audio processing method is provided, which is applied to an electronic device having multiple audio output channels. In one embodiment, the electronic device may include a mobile phone, a tablet computer, a laptop computer, a palmtop computer, a mobile Internet device (Mobile Internet Device (MID), a wearable device (such as a smart watch, smart bracelet, pedometer, etc.) Or other electronic devices with voice call function and speakers.

As shown in FIG. 3, in one embodiment, the audio processing method includes steps 302-308.

Step 302: When the target application is running, obtain the first audio behavior information set in the audio service.

In one embodiment, a monitoring module is created based on the operating system of the electronic device, and the first audio behavior information set in the audio service when the target application program is running can be collected through the monitoring module. Wherein, the first audio behavior information is parameter information of playing the audio data. Taking an electronic device with an Android operating system as an example, a system-level monitoring module (AtlasService module) can be created in the system framework layer (native/framework layer), and the playback audio data can be set in the audio service when the target application is running through the monitoring module. First audio behavior information. For example, you can set up a listener module at the framework layer and run it in the system service program (system_server). Since the listener module is set up at the system-level service framework layer, you can easily interact with other audio services, display services, system services, etc. At the same time, there is no need to worry about the permissions during system calls.

When the monitoring module interacts with the audio service, the audio service may collect the first audio behavior information for setting the audio data to be played in the audio service when the target application is running. The first audio behavior information may include at least an audio output channel, audio mode, volume, recording, and information related to audio data input and/or output. The audio output channel includes an earpiece channel, a speaker channel, and a headset channel, where the headset channel may include a wired headset channel and a wireless headset (Bluetooth headset) channel. When the audio output channel is the earpiece channel, the audio data is sent by the earpiece; when the audio output channel is the speaker channel, the audio data is sent by the external speaker; when the audio output channel is the earphone channel, the audio data can be through wired headphones or Bluetooth headphones issue. Audio modes can include multimedia mode, ringtone mode, alarm mode, call mode, call mode (including audio/video, VoIP call) and system mode.

The target application program may be understood as an application program capable of outputting and/or outputting audio signals, and the number of target application programs may be 1, 2, 3 or more. For example, the target application may include applications such as call, instant messaging, audio playback, video playback, sound control, and voice input. When the target application is running, it can be understood as running in the foreground or running in the background.

Audio data includes voice data, ringtone data, alarm data, multimedia data (video streaming, audio streaming data, etc.) and so on.

Step 304: When the target application plays audio data, obtain second audio behavior information of the electronic device playing audio data.

When the target application plays the audio data, the second audio behavior information of the electronic device currently actually playing the audio data may be acquired. The second audio behavior information may also include at least an audio output channel, audio mode, volume, recording, and information related to audio data input and/or output. For example, if the electronic device is currently in a call state and a speaker is used to transmit call audio, the second audio behavior information of the currently playing audio data (call voice data) acquired by the electronic device includes: the call mode, the speaker transmission channel, and the volume is A and other information.

Step 306: Identify whether the playback of audio data is abnormal according to the first audio behavior information and the second audio behavior information.

Both the first audio behavior information and the second audio behavior information may include at least audio output channel, audio mode, volume and other information. The first audio behavior information may be understood as standard audio behavior information set in the audio service when the target application plays audio data. The second audio behavior information can be understood as actual audio behavior information currently played by the target application. Under normal circumstances, the first audio behavior information and the second audio behavior information should be exactly the same. At this time, it can be considered that the playback action of the target application to play audio data is normal, if the first audio behavior information and the second audio When the behavior information should be inconsistent, the playback action of the target application to play audio data may be considered abnormal. For example, when the electronic device is in a call state, the first audio behavior information it sets includes the call mode, the earpiece output channel, and the volume is A; however, during the actual call, the second audio behavior information includes the call mode and the speaker The output channel and the volume are A. At this time, the audio output channel in the first audio behavior information and the second audio behavior information are different, it can be considered that the playback of audio data in the current call state is abnormal.

Step 308, when the playback of the audio data is abnormal, correct the second audio behavior information to repair the abnormal playback.

When the electronic device determines that the audio data is playing abnormally, it can correct the second audio behavior information according to the first audio behavior information, so that the second audio behavior information that the electronic device currently actually plays the audio data and the first set in the audio service The audio behavior is consistent, and then the abnormal playback is repaired, so that the audio data can be played normally, and the user experience is improved. For example, when the audio output channel of the electronic device is abnormal, the electronic device can call the preset interface function to correct the abnormal audio output channel, so that the audio of the call is output from the normal audio output channel; when the audio mode of the electronic device is abnormal At this time, the electronic device can perform mode conversion on the abnormal audio mode through the preset mode conversion interface to correct and repair the abnormal playback.

The above audio processing method can control the monitoring module to collect the first audio behavior information used to set the playback audio data in the audio service when the target application is running; when the target application plays the audio data, obtain the second audio data played by the electronic device Audio behavior information; identify whether the playback of audio data is abnormal according to the first audio behavior information and the second audio behavior information; when the playback of audio data is abnormal, correct the second audio behavior information to repair the abnormal playback, you can monitor the abnormal playback of audio data Situation, and make the audio data play normally, enhance the stability of the audio data output, and improve the user experience.

As shown in FIG. 4, in one embodiment, the control listening module collects first audio behavior information used to set playing audio data in the audio service when the target application is running, including steps 402-404. among them:

Step 402, when the target application is running, the control listening module sends an audio acquisition request to the audio service. The audio acquisition request is used to instruct the audio service to collect the first audio behavior information.

Step 404: Receive first audio behavior information fed back by an audio service.

Binder and socket communication mechanisms can be used for communication between the monitoring module of the electronic device and the audio service. That is, the listening module can use binder and socket communication mechanisms to communicate with the audio service. When the target application is running, the electronic device can control the listening module to send an audio acquisition request to the audio service using the binder and socket communication mechanisms. The audio service may collect the first audio behavior information used to set the target application to play audio data according to the received acquisition request. After the audio service collects the first audio behavior information, the binder and socket communication mechanisms may be used to feed back the collected first audio behavior information to the monitoring module, so that the monitoring module obtains the first audio behavior set when the target application plays audio data information.

Further, in the audio service, the same interface is also provided at the same time, and the monitoring module can communicate with the monitoring module through the binder and socket communication mechanism.

As shown in FIG. 5, in one embodiment, identifying whether audio data is abnormally played according to the first audio behavior information and the second audio behavior information includes steps 502-506. among them,

Step 502: Obtain application information of the target application.

In one embodiment, the electronic device may obtain the application information of the target application based on the identification information of the target application. The application information may include information such as usage information and application type of the target application program. Among them, the usage information can refer to the cumulative usage time, usage frequency, etc. within a preset time, and the application type can be divided according to the function of the target application, for example, call, instant messaging interaction, video, audio, entertainment Class, system custom class, etc. Among them, the system custom category may include ringtones, alarm clocks and so on.

Specifically, the electronic device may identify each target application in advance to form identification information, and the identification information may be represented by any one or combination of letters, numbers, and special symbols. Different types of target application programs can be represented by different identification information, and the identification information can distinguish the application types of the target application programs.

Further, the electronic device may make statistics on the usage information of the target application, or may inject the usage information into the identification information, so that the identification information carries the usage information of the target application.

Step 504: Determine whether the second audio behavior information is abnormal according to the application information and the first audio behavior information.

Step 506: If the second audio behavior information is abnormal, the playback of the audio data is abnormal.

In one embodiment, the electronic device may determine the determination order of the audio output channel, audio mode, and volume in the first audio behavior information and the second audio behavior information according to the application information of the target application program. Specifically, if any information in the first audio behavior information is inconsistent with the second audio behavior information, the second audio behavior information may be considered abnormal. Both the first audio behavior information and the second audio behavior information include information such as the audio output channel, audio mode, and volume. When determining whether the second audio behavior information is abnormal, it is necessary to determine the first audio behavior information and the second audio behavior information The order in which the information is compared. The electronic device may determine the determination order according to the application information. For example, if the current target application is a call-type application, the judgment order can be audio output channel, volume, audio mode, or audio output channel, audio mode, volume, where priority is given to determine whether the audio output channel is abnormal, if the current target When the application program is a system application program, the judgment order may be audio mode, volume, audio output channel, or audio mode, audio output channel, volume, wherein priority is given to whether the audio mode is abnormal.

The electronic device may determine whether the second audio behavior information is abnormal according to the application information, and according to the judgment sequence, sequentially compare whether the audio output channel, audio mode, and volume in the first audio behavior information and the second audio behavior information are consistent. When any one of the output channel, the audio mode and the volume is inconsistent, the second audio behavior information may be considered abnormal.

When the second audio behavior information is abnormal, it may be considered that the current playback behavior of the audio data is abnormal, that is, the audio data is abnormally played, and the abnormal playback needs to be corrected.

In this embodiment, the electronic device may determine the determination order of the audio output channel, the audio mode, and the volume in the first audio behavior information and the second audio behavior information according to the application information of the target application, which improves whether the second audio behavior information is abnormal The efficiency of judgment.

As shown in FIG. 6, in one embodiment, when the playback of the audio data is abnormal, correcting the second audio behavior information to repair the abnormal playback includes steps 602-604. among them,

Step 602: When the audio data plays abnormally, the abnormal type is obtained according to the second audio behavior information; the abnormal type includes a mode abnormality, a channel abnormality, and a volume abnormality.

When the audio data of the electronic device plays abnormally, the abnormal type of abnormal playback may be obtained according to the second audio behavior information. Among them, abnormal types include abnormal patterns, abnormal channels and abnormal volume. For example, if the first audio behavior information is inconsistent with the audio mode in the second audio behavior information, the abnormal type is a mode abnormality; if the first audio behavior information is inconsistent with the audio output channel in the second audio behavior information, the exception The type is channel abnormality; if the volume in the first audio behavior information and the second audio behavior information are inconsistent, or the volume in the second audio behavior information exceeds the preset volume range, the abnormal type is volume abnormality. It should be noted that the preset volume range can be set according to the volume of the first audio behavior information. For example, if the volume of the first audio behavior information is a and the volume of the second audio behavior information is b, then the preset volume range δ can be understood as the absolute value of the difference between a and b, and the absolute value of the difference between a and b If the value is greater than the preset volume range δ, the volume can be considered abnormal. Further, if the audio output channel, audio mode, and volume in the first audio behavior information and the second audio behavior information are inconsistent, the abnormal type includes channel abnormality, mode abnormality, and volume abnormality.

Step 604: A preset correction strategy is adopted according to the abnormal type to correct the second audio behavior information to repair the abnormal playback.

The abnormal types include mode abnormality, channel abnormality and volume abnormality, and different abnormal types correspond to different preset correction strategies.

In one embodiment, when the channel is abnormal, the preset interface function is called to correct the abnormal audio output channel in the second audio behavior information to repair the abnormal playback.

In one embodiment, the mode conversion interface is set when the mode is abnormal, and the mode conversion is performed on the audio mode through the mode conversion interface to correct the second audio behavior information to repair the abnormal playback.

Further, when the abnormal type includes at least two of channel abnormality, mode abnormality, and volume abnormality, the correction order may be determined according to the above-mentioned determination order, and all abnormality types may be sequentially corrected according to the correction order.

In this embodiment, the electronic device can determine the abnormal type of playback abnormality according to the second audio behavior information, and can adaptively correct it according to different abnormal types, so as to improve the correction efficiency and enable the audio data Normal playback improves user experience.

In one embodiment, when the audio data plays abnormally, the abnormal type is obtained according to the second audio behavior information. If the abnormal type is a channel abnormality, it may include an earphone channel abnormality, an earpiece channel abnormality, and a speaker channel abnormality. For example, the second audio behavior information is inconsistent with the audio output channel in the first audio behavior information. If the audio output channel in the second audio behavior information is a headphone channel, it can be considered as an abnormality in the headphone channel; if the audio in the second audio behavior information When the output channel is an earpiece channel, it can be considered as an abnormality of the earphone channel; if the audio output channel in the second audio behavior information is a speaker channel, it can be considered as an abnormality of the speaker channel.

When the channel for playing audio data is abnormal, the electronic device can call a preset interface function to set the audio output channel. The preset interface functions include at least the setSpeakerphoneOn() interface function, setMode(AudioManager.MODE_IN_CALL) interface function, isWiredHeadsetOn() interface function or other interface functions for setting the earphone channel and headphone channel.

For example, in an electronic device based on the Android operating system, the electronic device can set the speaker channel by calling the interface function setSpeakerphoneOn() in the AudioManager, that is, the speaker channel can be turned on or off. The electronic device can set the earpiece channel by calling the function setMode(AudioManager.MODE_IN_CALL) in AudioManager or the construction parameter streamType(STREAM_VOICE_CALL); the electronic device can set and detect the earpiece channel by calling the function isWiredHeadsetOn() in AudioManager.

Specifically, when the earphone channel of the audio output channel is abnormal, it is detected whether the electronic device is connected to the earphone; when the electronic device is connected to the earphone, the earphone channel of the audio data is changed so that the earphone channel plays audio data; when the electronic device is not connected to the earphone, Change the receiver channel of audio data so that the speaker channel plays audio data.

For example, an electronic device can set and detect whether a wired headset is connected by calling the function isWiredHeadsetOn() in AudioManager, or detect whether a wired headset is connected by detecting the high and low level of GPIO (General Purpose Input/Output) . Specifically, the preset state of the GPIO interface is a high level, and the current detection state is a low level, which indicates that the state of the GPIO interface has changed and the electronic device is connected to a wired headset. Electronic devices can also detect whether a Bluetooth headset is connected through the BluetoothAdapter class. At the same time, the electronic device can also detect the interface state of the corresponding audio interface based on the Bluetooth protocol, and then detect whether the electronic device is connected to the Bluetooth headset.

It should be noted that the electronic device can also detect whether it is connected to the earphone based on other software or hardware, which is not limited to the above example.

When the electronic device is connected to the earphone, the preset interface function for switching to the earphone channel can be called, and the audio output channel that outputs audio data is switched from the earpiece mode to the earphone channel according to the preset interface function, and the earphone channel plays the Audio data. When the electronic device is not connected to the headset, the preset interface function for switching to the speaker channel can be called, and the audio output channel that outputs audio data is switched from the earpiece mode to the speaker channel according to the preset interface function, and the speaker channel Play the audio data.

In this embodiment, when the earphone channel in the audio output channel is abnormal, the electronic device can adaptively switch its earphone channel to an audio output channel that matches the user's use scenario according to whether the headset is connected, which can improve the audio output. Stability and user experience.

Optionally, when the speaker channel of the audio output channel is abnormal, detect whether the electronic device is connected to the earphone; when the electronic device is connected to the earphone, change the earphone channel of the audio data so that the earphone channel plays audio data; when the electronic device is not connected to the earphone , Change the receiver channel of the audio data, so that the receiver channel plays audio data.

When the electronic device is connected to the earphone, the preset interface function for switching to the earphone channel can be called, and the audio output channel for outputting audio data can be switched from the speaker mode to the earphone channel according to the preset interface function and played by the earphone channel The audio data. When the earphone is not connected to the electronic device, if the default audio output channel corresponding to the audio mode of the target application is a speaker channel, the preset interface function for switching to the earphone channel can be called, and the output is output according to the preset interface function The audio output channel of the audio data is switched from the speaker mode to the receiver channel, and the receiver channel plays the audio data.

In this embodiment, when the speaker channel in the audio output channel is abnormal, the electronic device can adaptively switch its speaker channel to an audio output channel that matches the user's use scenario according to whether the headset is connected, which can improve the audio output. Stability and user experience.

Optionally, when the headphone channel of the audio output channel is abnormal, the preset interface function is called to change the headphone channel of the audio data, so that the speaker channel plays audio data. For example, the audio output channel in the first audio behavior information of the target application is the speaker channel. When the electronic device is connected to the headset, the alarm is output from the headset channel, but not from the speaker, the current headset channel may be considered abnormal, Then the electronic device can call the preset calling function for switching to the speaker channel, so that the alarm is output from the speaker channel, so that the alarm can be output from the earphone channel, and the user cannot perceive the occurrence of the alarm when the alarm is from When the speaker is output, the user can normally hear the alarm, which will not affect the user's normal work and rest.

Specifically, a mode conversion interface is provided, and a mode conversion is performed on the audio mode through the mode conversion interface. In the Android system, according to the current google SDK development kit agreement, there is a setmode function that can be used as the mode conversion interface. In the Android framework, the audio mode conversion can be achieved by calling the setmode function. For example, define setmode(0) as the media audio mode, setmode(1) as the ringtone mode, and setmode(2) as the voice call mode. Specifically, a mode conversion interface is provided to perform mode conversion on the audio mode through the mode conversion interface, and the abnormal audio mode in the second audio behavior information can be converted into a normal audio mode.

In one embodiment, when the volume is abnormal, the audio mode is converted according to the mode conversion interface to correct the abnormal audio mode; the volume is adjusted in the corrected audio mode to correct the abnormal volume, so that the audio data is at a normal volume Play.

For example, the abnormal mode includes abnormal media audio mode, abnormal silent mode, abnormal call mode, abnormal ring mode, etc. When the media audio mode is abnormal, the audio mode with abnormal audio mode may be corrected to the media audio mode, and adjusting the media audio may specifically be adjusting the sound quality and volume of the media audio mode. When the silent mode is abnormal, you can correct the audio mode of the target application to silent mode, specifically: set the audio mode to media audio mode, and adjust the media audio volume to 0, or set the audio mode to system audio mode And adjust the system audio volume to 0. When the call mode is abnormal, the audio mode of the target application will be corrected to the call mode. In addition, when the call mode is the handset mode, adjust the volume level of the handset mode to correct the abnormal volume, or, when the call mode is the hands-free mode, adjust the volume level of the hands-free mode to correct the abnormal volume. When the ringtone pattern is abnormal, the audio mode of the target application is corrected to the ringtone pattern. Wherein, the audio mode is corrected to ringtone audio, which may specifically be: the audio mode is corrected to adjust the ringtone, and the volume of the ringtone audio is adjusted to correct the abnormal volume.

In the embodiment of the present application, the electronic device can adaptively correct the abnormal audio mode according to the monitored audio mode is abnormal, so that the corrected audio mode is consistent with the audio mode in the first audio behavior information, which improves the audio data The stability of playback improves the user experience.

As shown in FIG. 7, in one embodiment, the audio processing method includes steps 702-710. among them,

Step 702: Control the monitoring 606 module to collect the first audio behavior information used to set the playback audio data in the audio service when the target application is running;

Step 704, when the target application plays audio data, obtain second audio behavior information of the electronic device playing audio data;

Step 706: Identify whether the playback of the audio data is abnormal according to the first audio behavior information and the second audio behavior information;

Step 708, when the playback of the audio data is abnormal, correct the second audio behavior information to repair the abnormal playback.

The above steps 702 to 708 correspond to steps 302 to 308 in the foregoing embodiment, and will not be repeated here.

Step 710: Obtain correction data correcting the second audio behavior information, and report and store the correction data.

After the electronic device performs correction processing on the second audio behavior information, it can obtain corresponding correction data, which includes abnormal information of the second audio behavior information (channel abnormality, mode abnormality, volume abnormality), correction time, correction cumulative number of times, Information such as the identity of the target application and the identity of the electronic device. The electronic device can report and store the obtained correction data to statistically correct the data, which can prove the processing effect and processing efficiency of the audio processing method, and reduce or avoid the occurrence of abnormal playback in the subsequent audio playback process.

As shown in FIG. 8, in one embodiment, the audio processing method further includes steps 802 to 808. among them,

Step 802: The monitoring module is controlled to collect the first display information used to set the display image in the display service when the target application is running.

In one embodiment, a monitoring module is created based on the operating system of the electronic device, and the monitoring module collects the first display information used to set the display image in the display service when the target application is running.

The binder and socket communication mechanisms can be used for communication between the monitoring module of the electronic device and the display service. When the target application is running, the electronic device can control the monitoring module to send a display acquisition request to the display service using the binder and socket communication mechanisms. The display service may collect the first display information for setting and displaying the target application display image according to the received display acquisition request. After the display service collects the first display information, the binder and socket communication mechanism may be used to feed back the collected first display information to the monitoring module, so that the monitoring module obtains the first display information set when the target application displays the image.

Step 804: When the target application displays the image, obtain second display information of the display image of the electronic device.

Step 806: Identify whether the display of the image is abnormal according to the first display information and the first display information.

Wherein, both the first display information and the second display information may include LCD/backlight information, frame rate information, display size information, display brightness information, and the like. If at least one of the first display information and the second display information is inconsistent, it may be considered that the display of the image is abnormal.

Specifically, the types of abnormalities that can display abnormalities may include abnormal flash screens, black screens, abnormal frame rate processing, abnormal display screens, abnormal display brightness, and the like.

Step 808, when the display of the image is abnormal, correct the second display information to repair the abnormal display.

When the image display is abnormal, the electronic device may adopt different strategies to correct the second display information to repair the abnormal display according to the type of abnormality displaying the abnormality. Among them, the correction strategy may include the correction processing of the display layer, the correction processing of the display area, the correction processing of the distribution leak, the correction processing of the brightness adjustment, the correction processing of the frame rate adjustment, and so on.

In this embodiment, the electronic device can monitor the abnormal display of the image and perform correction processing on the abnormal image display to improve the stability of the image displayed by the electronic device and improve the user experience.

It should be noted that the steps in this embodiment can also be used before or after the above steps 802 to 804 to improve the playback quality of the audio data played during the switching of the audio output channel and the user experience.

It should be understood that although the steps in the flowcharts of FIGS. 3-8 are sequentially displayed according to the arrows, the steps are not necessarily executed in the order indicated by the arrows. Unless clearly stated in this article, the execution of these steps is not strictly limited in order, and these steps may be executed in other orders. Moreover, at least some of the steps in FIGS. 3-8 may include multiple sub-steps or multiple stages. These sub-steps or stages are not necessarily executed at the same time, but may be executed at different times. These sub-steps or stages The execution order of is not necessarily sequential, but may be executed in turn or alternately with at least a part of other steps or sub-steps or stages of other steps.

As shown in FIG. 9, the present application also provides an audio processing device, which is applied to an electronic device. The device includes: an information collection module 910, an information acquisition module 920, an abnormality interpretation module 930, and an abnormality correction module 940. among them,

The information collection module 910 is configured to obtain first audio behavior information set in an audio service when the target application is running, where the first audio behavior information is parameter information for playing the audio data;

The information obtaining module 920 is configured to obtain second audio behavior information of the audio data played by the electronic device when the target application plays the audio data;

The abnormality interpretation module 930 is configured to identify whether the playback of the audio data is abnormal according to the first audio behavior information and the second audio behavior information; and

The abnormality correction module 940 is configured to correct the second audio behavior information to repair abnormal playback when the playback of the audio data is abnormal.

The above audio processing device can obtain the first audio behavior information set in the audio service when the target application is running; when the target application plays audio data, obtain the second audio behavior information of the audio data played by the electronic device; according to the first The audio behavior information and the second audio behavior information identify whether the playback of audio data is abnormal; when the playback of audio data is abnormal, correct the second audio behavior information to repair the abnormal playback, you can monitor the abnormal situation of audio data playback, and make the audio data normal Play, enhance the stability of audio data output, and improve user experience.

In one embodiment, the information collection module includes:

A sending unit, configured to control the listening module to send an audio acquisition request to the audio service when the target application is running; wherein, the audio acquisition request is used to instruct the audio service to collect the first audio behavior information;

The receiving unit is configured to receive the first audio behavior information fed back by the audio service.

In one embodiment, the listening module uses binder and socket communication mechanisms to communicate with the audio service.

In one embodiment, both the first audio behavior information and the second audio behavior information include at least an audio output channel, an audio mode, and a volume; an abnormality interpretation module includes:

The information acquisition unit is used to acquire application information of the target application program;

An abnormality determining unit, configured to determine whether the second audio behavior information is abnormal according to the application information and the first audio behavior information;

The playback abnormality unit is configured to play abnormal audio data if the second audio behavior information is abnormal.

In one embodiment, the abnormality determining unit is further used to determine the order of determining the audio output channel, audio mode, and volume in the first audio behavior information and the second audio behavior information according to the application information; determining the first audio behavior information according to the determination order Whether it is consistent with the second audio behavior information; if any one of the audio output channel, audio mode and volume is inconsistent, the second audio behavior information is abnormal.

In one embodiment, the abnormality correction module includes:

The type obtaining unit is configured to obtain an abnormal type according to the second audio behavior information when the audio data is abnormally played; the abnormal type includes a mode abnormality, a channel abnormality, and a volume abnormality;

The abnormality correction unit is configured to adopt a preset correction strategy according to the type of abnormality to correct the second audio behavior information to repair abnormal playback.

In one embodiment, the abnormality correction unit is further used to call a preset interface function to correct the abnormal audio output channel in the second audio behavior information when the channel is abnormal to repair abnormal playback.

In one embodiment, the abnormality correction unit is also used to call the preset interface function to change the earphone channel of the audio data when the earphone channel of the audio output channel is abnormal, so that the speaker channel plays audio data, or the abnormality correction unit is also used When the earphone channel of the audio output channel is abnormal, detect whether the electronic device is connected to the earphone; when the electronic device is connected to the earphone, change the earphone channel of the audio data to make the earphone channel play audio data; when the electronic device is not connected to the earphone, change the audio data The earphone channel of the speaker channel, so that the speaker channel plays audio data; or, the abnormality correction unit is also used to detect whether the electronic device is connected to the earphone when the speaker channel of the audio output channel is abnormal; when the electronic device is connected to the earphone, change the earphone channel of the audio data To enable the earphone channel to play audio data; when the electronic device is not connected to the earphone, change the earphone channel of the audio data so that the earphone channel plays audio data.

In this embodiment, when the earphone channel in the audio output channel is abnormal, the electronic device can adaptively switch its earphone channel to an audio output channel that matches the user's use scenario according to whether the headset is connected, which can improve the audio output. Stability and user experience. When the speaker channel in the audio output channel is abnormal, the electronic device can adaptively switch its speaker channel to an audio output channel that meets the user's usage scenario according to whether the headset is connected, which can improve the stability of the audio output and the user experience degree.

In one embodiment, the abnormality correction unit is further configured to set a mode conversion interface when the mode is abnormal, and perform mode conversion on the audio mode through the mode conversion interface to correct the second audio behavior information to repair abnormal playback.

In one embodiment, the abnormality correction unit is further used to perform mode conversion on the audio mode according to the mode conversion interface to correct the abnormal audio mode when the volume is abnormal; adjust the volume under the corrected audio mode to correct the abnormal volume.

In one embodiment, the device further includes:

The data acquisition module is used to acquire correction data for correcting the second audio behavior information, and report and store the correction data.

The electronic device can report and store the obtained correction data to statistically correct the data, which can prove the processing effect and processing efficiency of the audio processing method, and reduce or avoid the occurrence of abnormal playback in the subsequent audio playback process.

In one embodiment, wherein,

The information collection module is also used to control the monitoring module to collect the first display information used to set the display image in the display service when the target application is running;

The information acquisition module is also used to acquire the second display information of the display image of the electronic device when the target application displays the image;

The abnormality interpretation module is also used to identify whether the display of the image is abnormal based on the first display information and the first display information; and

The abnormality correction module is also used to correct the second display information to repair the abnormal display when the image is displayed.

The division of each module in the above audio processing device is for illustration only. In other embodiments, the audio processing device may be divided into different modules as needed to complete all or part of the functions of the above audio processing device.

Each module in the above audio processing device may be implemented in whole or in part by software, hardware, or a combination thereof. The above modules may be embedded in the hardware or independent of the processor in the electronic device, or may be stored in the memory in the electronic device in the form of software so that the processor can call and execute the operations corresponding to the above modules.

The embodiments of the present application also provide a computer-readable storage medium. One or more non-volatile computer-readable storage media containing computer-executable instructions, when the computer-executable instructions are executed by one or more processors, cause the processor to perform the following steps of the audio processing method:

Controlling the monitoring module to collect the first audio behavior information used to set the playing audio data in the audio service when the target application is running;

It should be noted that one or more non-volatile computer-readable storage media containing computer-executable instructions, when the computer-executable instructions are executed by one or more processors, may also cause the processor to perform any of the foregoing implementations Example audio processing method.

A computer program product containing instructions that, when run on a computer, causes the computer to perform the steps of the audio processing method:

It should be noted that a computer program product containing instructions, when run on a computer, causes the computer to perform the steps of the audio processing method in any of the above embodiments.

An embodiment of the present application also provides an electronic device. As shown in FIG. 10, for ease of description, only parts related to the embodiments of the present application are shown, and specific technical details are not disclosed, please refer to the method part of the embodiments of the present application. The electronic device may be any terminal device with a voice call function and a speaker, including mobile phones, tablet computers, PDA (Personal Digital Assistant), POS (Point of Sales), in-vehicle computers, wearable devices, etc. , Taking an electronic device as a mobile phone as an example:

10 is a block diagram of a partial structure of a mobile phone related to an electronic device provided by an embodiment of the present application. Referring to FIG. 10, the mobile phone includes: a radio frequency (Radio Frequency) circuit 1010, a memory 1020, an input unit 1030, a display unit 1040, a sensor 1050, an audio circuit 1060, a wireless fidelity (WiFi) module 1070, and a processor 1080 , And power supply 1090 and other components. Those skilled in the art may understand that the structure of the mobile phone shown in FIG. 10 does not constitute a limitation on the mobile phone, and may include more or fewer components than those shown in the figure, or a combination of certain components, or a different component arrangement.

Among them, the RF circuit 1010 can be used to receive and send signals during sending and receiving information or during a call. It can receive the downlink information of the base station and process it to the processor 1080; it can also send the uplink data to the base station. Generally, the RF circuit includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier (LNA), a duplexer, and the like. In addition, the RF circuit 1010 can also communicate with other devices via a wireless communication network. The above wireless communication can use any communication standard or protocol, including but not limited to Global System of Mobile (GSM), General Packet Radio Service (GPRS), and Code Division Multiple Access Multiple Access (CDMA), Wideband Code Division Multiple Access (Wideband Code Division Multiple Access, WCDMA), Long Term Evolution (LTE), e-mail, Short Message Service (SMS), etc.

The memory 1020 may be used to store software programs and modules. The processor 1080 executes various functional applications and data processing of the mobile phone by running the software programs and modules stored in the memory 1020. The memory 1020 may mainly include a program storage area and a data storage area, where the program storage area may store an operating system and at least one function-required application program (such as a sound playback function application program, an image playback function application program, etc.), etc.; The data storage area can store data (such as audio data, address book, etc.) created according to the use of the mobile phone. In addition, the memory 1020 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, or other volatile solid-state storage devices.

The input unit 1030 may be used to receive input numeric or character information, and generate key signal input related to user settings and function control of the mobile phone 1000. Specifically, the input unit 1030 may include a touch panel 1031 and other input devices 1032. The touch panel 1031, also known as a touch screen, can collect user's touch operations on or near it (for example, the user uses any suitable objects or accessories such as fingers, stylus, etc. on the touch panel 1031 or near the touch panel 1031 Operation), and drive the corresponding connection device according to the preset program. In one embodiment, the touch panel 1031 may include a touch detection device and a touch controller. Among them, the touch detection device detects the user's touch orientation, and detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives touch information from the touch detection device and converts it into contact coordinates, and then sends To the processor 1080, and can receive the commands sent by the processor 1080 and execute them. In addition, the touch panel 1031 may be implemented in various types such as resistive, capacitive, infrared, and surface acoustic waves. In addition to the touch panel 1031, the input unit 1030 may also include other input devices 1032. Specifically, the other input devices 1032 may include, but are not limited to, one or more of a physical keyboard, function keys (such as volume control keys, switch keys, etc.).

The display unit 1040 can be used to display information input by the user or information provided to the user and various menus of the mobile phone. The display unit 1040 may include a display panel 1041. In one embodiment, the display panel 1041 may be configured in the form of a liquid crystal display (Liquid Crystal) (LCD), an organic light-emitting diode (Organic Light-Emitting Diode, OLED), or the like. In one embodiment, the touch panel 1031 may cover the display panel 1041, and when the touch panel 1031 detects a touch operation on or near it, it is transmitted to the processor 1080 to determine the type of touch event, and then the processor 1080 according to The type of touch event provides a corresponding visual output on the display panel 1041. Although in FIG. 10, the touch panel 1031 and the display panel 1041 are implemented as two independent components to realize the input and input functions of the mobile phone, in some embodiments, the touch panel 1031 and the display panel 1041 may be integrated to Realize the input and output functions of the mobile phone.

The mobile phone 1000 may further include at least one sensor 1050, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor may include an ambient light sensor and a proximity sensor, wherein the ambient light sensor may adjust the brightness of the display panel 1041 according to the brightness of the ambient light, and the proximity sensor may close the display panel 1041 and/or when the mobile phone moves to the ear Or backlight. The motion sensor may include an acceleration sensor. The acceleration sensor can detect the magnitude of acceleration in various directions, and can detect the magnitude and direction of gravity when at rest. It can be used for applications that recognize mobile phone gestures (such as horizontal and vertical screen switching), and vibration recognition-related functions (such as Pedometer, percussion, etc.; in addition, the mobile phone can also be equipped with other sensors such as gyroscope, barometer, hygrometer, thermometer, infrared sensor, etc.

The audio circuit 1060, the speaker 1061, and the microphone 1062 may provide an audio interface between the user and the mobile phone. The audio circuit 1060 can transmit the converted electrical signal of the received audio data to the speaker 1061, which converts the speaker 1061 into a sound signal output; on the other hand, the microphone 1062 converts the collected sound signal into an electrical signal, which After receiving, it is converted into audio data, and then processed by the audio data output processor 1080, and then sent to another mobile phone through the RF circuit 1010, or the audio data is output to the memory 1020 for subsequent processing.

WiFi is a short-distance wireless transmission technology. The mobile phone can help users send and receive emails, browse web pages, and access streaming media through the WiFi module 1070. It provides users with wireless broadband Internet access. Although FIG. 10 shows the WiFi module 1070, it can be understood that it is not a necessary component of the mobile phone 1000, and may be omitted as needed.

The processor 1080 is the control center of the mobile phone, and uses various interfaces and lines to connect the various parts of the entire mobile phone, by running or executing the software programs and/or modules stored in the memory 1020, and calling the data stored in the memory 1020 to execute Various functions and processing data of the mobile phone, so as to monitor the mobile phone as a whole. In one embodiment, the processor 1080 may include one or more processing units. In one embodiment, the processor 1080 may integrate an application processor and a modem processor, where the application processor mainly processes an operating system, a user interface, an application program, and the like; the modem processor mainly processes wireless communication. It can be understood that the foregoing modem processor may not be integrated into the processor 1080.

The mobile phone 1000 also includes a power supply 1090 (such as a battery) for powering various components. Preferably, the power supply can be logically connected to the processor 1080 through a power management system, so as to realize functions such as charging, discharging, and power consumption management through the power management system.

In one embodiment, the mobile phone 1000 may further include a camera, a Bluetooth module, and the like.

In the embodiment of the present application, the processor 1080 included in the electronic device implements the following steps when executing the computer program stored on the memory:

It should be noted that an electronic device includes a memory and a processor, and the memory stores computer-readable instructions, and when the instructions are executed by the processor, the processor is caused to execute any of the foregoing embodiments Steps of the audio processing method.

Any references to memory, storage, databases, or other media used in this application may include non-volatile and/or volatile memory. Suitable non-volatile memory may include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), or flash memory. Volatile memory can include random access memory (RAM), which acts as external cache memory. By way of illustration and not limitation, RAM is available in many forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDR SDRAM), enhanced SDRAM (ESDRAM), synchronous Link (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).

The technical features of the above-mentioned embodiments can be arbitrarily combined. To simplify the description, all possible combinations of the technical features in the above-mentioned embodiments are not described. However, as long as there is no contradiction in the combination of these technical features, All should be considered within the scope of this description.

The above examples only express several implementations of the present invention, and their descriptions are more specific and detailed, but they should not be construed as limiting the patent scope of the invention. It should be noted that, for a person of ordinary skill in the art, without departing from the concept of the present invention, a number of modifications and improvements can also be made, which all fall within the protection scope of the present invention. Therefore, the protection scope of the invention patent shall be subject to the appended claims.

Claims

An audio processing method applied to electronic equipment, the method includes:

When the target application is running, obtain first audio behavior information set in an audio service, where the first audio behavior information is parameter information for playing the audio data;

When the target application plays the audio data, obtain second audio behavior information of the electronic device playing the audio data;

Identifying whether the playback of the audio data is abnormal according to the first audio behavior information and the second audio behavior information;

When the playback of the audio data is abnormal, the second audio behavior information is corrected to repair the abnormal playback.
The method according to claim 1, wherein, when the target application is running, acquiring the first audio behavior information set in the audio service includes:

When the target application is running, control the monitoring module to send an audio acquisition request to an audio service; wherein the audio acquisition request is used to instruct the audio service to collect the first audio behavior information;

Receiving the first audio behavior information fed back by the audio service.
The method according to claim 2, wherein the monitoring module uses binder and socket communication mechanisms to communicate with the audio service.
The method according to claim 1, wherein the first audio behavior information and the second audio behavior information each include at least an audio output channel, an audio mode, and a volume; the first audio behavior information and the first The second audio behavior information identifies whether the audio data is abnormally played, including:

Obtaining application information of the target application program;

Determine whether the second audio behavior information is abnormal according to the application information and the first audio behavior information;

If the second audio behavior information is abnormal, the playback of the audio data is abnormal.
The method according to claim 4, wherein the determining whether the second audio behavior information is abnormal according to the application information and the first audio behavior information includes:

Determine the determination order of the audio output channel, audio mode, and volume in the first audio behavior information and the second audio behavior information according to the application information;

Determine whether the first audio behavior information and the second audio behavior information are consistent according to the determination order;

If any one of the audio output channel, audio mode and volume is inconsistent, the second audio behavior information is abnormal.
The method according to claim 4, wherein, when the playback of the audio data is abnormal, correcting the second audio behavior information to repair the abnormal playback includes:

When the playback of the audio data is abnormal, the abnormal type is obtained according to the second audio behavior information; the abnormal type includes an abnormal mode, an abnormal channel, and an abnormal volume;

A preset correction strategy is adopted according to the abnormal type to correct the second audio behavior information to repair abnormal playback.
The method according to claim 6, wherein the adopting a corresponding correction strategy according to the abnormal type to correct the second audio behavior information to repair abnormal playback includes:

When the channel is abnormal, the preset interface function is called to correct the abnormal audio output channel in the second audio behavior information to repair the abnormal playback.
The method according to claim 7, wherein the call to correct the abnormal audio output channel in the second audio behavior information to repair abnormal playback when the channel is abnormal includes:

When the earphone channel of the audio output channel is abnormal, the preset interface function is called to change the earphone channel of the audio data, so that the speaker channel plays the audio data.
The method according to claim 7, wherein the call to correct the abnormal audio output channel in the second audio behavior information to repair abnormal playback when the channel is abnormal includes:

When the earphone channel of the audio output channel is abnormal, it is detected whether the electronic device is connected to a headset;

When the electronic device is connected with a headset, changing the earphone channel of the audio data, so that the headset channel plays the audio data;

When no earphone is connected to the electronic device, the earphone channel of the audio data is changed so that the speaker channel plays the audio data.
The method according to claim 7, wherein the call to correct the abnormal audio output channel in the second audio behavior information to repair abnormal playback when the channel is abnormal includes:

When the speaker channel of the audio output channel is abnormal, detect whether the electronic device is connected to a headset;

When the electronic device is connected with a headset, changing the earphone channel of the audio data, so that the headset channel plays the audio data;

When no earphone is connected to the electronic device, the earphone channel of the audio data is changed so that the earphone channel plays the audio data.
The method according to claim 6, wherein the adopting a corresponding correction strategy according to the abnormal type to correct the second audio behavior information to repair abnormal playback includes:

When the mode is abnormal, a mode conversion interface is set, and a mode conversion is performed on the audio mode through the mode conversion interface to correct the second audio behavior information to repair abnormal playback.
The method according to claim 11, wherein the adopting a corresponding correction strategy according to the abnormal type to correct the second audio behavior information to repair abnormal playback includes:

When the volume is abnormal, perform mode conversion on the audio mode according to the mode conversion interface to correct the abnormal audio mode;

Adjust the volume in the corrected audio mode to correct the abnormal volume.
The method of claim 1, wherein the method further comprises:

Obtain correction data correcting the second audio behavior information, and report and store the correction data.
The method of claim 1, wherein the method further comprises:

Controlling the monitoring module to collect the first display information used to set the display image in the display service when the target application is running;

When the target application displays the image, obtain second display information of the electronic device displaying the image;

Identifying whether the display of the image is abnormal according to the first display information and the first display information;

When the display of the image is abnormal, the second display information is corrected to repair the abnormal display.
An audio processing device is applied to electronic equipment. The device includes:

The information collection module is used to obtain first audio behavior information set in the audio service when the target application is running, wherein the first audio behavior information is parameter information for playing the audio data;

An information obtaining module, configured to obtain second audio behavior information of the electronic device playing the audio data when the target application plays the audio data;

An abnormality interpretation module, configured to identify whether the playback of the audio data is abnormal according to the first audio behavior information and the second audio behavior information; and

The abnormality correction module is configured to correct the second audio behavior information to repair abnormal playback when the playback of the audio data is abnormal.
A computer-readable storage medium on which a computer program is stored, which when executed by a processor implements the steps of the audio processing method according to any one of claims 1 to 14.
An electronic device includes a memory and a processor, and the memory stores computer-readable instructions, and when the instructions are executed by the processor, the processor is caused to perform as described in any one of claims 1 to 14. The audio processing method described.