WO2020107290A1

WO2020107290A1 - Audio output control method and apparatus, computer readable storage medium, and electronic device

Info

Publication number: WO2020107290A1
Application number: PCT/CN2018/118018
Authority: WO
Inventors: 李亚军
Original assignee: 深圳市欢太科技有限公司; Oppo广东移动通信有限公司
Priority date: 2018-11-28
Filing date: 2018-11-28
Publication date: 2020-06-04
Also published as: CN112997470A; CN112997470B

Abstract

An audio output control method and apparatus, a computer readable storage medium, and an electronic device. The audio output control method is applied to the electronic device having multiple audio output channels. The audio output control method comprises: obtaining an audio mode of a target application (302); monitoring whether the audio output channel of the target application for playing back audio data is abnormal according to the audio mode (304); when the audio output channel is abnormal, changing the audio output channel of the audio data, so that the changed audio output channel plays back the audio data (306).

Description

Audio output control method and device, computer readable storage medium, electronic equipment

Technical field

The present application relates to the technical field of electronic devices, and in particular to audio output control methods and devices, electronic devices, and computer-readable storage media.

Background technique

With the wide application of electronic devices and their increasingly rich functions, electronic devices have become an indispensable part of people's daily lives. Among them, the applications installed on electronic devices are more diverse. In the process of using the application, when the application plays audio data, the audio data can be output from the earpiece, speaker, and headphone channels.

However, during the use of the application, an abnormal call to the audio output channel occurs, which changes the output channel of the audio data. For example, the alarm sound should be output from the speaker channel, and the result is output from the earphone, which affects the user experience.

Summary of the invention

The embodiments of the present application provide an audio output control method and device, a computer-readable storage medium, and electronic equipment, which can repair abnormal audio output channels, enhance the stability of audio data output, and improve the user experience.

An audio output control method is applied to an electronic device having multiple audio output channels. The audio output channel includes an earpiece channel, an earphone channel, and a speaker channel. The method includes:

Get the audio mode of the target application;

Monitoring whether the audio output channel used by the target application to play audio data according to the audio mode is abnormal;

When the audio output channel is abnormal, the audio output channel of the audio data is changed so that the changed audio output channel plays the audio data.

An audio output control device is applied to electronic equipment having multiple audio output channels. The audio output channel includes an earpiece channel, a headphone channel, and a speaker channel. The device includes:

Mode acquisition module, used to obtain the audio mode of the target application;

A channel monitoring module, configured to monitor whether the audio output channel used by the target application to play audio data according to the audio mode is abnormal;

The channel processing module is configured to change the audio output channel of the audio data so that the changed audio output channel plays the audio data when the audio output channel is abnormal, wherein the audio output channel includes an earpiece channel, Headphone channel and speaker channel.

A computer-readable storage medium on which a computer program is stored, which when executed by a processor implements the steps of the audio output control method described above.

An electronic device includes a memory and a processor. The memory stores computer-readable instructions. When the instructions are executed by the processor, the processor causes the processor to execute the audio output control method according to the claims.

The above audio output control method and apparatus, computer-readable storage medium, and electronic equipment can acquire the audio mode of the target application program; monitor whether the audio output channel used by the target application to play audio data according to the audio mode is abnormal; when the audio output channel is abnormal When changing the audio output channel of the audio data, so that the changed audio output channel plays audio data, you can repair the abnormal audio output channel, automatically make the audio data output from the default audio output channel, and enhance the stability of the audio data output. It can avoid the situation that the audio data is output from other audio output channels, and improve the user experience.

BRIEF DESCRIPTION

In order to more clearly explain the embodiments of the present invention or the technical solutions in the prior art, the following will briefly introduce the drawings required in the embodiments or the description of the prior art. Obviously, the drawings in the following description are only These are some embodiments of the present invention. For those of ordinary skill in the art, without paying any creative labor, drawings of other embodiments can be obtained based on these drawings.

1 is a schematic diagram of the internal structure of an electronic device in an embodiment;

2 is a schematic diagram of a part of the architecture of an Android audio system in an embodiment;

3 is a schematic flowchart of an audio output control method in an embodiment;

4 is a schematic flowchart of whether an audio output channel used to listen to a target application program for playing audio data according to the audio mode is abnormal according to an embodiment;

5 is a schematic flowchart of changing the audio output channel of the audio data when the audio output channel is abnormal in another embodiment;

6 is a schematic flowchart of an audio output control method in another embodiment;

7 is a schematic flowchart of a method for controlling audio output in another embodiment;

FIG. 8 is a schematic flowchart of playing the audio data in the changed audio output channel in an embodiment;

9 is a schematic diagram of an audio output control device in an embodiment;

10 is a block diagram of a partial structure of a mobile phone related to an electronic device provided by an embodiment of the present application.

detailed description

In order to facilitate understanding of the present invention, the present invention will be described more fully below with reference to related drawings. The drawings show preferred embodiments of the invention. However, the present invention can be implemented in many different forms, and is not limited to the embodiments described herein. On the contrary, the purpose of providing these embodiments is to make the understanding of the disclosure of the present invention more thorough and comprehensive.

In one embodiment, as shown in FIG. 1, a schematic diagram of an internal structure of an electronic device is provided. The electronic device includes a processor, memory, and display screen connected by a system bus. Among them, the processor is used to provide computing and control capabilities to support the operation of the entire electronic device. The memory is used to store data, programs, and/or instruction codes, etc. At least one computer program is stored on the memory, and the computer program can be executed by the processor to implement the audio output control method for electronic devices provided in the embodiments of the present application . The memory may include a non-volatile storage medium such as a magnetic disk, an optical disk, a read-only memory (Read-Only Memory, ROM), or a random-access memory (Random-Access-Memory, RAM). For example, in one embodiment, the memory includes a non-volatile storage medium and internal memory. The non-volatile storage medium stores the operating system, database, and computer program. The database stores data related to an audio output control method provided by the above embodiments, for example, information such as the name of each process or application may be stored. The computer program can be executed by the processor to implement an audio output control method provided by various embodiments of the present application. The internal memory provides a cached operating environment for operating systems, databases, and computer programs in non-volatile storage media. The display screen may be a touch screen, such as a capacitive screen or an electronic screen, which is used to display interface information of applications corresponding to the foreground process, and may also be used to detect a touch operation acting on the display screen, and generate corresponding instructions, such as performing front and background Application switching instructions, etc.

Those skilled in the art may understand that the structure shown in FIG. 1 is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the electronic device to which the solution of the present application is applied. The specific electronic device may It includes more or fewer components than shown in the figure, or some components are combined, or have a different component arrangement. For example, the electronic device further includes a network interface connected through a system bus. The network interface may be an Ethernet card or a wireless network card, etc., and is used to communicate with external electronic devices, for example, it may be used to communicate with a server.

In one embodiment, as shown in FIG. 2, a partial architecture diagram of an Android audio system is provided. The architecture system of the Android audio system includes a kernel space layer 210, a local layer 220, a framework layer 230, and a client layer 240.

The Kernel space layer 210 may include an Audio driver module 211, where the Audio driver module interacts with the hardware and implements the local layer interface for the upper layer to call normally. Here, ALSA, OSS, and a custom audio driver can be selected. The local layer 220 includes an AtlasService_Jni module 221, an AtlasService Interface module 223, and an AtlasService module 225. The framework layer 230 includes an AtlasManager module 231 and an AtlasService module 233. Among them, the AtlasManager module 231 is provided with a conventional interface and a registration callback interface. The AtlasService module 225 in the local layer 220 and the AtlasService module 233 in the framework layer 230 are used for event reception and processing, information collection, abnormal feedback, and log collection, where the information collection may include the collection of display information and the collection of audio information. Among them, the audio information includes playback information, recording information, audio mode setting information, and so on. Because the AtlasService module is set up in the system-level framework layer, it can facilitate interaction with other system services, and at the same time, there is no need to worry about permissions during system calls. Through the above-mentioned architecture, the audio output control methods in various embodiments of the present application can be implemented.

In one embodiment, as shown in FIG. 3, an audio output control method is provided, which is applied to an electronic device having multiple audio output channels. In one embodiment, the electronic device may include a mobile phone, a tablet computer, a laptop computer, a palmtop computer, a mobile Internet device (Mobile Internet Device (MID), a wearable device (such as a smart watch, smart bracelet, pedometer, etc.) Or other electronic devices with voice call function and speakers.

The audio output channel includes an earpiece channel, a speaker channel, and a headset channel, where the headset channel may include a wired headset channel and a wireless headset (Bluetooth headset) channel. When the audio output channel is the earpiece channel, the audio data is sent by the earpiece; when the audio output channel is the speaker channel, the audio data is sent by the external speaker; when the audio output channel is the earphone channel, the audio data can be through wired headphones or Bluetooth headphones issue.

As shown in FIG. 3, in one embodiment, the audio output control method includes steps 302-306.

Step 302: Acquire the audio mode of the target application.

The target application program may be understood as an application program capable of outputting and/or outputting audio signals, and the number of target application programs may be 1, 2, 3 or more. For example, the target application may include applications such as call, instant messaging, audio playback, video playback, sound control, and voice input. Among them, the audio mode may include a multimedia mode, a ringtone mode, an alarm mode, a call mode, a call mode (including audio/video, VoIP call), and a system mode.

Each target application corresponds to an audio mode, for example, the audio mode corresponding to the audio playback and video playback target applications is the multimedia mode, the audio mode corresponding to the clock is the alarm clock mode, and the audio mode corresponding to the call target application Can be a call mode, etc.

The electronic device can manage the audio mode based on the AudioManager in the architecture system of the Android audio system. Specifically, the audio mode of the target application can be set based on the setting function setMode(). The electronic device can obtain the audio mode of the target application program in the running state based on the AudioManager. The running state can be understood as running in the foreground or running in the background.

In one embodiment, the electronic device may preset to construct a list or database including all target applications, for storing identification information of the target applications, and the like.

Step 304: Monitor whether the audio output channel used by the target application to play audio data is abnormal according to the audio mode.

Each audio mode can correspond to multiple audio output channels for playing audio data. For example, when the target application is a call application, the audio mode corresponding to the target application is a call mode, when the electronic device is in a call state , You can make a voice call through the receiver channel, speaker channel or headset channel, that is, the audio output channel corresponding to the call mode includes the receiver channel, speaker channel and headset channel.

At the same time, each audio mode can be provided with at least one default audio output channel. For example, when the audio mode is a call mode, the corresponding default audio output channels may include a receiver channel and a headset channel. When the electronic terminal is connected to the headset, the default audio output channel is the headset channel. When the electronic device is not connected to the headset, the default The audio output channel is the earpiece channel. For example, when the audio mode is the bell mode or the alarm mode, the corresponding default audio output channel is the speaker mode.

When the target application plays audio data, the electronic device can monitor the audio output channel currently used to play the audio data. If the audio output channel is consistent with the default audio output channel corresponding to the audio mode of the target application, it can be considered The audio output channel used by the target application to play audio data is normal; otherwise, the audio output channel used by the target application to play audio data is abnormal. For example, when an electronic device calls, its ringtone is sent from the earpiece channel or its ringtone is sent from the headset channel, it can be considered that the audio output channel of the target application used to play the ringtone is abnormal.

It should be noted that the audio data includes voice data, ringtone data, alarm data, multimedia data (video streaming, audio streaming data, etc.) and so on.

Step 306, when the audio output channel is abnormal, the audio output channel of the audio data is changed, so that the changed audio output channel plays audio data.

The electronic device can determine whether the audio output channel currently used to play audio data is abnormal. When the audio output channel is abnormal, the audio output channel currently used to play audio data can be changed so that the changed audio output channel can play the target application Control audio data for playback. For example, when an electronic device calls, the ringtone is sent from the earpiece channel or the ringtone is sent from the earphone channel, the electronic device can switch the earphone channel or the earphone channel currently used to play the ringtone to the speaker channel, and the audio data is played by the speaker.

The above audio output control method can obtain the audio mode of the target application; monitor whether the audio output channel used by the target application to play audio data is abnormal according to the audio mode; when the audio output channel is abnormal, change the audio output channel of the audio data to Make the changed audio output channel play audio data, can repair abnormal audio output channel, automatically make the audio data output from the default audio output channel, enhance the stability of the audio data output, can avoid the audio data output from other audio output channels The situation occurs, improving the user experience.

As shown in FIG. 4, in one embodiment, monitoring the audio output channel used by the target application to play audio data according to the audio mode is abnormal, including

Step 402: When the target application plays audio data, monitor the audio output channel that plays the audio data.

In one embodiment, a monitoring module is created based on the operating system of the electronic device, and the audio output channel of the target application program is monitored through the monitoring module. Wherein, the monitoring module can also be used to monitor the audio mode, volume adjustment, recording and other information related to the input and/or output of audio data of the target application. Taking an electronic device with an Android operating system as an example, a system-level monitoring module (AtlasService module) can be created at the system framework layer (native/framework layer) to monitor the audio output channel and audio mode of the target application through the monitoring module. For example, you can set up a listener module in the framework layer and run it in the system service program (system_server). Since the listener module is established in the system-level service framework layer, you can easily interact with other system services without worrying about system calls. Permissions issue.

Optionally, the electronic device can also create an independent monitoring process to monitor the audio output channel of the target application through the message transmission mechanism. In this process, a separate monitoring function is set up and called, which can be set to start automatically after power-on, and monitor the audio mode setting of any other target application and the audio output channel that plays audio data in real time.

Step 404: Identify whether the audio output channel conforms to the audio mode playback standard.

Step 406, when the audio output channel does not meet the playback standard of the audio mode, the audio output channel is abnormal.

Electronic equipment can also pre-construct a mapping table of audio output channels and audio mode matching; in this mapping table, all audio output channels of the audio mode and the default audio output channel are stored, where the default audio output channel can be understood as the target application When a program plays audio data, the audio output channel used to play the audio data has the highest priority, that is, the default audio output channel has the highest playback priority among all audio output channels. If the default audio output channel is used to play audio data, it can be considered to comply with the playback standards of the audio mode.

According to the mapping table, identify whether the audio output channel meets the playback standards of the audio mode. For example, the target application that controls the playback of audio data is a video application, and its audio mode is a multimedia mode, and the default audio output channel corresponding to the multimedia mode is a speaker channel. If the video application plays the video, the audio data is sent from the earphone channel, and the multimedia mode playback standard is that the audio data is sent from the speaker channel, it can be considered that the earphone channel does not meet the multimedia mode playback standard.

When the audio output channel does not meet the playback standards of the audio mode, the audio output channel is abnormal.

As shown in FIG. 5, in one embodiment, when the audio output channel is abnormal, changing the audio output channel of the audio data includes:

Step 502, when the audio output channel is abnormal, the preset interface function is called.

Step 504: Change the audio output channel of the audio data according to the preset interface function.

When the audio output channel playing audio data is abnormal, the electronic device can call a preset interface function to set the audio output channel. The preset interface functions include at least the setSpeakerphoneOn() interface function, setMode(AudioManager.MODE_IN_CALL) interface function, isWiredHeadsetOn() interface function or other interface functions for setting the earphone channel and headphone channel.

For example, in an electronic device based on the Android operating system, the electronic device can set the speaker channel by calling the interface function setSpeakerphoneOn() in the AudioManager, that is, the speaker channel can be turned on or off. The electronic device can set the earpiece channel by calling the function setMode(AudioManager.MODE_IN_CALL) in AudioManager or the construction parameter streamType(STREAM_VOICE_CALL); the electronic device can set and detect the earpiece channel by calling the function isWiredHeadsetOn() in AudioManager.

Optionally, the interface function setMode() can be used to set the sound mode, for example, void setMode(intmode). Among them, the settable values are NORMAL, RINGTONE and IN_CALL. For example, setRingerMode (intringerMode) can be used to set the ringtone mode of the phone, which includes normal ringtone (RINGER_MODE_NORMAL), ringtone silence (RINGER_MODE_SILENT), and vibration (RINGER_MODE_VIBRATE).

As shown in FIG. 6, in one embodiment, the audio output control method includes steps 602-610. among them,

Step 602: Acquire the audio mode of the target application.

Step 604: Monitor whether the audio output channel used by the target application to play audio data is abnormal according to the audio mode.

The above step 602 and step 604 correspond to step 302 and step 304 in the foregoing embodiment, and will not be described here.

Step 606, when the earphone channel is abnormal, it is detected whether the electronic device is connected to the earphone.

The electronic device can obtain the audio mode of the target application used to control the playback of audio data and determine the default audio output channel of the audio mode. The earpiece channel is considered abnormal.

When the earpiece channel is abnormal, the electronic device can detect whether a headset is currently connected to the electronic device. The connection may be a wired connection or a wireless connection (Bluetooth connection).

For example, an electronic device can set and detect whether a wired headset is connected by calling the function isWiredHeadsetOn() in AudioManager, or detect whether a wired headset is connected by detecting the high and low level of GPIO (General Purpose/Input, Output) . Specifically, the preset state of the GPIO interface is a high level, and the current detection state is a low level, indicating that the state of the GPIO interface has changed and the electronic device is connected to a wired headset.

For example, an electronic device can detect whether a Bluetooth headset is connected through the BluetoothAdapter class. At the same time, the electronic device can also detect the interface state of the corresponding audio interface based on the Bluetooth protocol, and then detect whether the electronic device is connected to the Bluetooth headset.

It should be noted that the electronic device can also detect whether it is connected to the earphone based on other software or hardware, which is not limited to the above example.

Step 608: When the electronic device is connected to the earphone, change the earphone channel of the audio data so that the earphone channel plays the audio data.

When the electronic device is connected to the headset, if the default audio output channel corresponding to the audio mode of the target application is the earpiece channel, the preset interface function for switching to the headset channel can be called, and the audio will be output according to the preset interface function The audio output channel of the data is switched from the earpiece mode to the headphone channel, and the headphone channel plays the audio data.

Step 610: When the electronic device is not connected with the earphone, change the earphone channel of the audio data, so that the speaker channel plays the audio data.

When the electronic device is connected to the headset, when the default audio output channel corresponding to the audio mode of the target application is the speaker channel, the preset interface function for switching to the speaker channel can be called, and the audio will be output according to the preset interface function The audio output channel of the data is switched from the receiver mode to the speaker channel, and the speaker channel plays the audio data.

In this embodiment, when the earphone channel in the audio output channel is abnormal, the electronic device can adaptively switch its earphone channel to an audio output channel that matches the user's use scenario according to whether the headset is connected, which can improve the audio output. Stability and user experience.

As shown in FIG. 7, in one embodiment, the audio output control method includes steps 702-710. among them,

Step 702: Acquire the audio mode of the target application.

Step 704: Monitor whether the audio output channel used by the target application to play audio data is abnormal according to the audio mode.

Step 702 and step 704 correspond to step 302 and step 304 in the foregoing embodiment, and will not be repeated here.

Step 706, when the speaker channel is abnormal, it is detected whether the electronic device is connected to the earphone.

The electronic device can obtain the audio mode of the target application used to control the playback of audio data, and determine the default audio output channel of the audio mode. If the default audio output channel is not a speaker channel, but its audio data is output through the speaker channel, The speaker channel is considered abnormal.

It should be noted that the detection method for detecting whether the electronic device is connected to the earphone in this step is the same as the detection method for detecting whether the electronic device is connected to the earphone in the foregoing embodiment, and details are not described here.

Step 708, when the electronic device is connected to the earphone, change the earphone channel of the audio data, so that the earphone channel plays the audio data.

When the electronic device is connected to the headset, if the default audio output channel corresponding to the audio mode of the target application is a speaker channel, a preset interface function for switching to the headset channel can be called, and the audio will be output according to the preset interface function The audio output channel of the data is switched from the speaker mode to the headphone channel, and the headphone channel plays the audio data.

Step 710, when the electronic device is not connected with the earphone, change the earphone channel of the audio data, so that the earphone channel plays the audio data.

When the electronic device is connected to a headset, if the default audio output channel corresponding to the audio mode of the target application is a speaker channel, a preset interface function for switching to the earpiece channel can be called, and the audio will be output according to the preset interface function The audio output channel of the data is switched from the speaker mode to the receiver channel, and the receiver channel plays the audio data.

In this embodiment, when the speaker channel in the audio output channel is abnormal, the electronic device can adaptively switch its speaker channel to an audio output channel that matches the user's use scenario according to whether the headset is connected, which can improve the audio output. Stability and user experience.

Further, when the speaker channel is abnormal, changing the audio output channel of the audio data may further include: when the speaker channel is abnormal, muting the volume of the speaker channel and changing the audio output channel of the audio data. Specifically, if the speaker channel is abnormal, the audio data can be output from the speaker channel. If the volume of the speaker output channel is adjusted to mute, the audio data can be prevented from being exposed by the speaker and leaking the privacy of the user's audio data, which improves the risk Protection of audio data played by the speaker output channel.

In one embodiment, when the earphone channel is abnormal, the audio output channel of the audio data is changed so that the changed audio output channel plays audio data, specifically including the earphone that changes the audio data when the electronic device is connected to the earphone and the earphone channel is abnormal Steps to enable the speaker channel to play audio data.

The electronic device can obtain the audio mode of the target application used to control the playback of audio data, and determine the default audio output channel of the audio mode. If the default audio output channel is not the headphone channel, but its audio data is output through the headphone channel, The earphone channel is considered abnormal. For example, in the alarm clock mode, the corresponding default audio output channel is the speaker. When the electronic device is connected to the headset, the alarm is output from the headset channel, but not from the speaker, it can be considered that the current headset channel is abnormal, then the electronic device It can call the preset calling function for switching to the speaker channel to make the alarm output from the speaker channel, so as to avoid the alarm output from the headset channel, and the user cannot perceive the alarm occurrence when the alarm is output from the speaker , The user can hear the alarm normally without affecting the user's normal work and rest.

As shown in FIG. 8, in one embodiment, playing audio data on the changed audio output channel includes:

Step 802: Acquire environmental noise of an electronic device.

When the electronic device determines that the audio output channel of the audio data is abnormal, it can change the audio output channel of the audio data, and at the same time, it can also obtain the environmental noise of the electronic device. Among them, the environmental noise may be the sound that interferes with the surrounding living environment generated in industrial production, building construction, transportation and social life. For example, the electronic device may collect environmental sounds based on at least one microphone, and analyze and process the environmental sounds to obtain environmental noise.

Step 804: Adjust the volume of the audio data played by the audio output channel according to the environmental noise.

The electronic device can adjust the volume of the audio data played by the audio output channel according to the environmental noise, that is, when the electronic device determines that the audio output channel of the audio data is abnormal, it can change the audio output channel of the audio data and adjust the audio output according to the environmental noise Channel playback volume for playing audio data. For example, the greater the environmental noise, the higher the correspondingly adjusted volume. However, the maximum value of the volume does not exceed the preset value.

In this embodiment, when the audio output channel is abnormal, the audio output channel of the audio data is changed, and at the same time, the volume of the audio data played by the changed audio output channel can be adjusted according to the environmental noise of the electronic device, thereby improving the user experience.

In one embodiment, enabling the changed audio output channel to play audio data includes: acquiring a playback time point of the audio data; and starting to play audio data from the playback time point according to the changed audio output channel.

Specifically, when the audio output channel is abnormal, the audio output channel of the audio data can be changed, and at the same time, the electronic device can also obtain the playback time point of the abnormal audio output channel to play the audio data, and make the changed audio output channel from the The audio data starts playing at the playback time. For example, if the earpiece channel is abnormal, the playing time of the earpiece channel playing audio data can be obtained. The playback time point can be understood as the initial time on the time axis of the audio data played by the earpiece, and record the time, for example, the time is 10:01:05, when the changed audio output channel is a speaker, you can use The speaker starts to play the audio data from the playback time point 10:01:05.

The audio control output method in this embodiment can automatically realize the replay of audio data in a period before switching the audio output channel, so that the user can learn the audio data in the process of switching the audio output mode, reducing user operations and improving the user experience.

It should be noted that the steps in this embodiment can also be used before or after steps 802 to 804 to improve the playback quality of the audio data played during the audio output channel switching process and enhance the user experience.

It should be understood that although the steps in the flowcharts of FIGS. 3-8 are sequentially displayed according to the arrows, these steps are not necessarily executed in the order indicated by the arrows. Unless clearly stated in this article, the execution of these steps is not strictly limited in order, and these steps can be executed in other orders. Moreover, at least some of the steps in FIGS. 3-8 may include multiple sub-steps or multiple stages. These sub-steps or stages are not necessarily executed at the same time, but may be executed at different times. These sub-steps or stages The execution order of is not necessarily sequential, but may be executed in turn or alternately with at least a part of other steps or sub-steps or stages of other steps.

As shown in FIG. 9, the present application also provides an audio output control device, including: an acquisition module 910, a listening module 920, and a processing module 930. among them,

The mode obtaining module 910 is used to obtain the audio mode of the target application program;

The channel monitoring module 920 is used to monitor whether the audio output channel used by the target application to play audio data is abnormal according to the audio mode;

The channel processing module 930 is configured to change the audio output channel of the audio data so that the changed audio output channel plays audio data when the audio output channel is abnormal, wherein the audio output channel includes an earphone channel, a headphone channel, and a speaker channel.

The above audio output control device can acquire the audio mode of the target application; monitor whether the audio output channel used by the target application to play audio data is abnormal according to the audio mode; when the audio output channel is abnormal, change the audio output channel of the audio data to Make the changed audio output channel play audio data, can repair abnormal audio output channel, automatically make the audio data output from the default audio output channel, enhance the stability of the audio data output, can avoid the audio data output from other audio output channels The situation occurs, improving the user experience.

In one embodiment, the channel monitoring module 920 includes:

The channel monitoring unit is used to monitor the audio output channel of the audio data when the target application plays the audio data;

Standard identification unit, used to identify whether the audio output channel meets the playback standards of the audio mode;

The abnormality judging unit is used to make the audio output channel abnormal when the audio output channel does not meet the playback standard of the audio mode.

In one embodiment, the channel monitoring unit is also used to:

The operating system based on the electronic device creates a monitoring module to monitor the audio output channel of the target application through the monitoring module, or creates a monitoring process to monitor the audio output channel of the target application through the message transmission mechanism.

In one embodiment, the standard identification unit is also used to:

Build a mapping table between the audio output channel and the audio mode; according to the mapping table, identify whether the audio output channel meets the playback standards of the audio mode.

In one embodiment, the channel processing module 930 includes:

The calling unit is used to call a preset interface function when the audio output channel is abnormal;

The processing unit is used to change the audio output channel of the audio data according to the preset interface function.

In one embodiment, the channel processing module 930 further includes:

The setting unit is used to set a preset interface function based on the operating system of the electronic device, and the preset interface function is used to set an audio output channel.

In one embodiment, when the earpiece channel is abnormal, the channel processing module 930 further includes:

The detection unit is used to detect whether the electronic device is connected to the earphone;

The processing unit is also used to change the earphone channel of the audio data when the electronic device is connected to the earphone, so that the earphone channel plays audio data; when the electronic device is not connected to the earphone, change the earphone channel of the audio data, so that the speaker channel plays audio data .

In one embodiment, when the speaker channel is abnormal, the processing unit is further used to change the earphone channel of the audio data when the electronic device is connected to the earphone, so that the earphone channel plays audio data

When no earphone is connected to the device, change the earphone channel of the audio data so that the earphone channel plays audio data.

In one embodiment, when the speaker channel is abnormal, the processing unit is also used to mute the volume of the speaker channel and change the audio output channel of the audio data.

In one embodiment, the channel processing module 930 further includes: a noise acquisition unit for acquiring environmental noise of the electronic device;

The processing unit is also used to adjust the volume of the audio output channel playing audio data according to the environmental noise.

In one embodiment, the channel processing module 930 further includes: a playback acquisition unit, configured to acquire a playback time point of audio data;

The processing unit is also used to start playing audio data from the playing time according to the changed audio output channel.

The division of each module in the above audio output control device is for illustration only. In other embodiments, the audio output control device may be divided into different modules as needed to complete all or part of the functions of the above audio output control device.

Each module in the above audio output control device may be implemented in whole or in part by software, hardware, or a combination thereof. The above modules may be embedded in the hardware or independent of the processor in the electronic device, or may be stored in the memory in the electronic device in the form of software, so that the processor can call and execute the operations corresponding to the above modules.

The embodiments of the present application also provide a computer-readable storage medium. One or more non-volatile computer-readable storage media containing computer-executable instructions, when the computer-executable instructions are executed by one or more processors, cause the processor to perform the following steps of the audio output control method:

Get the audio mode of the target application;

Monitor the audio output channel used by the target application to play audio data according to the audio mode for abnormality;

When the audio output channel is abnormal, the audio output channel of the audio data is changed so that the changed audio output channel plays audio data.

It should be noted that one or more non-volatile computer-readable storage media containing computer-executable instructions, when the computer-executable instructions are executed by one or more processors, may also cause the processor to perform any of the foregoing implementations Example audio output control method.

A computer program product containing instructions that, when run on a computer, causes the computer to perform the steps of the audio output control method:

Get the audio mode of the target application;

Whether the audio output channel used by the target application to play audio data according to the audio mode is abnormal;

It should be noted that a computer program product containing instructions, when run on a computer, causes the computer to execute the steps of the audio output control method in any of the above embodiments.

An embodiment of the present application also provides an electronic device. As shown in FIG. 10, for ease of description, only parts related to the embodiments of the present application are shown, and specific technical details are not disclosed, please refer to the method part of the embodiments of the present application. The electronic device may be any terminal device including a mobile phone, tablet computer, PDA (Personal Digital Assistant), POS (Point of Sales), in-vehicle computer, wearable device, etc. that has a voice call function and has a speaker , Taking an electronic device as a mobile phone as an example:

10 is a block diagram of a partial structure of a mobile phone related to an electronic device provided by an embodiment of the present application. 10, the mobile phone includes: a radio frequency (Radio Frequency) circuit 1010, a memory 1020, an input unit 1030, a display unit 1040, a sensor 1050, an audio circuit 1060, a wireless fidelity (WiFi) module 1070, a processor 1080 , And power supply 1090 and other components. Those skilled in the art may understand that the structure of the mobile phone shown in FIG. 10 does not constitute a limitation on the mobile phone, and may include more or less components than those shown in the figure, or a combination of certain components, or a different component arrangement.

Among them, the RF circuit 1010 can be used to receive and send signals during sending and receiving information or during a call. It can receive the downlink information of the base station and process it to the processor 1080; it can also send uplink data to the base station. Generally, RF circuits include but are not limited to antennas, at least one amplifier, transceiver, coupler, low noise amplifier (Low Noise Amplifier, LNA), duplexer, and so on. In addition, the RF circuit 1010 can also communicate with the network and other devices through wireless communication. The above wireless communication can use any communication standard or protocol, including but not limited to Global System of Mobile (GSM), General Packet Radio Service (GPRS), and Code Division Multiple Access (Code Division) Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Long Term Evolution (LTE), e-mail, Short Message Service (SMS), etc.

The memory 1020 may be used to store software programs and modules. The processor 1080 executes various functional applications and data processing of the mobile phone by running the software programs and modules stored in the memory 1020. The memory 1020 may mainly include a program storage area and a data storage area, where the program storage area may store an operating system and at least one function-required application program (such as a sound playback function application program, an image playback function application program, etc.), etc.; The data storage area can store data (such as audio data, address book, etc.) created according to the use of the mobile phone. In addition, the memory 1020 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, or other volatile solid-state storage devices.

The input unit 1030 may be used to receive input numeric or character information, and generate key signal input related to user settings and function control of the mobile phone 1000. Specifically, the input unit 1030 may include a touch panel 1031 and other input devices 1032. The touch panel 1031, also known as a touch screen, can collect user's touch operations on or near it (for example, the user uses any suitable objects or accessories such as fingers, stylus, etc. on or near the touch panel 1031 Operation), and drive the corresponding connection device according to the preset program. In one embodiment, the touch panel 1031 may include a touch detection device and a touch controller. Among them, the touch detection device detects the user's touch orientation, and detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives touch information from the touch detection device and converts it into contact coordinates, and then sends To the processor 1080, and can receive the commands sent by the processor 1080 and execute them. In addition, the touch panel 1031 can be implemented in various types such as resistive, capacitive, infrared, and surface acoustic waves. In addition to the touch panel 1031, the input unit 1030 may also include other input devices 1032. Specifically, other input devices 1032 may include, but are not limited to, one or more of a physical keyboard, function keys (such as volume control keys, switch keys, etc.), and the like.

The display unit 1040 may be used to display information input by the user or information provided to the user and various menus of the mobile phone. The display unit 1040 may include a display panel 1041. In one embodiment, the display panel 1041 may be configured in the form of a liquid crystal display (Liquid Crystal) (LCD), an organic light-emitting diode (Organic Light-Emitting Diode, OLED), or the like. In one embodiment, the touch panel 1031 may cover the display panel 1041, and when the touch panel 1031 detects a touch operation on or near it, it is transmitted to the processor 1080 to determine the type of touch event, and then the processor 1080 according to The type of touch event provides a corresponding visual output on the display panel 1041. Although in FIG. 10, the touch panel 1031 and the display panel 1041 are implemented as two independent components to realize the input and input functions of the mobile phone, in some embodiments, the touch panel 1031 and the display panel 1041 may be integrated to Realize the input and output functions of the mobile phone.

The mobile phone 1000 may further include at least one sensor 1050, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor may include an ambient light sensor and a proximity sensor, wherein the ambient light sensor may adjust the brightness of the display panel 1041 according to the brightness of the ambient light, and the proximity sensor may close the display panel 1041 and/or when the mobile phone moves to the ear Or backlight. The motion sensor may include an acceleration sensor. The acceleration sensor can detect the magnitude of acceleration in various directions, and can detect the magnitude and direction of gravity when at rest. Pedometer, percussion), etc. In addition, the mobile phone can also be equipped with other sensors such as gyroscope, barometer, hygrometer, thermometer, infrared sensor and so on.

The audio circuit 1060, the speaker 1061, and the microphone 1062 may provide an audio interface between the user and the mobile phone. The audio circuit 1060 can transmit the received audio data converted electrical signal to the speaker 1061, which converts the speaker 1061 into a sound signal output; on the other hand, the microphone 1062 converts the collected sound signal into an electrical signal, which is converted by the audio circuit 1060 After receiving, it is converted into audio data, and then processed by the audio data output processor 1080, and then sent to another mobile phone through the RF circuit 1010, or the audio data is output to the memory 1020 for subsequent processing.

WiFi is a short-range wireless transmission technology. Mobile phones can help users send and receive emails, browse web pages, and access streaming media through the WiFi module 1070. It provides users with wireless broadband Internet access. Although FIG. 10 shows the WiFi module 1070, it can be understood that it is not a necessary component of the mobile phone 1000, and may be omitted as needed.

The processor 1080 is the control center of the mobile phone, and uses various interfaces and lines to connect the various parts of the entire mobile phone, by running or executing the software programs and/or modules stored in the memory 1020, and calling the data stored in the memory 1020 to execute Various functions and processing data of the mobile phone, so as to monitor the mobile phone as a whole. In one embodiment, the processor 1080 may include one or more processing units. In one embodiment, the processor 1080 may integrate an application processor and a modem processor, where the application processor mainly processes an operating system, user interface, application programs, and the like; the modem processor mainly processes wireless communication. It can be understood that the foregoing modem processor may not be integrated into the processor 1080.

The mobile phone 1000 further includes a power supply 1090 (such as a battery) for powering various components. Preferably, the power supply can be logically connected to the processor 1080 through a power management system, so as to realize functions such as charging, discharging, and power management through the power management system.

In one embodiment, the mobile phone 1000 may further include a camera, a Bluetooth module, and the like.

In the embodiment of the present application, the processor 1080 included in the electronic device implements the following steps when executing the computer program stored in the memory:

Get the audio mode of the target application;

It should be noted that the processor 880 included in the electronic device implements the audio output control method in any of the foregoing embodiments when the computer program stored in the memory is executed.

Any references to memory, storage, databases, or other media used in this application may include non-volatile and/or volatile memory. Suitable non-volatile memory may include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), or flash memory. Volatile memory can include random access memory (RAM), which acts as external cache memory. By way of illustration and not limitation, RAM is available in many forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDR) SDRAM, enhanced SDRAM (ESDRAM), synchronous Link (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).

The technical features of the above-mentioned embodiments can be combined arbitrarily. To simplify the description, all possible combinations of the technical features in the above-mentioned embodiments are not described. However, as long as there is no contradiction in the combination of these technical features, All should be considered within the scope of this description.

The above-mentioned embodiments only express several embodiments of the present invention, and their descriptions are more specific and detailed, but they should not be construed as limiting the scope of the invention patent. It should be noted that, for a person of ordinary skill in the art, without departing from the concept of the present invention, several modifications and improvements can also be made, which all fall within the protection scope of the present invention. Therefore, the protection scope of the invention patent shall be subject to the appended claims.

Claims

An audio output control method is applied to an electronic device having multiple audio output channels, wherein the audio output channel includes an earpiece channel, an earphone channel, and a speaker channel, and the method includes:

Get the audio mode of the target application;

Monitoring whether the audio output channel used by the target application to play audio data according to the audio mode is abnormal;

When the audio output channel is abnormal, the audio output channel of the audio data is changed so that the changed audio output channel plays the audio data.
The method according to claim 1, wherein the monitoring of whether the audio output channel used by the target application to play audio data according to the audio mode is abnormal includes:

When the target application plays the audio data, monitor the audio output channel that plays the audio data;

Identify whether the audio output channel conforms to the playback standard of the audio mode;

When the audio output channel does not meet the playback standard of the audio mode, the audio output channel is abnormal.
The method according to claim 2, wherein the audio output channel for monitoring and playing the audio data includes:

Creating a monitoring module based on the operating system of the electronic device, and monitoring the audio output channel of the target application through the monitoring module, or,

Create a monitoring process to monitor the audio output channel of the target application through a message transmission mechanism.
The method according to claim 2, wherein the identifying whether the audio output channel conforms to the playback standard of the audio mode includes:

Build a mapping table between audio output channels and audio patterns;

According to the mapping table, identify whether the audio output channel conforms to the playback standard of the audio mode.
The method according to claim 1, wherein said changing the audio output channel of the audio data when the audio output channel is abnormal includes:

When the audio output channel is abnormal, call a preset interface function;

Changing the audio output channel of the audio data according to the preset interface function.
The method according to claim 1, wherein, when the earpiece channel is abnormal, changing the audio output channel of the audio data so that the changed audio output channel plays the audio data includes:

Detect whether the electronic device is connected to a headset;

When the electronic device is connected with a headset, changing the earphone channel of the audio data, so that the headset channel plays the audio data;

When no earphone is connected to the electronic device, the earphone channel of the audio data is changed so that the speaker channel plays the audio data.
The method according to claim 1, wherein, when the speaker channel is abnormal, changing the audio output channel of the audio data so that the changed audio output channel plays the audio data includes:

Detect whether the electronic device is connected to a headset;

When the electronic device is connected with a headset, changing the earphone channel of the audio data, so that the headset channel plays the audio data;

When no earphone is connected to the electronic device, the earphone channel of the audio data is changed so that the earphone channel plays the audio data.
The method according to claim 7, wherein said changing the audio output channel of the audio data when the speaker channel is abnormal includes:

When the speaker channel is abnormal, the volume of the speaker channel is muted, and the audio output channel of the audio data is changed.
The method according to claim 1, wherein, when the earphone channel is abnormal, changing the audio output channel of the audio data so that the changed audio output channel plays the audio data includes:

When the electronic device is connected to an earphone and the earphone channel is abnormal, the earphone channel of the audio data is changed so that the speaker channel plays the audio data.
The method according to claim 1 or 7 or 8, wherein the making the changed audio output channel play the audio data includes:

Obtain the environmental noise of the electronic device;

Adjusting the volume of the audio output channel to play the audio data according to the environmental noise.
The method according to claim 1 or 7 or 8, wherein the making the changed audio output channel play the audio data includes:

Acquiring the playback time point of the audio data;

Play the audio data from the playback time point according to the changed audio output channel.
An audio output control device is applied to electronic equipment having multiple audio output channels, wherein the audio output channel includes an earpiece channel, a headphone channel, and a speaker channel, and the device includes:

Mode acquisition module, used to obtain the audio mode of the target application;

A channel monitoring module, configured to monitor whether the audio output channel used by the target application to play audio data according to the audio mode is abnormal;

The channel processing module is configured to change the audio output channel of the audio data when the audio output channel is abnormal, so that the changed audio output channel plays the audio data.
A computer-readable storage medium on which a computer program is stored, which when executed by a processor implements the steps of the audio output control method according to any one of claims 1 to 11.
An electronic device includes a memory and a processor, and the memory stores computer-readable instructions, and when the instructions are executed by the processor, the processor is caused to perform as described in any one of claims 1 to 11. The audio output control method described.