CN112997470A

CN112997470A - Audio output control method and device, computer readable storage medium and electronic equipment

Info

Publication number: CN112997470A
Application number: CN201880098450.5A
Authority: CN
Inventors: 李亚军
Original assignee: Guangdong Oppo Mobile Telecommunications Corp Ltd; Shenzhen Huantai Technology Co Ltd
Current assignee: Guangdong Oppo Mobile Telecommunications Corp Ltd; Shenzhen Huantai Technology Co Ltd
Priority date: 2018-11-28
Filing date: 2018-11-28
Publication date: 2021-06-18
Anticipated expiration: 2038-11-28
Also published as: WO2020107290A1; CN112997470B

Abstract

An audio output control method and apparatus, a computer-readable storage medium, and an electronic device, the audio output control method being applied to an electronic device having a plurality of audio output channels, the audio output control method comprising: acquiring an audio mode of a target application (302); monitoring whether an audio output channel used by a target application program for playing audio data is abnormal according to an audio mode (304); when the audio output channel is abnormal, the audio output channel of the audio data is changed, so that the changed audio output channel plays the audio data (306).

Description

Audio output control method and device, computer readable storage medium and electronic equipment

Technical Field

The present application relates to the field of electronic device technologies, and in particular, to an audio output control method and apparatus, an electronic device, and a computer-readable storage medium.

Background

With the wide application of electronic devices and the increasing abundance of their functions, electronic devices have become an indispensable part of people's daily life. In which, the application programs installed in the electronic device are more diversified. During use of the application, when the application plays audio data, the audio data may be output from the earpiece, speaker, and headset channels.

However, in the using process of the application program, an audio output channel call exception occurs, so that the output channel of the audio data changes, for example, an alarm sound should be output from a speaker channel, and the result is output from a receiver, which affects the use experience of the user.

Disclosure of Invention

The embodiment of the application provides an audio output control method and device, a computer readable storage medium and an electronic device, which can repair an abnormal audio output channel, enhance the stability of audio data output and improve user experience.

An audio output control method applied to an electronic device having a plurality of audio output channels including an earpiece channel, a headphone channel, and a speaker channel, the method comprising:

acquiring an audio mode of a target application program;

monitoring whether an audio output channel used by a target application program for playing audio data is abnormal or not according to the audio mode;

and when the audio output channel is abnormal, changing the audio output channel of the audio data so as to enable the changed audio output channel to play the audio data.

An audio output control apparatus for use with an electronic device having a plurality of audio output channels including an earpiece channel, a headphone channel, and a speaker channel, the apparatus comprising:

the mode acquisition module is used for acquiring the audio mode of the target application program;

the channel monitoring module is used for monitoring whether an audio output channel used by the target application program for playing the audio data is abnormal or not according to the audio mode;

and the channel processing module is used for changing the audio output channel of the audio data when the audio output channel is abnormal so as to enable the changed audio output channel to play the audio data, wherein the audio output channel comprises an earphone channel, an earphone channel and a loudspeaker channel.

A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the steps of the audio output control method described above.

An electronic device comprising a memory and a processor, the memory having computer-readable instructions stored thereon which, when executed by the processor, cause the processor to perform the audio output control method of claim.

The audio output control method and device, the computer readable storage medium and the electronic equipment can acquire the audio mode of the target application program; monitoring whether an audio output channel used by a target application program for playing audio data is abnormal or not according to the audio mode; when the audio output channel is abnormal, the audio output channel of the audio data is changed, so that the changed audio output channel plays the audio data, the abnormal audio output channel can be repaired, the audio data is automatically output from the default audio output channel, the output stability of the audio data is enhanced, the condition that the audio data is output from other audio output channels can be avoided, and the user experience is improved.

Drawings

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings of the embodiments can be obtained according to the drawings without creative efforts.

FIG. 1 is a schematic diagram of an internal structure of an electronic device according to an embodiment;

FIG. 2 is a schematic diagram of a partial architecture of an android audio system in an embodiment;

FIG. 3 is a flowchart illustrating an audio output control method according to an embodiment;

FIG. 4 is a flowchart illustrating an embodiment of monitoring whether an audio output channel of a target application for playing audio data is abnormal according to the audio mode;

FIG. 5 is a schematic diagram illustrating a process of changing the audio output channel of the audio data when the audio output channel is abnormal according to another embodiment;

FIG. 6 is a flowchart illustrating an audio output control method according to another embodiment;

FIG. 7 is a flowchart illustrating an audio output control method according to still another embodiment;

FIG. 8 is a flow diagram illustrating playing of audio data in an altered audio output channel according to one embodiment;

FIG. 9 is a block diagram of an audio output control device in one embodiment;

fig. 10 is a block diagram of a partial structure of a mobile phone related to an electronic device provided in an embodiment of the present application.

Detailed Description

To facilitate an understanding of the invention, the invention will now be described more fully with reference to the accompanying drawings. Preferred embodiments of the present invention are shown in the drawings. This invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete.

In one embodiment, as shown in FIG. 1, a schematic diagram of an internal structure of an electronic device is provided. The electronic device includes a processor, a memory, and a display screen connected by a system bus. Wherein, the processor is used for providing calculation and control capability and supporting the operation of the whole electronic equipment. The memory is used for storing data, programs, instruction codes and/or the like, and at least one computer program is stored on the memory, and the computer program can be executed by the processor to realize the audio output control method suitable for the electronic equipment provided by the embodiment of the application. The Memory may include a non-volatile storage medium such as a magnetic disk, an optical disk, a Read-Only Memory (ROM), or a Random-Access-Memory (RAM). For example, in one embodiment, the memory includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a database, and a computer program. The database stores data related to implementing an audio output control method provided in the above embodiments, for example, information such as a name of each process or application may be stored. The computer program can be executed by a processor for implementing an audio output control method provided by various embodiments of the present application. The internal memory provides a cached operating environment for the operating system, databases, and computer programs in the non-volatile storage medium. The display screen may be a touch screen, such as a capacitive screen or an electronic screen, and is configured to display interface information of an application corresponding to a foreground process, and also may be configured to detect a touch operation applied to the display screen, and generate a corresponding instruction, such as a switching instruction for performing foreground and background applications.

Those skilled in the art will appreciate that the architecture shown in fig. 1 is a block diagram of only a portion of the architecture associated with the subject application, and does not constitute a limitation on the electronic devices to which the subject application may be applied, and that a particular electronic device may include more or less components than those shown, or may combine certain components, or have a different arrangement of components. For example, the electronic device further includes a network interface connected via the system bus, where the network interface may be an ethernet card or a wireless network card, and the like, and is used for communicating with an external electronic device, such as a server.

In one embodiment, as shown in fig. 2, a partial architecture diagram of an Android audio system is provided. The Android audio system architecture system includes a Kernel space layer 210, a local layer 220, a framework layer 230, and a Client layer 240.

An Audio driver module 211 may be included on the Kernel space layer 210, where the Audio driver module interacts with hardware and implements an interface of the local layer for normal calls of the upper layer, where ALSA, OSS and custom Audio drivers may be selected. The local layer 220 includes an atlas service _ Jni module 221, an atlas service Interface module 223, and an atlas service module 225. The framework layer 230 includes an atlas manager module 231 and an atlas service module 233. Wherein, the atlas manager module 231 is provided with a conventional interface and a registration callback interface. The atlas service module 225 in the local layer 220 and the atlas service module 233 in the framework layer 230 are used for event reception and processing, information collection, exception feedback, and log collection, where information collection may include the collection of display information and the collection of audio information. The audio information includes playing information, recording information, audio mode setting information, and the like. Because the atlas service module is arranged in a system-level framework layer, the atlas service module can conveniently interact with other system services without worrying about the authority problem during system calling. Through the above-mentioned architecture, the audio output control method in the embodiments of the present application can be realized.

In one embodiment, as shown in fig. 3, an audio output control method is provided that is applied to an electronic device having a plurality of audio output channels. In one embodiment, the electronic Device may be an electronic Device including a Mobile phone, a tablet computer, a notebook computer, a palm computer, a Mobile Internet Device (MID), a wearable Device (e.g., a smart watch, a smart bracelet, a pedometer, etc.), or other devices having a voice call function and a speaker.

The audio output channels include an earpiece channel, a speaker channel, and a headset channel, wherein the headset channel may include a wired headset channel and a wireless headset (bluetooth headset) channel. When the audio output channel is a receiver channel, the audio data is sent out by a receiver; when the audio output channel is a loudspeaker channel, the audio data is sent out by an external loudspeaker; when the audio output channel is an earphone channel, the audio data can be sent out through a wired earphone or a Bluetooth earphone.

As shown in FIG. 3, in one embodiment, an audio output control method includes steps 302-306.

Step 302, an audio mode of the target application program is obtained.

The target application may be understood as an application capable of outputting and/or outputting an audio signal, and the number of target applications may be 1, 2, 3, or more. For example, the target application may include a conversational class, an instant messaging class, an audio playback class, a video playback class, a voice control class, a voice input class, and the like. The audio mode may include a multimedia mode, a ring tone mode, an alarm clock mode, a call mode (including audio/video, VoIP call), and a system mode.

Each target application corresponds to an audio mode, for example, the audio mode corresponding to the audio playing type and video playing type target applications is a multimedia mode, the audio mode corresponding to the clock can be an alarm clock mode, and the audio mode corresponding to the call type target applications can be a call mode, etc.

The electronic device may manage the audio mode based on the AudioManager in the architecture system of the Android audio system, and in particular, may set the audio mode of the target application based on the set function setMode (). The electronic device can acquire the audio mode of the target application program in the running state based on the AudioManager. The running state may be understood as foreground running or background running.

In one embodiment, the electronic device may preset a list or database including all target applications for storing identification information of the target applications, and the like.

And step 304, monitoring whether an audio output channel used by the target application program for playing the audio data is abnormal according to the audio mode.

Each audio mode may correspond to a plurality of audio output channels for playing audio data, for example, when the target application program is a call application program, the audio mode corresponding to the target application program is a call mode, and when the electronic device is in a call state, a voice call may be performed through a headphone channel, a speaker channel, or an earphone channel, that is, the audio output channels corresponding to the call mode include the headphone channel, the speaker channel, and the earphone channel.

Meanwhile, each audio mode may be provided with at least one default audio output channel. For example, when the audio mode is a talk mode, the corresponding default audio output channel may include an earphone channel and a headphone channel, when the electronic terminal is connected to an earphone, the default audio output channel is the headphone channel, and when the electronic device is not connected to the earphone, the default audio output channel is the earphone channel. For example, when the audio mode is the ring tone mode or the alarm clock mode, the corresponding default audio output channel is the speaker mode.

When the target application program plays the audio data, the electronic device may monitor an audio output channel currently used for playing the audio data, and if the audio output channel is consistent with a default audio output channel corresponding to the audio mode of the target application program, the audio output channel used by the target application program for playing the audio data may be considered to be normal, otherwise, the audio output channel used by the target application program for playing the audio data may be considered to be abnormal. For example, when an incoming call comes from an electronic device, the ring tone of the electronic device is sent out from the earphone channel or the ring tone of the electronic device is sent out from the earphone channel, and the audio output channel of the target application program for playing the incoming call ring tone is considered to be abnormal.

It should be noted that the audio data includes voice data, ring tone data, alarm data, multimedia data (video stream, audio stream data, etc.), and the like.

Step 306, when the audio output channel is abnormal, the audio output channel of the audio data is changed, so that the changed audio output channel plays the audio data.

The electronic equipment can judge whether the audio output channel used for playing the audio data is abnormal or not, and when the audio output channel is abnormal, the audio output channel used for playing the audio data can be changed so that the changed audio output channel can play the audio data which is controlled to be played by the target application program. For example, when the electronic device receives a call, the ring tone thereof is sent out from the earphone channel or the ring tone thereof is sent out from the earphone channel, the electronic device may switch the earphone channel or the earphone channel currently used for playing the ring tone to the speaker channel, and the speaker plays the audio data.

The audio output control method can acquire the audio mode of the target application program; monitoring whether an audio output channel used by a target application program for playing audio data is abnormal or not according to the audio mode; when the audio output channel is abnormal, the audio output channel of the audio data is changed, so that the changed audio output channel plays the audio data, the abnormal audio output channel can be repaired, the audio data is automatically output from the default audio output channel, the output stability of the audio data is enhanced, the condition that the audio data is output from other audio output channels can be avoided, and the user experience is improved.

As shown in FIG. 4, in one embodiment, listening for an abnormality in an audio output channel of a target application for playing audio data according to an audio mode includes

Step 402, when the target application program plays the audio data, monitoring an audio output channel for playing the audio data.

In one embodiment, a listening module is created based on an operating system of the electronic device, and an audio output channel of the target application is listened through the listening module. The monitoring module can also be used for monitoring information related to audio data input and/or output, such as audio mode, volume adjustment, recording and the like of the target application program. Taking an electronic device with an android operating system as an example, a system-level monitoring module (atlas service module) can be created in a system framework layer (native/framework layer), and an audio output channel and an audio mode of a target application program are monitored through the monitoring module. For example, a monitoring module can be set up in the framework layer and run in a system service program (system _ server), and because the monitoring module is set up in the service framework layer of the system level, interaction with other system services can be facilitated without worrying about the authority problem when the system is called.

Optionally, the electronic device may also create an independent monitoring process, and monitor the audio output channel of the target application program through the message transmission mechanism. In the process, an independent monitoring function is set and called, the process can be set to be started up and started up, and the audio mode setting of any other target application program and the audio output channel for playing audio data are monitored in real time.

In step 404, it is identified whether the audio output channel meets the playing criteria of the audio mode.

In step 406, when the audio output channel does not meet the playing standard of the audio mode, the audio output channel is abnormal.

The electronic equipment can also pre-construct an audio output channel and audio mode matching mapping table; in the mapping table, all audio output channels of the audio mode and a default audio output channel are stored, wherein the default audio output channel is understood to be the audio output channel for playing the audio data with the highest priority when the target application plays the audio data, that is, the default audio output channel has the highest playing priority among all the audio output channels. If the default audio output channel is used to play the audio data, it can be considered to be in accordance with the playing standard of the audio mode.

And identifying whether the audio output channel meets the playing standard of the audio mode or not according to the mapping table. For example, the target application for controlling the playing of the audio data is a video application, the audio mode of the video application is a multimedia mode, and the default audio output channel corresponding to the multimedia mode is a speaker channel. If the audio data of the video application program is sent out by the receiver channel when the video application program plays the video, and the playing standard of the multimedia mode is that the audio data is sent out by the loudspeaker channel, the receiver channel can be considered to be not in accordance with the playing standard of the multimedia mode.

When the audio output channel does not meet the playing standard of the audio mode, the audio output channel is abnormal.

As shown in fig. 5, in one embodiment, changing the audio output channel of the audio data when the audio output channel is abnormal includes:

step 502, when the audio output channel is abnormal, a preset interface function is called.

Step 504, changing an audio output channel of the audio data according to a preset interface function.

When the audio output channel for playing the audio data is abnormal, the electronic device may call the preset interface function to set the audio output channel. The preset interface functions at least include setSpeakerphoneOn () interface function, setMode (audio manager, mode _ IN _ CALL) interface function, iswiredfeedseton () interface function, or other interface functions for setting a headphone channel and a headphone channel.

For example, in an electronic device based on the android operating system, the electronic device may set a speaker channel by calling an interface function setSpeakerphoneOn () in the AudioManager, that is, the speaker channel may be turned on or off. The electronic device may set a receiver channel by calling a function setMode (AudioManager, mode _ IN _ CALL) or a configuration parameter streamType (STREAM _ VOICE _ CALL) IN the AudioManager; the electronic device may set and detect the earpiece channel by calling the function iswiredfeadseton () in the AudioManager.

Alternatively, the interface function setMode () may be used to set a sound mode, for example, void setMode (intmode). Among the settable values are NORMAL, ringing and IN _ CALL. For example, setringmode (RINGER MODE) may be used to set the MODE of the phone ring, which includes a NORMAL ring (ring _ MODE _ NORMAL), ring mute (ring _ MODE _ SILENT), and VIBRATE (ring _ MODE _ vibrant).

As shown in fig. 6, in one embodiment, the audio output control method includes steps 602-610. Wherein the content of the first and second substances,

step 602, an audio mode of a target application is obtained.

And step 604, monitoring whether an audio output channel used by the target application program for playing the audio data is abnormal according to the audio mode.

The

steps

602 and 604 correspond to the

steps

302 and 304 in the previous embodiment one to one, and are not described herein again.

And 606, detecting whether the electronic equipment is connected with the earphone or not when the earphone channel is abnormal.

The electronic device may obtain an audio mode of a target application program for controlling playing of audio data, and determine a default audio output channel of the audio mode, and if the default audio output channel is not a headphone channel, but audio data of the default audio output channel is output through the headphone channel, the headphone channel is considered to be abnormal.

When the earphone channel is abnormal, the electronic equipment can detect whether the earphone is connected with the electronic equipment currently. The connection may be a wired connection or a wireless connection (bluetooth connection).

For example, the electronic device may set and detect whether a wired headset is connected by calling a function iswireedheadseton () in the AudioManager, or detect whether a wired headset is connected by detecting a high-low level of a GPIO (General Purpose Input/Output). Specifically, if the preset state of the GPIO interface is a high level and the current detection state is a low level, it indicates that the state of the GPIO interface has changed, and the electronic device is connected to a wired headset.

For example, the electronic device may detect whether a bluetooth headset is connected through the bluetooth adapter class. Meanwhile, the electronic equipment can detect the interface state of the corresponding audio interface based on the Bluetooth protocol, and then detect whether the electronic equipment is connected with the Bluetooth headset.

It should be noted that the electronic device may also detect whether to connect to the headset based on other software or hardware manners, and is not limited to the above example.

Step 608, when the electronic device is connected to the earphone, changing a receiver channel of the audio data to enable the earphone channel to play the audio data.

When the electronic device is connected with an earphone, if the default audio output channel corresponding to the audio mode of the target application program is the earphone channel, a preset interface function for switching to the earphone channel can be called, the audio output channel for outputting audio data is switched from the earphone mode to the earphone channel according to the preset interface function, and the audio data is played by the earphone channel.

Step 610, when the electronic device is not connected with the earphone, changing a receiver channel of the audio data to enable a loudspeaker channel to play the audio data.

When the electronic device is connected with an earphone, and the default audio output channel corresponding to the audio mode of the target application program is a speaker channel, a preset interface function for switching to the speaker channel can be called, the audio output channel for outputting audio data is switched from the earphone mode to the speaker channel according to the preset interface function, and the audio data is played by the speaker channel.

In this embodiment, when the earphone channel in the audio output channel is abnormal, the electronic device may adaptively switch the earphone channel to the audio output channel that conforms to the user usage scenario according to the state of whether the earphone is connected, so as to improve the stability of audio output and the user experience.

As shown in FIG. 7, in one embodiment, the audio output control method includes steps 702-710. Wherein the content of the first and second substances,

step 702, obtain the audio mode of the target application program.

Step 704, according to the audio mode, monitoring whether an audio output channel used by the target application program for playing the audio data is abnormal.

Step 702 and step 704 correspond to step 302 and step 304 in the previous embodiment one to one, and are not described herein again.

Step 706, when the speaker channel is abnormal, detecting whether the electronic device is connected to the earphone.

The electronic device may obtain an audio mode of a target application program for controlling playing of audio data, and determine a default audio output channel of the audio mode, and if the default audio output channel is not a speaker channel, but audio data of the default audio output channel is output through the speaker channel, the speaker channel is considered to be abnormal.

It should be noted that, the method for detecting whether the electronic device is connected to the earphone in this step is the same as the method for detecting whether the electronic device is connected to the earphone in the foregoing embodiment, and details are not repeated here.

In step 708, when the electronic device is connected to the earphone, the earphone channel of the audio data is changed so that the earphone channel plays the audio data.

When the electronic device is connected with an earphone, if the default audio output channel corresponding to the audio mode of the target application program is a speaker channel, a preset interface function for switching to the earphone channel can be called, the audio output channel for outputting audio data is switched from the speaker mode to the earphone channel according to the preset interface function, and the audio data is played by the earphone channel.

Step 710, when the electronic device is not connected to the earphone, changing a receiver channel of the audio data to enable the receiver channel to play the audio data.

When the electronic device is connected with an earphone, if the default audio output channel corresponding to the audio mode of the target application program is a speaker channel, a preset interface function for switching to a receiver channel can be called, the audio output channel for outputting audio data is switched from the speaker mode to the receiver channel according to the preset interface function, and the audio data is played by the receiver channel.

In this embodiment, when the speaker channel in the audio output channel is abnormal, the electronic device can adaptively switch the speaker channel to the audio output channel conforming to the user use scene according to the state of whether the earphone is connected or not, and the stability of audio output and the user experience degree can be improved.

Further, when the speaker channel is abnormal, changing the audio output channel of the audio data may further include: when the speaker channel is abnormal, adjusting the volume of the speaker channel to be mute, and changing the audio output channel of the audio data. Specifically, if the speaker channel is abnormal, the audio data can be output from the speaker channel, and if the volume of the speaker output channel is adjusted to be mute, the privacy of the audio data of the user can be prevented from being revealed by the external loudspeaker playing of the audio data, and the protection of the audio data played by the speaker output channel is improved.

In one embodiment, when the earphone channel is abnormal, the audio output channel of the audio data is changed to enable the changed audio output channel to play the audio data, which specifically includes a step of changing the earphone channel of the audio data to enable the speaker channel to play the audio data when the electronic device is connected to an earphone and the earphone channel is abnormal.

The electronic device may acquire an audio mode of a target application program for controlling playing of audio data, and determine a default audio output channel of the audio mode, and if the default audio output channel is not a headphone channel, but audio data of the default audio output channel is output through the headphone channel, the headphone channel is considered to be abnormal. For example, in the alarm clock mode, the corresponding default audio output channel is a speaker, when the electronic device is connected with a headset, the alarm clock is output through the headset channel, and when the alarm clock is not output through the speaker, the current headset channel can be considered to be abnormal, the electronic device can call a preset calling function for switching to the speaker channel, so that the alarm clock is output through the speaker channel, therefore, the alarm clock can be prevented from being output through the headset channel, a user cannot sense the alarm clock, when the alarm clock is output through the speaker, the user can normally hear the alarm clock, and the normal work and rest of the user cannot be influenced.

As shown in fig. 8, in one embodiment, causing the changed audio output channel to play audio data comprises:

step 802, acquiring environmental noise of the electronic device.

When the electronic equipment judges that the audio output channel of the audio data is abnormal, the audio output channel of the audio data can be changed, and meanwhile, the environmental noise of the electronic equipment can be acquired. The environmental noise can be sound which is generated in industrial production, building construction, transportation and social life and interferes with the surrounding living environment. For example, the electronic device may collect ambient sounds based on the at least one microphone and analyze the ambient sounds to obtain ambient noise.

Step 804, adjusting the volume of the audio output channel for playing the audio data according to the environmental noise.

The electronic equipment can adjust the volume of the audio output channel for playing the audio data according to the environmental noise, namely, when the electronic equipment judges that the audio output channel of the audio data is abnormal, the electronic equipment can change the audio output channel of the audio data, and simultaneously adjust the volume of the audio output channel for playing the audio data according to the environmental noise. For example, the larger the environmental noise is, the higher the volume of the corresponding adjustment is, but the maximum value of the volume does not exceed the preset value.

In this embodiment, when the audio output channel is abnormal, the audio output channel of the audio data is changed, and meanwhile, the volume of the audio data played by the changed audio output channel can be adjusted according to the environmental noise of the electronic device, so that the user experience is improved.

In one embodiment, causing the changed audio output channel to play audio data comprises: acquiring a playing time point of audio data; and playing the audio data from the playing time point according to the changed audio output channel.

Specifically, when the audio output channel is abnormal, the audio output channel of the audio data may be changed, and meanwhile, the electronic device may further obtain a playing time point at which the abnormal audio output channel plays the audio data, and start playing the audio data from the playing time point by the changed audio output channel. For example, if the earphone channel is abnormal, the playing time point of the earphone channel playing the audio data may be obtained. The playing time point may be understood as an initial time on a time axis when the audio data is played by the receiver, and the time is recorded, for example, the time is 10:01:05, and when the changed audio output channel is a speaker, the speaker may start playing the audio data from the playing time point 10:01: 05.

The audio control output method in the embodiment can automatically realize the replay of the audio data within a period of time before the audio output channel is switched, so that a user can know the audio data in the audio output mode switching process, the user operation is reduced, and the user experience is improved.

It should be noted that the steps in this embodiment may also be applied before or after the above-mentioned steps 802 to 804, so as to improve the playing quality of the audio data played in the audio output channel switching process, and improve the user experience.

It should be understood that although the various steps in the flow charts of fig. 3-8 are shown in order as indicated by the arrows, the steps are not necessarily performed in order as indicated by the arrows. The steps are not performed in the exact order shown and described, and may be performed in other orders, unless explicitly stated otherwise. Moreover, at least some of the steps in fig. 3-8 may include multiple sub-steps or multiple stages that are not necessarily performed at the same time, but may be performed at different times, and the order of performance of the sub-steps or stages is not necessarily sequential, but may be performed in turn or alternating with other steps or at least some of the sub-steps or stages of other steps.

As shown in fig. 9, the present application also provides an audio output control apparatus including: an acquisition module 910, a listening module 920, and a processing module 930. Wherein the content of the first and second substances,

a mode obtaining module 910, configured to obtain an audio mode of a target application;

a channel monitoring module 920, configured to monitor whether an audio output channel, used for playing audio data, of a target application is abnormal according to an audio mode;

the channel processing module 930 is configured to change an audio output channel of the audio data when the audio output channel is abnormal, so that the changed audio output channel plays the audio data, where the audio output channel includes an earphone channel, a headphone channel, and a speaker channel.

The audio output control device can acquire the audio mode of the target application program; monitoring whether an audio output channel used by a target application program for playing audio data is abnormal or not according to the audio mode; when the audio output channel is abnormal, the audio output channel of the audio data is changed, so that the changed audio output channel plays the audio data, the abnormal audio output channel can be repaired, the audio data is automatically output from the default audio output channel, the output stability of the audio data is enhanced, the condition that the audio data is output from other audio output channels can be avoided, and the user experience is improved.

In one embodiment, the channel listening module 920 includes:

the channel monitoring unit is used for monitoring an audio output channel for playing the audio data when the target application program plays the audio data;

the standard identification unit is used for identifying whether the audio output channel meets the playing standard of the audio mode;

and the abnormity judging unit is used for judging that the audio output channel is abnormal when the audio output channel does not accord with the playing standard of the audio mode.

In one embodiment, the channel listening unit is further configured to:

and creating a monitoring module based on the operating system of the electronic equipment, and monitoring the audio output channel of the target application program through the monitoring module, or creating a monitoring process and monitoring the audio output channel of the target application program through a message transmission mechanism.

In one embodiment, the standard identification unit is further configured to:

constructing an audio output channel and audio mode matching mapping table; and identifying whether the audio output channel meets the playing standard of the audio mode or not according to the mapping table.

In one embodiment, the channel processing module 930 includes:

the calling unit is used for calling a preset interface function when the audio output channel is abnormal;

and the processing unit is used for changing the audio output channel of the audio data according to the preset interface function.

In one embodiment, the channel processing module 930 further comprises:

the setting unit is used for setting a preset interface function based on an operating system of the electronic equipment, and the preset interface function is used for setting an audio output channel.

In one embodiment, when the earpiece channel is abnormal, the channel processing module 930 further includes:

the detection unit is used for detecting whether the electronic equipment is connected with the earphone or not;

the processing unit is also used for changing a receiver channel of the audio data when the electronic equipment is connected with the earphone so as to enable the earphone channel to play the audio data; when the electronic equipment is not connected with the earphone, the earphone channel of the audio data is changed, so that the loudspeaker channel plays the audio data.

In one embodiment, when the speaker channel is abnormal, the processing unit is further configured to change a headphone channel of the audio data when the electronic device is connected to a headphone, so that the headphone channel plays the audio data; when electrons are generated

And when the equipment is not connected with the earphone, changing the earphone channel of the audio data so as to enable the earphone channel to play the audio data.

In one embodiment, the processing unit is further configured to mute the volume of the speaker channel and change the audio output channel of the audio data when the speaker channel is abnormal.

In this embodiment, when the speaker channel in the audio output channel is abnormal, the electronic device can adaptively switch the speaker channel to the audio output channel conforming to the user usage scenario according to the state of whether the earphone is connected or not, and the stability of audio output and the user experience degree can be improved.

In one embodiment, the channel processing module 930 further comprises: a noise acquisition unit for acquiring environmental noise of the electronic device;

and the processing unit is also used for adjusting the volume of the audio output channel for playing the audio data according to the environmental noise.

In one embodiment, the channel processing module 930 further comprises: a play acquisition unit for acquiring a play time point of the audio data;

and the processing unit is also used for playing the audio data from the playing time point according to the changed audio output channel.

The division of the modules in the audio output control device is only for illustration, and in other embodiments, the audio output control device may be divided into different modules as needed to complete all or part of the functions of the audio output control device.

The modules in the audio output control device can be wholly or partially realized by software, hardware and a combination thereof. The modules can be embedded in a hardware form or independent of a processor in the electronic device, or can be stored in a memory in the electronic device in a software form, so that the processor can call and execute operations corresponding to the modules.

The embodiment of the application also provides a computer readable storage medium. One or more non-transitory computer-readable storage media containing computer-executable instructions that, when executed by one or more processors, cause the processors to perform the steps of the audio output control method of:

acquiring an audio mode of a target application program;

and when the audio output channel is abnormal, changing the audio output channel of the audio data so that the changed audio output channel plays the audio data.

It should be noted that one or more non-transitory computer-readable storage media containing computer-executable instructions that, when executed by one or more processors, further cause the processors to perform the audio output control method of any of the above embodiments.

A computer program product containing instructions which, when run on a computer, cause the computer to perform the steps of an audio output control method:

acquiring an audio mode of a target application program;

monitoring whether an audio output channel used by a target application program for playing audio data is abnormal or not according to an audio mode;

It should be noted that a computer program product containing instructions, when running on a computer, causes the computer to perform the steps of the audio output control method in any of the above embodiments.

The embodiment of the application also provides the electronic equipment. As shown in fig. 10, for convenience of explanation, only the parts related to the embodiments of the present application are shown, and details of the technology are not disclosed, please refer to the method part of the embodiments of the present application. The electronic device may be any terminal device having a voice call function and a speaker, including a mobile phone, a tablet computer, a PDA (Personal Digital Assistant), a POS (Point of Sales), a vehicle-mounted computer, a wearable device, and the like, taking the electronic device as the mobile phone as an example:

fig. 10 is a block diagram of a partial structure of a mobile phone related to an electronic device provided in an embodiment of the present application. Referring to fig. 10, the cellular phone includes: radio Frequency (RF) circuit 1010, memory 1020, input unit 1030, display unit 1040, sensor 1050, audio circuit 1060, wireless fidelity (WiFi) module 1070, processor 1080, and power source 1090. Those skilled in the art will appreciate that the handset configuration shown in fig. 10 is not intended to be limiting and may include more or fewer components than those shown, or some components may be combined, or a different arrangement of components.

The RF circuit 1010 may be configured to receive and transmit signals during information transmission and reception or during a call, and may receive downlink information of a base station and then process the received downlink information to the processor 1080; the uplink data may also be transmitted to the base station. Typically, the RF circuitry includes, but is not limited to, an antenna, at least one Amplifier, a transceiver, a coupler, a Low Noise Amplifier (LNA), a duplexer, and the like. In addition, the RF circuitry 1010 may also communicate with networks and other devices via wireless communications. The wireless communication may use any communication standard or protocol, including but not limited to Global System for Mobile communication (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Long Term Evolution (LTE)), e-mail, Short Messaging Service (SMS), and the like.

The memory 1020 can be used for storing software programs and modules, and the processor 1080 executes various functional applications and data processing of the mobile phone by operating the software programs and modules stored in the memory 1020. The memory 1020 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application program required for at least one function (such as an application program for a sound playing function, an application program for an image playing function, and the like), and the like; the data storage area may store data (such as audio data, an address book, etc.) created according to the use of the mobile phone, and the like. Further, the memory 1020 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.

The input unit 1030 may be used to receive input numeric or character information and generate key signal inputs related to user settings and function control of the cellular phone 1000. Specifically, the input unit 1030 may include a touch panel 1031 and other input devices 1032. The touch panel 1031, which may also be referred to as a touch screen, may collect touch operations by a user (e.g., operations by a user on or near the touch panel 1031 using any suitable object or accessory such as a finger, a stylus, etc.) and drive the corresponding connection device according to a preset program. In one embodiment, the touch panel 1031 may include two parts, a touch detection device and a touch controller. The touch detection device detects the touch direction of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch sensing device, converts the touch information into touch point coordinates, sends the touch point coordinates to the processor 1080, and can receive and execute commands sent by the processor 1080. In addition, the touch panel 1031 may be implemented by various types such as a resistive type, a capacitive type, an infrared ray, and a surface acoustic wave. The input unit 1030 may include other input devices 1032 in addition to the touch panel 1031. In particular, other input devices 1032 may include, but are not limited to, one or more of a physical keyboard, function keys (such as volume control keys, switch keys, etc.), and the like.

The display unit 1040 may be used to display information input by a user or information provided to the user and various menus of the cellular phone. The display unit 1040 may include a display panel 1041. In one embodiment, the Display panel 1041 may be configured in the form of a Liquid Crystal Display (LCD), an Organic Light-Emitting Diode (OLED), or the like. In one embodiment, the touch panel 1031 can overlay the display panel 1041, and when the touch panel 1031 detects a touch operation on or near the touch panel 1031, the touch operation is transmitted to the processor 1080 to determine the type of the touch event, and then the processor 1080 provides a corresponding visual output on the display panel 1041 according to the type of the touch event. Although in fig. 10, the touch panel 1031 and the display panel 1041 are two separate components to implement the input and output functions of the mobile phone, in some embodiments, the touch panel 1031 and the display panel 1041 may be integrated to implement the input and output functions of the mobile phone.

The cell phone 1000 may also include at least one sensor 1050, such as a light sensor, motion sensor, and other sensors. Specifically, the light sensor may include an ambient light sensor and a proximity sensor, wherein the ambient light sensor may adjust the brightness of the display panel 1041 according to the brightness of ambient light, and the proximity sensor may turn off the display panel 1041 and/or the backlight when the mobile phone moves to the ear. The motion sensor can comprise an acceleration sensor, the acceleration sensor can detect the magnitude of acceleration in each direction, the magnitude and the direction of gravity can be detected when the mobile phone is static, and the motion sensor can be used for identifying the application of the gesture of the mobile phone (such as horizontal and vertical screen switching), the vibration identification related functions (such as pedometer and knocking) and the like; the mobile phone may be provided with other sensors such as a gyroscope, a barometer, a hygrometer, a thermometer, and an infrared sensor.

Audio circuitry 1060, speaker 1061, and microphone 1062 may provide an audio interface between a user and a cell phone. The audio circuit 1060 can transmit the electrical signal converted from the received audio data to the speaker 1061, and the electrical signal is converted into a sound signal by the speaker 1061 and output; on the other hand, the microphone 1062 converts the collected sound signal into an electrical signal, which is received by the audio circuit 1060 and converted into audio data, and the audio data is processed by the audio data output processor 1080 and then transmitted to another mobile phone through the RF circuit 1010, or the audio data is output to the memory 1020 for subsequent processing.

WiFi belongs to short-distance wireless transmission technology, and the mobile phone can help the user to send and receive e-mail, browse web pages, access streaming media, etc. through the WiFi module 1070, which provides wireless broadband internet access for the user. Although fig. 10 shows the WiFi module 1070, it is to be understood that it does not belong to the essential constitution of the handset 1000 and may be omitted as needed.

The processor 1080 is a control center of the mobile phone, connects various parts of the whole mobile phone by using various interfaces and lines, and executes various functions of the mobile phone and processes data by operating or executing software programs and/or modules stored in the memory 1020 and calling data stored in the memory 1020, thereby integrally monitoring the mobile phone. In one embodiment, processor 1080 may include one or more processing units. In one embodiment, processor 1080 may integrate an application processor and a modem processor, wherein the application processor primarily handles operating systems, user interfaces, applications, and the like; the modem processor handles primarily wireless communications. It is to be appreciated that the modem processor described above may not be integrated into processor 1080.

The handset 1000 also includes a power supply 1090 (e.g., a battery) for powering the various components, which may preferably be logically coupled to the processor 1080 via a power management system that may be configured to manage charging, discharging, and power consumption.

In one embodiment, the cell phone 1000 may also include a camera, a bluetooth module, and the like.

In an embodiment of the application, the electronic device comprises a processor 1080 which, when executing the computer program stored on the memory, performs the following steps:

acquiring an audio mode of a target application program;

It should be noted that the processor 880 included in the electronic device implements the audio output control method in any of the above embodiments when executing the computer program stored on the memory.

Any reference to memory, storage, database, or other medium used herein may include non-volatile and/or volatile memory. Suitable non-volatile memory can include read-only memory (ROM), Programmable ROM (PROM), Electrically Programmable ROM (EPROM), Electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM), which acts as external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms, such as Static RAM (SRAM), Dynamic RAM (DRAM), Synchronous DRAM (SDRAM), double data rate SDRAM (DDR SDRAM), Enhanced SDRAM (ESDRAM), synchronous Link (Synchlink) DRAM (SLDRAM), Rambus Direct RAM (RDRAM), direct bus dynamic RAM (DRDRAM), and bus dynamic RAM (RDRAM).

The technical features of the embodiments described above may be arbitrarily combined, and for the sake of brevity, all possible combinations of the technical features in the embodiments described above are not described, but should be considered as being within the scope of the present specification as long as there is no contradiction between the combinations of the technical features.

The above-mentioned embodiments only express several embodiments of the present invention, and the description thereof is more specific and detailed, but not construed as limiting the scope of the invention. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the inventive concept, which falls within the scope of the present invention. Therefore, the protection scope of the present patent shall be subject to the appended claims.

Claims

An audio output control method applied to an electronic device having a plurality of audio output channels, wherein the audio output channels include an earpiece channel, a headphone channel, and a speaker channel, the method comprising:

acquiring an audio mode of a target application program;

monitoring whether an audio output channel used by a target application program for playing audio data is abnormal or not according to the audio mode;

and when the audio output channel is abnormal, changing the audio output channel of the audio data so as to enable the changed audio output channel to play the audio data.
The method of claim 1, wherein the listening, according to the audio mode, whether an audio output channel used by a target application to play audio data is abnormal comprises:

monitoring an audio output channel for playing the audio data when the target application program plays the audio data;

identifying whether the audio output channel meets the playing standard of the audio mode;

and when the audio output channel does not meet the playing standard of the audio mode, the audio output channel is abnormal.
The method of claim 2, wherein said listening to an audio output channel playing the audio data comprises:

creating a listening module based on an operating system of the electronic device, listening to an audio output channel of the target application program through the listening module, or,

and creating a monitoring process, and monitoring the audio output channel of the target application program through a message transmission mechanism.
The method of claim 2, wherein the identifying whether the audio output channel complies with the playback criteria for the audio mode comprises:

constructing an audio output channel and audio mode matching mapping table;

and identifying whether the audio output channel meets the playing standard of the audio mode or not according to the mapping table.
The method of claim 1, wherein said changing an audio output channel of the audio data when the audio output channel is abnormal comprises:

when the audio output channel is abnormal, calling a preset interface function;

and changing an audio output channel of the audio data according to the preset interface function.
The method of claim 1, wherein when the earpiece channel is abnormal, changing an audio output channel of the audio data to cause the changed audio output channel to play the audio data comprises:

detecting whether the electronic equipment is connected with an earphone or not;

when the electronic equipment is connected with an earphone, changing a receiver channel of the audio data to enable the earphone channel to play the audio data;

and when the electronic equipment is not connected with an earphone, changing a receiver channel of the audio data to enable the loudspeaker channel to play the audio data.
The method of claim 1, wherein when the speaker channel is abnormal, changing an audio output channel of the audio data to cause the changed audio output channel to play the audio data comprises:

detecting whether the electronic equipment is connected with an earphone or not;

when the electronic equipment is connected with an earphone, changing a receiver channel of the audio data to enable the earphone channel to play the audio data;

and when the electronic equipment is not connected with an earphone, changing an earphone channel of the audio data so as to enable the earphone channel to play the audio data.
The method of claim 7, wherein said changing an audio output channel of the audio data when the speaker channel is abnormal comprises:

and when the loudspeaker channel is abnormal, adjusting the volume of the loudspeaker channel to be mute, and changing the audio output channel of the audio data.
The method of claim 1, wherein when the headphone channel is abnormal, changing an audio output channel of the audio data to cause the changed audio output channel to play the audio data comprises:

and when the electronic equipment is connected with an earphone and the earphone channel is abnormal, changing the earphone channel of the audio data to enable the loudspeaker channel to play the audio data.
The method of claim 1 or 7 or 8, wherein said causing the changed audio output channel to play the audio data comprises:

acquiring environmental noise of the electronic equipment;

and adjusting the volume of the audio output channel for playing the audio data according to the environmental noise.
The method of claim 1 or 7 or 8, wherein said causing the changed audio output channel to play the audio data comprises:

acquiring a playing time point of the audio data;

and playing the audio data from the playing time point according to the changed audio output channel.
An audio output control apparatus for use with an electronic device having a plurality of audio output channels including an earpiece channel, a headphone channel, and a speaker channel, the apparatus comprising:

the mode acquisition module is used for acquiring the audio mode of the target application program;

the channel monitoring module is used for monitoring whether an audio output channel used by the target application program for playing the audio data is abnormal or not according to the audio mode;

and the channel processing module is used for changing the audio output channel of the audio data when the audio output channel is abnormal so as to enable the changed audio output channel to play the audio data.
A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the steps of the audio output control method according to any one of claims 1 to 11.
An electronic device comprising a memory and a processor, the memory having stored therein computer-readable instructions that, when executed by the processor, cause the processor to perform the audio output control method of any of claims 1 to 11.