WO2023116768A1

WO2023116768A1 - Audio playback method and related apparatus

Info

Publication number: WO2023116768A1
Application number: PCT/CN2022/140714
Authority: WO
Inventors: 宋孟; 李洪江; 庾能国
Original assignee: 华为技术有限公司
Priority date: 2021-12-24
Filing date: 2022-12-21
Publication date: 2023-06-29
Also published as: CN116339672A

Abstract

An audio playback method and a related apparatus. The method comprises: when an electronic device detects that audios in two different applications are output at a same moment, the electronic device determines, on the basis of a factor such as preset priority, or a playback sequence, or an audio type, which application needs to be paused to pause playback of the audio; then, the electronic device determines, on the basis of windows displayed by the application needing to pause the playback of the audio, a target window implementing playback logic; and finally, the electronic device controls, on the basis of a playback progress corresponding to the target window, the application to pause playback of the audio, and controls the other application to start the playback of the audio. In this way, the electronic device controls that only one audio can be played back at the same moment, thereby improving user experience.

Description

A kind of audio playing method and related device

This application claims the priority of the Chinese patent application with the application number 202111605105.6 and the application title "An Audio Playing Method and Related Device" submitted to the China Patent Office on December 24, 2021, the entire contents of which are incorporated by reference in this application middle.

technical field

The technical field of audio processing of the present application, in particular, relates to an audio playback method and related devices.

Background technique

At present, many electronic devices (such as personal computers) can smoothly play the audio files in the application when only one audio application is running, but when multiple audio applications of different types are running together, although they can all be played normally , but multiple applications of different types output different audio files at the same time, which may interfere with each other and bring confusion to the user.

Therefore, it is an urgent problem to be solved how to avoid confusion caused by simultaneous output of multiple audio channels due to sound mixing.

Contents of the invention

The present application provides an audio playback method and a related device, which realize the output of one and only one audio file at the same time, avoid confusion caused by simultaneous output of multiple audio channels due to sound mixing, and improve user experience.

In the first aspect, the present application provides an audio playback method, including: the electronic device plays the first audio file in the first application, and obtains the playback process number of the first application and the process number of the window displayed by the electronic device; The device receives the user's first operation, and the first operation is used to control the second application to play the second audio file; in response to the first operation, the electronic device determines the process number from the window displayed on the electronic device as the playing process number of the first application the target window; the electronic device controls the playing process of the first application corresponding to the target window to pause and play the first audio file, and controls the second application to play the second audio file.

Wherein, the window displayed by the electronic device includes a parent window displayed by the electronic device, and a child window associated with the parent window displayed by the electronic device. The parent window displayed by the electronic device may include multiple, and the child windows associated with each parent window displayed by the electronic device may also include multiple.

Optionally, the electronic device may determine based on the playing sequence that the first application is paused for playing. Exemplarily, since the playing time of the second application is later than the playing time of the first application, the electronic device determines that it is the first application that is suspended for playing.

Optionally, the electronic device may determine based on preset application priorities that the first application is paused for playback. Exemplarily, because the priority of the second application is the priority of the first application, the electronic device determines that the first application is paused.

Optionally, the electronic device may determine, based on the type of the audio file played by the application, that the first application is paused.

Optionally, the electronic device may determine, based on the preset application priority and the type of the audio file played by the application, that it is the first application that is paused for playback.

Through the audio playback method provided in the first aspect, one and only one audio file is output at the same time, avoiding confusion caused by simultaneous output of multiple audio channels due to sound mixing, and improving user experience.

With reference to the first aspect, in a possible implementation manner, the electronic device controls the playback process of the first application corresponding to the target window to pause the playback of the first audio file, which specifically includes: the electronic device obtains the identifier of the target window, and simulates a virtual The space key value of the space key; the electronic device sends the identification of the target window and the virtual space key value to the playback process of the first application; the electronic device uses the playback process of the first application corresponding to the target window based on the identification of the target window and the virtual space key The space key value controls the first application to pause playing the first audio file. In this way, the electronic device simulates a virtual space key value, and can automatically control the first application to pause and play the first audio file without the user operating the space bar on the keyboard to obtain the space key value.

With reference to the first aspect, in a possible implementation manner, in response to the first operation, the electronic device determines from the windows displayed on the electronic device the target window whose process number is the playback process number of the first application, specifically including: responding to In the first operation, the electronic device determines the target window whose process number is the playback process number of the first application from the windows displayed by the electronic device based on the priority of the first application and the priority of the second application. In this way, the electronic device can automatically control the application to pause and play audio based on the preset application priority.

With reference to the first aspect, in a possible implementation manner, based on the priority of the first application and the priority of the second application, the electronic device determines the process number from the window displayed on the electronic device as the playback process number of the first application The target window specifically includes: when the priority of the first application is lower than that of the second application, the electronic device determines the target window whose process number is the playback process number of the first application from the windows displayed on the electronic device .

With reference to the first aspect, in a possible implementation manner, when the priority of the first application is higher than the priority of the second application, the electronic device continues to play the first audio file in the first application, and does not play the first audio file in the first application. A second audio file in the second application. Optionally, in an implementation manner, when the priority of the first application is higher than the priority of the second application, when the electronic device receives the first operation for controlling the second application to play the second audio file After that, the electronic device can first play the second audio file in the second application, that is, play the first audio file and the second audio file at the same time; The program pauses playing the second audio file. That is, the target window of the second application is obtained by traversing, and then the simulated space key value is sent to make the second application pause and play the second audio file. The electronic device is made to continue playing the first audio file without playing the second audio file.

With reference to the first aspect, in a possible implementation manner, the method further includes: when the priority of the first application is the same as that of the second application, the electronic device outputs first prompt information, and the first prompt information uses Before prompting the user to play the second audio file in the second application, playing the first audio file in the first application is paused. In this way, the user may be prompted to pause playing the first audio file in the first application.

With reference to the first aspect, in a possible implementation manner, in response to the first operation, the electronic device determines from the windows displayed on the electronic device the target window whose process number is the playback process number of the first application, specifically including: responding to In the first operation, based on the type of the first audio file and the type of the second audio file, the electronic device determines the target window whose process number is the playing process number of the first application from the windows displayed by the electronic device. In this way, the electronic device can also automatically control the application to pause playing audio based on the type of the audio file played in the application.

With reference to the first aspect, in a possible implementation, the electronic device may also display from the electronic device based on the priority of the first application and the priority of the second application, the type of the first audio file, and the type of the second audio file The target window whose process ID is the playing process ID of the first application is determined from the windows. In this way, the electronic device can also automatically control the application to pause and play audio based on the preset priority of the application and the type of the audio file played in the application.

With reference to the first aspect, in a possible implementation manner, based on the type of the first audio file and the type of the second audio file, the electronic device determines the process number from the window displayed on the electronic device as the playback process number of the first application The target window specifically includes: when the type of the first audio file is a non-real-time audio file and the type of the second audio file is a real-time audio file, the electronic device determines that the process number is The target window of the playback process ID of the first application. In other words, real-time audio files have the highest priority.

With reference to the first aspect, in a possible implementation manner, before the electronic device controls the playing process of the first application corresponding to the target window to stop playing the first audio file, the method further includes: when the type of the first audio file is real-time In the case of an audio file, the electronic device outputs second prompt information, and the second prompt information is used to instruct the user to pause playing the first audio file of the first application; the electronic device controls the playing process of the first application corresponding to the target window to stop playing the first audio file. audio file, and controlling the second application to play the second audio file, specifically includes: the electronic device receives the user's second operation, and in response to the second operation, the electronic device controls the playback process of the first application corresponding to the target window to pause playing the first audio file, and control the second application to play the second audio file. In this way, since the real-time audio file has the highest priority, the electronic device can avoid switching the real-time audio file to a non-real-time audio file, thereby affecting user experience.

With reference to the first aspect, in a possible implementation manner, the electronic device controls the playback process of the first application corresponding to the target window to stop playing the first audio file, specifically including: the electronic device sequentially traverses each parent window displayed on the electronic device , determine the target parent window whose process number is the playing process number of the first application; the electronic device controls the playing process of the first application corresponding to the target parent window to stop playing the first audio file; or, the electronic device sequentially traverses each A parent window, determine the target parent window whose process number is the playback process number of the first application; when the electronic device fails to control the playback process of the first application corresponding to the target parent window to stop playing the first audio file, the electronic device sequentially Traverse each child window associated with each parent window displayed by the electronic device, and obtain the target child window whose process number is the playback process number, or, the electronic device sequentially traverses each child window associated with the target parent window displayed by the electronic device, and obtain Go to the target sub-window whose process ID is the playback process ID; the electronic device controls the playback process of the first application corresponding to the target sub-window to stop playing the first audio file. In this way, the electronic device first judges whether the target parent window can pause and play audio, and if so, it does not need to traverse the target sub-window, which saves the time for the electronic device to search for the target sub-window. If not, the electronic device traverses the target sub-window again.

With reference to the first aspect, in a possible implementation manner, the electronic device controls the playback process of the first application corresponding to the target window to stop playing the first audio file, specifically including: the electronic device sequentially traverses each parent window displayed on the electronic device , determine the target parent window whose process number is the playing process number of the first application; the electronic device sequentially traverses each child window displayed in the electronic device, and determine the target child window whose process number is the playing process number of the first application, or , the electronic device sequentially traverses each sub-window associated with the target parent window displayed by the electronic device, and determines the target sub-window whose process number is the playback process number of the first application; The playing process of the application stops playing the first audio file. In this way, the window implementing the playing logic is either the target child window or the target parent window, and the electronic device can directly obtain the target parent window and the target child window, so that the control application agrees to play audio.

With reference to the first aspect, in a possible implementation manner, after the electronic device starts to output the second audio file in the second application, the method further includes: the electronic device receives a third operation of the user, and the third operation is used to control the second audio file in the second application. The second application pauses playing the second audio file; in response to the third operation, the electronic device controls the second application to pause playing the second audio file, and controls the first application to continue playing the first audio file. In this way, the electronic device can control the application that pauses playing the audio due to the system device instead of the user actively triggering the operation to automatically start playing the audio again, which saves user operations.

With reference to the first aspect, in a possible implementation manner, the electronic device receives a user's fourth operation, and the fourth operation is used to control the first application to pause playing the first audio file; in response to the fourth operation, the electronic device controls the first The application pauses to play the first audio file, and controls the second application to continue to pause and play the second audio file. In this way, the electronic device will not control the application that pauses to play the audio due to the active trigger operation of the user to automatically start playing the audio again, so as to avoid conflicts with the user's wishes.

In the second aspect, the embodiment of the present application provides an electronic device, the electronic device includes: one or more processors, one or more memories; one or more memories are coupled with one or more processors, one or more The memory is used to store computer program codes, the computer program codes include computer instructions, and one or more processors call the computer instructions to make the electronic device execute the audio playing method provided in the first aspect.

In the third aspect, the embodiment of the present application provides an electronic device, a computer-readable storage medium, which is used to store computer instructions, and when the computer instructions are run on the electronic device, the audio playback method provided by the first aspect of the electronic device is made .

In a fourth aspect, an embodiment of the present application provides a computer program product, which, when the computer program product is run on the electronic device, enables the electronic device to perform the audio playback method provided in the first aspect.

For the beneficial effects of the second aspect to the fourth aspect, please refer to the beneficial effects of the first aspect, which will not be repeated in this embodiment of the present application.

Description of drawings

FIG. 1A-FIG. 1E are schematic diagrams of a set of electronic devices 100 playing multiple channels of audio at the same time provided by the embodiment of the present application;

FIG. 2 is a timing diagram of an electronic device 100 playing multiple channels of audio simultaneously according to an embodiment of the present application;

FIG. 3 is a schematic structural diagram of an electronic device 100 provided in an embodiment of the present application;

Fig. 4 is a schematic diagram of functional modules of how an electronic device 100 controls only one channel of audio to be played at the same time provided by the embodiment of the present application;

FIG. 5 is a schematic diagram of how to control the audio application 1 to continue playing music after the cross-process management module 430 in the embodiment of the present application controls the audio application 1 to stop playing music;

6A-6B are schematic diagrams of a parent window and a child window provided by the embodiment of the present application;

FIG. 7A is a schematic diagram of how the cross-process management module 430 controls the audio application 1 to stop playing audio based on the process number one and the pause instruction provided by the embodiment of the present application;

FIG. 7B is a schematic diagram of how another cross-process management module 430 according to the embodiment of the present application controls the audio application 1 to stop playing audio based on the process number one and the pause instruction;

FIG. 7C is a schematic diagram of how the cross-process management module 430 controls the audio application 1 to stop playing audio based on the process number one and the pause instruction provided by the embodiment of the present application;

FIG. 7D is a schematic diagram of how the cross-process management module 430 controls the audio application 1 to stop playing audio based on the process number one and the pause instruction provided by the embodiment of the present application;

8A-8B are schematic diagrams of how the electronic device 100 outputs audio when a group of low-priority audio applications are switched to high-priority audio applications provided by the embodiment of the present application;

9A-9C are schematic diagrams of how the electronic device 100 outputs audio when a group of high-priority audio applications are switched to low-priority audio applications provided by the embodiment of the present application;

10A-10C are schematic diagrams of how the electronic device 100 outputs audio when a group of audio applications with the same priority are switched according to the embodiment of the present application;

FIG. 11 is another timing diagram for playing multiple channels of audio at the same time provided by the embodiment of the present application;

FIG. 12 is a schematic flowchart of an audio playback method provided by an embodiment of the present application.

Detailed ways

The technical solutions in the embodiments of the present application will be described clearly and in detail below in conjunction with the accompanying drawings. Among them, in the description of the embodiments of this application, unless otherwise specified, "/" means or means, for example, A/B can mean A or B; "and/or" in the text is only a description of associated objects The association relationship indicates that there may be three kinds of relationships, for example, A and/or B, which may indicate: A exists alone, A and B exist at the same time, and B exists alone. In addition, in the description of the embodiment of the present application , "plurality" means two or more than two.

Hereinafter, the terms "first" and "second" are used for descriptive purposes only, and cannot be understood as implying or implying relative importance or implicitly specifying the quantity of indicated technical features. Therefore, the features defined as "first" and "second" may explicitly or implicitly include one or more of these features. In the description of the embodiments of the present application, unless otherwise specified, the "multiple" The meaning is two or more.

The term "user interface (UI)" in the following embodiments of this application is a medium interface for interaction and information exchange between an application program or an operating system and a user, and it realizes the difference between the internal form of information and the form acceptable to the user. conversion between. The user interface is the source code written in a specific computer language such as java and extensible markup language (XML). The source code of the interface is parsed and rendered on the electronic device, and finally presented as content that can be recognized by the user. The commonly used form of user interface is the graphical user interface (graphic user interface, GUI), which refers to the user interface related to computer operation displayed in a graphical way. It may be text, icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, Widgets, and other visible interface elements displayed on the display screen of the electronic device.

At present, for an electronic device 100 (such as a personal computer (PC)) equipped with Windows ^@ or other operating systems, since the operating system on the electronic device 100 does not have a multi-channel audio playback control strategy, the electronic device 100 is playing multiple audio channels at the same time. When there are multiple channels of audio, the electronic device 100 will play multiple channels of audio at the same time, and the audio effect heard by the user is a sound mixing effect.

Exemplarily, FIG. 1A-FIG. 1E exemplarily show schematic diagrams in which the electronic device 100 plays multiple channels of audio at the same time.

FIG. 1A exemplarily shows a desktop of an electronic device 100 . The desktop may include icons for one or more applications, a notification bar, and the like. Wherein, the icons of one or more application programs include, but are not limited to, icons of computer applications, icons of recycle bin applications, icons of instant messaging applications, icons of music applications, and icons of video applications. The talk bar can include time indicators, volume indicators, search areas, and more.

As shown in FIG. 1A , the electronic device 100 receives an input operation (for example, a double-click operation) on an icon of a music application, and the electronic device 100 displays a user interface 1001 of the music application on the desktop as shown in FIG. 1B . The user interface 1001 can be understood as the main user interface of the music application. The user interface 1001 includes a music application theme area, a recommended song area and a music playing area. Among them, the theme area includes singers, rankings, song lists and radio stations. There are multiple recommended songs in the recommended song area treasure house, such as "song 1-singer 1", "song 2-singer 2" and "song 3-singer 3". The music playing area includes the name of the song "song A", a pause/play control 1002, a previous song control, a next song control, a volume adjustment progress bar, and the like. It can be seen from FIG. 1A that the song "Song A" to be played in the music playing area has been paused.

As shown in FIG. 1B , the electronic device 100 receives an input operation (such as a click operation) on the pause/play control 1002 in the music playing area, and as shown in FIG. 1C , the electronic device 100 starts to play the song "song A". In this way, the user can hear the song played by the electronic device 100 .

As shown in FIG. 1D , when the electronic device 100 is playing music, the electronic device 100 receives a voice call request sent by other electronic devices, and the electronic device 100 displays a prompt bar 1003 on the desktop. The prompt bar 1003 includes a prompt message "Lily invites you to make a voice call", and the prompt bar 1003 also includes a receiving control 1004 and a rejecting control 1005 . As shown in FIG. 1D , the electronic device 100 receives the user's input operation (such as clicking) on the receiving control 1004 in the prompt bar 1003, and the electronic device 100 establishes a voice call connection with the electronic device used by the contact "Lily".

As shown in FIG. 1E , after the electronic device 100 establishes a voice call connection with the electronic device used by the contact "Lily", the electronic device 100 displays a voice call user interface 1006 on the desktop. The user interface 1006 can display the call duration (for example, the duration is 8 seconds), and the user interface 1006 also includes a mute control, a rejection control, a volume control, and the like. As shown in FIG. 1E , after the electronic device 100 establishes a voice call connection with the electronic device used by the contact "Lily", the electronic device 100 will not pause the music being played by the music application, and the electronic device 100 will continue to play the song "Song A" . At the same time, the electronic device 100 may also play the voice of the contact "Lily", and the content of the voice may be "wait for two minutes and wait for other people to go online".

In order to more clearly show that the electronic device 100 plays multiple channels of audio at the same time, FIG. 2 exemplarily shows a timing diagram of the electronic device 100 playing multiple channels of audio at the same time.

In FIG. 2, at 0 ms, the electronic device 100 receives the user's operation and starts to play the song in the music application. After a period of time (for example, 360 ms), the electronic device 100 receives the user's operation and accesses the electronic device sent by the contact "Lily". voice calls. As shown in FIG. 2 , after the electronic device 100 establishes a voice call connection with the electronic device used by the contact "Lily", the electronic device 100 may play the voice of the contact "Lily". For example, if the call duration is 480ms, when the electronic device 100 plays the voice of the contact "Lily" within 0ms-480ms, the electronic device 100 continues to play the songs in the music application. That is to say, the electronic device 100 overlaps and plays the song between 360ms-840ms in the music application and the real-time voice between 0ms-480ms in the call application, and what the user hears during this period is the sound mixing effect. After the real-time voice in the real-time voice/real-time video category lasts for 480ms, the voice call ends, and the electronic device 100 suspends playing the real-time voice in the calling application. The electronic device 100 still continues to play the songs in the music application.

It can be known from the above analysis that when the electronic device 100 plays multiple channels of audio, the electronic device 100 plays the multiple channels of audio overlappingly, and what the user hears is a sound mixing effect, and the user experience is not good. While the user is listening to music or watching a movie, the user accesses a voice call through the electronic device 100 . When the user is making a voice call, music or movies are still playing continuously, which will cause the user to miss nice music clips or wonderful movie clips, and the user experience is not good.

Based on this, the embodiment of the present application provides an audio playback method, which can be applied to an electronic device 100 installed with Windows ^@ or other operating systems, the method includes: the electronic device plays the first audio file in the first application, and Obtain the playback process number of the first application and the process number of the window displayed by the electronic device; the electronic device receives the first operation of the user, and the first operation is used to control the second application to play the second audio file; in response to the first operation, the electronic device The device determines from the windows displayed by the electronic device the target window whose process number is the playback process number of the first application; the electronic device controls the playback process of the first application corresponding to the target window to pause and play the first audio file, and controls the second application to play the second audio file. In this way, only one channel of audio can be played by the electronic device 100 at the same time without active triggering by the user, which improves user experience.

How the electronic device 100 controls only one audio output at a time will be described in detail in subsequent embodiments, and details will not be described here in this embodiment of the present application.

FIG. 3 exemplarily shows a schematic structural diagram of the electronic device 100 .

The electronic device 100 can be a portable terminal device equipped with ^Windows® or other operating systems, such as a personal computer (personal computer), a notebook computer, a handheld computer, a tablet computer, a desktop computer, etc. Non-portable terminal devices such as laptop computers (Laptop), ultra-mobile personal computers (ultra-mobile personal computer, UMPC), etc. The embodiment of the present application does not specifically limit the specific type of the electronic device 100 .

The electronic device 100 may include a processor 110 , an internal memory 120 , a wireless communication module 130 , a sensor module 150 , an audio module 160 , a display screen 170 , a power switch 180 , a motor 190 and a key 1000 .

The processor 110 may include one or more processing units, for example: the processor 110 may include an application processor (application processor, AP), a modem processor, a graphics processing unit (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), controller, video codec, digital signal processor (digital signal processor, DSP), baseband processor, and/or neural network processor (neural-network processing unit, NPU), etc. Wherein, different processing units may be independent devices, or may be integrated in one or more processors.

The internal memory 120 may include one or more random access memories (random access memory, RAM) and one or more non-volatile memories (non-volatile memory, NVM).

Random access memory can include static random-access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (synchronous dynamic random access memory, SDRAM), double data rate synchronous Dynamic random access memory (double data rate synchronous dynamic random access memory, DDR SDRAM, such as the fifth generation DDR SDRAM is generally called DDR5 SDRAM), etc.; non-volatile memory can include disk storage devices, flash memory (flash memory) .

According to the operating principle, flash memory can include NOR FLASH, NAND FLASH, 3D NAND FLASH, etc. According to the potential order of storage cells, it can include single-level storage cells (single-level cell, SLC), multi-level storage cells (multi-level cell, MLC), triple-level cell (TLC), quad-level cell (QLC), etc., can include universal flash storage (English: universal flash storage, UFS) according to storage specifications , embedded multimedia memory card (embedded multi media Card, eMMC), etc.

The random access memory can be directly read and written by the processor 110, and can be used to store executable programs (such as machine instructions) of an operating system or other running programs, and can also be used to store data of users and application programs.

The non-volatile memory can also store executable programs and data of users and application programs, etc., and can be loaded into the random access memory in advance for the processor 110 to directly read and write.

The wireless communication function of the electronic device 100 can be realized by the antenna 130A, the wireless communication module 130 , the modem processor, the baseband processor, and the like.

The antenna 130A can be used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 may be used to cover single or multiple communication frequency bands. Different antennas can also be multiplexed to improve the utilization of the antennas.

The wireless communication module 130 can provide wireless local area networks (wireless local area networks, WLAN), bluetooth (bluetooth, BT), global navigation satellite system (global navigation satellite system, GNSS), frequency modulation (frequency modulation, FM), near field communication technology (near field communication, NFC), infrared technology (infrared, IR) and other wireless communication solutions. The wireless communication module 130 may be one or more devices integrating at least one communication processing module. The wireless communication module 130 receives electromagnetic waves via the antenna 130A, frequency-modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110 . The wireless communication module 130 can also receive the signal to be transmitted from the processor 110, frequency-modulate it, amplify it, and convert it into electromagnetic wave and radiate it through the antenna 130A.

A modem processor may include a modulator and a demodulator. Wherein, the modulator is used for modulating the low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low frequency baseband signal. Then the demodulator sends the demodulated low-frequency baseband signal to the baseband processor for processing. The low-frequency baseband signal is passed to the application processor after being processed by the baseband processor. The application processor outputs sound signals through an audio device, or displays images or videos through the display screen 170 .

The sensor module 150 includes an acceleration sensor 1501, a temperature sensor 1502, a touch sensor 1503, a pressure sensor 1504, and the like.

Wherein, the acceleration sensor 1501 can be used to detect the acceleration of the electronic device 100 in various directions (generally three axes). The magnitude and direction of gravity can be detected when the electronic device 100 is stationary. It can also be used to identify the posture of electronic devices, and can be used in applications such as horizontal and vertical screen switching, pedometers, etc.

The temperature sensor 1502 is used to detect temperature. In some embodiments, the electronic device 100 uses the temperature detected by the temperature sensor 1502 to implement a temperature treatment strategy. For example, when the temperature reported by the temperature sensor 1502 exceeds the threshold, the electronic device 100 may reduce the performance of a processor located near the temperature sensor 1502, so as to reduce power consumption and implement thermal protection. In other embodiments, when the temperature is lower than another threshold, the electronic device 100 heats the battery, so as to prevent the electronic device 100 from being shut down abnormally due to the low temperature. In some other embodiments, when the temperature is lower than another threshold, the electronic device 100 boosts the output voltage of the battery to avoid abnormal shutdown caused by low temperature.

The touch sensor 1503 is also called "touch device". The touch sensor 1503 may be disposed on the display screen 170, and the touch sensor 1503 and the display screen 170 form a touch screen, also called a “touch screen”. The touch sensor 1503 is used to detect a touch operation acting on or near it. The touch sensor 1503 can transmit the detected touch operation to the application processor to determine the type of the touch event. Visual output related to the touch operation can be provided through the display screen 170 . In other embodiments, the touch sensor 1503 may also be disposed on the surface of the electronic device 100 , which is different from the position of the display screen 170 .

The pressure sensor 1504 is used to sense the pressure signal and convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 1504 may be disposed on the display screen 170 . There are many types of pressure sensors 1504, such as resistive pressure sensors, inductive pressure sensors, and capacitive pressure sensors. A capacitive pressure sensor may be comprised of at least two parallel plates with conductive material. When a force is applied to the pressure sensor 1504, the capacitance between the electrodes changes. The electronic device 100 determines the intensity of pressure according to the change in capacitance. When a touch operation acts on the display screen 170 , the electronic device 100 detects the intensity of the touch operation according to the pressure sensor 1504 . The electronic device 100 may also calculate the touched position according to the detection signal of the pressure sensor 1504 . In some embodiments, touch operations acting on the same touch position but with different touch operation intensities may correspond to different operation instructions. For example: when a touch operation with a touch operation intensity less than the first pressure threshold acts on the short message application icon, an instruction to view short messages is executed. When a touch operation whose intensity is greater than or equal to the first pressure threshold acts on the icon of the short message application, the instruction of creating a new short message is executed.

The audio module 160 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signal. The audio module 160 may also be used to encode and decode audio signals. In some embodiments, the audio module 160 may be set in the processor 110 , or some functional modules of the audio module 160 may be set in the processor 110 .

Speaker 1601, also called "horn", is used to convert audio electrical signals into sound signals. The electronic device 100 can listen to music through the speaker 1601 .

The microphone 1602, also called "microphone" or "microphone", is used to convert sound signals into electrical signals. The user may input a sound signal to the microphone 1602 when transmitting voice information. The electronic device 100 may be provided with at least one microphone 1602 . In some other embodiments, the electronic device 100 may be provided with two microphones 1602, which may also implement a noise reduction function in addition to collecting sound signals. In some other embodiments, the electronic device 100 can also be provided with three, four or more microphones 1602 to collect sound signals, reduce noise, identify sound sources, and realize directional recording functions, etc.

The electronic device 100 realizes the display function through the GPU, the display screen 170 , and the application processor. The GPU is a microprocessor for image processing, and is connected to the display screen 170 and the application processor. GPUs are used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs that execute program instructions to generate or change display information.

The display screen 170 is used to display images, videos and the like. The display screen 170 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active matrix organic light emitting diode or an active matrix organic light emitting diode (active-matrix organic light emitting diode, AMOLED), flexible light-emitting diode (flex light-emitting diode, FLED), Miniled, MicroLed, Micro-oLed, quantum dot light emitting diodes (quantum dot light emitting diodes, QLED), etc. In some embodiments, the electronic device 100 may include 1 or N display screens 170 , where N is a positive integer greater than 1.

The power switch 180 can be used to control power supply to the electronic device 100 .

The motor 190 can generate vibration prompts. The motor 190 can be used for incoming call vibration prompts, and can also be used for touch vibration feedback. For example, touch operations applied to different applications (such as audio playback, etc.) may correspond to different vibration feedback effects. The motor 190 can also correspond to different vibration feedback effects for touch operations acting on different areas of the display screen 170 . Different application scenarios (for example: time reminder, receiving information, alarm clock, games, etc.) can also correspond to different vibration feedback effects. The touch vibration feedback effect can also support customization.

The key 1000 includes a power key, a volume key and the like. The key 1000 may be a mechanical key. It can also be a touch button. The electronic device 100 may receive key input and generate key signal input related to user settings and function control of the electronic device 100 .

It can be understood that, the structure illustrated in the embodiment of the present invention does not constitute a specific limitation on the electronic device 100 . In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown in the figure, or combine certain components, or separate certain components, or arrange different components. The illustrated components can be realized in hardware, software or a combination of software and hardware.

As shown in FIG. 4 , FIG. 4 exemplarily shows a functional module schematic diagram of how the electronic device 100 controls only one channel of audio to be played at the same time.

The electronic device 100 includes an audio notification manager module (audio notification manager module) 410, a process manager module (process manager module) 420 and a cross-process management module (remote control module) 430.

Among them, the audio notification management module 410 is used to monitor the running state of the audio application in the electronic device 100. The running state of the audio application can be divided into an open state and an unopened state, and the open state can be divided into a play state and a pause state. When the audio application is in the open state, the electronic device 100 has created a process of the audio application and configured a corresponding process number. When the audio application is not opened, the process of the unopened audio application is not created. The playing state refers to that the electronic device 100 is playing an audio file in a certain audio application. The pause state means that a certain audio application has been opened, but the electronic device 100 has not played the audio file in the certain audio application, or the electronic device 100 has played the audio file in the certain audio application before, However, currently the electronic device 100 pauses playing the audio file in the certain audio application.

The audio notification management module 410 is configured to send the audio application in the open state and the process number of the audio application to the process management module 420 . When the open state of the same audio application changes, for example, the open state of the audio application changes from the play state to the pause state, or the open state of the audio application changes from the pause state to the play state, the audio notification management module 410 also uses Then, the changed open state of the audio application is sent to the process management module 420 again.

Exemplarily, the electronic device 100 receives the user operation to open the music application 1, but does not play the audio file in the music application 1, the electronic device 100 will create the process number of the music application 1, and the electronic device 100 will set the open state of the music application 1 (pause state) and the process number of the music application 1 are sent to the process management module 420.

Exemplarily, after the electronic device 100 starts the music application 1, the electronic device 100 receives a user operation to open the video application 1, and plays the video file in the video application 1, the electronic device 100 will create a process number for playing the video application 1, The electronic device 100 sends the start state (playing state) of the video application 1 and the process number of the video application 1 to the process management module 420 .

If at a certain moment, the electronic device 100 receives a user operation to suspend playing the video file in the video application 1, then the open state of the video application 1 changes from the playing state to the paused state. Since the opening state of the video application 1 has also changed, the audio notification management module 410 sends the opening state (suspended state) of the video application 1 and the process number of the video application 1 to the process management module 420 again.

The function of the process management module 420 is to control multiple audio applications at the same time, only one audio application can play audio. Specifically, the process management module 420 is configured to receive the start status of the audio application and the process number of the audio application sent by the audio notification management module 410 . And based on the open state of the audio application and the preset priority policy, it is determined which audio application needs to be controlled.

Optionally, the process management module 420 may also determine which audio application needs to be controlled based on the whitelist policy and the preset priority policy. A whitelist policy is a collection of preset applications that need to be controlled. Only when the application is in the white list, the process management module 420 will control the process of the application. If the application is not in the white list, the process management module 420 will not control the process of the application. In this way, it is possible to prevent the process management module 420 from controlling all the applications in the electronic device 100 , which would lead to an excessive load on the process management module 420 .

Optionally, the process management module 420 may control the applications in the whitelist based on the frequency of use of the user. For example, if the user does not use a certain application within a certain period of time (for example, one month), the process management module 420 may remove the certain application from the white list. After the process management module 420 removes this certain application from the white list, the process management module 420 detects that the number of times the user uses the certain application within a certain period of time (for example, within a week) is greater than the preset value, then the process management module 420 You can add this certain application to the white list again.

If the process management module 420 detects that two audio applications are in the playing state at the same time, for example, the audio application 1 and the audio application 2 are both in the playback state, then the process management module 420 will start from the two audio applications based on the preset The set priority strategy determines an audio application with a lower priority, for example, the priority of audio application 1 is lower than that of audio application 2, and the process management module 420 will obtain the process number of audio application 1 , and send the process number one to the cross-process management module 430 .

Exemplarily, the audio application 1 may be a music application 1, and the audio application 2 may be a video application 1. At the same time, the process management module 420 monitors that the music application 1 and the video application 1 are both in the playing state, then the process management module 420 will determine the priority from the music application 1 and the video application 1 based on the preset priority policy For a lower audio application, for example, if the process management module 420 determines that the priority of the music application 1 is low, then the process management module 420 will obtain the process number of the music application 1, and send the process number of the music application 1 and the pause instruction Sent to the cross-process management module 430.

The cross-process management module 430 is used to receive the process number one of the audio application 1 and the pause instruction sent by the process management module 420, and control the audio application 1 to stop playing audio based on the process number one of the audio application 1 and the pause instruction. In this way, through the control of audio applications, only one audio channel can be played at the same time. Specifically, how the cross-process management module 430 controls the audio application 1 to stop playing audio based on the process number of the audio application 1 will be described in detail in subsequent embodiments, and will not be repeated in this embodiment of the application.

Exemplarily, the cross-process management module 430 receives the process number of the music application 1 sent by the process management module 420 , and the cross-process management module 430 will control the music application 1 to stop playing music based on the process number of the music application 1 . Thus, only video application 1 has audio output. It is realized that the electronic device 100 can only play the audio in one audio application at the same time.

It should be noted that the above one or more functional modules can be combined at will, so that the electronic device 100 can only play the audio in one audio application at the same time.

As shown in FIG. 5 , FIG. 5 exemplarily shows a functional module diagram of how the cross-process management module 430 controls the audio application 1 to continue playing music after controlling the audio application 1 to stop playing music.

Functions of the functional modules in FIG. 5 are similar to those of the functional modules in FIG. 4 , and will not be repeated in this embodiment of the present application.

In the embodiment shown in FIG. 4 , when the process management module 420 determines to control the audio application 1 to suspend playing audio based on the playback priority policy, the process management module 420 also needs to mark the process number one of the audio application 1, Make the process management module 420 record that the audio application 1 pauses playing the audio due to the playback priority policy, and the audio application 1 is not triggered to pause the audio by the user. Optionally, the process management module 420 may store the process number one of the audio application 1 locally, so that when the process management module 420 controls the audio application 1 from the state of pausing the audio to the state of continuing to play the audio, Whether the process number 1 of the audio application 1 that needs to continue to play audio can be found from the process number of the audio application stored locally. If it is found, it means that the process management module 420 previously controlled the audio application 1 to suspend playing audio based on the playback policy, rather than the user actively triggering the audio application 1 to suspend playing audio. In this case, the process management module 420 will audio The process number one and the play instruction of the class application 1 are sent to the cross-process management module 430, and after the cross-process management module 430 receives the process number one and the play instruction of the audio class application 1 sent by the process management module Control audio application 1 to continue playing audio. If it is not found, it means that the process management module 420 did not control the audio application 1 to suspend playing audio based on the playback policy before, but the audio application 1 paused playing the audio due to the user's active trigger. In this case, the process management module 420 will not send the process number one of the audio application 1 and the playback instruction to the cross-process management module 430, so as to avoid conflicts with the user's willingness to actively trigger the audio application 1 to pause playing audio.

It should be noted that the process management module 420 can also mark the process number 1 of the audio application 1 based on other methods, not limited to the method of saving the process number 1 of the audio application 1 locally. There is no limit to this.

Specifically, after the cross-process management module 430 controls the audio application 1 to stop playing audio, the audio notification management module 410 will obtain that the audio application 1 is in the open state from the playback state to the pause state, then the audio notification management module 410 will send the audio The open state (ie, paused state) of the class application 1 and the process number of the audio class application 1 are sent to the process management module 420 . Then, the open state of the audio application 1 detected by the process management module 420 is the pause state, and the open state of the audio application 2 is the play state. That is, the process management module 420 detects that there is only one audio output.

After a period of time, it is assumed that the open state of the audio application 2 changes from the playing state to the paused state. Then the audio notification management module 410 will obtain the open state of the audio application 2 from the play state to the pause state, and the audio notification management module 410 will obtain the open state (ie, pause state) of the audio application 2 and the process number of the audio application 2. Sent to the process management module 420. Then, the open state of the audio application 1 detected by the process management module 420 is the suspended state, and the open state of the audio application 2 is also the suspended state.

At this time, assuming that the process management module 420 detects that the audio application 2 changes from the playing state to the paused state, then the process management module 420 based on the preset priority policy, the process number of the audio application stored in the process management module 420 and the The open state of other audio-type applications other than type-application 2 determines the audio-type application that needs to continue playing.

In some embodiments, if in addition to the audio application 2, the process management module 420 only monitors that the audio application 1 is in a suspended state, and the process number of the audio application stored by the process management module 420 includes the audio application 1 If the process number is one, then the process management module 420 determines that the audio application that continues to play is the audio application 1, and the process management module 420 sends the process number one and the playback instruction of the audio application 1 to the cross-process management module 430.

When the cross-process management module 430 receives the process number one and the play instruction of the audio application 1 sent by the process management module 420, the cross-process management module 430 will control the audio application 1 to continue playing audio based on the process number one and the play instruction.

In other embodiments, if in addition to the audio application 2, the process management module 420 only detects that the audio application 1 is in a suspended state, but the audio application 1 is not included in the process number of the audio application stored by the process management module 420 The process number is one, which means that it was not the process management module 420 that controlled the audio application 1 to suspend audio playback based on the playback priority policy. It may be that the user actively triggered the audio application 1 to suspend audio playback. It will not control the audio application 1 to continue playing audio, so as to avoid conflicts with the user's willingness to actively trigger the audio application 1 to suspend playing audio, and the process management module 420 will not send the process number 1 and the playback instruction of the audio application 1 to A cross-process management module 430 .

In other embodiments, if in addition to the audio application 2, the process management module 420 detects that both the audio application 1 and the audio application 3 are in a suspended state, but the priority of the audio application 1 is higher than that of the audio application 3. Priority, and the process number of the audio class application stored by the process management module 420 includes the process number one of the audio class application 1, then the process management module 420 determines that the audio class application that continues to play is the audio class application 1, and the process management module 420 Send the process number one of the audio application 1 and the play instruction to the cross-process management module 430 .

When the cross-process management module 430 receives the process number one and the play instruction of the audio application 3 sent by the process management module 420, the cross-process management module 430 will control the audio application 1 to continue playing audio based on the process number one and the play instruction.

Optionally, if in addition to the audio application 2, the process management module 420 only detects that the audio application 1 and the audio application 3 are in a suspended state, the priority of the audio application 1 is higher than that of the audio application 3 , but the process number of the audio application saved by the process management module 420 does not include the process number one of the audio application 1, but includes the process number three of the audio application 3, which means that the process management module 420 was not based on the playback priority strategy before. The audio application 1 is controlled to suspend audio playback, which may be triggered by the user to suspend audio application 1, but the process management module 420 controls audio application 3 to suspend audio playback based on the playback priority policy. Therefore, the process management module 420 determines that even if the priority of the audio application 1 is higher than that of the audio application 3, the process management module 420 will not control the audio application 1 to continue playing audio, so as to avoid actively triggering the audio application with the user. 1 There is a conflict in the desire to pause playing audio, but the process management module 420 will control the audio application 3 to continue playing audio, and the process management module 420 sends the process number three of the audio application 3 and the playback instruction to the cross-process management module 430.

When the cross-process management module 430 receives the process number three and the play instruction of the audio application 3 sent by the process management module 420, the cross-process management module 430 will control the audio application 3 to continue playing audio based on the process number three and the play instruction.

Here, how the cross-process management module 430 controls the audio application to continue playing audio based on the process number and the playback instruction will be described in detail in subsequent embodiments, and will not be repeated in this embodiment of the application.

It should be noted that the cross-process management module 430 is generally used to control an audio application of a non-real-time voice call or a non-real-time video call to continue playing audio after suspending. For audio applications of non-real-time voice calls or non-real-time video calls, the electronic device 100 essentially caches the audio files to be played by the audio applications of non-real-time voice calls or non-real-time video calls completely or partially in the Locally, the cross-process management module 430 can control the audio application of the non-real-time voice call or non-real-time video call to continue playing audio based on the complete or partial cached audio file.

Next, it will be introduced how the cross-process management module 430 controls the audio application to pause playing audio based on the process number and the playback instruction.

First introduce the concept of parent window and child window.

After the application is started, the parent window of the application is established, and when the application is closed, the parent window of the application does not exist. Each application has a different definition of a parent window and a child window. Each application program corresponds to one or more parent windows, and the parent window is used to host the child windows. A parent window can have one or more child windows.

The definition of the parent window and the child window will be explained in detail below by taking the music application as an example.

The electronic device 100 starts the music application, and displays the user interface 1001 of the music application shown in FIG. 1B . After the electronic device 100 starts the music application, the parent window of the music application has been established, but the electronic device 100 does not display the parent window of the music application.

The music application is based on functional modules, and the user interface 1001 is divided into several sub-windows. As shown in FIG. 6A, for example, the area 601 in the user interface 1001 is a sub-window 1, and the function of the sub-window 1 is to realize a search function, such as searching for songs, singers, music videos (music video, MV) and the like. The area 602 in the user interface 1001 is the sub-window 2, and the function of the sub-window 2 is to realize the song list display function, such as singer popularity ranking, popular song list, personal favorite song list, radio station and so on. The area 603 in the user interface 1001 is the sub-window 3. The function of the sub-window 3 is to realize the recommendation function, such as recommending the music that the user likes to listen to based on the user's preference, or recommending currently popular singles or MVs based on big data analysis. The area 604 in the user interface 1001 is a sub-window 4, and the function of the sub-window 4 is to realize playing/pausing music. The sub-window 4 includes a play/pause control, a previous song control, a next song control, a volume adjustment control and the like.

As shown in FIG. 6B , FIG. 6B shows a schematic diagram of the relationship between a parent window and multiple child windows in a music application.

The parent window in the music application is the bearer of all the child windows in the music application, and the child windows associated with the parent window may include child window 1, child window 2, child window 3 and child window 4. If the electronic device 100 receives the user's first input operation in the sub-window 1 , the electronic device 100 will overlay and display other user interfaces on the user interface 1001 . Then, other user interfaces displayed by the electronic device 100 may include one or more sub-windows, for example, other user interfaces include sub-window 5 and sub-window 6 , and both sub-window 5 and sub-window 6 belong to sub-windows of sub-window 1 .

It should be noted that both the parent window and the child window in the application include a unique window identifier, and the window identifier is used to indicate which parent window or which child window it is. The window identifier may include but not limited to window handle and other information. The window handle may be understood as the number of the window, and the number of each window is different. In this way, the electronic device 100 can find the corresponding window based on the handle of the window.

It should be noted that the definitions of the parent window and child window of each application are different, and the above explanations in FIG. 6A-FIG. 6B are only for explaining the present application, and this embodiment of the present application does not limit it.

FIG. 7A exemplarily shows a schematic diagram of how the cross-process management module 430 controls the audio application 1 to stop playing audio based on the process number one and the pause instruction.

S701A. The cross-process management module 430 traverses each parent window in turn, and acquires all parent windows whose process number is process number one as target parent windows.

Optionally, after the cross-process management module 430 acquires all parent windows, all parent windows can be divided into system parent windows and application parent windows. Since the electronic device 100 generally plays audio through applications, the cross-process management module 430 can filter all parent windows to obtain application-type parent windows.

Exemplarily, if the electronic device 100 starts the application 1 and the application 2, the electronic device 100 plays audio through the application 1. All parent windows acquired by the cross-process management module 430 may include the parent window of application 1, the parent window of application 2 and the system parent window. Since the electronic device 100 generally plays audio through the application, the cross-process management module 430 can obtain the parent window of the application 1 and the parent window of the application 2 from the parent window of the application 1, the parent window of the application 2 and the system parent window.

Optionally, after the cross-process management module 430 acquires all parent windows, all parent windows can be divided into system parent windows and application parent windows. Since the electronic device 100 generally plays audio through audio applications, the cross-process management module 430 can filter all parent windows to obtain the application parent window, and then filter the application parent windows to obtain the audio application parent window.

Exemplarily, if the electronic device 100 starts application 1 and application 2, application 1 is an audio application, application 2 is a non-audio application, and the electronic device 100 plays audio through application 1. All parent windows acquired by the cross-process management module 430 may include the parent window of application 1, the parent window of application 2 and the system parent window. Since the electronic device 100 generally plays audio through audio applications, the cross-process management module 430 can filter and obtain the parent window of application 1 from the parent window of application 1, the parent window of application 2 and the system parent window.

After the application program is started, the process number of the application program has been created. The application program corresponds to one or more processes, and each process corresponds to a parent window. Therefore, the opened application program may have one parent window, or may have multiple parent windows, which is not limited in this embodiment of the present application.

Exemplarily, if the same application program on the electronic device 100 is opened only once, then the application program has a parent window, and the parent window corresponds to a process number. If the same application program on the electronic device 100 is opened multiple times at the same time, then the application program has multiple parent windows, and the process ID of each of the multiple parent windows of the same application program is different.

The electronic device 100 can start an application program, then there is at least one parent window of the application program. If the electronic device 100 has opened two or more application programs, then there are at least two or more parent windows. The cross-process management module 430 needs to traverse each parent window in turn to find all parent windows.

Exemplarily, if the electronic device 100 starts the music application 1 and the video application 1 , then there is at least one parent window of the music application 1 and at least one parent window of the video application 1 in the electronic device 100 .

The cross-process management module 430 traverses each parent window in turn, and if the process number of the current parent window is process number one, the cross-process management module 43 takes the parent window as the target parent window.

Optionally, after the cross-process management module 430 finds the target parent window, the cross-process management module 430 can stop traversing other windows, so that the time for the cross-process management module 430 to find the target parent window can be saved.

Optionally, the cross-process management module 430 can continue to traverse other windows until all parent windows have been traversed. In this way, the situation that the cross-process management module 430 misses to find the target parent window can be avoided.

S702A, the cross-process management module 430 obtains the identifier of the target parent window.

S703A, the cross-process management module 430 sends the pause command and the target parent window identifier to the process with process number one.

The cross-process management module 430 obtains the target parent window after obtaining the parent window of process number one. The cross-process management module 430 obtains the identifier of the target parent window, and sends a pause command and the identifier of the target parent window to the process with process number one. In this way, due to the diversity of application programs, the cross-process management module 430 cannot obtain in advance which parent window or which child window the window implementing the play/pause function is. Therefore, the cross-process management module 430 first sends a pause instruction to the target parent window, and judges whether it is possible to control the current audio to pause and play.

Optionally, the pause command can be a simulated space key value. The simulated space bar value is equivalent to the electronic device 100 receiving the user's click operation on the space bar on the keyboard. In this way, the process management module 420 sends the simulated space key value to the process of process number one, so that the process of process number one can control the audio application 1 to play audio, which is equivalent to simulating the user manually clicking the space bar on the keyboard. Automatically pause the playback of audio application 1.

S704A. The cross-process management module 430 judges whether the audio application 1 stops playing audio?

If the cross-process management module 430 determines that the audio application 1 stops playing audio, it means that the window of the audio application 1 that implements the play/pause function is the parent window of the audio application 1, and the process ends.

If the cross-process management module 430 determines that the audio application 1 has not stopped playing audio, it means that the window of the audio application 1 that implements the play/pause function is not the parent window of the audio application 1, and the cross-process management module 430 executes S705.

S705A. The cross-process management module 430 sequentially traverses all child windows under each parent window, and acquires all child windows whose process number is process number one as target child windows.

Since the cross-process management module 430 cannot know which sub-window implements the pause/play function, the cross-process management module 430 needs to obtain all the sub-windows whose process number is process number one as the target sub-window.

Cross-process management module 430 traverses the child windows associated under each parent window in turn, if the process number of the child window associated under the current parent window is process number one, then the cross-process management module 43 uses the child window associated under the current parent window as The target subwindow.

Optionally, after the cross-process management module 430 finds the target sub-window, the cross-process management module 430 can stop the associated sub-windows under other parent windows. In this way, the time for the cross-process management module 430 to find the target sub-window can be saved.

Optionally, the cross-process management module 430 can continue to traverse the associated sub-windows under other parent windows until all the associated sub-windows under all parent windows have been traversed, so that the cross-process management module 430 can avoid the situation that the target sub-window is missed occur.

It should be noted that the number of all child windows under each parent window may be one, or two or more.

Exemplarily, if the electronic device 100 starts the music application 1 and the video application 1 , then there is a parent window of the music application 1 and a parent window of the video application 1 in the electronic device 100 . The cross-process management module 430 needs to find all the child windows in the parent window of the music application 1 first, and then, the cross-process management module 430 searches for all the child windows in the parent window of the video application 1.

If the cross-process management module 430 finds all child windows in the parent window of music application 1, and obtains the process numbers of all child windows of music application 1, when the process numbers of all child windows of music application 1 are process number one , all sub-windows of the music application 1 are used as target sub-windows. When the process numbers of some of the sub-windows of the music application 1 are process number 1, all the sub-windows of the music application 1 are used as the target sub-windows. When the process numbers of some of the sub-windows of the music application 1 are not process number 1, it means that the sub-windows in the music application 1 do not include the target sub-window. The cross-process management module 430 continues to search for all child windows in the parent window of the video application 1 .

Optionally, if the cross-process management module 430 finds all child windows whose process number is process number one in the parent window of the music application 1 . The cross-process management module 430 also needs to search for all sub-windows in the parent window of the video application 1, and obtain the process numbers of all sub-windows of the video application 1. When the process IDs of all the sub-windows of the video application 1 are process ID 1, all the sub-windows of the video application 1 are used as the target sub-windows. When the process number of some of the sub-windows of the video application 1 is process number 1, all the sub-windows of the video application 1 are used as the target sub-windows.

Through the above method, until the cross-process management module 430 finds all child windows whose process number is process number one in the parent window.

When the cross-process management module 430 first finds the target sub-window in the sub-window of the music application 1, the cross-process management module 430 can also continue to search for whether the target sub-window exists in the video application 1 until it traverses all the parent windows in turn. child window. In this way, the situation that the cross-process management module 430 fails to find the target sub-window can be avoided, and the accuracy of cross-process audio playback control is improved.

S706A, the cross-process management module 430 obtains the identifier of the target sub-window.

Here, the identifier of the target sub-window may be one or multiple.

The identifier of the target sub-window may be information such as a handle of the target sub-window. The handle of the target sub-window can be understood as the number of the target sub-window, and the labels of each target sub-window are different. In this way, the cross-process management module 430 can find the corresponding target sub-window based on the handle of the target sub-window.

S707A, the cross-process management module 430 sends the pause instruction and the target sub-window identifier to the process with process number one.

After obtaining the identification of the target sub-window, the cross-process management module 430 sends the suspension instruction and the identification of the target sub-window to the process of the process number one, and after the process of the process number one receives the suspension instruction and the identification of the target sub-window, The target sub-window corresponding to the identifier of the target sub-window will be controlled to pause playing audio. In this way, the cross-process management module 430 realizes the function of controlling audio pause across processes, avoiding multiple audio outputs at the same time and bringing bad user experience to the user.

FIG. 7B exemplarily shows another schematic diagram of how the cross-process management module 430 controls the audio application 1 to stop playing audio based on the process number one and the pause instruction.

S701B. The cross-process management module 430 traverses each parent window in turn, and obtains all parent windows whose process number is process number one as target parent windows.

S702B, the cross-process management module 430 sequentially traverses all child windows under each parent window, and acquires all child windows whose process number is process number one as target child windows.

S703B, the cross-process management module 430 acquires the identifier of the target parent window and the identifier of the target child window.

S704B, the cross-process management module 430 sends the pause command, the identifier of the target parent window and the identifier of the target child window to the process with process number one.

The difference between FIG. 7B and FIG. 7A is that the cross-process management module 430 does not need to execute the judgment step of S704A in FIG. 7A, because the cross-process management module 430 cannot obtain in advance which parent window or Which child window, and the window that implements the play/pause function is either in the parent window or in the child window. Therefore, the cross-process management module 430 directly sends pause commands to all target child windows and target parent windows, so that the audio application 1 can stop playing audio.

FIG. 7C exemplarily shows another schematic diagram of how the cross-process management module 430 controls the audio application 1 to stop playing audio based on the process number one and the pause instruction.

S701C. The cross-process management module 430 traverses each parent window in turn, and obtains all parent windows whose process ID is process ID 1 as target parent windows.

S702C, the cross-process management module 430 acquires the identifier of the target parent window.

S703C, the cross-process management module 430 sends the pause command and the target parent window identifier to the process with process number one.

S704C. The cross-process management module 430 judges whether the audio application 1 stops playing audio?

If the cross-process management module 430 determines that the audio application 1 has not stopped playing audio, it means that the window of the audio application 1 that implements the play/pause function is not the parent window of the audio application 1, and the cross-process management module 430 executes S705C.

S705C, cross-process management module 430 traverses to each child window associated with the target parent window in turn, and obtains all child windows whose process number is process number one as the target child window.

S706C, the cross-process management module 430 obtains the identifier of the target sub-window.

S707C, the cross-process management module 430 sends the pause command and the target sub-window identifier to the process with process number one.

The difference between FIG. 7C and FIG. 7A is that the cross-process management module 430 does not need to execute step S705A in FIG. 7A , but replaces S705A with S705C. In S705C, the cross-process management module 430 does not need to traverse each child window under each parent window in turn, and then obtain the child window whose process number is process number one from all the child windows. The cross-process management module 430 can directly traverse from the child window associated with the target parent window to the child window whose process number is one, as the target child window, saving the time for the cross-process management module 430 to find the child window whose process number is one, The efficiency of the cross-process management module 430 controlling the audio application 1 to stop playing audio is improved.

FIG. 7D exemplarily shows another schematic diagram of how the cross-process management module 430 controls the audio application 1 to stop playing audio based on the process number one and the pause instruction.

S701D. The cross-process management module 430 traverses each parent window in turn, and traverses to the next parent window.

S702D. Send the pause command and the next parent window identifier to the process with process number one.

S703D. The cross-process management module 430 judges whether the audio application 1 stops playing audio?

If the cross-process management module 430 determines that the audio application 1 has not stopped playing audio, it means that the window of the audio application 1 that implements the play/pause function is not the parent window of the audio application 1, and the cross-process management module 430 executes S704D.

If the cross-process management module 430 determines that the audio application 1 has stopped playing audio, it means that the window of the audio application 1 that implements the play/pause function is the parent window of the audio application 1, and the process ends.

S704D. The cross-process management module 430 sequentially traverses the child windows associated with the next parent window.

S705D. The cross-process management module 430 judges that the process number of the child window associated with the next parent window is process number one?

If yes, it means that the window implementing the play/pause function of the audio application 1 may be a child window associated with the next parent window, and the cross-process management module 430 executes S706D. If not, it means that the window implementing the play/pause function of the audio application 1 is not a child window associated with the next parent window, and the cross-process management module 430 executes S701D.

S706D, the cross-process management module 430 sends the pause command and the identifier of the child window associated with the next parent window of the process number one to the process of the process number one.

After the cross-process management module 430 sends the pause command and the identifier of the child window associated with the next parent window of the process number one to the process of the process number one, the cross-process management module 430 executes the judgment step of S703D. If the audio application 1 stops playing audio, it means that the window implementing the play/pause function of the audio application 1 is a child window associated with the next parent window, and the process ends. If not, it means that the window in which the audio application 1 implements the play/pause function is not a child window associated with the next parent window, the cross-process management module 430 executes S701D, and the cross-process management module 430 continues to search for the next parent window and the next parent window Associated child windows until the cross-process management module 430 finds the parent window that causes the audio application 1 to stop playing audio or the child window associated with the parent window.

The difference between Fig. 7C and Fig. 7A is that, firstly, the cross-process management module 430 does not need to judge the process number of the parent window, but when traversing to each parent window, it directly gives the identification and pause of the parent window being traversed. The instruction is sent to the process whose process ID is process ID one. Secondly, the cross-process management module 430 does not find all the child windows associated with the parent window at one time, but only traverses the child windows associated with the parent window being traversed, and the cross-process management module 430 uses the identifier of the child window associated with the parent window being traversed and suspend instruction is sent to the process whose process number is process number one, if this operation causes the audio application 1 to suspend playing audio, then the cross-process management module 430 does not need to traverse other parent windows and child windows, which is the same as S705A in FIG. 7A In comparison, the cross-process management module 430 saves time for traversing all child windows associated with the parent window. If the operation does not cause the audio application 1 to suspend playing audio, the cross-process management module 430 continues to execute S701D.

After the audio application 2 suspends playing the audio, the cross-process management module 430 may also automatically control the audio application 1 to continue playing the audio. The principle of how the cross-process management module 430 controls the audio application 1 to continue playing audio based on the process number one is similar to the principle of how the cross-process management module 430 controls the audio application 1 to pause playing audio based on the process number one. Specifically, reference may be made to related descriptions in FIG. 7A-FIG. 7C. It’s just that the former continues to play the audio, and the latter pauses the audio. The difference between the two is that before the cross-process management module 430 controls the audio application 1 to continue playing the audio, the cross-process management module 430 needs to determine the previous audio application. 1 Whether the trigger operation of pausing audio playback is initiated by the user or triggered by the system's playback priority policy. If the cross-process management module 430 determines that the previous trigger operation of the audio application 1 to suspend audio playback is actively triggered by the user, then the cross-process management module 430 will not control the audio application 1 to continue playing audio, so as to avoid conflicts with the user's wishes. If the cross-process management module 430 determines that the previous trigger operation of the audio application 1 to suspend playing audio is triggered by the system's playback priority policy, then the cross-process management module 430 will control the audio application 1 to continue playing audio. For how the cross-process management module 430 determines whether the audio application 1 pauses the audio playback trigger operation is triggered by the user, or is triggered by the system's playback priority policy, you can refer to the detailed introduction in the embodiment of Figure 5, the embodiment of the present application I won't repeat them here.

Next, the preset priority policy involved in the embodiment of the present application will be explained.

It should be noted that the preset priority policy is set for audio applications, that is, the electronic device 100 can divide audio applications into different priorities.

Way 1: Divide the applications in the electronic device 100 into different priority levels. For example, it can be divided into the first level, the second level, the third level and the fourth level, etc., wherein the priority of the first level is greater than the priority of the second level, and the priority of the second level is greater than the priority of the third level level, the priority of the third level is higher than that of the fourth level. The electronic device 100 divides different applications into different priority levels.

Table 1

Table 1 exemplarily shows the result of the priority level division of the applications in the electronic device 100 . For example, the priority level of real-time voice/real-time video applications is the first level, and real-time voice/real-time video applications may include but not limited to telephone applications and social applications (such as instant messaging applications, etc.). The priority level of the navigation application is the second level, and the navigation application may include but not limited to the Baidu map application and the like. The priority level of game applications is the third level, and game applications may include, but are not limited to, applications such as Honor of Kings. The priority level of music applications is the fourth level, and music applications may include but not limited to Netease cloud music applications. The priority level of video applications is also the fourth level, and video applications may include but not limited to Tencent video applications.

It should be noted that Table 1 only exemplarily shows the results of the priority division of some applications. In a specific implementation, it may include more levels of priority than those in Table 1, and there may be more categories of audio applications, which are not limited in this embodiment of the present application.

Since the types of applications in the electronic device 100 change in real time, the electronic device 100 may periodically update the priority levels of the applications in the electronic device 100 . Optionally, the electronic device 100 may change the priority level of the applications in the electronic device 100 based on the user's usage frequency and the user's usage habits. That is to say, the priority levels of the applications in the electronic device 100 can be changed. Optionally, the electronic device 100 can also customize the priority levels of the applications in the electronic device 100 by receiving the user's operation. In this way, the priority levels of unused applications can be set according to the user's wishes, which further improves the user experience.

Taking the audio application 1 and the audio application 2 as examples below, how to perform audio playback control according to a preset priority strategy.

1. When the priority of audio application 1 is the same as that of audio application 2, that is, switching at the same level, the electronic device 100 defaults that the audio application with a later playback time can continue to play audio, and the audio application with an earlier playback time Pause audio playback. Exemplarily, when the audio application 1 is playing audio, the electronic device 100 receives a user operation and starts playing audio through the audio application 2. Since the playback time of the audio application 2 is later than that of the audio application 1, the electronic device 100 The audio application 1 will be controlled to pause playback, and the audio application 2 will be controlled to start playing audio.

2. When the priority of the audio application 1 is higher than that of the audio application 2, that is, switching from a high level to a low level, the electronic device 100 can give a prompt message, which is used to prompt the user to suspend the high priority application first. An audio application that plays audio or prompts the user that the audio cannot be switched. Exemplarily, when the audio application 1 is playing audio, the electronic device 100 receives a user operation to start playing audio through the audio application 2. Since the priority of the audio application 1 is higher than that of the audio application 2, the electronic device 100 Cannot control audio application 1 to pause playback, and control audio application 2 to start playing audio. Optionally, the electronic device 100 may output prompt information, which is used to prompt the user that the audio application 2 cannot be controlled to start playing audio. Optionally, the electronic device 100 may also output prompt information, which is used to prompt the user to pause the audio played by the audio application 1 if he wants to start playing audio through the audio application 2 .

3. When the priority of the audio application 1 is lower than the priority of the audio application 2, that is, switching from low priority to high priority, the electronic device 100 can directly suspend the audio playback of the low priority audio application, and control the high priority audio application Audio apps play audio. Exemplarily, when the audio application 1 is playing audio, the electronic device 100 receives a user operation and starts playing audio through the audio application 2. Since the priority of the audio application 1 is lower than that of the audio application 2, the electronic device 100 The device 100 may directly pause the audio played by the audio application 1, and control the audio application 2 to start playing the audio.

Method 2: the electronic device 100 does not prioritize the audio applications in the electronic device 100, but determines whether to switch based on the playing time. By default, the electronic device 100 always has a higher priority of an audio application with a later playback time than an audio application with an earlier playback time. Exemplarily, when the audio application 1 is playing audio, the electronic device 100 receives a user operation and starts playing audio through the audio application 2. Since the playback time of the audio application 2 is later than that of the audio application 1, the electronic device 100 The audio application 1 will be controlled to pause playback, and the audio application 2 will be controlled to start playing audio.

It should be noted that it is not limited to the preset priority policies introduced in the first and second ways, but may also include other more priority policies, which are not limited in this embodiment of the present application.

Next, an audio playback method provided by the embodiment of the present application is introduced based on the preset priority policy described above in conjunction with the accompanying drawings.

8A-8B exemplarily show how the electronic device 100 outputs audio when switching from a low-priority audio application to a high-priority audio application.

Exemplarily, the audio application 1 may be a music application, and the audio application 2 may be an instant messaging application. The priority of music applications is lower than that of instant messaging applications. The instant messaging application has the function of voice chat or video chat.

Specifically, reference may be made to the relevant descriptions in FIGS. 1A-1C , the electronic device 10 plays music through a music application, and the electronic device 100 displays a user interface 1001 of the music application on the desktop.

Afterwards, as shown in FIG. 8A, during the electronic device 100 playing music, the electronic device 100 receives a voice call request sent by other electronic devices, and the electronic device 100 receives the user's input operation on the receiving control 1004 in the prompt bar 1003 ( For example, click), the electronic device 100 establishes a voice call connection with the electronic device used by the contact "Lily". After the electronic device 100 establishes a voice call connection with the electronic device used by the contact "Lily", since the priority of instant messaging applications is higher than that of music applications, in order to control only one audio output at the same time, the electronic device The 100 will control low-priority applications to suspend playing audio, that is, the electronic device 100 controls the music application to suspend playing audio.

As shown in FIG. 8B , after the electronic device 100 controls the music application to pause playing audio, the electronic device 100 displays the display form of the pause/play control 1002 in the user interface 1001 as a paused state. At the same time, the electronic device 100 displays the voice call user interface 1006, and the electronic device 100 controls the instant messaging application to play the voice of the contact "Lily".

After the electronic device 100 finishes establishing a voice call connection with the electronic device used by the contact "Lily", the electronic device 100 stops displaying the voice call user interface 1006, and the electronic device 100 still displays the user interface 1001 on the desktop, and the electronic device 100 will The display form of the pause/play control 1002 in the user interface 1001 is displayed as a playing state, that is, after the voice call is ended, if the electronic device 100 previously caused the music application to pause playing the audio due to the playback priority policy, rather than the user actively If the trigger operation causes the music application to pause playing audio, the electronic device 100 can automatically continue playing the audio in the music application.

9A-9C exemplarily show how the electronic device 100 outputs audio when switching from a high-priority audio application to a low-priority audio application.

Exemplarily, the audio application 1 may be an instant messaging application, and the audio application 2 may be a music application. The priority of music applications is lower than that of instant messaging applications.

Specifically, as shown in FIG. 9A , with specific reference to the description in FIG. 1D-FIG. 1E , the electronic device 100 first establishes a voice call connection with the electronic device used by the contact "Lily", and displays the message shown in FIG. 9A on the desktop. The voice call user interface 1006 shown.

Later, when the user is in the process of making a voice call with the contact "Lily", the user wants to play music through the music application. As shown in FIG. 9B , with specific reference to the description in FIGS. 1A-1B , the electronic device 100 displays the user interface 1001 of the music application as shown in FIG. 9B on the desktop.

As shown in Figure 9B, the electronic device 100 receives the user's input operation (for example, click) on the pause/play control 1002 in the user interface 1001, and in response to the user's input operation, the electronic device 100 displays on the desktop as shown in Figure 9C The prompt bar 901 of the music application. The prompt content in the prompt bar 901 can be "before playing music, please end the ongoing voice call first", and the prompt content in the prompt bar 901 can also be "the current ongoing voice call cannot play music" and so on. In this way, when switching from a high-priority audio application to a low-priority audio application, the electronic device 100 can output a prompt message to prevent the electronic device 100 from directly switching to a low-priority audio application to play audio, and the application user experience.

10A-10C exemplarily show how the electronic device 100 outputs audio when audio applications of the same priority are switched.

Exemplarily, the audio application 1 may be a music application, and the audio application 2 may be a video application. Music apps have the same priority as video apps.

Specifically, as shown in FIG. 10A , reference may be made to related descriptions in FIGS. 1A-1C , the electronic device 10 plays music through a music application. The electronic device 100 displays a user interface 1001 of a music application as shown in FIG. 10A on the desktop.

Afterwards, when the user wants to play a video through the video application, the electronic device 100 receives the user's input operation (for example, double-click) on the video icon on the desktop, and the electronic device 100 displays the main user interface 1101 of the video application as shown in FIG. 10B . The main user interface 1101 includes icons of multiple videos, such as the icon 1102 of Video A.

As shown in FIG. 10B , the electronic device 100 receives the user's input operation on the icon 1102 , and the electronic device 100 will display the playback interface of the video A. Since the priority of the music application is the same as that of the video application, as shown in FIG. 10C , the electronic device 100 can directly control the music application to pause playing music. The display form of the pause/play control 1002 in the user interface 1001 is displayed as a paused state. At the same time, the electronic device 100 displays a video playback interface 1103 of the video A, and the video playback interface 1103 may include a playback control, a previous episode control, a next episode control, a collection control, and the like. While the electronic device 100 displays the video playing interface 1103 , the electronic device 100 controls the video application to play the audio in the video A.

Optionally, after the electronic device 100 finishes playing the video by the video application, if the electronic device 100 previously made the music application pause playing the audio due to the playback priority policy, rather than the user actively triggering an operation to make the music application pause playing the audio, the electronic device 100 The audio in the music application can be played automatically, and the electronic device 100 displays the display form of the pause/play control 1002 in the user interface 1001 as a playing state, that is, after the video is played, the electronic device 100 can automatically continue to play the music Audio in the app.

Optionally, if the two applications with the same priority are two different real-time voice/real-time video applications, first, the electronic device 100 makes a voice call with the contact through the real-time voice/real-time video application one, and then, the real-time voice/real-time video The contact person of the second real-time video application also initiates a voice call request to the user. For a voice call with a contact in real-time video application 1, a prompt message is first output, which is used to remind the user that after accepting the voice call request from a contact in real-time voice/real-time video application 2, the communication with the real-time voice /Real-time video application one and contact one voice call. In this way, when switching between two real-time voice/real-time video applications, the electronic device 100 can output prompt information, prompting whether to switch the voice call, which improves user experience.

In the case that the electronic device 100 does not prioritize the audio-type applications in the electronic device 100, it determines whether to switch based on the playing time. That is to say, the priority of the audio played later is always higher than that of the audio played before. In the case of switching between non-real-time voice/real-time video applications, the electronic device 100 may directly switch. When it is necessary to switch the real-time audio/real-time video application to another audio application, the electronic device 100 may output a prompt message, so as to avoid sudden switching of the voice call and affect user experience.

As shown in FIG. 11 , FIG. 11 exemplarily shows another timing diagram for playing multiple channels of audio at the same time provided by the embodiment of the present application.

And the embodiment of the application is described by taking the switching from playing audio by a low-priority application to playing audio by a high-priority application as an example.

Exemplarily, the low-priority application may be a music application, and the high-priority application may be a real-time voice/real-time video application.

In FIG. 11, at 0 ms, the electronic device 100 receives the user's operation and starts to play the song in the music application. After a period of time (for example, 360 ms), the electronic device 100 receives the user's operation and accesses the electronic device sent by the contact "Lily". voice calls. As shown in FIG. 11 , after the electronic device 100 establishes a voice call connection with the electronic device used by the contact "Lily", the electronic device 100 can play the voice of the contact "Lily", and at the same time, the electronic device 100 pauses playing music in the application. song. For example, if the call duration is 480ms, then when the electronic device 100 plays the voice of the contact "Lily" within 0ms-480ms, the electronic device 100 pauses playing the songs in the music application. That is to say, when the electronic device 100 is playing the audio in the high-priority application, it will pause the audio in the low-priority application, so as to prevent the user from hearing the sound mixing effect caused by multiple channels of audio playing at the same time. After the voice call in the real-time voice/real-time video application lasts for 480ms, for example, at 840ms, the voice call ends, and the electronic device 100 pauses playing the real-time voice in the call application. The electronic device 100 continues to play the songs in the music application.

From the above analysis, it can be known that when the electronic device 100 is playing multiple channels of audio, when the electronic device 100 is playing audio in a high-priority application, it will pause playing the audio in a low-priority application, so as to avoid the simultaneous playback of multiple channels of audio and cause the user What you hear is the mixing effect. For example, while the user is listening to music or watching a movie, the user accesses a voice call through the electronic device 100 . When the user is in the process of making a voice call, the music or movie is paused, and after the voice call is over, the music or movie continues to play, which prevents the user from missing nice music clips or wonderful movie clips during the voice call, and improves the user experience. experience.

As shown in FIG. 12 , FIG. 12 exemplarily shows a schematic flowchart of an audio playback method provided by an embodiment of the present application.

S1201. The electronic device 100 plays a first audio file in a first application, and acquires a playing process number of the first application and a process number of a window displayed by the electronic device.

S1202. The electronic device receives a first operation of the user, where the first operation is used to control the second application to play the second audio file.

Optionally, the first application may be the audio application 1 (such as a music application) introduced in the foregoing embodiments. The playing process number of the first application may be the process number one of the audio application 1 introduced in the foregoing embodiments.

The first operation may be an input operation (eg, click) on the receiving control 1004 in FIG. 8A . The second application may be the audio application 2 (such as an instant messaging application) introduced in the foregoing embodiments.

Optionally, the first application may also be the audio application 2 (such as an instant messaging application) introduced in the foregoing embodiments. The playback process number of the first application may be the process number two of the audio application 2 described in the foregoing embodiments.

The first operation may be an input operation (eg, click) on the pause/play control 1002 in FIG. 9B . The second application may be the audio application 1 (such as a music application) introduced in the foregoing embodiments.

Optionally, the first application may also be the audio application 1 (such as a music application) introduced in the foregoing embodiments. The playing process number of the first application may be the process number one of the audio application 1 introduced in the foregoing embodiments.

The first operation may be an input operation for the icon 1102 in 10B. The second application may be the audio application 2 (such as a video application) introduced in the foregoing embodiments.

S1203. In response to the first operation, the electronic device determines, from the windows displayed by the electronic device, a target window whose process ID is the playing process ID of the first application.

In response to the first operation, the electronic device determines, from the windows displayed by the electronic device, the target window whose process number is the playing process number of the first application, specifically including: in response to the first operation, the electronic device determines, based on the priority of the first application and The priority of the second application determines the target window whose process number is the playback process number of the first application from the windows displayed on the electronic device. In this way, the electronic device can automatically control the application to pause and play audio based on the preset application priority.

Based on the priority of the first application and the priority of the second application, the electronic device determines from the windows displayed on the electronic device the target window whose process number is the playback process number of the first application, specifically including: If the priority is lower than that of the second application, the electronic device determines the target window whose process number is the playing process number of the first application from the windows displayed on the electronic device.

If the priority of the first application is higher than that of the second application, the electronic device continues to play the first audio file in the first application, and does not play the second audio file in the second application.

When the priority of the first application is the same as that of the second application, the electronic device outputs first prompt information, and the first prompt information is used to prompt the user to pause the playback before playing the second audio file in the second application A first audio file in a first application. In this way, the user may be prompted to pause playing the first audio file in the first application.

Optionally, in response to the first operation, the electronic device determines, from the windows displayed by the electronic device, the target window whose process number is the playing process number of the first application, which specifically includes: in response to the first operation, the electronic device determines, based on the first audio The type of the file and the type of the second audio file determine the target window whose process number is the playing process number of the first application from the windows displayed on the electronic device. In this way, the electronic device can also automatically control the application to pause playing audio based on the type of the audio file played in the application.

Optionally, the electronic device may also determine from the window displayed by the electronic device that the process number is the first based on the priority of the first application and the priority of the second application, the type of the first audio file, and the type of the second audio file. The target window of the application's playback process ID. In this way, the electronic device can also automatically control the application to pause and play audio based on the preset priority of the application and the type of the audio file played in the application.

Based on the type of the first audio file and the type of the second audio file, the electronic device determines from the windows displayed on the electronic device the target window whose process number is the playback process number of the first application, specifically including: If the second audio file is a non-real-time audio file and the type of the second audio file is a real-time audio file, the electronic device determines the target window whose process ID is the playback process ID of the first application from the windows displayed on the electronic device. In other words, real-time audio files have the highest priority.

Before the electronic device controls the playing process of the first application corresponding to the target window to stop playing the first audio file, the method further includes: when the type of the first audio file is a real-time audio file, the electronic device outputs second prompt information, The second prompt information is used to instruct the user to pause playing the first audio file of the first application; the electronic device controls the playback process of the first application corresponding to the target window to stop playing the first audio file, and controls the second application to play the second audio file, Specifically, the electronic device receives the user's second operation, and in response to the second operation, the electronic device controls the playing process of the first application corresponding to the target window to pause playing the first audio file, and controls the second application to play the second audio file. In this way, since the real-time audio file has the highest priority, the electronic device can avoid switching the real-time audio file to a non-real-time audio file, thereby affecting user experience.

S1204. The electronic device controls the playing process of the first application corresponding to the target window to pause playing the first audio file, and controls the second application to play the second audio file.

Optionally, the electronic device controls the playback process of the first application corresponding to the target window to pause the playback of the first audio file, specifically including: the electronic device obtains the identifier of the target window, and simulates a virtual space key value; the electronic device will The identification of the target window and the virtual space key value are sent to the playback process of the first application; the electronic device controls the first application to pause the playback of the first application based on the identification of the target window and the virtual space key value through the playback process of the first application corresponding to the target window an audio file. In this way, the electronic device simulates a virtual space key value, and the user does not need to operate the space key on the keyboard to obtain the space key value, which reduces user operations.

Optionally, the electronic device controls the playing process of the first application corresponding to the target window to stop playing the first audio file, which specifically includes: the electronic device sequentially traverses each parent window displayed in the electronic device, and determines that the process number is the first application's The target parent window of the playback process number; the electronic device controls the playback process of the first application corresponding to the target parent window to stop playing the first audio file; or, the electronic device traverses each parent window in the electronic device in turn, and determines that the process number is the first The target parent window of the playback process number of an application; in the case that the electronic device fails to control the playback process of the first application corresponding to the target parent window to stop playing the first audio file, the electronic device traverses in turn each parent window associated with the electronic device display For each sub-window of each sub-window, obtain the target sub-window whose process ID is the playback process ID, or, the electronic device sequentially traverses each sub-window associated with the target parent window displayed by the electronic device, and acquires the target sub-window whose process ID is the playback process ID Window: the electronic device controls the playing process of the first application corresponding to the target sub-window to stop playing the first audio file. In this way, the electronic device first judges whether the target parent window can pause and play audio, and if so, it does not need to traverse the target sub-window, which saves the time for the electronic device to search for the target sub-window. If not, the electronic device traverses the target sub-window again.

Optionally, the electronic device controls the playing process of the first application corresponding to the target window to stop playing the first audio file, which specifically includes: the electronic device sequentially traverses each parent window displayed in the electronic device, and determines that the process number is the first application's The target parent window of the playback process number; the electronic device traverses each sub-window displayed in the electronic device in turn, and determines the target sub-window whose process number is the playback process number of the first application, or the electronic device traverses the target displayed by the electronic device in turn For each child window associated with the parent window, determine the target child window whose process number is the playing process number of the first application; the electronic device controls the playing process of the first application corresponding to the target parent window and the target child window to stop playing the first audio file . In this way, the window implementing the playing logic is either the target child window or the target parent window, and the electronic device can directly obtain the target parent window and the target child window, so that the control application agrees to play audio.

For how the electronic device determines the target window whose process number is the playing process number of the first application from the windows displayed by the sub-device, reference may be made to the embodiments shown in FIGS. 7A-7D . The embodiment of the present application will not be repeated here.

Optionally, after the electronic device starts to output the second audio file in the second application, the method further includes: the electronic device receives a third user operation, and the third operation is used to control the second application to pause playing the second audio file; responding In the third operation, the electronic device controls the second application to pause playing the second audio file, and controls the first application to continue playing the first audio file. In this way, the electronic device can control the application that pauses playing the audio due to the system device instead of the user actively triggering the operation to automatically start playing the audio again, which saves user operations.

Optionally, the electronic device receives a fourth user operation, and the fourth operation is used to control the first application to pause playing the first audio file; in response to the fourth operation, the electronic device controls the first application to pause playing the first audio file, and controls the first application The second application continues to pause and play the second audio file. In this way, the electronic device will not control the application that pauses to play the audio due to the active trigger operation of the user to automatically start playing the audio again, so as to avoid conflicts with the user's wishes.

The embodiment of the present application also provides an electronic device, the electronic device includes: one or more processors, one or more memories; one or more memories are coupled with one or more processors, and one or more memories are used for Computer program codes are stored, and the computer program codes include computer instructions, and one or more processors call the computer instructions to make the electronic device execute an audio playback method shown in FIG. 12 .

Various implementation modes of the present application can be combined arbitrarily to achieve different technical effects.

In the above embodiments, all or part of them may be implemented by software, hardware, firmware or any combination thereof. When implemented using software, it may be implemented in whole or in part in the form of a computer program product. A computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on the computer, the processes or functions according to the present application are generated in whole or in part. A computer can be a general purpose computer, special purpose computer, computer network, or other programmable device. Computer instructions may be stored in or transmitted from one computer-readable storage medium to another computer-readable storage medium, e.g. Coaxial cable, optical fiber, digital subscriber line) or wireless (such as infrared, wireless, microwave, etc.) to another website site, computer, server or data center. The computer-readable storage medium may be any available medium that can be accessed by a computer, or a data storage device such as a server, a data center, etc. integrated with one or more available media. The usable medium may be a magnetic medium (such as a floppy disk, a hard disk, or a magnetic tape), an optical medium (such as a DVD), or a semiconductor medium (such as a solid state disk (solid state disk, SSD)), etc.

Those of ordinary skill in the art can understand that all or part of the processes in the methods of the above embodiments are realized. The processes can be completed by computer programs to instruct related hardware. The programs can be stored in computer-readable storage media. When the programs are executed , may include the processes of the foregoing method embodiments. The aforementioned storage medium includes: ROM or random access memory RAM, magnetic disk or optical disk, and other various media that can store program codes.

In a word, the above are only examples of the technical solutions of the present invention, and are not intended to limit the protection scope of the present invention. All modifications, equivalent replacements, improvements, etc. made according to the disclosure of the present invention shall be included in the protection scope of the present invention.

Claims

An audio playback method, characterized in that the method comprises:

The electronic device plays the first audio file in the first application, and obtains the playing process number of the first application and the process number of the window displayed by the electronic device;

The electronic device receives a user's first operation, and the first operation is used to control the second application to play the second audio file;

In response to the first operation, the electronic device determines, from the windows displayed by the electronic device, a target window whose process number is the playback process number of the first application;

The electronic device controls the playing process of the first application corresponding to the target window to pause playing the first audio file, and controls the second application to play the second audio file.
The method according to claim 1, wherein the electronic device controls the playing process of the first application corresponding to the target window to pause playing the first audio file, specifically comprising:

The electronic device obtains the identification of the target window, and simulates a virtual space key space key value;

The electronic device sends the identity of the target window and the virtual space key value to the playback process of the first application;

The electronic device controls the first application to pause playing the first audio file based on the identifier of the target window and the virtual space key value through the playing process of the first application corresponding to the target window.
The method according to claim 1 or 2, wherein in response to the first operation, the electronic device determines that the process number is the playing of the first application from the window displayed by the electronic device The target window of the process ID, including:

In response to the first operation, based on the priority of the first application and the priority of the second application, the electronic device determines from a window displayed by the electronic device that the process number is the first application The playback process ID of the target window.
The method according to claim 3, wherein, based on the priority of the first application and the priority of the second application, the electronic device determines that the process number is The target window of the playback process number of the first application specifically includes:

When the priority of the first application is lower than the priority of the second application, the electronic device determines that the process number is the playback process number of the first application from a window displayed by the electronic device of the target window.
The method according to claim 4, characterized in that the method further comprises:

If the priority of the first application is higher than the priority of the second application, the electronic device continues to play the first audio file in the first application without playing the second application The second audio file in .
The method according to claim 4 or 5, characterized in that the method further comprises:

When the priority of the first application is the same as that of the second application, the electronic device outputs first prompt information, the first prompt information is used to prompt the user to play the second application Before the second audio file in the application, pause playing the first audio file in the first application.
The method according to claim 1 or 2, wherein in response to the first operation, the electronic device determines that the process number is the playing of the first application from the window displayed by the electronic device The target window of the process ID, including:

In response to the first operation, based on the type of the first audio file and the type of the second audio file, the electronic device determines from a window displayed by the electronic device that the process number is the first application The target window of the playback process ID.
The method according to claim 7, wherein, based on the type of the first audio file and the type of the second audio file, the electronic device determines that the process number is The target window of the playback process number of the first application specifically includes:

In the case where the type of the first audio file is a non-real-time audio file and the type of the second audio file is a real-time audio file, the electronic device determines the process number from the window displayed by the electronic device It is the target window of the playing process number of the first application.
The method according to claim 7 or 8, wherein before the electronic device controls the playing process of the first application corresponding to the target window to stop playing the first audio file, the method further comprises :

When the type of the first audio file is a real-time audio file, the electronic device outputs second prompt information, and the second prompt information is used to instruct the user to pause playing the first audio file of the first application. audio files;

The electronic device controls the playing process of the first application corresponding to the target window to stop playing the first audio file, and controls the second application to play the second audio file, specifically including:

The electronic device receives the user's second operation, and in response to the second operation, the electronic device controls the playing process of the first application corresponding to the target window to pause playing the first audio file, and controls all The second application plays the second audio file.
The method according to any one of claims 1-9, wherein the electronic device controls the playing process of the first application corresponding to the target window to stop playing the first audio file, specifically comprising:

The electronic device sequentially traverses each parent window displayed in the electronic device, and determines the target parent window whose process number is the playing process number of the first application;

The electronic device controls the playing process of the first application corresponding to the target parent window to stop playing the first audio file;

or,

The electronic device sequentially traverses each parent window in the electronic device, and determines a target parent window whose process number is the playback process number of the first application;

When the electronic device fails to control the playing process of the first application corresponding to the target parent window to stop playing the first audio file, the electronic device sequentially traverses each parent window displayed by the electronic device For each associated sub-window, obtain the target sub-window whose process ID is the playback process ID;

The electronic device controls the playing process of the first application corresponding to the target sub-window to stop playing the first audio file.
The method according to any one of claims 1-9, wherein the electronic device controls the playing process of the first application corresponding to the target window to stop playing the first audio file, specifically comprising:

The electronic device sequentially traverses each parent window displayed in the electronic device, and determines the target parent window whose process number is the playing process number of the first application;

The electronic device sequentially traverses each sub-window displayed in the electronic device, and determines a target sub-window whose process number is the playing process number of the first application;

The electronic device controls the playing process of the first application corresponding to the target parent window and the target child window to stop playing the first audio file.
The method according to any one of claims 1-11, wherein after the electronic device starts to output the second audio file in the second application, the method further comprises:

The electronic device receives a third operation of the user, and the third operation is used to control the second application to pause playing the second audio file;

In response to the third operation, the electronic device controls the second application to pause playing the second audio file, and controls the first application to continue playing the first audio file.
An electronic device, characterized in that the electronic device includes: one or more processors, one or more memories; the one or more memories are coupled to the one or more processors, and the one or more A plurality of memories for storing computer program codes, the computer program codes comprising computer instructions, the one or more processors invoke the computer instructions to cause the electronic device to perform the electronic device described in any one of the preceding claims 1-12. described method.
A computer-readable storage medium for storing computer instructions, when the computer instructions are run on an electronic device, the electronic device is made to execute the method described in any one of claims 1-12 above.
A computer program product, characterized in that, when the computer program product is run on an electronic device, the electronic device is made to execute the method described in any one of claims 1-12.