WO2024037353A1

WO2024037353A1 - Application processing method and electronic device

Info

Publication number: WO2024037353A1
Application number: PCT/CN2023/111084
Authority: WO
Inventors: 陈明; 谢冰; 李自勉
Original assignee: 华为技术有限公司
Priority date: 2022-08-15
Filing date: 2023-08-03
Publication date: 2024-02-22
Also published as: CN117632452A

Abstract

Provided in the embodiments of the present application are an application processing method and an electronic device. The method comprises: when an application, which is run in the background, is playing audio, detecting whether the duration of an audio stream, which is cached in a buffer of an AudioFlinger, is greater than or equal to a first preset duration; and in response to the duration of the audio stream, which is cached in the buffer, being greater than or equal to the first preset duration, freezing the application, and when the application is frozen, the application continuing to play the audio. In the embodiments of the present application, for an application which can be perceived by a user when run in the background, freezing management can be performed without affecting the user experience, for example, the user can continue to listen to music.

Description

Application processing methods and electronic devices

This application claims priority to the Chinese patent application filed with the China Patent Office on August 15, 2022, with application number 202210972739.3 and application name "Application Processing Method and Electronic Device", the entire content of which is incorporated into this application by reference.

Technical field

The embodiments of the present application relate to the field of terminal technology, and in particular, to an application processing method and electronic device.

Background technique

More and more applications are installed on terminals, and the rich functions of applications can facilitate users' lives. When the application is running in the background, it will also occupy terminal resources, causing terminal resource shortage.

Currently, when some applications are running in the background, the terminal can freeze applications that have a running time longer than the preset time to reduce the usage of terminal resources. However, for applications that are perceptible to the user when running in the background, such as applications that play audio, applications that perform positioning and navigation, etc., although such applications are switched to the background by the user, they are still performing functions that are perceptible to the user, such as playing audio, positioning and navigation, etc. Therefore, in order to ensure user experience, the terminal will not freeze these applications, and these applications will still occupy terminal resources.

Therefore, there is an urgent need for a method of processing applications that are user-aware when running in the background.

Contents of the invention

Embodiments of the present application provide an application processing method and an electronic device, which can freeze applications that are perceptible to users when running in the background.

In the first aspect, embodiments of the present application provide an application processing method. The execution subject that executes the method may be a terminal or a chip in the terminal. The following description takes the terminal as an example. In this method, when the application running in the background is playing audio, the terminal detects whether the duration of the audio stream buffered in the buffer of AudioFlinger is greater than or equal to the first preset duration. In the embodiment of this application, compared with the buffer of AudioFlinger in the prior art, the capacity of the buffer of AudioFlinger can be increased. For example, the buffer of AudioFlinger in the prior art can cache 1k audio stream. In the embodiment of this application The AudioFlinger buffer can buffer 1M audio streams.

The terminal responds that the duration of the audio stream buffered in the buffer is greater than or equal to the first preset duration, indicating that enough audio streams have been buffered in the buffer to maintain playback for a period of time, so the terminal can freeze and run in the background. The application that is playing audio to reduce the application's occupation of terminal resources. When the application is frozen, the application can continue to play the audio based on the audio cached in the buffer. In this way, after the application is frozen, the user can still hear the audio played by the background application, and the user does not perceive that the background application has been frozen. .

In the embodiment of this application, for applications that are perceptible to users when running in the background, the terminal can perform freezing management to reduce the application's occupation of terminal resources. In addition, after the application is frozen, the user can continue to listen to the music played by the application. Affect user experience.

In one possible implementation, before the terminal detects whether the duration of the audio stream cached in the buffer of AudioFlinger is greater than or equal to the first preset duration, the terminal can also respond to the target event to detect whether the application running in the background is playing audio. , the target event is an event triggered by any of the following: application startup, interface switching, and terminal frame dropping. Wherein, the terminal may determine that the application is playing audio in response to the audio stream of the application being cached in the buffer. The terminal determines that the application does not play audio in response to the audio stream of the application being cached in the buffer.

The target event is an event with relatively high terminal load requirements, such as application startup and interface switching, or the target event is an event that indicates that the terminal is already under high load, such as terminal frame drop. In one example, the target event can be understood as: an event that will cause a high load on the terminal, or an event that can characterize a high load on the terminal. In the embodiment of this application, when the terminal detects the target event, the purpose of executing the application processing method provided by this application is to: reduce the load of the terminal, ensure the smooth operation of the terminal, and avoid problems such as application lags and crashes that affect the user experience. .

In a possible implementation, after freezing the application, the terminal may also perform a countdown, and the countdown time is a second preset time length, and the second preset time length is less than the first preset time length. The purpose of the terminal's countdown is to unfreeze the application before the audio stream cached in the cache is played, so that the application continues to cache the audio stream in the cache, so as to avoid the audio stream in the cache being played out and the user's perception of audio interruption.

When the countdown ends, the terminal unfreezes the application. Wherein, the duration of the countdown is a second preset duration, and the second preset duration is smaller than During the first preset duration, it is ensured that before the audio stream in the buffer is played, the application continues to buffer the audio stream in the buffer, thereby ensuring audio continuity.

In a possible implementation, the terminal detects whether the duration of the audio stream buffered in the buffer of AudioFlinger is greater than or equal to the first preset duration. If the duration of the audio stream buffered in the buffer is less than the first preset duration, The duration indicates that the audio stream cached in the cache will be played quickly. In order not to affect the user experience, the terminal does not need to freeze the application.

In addition, the terminal can detect whether the application is performing network positioning. The purpose of the terminal detecting whether the application is performing network positioning is to more comprehensively freeze and manage the applications running in the background. It should be understood that network positioning can be understood as base station positioning. The positioning accuracy of network positioning is low, that is, the terminal can accept lower positioning accuracy. Therefore, freezing the application for a period of time will not affect the user experience.

In this implementation manner, the terminal freezes the application in response to the application performing network positioning. After freezing the application, the terminal may perform a countdown, and the countdown duration is the third preset duration. Freezing applications on the terminal can reduce the application's occupation of terminal resources and reduce terminal load. The purpose of terminal countdown is to prevent applications from freezing for a long time, causing users to perceive that the application is not positioned, and to avoid affecting the user experience. At the end of the countdown, the terminal can unfreeze the application, and the application can continue to perform network positioning.

In a possible implementation, when the terminal detects whether the application is performing network positioning, if the application is not performing network positioning, the terminal may detect whether the terminal is absolutely stationary. The purpose of the terminal detecting whether the terminal is absolutely stationary is to more comprehensively freeze and manage applications running in the background. It should be understood that absolute stillness can be understood as: the position and attitude of the terminal have not changed.

When the terminal is absolutely stationary, the terminal can freeze the application to reduce the application's occupation of terminal resources. In this implementation, the terminal can unfreeze the application when detecting a change in the terminal's position or attitude.

The following describes the application processing method provided by the embodiment of the present application from the perspective of the internal modules included in the terminal. In one example, the terminal includes: a freezing module and a process management module.

Wherein, in response to the duration of the audio stream cached in the buffer being greater than or equal to the first preset duration, the freezing module writes the identifier of the process corresponding to the audio stream into the node, and the process is the application process. The process management module freezes the process in response to the identification of the process written in the node.

Correspondingly, when an application needs to be unfrozen, the freezing module writes the process of the application to be unfrozen into the node, and the process management module can unfreeze the process in response to writing the identifier of the process in the node.

In a possible implementation, the terminal further includes: Location, the Location is used to obtain the location of the terminal and feed it back to the freezing module.

Wherein, when the application is performing network positioning and the application is frozen, the freezing module responds to the location of the terminal from Location and does not send the location of the terminal to the application. In this way, the application cannot receive the terminal's location, so operations such as location updates will not be performed.

When the application is performing network positioning and the application is unfrozen, the freezing module responds to the location of the terminal from Location and sends the location of the terminal to the application. In this way, the application can receive the location of the terminal and continue to perform operations such as location update and playback location.

In a second aspect, embodiments of the present application provide an electronic device, which may include a processor and a memory. The memory is used to store computer-executable program code, and the program code includes instructions; when the processor executes the instructions, the instructions cause the electronic device to perform the method in the first aspect.

In a third aspect, embodiments of the present application provide a computer program product containing instructions that, when run on a computer, cause the computer to execute the method in the first aspect.

In a fourth aspect, embodiments of the present application provide a computer-readable storage medium that stores instructions that, when run on a computer, cause the computer to execute the method in the first aspect.

The beneficial effects of each possible implementation manner of the above-mentioned second aspect to the fourth aspect can be referred to the beneficial effects brought by the above-mentioned first aspect, and will not be described again here.

Description of drawings

Figure 1 is a schematic structural diagram of a terminal provided by an embodiment of the present application;

Figure 2 is a schematic flow chart of an embodiment of the application processing method provided by the embodiment of the present application;

Figure 3 is a schematic flowchart of another embodiment of the application processing method provided by the embodiment of the present application;

Figure 4 is a schematic flow chart of an application playing audio provided by an embodiment of the present application;

Figure 5 is a schematic flow chart of network positioning using an application provided by an embodiment of the present application;

Figure 6 is a schematic flowchart of another embodiment of the application processing method provided by the embodiment of the present application;

FIG. 7 is a schematic structural diagram of an electronic device provided by an embodiment of the present application.

Detailed ways

Definitions of professional terms involved in the embodiments of this application:

The application runs in the foreground: the terminal runs the application in the foreground, and the application process is the foreground process. When the application is running in the foreground, the terminal displays the application interface and the user can see the application interface. For example, if the application is a call application, running the call application in the foreground can be understood as: the terminal displays the call interface. Application running in the foreground can also be called: application running in the foreground.

The application runs in the background: The terminal runs the application in the background, and the application process is a background process. When an application is running in the background, the terminal can display the interface of other applications without displaying the interface of the application running in the background, that is, the user cannot see the interface of the application running in the background. Alternatively, the terminal can display a logo indicating that the application is running in the background on the interface of other applications. For example, when the calling application is running in the background, the terminal can display a card indicating "on a call" on the interface, and information such as the call duration can be displayed on the card. The card can be regarded as a symbol indicating that the calling application is running in the background. Application running in the background can also be called: application running in the background.

Process: Considered as an instance of a running program, each application runs in an independent process.

Freezing: The embodiment of this application refers to freezing the application process. Among them, freezing an application can also be understood as freezing an application's process.

Unfreeze: Unfreeze the frozen application process.

User-perceivable applications running in the background: including but not limited to applications that play audio and applications that perform positioning. For example, when an application that plays audio is running in the background, it will continue to play audio, and the user can hear the audio. Therefore, when the application that plays audio is running in the background, it is perceivable to the user. In another example, when the positioning application is running in the background, it will continue to locate the position of the terminal and play audio to notify the terminal's position. The user can perceive the position of the terminal. Therefore, when the positioning application is running in the background, it will continue to locate the position of the terminal. The user is aware.

The terminal in the embodiment of this application may be called user equipment (UE). For example, the terminal can be a mobile phone, a tablet (portable android device, PAD), a personal digital assistant (PDA), a handheld device with wireless communication capabilities, a computing device, a vehicle-mounted device or a wearable device, a virtual reality (virtual reality) reality (VR) terminal equipment, augmented reality (AR) terminal equipment, wireless terminals in industrial control (industrial control), terminals in smart home (smart home), etc. In the embodiments of this application, the form of the terminal does not matter. Make specific limitations.

Applications will occupy terminal resources when running in the foreground or background. Terminal resources may include but are not limited to: processor resources, memory resources, and input/output (I/O) resources in the terminal. When there are a large number of applications running on the terminal, the terminal will be under high load, which will lead to slow application response, even no response, crashes and other problems. The applications running in the foreground are applications required by the user. The terminal usually does not freeze the applications running in the foreground. Instead, it freezes the applications running in the background to reduce the occupation of terminal resources and reduce the load on the terminal.

It should be noted that in order to improve user experience, in the existing technical solution, the applications running in the background frozen by the terminal do not include applications that are perceptible to the user. Examples of user-perceivable applications include, but are not limited to: applications for playing audio and applications for positioning. In some examples, an application that is user-aware when running in the background may be referred to as a target application. Among them, when the target application is running in the background, if the terminal freezes the target application, the user can perceive that the terminal does not play audio, does not perform positioning (navigation), etc., resulting in a low user experience. Therefore, when the target application is currently running in the background, the terminal cannot The target application will be frozen.

In one embodiment, when the target application is running in the background, the main process of the target application can be bound to a service process, and the service process completes tasks such as audio playback and positioning.

In one embodiment, when the target application is running in the background, the terminal can increase the priority of the target application, and the terminal will freeze the low-priority application running in the background. Since the target application has a high priority, the terminal will not Freeze the target application. In one embodiment, the processing rules when the application is running in the background can be preset, and the processing rules when the target application is running in the background can be: do not freeze. In this embodiment, when the target application is running in the background, the terminal does not freeze the target application according to the processing rules when the target application is running in the background.

In order to improve user experience, the above two implementation methods adopt different methods and do not freeze the target application running in the background. Target applications running in the background will also occupy terminal resources, causing high load on the terminal.

In view of this, embodiments of the present application provide an application processing method that can freeze and unfreeze applications that are perceivable to users when running in the background, so as to reduce terminal resources occupied by applications perceivable to users when running in the background and reduce terminal load. .

Before introducing the application processing method provided by the embodiment of the present application, the structure of the terminal provided by the embodiment of the present application is first introduced:

Figure 1 is a schematic structural diagram of a terminal provided by an embodiment of the present application. Referring to Figure 1, the terminal software system can adopt a layered architecture. The layered architecture divides the terminal software system into several layers. Each layer has a clear role and division of labor, and the layers communicate through software interfaces. In some examples, the software system can be divided into five layers, namely application layer, application framework layer, Android runtime and system library, and hardware abstract layer. , HAL) and the kernel layer (kernel). The embodiments of the present application do not limit the layering of the software structure of the terminal.

It should be understood that Figure 1 shows the application layer, application framework layer, hardware abstraction layer, and kernel layer involved in the embodiment of the present application. The modules included in each layer shown in Figure 1 are modules involved in the embodiments of the present application. The modules included in the following layers do not limit the structure of the terminal, nor does the level of module deployment. Limitations on the structure of the terminal. In some examples, the modules shown in Figure 1 can be deployed individually, or several modules can be deployed together, the division of modules in Figure 1 being one example.

The application layer can include a series of application packages. The application layer runs applications by calling the application programming interface (API) provided by the application framework layer. As shown in Figure 1, the application package may include: target application, AudioTrack.

The target application is a user-aware application running in the background. Examples of target applications include but are not limited to: applications that play audio and applications that perform positioning. Examples of applications that play audio may include, but are not limited to: audio applications, social applications, navigation applications, and video applications. Applications for positioning may include, but are not limited to: audio applications, social applications, and navigation applications. Figure 1 takes the target application including audio application and navigation application as an example for illustration.

Taking an audio application as an example, an audio application can create an AudioTrack instance when playing audio. AudioTrack, used to be called by audio applications to decode audio data. In some examples, audio applications can call AudioTrack to decode audio data and obtain audio streams in pulse code modulation (PCM) format.

The application framework layer provides APIs and programming frameworks for applications in the application layer. The application framework layer includes some predefined functions. As shown in Figure 1, the application framework layer can include: AudioFlinger, Location, freezing module, event transmission module, and front and back management modules. Among them, AudioFlinger can be regarded as a module that provides audio processing services, and Location can be regarded as a module that provides positioning services.

AudioFlinger, the executor of the audio strategy, is responsible for the transmission of audio streams. A buffer can be set up in AudioFlinger, and the buffer is used to cache the audio stream.

Location, used to provide the location of the terminal to the target application.

A freezing module is used to detect whether the target application meets the freezing conditions, to freeze the target application when the target application meets the freezing conditions, and to detect whether the target application meets the unfreezing conditions to unfreeze the target application when the target application meets the unfreezing conditions.

The event transmission module is used to send events to the freezing module to trigger the freezing module to detect whether the target application meets the freezing conditions.

The front and back management module is used to detect whether the target application is running in the foreground or the background. When the target application is running in the background, the information that the target application is running in the background can be synchronized to the freezing module.

The hardware abstraction layer can include multiple library modules. The library modules can be, for example, camera library modules, motor library modules, and speaker library modules. The application framework layer can achieve the purpose of the application framework layer accessing the device hardware by calling the corresponding library module in the hardware abstraction layer. Device hardware may include motors, cameras, speakers, etc. in electronic devices.

As shown in Figure 1, the hardware abstraction layer may include AudioHAL.

Among them, AudioFlinger can access the audio hardware to play audio by calling AudioHAL. Audio hardware such as speakers, etc.

The kernel layer is the layer between hardware and software. The kernel layer is used to drive the hardware and make the hardware work. The kernel layer at least includes a display driver, a camera driver, an audio driver, etc., which are not limited in the embodiments of this application. As shown in Figure 1, the kernel layer includes: process management module and audio driver.

The process management module is used to manage the process of the target application. For example, the process management module can freeze or unfreeze the process of the target application.

Audio driver, used to drive audio hardware.

It should be understood that the functions of the modules at each level of the terminal are briefly described above. For specific functions, please refer to the relevant descriptions in Figure 6 .

The application processing method provided by the embodiment of the present application will be described below with reference to specific embodiments. The following embodiments can be combined with each other, and the same or similar concepts or processes will not be described again in some embodiments.

FIG. 2 is a schematic flowchart of an embodiment of the application processing method provided by the embodiment of the present application. Referring to Figure 2, the application processing method provided by the embodiment of the present application may include:

S201, detect whether the application running in the background is playing audio. If yes, execute S202; if not, execute S206.

Applications can run in the foreground or background, and the terminal can determine whether the application is running in the foreground or background. For example, when the application is running in the foreground, the identification of the application's process is marked as running in the foreground, and when the application is running in the background, the identification of the application's process is marked as running in the background. The terminal can determine whether the application is running in the foreground or background based on the process identifier.

In some examples, the identifier of the application's process may be the application's process number. For example, when the audio application is running in the background, the process number of the audio application is marked as running in the background. When the navigation application is running in the background, the process number of the navigation application is marked as running in the background. For example, if both the audio application and the navigation application are running in the background, and the process number of the audio application is process 1, and the process number of the navigation application is process 2, then process 1 and process 2 are marked as running in the background, and the terminal can be marked as running in the background according to process 1. , Process 2 is marked as running in the background, and it is determined that audio applications and navigation applications are running in the background.

In one embodiment, the terminal can detect in real time whether an application running in the background is playing audio.

In one embodiment, the terminal may respond to the target event and detect whether an application running in the background is playing audio to reduce the terminal load. Among them, the target event may include but is not limited to: starting an application, switching interfaces, or sliding to drop frames, etc. In other words, in response to detecting that the terminal starts an application, switches interfaces, or slides to drop frames, the terminal can detect whether the application running in the background is playing audio.

It should be understood that the reason why the terminal responds to the target event and detects whether the application running in the background is playing audio is because: starting an application or switching interfaces requires relatively high terminal load. The occurrence of the target event will increase the terminal load, which is characterized by sliding frames. The terminal load is already high. In order to ensure the user experience and avoid the problem of application lagging due to high terminal load, the terminal can detect whether the application running in the background is playing audio when detecting the target event, which can trigger the terminal to freeze the application running in the background. Applications that play audio can reduce the occupation of the terminal load by playing audio running in the background and reduce the terminal load.

Among them, the terminal starting an application can be understood as: the terminal creates an application process and starts the application process to start the application. For example, when the application is not started, the user clicks the application icon on the desktop of the terminal to trigger the terminal to start the application.

Switching the interface can be understood as: the interface of the terminal changes.

Terminal frame drop can be understood as: when the terminal draws picture frames, the number of picture frames drawn is less than the number of picture frames corresponding to the refresh rate of the terminal, which in turn causes the number of picture frames displayed by the terminal to decrease, and even causes the terminal interface to freeze. Dayton's question. For example, taking the refresh rate of the terminal as 60Hz as an example, the terminal can display 60 frames per second, that is, one frame is displayed every 16.6ms. However, when the terminal draws frames, the number of frames drawn is less than 60. frames, only 30 frames are drawn, resulting in fewer frames displayed on the terminal, that is, the terminal drops frames. Sliding frame drop is one of the terminal frame drops. Sliding frame drop can be understood as: interface frame drop that occurs when the user performs a sliding operation on the terminal interface. Terminal frame drops may also include click frame drops, frame drops when any interface changes, etc. In some examples, the target event may include terminal frame drops.

When an application plays audio, the application can call AudioTrack to decode the audio data and obtain the audio stream. The audio data may be locally stored audio data, or audio data downloaded from the server by the application, which is not limited in the embodiment of the present application. The application can transmit the decoded audio stream to AudioFlinger, and AudioFlinger can cache the received audio stream in AudioFlinger's buffer for playback. Among them, AudioFlinger can cache the audio stream, read the audio stream in the buffer, call the Audio HAL of the hardware abstraction layer, and control the audio hardware to play audio.

The terminal can detect whether there is an audio stream cached in the buffer to detect whether the application running in the background is playing audio. Among them, when there is an audio stream cached in the buffer, the terminal can determine that there is an application in the terminal that is playing the audio, but it cannot determine whether the application running in the foreground is playing the audio or the application running in the background is playing the audio.

It should be noted that when the application transmits the decoded audio stream to AudioFlinger, it can also send the identifier of the process corresponding to the audio stream to AudioFlinger. The terminal can determine that it is running in the foreground based on the identifier of the process corresponding to the audio stream cached in the buffer. The application plays audio, or the application running in the background plays audio. In other words, the terminal can determine whether the application running in the background is playing audio. Among them, when the identifier of the process corresponding to the audio stream cached in the buffer is the process identifier of the application running in the foreground, the terminal can determine that the application running in the foreground is playing audio. When the identifier of the process corresponding to the audio stream cached in the buffer is the process identifier of the application running in the foreground, When identifying the process of a running application, the terminal can determine that the application running in the background is playing audio.

For example, when the identifier of the process corresponding to the audio stream buffered in the buffer is process 1, the terminal can determine that process 1 is marked as running in the background, so that the terminal can determine that the application running in the background is playing audio.

S202: Detect whether the duration of the audio stream buffered in AudioFlinger's buffer is greater than or equal to the first preset duration. If yes, execute S203, if not, execute S206.

In the embodiment of this application, the size of the buffer of AudioFlinger is increased. The size of the buffer can be understood as the amount of data that the buffer can accommodate for the audio stream. For example, in the prior art, the buffer size of AudioFlinger is 20K. In the embodiment of this application, the buffer size of AudioFlinger can be expanded to 1M, that is, the buffer size is increased to 1M, so that AudioFlinger can cache more audio streams.

The terminal can detect whether the duration of the audio stream buffered in AudioFlinger's buffer is greater than or equal to the first preset duration. For example, the first preset time period may be 10 seconds. In one example, when the application sends the decoded audio stream to AudioFlinger, it can also carry the timestamp of the audio stream. The terminal can determine the duration of the audio stream buffered in AudioFlinger's buffer based on the timestamp of the audio stream buffered in AudioFlinger's buffer to detect whether the duration of the audio stream buffered in AudioFlinger's buffer is greater than or equal to the first preset duration. For example, the terminal can subtract the earliest timestamp from the latest timestamp of the audio stream buffered in the buffer to obtain the duration of the audio stream buffered in the buffer.

Among them, when the duration of the audio stream cached in the buffer is greater than or equal to the first preset duration, it means that enough audio streams have been cached in the buffer, and freezing applications running in the background for a short time will not affect audio playback, and the terminal can play The audio stream has been cached in the buffer. Therefore, when the duration of the audio stream cached in the buffer is greater than or equal to the first preset duration, the terminal can freeze the application running in the background that is playing audio. When the duration of the audio stream cached in the buffer is less than the first preset duration, it means that there are fewer audio streams cached in the buffer. If the application running in the background is frozen, the audio stream cached in the buffer will be played out soon, and the user will perceive Audio playback is interrupted. In order not to affect the user experience, when the duration of the audio stream cached in the buffer is less than the first preset duration, the terminal may not freeze the application running in the background that is playing audio.

S203, freeze the application.

Application refers to the application that is playing audio in the background. Terminal freezing application can be understood as: terminal freezing application process. For example, taking the application as an audio application, when the audio application is running in the background and playing audio, if the terminal detects that the duration of the audio stream buffered in AudioFlinger's buffer is greater than or equal to the first preset duration, the terminal You can freeze the process of audio applications 1. After process 1 of the audio application is frozen, the audio application will not call AudioTrack to decode audio data, nor will it transmit the decoded audio stream to AudioFlinger.

It should be noted that in the embodiment of this application, because the size of AudioFlinger's buffer is increased, after the application that plays audio is frozen, the audio stream is still cached in AudioFlinger's buffer, so AudioFlinger can continue to read the audio in the buffer. Stream, call the Audio HAL of the hardware abstraction layer, and control the audio hardware to play audio. In other words, after the application that plays audio is frozen, the terminal can still play audio, that is, the user perceives that the audio has not stopped playing. It should be understood that after the application that plays audio is frozen, the application that plays audio will not occupy terminal resources, so the terminal load can be reduced.

S204, perform a countdown, and the countdown duration is the second preset duration.

In order to ensure that the user perceives that the audio played by the application in the background is not interrupted, the terminal can count down after freezing the application so that the application can be unfrozen before the audio stream buffered in the AudioFlinger buffer is played. In this way, the application can continue to call AudioTrack to decode the audio data and continue Transmit the decoded audio stream to AudioFlinger to ensure that the application continues to play audio in the background, so that the user can perceive uninterrupted audio playback and improve the user experience. It should be understood that the starting point for the terminal to countdown may be the moment when the terminal completes freezing the application.

Among them, in order to unfreeze the application before the audio stream buffered in the AudioFlinger buffer is played, the terminal countdown time is the second preset time, and the second preset time is shorter than the first preset time. For example, the first preset duration is 10s, and the second preset duration can be 9s, that is, the terminal can unfreeze the application when there is 1s left of the audio stream buffered in the buffer.

S205, when the countdown ends, unfreeze the application.

Unfreezing an application on the terminal can be understood as: the process of unfreezing the application. After the application is unfrozen, the application can continue to call AudioTrack to decode audio data and continue to transmit the decoded audio stream to AudioFlinger. AudioFlinger can also continue to cache the audio stream in the buffer and call the Audio HAL of the hardware abstraction layer to control the audio hardware to play audio.

In one embodiment, if the countdown has not ended yet, the terminal detects that the application running in the background switches to the foreground, and the terminal can also unfreeze the application. Alternatively, if the countdown has not ended yet, the terminal detects the identification of the application running in the background displayed on the user's operation terminal interface, and the terminal can also unfreeze the application. Or, if the countdown has not ended, the terminal detects that the user operates the volume button on the terminal to control the volume of the audio played by the application, or the terminal detects that the user operates the button on the headset connected to the terminal to control the audio played by the application ( Such as pause, next song, etc.), the terminal can also unfreeze the application.

S206: Detect whether the application running in the background is performing network positioning. If yes, execute S207; if not, execute S210.

In addition to playing audio while the app is running in the background, the app can also be positioned in the background. If the application performs positioning in the background, it can provide route navigation for the user, so that the user can also perceive that the application is positioning. In one embodiment, when the application running in the background does not play audio, or the duration of the audio stream buffered in AudioFlinger's buffer is less than the first preset duration, the terminal can continue to detect whether the application running in the background is performing network positioning, so that The terminal can more comprehensively determine the tasks performed by applications running in the background, determine whether to freeze applications running in the background, and ensure more accurate management of applications running in the background.

Currently commonly used positioning methods include: global positioning system (GPS) positioning and base station positioning. Network positioning can be understood as: base station positioning. When the application needs positioning, it can initiate a registration request to the Location. The registration request is used to instruct the Location to feed back the location of the terminal to the application when it detects a change in the location of the terminal. In some examples, the registration request may also include the application's positioning requirements, such as base station positioning. Among them, Location responds to the registration request and can use base station positioning to obtain the location of the terminal. When the location of the terminal changes, Location can call back the application interface and feedback the location of the terminal to the application.

In this example, the terminal can detect whether the application running in the background initiates a registration request for network positioning to Location to detect whether the application running in the background is performing network positioning. Among them, if the application running in the background has initiated a registration request for network positioning to Location, the terminal can determine that the application running in the background is performing network positioning. If the application running in the background has not initiated a registration request for network positioning to Location, the terminal can determine that the application running in the background has not initiated a registration request for network positioning to Location. The app is not network targeted.

Among them, the positioning accuracy of network positioning is low. When an application running in the background performs network positioning, it means that the application running in the background can receive lower positioning accuracy. Therefore, when the terminal detects that the application running in the background performs network positioning, the terminal can freeze. Applications running in the background have a low impact on positioning accuracy.

S207, freeze the application.

For the frozen application in S207, please refer to the relevant description in S203. In the embodiment of this application, after the application running in the background and performing network positioning is frozen, Location can call back the interface of the application when the location of the terminal changes and feedback the location of the terminal to the application. However, because the application is in a frozen state, the application Unable to receive the location of the terminal from Location.

S208, perform a countdown, and the countdown duration is the third preset duration.

The third preset time period and the second preset time period may be equal to or different from each other. For example, the third preset time length may be different from the second preset time length, for example, the third preset time length may be 1.5 seconds. It should be understood that the starting point for the terminal to countdown may be the moment when the terminal completes freezing the application.

S209, when the countdown ends, unfreeze the application.

For the unfreezing application in S209, please refer to the relevant description in S205. In the embodiment of this application, after the application running in the background and performing network positioning is unfrozen, the application can continue to receive the location of the terminal from Location, so as to update the location of the terminal in real time.

It should be understood that, for example, when the third preset duration can be 1.5s, the application is frozen within the 1.5s duration, and the application does not occupy terminal resources, which can reduce terminal load. In addition, because the application performs network positioning, that is, the application can accept lower-precision positioning, so the application does not update the terminal's location within 1.5 seconds, which will not affect the user experience.

S210, detect whether the terminal is absolutely stationary. If yes, execute S207; if not, execute S211.

The absolute rest of the terminal can be understood as: the position and posture of the terminal have not changed. In one embodiment, the terminal may detect whether the terminal's location changes based on the terminal's location from Location. In one embodiment, the terminal may include an acceleration sensor, a gyroscope, etc., and the terminal may detect the posture of the terminal based on the data collected by the acceleration sensor, gyroscope, etc., and further detect whether the posture of the terminal changes. Embodiments of the present application The process of the terminal obtaining the posture of the terminal will not be described in detail.

Among them, when neither the position nor the posture of the terminal changes, the terminal can determine that the terminal is absolutely stationary. When the terminal is absolutely stationary, the terminal does not need to update the location of the terminal. In this way, the terminal can freeze applications running in the background to reduce the resource usage of the terminal.

S211, no response.

When the position or posture of the terminal changes, the terminal determines that the terminal is not absolutely stationary, and the terminal can continue to use network positioning, that is, the terminal does not respond and does not freeze applications running in the background.

In the above embodiment, the terminal can determine whether to freeze applications running in the background based on user-perceivable tasks performed in the background of the terminal and corresponding freezing conditions, so as to reduce the occupation of terminal resources by applications running in the background. Among them, tasks that users can perceive include: playing audio, positioning, etc. In this embodiment, for user-perceivable applications running in the background, the above S201-S211 can be performed.

In summary, the application processing method provided by the embodiment of the present application is described below with reference to FIG. 3 . Referring to Figure 3, when the application is running in the foreground, the terminal does not freeze the application. When an application is switched to running in the background, for applications that the user is not aware of, the terminal can freeze the application when the application that the user is not aware of runs for a preset period of time. For applications that the user is aware of, the terminal can freeze the application on demand. Freezing on demand can It is understood that the terminal can freeze the application as described in S201-S211 above.

In one embodiment, the terminal can adaptively adjust the steps performed by the terminal for different types of user-perceivable applications running in the background, and can also achieve the purpose of reducing the amount of terminal resources occupied by applications running in the background. For example, a whitelist may be stored in the terminal. The whitelist includes identification of different types of user-perceivable applications and processing steps when the application is running in the background. The identification of an application may include but is not limited to: the name of the application, a picture, and other information used to distinguish the application.

For example, the applications stored in the whitelist may include: first type applications, second type applications, and third type applications. Among them, the first type of application only plays audio when running in the background, the second type of application only performs positioning when running in the background, and the third type of application can both play audio and perform positioning when running in the background. For example, the first type of applications includes audiobook applications, audio applications, and social networking applications, and the second type of applications includes city parking applications. The third type of application is a navigation application. When the navigation application is running in the background, it can position and play navigation audio.

In this embodiment, when the first type of application is running in the background, the terminal may perform S201-S205. Wherein, when the first type of application does not play audio in the background, even if the terminal freezes the application, the user will not notice it. Therefore, when the first type of application does not play audio in the background, the terminal can freeze the first type of application. Among them, when the first type of application plays audio in the background, if the terminal detects that the duration of the audio stream buffered in AudioFlinger's buffer is less than the first preset duration, it means that there are fewer audio streams buffered in the buffer, and the terminal does not need to freeze the first audio stream. A type of application so that AudioFlinger can continue to cache audio streams in the buffer to ensure continuous uninterrupted audio playback and improve user experience.

When the second type of application is running in the background, the terminal can execute S206-S211. When the third type of application is running in the background, the terminal can execute S201-S211. In this embodiment, for different types of user-perceivable applications running in the background, the terminal can perform different processing operations to detect whether the application meets the freezing conditions. When the application meets the freezing conditions, the terminal can freeze the application to reduce the impact of the application. Occupy terminal resources and reduce terminal load. In addition, in this embodiment, for the first type of application and the second type of application, the terminal can adaptively reduce processing operations and improve processing efficiency.

According to the application processing method provided by the embodiment of the present application, for an application running in the background and perceivable by the user, the terminal can detect whether the application meets the freezing conditions, and then freeze the application when the application running in the background and perceivable by the user meets the freezing conditions. It can reduce the usage of terminal resources by applications running in the background and visible to users. In addition, the terminal can also perform a countdown to unfreeze the application when the countdown ends, so that the audio playback is not interrupted, and the terminal can continue to update the terminal location without affecting the user experience.

The following describes the application processing method provided by the embodiment of the present application from the perspective of internal module interaction of the terminal in conjunction with the structure of the terminal shown in Figure 1 .

Referring to Figure 4, taking an application running in the background playing audio as an example, the application can download audio data from the server, and the application calls AudioTrack to decode the audio data and obtain the audio stream. Applications can stream audio to AudioFlinger. AudioFlinger caches the received audio stream in AudioFlinger's buffer, and calls the Audio HAL of the hardware abstraction layer to control the audio hardware to play audio.

Referring to Figure 5, taking an application running in the background performing network positioning as an example, the application can initiate a registration request to Location during positioning. Location can call back the application's interface when the terminal's location changes and feedback the terminal's location to the application. In the embodiment of this application, the freezing module can connect applications and locations. Among them, when the location of the terminal changes, Location calls back the application interface and feeds back the location of the terminal to the freezing module. When the application is in a frozen state, the freezing module may not feedback the location of the terminal to the application, that is, the application cannot receive the location of the terminal from Location. When the application is in the unfrozen state, the freezing module can feed back the location of the terminal from Location to the application, and the application can receive the location of the terminal.

Referring to Figure 6, the application processing method provided by the embodiment of the present application may include:

S601: The freezing module detects whether the application running in the background is playing audio. If yes, execute S602; if not, execute S608.

In one embodiment, the freezing module can detect in real time whether an application running in the background is playing audio.

In one embodiment, the freezing module may detect whether an application running in the background is playing audio in response to a target event from the event transmission module. For the target event, please refer to the relevant description in S201. For example, when it is detected that the terminal starts an application, switches interfaces, or slides to drop frames, etc., the event transmission module can send a target event to the freezing module. The freeze module responds to the target event and can detect whether an application running in the background is playing audio event transport module.

For the method of detecting whether the application running in the background is playing audio by the freezing module, please refer to the relevant description in S201.

S602. The freezing module detects whether the duration of the audio stream buffered in the buffer of AudioFlinger is greater than or equal to the first preset duration. If yes, execute S603; if not, execute S608.

S602 may refer to the relevant description in S202.

S603: The freezing module writes the identity of the process of the application running in the background into the node of the kernel layer.

When freezing an application running in the background, the freezing module can write the identity of the process of the application running in the background to a node in the kernel layer. For example, the freezing module can write the process ID of the application running in the background to the node of the kernel layer.

In one embodiment, the freezing module can also write a freezing identifier in the node to instruct the process management module to freeze the written process.

S604: The process management module freezes the process in response to the identification of the process written in the node.

The process management module can monitor the node, and can detect the status of the process in response to the identification of the process written in the node. The status of the process includes frozen status and unfrozen status. If the process management module detects that the process is in a thawed state, the process management module freezes the process in response to the identification of the process.

In one embodiment, when the freezing module also writes a frozen identification in the node, the process management module may freeze the process in response to the frozen identification written in the node and the identification of the process.

S605: The freezing module counts down, and the countdown time is the second preset time length.

S605 may refer to the relevant description in S204. There is no order distinction between S605 and S604, and both can be executed at the same time.

S606: When the countdown ends, the freezing module writes the identity of the process of the application running in the background into the node of the kernel layer.

In one embodiment, the freezing module can also write a defrosting identifier in the node to instruct the written process to be defrosted.

S607: The process management module responds to the identification of the process written in the node and unfreezes the process.

In one embodiment, the process management module can detect the status of the process in response to the identification of the process written in the node. If the process management module detects that the process is in a frozen state, the process management module responds to the identification of the process and unfreezes the process. .

In one embodiment, when the freezing module also writes the unfrozen identifier in the node, the process management module can unfreeze the process in response to the unfrozen identifier written in the node and the process identifier.

S608: The freezing module detects whether the application running in the background is performing network positioning. If yes, execute S609; if not, execute S616.

S608 may refer to the relevant description in S206.

S609: The freezing module writes the identity of the process of the application running in the background into the node of the kernel layer.

S610: The process management module freezes the process in response to the identification of the process written in the node.

For S609-S610, please refer to the relevant descriptions in S603-S604.

S611: The freezing module responds to receiving the location of the terminal from Location and does not feedback the location of the terminal to the application.

In the embodiment of the present application, referring to Figure 5, when the application running in the background is in a frozen state, the freezing module may not feed back the location of the terminal to the application when receiving the location of the terminal from Location.

S612, the freezing module counts down, and the countdown time is the third preset time length.

S612 may refer to the relevant description in S208. There is no order distinction between S610 and S609, and both can be executed at the same time.

S613. When the countdown ends, the freezing module writes the identity of the process of the application running in the background into the node of the kernel layer.

S614. The process management module responds to the identification of the process written in the node and unfreezes the process.

S613-S614 may refer to the relevant descriptions in S606-S607.

S615: The freezing module responds to receiving the location of the terminal from Location and feeds back the location of the terminal to the application.

Referring to Figure 5, when the application running in the background is in the unfrozen state, the freezing module can feedback the location of the terminal to the application when receiving the location of the terminal from Location. The application can update the location of the terminal based on the location of the terminal from the freezing module. .

S616: The freezing module detects whether the terminal is absolutely still. If yes, execute S609; if not, execute S617.

S616 may refer to the relevant description in S210.

S617, the frozen module does not respond.

When the position or attitude of the terminal changes, the freezing module determines that the terminal is not absolutely stationary and can continue to perform network positioning. The freezing module does not freeze applications running in the background.

In one embodiment, some of the steps shown in Figure 6 are optional steps, and the steps can be combined with each other. In one embodiment, the modules shown in Figure 6 can also be combined, and the combined modules are used for the steps performed by the modules.

In the embodiments of this application, the application processing method provided by the embodiments of this application is introduced from the perspective of internal module interaction of the terminal. In this method, freezing and thawing of applications running in the background and perceivable by the user can be realized. On the one hand, in the application freezing At the same time, it can reduce the application's occupation of terminal resources. On the other hand, it can also unfreeze the application in time without affecting the user experience.

In one embodiment, the embodiment of the present application further provides an electronic device, and the electronic device may be the terminal described in the above embodiment. Referring to FIG. 7 , the electronic device may include: a processor 701 (such as a CPU) and a memory 702 . The memory 702 may include high-speed random-access memory (RAM), and may also include non-volatile memory (non-volatile memory, NVM), such as at least one disk memory. Various instructions may be stored in the memory 702 , to complete various processing functions and implement the method steps of the present application.

Optionally, the electronic device involved in this application may also include: a power supply 703, a communication bus 704, and a communication port 705. The above-mentioned communication port 705 is used to realize connection and communication between the electronic device and other peripheral devices. In this embodiment of the present application, the memory 702 is used to store computer executable program code, and the program code includes instructions; when the processor 701 executes the instructions, the instructions cause the processor 701 of the electronic device to perform the actions in the above method embodiment, which implements The principles and technical effects are similar and will not be repeated here.

It should be noted that the modules or components described in the above embodiments may be one or more integrated circuits configured to implement the above methods, such as: one or more application specific integrated circuits (ASICs), or , one or more microprocessors (digital signal processor, DSP), or one or more field programmable gate arrays (field programmable gate array, FPGA), etc. For another example, when one of the above modules is implemented in the form of a processing element scheduler code, the processing element can be a general processor, such as a central processing unit (CPU) or other processors that can call the program code such as a control device. For another example, these modules can be integrated together and implemented in the form of a system-on-a-chip (SOC).

In the above embodiments, it may be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented using software, it may be implemented in whole or in part in the form of a computer program product. A computer program product includes one or more computer instructions. When computer program instructions are loaded and executed on a computer, processes or functions according to embodiments of the present application are generated in whole or in part. The computer may be a general purpose computer, a special purpose computer, a computer network, or other programmable device. Computer instructions may be stored in or transmitted from one computer-readable storage medium to another computer-readable storage medium, e.g., computer instructions may be transmitted from a website, computer, server or data center via a wired link (e.g. Coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (such as infrared, wireless, microwave, etc.) means to transmit to another website site, computer, server or data center. Computer-readable storage media can be any available media that can be accessed by a computer or a data storage device such as a server, data center, or other integrated media that contains one or more available media. Available media may be magnetic media (eg, floppy disk, hard disk, tape), optical media (eg, DVD), or semiconductor media (eg, Solid State Disk (SSD)), etc.

The term "plurality" as used herein means two or more. The term "and/or" in this article is just an association relationship that describes related objects, indicating that three relationships can exist. For example, A and/or B can mean: A exists alone, A and B exist simultaneously, and they exist alone. B these three situations. In addition, the character "/" in this article generally indicates that the related objects before and after are an "or" relationship; in the formula, the character "/" indicates that the related objects before and after are a "division" relationship. In addition, it should be understood that in the description of this application, words such as "first" and "second" are only used for the purpose of distinguishing the description, and cannot be understood as indicating or implying relative importance, nor can they be understood as indicating. Or suggestive order.

It can be understood that the various numerical numbers involved in the embodiments of the present application are only for convenience of description and are not used to limit the scope of the embodiments of the present application.

It can be understood that in the embodiments of the present application, the size of the sequence numbers of the above-mentioned processes does not mean the order of execution. The execution order of each process should be determined by its functions and internal logic, and should not be used in the implementation of the present application. The implementation of the examples does not constitute any limitations.

Claims

An application processing method, characterized in that it is applied to a terminal, and the method includes:

When the application running in the background is playing audio, detect whether the duration of the audio stream cached in the AudioFlinger buffer is greater than or equal to the first preset duration;

In response to the duration of the audio stream cached in the cache being greater than or equal to the first preset duration, the application is frozen, and when the application is frozen, the application continues to play audio.
The method according to claim 1, characterized in that after freezing the application, it further includes:

Perform a countdown, the duration of the countdown is a second preset duration, and the second preset duration is less than the first preset duration;

When the countdown ends, unfreeze the app.
The method according to claim 1 or 2, characterized in that, the method further includes:

In response to the duration of the audio stream buffered in the buffer being less than the first preset duration, detect whether the application is performing network positioning;

In response to the application performing network location, freezing the application;

Perform a countdown, the duration of the countdown being the third preset duration;

When the countdown ends, unfreeze the app.
The method of claim 3, further comprising:

In response to the application not performing network positioning, detect whether the terminal is absolutely stationary;

In response to the terminal being absolutely still, the application is frozen.
The method according to any one of claims 1 to 4, characterized in that before detecting whether the duration of the audio stream buffered in the buffer of AudioFlinger is greater than or equal to the first preset duration, it further includes:

In response to a target event, it is detected whether the application running in the background is playing audio. The target event is an event triggered by any of the following: application startup, interface switching, and terminal frame dropping.
The method of claim 5, wherein detecting whether an application running in the background is playing audio includes:

In response to the audio stream of the application being cached in the buffer, it is determined that the application is playing audio.
The method according to claim 3 or 4, characterized in that the terminal includes: a freezing module and a process management module;

In response to the duration of the audio stream cached in the cache being greater than or equal to the first preset duration, the freezing module writes the identifier of the process corresponding to the audio stream into the node, and the process is the application's process;

The process management module freezes the process in response to the identification of the process written in the node.
The method according to claim 7, characterized in that the terminal further includes: Location, the Location is used to obtain the location of the terminal and feed it back to the freezing module, the method further includes:

When the application is performing network positioning and the application is frozen, the freezing module responds to the location of the terminal from Location and does not send the location of the terminal to the application;

When the application is performing network positioning and the application is unfrozen, the freezing module responds to the location of the terminal from Location and sends the location of the terminal to the application.
An electronic device, characterized by including: a processor and a memory;

The memory stores computer instructions;

The processor executes computer instructions stored in the memory, so that the processor executes the method according to any one of claims 1-8.
A computer-readable storage medium, characterized in that computer programs or instructions are stored in the computer-readable storage medium. When the computer programs or instructions are run, the implementation of any one of claims 1-8 is achieved. method described.
A program product, characterized in that the program product includes a computer program, the computer program is stored in a readable storage medium, and at least one processor of the communication device can read the computer program from the readable storage medium , the at least one processor executes the computer program so that the communication device implements the method according to any one of claims 1-8.