CN113039524A

CN113039524A - Audio resource processing method and device, computer readable storage medium and electronic equipment

Info

Publication number: CN113039524A
Application number: CN201880098438.4A
Authority: CN
Inventors: 李亚军
Original assignee: Guangdong Oppo Mobile Telecommunications Corp Ltd; Shenzhen Huantai Technology Co Ltd
Current assignee: Guangdong Oppo Mobile Telecommunications Corp Ltd; Shenzhen Huantai Technology Co Ltd
Priority date: 2018-11-22
Filing date: 2018-11-22
Publication date: 2021-06-25
Also published as: WO2020103073A1

Abstract

An audio resource processing method and device, a computer-readable storage medium and an electronic device, wherein the audio resource processing method comprises the following steps: monitoring audio resources occupied by the running of a target application program; when the preset operation of the target application program is detected, monitoring whether the occupied audio resource is released or not; and when the occupied audio resources are not released, releasing the occupied audio resources.

Description

Audio resource processing method and device, computer readable storage medium and electronic equipment

Technical Field

The present application relates to the field of electronic device technologies, and in particular, to an audio resource processing method and apparatus, an electronic device, and a computer-readable storage medium.

Background

With the wide application of electronic devices and the increasing abundance of their functions, electronic devices have become an indispensable part of people's daily life. In which, the application programs installed in the electronic device are more diversified. If the application program is required to be used for transmitting the audio data, the corresponding audio resource is used in the using process of the application program.

However, some applications are used in the foreground or in the background, but when audio data transmission is not needed, the audio resources are kept occupied, the use of other applications is affected, and the use experience of a user is affected.

Disclosure of Invention

The embodiment of the application provides an audio resource processing method and device, a computer-readable storage medium and an electronic device, which can automatically release unused audio resources occupied by a target application program, realize the recovery of the audio resources and improve user experience.

A method for processing audio resources comprises a first step of processing audio resources,

monitoring audio resources occupied by the running of a target application program;

when the preset operation of the target application program is detected, monitoring whether the occupied audio resource is released or not;

and when the occupied audio resources are not released, releasing the occupied audio resources.

An audio resource processing apparatus comprising:

the resource monitoring module is used for monitoring audio resources occupied by the running of the target application program;

the release judging module is used for monitoring whether the occupied audio resources are released or not when the preset operation of the target application program is detected;

and the release processing module is used for releasing the occupied audio resources when the occupied audio resources are not released.

A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the steps of the audio resource processing method as described above.

An electronic device comprising a memory and a processor, the memory having stored therein computer-readable instructions that, when executed by the processor, cause the processor to perform the audio resource processing method of claim.

The audio resource processing method and device, the computer readable storage medium and the electronic device can monitor the audio resources occupied by the target application program in running; when the preset operation of the target application program is detected, monitoring whether the occupied audio resource is released or not; and when the occupied audio resources are not released, releasing the occupied audio resources, automatically releasing the audio resources occupied by the target application program and unused, and recycling the audio resources so that other target application programs can use the released audio resources, thereby improving the user experience.

Drawings

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings of the embodiments can be obtained according to the drawings without creative efforts.

FIG. 1 is a schematic diagram of an internal structure of an electronic device according to an embodiment;

FIG. 2 is a schematic diagram of a partial architecture of an android audio system in an embodiment;

FIG. 3 is a flowchart illustrating an audio resource processing method according to an embodiment;

fig. 4 is a schematic flowchart illustrating a process of monitoring whether occupied audio resources are released when a preset operation of a target application is detected in an embodiment;

fig. 5 is a schematic flowchart illustrating an embodiment of a process for monitoring whether audio hardware resources and audio playback resources are released when an operation of switching a target application to a background operation is detected, where an application type is an instant messaging type;

fig. 6 is a flowchart illustrating an embodiment of monitoring whether occupied audio resources are released when a predetermined operation of a target application is detected in the case that an application type is a non-instant messaging type;

FIG. 7 is a flowchart illustrating a method for processing audio resources according to another embodiment;

FIG. 8 is a block diagram of an audio asset processing device in one embodiment;

fig. 9 is a block diagram of a partial structure of a mobile phone related to an electronic device provided in an embodiment of the present application.

Detailed Description

To facilitate an understanding of the invention, the invention will now be described more fully with reference to the accompanying drawings. Preferred embodiments of the present invention are shown in the drawings. This invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete.

In one embodiment, as shown in FIG. 1, a schematic diagram of an internal structure of an electronic device is provided. The electronic device includes a processor, a memory, and a display screen connected by a system bus. Wherein, the processor is used for providing calculation and control capability and supporting the operation of the whole electronic equipment. The memory is used for storing data, programs, instruction codes and/or the like, and at least one computer program is stored on the memory, and the computer program can be executed by the processor to realize the audio resource processing method suitable for the electronic equipment provided by the embodiment of the application. The Memory may include a non-volatile storage medium such as a magnetic disk, an optical disk, a Read-Only Memory (ROM), or a Random-Access-Memory (RAM). For example, in one embodiment, the memory includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a database, and a computer program. The database stores data related to implementing an audio resource processing method provided in the above embodiments, for example, information such as a name of each process or application may be stored. The computer program can be executed by a processor for implementing an audio resource processing method provided by various embodiments of the present application. The internal memory provides a cached operating environment for the operating system, databases, and computer programs in the non-volatile storage medium. The display screen may be a touch screen, such as a capacitive screen or an electronic screen, and is configured to display interface information of an application corresponding to a foreground process, and also may be configured to detect a touch operation applied to the display screen, and generate a corresponding instruction, such as a switching instruction for performing foreground and background applications.

Those skilled in the art will appreciate that the architecture shown in fig. 1 is a block diagram of only a portion of the architecture associated with the subject application, and does not constitute a limitation on the electronic devices to which the subject application may be applied, and that a particular electronic device may include more or less components than those shown, or may combine certain components, or have a different arrangement of components. For example, the electronic device further includes a network interface connected via the system bus, where the network interface may be an ethernet card or a wireless network card, and the like, and is used for communicating with an external electronic device, such as a server.

In one embodiment, as shown in fig. 2, a partial architecture diagram of an Android audio system is provided. The Android audio system architecture system includes a Kernel space layer 210, a local layer 220, a framework layer 230, and a Client layer 240.

An Audio driver module 211 may be included on the Kernel space layer 210, where the Audio driver module interacts with hardware and implements an interface of the local layer for normal calls of the upper layer, where ALSA, OSS and custom Audio drivers may be selected. The local layer 220 includes an atlas service _ Jni module 221, an atlas service Interface module 223, and an atlas service module 225. The framework layer 230 includes an atlas manager module 231 and an atlas service module 233. Wherein, the atlas manager module 231 is provided with a conventional interface and a registration callback interface. The atlas service module 225 in the local layer 220 and the atlas service module 233 in the framework layer 230 are used for event reception and processing, information collection, exception feedback, and log collection, where information collection may include the collection of display information and the collection of audio information. The audio information includes audio resource information, playing information, recording information, audio mode setting information, and the like. Because the atlas service module is arranged in a system-level framework layer, the atlas service module can conveniently interact with other system services without worrying about the authority problem during system calling. Through the above framework, the audio resource processing method in the embodiments of the present application can be realized.

In one embodiment, as shown in FIG. 3, an audio asset processing method is provided. The audio resource processing method can be applied to electronic equipment. In one embodiment, the electronic Device may be an electronic Device including a Mobile phone, a tablet computer, a notebook computer, a palm computer, a Mobile Internet Device (MID), a wearable Device (e.g., a smart watch, a smart bracelet, a pedometer, etc.), or other devices with audio output functions.

As shown in fig. 3, in one embodiment, the audio asset processing method comprises steps 302-306.

Step 302, monitoring audio resources occupied by the target application program in operation.

The target application may be understood as an application capable of outputting and/or outputting an audio signal, and the number of target applications may be 1, 2, 3, or more. For example, the target application may include an instant messaging class (including telephony class), an audio playback class, a video playback class, a voice control class, a voice input class, and the like.

When the target application program runs, the electronic equipment can monitor the audio resource occupied by the target application program. Among them, audio resources include, but are not limited to: system resources related to audio playback, such as memory, CPU; audio hardware resources such as speakers, earphones, microphones, earphones and the like, and audio playing service resources in the kernel and the like.

In one embodiment, the monitoring module is created based on an operating system of the electronic device, and audio resources occupied by the target application program are monitored through the monitoring module. The monitoring module can also be used for monitoring information related to audio data input and/or output, such as audio mode, volume adjustment, recording and the like of the target application program. Taking an electronic device with an android operating system as an example, a system-level monitoring module (atlas service module) can be created in a system framework layer (native/framework layer), and audio resources occupied by a target application program are monitored through the monitoring module. For example, a monitoring module can be set up in the framework layer and run in a system service program (system _ server), and because the monitoring module is set up in the service framework layer of the system level, interaction with other system services can be facilitated without worrying about the authority problem when the system is called.

Optionally, the electronic device may also create an independent monitoring process, and monitor the occupied audio resource of the target application program through a message transmission mechanism. An independent monitoring function is set and called in the process, the process can be set to be started up and started automatically, and audio resources occupied by any target application program are monitored in real time.

And 304, monitoring whether the occupied audio resource is released or not when the preset operation of the target application program is detected.

When the electronic device detects the preset operation of the target application program, whether the occupied audio resource is waiting for release or not can be monitored continuously. The preset operation is associated with the application type of the target application program, the application type of the target application program is different, and the corresponding preset operation may be different. The preset operations include, but are not limited to: ending the operation of playing the audio, ending the operation of recording the audio, switching the target application program to the background operation, and the like.

When the electronic device detects the preset operation of the target application program, whether the audio resource occupied by the current target application program is released or not can be monitored. The preset operations are different, and the resource types of the audio resources occupied by the monitoring operations can be different. Resource types include, but are not limited to: system resources related to audio playback, such as memory, CPU; audio hardware resources such as speakers, earphones, microphones, earphones and the like, and audio playing service resources in the kernel and the like.

In one embodiment, whether the audio resource occupied by the target application is released may be monitored based on the created monitoring mode, and the audio data may be further analyzed to determine whether the audio resource is released according to the analyzed audio data.

And step 306, when the occupied audio resources are not released, releasing the occupied audio resources.

When the occupied audio resource is still in the occupied state, the audio resource is not released, namely the target application program occupies the audio resource but does not use the audio resource; when the occupied audio resource is not in the occupied state, the audio resource is released. When the electronic equipment detects that the occupied audio resources are not released, the electronic equipment can forcibly check, kill and clean the target application program running in the background to close the target application program so as to release all the occupied audio resources and realize the recovery of the audio resources.

Optionally, when the electronic device detects that the occupied audio resources are not released, the electronic device may forcibly release the audio hardware resources occupied by the target application running in the foreground or running in the background. For example, the electronic device may release the audio hardware resource by setting a preset interface function. The preset interface function at least comprises a setSpeakerphoneOn () interface function and is used for setting the loudspeaker to be turned on or off; the preset interface function may further include a setMode (audio manager, mode _ IN _ CALL) interface function, configured to turn on or off a speaker phone; the preset interface function may further include an iswiredfeadseton () interface function for turning on or off the headset.

The audio resource processing method can monitor the audio resources occupied by the target application program in operation; when the preset operation of the target application program is detected, monitoring whether the occupied audio resource is released or not; when the occupied audio resources are not released, the occupied audio resources are released, the audio resources occupied by the target application program and unused audio resources can be automatically released, the audio resources can be recycled, other target application programs can use the released audio resources, and user experience is improved.

As shown in fig. 4, in one embodiment, when the preset operation of the target application is detected, listening whether the occupied audio resource is released includes steps 402 to 406. Wherein the content of the first and second substances,

step 402, obtaining the application type of the target application program, wherein the application type comprises an instant messaging type and a non-instant messaging type.

In one embodiment, the electronic device may obtain the application type of the target application based on the identification information of the target application. The application types can include an instant messaging type and a non-instant messaging type, wherein the instant messaging type can be understood as an application program capable of interacting with other electronic equipment in terms of characters, voice, video and the like, and meanwhile, the application program of the instant messaging type can also specifically include an application program of a conversation type.

Specifically, the electronic device may preset to identify each target application to form identification information, and the identification information may be represented by any one of letters, numbers, special symbols, or a combination thereof. The identification information can distinguish the application types of the instant messaging class and the non-instant messaging class. For example, when an attribute string for distinguishing an instant messenger class from a non-instant messenger class may be included in the identification information, the attribute string may be represented by "True" or "False". And if the identification information carries 'True', the application type of the target application program is an instant messaging type, and if the identification information carries 'False', the application type of the target application program is a non-instant messaging type.

Step 404, determining a preset operation and a resource type of the audio resource according to the application type.

In one embodiment, different application types may correspond to different preset operations, and meanwhile, different preset operations may correspond to different resource types of audio resources.

The preset operations include, but are not limited to: ending the operation of playing the audio, ending the operation of recording the audio, switching the target application program to the background operation, and the like.

And the types of the resources occupying the audio resources, which are required to be monitored, are different corresponding to different preset operations. The resource types comprise audio hardware resources, audio playing resources and system resources. Specifically, the audio hardware resources include hardware transmission devices for audio input or output, such as an earphone, a speaker, a microphone, and an earphone; the audio playing resources can be resources used for controlling and managing audio playing services in the kernel; system resources may include memory, CPU, etc.

In one embodiment, the electronic device may construct a corresponding relationship between an application type, a preset operation, and a resource type, and determine the preset operation of the target application program and the resource type corresponding to the preset operation according to the corresponding relationship. For example, the application type of the target application program is an instant messaging type, and the corresponding preset operations include an operation of ending playing an audio, an operation of ending recording the audio, and an operation of switching the target application program to a background operation. When the preset operation is the operation of ending playing the audio and the operation of ending recording the audio, the resource type of the audio resource occupied by the target application program corresponding to the preset operation is the audio hardware resource.

Step 406, when the preset operation is detected, monitoring whether the audio resource of the resource type corresponding to the preset operation is released.

In one embodiment, the electronic device may detect a preset operation of the target application program, and according to the correspondence, may determine a resource type of the audio resource occupied by the target application program that needs to be monitored, which corresponds to the preset operation. For example, when the type of the audio resource occupied by the target application program to be monitored is an audio hardware resource, and the electronic device detects the preset operation, it is sufficient to monitor whether the audio hardware resource occupied by the target application program is released, and it is not necessary to monitor whether the audio hardware resource of other resource types is released.

In this embodiment, the electronic device may detect the preset operation according to the application type of the target application program, determine the resource type occupying the audio resource to be monitored according to the preset operation, and monitor whether the audio resource of the resource type is released, may monitor whether the audio resources of different resource types are released in a self-adaptive manner, and improve monitoring efficiency and processing efficiency.

In one embodiment, the application type is an instant messaging type, and when a preset operation of a target application program is detected, monitoring whether occupied audio resources are released specifically includes: and when detecting that the target application program runs in a foreground and finishes playing and/or recording the audio, monitoring whether the audio hardware resource of the audio resource is released or not.

That is, when the application type of the target application is the communication type, the corresponding preset operation is that the target application is in foreground operation and detects that the playing and/or recording of the audio is finished. The type of the resource occupying the audio resource and needing to be monitored corresponding to the preset operation is an audio hardware resource. That is, when the preset operation is to end the playing, whether the receiver or the loudspeaker in the audio hardware resources occupied by the preset operation is released or not is correspondingly monitored; and when the preset operation is to finish the recording, correspondingly monitoring whether the microphone in the audio hardware resource occupied by the preset operation is released.

When the monitored audio hardware resources are not released, the electronic device may continuously monitor whether an operation of playing and/or recording an audio is detected within a preset time, and if not, the electronic device may release the audio hardware resources so that other target application programs can use the released audio hardware resources.

In one embodiment, the application type is an instant messaging type, and when a preset operation of the target application program is detected, whether occupied audio resources are released or not is monitored. That is, when the application type of the target application program is the communication type, the corresponding preset operation may also be to switch the target application program to a background operation, and the resource types that need to monitor and occupy the audio resource corresponding to the preset operation are the audio hardware resource and the audio playing resource.

As shown in fig. 5, in one embodiment, when an operation of switching the target application to the background running is detected, it is monitored whether the audio hardware resource and the audio playing resource are released, including steps 502 to 506. Wherein the content of the first and second substances,

step 502, when detecting that the target application program is switched to the background running operation, acquiring the priority of the audio resource used by the target application program.

And when the application type of the target application program is an instant messaging type, the preset operation is that the target application program is switched to a background to run. When the operation that the target application program is switched to the background running is detected, the electronic equipment can acquire the priority of the audio resource used by the target application program.

When a plurality of target applications of the instant messaging class are available, the priority of the audio resource used by each target application of the instant messaging class and the target application of the instant messaging class can be set according to a preset rule. The preset rule can be set by default in the system, and the priority of the preset rule can also be set by self-definition according to the habit of a user.

In the embodiment of the present application, the target application program of the instant messaging class may include a conversation class (a conversation application carried by the electronic device system, a three-party conversation application downloaded by the user, and the like), and a chat interaction class (WeChat, QQ, and the like), where the priority of the conversation class is higher than that of the chat class, that is, the target application program of the conversation class has the highest priority for use. Wherein the higher the priority, the more preferred the audio resource may be used. For example, when audio resource usage conflicts, the target application with the highest priority may preferentially use the audio resource.

For example, the electronic device may listen to process information of the target application program and determine the operating state of the target application program according to the process information. The electronic device may also monitor whether the target application runs in the background based on using the Activity lifecycle callbacks, according to the lifecycle of Activity, where onStart () represents that an Activity is in the foreground and onStop () represents that the Activity is not visible in the background. Of course, the electronic device may also obtain the running state of the target application through getreporting tasks, and may also obtain the running state of the target application through a combination of getreporting tasks and RunningAppProcessInfo. Here, how the electronic device acquires the operating state of the target application is not further limited, nor is it limited to the above example.

And step 504, when the priority is the highest priority and when the target application program is detected to finish the playing and/or recording operation, monitoring whether the audio hardware resources of the audio resources are released or not.

In one embodiment, when a target application of the instant messaging class switches to the background, the priority of the target application for using the audio resource may be obtained. When the priority is the highest priority, it indicates that the target application can still use the audio resource even if the target application switches to the background. For example, the electronic device is a non-instant messaging application program running in the foreground, and when the call is switched to the background running, the audio resource which is preferentially used can still be used for the call, and the target application program running in the foreground cannot use the audio resource occupied during the call. After the call is finished, the electronic device can monitor whether the audio hardware resources used in the call process are released.

Step 506, when the priority is not the highest priority, monitoring whether the audio hardware resource and the audio playing resource are released.

In one embodiment, when a target application of the instant messaging class switches to the background, the priority of the target application for using the audio resource may be obtained. And when the priority is the highest priority, the target application program is indicated to be incapable of continuously using the audio resources occupied by the target application program during foreground operation even if the target application program is switched to the background. For example, the electronic device is operating in the foreground as WeChat or QQ. When the WeChat or QQ is switched to the background, the electronic equipment can monitor whether the audio hardware resources and the audio playing resources used by the WeChat or QQ during the foreground operation are released. When the release is not obtained, the electronic device can release the audio hardware resource and the audio playing resource, so that the target application program running in the foreground can use the audio resource occupied by the WeChat or QQ when the QQ is in the foreground running.

As shown in fig. 6, in an embodiment, the monitoring whether the occupied audio resource is released when detecting the preset operation of the target application program, where the application type is a non-instant messaging type, includes:

step 602, when detecting that the target application program is switched to the background running operation, detecting whether the target application program is occupying the audio resource to play the audio data.

In one embodiment, the application type is a non-instant messaging type, the corresponding preset operation may be an operation of switching the target application program to a background operation, and the type of the resource occupying the audio resource corresponding to the preset operation, which needs to be monitored, is an audio resource capable of controlling playing of the played audio data. The audio resources may include audio hardware resources, audio playback resources, and system resources. Audio data includes, but is not limited to, voice data, ring tone data, alarm data, multimedia data (video streaming, audio streaming data, etc.).

Step 604, determining whether the occupied audio resource is released according to the validity of the audio data.

The electronic equipment can analyze the detected audio data, then judge whether the audio data is valid data, and when the audio data is invalid data, the electronic equipment indicates that the occupied audio resources are not released; when the audio data is valid data, it indicates that the occupied audio resource is in normal use, and the audio resource may not be released.

Specifically, the electronic device may obtain audio data output by a target application program within a preset time, perform sampling analysis on any number of frames of digital data included in the audio data, determine a ratio of the number of digital data equal to 0 to the total number of the number of one frame of digital data, and when the ratio is greater than a preset threshold, determine that the audio data is invalid, and at the same time, indicate that an audio resource occupied by the target application program for playing the audio data is not released. Wherein, the preset value can be 99%, 98%, etc. close to 100%.

When the non-instant messaging class runs in the background, if the output audio data is invalid data, the audio resource used for playing the invalid data can be released, so that other target application programs can use the audio resource, and meanwhile, the user experience can be improved.

As shown in FIG. 7, in one embodiment, the audio asset processing method comprises steps 702-710. Wherein the content of the first and second substances,

step 702, monitoring audio resources occupied by the running of a target application program;

step 704, obtaining the application type of the target application program, wherein the application type comprises an instant messaging type and a non-instant messaging type;

step 706, determining a preset operation and a resource type of the audio resource according to the application type; the resource types comprise audio hardware resources, audio playing resources and system resources;

step 708, the application type is an instant messaging type, and when detecting that the target application program is in foreground operation and finishes playing and/or recording audio, monitoring whether audio hardware resources of the audio resources are released, or when detecting that the target application program is switched to background operation, monitoring whether the audio hardware resources and the audio playing resources are released;

step 710, the application type is a non-instant messaging type, and when the operation that the target application program is switched to the background running is detected, whether the target application program occupies an audio resource to play audio data is detected;

step 712, determining whether the occupied audio resource is released according to the validity of the audio data;

and 714, when the occupied audio resources are not released, performing killing and cleaning on the target application program running in the background to release the occupied audio resources.

In this embodiment, the audio resource processing method can determine a corresponding preset operation according to the application type of the target application program, adaptively monitor whether the audio resources of different resource types occupied are released according to the preset operation, and when the occupied audio resources are not released, perform checking, killing and cleaning on the target application program running in the background to automatically release the audio resources occupied and unused by the target application program, and recycle the audio resources, so that other target application programs can use the released audio resources, and user experience is improved.

It should be understood that although the various steps in the flow charts of fig. 3-7 are shown in order as indicated by the arrows, the steps are not necessarily performed in order as indicated by the arrows. The steps are not performed in the exact order shown and described, and may be performed in other orders, unless explicitly stated otherwise. Moreover, at least some of the steps in fig. 3-7 may include multiple sub-steps or multiple stages that are not necessarily performed at the same time, but may be performed at different times, and the order of performance of the sub-steps or stages is not necessarily sequential, but may be performed in turn or alternating with other steps or at least some of the sub-steps or stages of other steps.

As shown in fig. 8, the present application also provides an audio resource processing apparatus, including: a resource monitoring module 810, a release determination module 820, and a release processing module 830, wherein,

the resource monitoring module 810 is configured to monitor audio resources occupied by the target application program during running;

a release determining module 820, configured to monitor whether an occupied audio resource is released when a preset operation of a target application is detected;

and a release processing module 830, configured to release the occupied audio resource when the occupied audio resource is not released.

The audio resource processing device can monitor the audio resources occupied by the target application program in running; when the preset operation of the target application program is detected, monitoring whether the occupied audio resource is released or not; when the occupied audio resources are not released, the occupied audio resources are released, the audio resources occupied by the target application program and unused audio resources can be automatically released, the audio resources can be recycled, other target application programs can use the released audio resources, and user experience is improved.

In one embodiment, the resource listening module 810 is further configured to:

creating a monitoring module based on the operating system of the electronic equipment, monitoring the audio resource occupied by the target application program through the monitoring module, or,

and creating a monitoring process, and monitoring the audio resources occupied by the target application program through a message transmission mechanism.

In one embodiment, the release determination module 820 includes:

the first type acquisition unit is used for acquiring the application types of the target application program, wherein the application types comprise an instant messaging type and a non-instant messaging type;

the second type acquisition unit is used for determining the preset operation and the resource type of the audio resource according to the application type; the resource types comprise audio hardware resources, audio playing resources and system resources;

and the resource release judging unit is used for monitoring whether the audio resources of the resource types are released or not when the preset operation is detected.

In an embodiment, the second type obtaining unit is further configured to construct a corresponding relationship between the application type, the preset operation, and the resource type; and determining the preset operation of the target application program and the resource type of the audio resource according to the corresponding relation.

In one embodiment, the first-type obtaining unit is further configured to obtain the application type of the target application according to the identification information of the target application.

In an embodiment, the application type is an instant messaging type, and the release determining module 820 is further configured to:

when detecting that the target application program runs in a foreground and finishes playing and/or recording audio, monitoring whether audio hardware resources of the audio resources are released or not; or the like, or, alternatively,

and when the operation that the target application program is switched to the background running is detected, monitoring whether the audio hardware resource and the audio playing resource are released or not.

In one embodiment, the release determination module 820 is further configured to:

when the operation that the target application program is switched to the background running is detected, acquiring the priority of the target application program for using the audio resources;

when the priority is the highest priority and when the operation that the target application program finishes playing and/or recording is detected, monitoring whether audio hardware resources of the audio resources are released or not;

and when the priority is not the highest priority, monitoring whether the audio hardware resource and the audio playing resource are released or not.

In an embodiment, the application type is a non-instant messaging type, and the release determining module 820 is further configured to:

when the operation that the target application program is switched to the background running is detected, whether the target application program occupies audio resources to play audio data is detected; and judging whether the occupied audio resources are released or not according to the validity of the audio data.

In one embodiment, the release determination module 820 further comprises:

the data analysis unit is used for analyzing the audio data and judging whether the audio data is valid data;

and the resource release judging unit is further configured to, when the audio data is invalid data, not release the occupied audio resource.

In one embodiment, the release processing module 830 is configured to perform killing and cleaning on the target application running in the background to release the occupied audio resource when the occupied audio resource is not released.

The division of the modules in the audio resource processing apparatus is only for illustration, and in other embodiments, the audio resource processing apparatus may be divided into different modules as needed to complete all or part of the functions of the audio resource processing apparatus.

The modules in the audio resource processing device can be wholly or partially implemented by software, hardware and a combination thereof. The modules can be embedded in a hardware form or independent of a processor in the electronic device, or can be stored in a memory in the electronic device in a software form, so that the processor can call and execute operations corresponding to the modules.

The embodiment of the application also provides a computer readable storage medium. One or more non-transitory computer-readable storage media containing computer-executable instructions that, when executed by one or more processors, cause the processors to perform the steps of the audio resource processing method of:

when the occupied audio resource is not released, releasing the occupied audio resource

It is noted that one or more non-transitory computer-readable storage media containing computer-executable instructions that, when executed by one or more processors, further cause the processors to perform the audio resource processing method of any of the above embodiments.

A computer program product containing instructions which, when run on a computer, cause the computer to perform the steps of an audio resource processing method:

It should be noted that a computer program product containing instructions, when running on a computer, causes the computer to perform the steps of the audio asset processing method in any of the above embodiments.

The embodiment of the application also provides the electronic equipment. As shown in fig. 9, for convenience of explanation, only the parts related to the embodiments of the present application are shown, and details of the technology are not disclosed, please refer to the method part of the embodiments of the present application. The electronic device may be any terminal device having a voice call function and a speaker, including a mobile phone, a tablet computer, a PDA (Personal Digital Assistant), a POS (Point of Sales), a vehicle-mounted computer, a wearable device, and the like, taking the electronic device as the mobile phone as an example:

fig. 9 is a block diagram of a partial structure of a mobile phone related to an electronic device provided in an embodiment of the present application. Referring to fig. 9, the handset includes: radio Frequency (RF) circuit 910, memory 920, input unit 930, display unit 940, sensor 950, audio circuit 960, wireless fidelity (WiFi) module 970, processor 980, and power supply 990. Those skilled in the art will appreciate that the handset configuration shown in fig. 9 is not intended to be limiting and may include more or fewer components than those shown, or some components may be combined, or a different arrangement of components.

The RF circuit 910 may be used for receiving and transmitting signals during information transmission or communication, and may receive downlink information of a base station and then process the downlink information to the processor 980; the uplink data may also be transmitted to the base station. Typically, the RF circuitry includes, but is not limited to, an antenna, at least one Amplifier, a transceiver, a coupler, a Low Noise Amplifier (LNA), a duplexer, and the like. In addition, the RF circuit 910 may also communicate with networks and other devices via wireless communication. The wireless communication may use any communication standard or protocol, including but not limited to Global System for Mobile communication (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Long Term Evolution (LTE)), e-mail, Short Messaging Service (SMS), and the like.

The memory 920 may be used to store software programs and modules, and the processor 980 may execute various functional applications and data processing of the mobile phone by operating the software programs and modules stored in the memory 920. The memory 920 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application program required for at least one function (such as an application program for a sound playing function, an application program for an image playing function, and the like), and the like; the data storage area may store data (such as audio data, an address book, etc.) created according to the use of the mobile phone, and the like. Further, the memory 920 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.

The input unit 930 may be used to receive input numeric or character information and generate key signal inputs related to user settings and function control of the cellular phone 900. Specifically, the input unit 930 may include a touch panel 931 and other input devices 932. The touch panel 931, which may also be referred to as a touch screen, may collect a touch operation performed by a user on or near the touch panel 931 (e.g., a user operating the touch panel 931 or near the touch panel 931 by using a finger, a stylus, or any other suitable object or accessory), and drive the corresponding connection device according to a preset program. In one embodiment, the touch panel 931 may include two parts of a touch detection device and a touch controller. The touch detection device detects the touch direction of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch sensing device, converts the touch information into touch point coordinates, sends the touch point coordinates to the processor 980, and can receive and execute commands sent by the processor 980. In addition, the touch panel 931 may be implemented by various types, such as a resistive type, a capacitive type, an infrared ray, and a surface acoustic wave. The input unit 930 may include other input devices 932 in addition to the touch panel 931. In particular, other input devices 932 may include, but are not limited to, one or more of a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), and the like.

The display unit 940 may be used to display information input by the user or information provided to the user and various menus of the mobile phone. The display unit 940 may include a display panel 941. In one embodiment, the Display panel 941 may be configured in the form of a Liquid Crystal Display (LCD), an Organic Light-Emitting Diode (OLED), or the like. In one embodiment, the touch panel 931 may overlay the display panel 941, and when the touch panel 931 detects a touch operation thereon or nearby, the touch operation is transmitted to the processor 980 to determine the type of touch event, and then the processor 980 provides a corresponding visual output on the display panel 941 according to the type of touch event. Although in fig. 9, the touch panel 931 and the display panel 941 are two independent components to implement the input and output functions of the mobile phone, in some embodiments, the touch panel 931 and the display panel 941 may be integrated to implement the input and output functions of the mobile phone.

Cell phone 900 may also include at least one sensor 950, such as a light sensor, motion sensor, and other sensors. Specifically, the light sensor may include an ambient light sensor that adjusts the brightness of the display panel 941 according to the brightness of ambient light, and a proximity sensor that turns off the display panel 941 and/or backlight when the mobile phone is moved to the ear. The motion sensor can comprise an acceleration sensor, the acceleration sensor can detect the magnitude of acceleration in each direction, the magnitude and the direction of gravity can be detected when the mobile phone is static, and the motion sensor can be used for identifying the application of the gesture of the mobile phone (such as horizontal and vertical screen switching), the vibration identification related functions (such as pedometer and knocking) and the like; the mobile phone may be provided with other sensors such as a gyroscope, a barometer, a hygrometer, a thermometer, and an infrared sensor.

Audio circuitry 960, speaker 961 and microphone 962 may provide an audio interface between a user and a cell phone. The audio circuit 960 may transmit the electrical signal converted from the received audio data to the speaker 961, and convert the electrical signal into a sound signal for output by the speaker 961; on the other hand, the microphone 962 converts the collected sound signal into an electrical signal, converts the electrical signal into audio data after being received by the audio circuit 960, and then outputs the audio data to the processor 980 for processing, and then the audio data can be transmitted to another mobile phone through the RF circuit 910, or the audio data can be output to the memory 920 for subsequent processing.

WiFi belongs to short-distance wireless transmission technology, and the mobile phone can help a user to receive and send e-mails, browse webpages, access streaming media and the like through the WiFi module 970, and provides wireless broadband Internet access for the user. Although fig. 9 shows WiFi module 970, it is to be understood that it does not belong to the essential components of cell phone 900 and may be omitted as desired.

The processor 980 is a control center of the mobile phone, connects various parts of the entire mobile phone by using various interfaces and lines, and performs various functions of the mobile phone and processes data by operating or executing software programs and/or modules stored in the memory 920 and calling data stored in the memory 920, thereby integrally monitoring the mobile phone. In one embodiment, processor 980 may include one or more processing units. In one embodiment, the processor 980 may integrate an application processor and a modem processor, wherein the application processor primarily handles operating systems, user interfaces, applications, and the like; the modem processor handles primarily wireless communications. It will be appreciated that the modem processor described above may not be integrated into the processor 980.

The handset 900 also includes a power supply 990 (e.g., a battery) for supplying power to various components, which may preferably be logically connected to the processor 980 via a power management system, such that the power management system may be used to manage charging, discharging, and power consumption.

In one embodiment, the cell phone 900 may also include a camera, a bluetooth module, and the like.

In an embodiment of the application, the electronic device comprises a processor 980 that, when executing the computer program stored on the memory, performs the following steps:

It should be noted that the processor 880 included in the electronic device implements the audio resource processing method in any of the above embodiments when executing the computer program stored in the memory.

Any reference to memory, storage, database, or other medium used herein may include non-volatile and/or volatile memory. Suitable non-volatile memory can include read-only memory (ROM), Programmable ROM (PROM), Electrically Programmable ROM (EPROM), Electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM), which acts as external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms, such as Static RAM (SRAM), Dynamic RAM (DRAM), Synchronous DRAM (SDRAM), double data rate SDRAM (DDR SDRAM), Enhanced SDRAM (ESDRAM), synchronous Link (Synchlink) DRAM (SLDRAM), Rambus Direct RAM (RDRAM), direct bus dynamic RAM (DRDRAM), and bus dynamic RAM (RDRAM).

The technical features of the embodiments described above may be arbitrarily combined, and for the sake of brevity, all possible combinations of the technical features in the embodiments described above are not described, but should be considered as being within the scope of the present specification as long as there is no contradiction between the combinations of the technical features.

The above-mentioned embodiments only express several embodiments of the present invention, and the description thereof is more specific and detailed, but not construed as limiting the scope of the invention. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the inventive concept, which falls within the scope of the present invention. Therefore, the protection scope of the present patent shall be subject to the appended claims.

Claims

An audio resource processing method applied to an electronic device, the method comprising:

monitoring audio resources occupied by the running of a target application program;

when the preset operation of the target application program is detected, monitoring whether the occupied audio resource is released or not;

and when the occupied audio resources are not released, releasing the occupied audio resources.
The method of claim 1, wherein listening for audio resources occupied by a target application runtime comprises:

creating a monitoring module based on the operating system of the electronic equipment, monitoring the audio resource occupied by the target application program through the monitoring module, or,

and creating a monitoring process, and monitoring the audio resources occupied by the target application program through a message transmission mechanism.
The method of claim 1, wherein the monitoring whether the occupied audio resource is released when the preset operation of the target application program is detected comprises:

acquiring an application type of the target application program, wherein the application type comprises an instant messaging type and a non-instant messaging type;

determining the preset operation and the resource type of the audio resource according to the application type; the resource types comprise audio hardware resources, audio playing resources and system resources;

and when the preset operation is detected, monitoring whether the audio resource of the resource type corresponding to the preset operation is released or not.
The method of claim 3, wherein determining the preset operation and the resource type of the audio resource according to the application type comprises:

constructing a corresponding relation among the application type, the preset operation and the resource type;

and determining the preset operation of the target application program and the resource type of the audio resource according to the corresponding relation.
The method of claim 3, wherein the obtaining the application type of the target application comprises:

and acquiring the application type of the target application program according to the identification information of the target application program.
The method of claim 3, wherein the application type is an instant messaging type, and the monitoring whether the occupied audio resource is released when detecting the preset operation of the target application program comprises:

when detecting that the target application program runs in a foreground and finishes playing and/or recording audio, monitoring whether audio hardware resources of the audio resources are released or not; or the like, or, alternatively,

and when the operation that the target application program is switched to the background running is detected, monitoring whether the audio hardware resource and the audio playing resource are released or not.
The method of claim 6, wherein the monitoring whether the audio hardware resource and audio playback resource are released when the target application is detected to switch to a background running operation comprises:

when the operation that the target application program is switched to the background running is detected, acquiring the priority of the target application program for using the audio resources;

when the priority is the highest priority and when the operation that the target application program finishes playing and/or recording is detected, monitoring whether audio hardware resources of the audio resources are released or not;

and when the priority is not the highest priority, monitoring whether the audio hardware resource and the audio playing resource are released or not.
The method of claim 3, wherein the application type is a non-instant messaging type, and the monitoring whether the occupied audio resource is released when detecting the preset operation of the target application program comprises:

when the operation that the target application program is switched to the background running is detected, whether the target application program occupies audio resources to play audio data is detected;

and judging whether the occupied audio resources are released or not according to the validity of the audio data.
The method of claim 8, wherein the determining whether the occupied audio resource is released according to the validity of the audio data comprises:

analyzing the audio data to judge whether the audio data is valid data;

and when the audio data is invalid data, the occupied audio resources are not released.
The method of claim 1, wherein the releasing the occupied audio resource when the occupied audio resource is not released comprises:

and when the occupied audio resources are not released, the target application program running in the background is checked, killed and cleaned so as to release the occupied audio resources.
An audio resource processing device applied to an electronic device comprises:

the resource monitoring module is used for monitoring audio resources occupied by the running of the target application program;

the release judging module is used for monitoring whether the occupied audio resources are released or not when the preset operation of the target application program is detected;

and the release processing module is used for releasing the occupied audio resources when the occupied audio resources are not released.
The apparatus of claim 11, the resource listening module further to:

creating a monitoring module based on the operating system of the electronic equipment, monitoring the audio resource occupied by the target application program through the monitoring module, or,

and creating a monitoring process, and monitoring the audio resources occupied by the target application program through a message transmission mechanism.
The apparatus of claim 11, the release determination module, comprising:

the first type acquisition unit is used for acquiring the application types of the target application program, wherein the application types comprise an instant messaging type and a non-instant messaging type;

the second type acquisition unit is used for determining the preset operation and the resource type of the audio resource according to the application type; the resource types comprise audio hardware resources, audio playing resources and system resources;

and the resource release judging unit is used for monitoring whether the audio resources of the resource type corresponding to the preset operation are released or not when the preset operation is detected.
The apparatus according to claim 13, wherein the second type obtaining unit is further configured to construct a corresponding relationship between the application type, the preset operation, and the resource type; and determining the preset operation of the target application program and the resource type of the audio resource according to the corresponding relation.
The apparatus according to claim 13, wherein the first-type obtaining unit is further configured to obtain the application type of the target application according to the identification information of the target application.
The apparatus of claim 13, wherein the application type is an instant messaging type, and the release determination module is further configured to:

when detecting that the target application program runs in a foreground and finishes playing and/or recording audio, monitoring whether audio hardware resources of the audio resources are released or not; or the like, or, alternatively,

and when the operation that the target application program is switched to the background running is detected, monitoring whether the audio hardware resource and the audio playing resource are released or not.
The apparatus of claim 16, the release determination module further configured to:

when the operation that the target application program is switched to the background running is detected, acquiring the priority of the target application program for using the audio resources;

when the priority is the highest priority and when the operation that the target application program finishes playing and/or recording is detected, monitoring whether audio hardware resources of the audio resources are released or not;

and when the priority is not the highest priority, monitoring whether the audio hardware resource and the audio playing resource are released or not.
The apparatus of claim 13, wherein the application type is a non-instant messaging type, and the release determination module is further configured to:

when the operation that the target application program is switched to the background running is detected, whether the target application program occupies audio resources to play audio data is detected; and judging whether the occupied audio resources are released or not according to the validity of the audio data.
The apparatus of claim 18, the release determination module further comprising:

the data analysis unit is used for analyzing the audio data and judging whether the audio data is valid data;

and the resource release judging unit is further configured to, when the audio data is invalid data, not release the occupied audio resource.
The apparatus according to claim 11, wherein the release processing module is configured to perform killing cleaning on the target application running in the background to release the occupied audio resource when the occupied audio resource is not released.
A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the steps of the audio resource processing method as claimed in any one of claims 1 to 10.
An electronic device comprising a memory and a processor, the memory having stored therein computer-readable instructions that, when executed by the processor, cause the processor to perform the audio resource processing method of any of claims 1 to 10.