WO2020048209A1

WO2020048209A1 - Sound effect processing method and apparatus, and electronic device and storage medium

Info

Publication number: WO2020048209A1
Application number: PCT/CN2019/094437
Authority: WO
Inventors: 李亚军; 许钊铵; 冷文华
Original assignee: Oppo广东移动通信有限公司
Priority date: 2018-09-04
Filing date: 2019-07-02
Publication date: 2020-03-12
Also published as: CN109107158B; CN109107158A

Abstract

Disclosed are a sound effect processing method and apparatus, and an electronic device and a storage medium. The method comprises: obtaining the current audio output scene, the audio output scene having a plurality of corresponding audio output channels, and each of the audio output channels being used for transmitting different types of audio; determining a target audio output channel corresponding to the audio output scene from the plurality of audio output channels, the target audio output channel being an audio output channel requiring sound effect enhancement among the plurality of audio output channels; and enhancing the sound effect of an audio transmitted by the target audio output channel. The method enables an electronic device to selectively perform sound effect enhancement from the plurality of audio output channels corresponding to the audio output scene according to the current audio output scene, the flexibility of sound effect processing is improved, and thus the user experience can be improved.

Description

Sound effect processing method, device, electronic equipment and storage medium

Cross-reference to related applications

This application claims priority from Chinese application with application number 201811028137.2, filed on September 4, 2018, which is hereby incorporated by reference in its entirety for all purposes.

Technical field

The present application relates to the technical field of electronic devices, and more particularly, to a sound effect processing method, device, electronic device, and storage medium.

Background technique

With the rapid development of terminal technology, electronic devices such as mobile phones and tablets have become an integral part of people's lives. People can not only use electronic devices for daily phone calls, text messages, and other functions, but also use electronic devices to run various applications, such as game applications, web browsing applications, and audio and video broadcast applications. and many more. However, during the running of the application, the flexibility of adjusting the sound effects of the output audio of the application and the user experience need to be improved.

Summary of the Invention

In view of the above problems, this application proposes a sound effect processing method, device, electronic device, and storage medium to achieve improvement of the above problems.

In a first aspect, the present application provides a sound effect processing method applied to an electronic device. The method includes: obtaining a current audio output scene, where the audio output scene corresponds to multiple audio output channels, and each of the audio outputs The types of audio channels used for transmission are different; from the multiple audio output channels, a target audio output channel corresponding to the audio output scene is determined, and the target audio output channels are sound effects that need to be performed in the multiple audio output channels. Enhanced audio output path; enhancing the sound effect of audio transmitted by the target audio output path.

In a second aspect, the present application provides a sound effect processing device that runs on an electronic device. The device includes: an audio scene acquisition unit configured to obtain a current audio output scene, where the audio output scene corresponds to multiple audio output channels. Each audio output channel has a different audio type for transmission; a target determination unit is configured to determine, from the multiple audio output channels, a target audio output channel corresponding to the audio output scene, and the target audio output The channel is an audio output channel that needs to be enhanced in the multiple audio output channels; a sound effect processing unit is used to enhance the audio effect of the audio transmitted by the target audio output channel.

In a third aspect, the present application provides an electronic device including one or more processors and a memory; one or more programs are stored in the memory and configured to be executed by the one or more processors, The one or more programs are configured to perform the method described above.

According to a fourth aspect, a computer-readable storage medium provided in the present application, wherein the computer-readable storage medium stores program code, and the method is executed when the program code is executed by a processor.

BRIEF DESCRIPTION OF THE DRAWINGS

In order to explain the technical solutions in the embodiments of the present application more clearly, the drawings used in the description of the embodiments are briefly introduced below. Obviously, the drawings in the following description are just some embodiments of the application. For those skilled in the art, other drawings can be obtained based on these drawings without paying creative labor.

FIG. 1 shows a flowchart of a sound effect processing method provided by the present application.

FIG. 2 shows a schematic diagram of another interface proposed by the present application.

FIG. 3 is a schematic diagram of still another interface proposed by the present application.

FIG. 4 shows a flowchart of another sound effect processing method provided by the present application.

FIG. 5 shows a schematic diagram of an interface proposed by the present application.

FIG. 6 shows a schematic diagram of a network environment proposed by the present application.

FIG. 7 shows a structural block diagram of a sound effect processing device proposed in the present application.

FIG. 8 shows a structural block diagram of another sound effect processing device proposed in the present application.

FIG. 9 shows a structural block diagram of an electronic device proposed by the present application.

FIG. 10 is a storage unit for storing or carrying a program code for implementing a sound effect processing method according to an embodiment of the present application.

detailed description

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application. Based on the embodiments in the present application, all other embodiments obtained by a person of ordinary skill in the art without creative efforts shall fall within the protection scope of the present application.

Sound effects can be a ubiquitous sound in our lives. Sound effects such as footsteps when walking, squeaking when opening a door, and door opening and closing of an elevator penetrate into every corner of our lives.

And sound effects are everywhere in electronic devices. For example, when the electronic device is started, it may be accompanied by a startup sound effect, when the electronic device is turned off, it may be accompanied by a shutdown sound effect, and when the power of the electronic device is insufficient, the electronic device may also emit an alarm sound effect.

The same is true for applications running on electronic devices. For example, a game application can generate game sound effects during running. Game sound effects refer to effect music played when a specific behavior or specific operation occurs in a video game. Such as the sound of a bullet when it is launched, the scream of a monster when it "dies", and the "click" sound when a button is clicked. It is precisely because of the existence of game sound effects that users can have a more realistic experience when playing games.

It can be understood that, in addition to the aforementioned game type applications, there are also sound effects. For example, the audio and video sound effects of audio and video playing applications during the playback of audio and video, and the sound effects of web browsing applications during the loading of web page content.

However, the inventors have found that the sound effects of some audio output scenes are usually enhanced in electronic devices to improve the user experience. However, the current sound enhancement methods still lack some flexibility, which affects the effects of sound enhancement and also results in a poor user experience. Therefore, the inventor proposes a sound effect processing method, device, electronic device, and storage medium that can improve the flexibility of sound effect enhancement and improve the user experience in this application.

The embodiments of the present application will be described in detail below with reference to the drawings.

Please refer to FIG. 1, a sound effect processing method provided in this application is applied to an electronic device, and the method includes:

Step S110: Acquire a current audio output scene, where the audio output scene corresponds to multiple audio output channels, and each of the audio output channels has a different audio type for transmission.

Among them, it can be understood that during the operation of the electronic device, audio output may exist in multiple scenarios. For example, when an electronic device is running a game application, a game interface scene is displayed. In the game interface scene, there may be audio outputs such as game sound effects, game background music, or button sounds. Among them, the game sound effects include the sound effects of game characters, the sound effects of the voice of the game characters, and the sound effects of other NPC (Non Player and Character) characters.

As another example, when an electronic device is running an audio application, an audio playback scene is displayed, and an environmental sound effect exists in the audio playback scene. When the electronic device is running a video-type application, a video screen playing scene is displayed, and in the video screen playing scene, there are sound effects such as human voices and environmental sound effects.

It should be noted that the foregoing audio output scenario is only exemplary and does not limit the present application. The application may also include audio output scenes other than the audio output scenes of the above examples.

Based on the above situation, the electronic device can determine the current audio output scene in multiple ways. Optionally, the electronic device may determine a current audio output scene by querying a currently running application program. Among them, if the electronic device is an Android operating system, the name of the application currently running in the foreground can be obtained by executing the getRunningTasks method of the ActivityManager. In addition, the electronic device can also obtain a list of programs used by the user through UsageStatsManager, and identify the most recently used application recorded in the list as the current foreground application. In addition, you can also use Android's built-in accessibility function to monitor the focus change of the window and get the package name corresponding to the focus window as the application currently running in the foreground.

After the electronic device obtains the currently running application program, it can determine the current audio output scene according to the type of the currently running application program. For example, if the application is a game application, it may be determined that the current audio output scene is a game interface scene. If the application is a music playback application, it can be determined that the current audio output scene is a music playback scene. If the application is a video application, it can be determined that the current audio output scene is a video playback scene.

The audio output scene usually includes one or more audio types that need to be output. For example, in an audio output scene such as a game interface scene, there may be several audio types that need to be output, such as sound effects, background music, and key sounds. In order to improve the effect of audio output, different audio output channels can be configured for audio of different audio types, so that the audio output scene corresponds to multiple audio output channels, and each of the audio output channels is used to transmit audio. Different types.

The following uses Android system as an example to explain the above content. In the electronic device of the Android operating system, there are 11 stream_types (audio types) defined, which can also be regarded as types of audio streams. And for the 11 types of stream_type audio streams defined therein, after entering the Attribute, the electronic device will sort them into several types and then output them, then this type corresponds to an audio output channel.

Step S120: From among the multiple audio output channels, determine a target audio output channel corresponding to the audio output scene, and the target audio output channel is an audio output channel among the multiple audio output channels that requires sound enhancement.

Optionally, if the audio output from all audio output channels is enhanced, part of the audio may not be highlighted, and the user's audiovisual effect may be poor. For example, in a game interface scene, the types of audio included include audio output such as game sound effects, game background music, or button sounds. In the case where types of audio such as game sound effects, game background music, or key sound are output through different audio output channels, if the sound effects of game sound effects, game background music, or key sound are all enhanced at the same time, it may be Causes a messy sound.

Then, in order to facilitate the highlighting of the audio characteristics of one audio type in the presence of multiple audio types, a target audio output channel corresponding to the audio output scene may be determined from the multiple audio output channels, so that Only the audio transmitted in the target audio output path is enhanced.

Optionally, for different audio output scenarios, the corresponding target audio output channels are different.

As a method, if the current audio output scene is a game interface scene, the action sound output path among the multiple audio output paths is determined as the target audio output path.

It should be noted that, in a game interface scene, there may be an action of a game user walking in the scene. Correspondingly, there may be other users walking in the game interface scene in the game interface scene. Then there is a case where the game user of the electronic device needs to determine other situations through the situation of other game users walking in the game interface scene. The position of the game user, taking measures to capture or kill other game users. Then in this case, the situation of other game users walking in the game interface scene can be judged by the action sound effect. Therefore, the case where the action sound effect output path among the multiple audio output paths is determined as the target audio output path Next, the action sound effect output in the audio output path can be enhanced, thereby helping users to clearly or quickly recognize the actions of other game users.

The following describes the specific types of action sound effects.

Optionally, the motion sound effect may include motion information and phase information. Among them, the motion information is used to identify the type of character movement in the game, and the phase information is used to identify the direction in which the action is generated. For example, when the user walks in the game, there will be a sound of "咚咚咚", and when the user hears the sound of "咚咚咚", it can be determined that other game users are walking. The phase information corresponding to the sound of the “咚咚咚” can enable the user of the electronic device not only to judge that other game users are walking, but also to further determine the direction in which other game users are walking and how far they are from themselves.

In addition, in addition to being a game interface scene, if the current audio output scene is an audio scene, a character sound output path among the plurality of audio output paths is determined as a target audio output path. If the current audio output scene is a video playback scene, a background music output path among the multiple audio output paths is determined as a target audio output path.

Furthermore, the target audio output path can also be freely selected by the user through a manual mode. As a method, the audio control control may be displayed in an interface corresponding to the audio output scene displayed by the electronic device. After detecting that the user triggers the audio control control, the electronic device may display a control interface, and the control interface may display a control interface. Controls for the user to adjust the target audio output path. Different audio control controls correspond to different target audio output paths. It can be understood that, in order to facilitate user adjustment, the channel may be replaced by words representing effects in the control interface, so that the user can understand the effects corresponding to different options.

For example, as shown in FIG. 2, if the audio output scene is the illustrated game interface scene, the game interface scene corresponds to a game interface 99, and audio control controls 98 are displayed in the game interface 99. Then, when the user touches the audio control control 98, as shown in FIG. 3, a control interface 97 can be triggered to be suspended in the interface 99. A sound effect selection control 96 is displayed in the control interface 97, so that a user can select a desired enhanced effect by operating the sound effect selection control 96, so that the electronic device determines a target audio output path. For example, if the user selects enhanced action sound effects, the corresponding determined target audio output path is an audio output path whose transmitted audio type is a game interface scene.

Step S130: Enhance the audio effect of the audio transmitted by the target audio output path.

It can be understood that by enhancing the sound effect of the audio transmitted by the target audio output path, the effect of the sound effect of the audio transmitted by the target audio output path can be made more prominent in order to improve the user experience. According to the foregoing content, it can be known that the motion sound effect may include motion information and phase information. Then, as a way, the step of enhancing the sound effect of the audio transmitted by the target audio output path may include: detecting whether the audio transmitted by the target audio output path has phase information; if phase information is detected, then A sound effect of audio transmitted on the target audio output path may be enhanced according to the phase information.

It should be noted that the inventor found that the mechanism of the human ear to distinguish the direction is simply produced by the synergy of the left and right ears, just like we can recognize the distance by looking at the object with both eyes. The sounds received by both ears have "intensity difference" and "time difference". There is also a "phase difference" in sounds containing more low-frequency components. At the same time, the human head still has a certain masking effect on the sound to produce "tone color difference". Then, the foregoing phase information can be understood as the “intensity difference”, “time difference”, or “tone color difference” of the sound.

It can be understood that, as a way, the audio content of the left channel and the audio content of the right channel can be included in the action sound output path. Then, as a way, if phase information is detected, enhancing the sound effect of the audio transmitted on the target audio output path according to the phase information may include:

The difference of the parameters of the audio content transmitted by the left channel and the right channel in the action sound effect output path is enhanced to enhance the sound effect of the action sound effect transmitted by the target audio output path.

It can be understood that, in the audio output channel for transmitting motion sound effects, the audio content transmitted by the left and right channels included is the same. For example, for the walking sound effect of the game character "咚咚咚", both the left and right channels transmit the sound effect "咚咚咚". However, if it is detected that the transmitted sound effect has corresponding phase information, then the parameters corresponding to the audio content transmitted by the left and right channels included in the audio output path for transmitting the motion sound effect will be different. The parameters may include sound intensity, sound time, and sound color.

For example, if the walking sound currently representing "咚咚咚" is transmitted from the left side of the position of the user of the electronic device in the game interface scene to the user, the "的" transmitted by the left channel may be transmitted The sound intensity of the sound is set higher than the sound intensity of the sound of "传输" transmitted in the right channel. Still alternatively, the sound time of the sound of “咚咚咚” transmitted on the left channel may be earlier in time than the sound time of the sound of “咚咚咚” transmitted on the right channel. Then, in this case, enhancing the sound effect of the action sound effect transmitted by the target audio output path can be achieved by increasing the difference between the sound intensity of the sound transmitted from the left channel and the sound intensity of the sound transmitted from the right channel. This can be achieved by increasing the time difference between the sound time of the sound transmitted by the left channel and the sound time of the sound transmitted by the right channel.

Among them, as a method, increasing the difference between the parameters corresponding to the audio content transmitted by the left channel and the right channel will cause more power consumption, so for the aforementioned left channel and right channel, The specific increase in the difference between the parameters corresponding to the audio content transmitted by the channels can be determined in multiple ways.

Optionally, it may be determined according to the current audio output device of the electronic device. Among them, if the audio output device is a speaker or a speaker provided by an electronic device, the sound played by the speaker and the speaker usually needs to propagate a certain distance in the air before reaching the user's ear, so in order to facilitate this situation Next, to ensure the effect of sound enhancement, the difference between the parameters corresponding to the audio content transmitted by the left and right channels can be increased by a first threshold (the first threshold here is greater than the second involved in the subsequent Threshold).

Furthermore, if the audio output device is an audio output device such as a headset that can be directly worn in the user's ear, the sound played is usually directly transmitted to the user's ear, and does not need to travel a distance in the air, then In this case, the user can more sensitively identify the difference between the sound of the left channel (played by headphones worn in the left ear) and the sound of the right channel (played by headphones worn in the right ear). In this case, the difference between the parameters corresponding to the audio content transmitted by the left and right channels may be increased by a second threshold, where the second threshold is smaller than the aforementioned first threshold.

Then through the above method, the degree of difference between the parameters corresponding to the audio content transmitted by the left channel and the right channel can be flexibly determined according to the current audio output device of the electronic device, so that the maximum degree of While ensuring sound enhancement, save power.

As for increasing the parameters of the left channel to increase the difference between the parameters corresponding to the audio content transmitted by the left and right channels, or increasing the parameters of the right channel to increase the left and right channels, The electronic device can also determine the difference between the parameters corresponding to the audio content transmitted by the channels in various ways.

For example, when the audio output device is a headset, optionally, the headset includes a left headset and a right headset. If it is detected that the left headset is worn on the right ear and the right headset is worn on the left ear, then a guarantee is detected. In the case of the "咚咚咚" walking sound on the left, the difference between the parameters corresponding to the audio content transmitted by the left and right channels can be increased by increasing the parameters of the right channel; if In the case where a walking sound of "保证" with a guaranteed right is detected, the parameters of the left channel and the right channel can be increased by increasing the parameters of the left channel by increasing the parameters of the left channel. The difference in value, thereby avoiding the wrong direction judgment caused by the user turning the headset back.

It should be noted that, for enhancing the difference between the parameters corresponding to the audio content transmitted by the left channel and the right channel, the parameter corresponding to the audio content transmitted by the left channel may be enhanced to achieve enhancement. The difference between the parameters corresponding to the audio content transmitted by the left channel and the right channel can also be achieved by reducing the value of the parameter corresponding to the audio content transmitted by the right channel. In this manner, this application does not specifically limit.

It can be understood that the principle of the action sound effect to be enhanced in other directions is similar to the foregoing, and is not repeated here.

A method for processing sound effects provided by this application is to obtain a current audio output scene. In the case where the audio output scene corresponds to multiple audio output channels, and each of the audio output channels is used to transmit different audio, from Among the plurality of audio output channels, a target audio output channel corresponding to the audio output scene is determined, and then the audio effect of the audio transmitted by the target audio output channel is enhanced, so that the electronic device can remove the audio from the audio according to the current audio output scene. The output scene corresponds to multiple audio output channels for selective audio enhancement, which improves the flexibility of audio effects processing, which in turn can improve the user experience.

Please refer to FIG. 4, a sound effect processing method provided in this application is applied to an electronic device, and the method includes:

Step S210: Acquire a current audio output scene, where the audio output scene corresponds to multiple audio output channels, and each of the audio output channels has a different audio type for transmission.

Step S220: Acquire an associated electronic device associated with the electronic device.

As a way to obtain an associated electronic device associated with the electronic device, the electronic device may obtain an associated user account associated with a user account bound to the electronic device; obtain a reference associated electronic device bound with the associated user account Device; selecting a device in the same local area network as the electronic device from the reference associated electronic device as the associated electronic device.

For example, as shown in FIG. 5, in the network structure shown in FIG. 5, the electronic device 95 and the electronic device 94 access the server 90 through the same wireless access point 92, and the electronic device 93 accesses through the wireless access point 91. To server 90. Then, if the first user account bound by the electronic device 95, the second user account bound by the electronic device 94, and the third user account bound by the electronic device 93 are all allocated by the server 90 as a game group, After the information is sent to the electronic device 95, the electronic device 94, and the electronic device 93, the electronic device 95 can identify the second user account and the third user account as associated user accounts associated with the first user account to which it is bound. Then, it can be identified that the electronic device 94 bound to the second user account and the electronic device 95 bound to the third user account are reference-related electronic devices associated with them.

Further, as a way, in order for the server to identify different electronic devices in the same local area network, the electronic device may upload its own local area network IP address or its own MAC address to the server after establishing a communication connection with the server. In order to serve as the device identification of the electronic device.

Then in this case, when the server sends the associated user account associated with the user account to which it is bound to each electronic device, the server sends the device identifier of the electronic device bound to the associated user account to each electronic device. device. If the device identification is a local area network IP address, the electronic device can identify whether there is a device in the same local area network as the electronic device according to the received local area network IP address.

Step S230: Obtain a target audio output path determined by the associated electronic device when the audio output scene is displayed.

Step S240: Determine a target audio output channel corresponding to the audio output scene according to a target audio output channel determined by the associated electronic device, where the target audio output channel is an audio that needs to be enhanced in the multiple audio output channels. Output path.

Among them, as a method, the electronic device can keep the target audio path determined by itself and the target audio path determined by the associated electronic device the same, so as to achieve the same sound effect enhancement effect for users of electronic devices in the same local area network.

Furthermore, in some scenarios, it can also be achieved that the target audio path determined by the electronic device and the associated electronic device is different. For example, for some combat games, when in a combat scenario, the user interface and background music of the same group are the same.

Then, in this case, the bound accounts are in the same group, and the connected wireless access points are the same, then the electronic device can determine that these users are closer to each other, so as a way to save power In this way, the electronic device can enhance the action sound effect, and the associated electronic device can enhance the background music, and vice versa. Or, if there is another associated electronic device, the other associated electronic device can be used to enhance the character voice. Therefore, without the need for the electronic device to perform sound enhancement on multiple audio output channels, users of the electronic device can still experience the effects brought by the simultaneous enhancement of multiple audio output channels.

For example, as shown in FIG. 5, if the character A is a character corresponding to the user account bound to the electronic device, the character B is a character corresponding to the user account bound to the associated electronic device. Then both character A and character B are currently in the same game scene, then their corresponding sound effects and background music can be the same. Then in this case, the electronic device can be enhanced with the action sound effect, and the associated electronic device can be enhanced with the background music.

Step S250: Enhance the sound effect of the audio transmitted by the target audio output path.

It can be understood that, for the associated electronic devices in the same local area network, the associated electronic devices may be disconnected from the wireless access point for some reason, or the associated electronic devices may be disconnected from the data interaction with the server. It may also cause the associated electronic device to fail to synchronize the display interface with the electronic device, which may also cause the audio enhancement effect to fail to synchronize. In this case, as a way, the target audio output determined according to the associated electronic device is After the step of determining a target audio output path corresponding to the audio output scene, the method further includes: if it is detected that the status information of the associated electronic device meets a preset condition, adding the target audio path determined by the electronic device to the target audio path. The target audio output path determined by the associated electronic device. The preset condition is used to indicate that the associated electronic device cannot perform interface synchronous display with the electronic device.

For example, the network environment shown in FIG. 6 is used as an example for description. If the electronic device 95 recognizes that the electronic device 94 is an associated electronic device, and if the target audio output path determined by the electronic device 95 is an audio path of an output sound effect type, and the target audio output path determined by the electronic device 94 is an output background music type Audio path. Then when the electronic device 95 detects that the electronic device 94 meets the above preset conditions, in addition to continuing to determine the audio path of the output sound effect type as the target audio path, it also determines the audio path of the output background music type as a target audio path. , So that both background music and sound effects are enhanced. As a result, the electronic device can flexibly adjust the target audio communication network when it detects that the associated electronic device cannot display the picture synchronously with itself, so as to improve the user experience.

Wherein, if it is detected that the status information of the associated electronic device meets a preset condition, the method includes:

If it is detected that the associated electronic device is disconnected from the electronic device; if it is detected that the power of the associated electronic device is lower than a set value; or if it is detected that the associated electronic device switches the wireless access hotspot.

Optionally, if the electronic device receives the associated electronic device sent by the server and exits the user group originally allocated, it determines that the associated electronic device releases the association relationship with the electronic device. Optionally, if the electronic device receives the power alarm prompt information of the associated electronic device sent by the server, it is determined that the power of the associated electronic device is lower than a set value. Alternatively, after detecting that the server sends a prompt message to the electronic device when the network segment corresponding to the local area network IP address of the previously associated electronic device changes, it is determined that the associated electronic device has switched to a wireless access hotspot.

In addition, in addition to detecting that the associated electronic device is unable to perform screen synchronization, the determined target audio output path is adjusted according to the foregoing principles, and may also be adjusted according to the audio output situation of the associated electronic device or other parameters.

Optionally, if it is detected that the power of the associated electronic device is lower than the set threshold, the target audio output path may be adjusted according to the foregoing manner. For example, if the power of the associated electronic device is lower than the set value, in order to reduce the power consumption of the associated electronic device, the electronic device can enhance the playback of the audio originally enhanced by the associated electronic device. Alternatively, if it is detected that the associated electronic device has turned off the audio output or switched the audio output to the headphone mode, the target audio output path may also be adjusted according to the foregoing manner.

It should be noted that, in order to facilitate the electronic device to obtain the audio output status, network status, or power status of the associated electronic device in real time, and to facilitate the associated electronic device to obtain the audio output status, network status, or power status of the electronic device in real time. As a method, the electronic device or associated electronic device may upload its own audio output status, network status, or power status at a preset frequency after the data communication is established with the server, so that the server outputs the audio output uploaded by the electronic device. Forward the status, network status, or power status to other associated electronic devices, or forward the audio output status, network status, or power status uploaded by the associated electronic device to the electronic device.

A sound effect processing method provided by the present application is obtained by acquiring a current audio output scene, and in a case where the audio output scene corresponds to multiple audio output channels, and each of the audio output channels is used to transmit different audio, The associated electronic device associated with the electronic device obtains the target audio path determined by the associated electronic device, and then determines the target corresponding to the audio output scene from the multiple audio output channels according to the target audio path determined by the associated electronic device. The audio output channel further enhances the audio effect of the audio transmitted by the target audio output channel, so that the electronic device can selectively enhance the sound effect from multiple audio output channels corresponding to the audio output scene according to the current audio output scene. The flexibility of sound effects processing can further improve the user experience.

Referring to FIG. 7, this application provides a sound effect processing device 300 that runs on an electronic device. The device 300 includes: an audio scene acquisition unit 310, a target determination unit 320, and a sound effect processing unit 330.

The audio scene obtaining unit 310 is configured to obtain a current audio output scene, where the audio output scene corresponds to multiple audio output channels, and each of the audio output channels is used to transmit different audio types.

A target determining unit 320 is configured to determine, from the multiple audio output channels, a target audio output channel corresponding to the audio output scene, where the target audio output channel is one of the multiple audio output channels that needs to be enhanced by sound effects. Audio output path.

As a method, the target determination unit 320 is specifically configured to determine the action sound output path among the multiple audio output paths as the target audio output path if the audio scene acquisition unit 310 acquires the audio output scene as a game interface scene. .

As another way, the target determining unit 320 is further configured to determine, if the audio scene acquiring unit 310 obtains the current audio output scene as an audio scene, a character sound output path among the multiple audio output paths as the target audio. An output path; or, if the audio scene acquisition unit 310 acquires that the current audio output scene is a video playback scene, determine the background music output path among the multiple audio output paths as the target audio output path.

The sound effect processing unit 330 is configured to enhance the sound effect of the audio transmitted by the target audio output path.

As a method, if the audio scene acquisition unit 310 acquires that the audio output scene is a game interface scene, the action sound output path among the multiple audio output paths is determined as the target audio output path.

Correspondingly, the sound effect processing unit 330 is specifically configured to detect whether the audio transmitted by the target audio output path has phase information; if phase information is detected, enhance the transmission of the target audio output path according to the phase information. Audio sound effects.

A sound effect processing device provided by the present application obtains a current audio output scene. In the case where the audio output scene corresponds to multiple audio output channels, and each of the audio output channels is used to transmit different audio, Among the plurality of audio output channels, a target audio output channel corresponding to the audio output scene is determined, and then the audio effect of the audio transmitted by the target audio output channel is enhanced, so that the electronic device can remove the audio from the audio according to the current audio output scene. The output scene corresponds to multiple audio output channels for selective audio enhancement, which improves the flexibility of audio effects processing, which in turn can improve the user experience.

Referring to FIG. 8, this application provides a sound effect processing apparatus 400 that runs on an electronic device. The apparatus 400 includes: an audio scene acquisition unit 410, an associated device acquisition unit 420, an associated path acquisition unit 430, a target determination unit 440, and Sound effect processing unit 450.

The audio scene obtaining unit 410 is configured to obtain a current audio output scene, where the audio output scene corresponds to multiple audio output channels, and each of the audio output channels is used to transmit different audio types.

An associated device obtaining unit 420 is configured to obtain an associated electronic device associated with the electronic device.

As one way, the associated device obtaining unit 420 is specifically configured to obtain an associated user account associated with a user account bound to the electronic device; obtain a reference associated electronic device bound with the associated user account; and from the reference Among the associated electronic devices, a device in the same local area network as the electronic device is selected as the associated electronic device.

The associated path acquisition unit 430 is configured to acquire a target audio output path determined by the associated electronic device when the audio output scene is displayed.

The target determining unit 440 is configured to determine a target audio output path corresponding to the audio output scene according to a target audio output path determined by the associated electronic device.

The target determining unit 440 is further configured to add a target audio output path determined by the associated electronic device to a target audio path determined by the electronic device if it is detected that the status information of the associated electronic device meets a preset condition.

Optionally, if it is detected that the status information of the associated electronic device meets a preset condition, the method includes:

If it is detected that the associated electronic device releases the association relationship with the electronic device;

If it is detected that the power of the associated electronic device is lower than a set value; or

If it is detected that the associated electronic device switches a wireless access hotspot.

The sound effect processing unit 450 is configured to enhance the sound effect of the audio transmitted by the target audio output path.

A sound effect processing device provided by the present application is obtained by acquiring a current audio output scene. In the case where the audio output scene corresponds to multiple audio output channels, and each of the audio output channels is used to transmit different audio, The associated electronic device associated with the electronic device obtains the target audio path determined by the associated electronic device, and then determines the target corresponding to the audio output scene from the multiple audio output channels according to the target audio path determined by the associated electronic device. The audio output channel further enhances the audio effect of the audio transmitted by the target audio output channel, so that the electronic device can selectively enhance the sound effect from multiple audio output channels corresponding to the audio output scene according to the current audio output scene. The flexibility of sound effects processing can further improve the user experience.

It should be noted that those skilled in the art can clearly understand that, for the convenience and brevity of the description, the specific working processes of the devices and units described above can refer to the corresponding processes in the foregoing method embodiments, and are not repeated here. . In the several embodiments provided in this application, the coupling between the modules may be electrical, mechanical, or other forms of coupling. In addition, each functional module in each embodiment of the present application may be integrated into one processing module, or each module may exist separately physically, or two or more modules may be integrated into one module. The above integrated modules may be implemented in the form of hardware or software functional modules.

It should be noted that, in the present application, specifically how to encode audio data according to the type of audio encoding can use existing technology, which will not be described in detail in this application.

In summary, a sound effect processing method, device, electronic device, and storage medium provided in this application, by obtaining a current audio output scene, there are multiple audio output channels corresponding to the audio output scene, and each of the audio When the output channel is used to transmit different audio, determining a target audio output channel corresponding to the audio output scene from the multiple audio output channels, and then enhancing the audio effect of the audio transmitted by the target audio output channel, As a result, the electronic device can selectively perform sound enhancement from multiple audio output channels corresponding to the audio output scene according to the current audio output scene, improving the flexibility of sound effect processing, and further improving the user experience.

An electronic device provided in the present application will be described below with reference to FIG. 9.

Referring to FIG. 9, based on the foregoing sound effect processing method and device, another embodiment of the present application further provides an electronic device 100 that can execute the foregoing terminal control method. The electronic device 100 includes one or more processors (only one is shown in the figure), a memory 104, a wireless module 106, and an audio module 108 that are coupled to each other. The memory 104 stores a program that can execute the content in the foregoing embodiment, and the processor 102 can execute the program stored in the memory 104.

The processor 102 may include one or more processing cores. The processor 102 uses various interfaces and lines to connect various parts of the entire electronic device 100, and executes or executes instructions, programs, code sets, or instruction sets stored in the memory 104 by calling or executing data stored in the memory 104 to execute Various functions and processing data of the electronic device 100. Optionally, the processor 102 may use at least one of Digital Signal Processing (DSP), Field-Programmable Gate Array (FPGA), and Programmable Logic Array (PLA). To implement a hardware form. The processor 102 may integrate one or a combination of a central processing unit (Central Processing Unit), a graphics processor (Graphics Processing Unit, GPU), and a modem. Among them, the CPU mainly handles the operating system, user interface, and target applications; the GPU is responsible for rendering and rendering of the displayed content; the modem is used for wireless communication. It can be understood that the modem may not be integrated into the processor 102, and may be implemented by a communication chip alone.

The memory 104 may include random access memory (Random Access Memory, RAM), and may also include read-only memory (Read-Only Memory). The memory 104 may be used to store instructions, programs, codes, code sets, or instruction sets. The memory 104 may include a storage program area and a storage data area. For example, the memory 104 may store a sound effect processing device. The sound effect processing device may be the aforementioned device 300 or the device 400. The storage program area may store instructions for implementing an operating system, instructions for implementing at least one function (such as a touch function, a sound playback function, an image playback function, etc.), and instructions for implementing the following method embodiments. Wait. The storage data area may also store data (such as phonebook, audio and video data, and chat history data) created by the terminal 100 during use.

The wireless module 106 is used to receive and send electromagnetic waves, and realize the mutual conversion of electromagnetic waves and electrical signals, so as to communicate with a communication network or other equipment, such as communicating with audio playback equipment. The wireless module 106 may include various existing circuit elements for performing these functions, such as an antenna, a radio frequency transceiver, a digital signal processor, an encryption / decryption chip, a subscriber identity module (SIM) card, a memory, and the like . The wireless module 106 can communicate with various networks, such as the Internet, an intranet, and a wireless network, or communicate with other electronic devices through a wireless network. The wireless network may include a cellular telephone network, a wireless local area network, or a metropolitan area network. The above-described wireless networks may use various communication standards, protocols and technologies, including but not limited to IEEE 802 protocol and the Bluetooth protocol, this protocol may even including those not yet been developed.

Furthermore, the audio module 108 can be used to process audio output by an application program running in the electronic device 100. For example, the audio module 108 may receive audio processing parameters obtained by the wireless module 106 from other electronic devices, and then adjust the audio processing parameters of the audio module 108.

Please refer to FIG. 10, which shows a structural block diagram of a computer-readable storage medium provided by an embodiment of the present application. The computer-readable medium 800 stores program code, and the program code can be called by a processor to execute the method described in the foregoing method embodiment.

The computer-readable storage medium 800 may be an electronic memory such as a flash memory, an EEPROM (Electrically Erasable Programmable Read-Only Memory), an EPROM, a hard disk, or a ROM. Optionally, the computer-readable storage medium 800 includes a non-transitory computer-readable storage medium. The computer-readable storage medium 800 has a storage space for program code 810 that performs any of the method steps in the above-described methods. These program codes can be read from or written into one or more computer program products. The program code 810 may be compressed, for example, in a suitable form.

For the purposes of this specification, a "computer-readable medium" may be any device that can contain, store, communicate, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device. More specific examples (non-exhaustive list) of computer readable media include the following: electrical connections (electronic devices) with one or more wirings, portable computer disk enclosures (magnetic devices), random access memory (RAM), Read-only memory (ROM), erasable and editable read-only memory (EPROM or flash memory), fiber optic devices, and portable optical disk read-only memory (CDROM). In addition, the computer-readable medium may even be paper or other suitable medium on which the program can be printed, because, for example, by optically scanning the paper or other medium, followed by editing, interpretation, or other suitable Processing to obtain the program electronically and then store it in computer memory.

Finally, it should be noted that the above embodiments are only used to describe the technical solution of the present application, rather than limiting it. Although the present application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that they can still Modifications to the technical solutions described in the foregoing embodiments, or equivalent replacements of some of the technical features thereof; and these modifications or replacements do not drive the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application.

Claims

A sound effect processing method, which is characterized in that the method is applied to an electronic device, and the method includes:

Acquiring a current audio output scene, where the audio output scene corresponds to multiple audio output channels, and each of the audio output channels is used to transmit different audio types;

Determining, from the plurality of audio output channels, a target audio output channel corresponding to the audio output scene, where the target audio output channel is an audio output channel that requires sound enhancement among the plurality of audio output channels;

Enhancing the sound effect of the audio transmitted by the target audio output path.
The method according to claim 1, wherein the step of determining a target audio output path corresponding to the audio output scene from the plurality of audio output paths comprises:

If the current audio output scene is a game interface scene, determine an action audio output path among the plurality of audio output paths as a target audio output path.
The method according to claim 2, wherein the step of enhancing a sound effect of audio transmitted by the target audio output path comprises:

Detecting whether the audio transmitted by the target audio output path has phase information;

If phase information is detected, the sound effect of the audio transmitted on the target audio output path is enhanced according to the phase information.
The method according to any one of claims 2-3, wherein the action sound output path includes audio content of a left channel and audio content of a right channel, and if phase information is detected, The step of enhancing the sound effect of the audio transmitted on the target audio output path by the phase information includes:

Increasing the difference between the parameters of the audio content transmitted by the left channel and the right channel in the action sound effect output path to enhance the sound effect of the action sound effect transmitted by the target audio output path, wherein the Parameters include sound intensity, sound time, and sound tone.
The method according to claim 4, wherein the step of increasing the difference between the parameters of the audio content transmitted by the left channel and the right channel in the action sound effect output path comprises:

Get the current audio output device type of the electronic device;

Determining, according to the type of the audio output device, a difference between a parameter corresponding to the audio content transmitted by the left channel and the right channel by an increase threshold.
The method according to claim 5, characterized in that the difference between the parameters corresponding to the audio content transmitted by the left channel and the right channel is determined according to the type of the audio output device The steps to increase the threshold include:

If the audio output device is a built-in speaker, increasing a difference between parameters corresponding to the audio content transmitted by the left channel and the right channel by a first threshold value;

If the audio output device is an audio output device directly worn in the user's ear, increasing the difference between the parameters corresponding to the audio content transmitted by the left channel and the right channel by a second threshold , The second threshold is smaller than the first threshold.
The method according to claim 5, characterized in that if the sound effect output device is a headphone, the earphone includes a left earphone and a right earphone, and increasing the left channel and the right channel in the action sound output path The steps of the difference of the parameters of the respective transmitted audio content include:

If it is detected that the left earphone is worn on the right ear, and the right earphone is worn on the left ear, if a sound is detected on the left side, increase the parameters of the right channel to increase the left channel and A difference between parameters corresponding to the audio content respectively transmitted by the right channels;

If sound is detected on the right side, by increasing the parameters of the left channel, the difference between the parameters corresponding to the audio content transmitted by the left channel and the right channel is increased.
The method according to claim 2, wherein the step of determining a target audio output path corresponding to the audio output scene from the plurality of audio output paths further comprises:

If the current audio output scene is an audio scene, determining a person sound output path among the plurality of audio output paths as a target audio output path;

If the current audio output scene is a video playback scene, a background music output path among the multiple audio output paths is determined as a target audio output path.
The method according to claim 1, wherein the step of determining a target audio output path corresponding to the audio output scene from the plurality of audio output paths comprises:

Displaying an audio control control of an interface corresponding to the audio output scene, the audio control control being used by a user to adjust a target audio output path, and different audio control controls correspond to different target audio output paths;

Obtaining a touch operation of the audio control control;

A target audio output path corresponding to the audio control control is determined according to the touch operation.
The method according to claim 1, wherein the step of determining a target audio output path corresponding to the audio output scene from the plurality of audio output paths comprises:

Acquiring an associated electronic device associated with the electronic device;

Obtaining a target audio output path determined by the associated electronic device when displaying the audio output scene;

Determining a target audio output path corresponding to the audio output scene according to the target audio output path determined by the associated electronic device.
The method according to claim 10, wherein the step of obtaining an associated electronic device associated with the electronic device comprises:

Obtaining an associated user account associated with a user account bound to the electronic device;

Obtaining a reference associated electronic device to which the associated user account is bound;

A device in the same local area network as the electronic device is selected from the reference associated electronic devices as the associated electronic device.
The method according to claim 11, wherein when the obtaining an associated user account associated with a user account bound to the electronic device further comprises:

Obtaining a device identifier of an electronic device bound to the associated user account;

The step of selecting a device in the same local area network as the associated electronic device from the reference associated electronic device includes:

A device that is in the same local area network as the electronic device is selected as the associated electronic device from the reference associated electronic device based on the device identification.
The method according to claim 12, wherein the device identifier comprises a local area network IP address, and the device associated with the electronic device on the same local area network as the electronic device is selected as an association from the reference associated electronic device based on the device identifier. The steps of the electronic device include:

Detecting whether the local area network IP address is consistent with the local area network IP address where the electronic device is located;

If they are the same, the device in the same local area network as the electronic device is regarded as the associated electronic device.
The method according to claim 10, wherein after the step of determining a target audio output path corresponding to the audio output scene according to the target audio output path determined by the associated electronic device, further comprising:

If it is detected that the status information of the associated electronic device meets a preset condition, a target audio output path determined by the associated electronic device is added to a target audio path determined by the electronic device.
The method according to claim 14, wherein if the state information of the associated electronic device is detected to meet a preset condition comprises:

If it is detected that the associated electronic device releases the association relationship with the electronic device;

If it is detected that the power of the associated electronic device is lower than a set value; or

If it is detected that the associated electronic device switches a wireless access hotspot.
The method according to claim 1, wherein the step of obtaining a current audio output scene comprises:

Get the currently running application;

The current audio output scene is determined according to the type of the application.
The method according to claim 16, wherein the step of determining a current audio output scene according to the type of the application comprises:

If the application is a game application, determine that the current audio output scene is a game interface scene;

If the application is a music playback application, determining that the current audio output scene is a music playback scene;

If the application is a video application, determine that the current audio output scene is a video playback scene.
A sound effect processing device, characterized in that it runs on electronic equipment, and the device includes:

An audio scene obtaining unit, configured to obtain a current audio output scene, where the audio output scene corresponds to multiple audio output channels, and each of the audio output channels is used to transmit different audio types;

A target determining unit is configured to determine, from the multiple audio output channels, a target audio output channel corresponding to the audio output scene, where the target audio output channel is an audio that needs to be enhanced in the multiple audio output channels. Output path

A sound effect processing unit, configured to enhance the sound effect of the audio transmitted by the target audio output path.
An electronic device, comprising one or more processors and a memory;

One or more programs are stored in the memory and configured to be executed by the one or more processors, and the one or more programs are configured to perform the method of any one of claims 1-17.
A computer-readable storage medium, characterized in that the computer-readable storage medium stores program code, wherein the method according to any one of claims 1-17 is executed when the program code is run by a processor.