CN109107158B - Sound effect processing method and device, electronic equipment and computer readable storage medium - Google Patents
Sound effect processing method and device, electronic equipment and computer readable storage medium Download PDFInfo
- Publication number
- CN109107158B CN109107158B CN201811028137.2A CN201811028137A CN109107158B CN 109107158 B CN109107158 B CN 109107158B CN 201811028137 A CN201811028137 A CN 201811028137A CN 109107158 B CN109107158 B CN 109107158B
- Authority
- CN
- China
- Prior art keywords
- audio output
- audio
- channel
- scene
- electronic equipment
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/50—Controlling the output signals based on the game progress
- A63F13/54—Controlling the output signals based on the game progress involving acoustic signals, e.g. for simulating revolutions per minute [RPM] dependent engine sounds in a driving game or reverberation against a virtual wall
Abstract
The embodiment of the application discloses a sound effect processing method and device and electronic equipment. The method comprises the following steps: acquiring a current audio output scene, wherein the audio output scene corresponds to a plurality of audio output channels, and the audio types of the audio output channels for transmission are different; determining a target audio output channel corresponding to the audio output scene from the plurality of audio output channels, wherein the target audio output channel is an audio output channel needing sound effect enhancement in the plurality of audio output channels; enhancing the sound effect of the audio transmitted by the target audio output channel. The method enables the electronic equipment to selectively enhance the sound effect from the plurality of audio output channels corresponding to the audio output scene according to the current audio output scene, and can independently distribute the sound effect processing algorithm to each channel, thereby enhancing the sound effect processing effect, improving the flexibility of sound effect processing and further improving the user experience.
Description
Technical Field
The present disclosure relates to the field of electronic devices, and more particularly, to a sound effect processing method and apparatus, and an electronic device.
Background
With the rapid development of terminal technology, electronic devices such as mobile phones and tablet computers have become an indispensable part of people's lives. People can not only use the electronic equipment to make daily calls, send short messages and other functions, but also use the electronic equipment to run various application programs, such as game application programs, web browsing application programs, audio and video playing application programs and the like. However, in the running process of the application program, flexibility of sound effect adjustment of the output audio of the application program and user experience are still to be improved.
Disclosure of Invention
In view of the foregoing problems, the present application provides a sound effect processing method, device and electronic device to improve the foregoing problems.
In a first aspect, the present application provides a sound effect processing method applied to an electronic device, the method including: acquiring a current audio output scene, wherein the audio output scene corresponds to a plurality of audio output channels, and the audio types of the audio output channels for transmission are different; determining a target audio output channel corresponding to the audio output scene from the plurality of audio output channels, wherein the target audio output channel is an audio output channel needing sound effect enhancement in the plurality of audio output channels; enhancing the sound effect of the audio transmitted by the target audio output channel.
In a second aspect, the present application provides an audio processing apparatus, operating on an electronic device, the apparatus comprising: the audio scene acquisition unit is used for acquiring a current audio output scene, the audio output scene corresponds to a plurality of audio output channels, and the audio types of the audio output channels for transmission are different; the target determining unit is used for determining a target audio output channel corresponding to the audio output scene from the plurality of audio output channels, wherein the target audio output channel is an audio output channel needing sound effect enhancement in the plurality of audio output channels; and the sound effect processing unit is used for enhancing the sound effect of the audio transmitted by the target audio output channel.
In a third aspect, the present application provides an electronic device comprising one or more processors and a memory; one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs configured to perform the methods described above.
In a fourth aspect, the present application provides a computer-readable storage medium having a program code stored therein, wherein the program code performs the above method when running.
The application provides a sound effect processing method, device and electronic equipment, through obtaining current audio output scene corresponds there are a plurality of audio output passageways, every under the audio output passageway is used for the different circumstances of the audio frequency of transmission, follow in a plurality of audio output passageways, confirm the target audio output passageway that audio output scene corresponds strengthens again the audio of the audio that target audio output passageway transmitted to make electronic equipment can correspond from audio output scene according to current audio output scene and have a plurality of audio output passageways selectivity carry out the sound effect reinforcing, and can independently distribute the sound effect processing algorithm to every passageway, strengthened the sound effect treatment effect, promoted the flexibility of sound effect processing, and then can promote user experience.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
FIG. 1 is a flow chart of an audio processing method proposed in the present application;
FIG. 2 shows a schematic view of another interface proposed by the present application;
FIG. 3 shows a schematic diagram of yet another interface proposed by the present application;
FIG. 4 is a flow chart of another sound effect processing method proposed in the present application;
FIG. 5 shows a schematic view of an interface proposed by the present application;
FIG. 6 is a schematic diagram of a network environment proposed by the present application;
FIG. 7 is a block diagram of an audio processing apparatus according to the present application;
FIG. 8 is a block diagram showing another audio effect processing device proposed in the present application;
fig. 9 shows a block diagram of an electronic device proposed in the present application;
FIG. 10 is a storage unit for storing or carrying program codes for implementing sound effect processing methods according to embodiments of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
The sound effect can be a sound which is everywhere in our lives. Sound effects such as footsteps while walking, squeaks while opening doors, opening and closing doors of elevators, etc. permeate every corner of our lives.
Sound effects are also ubiquitous in electronic devices. For example, when the electronic device is started, a start sound effect may be accompanied, when the electronic device is turned off, a turn-off sound effect may be accompanied, and when the power of the electronic device is insufficient, the electronic device may also give an alarm sound effect.
But also for applications running in the electronic device. For example, the application program of game class can generate game sound effect during running. The game sound effect refers to effect music played when a specific action occurs or a specific operation is performed in the electronic game. Such as a sound when a bullet is shot, a cry when a monster dies, a "clickly" sound when a button is clicked, and the like. Formally, the existence of the game sound effect enables the user to have more real experience when playing the game.
It will be appreciated that in addition to the sound effects of the game type application described above, sound effects may be present in other types of applications. For example, the audio/video sound effect of the audio/video playing application program in the audio/video playing process, the sound effect of the web browsing application program in the web content loading process, and the like.
However, the inventor finds that the sound effect of a part of the audio output scene is usually enhanced in the electronic device to enhance the user experience. However, the current sound effect enhancement mode still lacks certain flexibility, thereby affecting the effect of sound effect enhancement and causing poor user experience. Therefore, the inventor provides the sound effect processing method, the sound effect processing device and the electronic equipment, which can improve the flexibility of sound effect enhancement and improve the user experience.
Embodiments of the present application will be described in detail below with reference to the accompanying drawings.
Referring to fig. 1, a sound effect processing method provided by the present application is applied to an electronic device, and the method includes:
step S110: the method comprises the steps of obtaining a current audio output scene, wherein the audio output scene corresponds to a plurality of audio output channels, and the audio output channels are different in audio type for transmission.
It can be understood that, in the operation process of the electronic device, there are many scenes in which audio is output. For example, when the electronic device runs a game-like application, a game interface scene is displayed, and audio output such as game sound effects, game background music, or key tones may exist in the game interface scene. Wherein, the game sound effect comprises the action sound effect of the game character, the sound effect of the speaking sound of the game character and the sound effect sent by other NPC (non Player character) characters.
For another example, when the electronic device runs an audio application, an audio playing scene in which an ambient sound effect exists is displayed. When the electronic equipment runs a video application program, a video picture playing scene can be displayed, and the sound effect of the speaking sound of a person, the environmental sound effect and the like can exist in the video picture playing scene.
It should be noted that the audio output scenario described above is only exemplary and is not intended to limit the present application. The present application may also include audio output scenarios other than the audio output scenarios of the above examples.
Then the electronic device may determine the current audio output scene in a number of ways based on the above. Alternatively, the electronic device may determine the current audio output scenario by querying the application currently running. As one mode, if the electronic device is an Android operating system, the name of the application program currently running in the foreground may be obtained by executing a getreporting tasks method of the ActivityManager. In addition, the electronic device may further acquire a list of programs used by the user through the usagetstatsmanager, and identify a most recently used application program recorded in the list as a current foreground application. Moreover, the Android can monitor the change of the focus of the window through the barrier-free function of the Android, and the package name corresponding to the focus window is taken as the application program which runs in the foreground at the present time.
After the electronic device obtains the currently running application program, the current audio output scene may be determined according to the type of the currently running application program. For example, if the application is a game-like application, then the current audio output scene may be determined to be a game interface scene. If the application program is a music playing application program, it may be determined that the current audio output scene is a music playing scene. If the application program is a video-type application program, it may be determined that the current audio output scene is a video playing scene.
One or more types of audio to be output are typically included in an audio output scenario. For example, in an audio output scene, such as a game interface scene, several audio types to be output may be included, such as sound effect, background music, and touch tone. In order to improve the effect of audio output, different audio output channels may be configured for different audio types of audio, so that the audio output scene corresponds to multiple audio output channels, and each audio output channel is used for transmitting different audio types.
The following describes the above with reference to the Android system as an example. In an electronic device of the Android operating system, 11 stream _ types (audio types) are defined, and can also be regarded as types of audio streams. And after the audio streams of the 11 defined stream _ types enter the Attribute, the electronic device arranges the audio streams into several types and then outputs the types, and each type corresponds to one audio output channel.
Step S120: and determining a target audio output channel corresponding to the audio output scene from the plurality of audio output channels, wherein the target audio output channel is an audio output channel needing sound effect enhancement in the plurality of audio output channels.
Alternatively, if the audio output from all the audio output channels is enhanced, a part of the audio may not be highlighted, and the audio-visual effect of the user may be poor. For example, in a game interface scene, the audio types include game sound effects, game background music, or touch tones. In a case where the game sound effect, the game background music, or the key sound and other types of audio are output through different audio output channels, if the game sound effect, the game background music, or the key sound and other types of audio are enhanced at the same time, the audio may be relatively cluttered.
In order to highlight the characteristics of the audio of a certain audio type in the case of multiple audio types, the target audio output channel corresponding to the audio output scene can be determined from the multiple audio output channels, so that only the audio transmitted in the target audio output channel can be subjected to sound effect enhancement.
Optionally, for different audio output scenes, the corresponding target audio output paths are different.
As a mode, if the current audio output scene is a game interface scene, the action sound effect output channel of the plurality of audio output channels is determined as a target audio output channel.
In the game interface scene, there may be an action of the game user walking in the scene. Accordingly, a situation that other users walk in the game interface scene may also exist in the game interface scene, and then there is a situation that the game user of the electronic device needs to determine the directions of the other users according to the situation that the other users walk in the game interface scene, so as to take measures to capture or kill the other game users. In this case, the walking condition of other users in the game interface scene can be judged through the action sound effect, so that the action sound effect output in the audio output channel can be enhanced under the condition that the action sound effect output channel in the plurality of audio output channels is determined as the target audio output channel, and the actions of other users can be clearly or more quickly identified by the user.
The specific type of action sound effect will be described below.
Optionally, the motion sound effect may include motion information and phase information. Wherein the motion information user identifies the type of action of a character in the game and the phase information is used to identify the direction in which the action is generated. For example, the user can hear the sound of "clattering-clattering" when the user walks in the game, and the user can judge that other game users walk by hearing the sound of "clattering-clattering". The phase information corresponding to the "clattering-clattering" sound enables a user of the electronic device to determine not only that another user is walking, but also the direction in which the other user is walking and the distance from the user.
Besides, if the current audio output scene is an audio scene, the character sound output path in the multiple audio output paths is determined as a target audio output path except for a game interface scene. And if the current audio output scene is a video playing scene, determining a background music output channel in the plurality of audio output channels as a target audio output channel.
Further, the target audio output path can be freely selected by the user in the manual mode. As a mode, an audio control may be displayed in an interface corresponding to an audio output scene displayed by the electronic device, and after it is detected that the user triggers the audio control, the electronic device may display a control interface in which a control for the user to adjust a target audio output path is displayed. It is understood that, in order to facilitate the adjustment of the user, the path may be replaced with words representing the effect in the control interface, so that the user can easily understand the effect corresponding to the different options.
For example, as shown in fig. 2, if the audio output scene is the illustrated game interface scene, the game interface scene corresponds to a game interface 99, and an audio control 98 is displayed on the game interface 99. Then when the user touches the audio control 98, as shown in fig. 3, a control interface 97 may be triggered to be displayed in suspension in interface 99. An audio effect selection control 96 is displayed in the control interface 97 so that a user can select a desired enhanced effect by operation of the audio effect selection control 96, thereby causing the electronic device to determine a target audio output channel. For example, if the user selects the enhanced action sound effect, the corresponding determined target audio output channel is a channel with the audio transmission type being a sound effect.
Step S130: enhancing the sound effect of the audio transmitted by the target audio output channel.
It can be understood that, by enhancing the sound effect of the audio transmitted by the target audio output channel, the sound effect of the audio transmitted by the target audio output channel can be more prominent, so as to enhance the user experience. As can be seen from the above, the motion effect may include motion information and phase information. Then, as a way of example, the step of enhancing the effect of the audio transmitted by the target audio output channel may include: detecting whether the audio transmitted by the target audio output channel has phase information or not; and if the phase information is detected, enhancing the sound effect of the audio transmitted by the target audio output channel according to the phase information.
It should be noted that the inventor found that the mechanism of human ear direction discrimination is simply generated by the cooperation of left and right ears, which is similar to how we can recognize distance by looking at objects with both eyes. The sound received by the ears has 'intensity difference' and 'time difference', the sound containing more low-frequency components has 'phase difference', and the human head has certain shielding effect on the sound to generate 'sound color difference'. Then the aforementioned phase information can be understood as "intensity difference", "time difference" or "sound color difference" of the sound.
It will be appreciated that, as one approach, the audio content of the left channel and the audio content of the right channel may be included in the motion-sound effect output path. As one way, if phase information is detected, enhancing the sound effect of the audio transmitted by the target audio output channel according to the phase information may include:
and enhancing the parameter difference of the audio contents transmitted by the left channel and the right channel in the action audio effect output channel so as to enhance the audio effect of the action audio effect transmitted by the target audio output channel.
It is understood that, in the audio output path for transmitting the action sound effect, the transmitted audio contents of the left channel and the right channel are the same. For example, for the moving sound effect of the game character, the sound effect is "clattering-clattering", and the sound effect is transmitted by the left channel and the right channel. However, if it is detected that the transmitted sound effect has corresponding phase information, the audio output path for transmitting the action sound effect includes parameters corresponding to the audio contents transmitted by the left channel and the right channel. Wherein the parameters may include sound intensity, sound time, sound timbre, and the like.
For example, if the moving sound of "clattering-dong" is currently transmitted to the user from the left side of the position of the electronic device user in the game interface scene in order to represent the moving sound of "clattering-dong", the sound intensity of the "clattering-dong" sound transmitted by the left channel may be set to be higher than the sound intensity of the "clattering-dong" sound transmitted by the right channel. Still alternatively, the sound time of the "clattering-clattering" sound transmitted by the left channel may be chronologically earlier than the sound time of the "clattering-clattering" sound transmitted by the right channel. In this case, then, the enhancement of the effect of the action sound transmitted to the target audio output channel can be achieved by increasing the difference in the sound intensity of the sound transmitted by the left channel and the sound intensity of the sound transmitted by the right channel, or by increasing the time difference in the sound time of the sound transmitted by the left channel and the sound time of the sound transmitted by the right channel in time series.
As one way, increasing the difference between the parameters corresponding to the audio contents transmitted by the left channel and the right channel may cause more power consumption, and then, how much the difference between the parameters corresponding to the audio contents transmitted by the left channel and the right channel is specifically enhanced may be determined in various ways.
Alternatively, the determination may be based on the current audio output device of the electronic device. If the audio output device is a sound box or a speaker of the electronic device, the sound played by the sound box and the speaker usually needs to travel a certain distance in the air before reaching the ear of the user, and in order to ensure the effect of sound effect enhancement under such a situation, the difference between the parameters corresponding to the audio contents transmitted by the left channel and the right channel may be enhanced by a first threshold (where the first threshold is greater than a second threshold related to the following).
Furthermore, if the audio output device is an audio output device such as an earphone that can be worn directly in the ear of the user, and the sound played by the audio output device is usually transmitted directly to the ear of the user, and does not need to be transmitted in the air for a certain distance, in this case, the user can more sensitively recognize the difference between the sound of the left channel (played by the earphone worn in the left ear) and the sound of the right channel (played by the earphone worn in the right ear), in this case, the difference between the parameters corresponding to the audio contents transmitted by the left channel and the right channel can be enhanced by a second threshold, where the second threshold is smaller than the first threshold.
Through the mode, the degree of enhancement of the difference value between the parameters corresponding to the audio contents transmitted by the left channel and the right channel respectively can be flexibly determined according to the current audio output equipment of the electronic equipment, so that the electric quantity is saved while the sound effect enhancement effect is ensured to the maximum extent.
The electronic device may also determine the difference between the parameters corresponding to the audio contents transmitted by the left channel and the right channel by increasing the parameter of the left channel, or increase the parameter of the right channel to increase the difference between the parameters corresponding to the audio contents transmitted by the left channel and the right channel.
For example, in the case where the audio output device is an earphone, if it is detected that the left earphone is worn on the right ear and the right earphone is worn on the left ear, when the left "clattering-clattering" walking sound is detected, the difference between the parameters corresponding to the audio contents transmitted by the left channel and the right channel can be increased by increasing the parameters of the right channel; if the walking sound of the right side which is ensured to be clattering-dong is detected, the difference value between the parameters corresponding to the audio contents transmitted by the left channel and the right channel can be increased by increasing the parameters of the left channel, so that the direction judgment error caused by the fact that the user brings the earphone back is avoided.
It should be noted that, for enhancing the difference between the parameters corresponding to the audio contents transmitted by the left channel and the right channel, the enhancement of the difference between the parameters corresponding to the audio contents transmitted by the left channel and the right channel may be implemented by increasing the parameters corresponding to the audio contents transmitted by the left channel, or may be implemented by decreasing the values of the parameters corresponding to the audio contents transmitted by the right channel, and what is specifically adopted is not specifically limited in the present application.
It is understood that the principle for enhancing the action sound effect in other directions is similar to the foregoing, and is not described in detail herein.
The application provides a pair of audio processing method, through obtaining current audio output scene correspondence has a plurality of audio output passageways, every under the audio output passageway is used for the different circumstances of audio frequency of transmission, follow among a plurality of audio output passageways, confirm the target audio output passageway that audio output scene corresponds strengthens again the audio of the audio that target audio output passageway transmitted to make electronic equipment can be according to current audio output scene from audio output scene correspondence has a plurality of audio output passageways in the selective audio enhancement that carries on, promoted the flexibility of audio processing, and then can promote user experience.
Referring to fig. 4, a sound effect processing method provided by the present application is applied to an electronic device, and the method includes:
step S210: the method comprises the steps of obtaining a current audio output scene, wherein the audio output scene corresponds to a plurality of audio output channels, and the audio output channels are different in audio type for transmission.
Step S220: an associated electronic device associated with the electronic device is obtained.
As a way of acquiring an associated electronic device associated with the electronic device, the electronic device may acquire an associated user account associated with a user account bound to the electronic device; acquiring reference associated electronic equipment bound with the associated user account; and selecting equipment in the same local area network with the electronic equipment from the reference associated electronic equipment as associated electronic equipment.
For example, as shown in fig. 5, in the network configuration shown in the figure, an electronic device 95 and an electronic device 94 access a server 90 through the same wireless access point 92, and an electronic device 93 accesses the server 90 through a wireless access point 91. Then, if the first user account bound to the electronic device 95, the second user account bound to the electronic device 94, and the third user account bound to the electronic device 93 are all allocated as a game group by the server 90, and the grouping information is respectively sent to the electronic device 95, the electronic device 94, and the electronic device 93, the electronic device 95 can recognize that the second user account and the third user account are the associated user accounts with the first user account bound thereto. Then the electronic device 94 bound to the second user account and the electronic device 95 bound to the third user account can be identified as the reference associated electronic devices associated therewith.
Further, as a way, in order to facilitate the server to identify different electronic devices in the same lan, the electronic device may upload its own lan IP address or its own MAC address to the server after the server establishes a communication connection, so as to serve as a device identifier of the electronic device.
In this case, when sending the associated account of the user account bound to the server to each electronic device, the server will send a device identifier of the electronic device bound to the associated account to each electronic device. If the device identifier is a local area network IP address, the electronic device may identify whether there is a device in the same local area network as the electronic device according to the received local area network IP address.
Step S230: and acquiring a target audio output channel determined when the associated electronic equipment displays the audio output scene.
Step S240: and determining a target audio output channel corresponding to the audio output scene according to the target audio output channel determined by the associated electronic equipment, wherein the target audio output channel is an audio output channel needing sound effect enhancement in the plurality of audio output channels.
As a way, the electronic device may keep the target audio channel determined by the electronic device to be the same as the target audio channel determined by the associated electronic device, so as to achieve the same sound effect enhancement effect for users of the electronic devices in the same local area network.
Furthermore, in some scenarios, it may also be possible to implement a target audio path that is different for the electronic device and the associated electronic device. For example, for some combat-type games, the interface and background music of the same group of users are the same when in a combat scenario.
In this case, the bound accounts are in the same group, and the connected wireless access points are the same, so that the electronic device can determine that the users are closer to each other, and as a way of saving electric quantity, the electronic device can enhance action sound effects, and the associated electronic device can enhance background music, or vice versa. Still alternatively, if there are additional associated electronic devices, the additional associated electronic devices may be made to enhance the character's voice. Therefore, under the condition that the electronic equipment is not required to enhance the sound effect of the plurality of audio output channels, the user of the electronic equipment can still experience the effect of enhancing the plurality of audio output channels simultaneously.
For example, as shown in fig. 5, if the person a is a person corresponding to a user account bound to the electronic device, and the person B is a person corresponding to a user account bound to the associated electronic device. Then the character a and the character B are both currently located in the same game scene, and the sound effect and the background music corresponding to the character a and the character B can be the same. In this case, the action sound effect may be enhanced by the electronic device, and the background music may be enhanced by the associated electronic device.
Step S250: enhancing the sound effect of the audio transmitted by the target audio output channel.
It is understood that for the associated electronic devices in the same lan, the associated electronic devices may be disconnected from the wireless access point for some reason, or the associated electronic devices may be disconnected from the data interaction with the server. In this case, as a manner, the step of determining the target audio output path corresponding to the audio output scene according to the target audio output path determined by the associated electronic device further includes: and if the state information of the associated electronic equipment is detected to meet the preset condition, adding a target audio output channel determined by the associated electronic equipment in a target audio channel determined by the electronic equipment. The preset condition is used for indicating that the associated electronic equipment cannot perform interface synchronous display with the electronic equipment.
For example, the network environment shown in fig. 6 is also described as an example. If the electronic device 95 identifies the electronic device 94 as a related electronic device, and if the target audio output channel determined by the electronic device 95 is an audio channel of an output sound type, the target audio output channel determined by the electronic device 94 is an audio channel of an output background music type. Then, when the electronic device 95 detects that the electronic device 94 satisfies the preset condition, in addition to continuously determining the audio channel outputting the sound effect type as the target audio channel, the audio channel outputting the background music type is also determined as a target audio channel, so that the background music and the sound effect are enhanced. Therefore, the electronic equipment can flexibly adjust the target audio to be communicated under the condition that the associated electronic equipment cannot keep picture synchronous display with the electronic equipment, so that the user experience is improved.
Wherein, if it is detected that the state information of the associated electronic device meets a preset condition, the method includes:
if the associated electronic equipment is detected to be released from the association relation with the electronic equipment; or if the associated electronic equipment is detected to switch the wireless access hotspot.
Optionally, if the electronic device receives a condition that the associated electronic device sent by the server exits from the originally allocated user group, it is determined that the associated electronic device is disassociated from the electronic device. And then, or when detecting that the server judges that the network segment corresponding to the local area network IP address of the original associated electronic equipment changes and the prompt message sent to the electronic equipment, determining that the associated electronic equipment is switched to the wireless access hotspot.
Besides, when detecting that the associated electronic device cannot perform screen synchronization, the determined target audio output path is adjusted according to the foregoing principle, and the adjustment may be performed according to the audio output condition or other parameters of the associated electronic device.
Optionally, if it is detected that the electric quantity of the associated electronic device is lower than the set threshold, the target audio output path may be adjusted according to the foregoing manner. For example, if the power of the associated electronic device is lower than the set value, the electronic device may enhance the playing of the audio that is originally enhanced by the associated electronic device in order to reduce the power consumption of the associated electronic device. Or, if it is detected that the associated electronic device turns off the audio output or switches the audio output to the headphone mode, the target audio output path may also be adjusted according to the foregoing manner.
It should be noted that, in order to facilitate the electronic device to obtain the audio output state, the network state, or the power state of the associated electronic device in real time, the audio output state, the network state, or the power state of the associated electronic device is also obtained in real time by the associated electronic device. As one mode, after the server establishes data communication, the electronic device or the associated electronic device may upload the audio output state, the network state, or the power state of the electronic device at a preset frequency, so that the server forwards the received audio output state, the network state, or the power state uploaded by the electronic device to other associated electronic devices, or forwards the received audio output state, the network state, or the power state uploaded by the associated electronic device to the electronic device.
The application provides a sound effect processing method, by acquiring a current audio output scene, under the condition that the audio output scene is correspondingly provided with a plurality of audio output channels, and each audio output channel is used for transmitting different audio, acquiring associated electronic equipment associated with the electronic equipment, acquiring a target audio channel determined by the associated electronic equipment, and then, based on the target audio path determined by the associated electronic device, selecting, from the plurality of audio output paths, determining a target audio output channel corresponding to the audio output scene, and then enhancing the sound effect of the audio transmitted by the target audio output channel, therefore, the electronic equipment can selectively enhance the sound effect from the plurality of audio output channels corresponding to the audio output scene according to the current audio output scene, the flexibility of sound effect processing is improved, and the user experience can be further improved.
Referring to fig. 7, the present application provides a sound effect processing apparatus 300, operating on an electronic device, where the apparatus 300 includes: an audio scene acquisition unit 310, a target determination unit 320, and a sound effect processing unit 330.
An audio scene obtaining unit 310, configured to obtain a current audio output scene, where the audio output scene corresponds to multiple audio output channels, and each of the audio output channels is used for transmitting different audio types.
A target determining unit 320, configured to determine a target audio output channel corresponding to the audio output scene from the multiple audio output channels, where the target audio output channel is an audio output channel that needs to be subjected to sound effect enhancement.
As one mode, the target determining unit 320 is specifically configured to determine, if the audio scene obtaining unit 310 obtains the audio output scene as a game interface scene, an action sound effect output channel of the multiple audio output channels as a target audio output channel.
Alternatively, the target determining unit 320 is further configured to determine a character sound output path of the multiple audio output paths as a target audio output path if the audio scene obtaining unit 310 obtains that the current audio output scene is an audio scene; alternatively, if the audio scene acquiring unit 310 acquires that the current audio output scene is a video playing scene, a background music output channel of the multiple audio output channels is determined as a target audio output channel.
The sound effect processing unit 330 is configured to enhance the sound effect of the audio transmitted by the target audio output channel.
As one mode, if the audio scene acquiring unit 310 acquires that the audio output scene is a game interface scene, an action sound effect output channel of the plurality of audio output channels is determined as a target audio output channel.
Correspondingly, the sound effect processing unit 330 is specifically configured to detect whether the audio transmitted by the target audio output channel has phase information; and if the phase information is detected, enhancing the sound effect of the audio transmitted by the target audio output channel according to the phase information.
The application provides a pair of audio processing apparatus, through obtaining current audio output scene correspondence has a plurality of audio output passageways, every under the audio output passageway is used for the different circumstances of audio frequency of transmission, follow among a plurality of audio output passageways, confirm the target audio output passageway that audio output scene corresponds strengthens again the audio of the audio that target audio output passageway transmitted to make electronic equipment can have the selective audio enhancement that carries out in a plurality of audio output passageways from audio output scene correspondence according to current audio output scene, promoted the flexibility that the audio was handled, and then can promote user experience.
Referring to fig. 8, the present application provides a sound effect processing apparatus 400, operating on an electronic device, where the apparatus 400 includes: an audio scene acquisition unit 410, an associated device acquisition unit 420, an associated path acquisition unit 430, a target determination unit 440, and a sound effect processing unit 450.
An audio scene obtaining unit 410, configured to obtain a current audio output scene, where the audio output scene corresponds to multiple audio output channels, and each of the audio output channels is used for transmitting different audio types.
An associated device obtaining unit 420, configured to obtain an associated electronic device associated with the electronic device.
As one mode, the associated device obtaining unit 420 is specifically configured to obtain an associated user account associated with a user account bound to the electronic device; acquiring reference associated electronic equipment bound with the associated user account; and selecting equipment in the same local area network with the electronic equipment from the reference associated electronic equipment as associated electronic equipment.
An associated path acquiring unit 430, configured to acquire a target audio output path determined by the associated electronic device when the audio output scene is displayed.
And a target determining unit 440, configured to determine a target audio output path corresponding to the audio output scene according to the target audio output path determined by the associated electronic device.
The target determining unit 440 is further configured to add a target audio output path determined by the associated electronic device to a target audio path determined by the electronic device if it is detected that the state information of the associated electronic device meets a preset condition.
Optionally, the step of detecting that the state information of the associated electronic device meets a preset condition includes:
if the associated electronic equipment is detected to be released from the association relation with the electronic equipment;
if the electric quantity of the associated electronic equipment is detected to be lower than a set value; or
And if the associated electronic equipment is detected to be switched to the wireless access hotspot.
The sound effect processing unit 450 is configured to enhance the sound effect of the audio transmitted by the target audio output channel.
The application provides a sound effect processing device, by acquiring the current audio output scene, a plurality of audio output channels are corresponding to the audio output scene, and under the condition that the transmitted audio is different, acquiring associated electronic equipment associated with the electronic equipment, acquiring a target audio channel determined by the associated electronic equipment, and then, based on the target audio path determined by the associated electronic device, selecting, from the plurality of audio output paths, determining a target audio output channel corresponding to the audio output scene, and then enhancing the sound effect of the audio transmitted by the target audio output channel, therefore, the electronic equipment can selectively enhance the sound effect from the plurality of audio output channels corresponding to the audio output scene according to the current audio output scene, the flexibility of sound effect processing is improved, and the user experience can be further improved.
It should be noted that, as will be clear to those skilled in the art, for convenience and brevity of description, the specific working processes of the above-described apparatuses and units may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again. In the several embodiments provided in the present application, the coupling between the modules may be electrical, mechanical or other type of coupling. In addition, functional modules in the embodiments of the present application may be integrated into one processing module, or each of the modules may exist alone physically, or two or more modules are integrated into one module. The integrated module can be realized in a hardware mode, and can also be realized in a software functional module mode.
It should be noted that, in the present application, it is a prior art that can be specifically applied to how to encode audio data according to the audio encoding type, and the present application will not be described in detail.
To sum up, the sound effect processing method, the sound effect processing device and the electronic equipment provided by the application are characterized in that the sound effect processing method, the sound effect processing device and the electronic equipment are used for obtaining a current sound output scene, a plurality of sound output channels are correspondingly arranged in the sound output scene, each sound output channel is used for transmitting sound in different situations, and then the sound effect enhancement is selectively carried out in the plurality of sound output channels according to the current sound output scene, and sound effect processing algorithms can be independently distributed for each channel, so that the sound effect processing flexibility is improved, and further the user experience can be improved.
An electronic device provided by the present application will be described below with reference to fig. 9.
Referring to fig. 9, based on the sound processing method and apparatus, another electronic device 100 capable of executing the terminal control method is further provided in the embodiment of the present application. Electronic device 100 includes one or more processors 102 (only one shown), memory 104, wireless module 106, and audio module 108 coupled to each other. The memory 104 stores programs that can execute the content of the foregoing embodiments, and the processor 102 can execute the programs stored in the memory 104.
The Memory 104 may include a Random Access Memory (RAM) or a Read-Only Memory (Read-Only Memory). The memory 104 may be used to store instructions, programs, code sets, or instruction sets. The memory 104 may include a stored program area and a stored data area, wherein the stored program area may store instructions for implementing an operating system, instructions for implementing at least one function (such as a touch function, a sound playing function, an image playing function, etc.), instructions for implementing various method embodiments described below, and the like. The storage data area may also store data created by the terminal 100 in use, such as a phonebook, audio-video data, chat log data, and the like.
The wireless module 106 is configured to receive and transmit electromagnetic waves, and achieve interconversion between the electromagnetic waves and the electrical signals, so as to communicate with a communication network or other devices, for example, an audio playing device. The wireless module 106 may include various existing circuit elements for performing these functions, such as an antenna, a radio frequency transceiver, a digital signal processor, an encryption/decryption chip, a Subscriber Identity Module (SIM) card, memory, and so forth. The wireless module 106 may communicate with various networks, such as the internet, an intranet, a wireless network, or with other electronic devices via a wireless network. The wireless network may comprise a cellular telephone network, a wireless local area network, or a metropolitan area network. The wireless network described above may use various communication standards, protocols, and technologies, including but not limited to the IEEE 802 protocol and the bluetooth protocol, and may even include those that are not yet developed.
Furthermore, the audio module 108 may be used to process audio output by applications running in the electronic device 100. For example, the audio module 108 may receive audio processing parameters obtained by the wireless module 106 from other electronic devices and then adjust the audio processing parameters of the audio module 108.
Referring to fig. 10, a block diagram of a computer-readable storage medium according to an embodiment of the present application is shown. The computer-readable medium 800 has stored therein a program code that can be called by a processor to execute the method described in the above-described method embodiments.
The computer-readable storage medium 800 may be an electronic memory such as a flash memory, an EEPROM (electrically erasable programmable read only memory), an EPROM, a hard disk, or a ROM. Alternatively, the computer-readable storage medium 800 includes a non-volatile computer-readable storage medium. The computer readable storage medium 800 has storage space for program code 810 to perform any of the method steps of the method described above. The program code can be read from or written to one or more computer program products. The program code 810 may be compressed, for example, in a suitable form.
For the purposes of this description, a "computer-readable medium" can be any means that can contain, store, communicate, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device. More specific examples (a non-exhaustive list) of the computer-readable medium would include the following: an electrical connection (electronic device) having one or more wires, a portable computer diskette (magnetic device), a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber device, and a portable compact disc read-only memory (CDROM). Additionally, the computer-readable medium could even be paper or another suitable medium upon which the program is printed, as the program can be electronically captured, via for instance optical scanning of the paper or other medium, then compiled, interpreted or otherwise processed in a suitable manner if necessary, and then stored in a computer memory.
Finally, it should be noted that: the above embodiments are only used to illustrate the technical solutions of the present application, and not to limit the same; although the present application has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; such modifications and substitutions do not necessarily depart from the spirit and scope of the corresponding technical solutions in the embodiments of the present application.
Claims (9)
1. A sound effect processing method is applied to electronic equipment, and the method comprises the following steps:
acquiring a current audio output scene, wherein the audio output scene corresponds to a plurality of audio output channels, and the audio types of the audio output channels for transmission are different;
determining a target audio output channel corresponding to the audio output scene from the plurality of audio output channels, wherein the target audio output channel is an audio output channel needing sound effect enhancement in the plurality of audio output channels;
detecting whether the audio transmitted by the target audio output channel has phase information, wherein the phase information is intensity difference, time difference or sound color difference; if the phase information is detected, enhancing the parameter difference of the audio contents transmitted by the left channel and the right channel in the action audio output channel so as to enhance the audio effect of the action audio transmitted by the target audio output channel, wherein the parameter difference is the difference between the parameters;
if the audio output device is a sound box or a speaker of the electronic device, enhancing a first threshold value for a difference value between parameters corresponding to audio contents transmitted by the left channel and the right channel, and if the audio output device is an earphone, enhancing a second threshold value for a difference value between parameters corresponding to audio contents transmitted by the left channel and the right channel, wherein the second threshold value is smaller than the first threshold value.
2. The method of claim 1, wherein the step of determining a target audio output path corresponding to the audio output scene from the plurality of audio output paths further comprises:
if the current audio output scene is an audio scene, determining a character sound output channel in the multiple audio output channels as a target audio output channel;
and if the current audio output scene is a video playing scene, determining a background music output channel in the plurality of audio output channels as a target audio output channel.
3. The method of claim 1, wherein the step of determining a target audio output path corresponding to the audio output scene from the plurality of audio output paths comprises:
acquiring associated electronic equipment associated with the electronic equipment;
acquiring a target audio output channel determined when the associated electronic equipment displays the audio output scene;
and determining a target audio output path corresponding to the audio output scene according to the target audio output path determined by the associated electronic equipment.
4. The method of claim 3, wherein the step of obtaining an associated electronic device associated with the electronic device comprises:
acquiring a related user account related to the user account bound with the electronic equipment;
acquiring reference associated electronic equipment bound with the associated user account;
and selecting equipment in the same local area network with the electronic equipment from the reference associated electronic equipment as associated electronic equipment.
5. The method of claim 3, wherein the step of determining a target audio output path corresponding to the audio output scene based on the target audio output path determined by the associated electronic device further comprises:
and if the state information of the associated electronic equipment is detected to meet the preset condition, adding a target audio output channel determined by the associated electronic equipment in a target audio channel determined by the electronic equipment.
6. The method of claim 5, wherein the detecting that the state information of the associated electronic device meets a predetermined condition comprises:
if the associated electronic equipment is detected to be released from the association relation with the electronic equipment;
if the electric quantity of the associated electronic equipment is detected to be lower than a set value; or
And if the associated electronic equipment is detected to be switched to the wireless access hotspot.
7. An audio processing apparatus, operable on an electronic device, the apparatus comprising:
the audio scene acquisition unit is used for acquiring a current audio output scene, the audio output scene corresponds to a plurality of audio output channels, and the audio types of the audio output channels for transmission are different;
the target determining unit is used for determining a target audio output channel corresponding to the audio output scene from the plurality of audio output channels, wherein the target audio output channel is an audio output channel needing sound effect enhancement in the plurality of audio output channels;
the sound effect processing unit is used for detecting whether the audio transmitted by the target audio output channel has phase information, and the phase information is intensity difference, time difference or sound color difference; if the phase information is detected, enhancing the parameter difference of the audio contents transmitted by the left channel and the right channel in the action audio output channel so as to enhance the audio effect of the action audio transmitted by the target audio output channel, wherein the parameter difference is the difference between the parameters; if the audio output device is a sound box or a speaker of the electronic device, enhancing a first threshold value for a difference value between parameters corresponding to audio contents transmitted by the left channel and the right channel, and if the audio output device is an earphone, enhancing a second threshold value for a difference value between parameters corresponding to audio contents transmitted by the left channel and the right channel, wherein the second threshold value is smaller than the first threshold value.
8. An electronic device comprising one or more processors and memory;
one or more programs stored in the memory and configured to be executed by the one or more processors, the one or more programs configured to perform the methods of any of claims 1-6.
9. A computer-readable storage medium, having a program code stored therein, wherein the program code when executed by a processor performs the method of any of claims 1-6.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811028137.2A CN109107158B (en) | 2018-09-04 | 2018-09-04 | Sound effect processing method and device, electronic equipment and computer readable storage medium |
| PCT/CN2019/094437 WO2020048209A1 (en) | 2018-09-04 | 2019-07-02 | Sound effect processing method and apparatus, and electronic device and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811028137.2A CN109107158B (en) | 2018-09-04 | 2018-09-04 | Sound effect processing method and device, electronic equipment and computer readable storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109107158A CN109107158A (en) | 2019-01-01 |
| CN109107158B true CN109107158B (en) | 2020-09-22 |
Family
ID=64861934
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811028137.2A Active CN109107158B (en) | 2018-09-04 | 2018-09-04 | Sound effect processing method and device, electronic equipment and computer readable storage medium |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN109107158B (en) |
| WO (1) | WO2020048209A1 (en) |
Families Citing this family (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109218528B (en) * | 2018-09-04 | 2021-03-02 | Oppo广东移动通信有限公司 | Sound effect processing method and device and electronic equipment |
| CN109107158B (en) * | 2018-09-04 | 2020-09-22 | Oppo广东移动通信有限公司 | Sound effect processing method and device, electronic equipment and computer readable storage medium |
| CN109165005B (en) * | 2018-09-04 | 2020-08-25 | Oppo广东移动通信有限公司 | Sound effect enhancement method and device, electronic equipment and storage medium |
| CN110580914A (en) * | 2019-07-24 | 2019-12-17 | 安克创新科技股份有限公司 | Audio processing method and equipment and device with storage function |
| CN112000835A (en) * | 2020-08-31 | 2020-11-27 | 上海商米科技集团股份有限公司 | Dynamic sound effect loading system and method for electronic equipment |
| CN117406654B (en) * | 2023-12-15 | 2024-04-16 | 荣耀终端有限公司 | Sound effect processing method and electronic equipment |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103893971A (en) * | 2012-12-25 | 2014-07-02 | 腾讯科技（深圳）有限公司 | Game sound effect generating method and client |
| CN104240738A (en) * | 2014-08-28 | 2014-12-24 | 杰发科技（合肥）有限公司 | Sound effect setting method and electronic device |
| CA2947011A1 (en) * | 2014-04-25 | 2015-10-29 | Motorola Solutions, Inc. | Method and system for providing alerts for radio communications |
| CN106095384A (en) * | 2016-06-16 | 2016-11-09 | 广东欧珀移动通信有限公司 | A kind of effect adjusting method and user terminal |
| CN107077318A (en) * | 2016-12-14 | 2017-08-18 | 深圳前海达闼云端智能科技有限公司 | A kind of sound processing method, device, electronic equipment and computer program product |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105280212A (en) * | 2014-07-25 | 2016-01-27 | 中兴通讯股份有限公司 | Audio mixing and playing method and device |
| CN106095387B (en) * | 2016-06-16 | 2019-06-25 | Oppo广东移动通信有限公司 | A kind of the audio setting method and terminal of terminal |
| CN106775562A (en) * | 2016-12-09 | 2017-05-31 | 奇酷互联网络科技（深圳）有限公司 | The method and device of audio frequency parameter treatment |
| CN109107158B (en) * | 2018-09-04 | 2020-09-22 | Oppo广东移动通信有限公司 | Sound effect processing method and device, electronic equipment and computer readable storage medium |
-
2018
- 2018-09-04 CN CN201811028137.2A patent/CN109107158B/en active Active
-
2019
- 2019-07-02 WO PCT/CN2019/094437 patent/WO2020048209A1/en active Application Filing
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103893971A (en) * | 2012-12-25 | 2014-07-02 | 腾讯科技（深圳）有限公司 | Game sound effect generating method and client |
| CA2947011A1 (en) * | 2014-04-25 | 2015-10-29 | Motorola Solutions, Inc. | Method and system for providing alerts for radio communications |
| CN104240738A (en) * | 2014-08-28 | 2014-12-24 | 杰发科技（合肥）有限公司 | Sound effect setting method and electronic device |
| CN106095384A (en) * | 2016-06-16 | 2016-11-09 | 广东欧珀移动通信有限公司 | A kind of effect adjusting method and user terminal |
| CN107077318A (en) * | 2016-12-14 | 2017-08-18 | 深圳前海达闼云端智能科技有限公司 | A kind of sound processing method, device, electronic equipment and computer program product |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2020048209A1 (en) | 2020-03-12 |
| CN109107158A (en) | 2019-01-01 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109107158B (en) | Sound effect processing method and device, electronic equipment and computer readable storage medium | |
| CN109445740B (en) | Audio playing method and device, electronic equipment and storage medium | |
| CN109257500B (en) | Audio playing method and device, electronic equipment and storage medium | |
| CN109413555B (en) | Audio output method and device, earphone and electronic equipment | |
| CN109151212B (en) | Equipment control method and device and electronic equipment | |
| CN109151194B (en) | Data transmission method, device, electronic equipment and storage medium | |
| CN110913442B (en) | Network switching method and device, electronic equipment and storage medium | |
| CN109388367B (en) | Sound effect adjusting method and device, electronic equipment and storage medium | |
| CN109151211B (en) | Voice processing method and device and electronic equipment | |
| CN109218528B (en) | Sound effect processing method and device and electronic equipment | |
| CN109165005B (en) | Sound effect enhancement method and device, electronic equipment and storage medium | |
| CN112203206B (en) | Microphone hole blockage detection method and related product | |
| CN109284080B (en) | Sound effect adjusting method and device, electronic equipment and storage medium | |
| CN109410900B (en) | Sound effect processing method and device and electronic equipment | |
| CN109275129B (en) | Communication processing method, communication processing device, electronic equipment and storage medium | |
| CN109274407B (en) | Data transmission method, device, electronic equipment and storage medium | |
| CN109257732B (en) | Equipment control method and device and electronic equipment | |
| CN106341546B (en) | A kind of playback method of audio, device and mobile terminal | |
| CN109273017A (en) | Coding control method, device and electronic equipment | |
| CN109151861A (en) | Encoding rate method of adjustment, device and electronic equipment | |
| CN108600887B (en) | Touch control method based on wireless earphone and related product | |
| CN110602683B (en) | Bluetooth control method, device, mobile terminal and storage medium | |
| CN112135081A (en) | Mode control method and device, frame insertion chip and electronic equipment | |
| CN109814798B (en) | Ear return function control method and device and mobile terminal | |
| CN111277697B (en) | Audio processing method and device, storage medium and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |