CN109165005B - Sound effect enhancement method and device, electronic equipment and storage medium - Google Patents
Sound effect enhancement method and device, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN109165005B CN109165005B CN201811028127.9A CN201811028127A CN109165005B CN 109165005 B CN109165005 B CN 109165005B CN 201811028127 A CN201811028127 A CN 201811028127A CN 109165005 B CN109165005 B CN 109165005B
- Authority
- CN
- China
- Prior art keywords
- audio
- target
- sound
- transmitted
- channel
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/16—Sound input; Sound output
- G06F3/165—Management of the audio stream, e.g. setting of volume, audio stream path
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/50—Controlling the output signals based on the game progress
- A63F13/54—Controlling the output signals based on the game progress involving acoustic signals, e.g. for simulating revolutions per minute [RPM] dependent engine sounds in a driving game or reverberation against a virtual wall
Abstract
The embodiment of the application discloses a sound effect enhancing method and device, electronic equipment and a storage medium, and relates to the field of electronic equipment. Wherein, the method comprises the following steps: determining a target audio channel corresponding to a current audio output scene in the audio channels of the electronic equipment; determining a target sound type of audio conveyed by the target audio pathway; and enhancing the audio transmitted by the target audio channel through a target sound effect algorithm corresponding to the target sound type. According to the scheme, the audio of different sound types can be enhanced by different target sound effect algorithms, the sound effect enhancement effect is improved, and therefore the user experience is improved.
Description
Technical Field
The present disclosure relates to the field of electronic devices, and more particularly, to a sound effect enhancement method and apparatus, an electronic device, and a storage medium.
Background
With the development of technology, intelligent electronic devices such as mobile phones and computers are more and more commonly used, and functions are more and more perfect. The audio playing is one of the basic functions of the electronic device. The audio data played by the electronic equipment is electronic data sampled and stored according to real sound, and in order to enable the audio data to have more sense of reality during playing, sound effects can be added to the played audio. But usually the setting of sound effect is fixed single, influences user experience.
Disclosure of Invention
In view of the above problems, the present application provides a sound effect enhancing method, apparatus, electronic device and storage medium to solve the above problems.
In a first aspect, an embodiment of the present application provides a sound effect enhancing method, which is applied to an electronic device, and the method includes: determining a target audio channel corresponding to a current audio output scene in the audio channels of the electronic equipment; determining a target sound type of audio conveyed by the target audio pathway; and enhancing the audio transmitted by the target audio channel through a target sound effect algorithm corresponding to the target sound type.
In a second aspect, an embodiment of the present application provides a sound effect enhancing apparatus, which is applied to an electronic device, the apparatus includes: the path determining module is used for determining a target audio path corresponding to the current audio output scene in the audio paths of the electronic equipment; a type determination module for determining a target sound type of audio transmitted by the target audio channel; and the sound effect enhancing module is used for enhancing the audio transmitted by the target audio channel through a target sound effect algorithm corresponding to the target sound type.
In a third aspect, an embodiment of the present application provides an electronic device, including: one or more processors; a memory; one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs configured to perform the methods described above.
In a fourth aspect, the present application provides a computer-readable storage medium, in which a program code is stored, and the program code can be called by a processor to execute the above method.
According to the sound effect enhancement method and device, the electronic equipment and the storage medium, the target sound type of the audio transmitted in the target audio channel is enhanced through the corresponding target sound effect algorithm, the audio of different sound types can be enhanced through different target sound effect algorithms, the sound effect enhancement effect is improved, and therefore user experience is improved.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
FIG. 1 is a flowchart illustrating a sound effect enhancement method according to an embodiment of the present application.
FIG. 2 is a flow chart of a sound effect enhancement method according to another embodiment of the present application.
Fig. 3 is a functional block diagram of a sound-effect enhancing device according to an embodiment of the present disclosure.
Fig. 4 shows a block diagram of an electronic device provided in an embodiment of the present application.
Fig. 5 is a storage unit for storing or carrying program codes for implementing the sound-effect enhancement method according to the embodiment of the present application.
Detailed Description
In order to make the technical solutions better understood by those skilled in the art, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application.
The electronic equipment can add sound effect to the audio data that need broadcast, and after audio data was handled with the sound effect algorithm promptly, carry out corresponding broadcast to audio data again, realize the sound effect reinforcing. Usually, some default sound effect is added to the electronic equipment, and the sound effect enhancement effect is not ideal.
The inventor finds that the reason that the audio effect enhancement effect of the audio is not ideal enough is that the enhancement of the audio effect does not have differentiation for the audio itself, and different audio frequencies may need different enhancement modes, for example, game audio of some indoor scenes needs to express the spatial sense of sound and needs to enhance the spatial sense; some live-type music audio, such as the audio of a concert, require an enhanced live feel of the audio, and so forth.
Therefore, the embodiment of the application provides a sound effect enhancement method, a sound effect enhancement device, electronic equipment and a storage medium, and sound effect enhancement is performed according to the sound type of the audio in the audio channel.
The sound effect enhancing method, device, electronic device and storage medium provided by the embodiments of the present application will be described in detail through specific embodiments.
Referring to fig. 1, an embodiment of the present application provides a method for enhancing audio effect, in which a target sound type of an audio transmitted by a target audio channel obtains a corresponding target audio effect algorithm to perform audio effect enhancement on the audio. Specifically, the method comprises the following steps:
step S110: and determining a corresponding target audio path of the current audio output scene in the audio paths of the electronic equipment.
In electronic devices, there may be a variety of audio output scenarios. The audio playing corresponding to each application program can be used as an audio output scene; or music corresponding to each type of application program is played, and the music can be used as an audio output scene. For example, an audio output corresponding to a music application is taken as a music output scene, an audio output corresponding to a video application is taken as a video output scene, an audio output corresponding to a game application is taken as a game scene, an audio output corresponding to an alarm clock is taken as an alarm clock scene, an audio output corresponding to a ring incoming call is taken as a ring tone scene, and when the electronic device performs a voice call, the output audio can be taken as a call audio scene and a playing scene of audio transmitted by other devices through a wireless or wired connection manner such as Wi-Fi connection, bluetooth connection, data line connection, and the like.
When the electronic equipment plays the audio, the audio output scene corresponding to the played audio can be obtained. For example, in the electronic device, each audio output scene may correspond to one scene parameter, and the audio data corresponding to each audio includes the scene parameter, so that the audio output scene corresponding to the audio may be determined by the scene parameter included in the audio data of the audio.
In the electronic device, each audio output scene may correspond to an audio channel, and audio output scenes in different channels do not interfere with each other, that is, audio transmitted through each audio channel does not interfere with each other. For example, in an Android (Android) system, different audio output paths are provided, respectively. Such as in the android system, including media sound, system sound, alarm sound, conversation sound, alarm sound, etc. Java class is defined as streamType, such as STREAM _ MUSIC, STREAM _ SYSTEM, STREAM _ ALARM, STREAM _ VOICE _ CALL, STREAM _ RING, and each streamType corresponds to an audio channel.
In order to avoid the interference between the audio output from different audio output scenes, each audio output scene may correspond to one audio channel separately.
In addition, a plurality of audio output scenes may correspond to one audio channel or the like. For example, the audio channel corresponding to the media audio, such as an audio output scene corresponding to a music application, an audio output scene corresponding to a video application, etc.; the audio output scene corresponding to the alarm clock corresponds to the audio channel corresponding to the alarm clock sound; an audio channel corresponding to an alarm corresponding to an audio output scene corresponding to the incoming call ringtone; the audio output scene when the electronic device performs a voice call may correspond to an audio path corresponding to the call sound. In the embodiment of the present application, the specific number of audio channels is not limited, and the corresponding relationship between the audio output scene and the audio channels is also not limited.
In particular, each audio channel may also be provided with corresponding channel parameters. In the above-described android SYSTEM, STREAM _ MUSIC, STREAM _ SYSTEM, STREAM _ ALARM, STREAM _ VOICE _ CALL, STREAM _ RING, and other STREAMs type are respectively associated with different parameter values. Therefore, the corresponding relation between the audio output scene and the audio channel can be determined through the corresponding relation between the channel parameters and the scene parameters.
Therefore, in the embodiment of the present application, the current audio output scene may be determined according to the currently output audio. And determining the audio channel corresponding to the audio output scene in each audio channel of the electronic equipment according to the currently output audio scene. And taking the audio channel corresponding to the current audio output scene as a target audio channel.
As an implementation manner, in the embodiment of the present application, a target audio path corresponding to a current audio output scene may be determined in real time.
As an embodiment, in the embodiment of the present application, when the sound emission of the audio output scene changes, the target audio channel corresponding to the changed audio output scene may also be determined.
Step S120: a target sound type of audio conveyed by the target audio pathway is determined.
In the embodiment of the present application, sounds may be classified into different types according to their characteristics. The division of the specific sound type is not limited in the embodiment of the present application, for example, in a limited space range such as indoor, a spatial sound needs to be represented as the space type; recording of the concert scene is used as the type of the concert; human voice as a type of human voice, etc. The electronic device may determine from the target audio pathway a target sound type to which the transmitted audio pertains.
Specifically, a type parameter may be set for each type of sound, and the various types of parameters may be stored in the electronic device. In the audio data of the audio, a type parameter to which it belongs may be stored. A type parameter indicating the type of the audio is included in the audio data of the audio played by the electronic device. Therefore, when the audio is transmitted in the target audio channel, the type of the audio can be obtained according to the type parameter of the audio, and the type is taken as the target sound type.
Step S130: and enhancing the audio transmitted by the target audio channel through a target sound effect algorithm corresponding to the target sound type.
In the embodiment of the application, sound effects of various types of sound can be enhanced according to the characteristics of the sound, so that a good playing effect is obtained. For some sound with space characteristics and needing space expression, the enhancement of space sense is carried out; for life, the sound pleasure degree is improved through the lifting or attenuation of partial frequencies; the present invention improves the live performance of live voices such as concerts. Specifically, in the corresponding audio channel, a corresponding audio effect algorithm may be used to perform audio effect enhancement on the audio in the audio channel. The algorithm corresponding to the specific enhancement effect may be set according to an existing algorithm, and is not described in detail in the embodiment of the present application.
Specifically, in each audio channel, an audio algorithm for enhancing audio effects of various types of sounds may be correspondingly set. And when the audio is transmitted in the audio channel, acquiring a sound effect algorithm corresponding to the audio according to the sound type of the audio.
And taking the sound effect algorithm corresponding to the target sound type as the target sound effect algorithm. When the audio of the target sound type is transmitted in the target audio channel, the audio data corresponding to the audio belonging to the target sound type can be processed through the target sound effect algorithm corresponding to the target sound type, so that the sound effect enhancement of the audio is realized.
Wherein, each sound type can correspond to one sound effect algorithm, and can also correspond to a plurality of sound effect algorithms. If the target sound type corresponds to a sound effect algorithm, processing the audio data corresponding to the target sound type through the sound effect algorithm to realize sound effect enhancement; and if the sound effect algorithms corresponding to the target sound types are multiple, processing the audio data corresponding to the target sound types through the multiple sound effect algorithms to realize sound effect enhancement.
As an embodiment, the sound effect algorithms corresponding to different sound types may be different, that is, different sound effect algorithms are used for processing according to the characteristics of the sound.
As an embodiment, if two or more sound types have certain common characteristics, if the enhancement of the spatial sense is required, two or more sound types may correspond to the same sound effect algorithm.
In the embodiment of the present application, the specific corresponding manner of the sound type and the sound effect algorithm is not limited. As an embodiment, a corresponding relationship between the sound type and the sound effect algorithm may be preset, and the corresponding relationship is set and stored through a corresponding relationship table. Therefore, when the target sound type is obtained, the target sound effect algorithm corresponding to the target sound type can be obtained according to the preset corresponding relation between the sound type and the sound effect algorithm. And enhancing the audio transmitted by the target audio channel by the target audio effect algorithm.
In different audio channels, the same type of sound can be processed by different processing sound effects so as to meet the actual requirements. For example, also human voice, in voice call, it is required that the voice is clearer; in video applications, however, the sound is required to be more pleasant. Processing the audio frequency through a sound effect algorithm for improving the sound definition in the audio frequency channel corresponding to the call sound; in the audio channel corresponding to the media sound, the audio is processed by the sound effect score which improves the pleasure degree of the sound. Therefore, optionally, in this embodiment, the sound effect algorithms corresponding to the same sound type may be different, that is, the correspondence between the sound type and the sound effect algorithm may be different in different audio channels.
As another embodiment, it is also possible that a type parameter is set and stored for each sound type, an algorithm parameter is set and stored for each sound effect algorithm, and a conversion function between the type parameter and the algorithm parameter is set and stored in advance. The type parameters are calculated through the conversion function, algorithm parameters corresponding to the type parameters can be obtained, and accordingly, the sound effect algorithm corresponding to the sound type corresponding to the type parameters is obtained according to the correspondence between the type parameters and the algorithm parameters. Therefore, when the target sound type corresponding to the audio in the target audio channel is obtained, the target sound effect algorithm corresponding to the target sound type can be obtained according to the type parameter of the target sound type and the conversion function.
Optionally, in this embodiment, the transfer functions corresponding to the same sound type may be different in different audio channels. That is, the transfer function between the type parameter and the algorithm parameter may be different in different audio paths.
In addition, in the embodiment of the present application, the audio output by the current audio output scene may include one type of audio, and may also include multiple types of audio.
If the audio output by the current audio output scene includes multiple types of audio, multiple sound types may be included in the audio transmitted by the target audio channel. If the target audio channel transmits audio of multiple sound types, the multiple sound types are all used as target sound types, that is, the target sound types include multiple sound types. For example, when a game sound is played, a human voice, a footstep sound in an indoor space, and the like are simultaneously included, and a spatial type sound and a human voice type sound are simultaneously transmitted in the corresponding audio channels, and the spatial type and the human voice type are set as target sound types.
And when the target sound type comprises a plurality of sound types, respectively acquiring corresponding sound effect algorithms for the plurality of sound types, and processing the audio of the corresponding sound type through the sound effect algorithms. For example, in the target audio channel, the transmitted audio includes audio a with sound type a and audio B with sound type B, and the audio algorithm a1 corresponding to sound type a and the audio score B1 corresponding to sound type B are obtained. And, audio a is processed by the sound effect algorithm A1 and audio B is processed by the sound type B1.
In the embodiment of the present application, in the target audio path, the transmitted audio may vary according to the time, and the type of the audio may also vary. For example, for sounds in a game scene, the game progresses to different stages, different sounds may be generated, and different sounds may belong to different sound types. Therefore, in the process of transmitting audio in the target audio path for the same audio output scene, the electronic equipment can determine the corresponding sound type of the audio transmitted in the target audio path in real time as the target sound type. Under the condition that the target sound type is changed, a target sound effect algorithm corresponding to the latest target sound type can be determined, and the audio corresponding to the target sound type is processed.
In the embodiment of the present application, for a current audio output scene, an audio channel corresponding to the current audio output scene may be determined as a target audio channel. When the audio corresponding to the current audio output scene is transmitted in the target audio channel, the sound type of the audio transmitted in the target audio channel may be determined as the target sound type. In addition, in the embodiment of the application, each sound type corresponds to a sound algorithm for performing sound effect enhancement processing on the audio, so that a target sound effect algorithm corresponding to the target sound type can be obtained according to the target sound type, and then the sound effect enhancement processing is performed on the corresponding audio through the target sound effect algorithm. Thus, when the processed audio is played, the audio-visual effect with enhanced sound effect is obtained. Therefore, in the embodiment of the application, the audios of different sound types can have different sound effect enhancements, and the user experience is improved.
In the embodiment of the application, the target sound type may be a spatial type, and the target sound effect algorithm may be a sound effect algorithm for performing spatial perception enhancement on audio corresponding to the spatial type. That is to say, in the embodiment of the present application, sound effect processing for performing spatial sense enhancement on audio of which the type parameter corresponds to a spatial type may also be included. Specifically, referring to fig. 2, the method includes:
step S210: and determining a corresponding target audio path of the current audio output scene in the audio paths of the electronic equipment.
And when the audio is output, determining an audio channel corresponding to the current audio output scene.
Optionally, the current audio output scene is a game scene, and since the sound of the game is a everyday sound, an audio channel corresponding to the media sound of the electronic device may be used as the target audio channel.
Optionally, different audio channels do not affect each other, and each audio channel may be enhanced by separately setting a sound effect algorithm. In order to obtain a better game effect, if the current audio output scene is a game scene, the created audio channel only used for transmitting the audio in the game scene is used as the target audio channel. That is, a separate audio channel may be created for the game scene for the sound effect enhancement process.
Step S220: a target sound type of audio conveyed by the target audio pathway is determined.
Step S230: and if the target sound type is a sound type with a space type parameter, enhancing the spatial sense of the audio transmitted by the target audio channel through the phase information.
For some audio needing to enhance the spatial sense, a type parameter corresponding to the spatial type can be added to the audio. Therefore, when the audio with the type parameter corresponding to the spatial type is transmitted in the target audio channel, the audio processing for enhancing the spatial sense of the audio can be determined according to the type parameter. Specifically, the audio transmitted through the target audio channel is enhanced by a target audio effect algorithm corresponding to the target sound type, and the spatial impression that the audio can express can be enhanced by phase information.
Specifically, in an actual environment, sound reaches the ears of a person from different positions, and a sense of space is given to the person. For example, in a small spatial range, a sound generated by one sound source partially reaches the human ear, and partially reaches the human ear after being reflected by an obstacle in the space, and the direction and time of reaching the sound are different, so that a listener can hear a spatial sense of the sound.
The inventor has found through research that, for sounds arriving at human ears in different directions, the brain analyzes the direction and time delay of the received sounds according to the phase of the received sounds. Since sound propagates in the form of waves and causes vibration of the eardrum, the sound arrives at the human ear and is received by the human ear in a certain phase. The brain analyzes the sound reaching the eardrum, and acquires information such as the direction and time of arrival of the sound from the phase of the sound. Therefore, the sound reaching the human ear with the phase difference is analyzed by the brain of the listener, and the spatial feeling of the sound is given to the listener, so that the spatial feeling is increased.
Therefore, in the embodiment of the application, a phase difference can be set for the audio frequency, so that the sound effect with enhanced spatial sense is realized. Since it is necessary to have a phase difference, at least an alignment involving two different phases should be provided. While the audio in the target path may only have phase information, therefore, the method of enhancing the spatial perception of the audio in the target path may be: and copying the original audio to obtain an audio copy by taking the audio transmitted by the target audio channel as the original audio. And delaying the audio copy for a preset time length relative to the original audio so that a phase difference exists between the audio copy and the original audio.
In order to make the sound content played by the audio consistent, in the embodiment of the present application, the audio transmitted in the target audio may be copied to obtain an audio copy consistent with the original audio content.
In order to obtain audio with a phase difference, the audio copy is processed to have a phase difference with the original audio. Specifically, since sound propagates in the air in the form of waves, the phases are different at different times for waves having the same period and amplitude. Therefore, the phase difference between the audio copy and the original audio can be realized by delaying the audio copy for a preset time length relative to the original audio, and when the processed audio is played and the generated sound reaches the eardrum, the phase corresponding to the original audio is different from the phase corresponding to the audio copy, so that the spatial sensation is enhanced.
In the embodiment of the present application, the specific time length of the preset time duration is not limited, and may be obtained by calculation according to the desired sound effect enhancement effect, such as information about the angle and distance between sounds heard by the listener. The specific calculation method may refer to the existing manner, and is not described in detail in the embodiments of the present application.
Since the sound wave has periodicity, in the embodiment of the present application, in order to have a certain phase difference, the preset time length may not be equal to the period corresponding to the audio frequency or a multiple of the period. In addition, in order to avoid sound cancellation caused by completely opposite phase differences, the preset time length is not equal to one-half period of the sound wave corresponding to the audio frequency or an integer multiple of the period plus one-half period.
Alternatively, two sounds may be considered acoustically the same sound, since the time difference to the listener is less than 35ms and the sound pressure difference remains within 10 dB. At this time, the directivity of the direct sound is maintained and is regarded as the only direction of the sound source. But due to the existence of the phase difference of the two sounds, the spatial sense can be enhanced additionally in an intangible way. Therefore, if the listener can feel a sense of space in the audio while viewing the sound as the same sound, the preset time period may be set to a time less than 35 ms. In addition, the original audio and the audio copy may be set to have a sound pressure difference within 10 dB. If the listener wants to see the sound as a spatial sensation caused by different sounds, like a sound formed by reflecting one sound in a room multiple times, the preset time may be set to be greater than 35ms, or the sound pressure difference may be set to be other than 10 dB.
Optionally, in this embodiment of the application, when performing sound effect enhancement, the number of audio copies that can be copied in the target audio channel is not limited, and may also be two or more, and a certain delay may be set between different audio copies and the original audio to implement a difference in phase difference, thereby implementing multiple spatial senses.
Alternatively, some audio data may carry phase information, and some audio data may not carry phase information. Therefore, before enhancing the spatial sense of the audio transmitted by the target audio channel through the phase information, it can be determined whether the phase information is included in the audio transmitted by the target audio channel.
For audio that does not carry phase information, virtual phase information may be added to the audio, that is, phase information is added to the audio data of the audio. And then the added phase information is processed to realize the enhancement of the sound effect.
In the embodiment of the application, the audio processed by the sound effect enhancement algorithm is played by the audio playing device such as the earphone and the loudspeaker which responds.
Optionally, during audio playing, a left channel signal and a right channel signal may be respectively corresponding to the audio signals and are respectively used for entering a left ear and a right ear of a user, and if the audio signals are played through an earphone, the left channel signal is played through a left earphone, and the right channel signal is played through a right earphone, so that a stronger stereo effect is achieved.
In the embodiment of the application, for the audio with the sound type needing the spatial sense enhancement, the representation of the spatial sense of the audio can be enhanced by processing the phase information of the audio in the target audio channel.
In the embodiment of the present application, a sound effect enhancing apparatus 300 is further provided, which is applied to an electronic device. Specifically, referring to fig. 3, the apparatus 300 includes: a path determining module 310, configured to determine a target audio path corresponding to the current audio output scene in the audio paths of the electronic device. A type determining module 320, configured to determine a target sound type of the audio transmitted by the target audio channel. And the sound effect enhancing module 330 is configured to enhance the audio transmitted by the target audio channel through a target sound effect algorithm corresponding to the target sound type.
Optionally, in this embodiment of the application, various audio output scenes may have corresponding audio output channels, for example, if a current audio output scene is a game scene, an audio channel corresponding to a media sound of the electronic device is taken as the target audio channel.
Optionally, in order that the audio playing in some scenes is not affected by the audio in other scenes, an audio path may also be created specifically for some scenes. For example, if the current audio output scene is a game scene, the created audio channel only used for transmitting the audio in the game scene is used as the target audio channel.
Optionally, in this embodiment of the application, after the type determining module 320 determines the target sound type, the sound effect enhancing module may further include an algorithm determining unit for determining a sound effect algorithm corresponding to the target sound type. Specifically, the algorithm determining unit is configured to obtain a target sound effect algorithm corresponding to the target sound type according to a preset correspondence between the sound type and the sound effect algorithm. The audio enhancement module 330 may further include an audio enhancement unit for enhancing the audio transmitted by the target audio channel by the target audio algorithm.
Optionally, in this embodiment of the application, the sound effect enhancing module 330 may be configured to enhance the spatial impression of the audio transmitted through the target audio channel through the phase information if the target sound type is a sound type with a spatial type parameter.
Optionally, the sound effect enhancing module 330 may include: and the audio copying unit is used for copying the original audio to obtain an audio copy by taking the audio transmitted by the target audio channel as the original audio. And the enhancement unit is used for delaying the audio copy for a preset time length relative to the original audio so that a phase difference exists between the audio copy and the original audio.
Alternatively, there may be some audio data in which phase information is present, and some other audio data in which phase information is not present. Therefore, in the embodiment of the present application, the apparatus may include a determining module, configured to determine whether phase information is included in audio transmitted by the target audio path. If included, the audio enhancement module 330 can enhance the spatial perception of the audio transmitted by the target audio channel through the phase information. If the audio does not include phase information, the apparatus provided in the embodiment of the present application may further include: and the phase adding module is used for adding virtual phase information to the audio. After the phase adding module adds virtual phase information to the audio, the sound effect enhancing module is used for enhancing the spatial sense of the audio transmitted by the target audio channel through the phase information.
Optionally, because the left channel signal and the right channel signal are played in a matching manner to generate a better spatial stereo effect, in this embodiment of the present application, the original audio may be used as the left channel signal, and the audio copy may be used as the right channel signal. The embodiment of the application may further include a playing module, configured to play the original audio and the audio copy through a left channel and a right channel, respectively.
It can be clearly understood by those skilled in the art that, for convenience and brevity of description, the specific working processes of the above-described apparatuses and modules may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
In the several embodiments provided in the present application, the coupling between the modules may be electrical, mechanical or other type of coupling.
In addition, functional modules in the embodiments of the present application may be integrated into one processing module, or each of the modules may exist alone physically, or two or more modules are integrated into one module. The integrated module can be realized in a hardware mode, and can also be realized in a software functional module mode.
Referring to fig. 4, a block diagram of an electronic device 400 according to an embodiment of the present disclosure is shown. The electronic device 400 may be a smart phone, a tablet computer, a music playing device, or other electronic devices capable of running an application. The electronic device includes one or more processors 410 (only one shown), memory 420, and one or more programs. Wherein the one or more programs are stored in the memory 420 and configured to be executed by the one or more processors 410. The one or more programs are configured to perform the methods described in the foregoing embodiments.
Processor 410 may include one or more processing cores. The processor 410 interfaces with various components throughout the electronic device 400 using various interfaces and circuitry to perform various functions of the electronic device 400 and process data by executing or executing instructions, programs, code sets, or instruction sets stored in the memory 420 and invoking data stored in the memory 420. Alternatively, the processor 410 may be implemented in hardware using at least one of Digital Signal Processing (DSP), Field-Programmable Gate Array (FPGA), and Programmable Logic Array (PLA). The processor 410 may integrate one or more of a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), a modem, and the like. Wherein, the CPU mainly processes an operating system, a user interface, an application program and the like; the GPU is used for rendering and drawing display content; the modem is used to handle wireless communications. It is understood that the modem may not be integrated into the processor 410, but may be implemented by a communication chip.
The Memory 420 may include a Random Access Memory (RAM) or a Read-Only Memory (Read-Only Memory). The memory 420 may be used to store instructions, programs, code, sets of codes, or sets of instructions. The memory 420 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for implementing at least one function, instructions for implementing the various method embodiments described above, and the like. The data storage area can also store data (such as a phone book, audio and video data, chatting record data) and the like created by the electronic equipment in use.
Referring to fig. 5, a block diagram of a computer-readable storage medium according to an embodiment of the present application is shown. The computer-readable storage medium 500 has stored therein program code that can be called by a processor to execute the method described in the above-described method embodiments.
The computer-readable storage medium 500 may be an electronic memory such as a flash memory, an EEPROM (electrically erasable programmable read only memory), an EPROM, a hard disk, or a ROM. Alternatively, the computer-readable storage medium 500 includes a non-volatile computer-readable medium (non-transitory-readable storage medium). The computer readable storage medium 500 has storage space for program code 510 for performing any of the method steps of the method described above. The program code can be read from or written to one or more computer program products. The program code 510 may be compressed, for example, in a suitable form.
Finally, it should be noted that: the above embodiments are only used to illustrate the technical solutions of the present application, and not to limit the same; although the present application has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; such modifications and substitutions do not necessarily depart from the spirit and scope of the corresponding technical solutions in the embodiments of the present application.
Claims (10)
1. A sound effect enhancement method is applied to electronic equipment, and comprises the following steps:
determining a target audio channel corresponding to a current audio output scene in the audio channels of the electronic equipment;
determining a target sound type of the audio transmitted by the target audio channel, wherein the target sound type is divided according to the characteristics of sound;
and enhancing the audio transmitted by the target audio channel through a target audio effect algorithm corresponding to the target sound type, wherein when the audio of the same sound type is transmitted in different audio channels, the audio effect algorithms corresponding to the same sound type are different.
2. The method of claim 1, wherein the enhancing the audio transmitted by the target audio channel by a target audio effect algorithm corresponding to the target sound type comprises:
and if the target sound type is a sound type with a space type parameter, enhancing the spatial sense of the audio transmitted by the target audio channel through the phase information.
3. The method of claim 2, wherein the enhancing the spatial perception of the sound transmitted by the target audio pathway by phase information comprises:
copying the original audio to obtain an audio copy by taking the audio transmitted by the target audio channel as the original audio;
and delaying the audio copy for a preset time length relative to the original audio so that a phase difference exists between the audio copy and the original audio.
4. The method of claim 3, wherein after delaying the audio copy with respect to the original audio for a predetermined time period to provide a phase difference between the audio copy and the original audio, further comprising:
and respectively playing the original audio and the audio copy through a left audio channel and a right audio channel.
5. The method of claim 2, wherein prior to enhancing the spatial perception of the audio transmitted by the target audio path by phase information, further comprising:
judging whether the audio transmitted by the target audio channel comprises phase information or not, if so, executing the step of enhancing the spatial sense of the audio transmitted by the target audio channel through the phase information;
and if the audio transmitted by the target audio channel does not comprise phase information, adding virtual phase information to the audio, and then executing the step of enhancing the spatial sense of the audio transmitted by the target audio channel through the phase information.
6. The method of claim 1, wherein the enhancing the audio transmitted by the target audio channel by a target audio effect algorithm corresponding to the target sound type comprises:
acquiring a target sound effect algorithm corresponding to the target sound type according to a preset corresponding relation between the sound type and the sound effect algorithm;
and enhancing the audio transmitted by the target audio channel by the target audio effect algorithm.
7. The method according to claim 1, characterized in that it comprises:
if the current audio output scene is a game scene, taking an audio channel corresponding to the media sound of the electronic equipment as the target audio channel; or
And if the current audio output scene is a game scene, taking the created audio channel which is only used for transmitting the audio in the game scene as the target audio channel.
8. An audio effect enhancement device, applied to an electronic device, the device comprising:
the path determining module is used for determining a target audio path corresponding to the current audio output scene in the audio paths of the electronic equipment;
the type determining module is used for determining a target sound type of the audio transmitted by the target audio channel, and the target sound type is divided according to the characteristics of sound;
and the sound effect enhancing module is used for enhancing the audio transmitted by the target audio channel through a target sound effect algorithm corresponding to the target sound type, wherein when the audio of the same sound type is transmitted in different audio channels, the sound effect algorithms corresponding to the same sound type are different.
9. An electronic device, comprising:
one or more processors;
a memory;
one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs configured to perform the method of any of claims 1-7.
10. A computer-readable storage medium, having stored thereon program code that can be invoked by a processor to perform the method according to any one of claims 1 to 7.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811028127.9A CN109165005B (en) | 2018-09-04 | 2018-09-04 | Sound effect enhancement method and device, electronic equipment and storage medium |
| PCT/CN2019/095140 WO2020048221A1 (en) | 2018-09-04 | 2019-07-08 | Sound effect enhancement method and apparatus, electronic device, and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811028127.9A CN109165005B (en) | 2018-09-04 | 2018-09-04 | Sound effect enhancement method and device, electronic equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109165005A CN109165005A (en) | 2019-01-08 |
| CN109165005B true CN109165005B (en) | 2020-08-25 |
Family
ID=64893921
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811028127.9A Active CN109165005B (en) | 2018-09-04 | 2018-09-04 | Sound effect enhancement method and device, electronic equipment and storage medium |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN109165005B (en) |
| WO (1) | WO2020048221A1 (en) |
Families Citing this family (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110580914A (en) * | 2019-07-24 | 2019-12-17 | 安克创新科技股份有限公司 | Audio processing method and equipment and device with storage function |
| CN111601157B (en) * | 2020-05-11 | 2022-06-14 | 海信视像科技股份有限公司 | Audio output method and display device |
| CN115904303A (en) * | 2021-05-21 | 2023-04-04 | 荣耀终端有限公司 | Method and equipment for playing sound |
| CN113241091B (en) * | 2021-05-28 | 2022-07-12 | 思必驰科技股份有限公司 | Sound separation enhancement method and system |
| CN113318432B (en) * | 2021-06-07 | 2024-02-23 | 网易（杭州）网络有限公司 | Music control method in game, nonvolatile storage medium and electronic device |
| CN114302295A (en) * | 2021-12-17 | 2022-04-08 | 深圳市锐尔觅移动通信有限公司 | Parameter configuration method and device, electronic equipment and storage medium |
| CN114510290A (en) * | 2022-01-26 | 2022-05-17 | 海宁奕斯伟集成电路设计有限公司 | Sound effect processing method and device, electronic equipment, storage medium and program product |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101808208A (en) * | 2009-02-17 | 2010-08-18 | 深圳Tcl新技术有限公司 | Television and method for setting sound effect mode of same |
| CN103927146A (en) * | 2014-04-30 | 2014-07-16 | 深圳市中兴移动通信有限公司 | Sound effect self-adapting method and device |
| CN104090766A (en) * | 2014-07-17 | 2014-10-08 | 广东欧珀移动通信有限公司 | Sound effect switching method and system for mobile terminal |
| CN105824598A (en) * | 2016-02-29 | 2016-08-03 | 维沃移动通信有限公司 | Sound effect management method and mobile terminal |
| CN106095387A (en) * | 2016-06-16 | 2016-11-09 | 广东欧珀移动通信有限公司 | The audio method to set up of a kind of terminal and terminal |
| CN106126174A (en) * | 2016-06-16 | 2016-11-16 | 广东欧珀移动通信有限公司 | The control method of a kind of scene audio and electronic equipment |
| CN106775562A (en) * | 2016-12-09 | 2017-05-31 | 奇酷互联网络科技（深圳）有限公司 | The method and device of audio frequency parameter treatment |
| CN107910018A (en) * | 2017-10-30 | 2018-04-13 | 广州视源电子科技股份有限公司 | Sound effect treatment method and system, computer-readable storage medium and equipment |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20060003631A (en) * | 2004-07-07 | 2006-01-11 | 주식회사 산돌커뮤니케이션 | Method and apparatus for generating sound effects on particular character in text |
| CN104238990B (en) * | 2013-06-14 | 2021-09-14 | 联想(北京)有限公司 | Electronic equipment and audio output method |
| CN106464939B (en) * | 2016-07-28 | 2019-10-25 | 北京小米移动软件有限公司 | The method and device of play sound effect |
| CN109218528B (en) * | 2018-09-04 | 2021-03-02 | Oppo广东移动通信有限公司 | Sound effect processing method and device and electronic equipment |
| CN109107158B (en) * | 2018-09-04 | 2020-09-22 | Oppo广东移动通信有限公司 | Sound effect processing method and device, electronic equipment and computer readable storage medium |
| CN109271128A (en) * | 2018-09-04 | 2019-01-25 | Oppo广东移动通信有限公司 | Audio setting method, device, electronic equipment and storage medium |
-
2018
- 2018-09-04 CN CN201811028127.9A patent/CN109165005B/en active Active
-
2019
- 2019-07-08 WO PCT/CN2019/095140 patent/WO2020048221A1/en active Application Filing
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101808208A (en) * | 2009-02-17 | 2010-08-18 | 深圳Tcl新技术有限公司 | Television and method for setting sound effect mode of same |
| CN103927146A (en) * | 2014-04-30 | 2014-07-16 | 深圳市中兴移动通信有限公司 | Sound effect self-adapting method and device |
| CN104090766A (en) * | 2014-07-17 | 2014-10-08 | 广东欧珀移动通信有限公司 | Sound effect switching method and system for mobile terminal |
| CN105824598A (en) * | 2016-02-29 | 2016-08-03 | 维沃移动通信有限公司 | Sound effect management method and mobile terminal |
| CN106095387A (en) * | 2016-06-16 | 2016-11-09 | 广东欧珀移动通信有限公司 | The audio method to set up of a kind of terminal and terminal |
| CN106126174A (en) * | 2016-06-16 | 2016-11-16 | 广东欧珀移动通信有限公司 | The control method of a kind of scene audio and electronic equipment |
| CN106775562A (en) * | 2016-12-09 | 2017-05-31 | 奇酷互联网络科技（深圳）有限公司 | The method and device of audio frequency parameter treatment |
| CN107910018A (en) * | 2017-10-30 | 2018-04-13 | 广州视源电子科技股份有限公司 | Sound effect treatment method and system, computer-readable storage medium and equipment |
Non-Patent Citations (1)
| Title |
|---|
| 很多人不知道的干货：从心里声学角度提升观众听觉体验的5个技巧;Get That Pro Sound;《http://www.sohu.com/a/160837024_301624》;20170728;第1-2页 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109165005A (en) | 2019-01-08 |
| WO2020048221A1 (en) | 2020-03-12 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109165005B (en) | Sound effect enhancement method and device, electronic equipment and storage medium | |
| CN109445740B (en) | Audio playing method and device, electronic equipment and storage medium | |
| CN109257500B (en) | Audio playing method and device, electronic equipment and storage medium | |
| US20140226842A1 (en) | Spatial audio processing apparatus | |
| US10475434B2 (en) | Electronic device and control method of earphone device | |
| CN109107158B (en) | Sound effect processing method and device, electronic equipment and computer readable storage medium | |
| EP3846020A1 (en) | Sound effect adjusting method and apparatus, electronic device, and storage medium | |
| WO2017219538A1 (en) | Channel data matching method and device | |
| CN109379490B (en) | Audio playing method and device, electronic equipment and computer readable medium | |
| US11223920B2 (en) | Methods and systems for extended reality audio processing for near-field and far-field audio reproduction | |
| TWI819344B (en) | Audio signal rendering method, apparatus, device and computer readable storage medium | |
| US20230364513A1 (en) | Audio processing method and apparatus | |
| US20170195817A1 (en) | Simultaneous Binaural Presentation of Multiple Audio Streams | |
| US20230370774A1 (en) | Bluetooth speaker control method and system, storage medium, and mobile terminal | |
| CN109298846B (en) | Audio transmission method and device, electronic equipment and storage medium | |
| WO2020063027A1 (en) | 3d sound effect processing method and related product | |
| JPWO2020022154A1 (en) | Calling terminals, calling systems, calling terminal control methods, calling programs, and recording media | |
| CN112073890B (en) | Audio data processing method and device and terminal equipment | |
| CN106293607B (en) | Method and system for automatically switching audio output modes | |
| CN114710730A (en) | Volume prompting method and device, earphone and storage medium | |
| KR20230004754A (en) | Audio Enhancement for Hearing Impaired in Shared Listening Environments | |
| CN213880236U (en) | Sound effect conversion device | |
| CN113411725B (en) | Audio playing method and device, mobile terminal and storage medium | |
| WO2023142783A1 (en) | Audio processing method and terminals | |
| TWI784594B (en) | Conference terminal and embedding method of audio watermark |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |