WO2022135201A1 - 音效调节方法及电子设备 - Google Patents

音效调节方法及电子设备 Download PDF

Info

Publication number
WO2022135201A1
WO2022135201A1 PCT/CN2021/137362 CN2021137362W WO2022135201A1 WO 2022135201 A1 WO2022135201 A1 WO 2022135201A1 CN 2021137362 W CN2021137362 W CN 2021137362W WO 2022135201 A1 WO2022135201 A1 WO 2022135201A1
Authority
WO
WIPO (PCT)
Prior art keywords
electronic device
sound effect
audio
sound
user
Prior art date
Application number
PCT/CN2021/137362
Other languages
English (en)
French (fr)
Inventor
胡伟湘
李伟
孙晨
吕帅林
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Priority to EP21909198.0A priority Critical patent/EP4246982A4/en
Priority to US18/258,883 priority patent/US20240045645A1/en
Publication of WO2022135201A1 publication Critical patent/WO2022135201A1/zh

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42203—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS] sound input device, e.g. microphone
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16—Sound input; Sound output
    • G06F3/165—Management of the audio stream, e.g. setting of volume, audio stream path
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • H04N21/43615—Interfacing a Home Network, e.g. for connecting the client to a plurality of peripherals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/439—Processing of audio elementary streams
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/443—OS processes, e.g. booting an STB, implementing a Java virtual machine in an STB or power management in an STB
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/485—End-user interface for client configuration
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/488—Data services, e.g. news ticker
    • H04N21/4882—Data services, e.g. news ticker for displaying messages, e.g. warnings, reminders
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control
    • H04S7/30—Control circuits for electronic adaptation of the sound field
    • H04S7/301—Automatic calibration of stereophonic sound system, e.g. with test microphone
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2420/00—Details of connection covered by H04R, not provided for in its groups
    • H04R2420/01—Input selection or mixing for amplifiers or loudspeakers
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2430/00—Signal processing covered by H04R, not provided for in its groups
    • H04R2430/01—Aspects of volume control, not necessarily automatic, in sound systems
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R3/00—Circuits for transducers, loudspeakers or microphones
    • H04R3/005—Circuits for transducers, loudspeakers or microphones for combining the signals of two or more microphones
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S2400/00—Details of stereophonic systems covered by H04S but not provided for in its groups
    • H04S2400/13—Aspects of volume control, not necessarily automatic, in stereophonic sound systems
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control
    • H04S7/30—Control circuits for electronic adaptation of the sound field
    • H04S7/302—Electronic adaptation of stereophonic sound system to listener position or orientation
    • H04S7/303—Tracking of listener position or orientation

Definitions

  • the present application relates to the technical field of terminals, and in particular, to a sound effect adjustment method and electronic device.
  • the sound effects of the audio played in the audio playback device are generally preset by the electronic device before leaving the factory or manually set by the user. During the process of playing the audio by the audio playback device, the sound effect will not change or need to be manually adjusted by the user. If the distance or angle between the user and the device changes or the surrounding environment is noisy during the audio playback process, it is difficult for the audio playback device to play the audio sound effects to the user with a good sense of hearing. In addition, the user's manual adjustment of sound effects is also cumbersome.
  • the present application provides a sound effect adjustment method and electronic device, which can use the electronic device that is most likely to be carried by the user near the audio playback device to collect audio signals, so as to determine whether the audio played by the audio playback device is listened to by the user at the location of the user. sound effects. Furthermore, the audio playback device can adjust the audio parameters of the audio during playback according to the user's listening sound effect, so that the user's listening sound effect achieves the best sound effect.
  • the above method for dynamically adjusting the sound effect can make the user's listening sound effect not affected by factors such as the distance change between the user and the audio playback device, the angle change, and the environmental noise change, thereby improving the user's experience of listening to audio.
  • the present application provides a sound effect adjustment method.
  • the method can be applied to a sound effect adjustment system.
  • the sound effect adjustment system may include a first electronic device and a second electronic device.
  • a communication connection is established between the first electronic device and the second electronic device.
  • the first electronic device is operable to play the first audio.
  • the second electronic device is operable to capture the second audio while the first audio is being played.
  • the method includes: when the first audio frequency is played with the first sound effect, the second sound effect can be determined according to the second audio frequency.
  • the second sound effect is the listening sound effect of the second electronic device when the first audio is played with the first sound effect.
  • the difference between the second sound effect and the third sound effect exceeds the first difference, the playing sound effect of the first audio frequency is determined as the fourth sound effect.
  • the difference between the listening sound effect of the second electronic device and the third sound effect is smaller than the first difference.
  • the third sound effect is the best sound effect when the first audio is played with the first sound effect.
  • the above-mentioned first audio may be audio of music, audio of video, audio in a voice call, audio in a video call, and the like.
  • This embodiment of the present application does not specifically limit the source of the first audio frequency.
  • the above-mentioned first sound effect and the above-mentioned fourth sound effect are both playing sound effects of the first electronic device playing the first audio frequency.
  • the playing sound effect may refer to the effect of the sound when the audio is output through the audio output device in the first electronic device.
  • the first electronic device can adjust the playing sound effect by changing the loudness, adjusting the equalizer of the audio signal and the parameters in the dynamic range controller and other audio parameters.
  • the above-mentioned second sound effect is a listening sound effect.
  • the listening sound effect may refer to the effect of the audio played by the first electronic device heard by the human ear of the user.
  • the audio signal collected by the electronic device carried by the user can be used to determine the listening sound effect of the user.
  • Listening to the sound effect is mainly determined by the above-mentioned playback sound effect. Listening to sound is also affected by factors such as the distance, angle, and ambient noise between the user and the electronic device.
  • the above-mentioned playing sound effects may be listening sound effects heard when the distance between the user and the audio playing device approaches zero.
  • the third sound effect mentioned above is the best sound effect.
  • the best sound effect can refer to the sound effect of the audio played by the electronic device in the best listening position and in a quiet environment. It can be understood that the best sound effect may be the listening sound effect with the best listening experience for the user to listen to the audio played by the electronic device.
  • the first electronic device may obtain the best sound effect mapping table.
  • the optimal sound effect mapping table may include the corresponding relationship between different audios being played with different playing sound effects and the values of the above audio parameters under the optimal sound effect.
  • the electronic device plays the first audio when the audio parameter is the first parameter (eg, the loudness is 10 decibels, the parameter of EQ and the parameter of DRC are preset parameters).
  • the electronic device may determine that the audio parameter of the first audio under the optimal sound effect is the second parameter by using the above-mentioned optimal sound effect mapping table.
  • the optimal sound effect mapping table may be preset in the first electronic device when the first electronic device leaves the factory.
  • the value of each audio parameter in the optimal sound effect mapping table may be determined according to professional instructions for adjusting audio parameters in the prior art.
  • the optimal sound effect mapping table may also be obtained by the first electronic device from a cloud server.
  • the first electronic device may use an optimal sound effect calculation algorithm to determine the value of the above-mentioned audio parameter under the optimal sound effect.
  • the above optimal sound effect calculation algorithm may be used to indicate the correspondence between different audios being played with different sound effects and the values of the above audio parameters under the optimal sound effect.
  • the above optimal sound effect calculation algorithm may be determined according to professional instructions for adjusting audio parameters in the prior art.
  • the above optimal sound effect calculation algorithm may be stored locally in the first electronic device or in a cloud server.
  • the first electronic device may continue to play the first audio with the first sound effect when the gap between the second sound effect and the third sound effect does not exceed the first gap.
  • the listening sound effect of the second electronic device at the first position is different from the listening sound effect of the second electronic device at the second position.
  • the above-mentioned first position and the above-mentioned second position are different positions.
  • the first electronic device that plays the first audio can collect the ambient sound at the location of the user by means of the second electronic device carried by the user. Based on the evaluation result of the first audio and the ambient audio at the user's location, the first electronic device may determine the listening sound effect of the first audio at the user's location.
  • the first electronic device can adjust the playing sound effect of the first audio frequency, so that the listening sound effect of the first audio frequency at the location of the user reaches the sound effect in the best listening position and in a quiet environment. That is to say, during the audio playback process of the first electronic device, the sound effects heard by the user (that is, listening to sound effects) may not be affected by factors such as changes in distance, angle, and ambient noise between the user and the first electronic device.
  • the first electronic device can dynamically adjust the playing sound effect of the first audio according to the change of the user's location and environment, so as to improve the user's experience of listening to the audio.
  • the step of determining the second sound effect according to the above-mentioned second audio can be performed by the first electronic device, or by the second Electronic equipment performs.
  • the step of determining the playing sound effect of the first audio as the fourth sound effect can be performed by the first sound effect. Executed by the electronic device, or executed by a second electronic device.
  • the first electronic device has a sound effect evaluation module.
  • the sound effect evaluation module may determine the second sound effect according to the second audio when the first audio is played with the first sound.
  • the sound effect evaluation module may determine the playing sound effect of the first audio as the fourth sound effect when the difference between the second sound effect and the third sound effect exceeds the first difference.
  • the first electronic device also has a sound effect adjustment module.
  • the sound effect adjustment module can adjust the playing sound effect of the first audio frequency played by the first electronic device from the first sound effect to the fourth sound effect.
  • the first electronic device may play the above-mentioned first audio with a fourth sound effect.
  • the sound effect evaluation module can determine, according to the audio collected by the second electronic device, whether the listening sound effect of the second electronic device reaches the best sound when the first audio is played with the fourth sound effect. sound effects.
  • the second audio frequency can be sent to the first electronic device.
  • the second electronic device has a sound effect evaluation module, which can determine the playing sound effect of the first audio frequency as the fourth sound effect.
  • the second electronic device may send the fourth sound effect to the first electronic device.
  • the audio adjustment module of the first electronic device can adjust the playing sound effect of playing the first audio from the first sound effect to the fourth sound effect.
  • the first electronic device may send the first audio played with the first sound effect to the second electronic device.
  • the above sound effect adjustment system may further include a third electronic device.
  • the first electronic device may establish a communication connection with the third electronic device.
  • the step of determining an audio playing sound effect as the fourth sound effect may be performed by the third electronic device.
  • the third electronic device may include a sound effect evaluation module, and may determine the playing sound effect of the first audio frequency as the fourth sound effect.
  • the third electronic device may send the fourth sound effect to the first electronic device.
  • the audio adjustment module of the first electronic device can adjust the playing sound effect of playing the first audio from the first sound effect to the fourth sound effect.
  • the second electronic device may send the collected second audio to the first electronic device.
  • the first electronic device may send the first audio played with the first sound effect and the second audio from the second electronic device to the third electronic device.
  • the first electronic device may instruct the second electronic device to establish a communication connection with the third electronic device.
  • the second electronic device may transmit the second audio to the third electronic device.
  • the first electronic device may send the first audio played with the first sound effect to the third electronic device.
  • the first electronic device may determine an electronic device having the above-mentioned sound effect evaluation module among the electronic devices (eg, the second electronic device and the third electronic device) that have established a communication connection with itself.
  • the second electronic device and the third electronic device have sound effect evaluation modules.
  • the first electronic device may select one of the second electronic device and the third electronic device according to the processing capability of the electronic device or according to the busyness of the electronic device, and determine according to the second audio when the first audio is played with the first sound effect. A second sound effect is generated, or when the gap between the second sound effect and the third sound effect exceeds the first gap, the playing sound effect of the first audio is determined as the fourth sound effect.
  • the above method can reasonably schedule the software and hardware resources of the electronic devices near the first electronic device, improve the efficiency of sound effect evaluation, and better adjust the sound effect.
  • the first electronic device may play the first audio with a first sound effect, and establish a communication connection (such as a Bluetooth connection with a nearby electronic device) , Wi-Fi connection, etc.).
  • a communication connection such as a Bluetooth connection with a nearby electronic device
  • Wi-Fi connection etc.
  • the first establishment of a communication connection between the first electronic device and a nearby electronic device may be done manually by a user.
  • the second and subsequent communication connections between the first electronic device and the nearby electronic devices may be automatically completed by the first electronic device and the nearby electronic devices.
  • the first electronic device may provide an electronic device option for selecting an electronic device for capturing the second audio.
  • These electronic device options include options corresponding to the second electronic device.
  • the first electronic device receives a user operation to select an option corresponding to the second electronic device.
  • the first electronic device may instruct the second electronic device to capture the second audio.
  • the user can select the electronic device he carries with him to collect the second audio, and assist the first electronic device to dynamically adjust the sound effect.
  • the first electronic device may determine, based on the first priority rule, that the second electronic device is the electronic device with the highest priority among the electronic devices that have established a communication connection with the first electronic device, and indicate The second electronic device captures the second audio.
  • the principle for determining the priority order of electronic devices in the first priority rule is as follows: according to the device type of the electronic device, the possibility of the user carrying it with him or her is determined, and the electronic device with the higher possibility of the user carrying it is in the first priority rule. Medium priority is higher.
  • the first priority rule may be that the priority of the wearable device is higher than the priority of the mobile phone.
  • the above-mentioned first priority rule may be preset.
  • the second audio may include a first audio portion and a background noise portion.
  • the above-mentioned second sound effect is determined by the first audio part and the background noise part. Wherein, the larger the background noise indicated by the background noise part, the louder in the fourth sound effect is higher than that in the first sound effect.
  • the first electronic device may increase the loudness, so as to prevent the background noise from drowning out the sound of the first audio frequency played by the first electronic device.
  • the loudness in the first sound effect may be the same as the loudness in the first sound effect, or the loudness in the fourth sound effect is higher than that in the first sound effect. Low loudness in sound effects.
  • the possibility of the user chatting with others or making a phone call is high.
  • Keeping the loudness of playing the first audio constant or reducing the loudness of the first electronic device can reduce the influence of the playing of the first audio on the user's chatting or making phone calls, so as to prevent the sound of the first audio from interfering with the sound of the user's speaking.
  • the present application further provides a sound effect adjustment method.
  • the method includes: the first electronic device can play the first audio with the first sound effect, and establish a communication connection with the second electronic device.
  • the first electronic device may receive the second audio from the second electronic device.
  • the second audio is collected by the second electronic device when the first audio is played.
  • the first electronic device may determine the second sound effect according to the second audio.
  • the second sound effect is a listening sound effect of the second electronic device when the first audio is played with the first sound effect.
  • the first electronic device may determine the playing sound effect of the first audio as the fourth sound effect when the gap between the second sound effect and the third sound effect exceeds the first gap.
  • the difference between the listening sound effect of the second electronic device and the third sound effect is smaller than the first difference.
  • the third sound effect is the best sound effect when the first audio is played with the first sound effect.
  • the first electronic device that plays the first audio can collect the ambient sound at the location of the user by means of the second electronic device carried by the user. Based on the evaluation result of the first audio and the ambient audio at the user's location, the first electronic device may determine the listening sound effect of the first audio at the user's location.
  • the first electronic device can adjust the playing sound effect of the first audio frequency, so that the listening sound effect of the first audio frequency at the location of the user reaches the sound effect in the best listening position and in a quiet environment. That is to say, during the audio playback process of the first electronic device, the sound effects heard by the user (that is, listening to sound effects) may not be affected by factors such as changes in distance, angle, and ambient noise between the user and the first electronic device.
  • the first electronic device can dynamically adjust the playing sound effect of the first audio according to the change of the user's location and environment, so as to improve the user's experience of listening to the audio.
  • the first electronic device may provide an electronic device option for selecting an electronic device for capturing the second audio.
  • These electronic device options include options corresponding to the second electronic device.
  • the first electronic device receives a user operation to select an option corresponding to the second electronic device.
  • the first electronic device may instruct the second electronic device to capture the second audio.
  • the user can select the electronic device he carries with him to collect the second audio, and assist the first electronic device to dynamically adjust the sound effect.
  • the first electronic device may determine, based on the first priority rule, that the second electronic device is the electronic device with the highest priority among the electronic devices that have established a communication connection with the first electronic device, and indicate The second electronic device captures the second audio.
  • the principle for determining the priority order of electronic devices in the first priority rule is as follows: according to the device type of the electronic device, the possibility of the user carrying it with him or her is determined, and the electronic device with the higher possibility of the user carrying it is in the first priority rule. Medium priority is higher.
  • the first priority rule may be that the priority of the wearable device is higher than the priority of the mobile phone.
  • the above-mentioned second audio includes a first audio portion and a background noise portion.
  • the second sound effect may be determined by the first audio portion and the background noise portion. Wherein, the larger the background noise indicated by the background noise part, the louder in the fourth sound effect is higher than that in the first sound effect.
  • the first electronic device may increase the loudness, so as to prevent the background noise from drowning out the sound of the first audio frequency played by the first electronic device.
  • the loudness in the fourth sound effect may be the same as that in the first sound effect, or the loudness in the fourth sound effect may be higher than that in the first sound effect. Low loudness in sound effects.
  • the possibility of the user chatting with others or making a phone call is high.
  • Keeping the loudness of playing the first audio constant or reducing the loudness of the first electronic device can reduce the influence of the playing of the first audio on the user's chatting or making phone calls, so as to prevent the sound of the first audio from interfering with the sound of the user's speaking.
  • the adjustment of the above-mentioned first audio from being played with the first sound effect to being played with the fourth sound effect can be achieved by adjusting a sound effect parameter.
  • the above audio parameters may include one or more of the following: loudness, parameters in the equalizer, parameters in the dynamic range controller.
  • the present application provides an electronic device.
  • the electronic device is a first electronic device.
  • the first electronic device may include an audio output device, a communication device, a memory and a processor.
  • the audio output device can be used to play the first audio with the first sound effect.
  • the communication device can be used to establish a communication connection with the second electronic device and receive the second audio from the second electronic device.
  • the second audio may be collected by the second electronic device while the first audio is being played.
  • Memory is used to store computer programs.
  • the processor may be configured to invoke a computer program to cause the first electronic device to execute any of the possible implementations of the second aspect above.
  • the present application provides a computer storage medium, comprising instructions, when the above-mentioned instructions are executed on an electronic device, the above-mentioned electronic device is made to execute any one of the possible implementations of the above-mentioned first aspect, or the above-mentioned electronic device is made to execute Any possible implementation manner of the second aspect above.
  • an embodiment of the present application provides a chip, the chip is applied to an electronic device, the chip includes one or more processors, and the processor is configured to invoke computer instructions to cause the electronic device to execute any one of the first aspects above a possible implementation manner, or the above-mentioned electronic device is made to perform any one of the possible implementation manners of the foregoing second aspect.
  • an embodiment of the present application provides a computer program product containing instructions, when the computer program product is run on a device, the electronic device is made to execute any one of the possible implementations of the first aspect above, or the above The electronic device executes any one of the possible implementations of the second aspect above.
  • the electronic device provided in the third aspect, the computer storage medium provided in the fourth aspect, the chip provided in the fifth aspect, and the computer program product provided in the sixth aspect are all used to execute the method provided by the embodiments of the present application. Therefore, for the beneficial effects that can be achieved, reference may be made to the beneficial effects in the corresponding method, which will not be repeated here.
  • Fig. 1 is a scene schematic diagram of a sound effect adjustment provided by an embodiment of the present application
  • FIG. 2 is a schematic structural diagram of a first electronic device 100 provided by an embodiment of the present application.
  • 3A to 3D are schematic diagrams of user interfaces for establishing communication connections between some first electronic devices 100 and other electronic devices according to an embodiment of the present application;
  • 4A to 4D are schematic diagrams of user interfaces for determining an electronic device for collecting ambient sound in some sound effect adjustment processes provided by embodiments of the present application;
  • 5A and 5B are schematic diagrams of user interfaces for determining an electronic device for collecting ambient sound in other sound effect adjustment processes provided by an embodiment of the present application;
  • FIG. 6 is a flowchart of a sound effect adjustment method provided by an embodiment of the present application.
  • FIG. 8 is a flowchart of another sound effect adjustment method provided by an embodiment of the present application.
  • first and second are only used for descriptive purposes, and should not be construed as implying or implying relative importance or implying the number of indicated technical features. Therefore, the features defined as “first” and “second” may explicitly or implicitly include one or more of the features. In the description of the embodiments of the present application, unless otherwise specified, the “multiple” The meaning is two or more.
  • a first electronic device 100 (such as a TV) playing the first audio can establish a communication connection with a nearby electronic device, for example, a Bluetooth connection, wireless fidelity (Wi-Fi) )connect.
  • the first electronic device 100 establishes a communication connection with the second electronic device 200 .
  • the second electronic device 200 is a device (such as a watch) carried by the user.
  • a microphone is arranged in the second electronic device 200 .
  • the first electronic device 100 may instruct the second electronic device 200 to turn on the microphone to collect ambient sounds.
  • the ambient sound is the ambient sound of the user's location.
  • the ambient sound may include the sound of the first electronic device 100 playing the first audio and ambient noise at the location of the user.
  • the first electronic device 100 can also establish a communication connection with the third electronic device 300 (eg, a mobile phone).
  • the third electronic device 300 has a sound effect evaluation module.
  • the third electronic device 300 may acquire the first audio played by the first electronic device 100 and the ambient audio obtained by the second electronic device 200 collecting ambient sounds.
  • the sound effect evaluation module in the third electronic device 300 can evaluate whether the listening sound effect of the first audio frequency at the location of the user reaches the best sound effect.
  • the above best sound effect may be the sound effect of the audio played by the first electronic device 100 in the best listening position and in a quiet environment.
  • the above-mentioned optimal listening position may be the position with the best sense of hearing when listening to the audio played by the first electronic device.
  • the above-mentioned quiet environment may be an environment in which the loudness of the ambient noise is lower than the preset loudness.
  • the first electronic device 100 may adjust the playing sound effect of the first audio according to the evaluation result of the sound effect evaluation module, so that the listening sound effect of the first audio at the location of the user reaches the above-mentioned optimal sound effect.
  • the above-mentioned first audio may be audio of music, audio of video, audio in a voice call, audio in a video call, and the like.
  • This embodiment of the present application does not specifically limit the source of the first audio frequency.
  • the above-mentioned first electronic device 100 may have a sound effect evaluation module. That is, the third electronic device 300 and the first electronic device 100 may be the same electronic device. After instructing the second electronic device 200 to collect ambient sound, the first electronic device 100 may receive ambient audio from the second electronic device 200 . The first electronic device 100 may adjust the playing sound effect of the first audio according to the evaluation result obtained by its own sound effect evaluation module.
  • the above-mentioned second electronic device 200 may also have a sound effect evaluation module. That is, the third electronic device 300 and the second electronic device 200 may be the same electronic device. After instructing the second electronic device 200 to collect ambient sound, the first electronic device 100 may send the played first audio to the second electronic device 200 . The second electronic device 200 may send the evaluation result obtained by its own sound effect evaluation module to the first electronic device 100 . Furthermore, the first electronic device 100 may adjust the playing sound effect of the first audio according to the above evaluation result.
  • the first electronic device that plays the first audio can collect the ambient sound at the location of the user by means of the second electronic device carried by the user. Based on the evaluation result of the first audio and the ambient audio at the user's location, the first electronic device may determine the listening sound effect of the first audio at the user's location.
  • the first electronic device can adjust the playing sound effect of the first audio frequency, so that the listening sound effect of the first audio frequency at the location of the user reaches the sound effect in the best listening position and in a quiet environment. That is to say, during the audio playback process of the first electronic device, the sound effects heard by the user (that is, listening to sound effects) may not be affected by factors such as changes in distance, angle, and ambient noise between the user and the first electronic device.
  • the first electronic device can dynamically adjust the playing sound effect of the first audio according to the change of the user's location and environment, so as to improve the user's experience of listening to the audio.
  • Sound effects may refer to the effects of sound.
  • Playing sound effects may refer to the effect of sound when audio is output through an audio output device in an electronic device.
  • Electronic devices can adjust the playback sound effects by changing audio parameters such as loudness (ie volume), adjusting the equalizer (EQ) of the audio signal, and parameters in the dynamic range control (DRC).
  • audio parameters such as loudness (ie volume), adjusting the equalizer (EQ) of the audio signal, and parameters in the dynamic range control (DRC).
  • the parameters in the above-mentioned EQ may include filter type (such as low-pass filter, high-pass filter, etc.), center frequency (center frequency), gain (gain), quality factor (quality factor), and the like.
  • the parameters in the above DRC may include frequency band range, signal threshold, compression ratio, signal gain, and the like.
  • the sound effect adjusted in the sound effect adjustment method mentioned in the embodiment of the present application may refer to playing sound effect.
  • the embodiment of the present application does not limit the audio parameters adjusted when the electronic device adjusts the playing sound effect, and the audio parameters used for changing the playing sound effect may also be other.
  • Listening to the sound effect may refer to the effect of the sound of the electronic device playing audio heard by the user's human ear. Listening to the sound effect is mainly determined by the above-mentioned playback sound effect. Listening to sound is also affected by factors such as the distance, angle, and ambient noise between the user and the electronic device.
  • playing sound effects may be listening sound effects heard when the distance between the user and the audio playing device approaches zero.
  • the electronic device can adjust the above-mentioned playing sound effect so that the listening sound effect of the user always achieves the best sound effect or is close to the best sound effect. In this way, the influence of factors such as the distance, angle, and environmental noise between the user and the electronic device on the user's listening sound effects can be reduced, and the user's listening experience of listening to audio can be improved.
  • the best sound effect can refer to the sound effect of the audio played by the electronic device in the best listening position and in a quiet environment. It can be understood that the best sound effect may be the listening sound effect with the best listening experience for the user to listen to the audio played by the electronic device.
  • an optimal sound effect mapping table may be stored in the electronic device.
  • the optimal sound effect mapping table may include the corresponding relationship between different audios being played with different playing sound effects and the values of the above audio parameters under the optimal sound effect.
  • the electronic device plays the first audio when the audio parameter is the first parameter (eg, the loudness is 10 decibels, the parameter of EQ and the parameter of DRC are preset parameters).
  • the electronic device may determine that the audio parameter of the first audio under the optimal sound effect is the second parameter by using the above-mentioned optimal sound effect mapping table.
  • the values of the above audio parameters under optimal sound effects may be preset when the electronic device leaves the factory. The specific values of these values may be determined according to the professional knowledge of adjusting audio parameters in the prior art, which is not limited in this embodiment of the present application.
  • the above optimal sound effect mapping table may also be stored in the cloud server, and the electronic device may obtain the optimal sound effect mapping table from the cloud server.
  • the electronic device may use an optimal sound effect calculation algorithm to determine the values of the above audio parameters under the optimal sound effect.
  • the above optimal sound effect calculation algorithm may be used to indicate the correspondence between different audios being played with different sound effects and the values of the above audio parameters under the optimal sound effect.
  • the above optimal sound effect calculation algorithm may be determined according to professional instructions for adjusting audio parameters in the prior art, which is not limited in this embodiment of the present application.
  • the above-mentioned first electronic device 100 is an electronic device having an audio playback capability.
  • the first electronic device 100 may be a television, a speaker, a mobile phone, a tablet computer, a notebook computer, an ultra-mobile personal computer (UMPC), a handheld computer, a netbook, a personal digital assistant (PDA), a portable Multimedia player (portable multimedia player, PMP), dedicated media player, etc.
  • UMPC ultra-mobile personal computer
  • PMP portable Multimedia player
  • dedicated media player etc.
  • the above-mentioned second electronic device 200 is an electronic device that can be carried by a user and has a sound collection capability.
  • the second electronic device 200 may be a watch, an earphone, a mobile phone, a PMP, or the like.
  • the second electronic device 200 and the first electronic device 100 are not the same electronic device.
  • the above-mentioned third electronic device 300 is an electronic device having an audio effect evaluation module.
  • the third electronic device 300 may be a television, a speaker, a mobile phone, a watch, a tablet computer, a notebook computer, a UMPC, a handheld computer, a netbook, a PDA, a PMP, a dedicated media player, or the like.
  • the third electronic device 300 and the first electronic device 100 may be the same electronic device.
  • the third electronic device 300 and the second electronic device 200 may be the same electronic device.
  • the first electronic device 100 , the second electronic device 200 , and the third electronic device 300 may also be other types of electronic devices.
  • FIG. 2 exemplarily shows a schematic structural diagram of a first electronic device 100 .
  • the first electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, Antenna 2, mobile communication module 150, wireless communication module 160, audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone jack 170D, sensor module 180, button 190, motor 191, indicator 192, camera 193, display screen 194 , and a subscriber identification module (subscriber identification module, SIM) card interface 195 and the like.
  • SIM subscriber identification module
  • the sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, and ambient light. Sensor 180L, bone conduction sensor 180M, etc.
  • the structures illustrated in the embodiments of the present invention do not constitute a specific limitation on the first electronic device 100 .
  • the first electronic device 100 may include more or less components than shown, or some components are combined, or some components are separated, or different components are arranged.
  • the illustrated components may be implemented in hardware, software, or a combination of software and hardware.
  • the processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (application processor, AP), a modem processor, a graphics processor (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), controller, memory, video codec, digital signal processor (digital signal processor, DSP), baseband processor, and/or neural-network processing unit (NPU) Wait. Wherein, different processing units may be independent devices, or may be integrated in one or more processors.
  • application processor application processor, AP
  • modem processor graphics processor
  • graphics processor graphics processor
  • ISP image signal processor
  • controller memory
  • video codec digital signal processor
  • DSP digital signal processor
  • NPU neural-network processing unit
  • the processor 110 may include a sound effect evaluation module and a sound effect adjustment module.
  • the sound effect evaluation module and the sound effect adjustment module can be integrated in different processor chips and executed by different chips.
  • the sound effect evaluation module can be integrated in the NPU or other chips.
  • the sound effect adjustment module can be integrated in the DSP chip. In this way, after the sound effect evaluation module obtains the sound effect evaluation result according to the first audio played by the first electronic device 100 and the environmental audio collected by other electronic devices, the chip where the sound effect adjustment module is located can be woken up to adjust the sound effect evaluation result according to the above-mentioned sound effect evaluation result. An audio playback sound effect, saving power consumption.
  • the sound effect evaluation module and the sound effect adjustment module may be integrated in the same processor chip, and the same chip performs related functions. For example, both the sound effect evaluation module and the sound effect adjustment module can be integrated into the DSP chip.
  • the sound effect evaluation module can perform sound source separation on the above-mentioned ambient audio. Specifically, the sound effect evaluation module can divide the above-mentioned ambient audio into two parts of audio: a playback audio part and a background noise part.
  • the above-mentioned audio playing part may be the audio corresponding to the sound of the first electronic device 100 playing the first audio for the electronic device that collects the ambient sound. Further, the sound effect evaluation module can evaluate the audio signal of the first audio with the best sound effect and the audio signal of the above-mentioned playing audio part, and obtain the sound effect evaluation result. This sound evaluation result can be used to indicate the gap between the user's listening sound and the best sound.
  • the sound effect evaluation module may send the above sound effect evaluation result to the sound effect adjustment module.
  • the sound effect adjustment module can acquire the value ranges of the above-mentioned audio parameters under the best sound effect of the first audio played by the first electronic device 100 . According to the sound effect evaluation result from the sound effect evaluation module, the sound effect adjustment module can adjust the playing sound effect of playing the first audio frequency. That is, the sound effect adjustment module can adjust the audio parameters such as loudness, parameters in the EQ, parameters in the DRC, etc., so that the values of the audio parameters of the audio signal in the above-mentioned playback audio part reach the above-mentioned first audio under the best sound effect. The value range of the parameter.
  • the sound effect adjustment module may also acquire the audio signal of the above-mentioned background noise part.
  • the higher the amplitude of the audio signal in the background noise part that is, the greater the background noise
  • the sound effect adjustment module can deliver the adjusted audio signal to the speaker 170A.
  • the speaker 170A can output sound.
  • a memory may also be provided in the processor 110 for storing instructions and data.
  • the memory in processor 110 is cache memory. This memory may hold instructions or data that have just been used or recycled by the processor 110 . If the processor 110 needs to use the instruction or data again, it can be called directly from the memory. Repeated accesses are avoided and the latency of the processor 110 is reduced, thereby increasing the efficiency of the system.
  • the processor 110 may include one or more interfaces.
  • the interface may include an integrated circuit (inter-integrated circuit, I2C) interface, an integrated circuit built-in audio (inter-integrated circuit sound, I2S) interface, a pulse code modulation (pulse code modulation, PCM) interface, a universal asynchronous transceiver (universal asynchronous transmitter) receiver/transmitter, UART) interface, mobile industry processor interface (MIPI), general-purpose input/output (GPIO) interface, subscriber identity module (SIM) interface, and / or universal serial bus (universal serial bus, USB) interface, etc.
  • I2C integrated circuit
  • I2S integrated circuit built-in audio
  • PCM pulse code modulation
  • PCM pulse code modulation
  • UART universal asynchronous transceiver
  • MIPI mobile industry processor interface
  • GPIO general-purpose input/output
  • SIM subscriber identity module
  • USB universal serial bus
  • the I2C interface is a bidirectional synchronous serial bus that includes a serial data line (SDA) and a serial clock line (SCL).
  • SDA serial data line
  • SCL serial clock line
  • the I2S interface can be used for audio communication.
  • the processor 110 may contain multiple sets of I2S buses.
  • the processor 110 may be coupled with the audio module 170 through an I2S bus to implement communication between the processor 110 and the audio module 170 .
  • the PCM interface can also be used for audio communications, sampling, quantizing and encoding analog signals.
  • the audio module 170 and the wireless communication module 160 may be coupled through a PCM bus interface.
  • the UART interface is a universal serial data bus used for asynchronous communication.
  • the bus may be a bidirectional communication bus. It converts the data to be transmitted between serial communication and parallel communication.
  • a UART interface is typically used to connect the processor 110 with the wireless communication module 160 .
  • the processor 110 communicates with the Bluetooth module in the wireless communication module 160 through the UART interface to implement the Bluetooth function.
  • the interface connection relationship between the modules illustrated in the embodiment of the present invention is only a schematic illustration, and does not constitute a structural limitation of the first electronic device 100 .
  • the first electronic device 100 may also adopt different interface connection manners in the foregoing embodiments, or a combination of multiple interface connection manners.
  • the charging management module 140 is used to receive charging input from the charger.
  • the power management module 141 is used for connecting the battery 142 , the charging management module 140 and the processor 110 .
  • the power management module 141 receives input from the battery 142 and/or the charging management module 140 and supplies power to the processor 110 , the internal memory 121 , the external memory, the display screen 194 , the camera 193 , and the wireless communication module 160 .
  • the wireless communication function of the first electronic device 100 may be implemented by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modulation and demodulation processor, the baseband processor, and the like.
  • Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals.
  • Each antenna in the first electronic device 100 may be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization.
  • the mobile communication module 150 may provide a wireless communication solution including 2G/3G/4G/5G etc. applied on the first electronic device 100 .
  • at least part of the functional modules of the mobile communication module 150 may be provided in the same device as at least part of the modules of the processor 110 .
  • the wireless communication module 160 can provide applications on the first electronic device 100 including wireless local area networks (WLAN) (such as Wi-Fi networks), Bluetooth, global navigation satellite system (GNSS), frequency modulation (frequency modulation, FM), near field communication technology (near field communication, NFC), infrared technology (infrared, IR) and other wireless communication solutions.
  • WLAN wireless local area networks
  • GNSS global navigation satellite system
  • FM frequency modulation
  • FM frequency modulation
  • NFC near field communication technology
  • infrared technology infrared, IR
  • the processor 110 may instruct the wireless communication module 160 to initiate one or more kinds of wireless communication, so that the first electronic device 100 establishes a communication connection with a nearby electronic device .
  • the processor 110 may instruct the wireless communication module 160 to initiate Bluetooth communication, so that the first electronic device 100 establishes a Bluetooth connection with a nearby Bluetooth device.
  • the processor 110 may instruct the wireless communication module 160 to initiate Wi-Fi network communication, so that the first electronic device 100 establishes a communication connection with an electronic device that accesses the same home Wi-Fi.
  • the first electronic device 100 implements a display function through a GPU, a display screen 194, an application processor, and the like.
  • the GPU is a microprocessor for image processing, and is connected to the display screen 194 and the application processor.
  • the GPU is used to perform mathematical and geometric calculations for graphics rendering.
  • Processor 110 may include one or more GPUs that execute program instructions to generate or alter display information.
  • Display screen 194 is used to display images, videos, and the like.
  • the first electronic device 100 may include 1 or N display screens 194 , where N is a positive integer greater than 1.
  • the first electronic device 100 may implement a shooting function through an ISP, a camera 193, a video codec, a GPU, a display screen 194, an application processor, and the like.
  • the ISP is used to process the data fed back by the camera 193 .
  • the shutter is opened, the light is transmitted to the camera photosensitive element through the lens, the light signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to the ISP for processing, and converts it into an image visible to the naked eye.
  • Camera 193 is used to capture still images or video.
  • the first electronic device 100 may include 1 or N cameras 193 , where N is a positive integer greater than 1.
  • a digital signal processor is used to process digital signals. In addition to processing digital image signals, it can also process other digital signals such as digital audio signals. For example, when the first electronic device 100 selects a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy and the like.
  • the NPU is a neural-network (NN) computing processor.
  • NN neural-network
  • Applications such as intelligent cognition of the first electronic device 100 can be implemented through the NPU, for example, sound source separation, image recognition, face recognition, speech recognition, text understanding, and the like.
  • the external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the first electronic device 100.
  • an external memory card such as a Micro SD card
  • Internal memory 121 may be used to store computer executable program code, which includes instructions.
  • the processor 110 executes various functional applications and data processing of the first electronic device 100 by executing the instructions stored in the internal memory 121 .
  • the first electronic device 100 may implement audio functions through an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, an application processor, and the like. Such as music playback, recording, etc.
  • the audio module 170 is used for converting digital audio information into analog audio signal output, and also for converting analog audio input into digital audio signal. Audio module 170 may also be used to encode and decode audio signals. In some embodiments, the audio module 170 may be provided in the processor 110 , or some functional modules of the audio module 170 may be provided in the processor 110 .
  • Speaker 170A also referred to as a "speaker" is used to convert audio electrical signals into sound signals.
  • the first electronic device 100 can listen to music through the speaker 170A, or listen to a hands-free call.
  • the receiver 170B also referred to as "earpiece" is used to convert audio electrical signals into sound signals.
  • the voice can be answered by placing the receiver 170B close to the human ear.
  • the microphone 170C also called “microphone” or “microphone”, is used to convert sound signals into electrical signals.
  • the first electronic device 100 may be provided with at least one microphone 170C.
  • the first electronic device 100 may be provided with two microphones 170C, which may implement a noise reduction function in addition to collecting sound signals.
  • the first electronic device 100 may further be provided with three, four or more microphones 170C to collect sound signals, reduce noise, identify sound sources, and implement directional recording functions.
  • the earphone jack 170D is used to connect wired earphones.
  • the pressure sensor 180A is used to sense pressure signals, and can convert the pressure signals into electrical signals.
  • the pressure sensor 180A may be provided on the display screen 194 .
  • the gyro sensor 180B may be used to determine the motion attitude of the first electronic device 100 .
  • the angular velocity of the first electronic device 100 about three axes ie, the x, y and z axes
  • the gyro sensor 180B may be determined by the gyro sensor 180B.
  • the acceleration sensor 180E can detect the magnitude of the acceleration of the first electronic device 100 in various directions (generally three axes). The magnitude and direction of gravity can be detected when the first electronic device 100 is stationary.
  • the fingerprint sensor 180H is used to collect fingerprints.
  • the first electronic device 100 can use the collected fingerprint characteristics to realize fingerprint unlocking, accessing application locks, taking photos with fingerprints, answering incoming calls with fingerprints, and the like.
  • Touch sensor 180K also called “touch panel”.
  • the touch sensor 180K may be disposed on the display screen 194 , and the touch sensor 180K and the display screen 194 form a touch screen, also called a “touch screen”.
  • the touch sensor 180K is used to detect a touch operation on or near it.
  • the touch sensor can pass the detected touch operation to the application processor to determine the type of touch event.
  • the bone conduction sensor 180M can acquire vibration signals. In some embodiments, the bone conduction sensor 180M can acquire the vibration signal of the vibrating bone mass of the human voice.
  • the keys 190 include a power-on key, a volume key, and the like.
  • the first electronic device 100 may receive key inputs, and generate key signal inputs related to user settings and function control of the first electronic device 100.
  • Motor 191 can generate vibrating cues.
  • the motor 191 can be used for vibrating alerts for incoming calls, and can also be used for touch vibration feedback.
  • the indicator 192 can be an indicator light, which can be used to indicate the charging state, the change of the power, and can also be used to indicate a message, a missed call, a notification, and the like.
  • the SIM card interface 195 is used to connect a SIM card.
  • the first electronic device 100 interacts with the network through the SIM card to implement functions such as call and data communication.
  • the first electronic device 100 employs an eSIM, ie an embedded SIM card.
  • the eSIM card can be embedded in the first electronic device 100 and cannot be separated from the first electronic device 100 .
  • the first electronic device 100 may also include more or less components.
  • the structure of the electronic device shown in FIG. 2 may also be a schematic structural diagram of the second electronic device 200 and the third electronic device 300 .
  • the second electronic device 200 and the third electronic device 300 may also include more or less components.
  • the following specifically describes an implementation process of establishing a communication connection between the first electronic device 100 and a nearby electronic device.
  • the introduction is made by taking the first electronic device 100 establishing a Bluetooth connection with a nearby electronic device as an example.
  • the first electronic device 100 may establish a Bluetooth connection with a nearby electronic device according to the received user operation.
  • 3A to 3D exemplarily show schematic diagrams of establishing a Bluetooth connection between the first electronic device 100 and the second electronic device 200 .
  • the first electronic device 100 may display a Bluetooth setting interface 210 .
  • the Bluetooth setting interface 210 may include a title bar 211 , a device name 212 , a Bluetooth switch control 213 , and a scan device control 214 . in:
  • the title bar 211 may include the textual information "Bluetooth”.
  • the title bar 211 may be used to prompt the user that the user interface currently displayed by the first electronic device 100 is the user interface for setting Bluetooth.
  • the device name 211 may be the device name of the first electronic device 100 .
  • the device name of the first electronic device 100 may be "Device100".
  • the other electronic devices may display the device name of the first electronic device 100 .
  • the Bluetooth switch control 213 can be used to turn on or turn off the Bluetooth of the first electronic device 100 . As shown in FIG. 3A , the Bluetooth of the first electronic device 100 is turned on. There may be text information "currently discoverable by nearby Bluetooth devices" on the Bluetooth switch control 213 .
  • the scan device control 214 may be used for the first electronic device 100 to scan for nearby Bluetooth devices.
  • the above-mentioned Bluetooth device may be an electronic device in which the Bluetooth is turned on and transmits broadcast data packets through the Bluetooth in a broadcast manner.
  • the first electronic device 100 may enter a scanning state to receive broadcast data packets sent by nearby Bluetooth devices. In this way, the first electronic device 100 can acquire information such as device addresses and device names of nearby Bluetooth devices.
  • the first electronic device 100 may display the user interface 220 as shown in FIG. 3B .
  • the user interface 220 may be used to display the information of the Bluetooth devices scanned by the first electronic device 100 .
  • the user interface 220 may include a title bar 221 , a second electronic device indication control 222 , a third electronic device indication control 224 , and a fourth electronic device indication control 223 . in:
  • the title bar 221 may include text information "Available Devices"
  • the title bar may be used to prompt the user that the electronic device indicated by each device indication control in the current user interface of the first electronic device 100 is a device that can establish a Bluetooth connection.
  • the second electronic device indicating control 222, the third electronic device indicating control 224, and the fourth electronic device indicating control 223 can be used for the first electronic device 100 and the second electronic device 200, the third electronic device 300 and the fourth electronic device 201, respectively Establish a Bluetooth connection.
  • the first electronic device 100 may also acquire the device type of the scanned Bluetooth device.
  • the first electronic device obtains that the device type of the second electronic device 200 is a watch.
  • the second electronic device indication control 222 may include the icon of the watch and the device name “Device200” of the second electronic device 200 .
  • the first electronic device acquires that the device type of the third electronic device 300 is a mobile phone.
  • the third electronic device indicating control 224 may include the icon of the mobile phone and the device name “Device300” of the third electronic device 300 .
  • the first electronic device acquires that the device type of the fourth electronic device 400 is a headset.
  • the fourth electronic device indicating control 223 may include the icon of the headset and the device name “Device201” of the fourth electronic device 400 .
  • the first electronic device 100 may send a Bluetooth connection request to the second electronic device 200 .
  • the Bluetooth connection request may be used to request to establish a Bluetooth connection with the second electronic device 200 .
  • the second electronic device 200 may display a user interface 230 as shown in FIG. 3C .
  • the user interface 230 may include a status bar 231 , a prompt box 232 . in:
  • the status bar 231 may include a signal strength indicator of a mobile communication signal, a Bluetooth indicator, and a battery status indicator.
  • the prompt box 232 may be used to prompt the user that the first electronic device 100 whose device name is "Device100" requests to establish a Bluetooth connection.
  • the prompt box 232 may include the text message "Does the Bluetooth connection request agree to connect with Device 100?".
  • Rejection controls 232A and consent controls 232B may also be included in prompt box 232 .
  • the reject control 232A can be used to reject the establishment of a Bluetooth connection with the first electronic device 100 .
  • the second electronic device 200 may send a connection rejection message to the first electronic device 100 .
  • the consent control 232B may be used to consent to establishing a Bluetooth connection with the first electronic device 100 .
  • the second electronic device 200 may send a message agreeing to the connection to the first electronic device 100 .
  • the first electronic device 100 may display a paired device list 215 on the Bluetooth setting interface 210 .
  • the paired device list 215 may include a device indicator that currently has a Bluetooth connection with the first electronic device 100, such as a second electronic device indicator 215A.
  • the second electronic device indicator 215A may include an icon of a device type (eg, a watch) of the second electronic device 200 , a device name "Device200", and a connection status prompt (eg, a text prompt "connected").
  • the paired device list 215 may also include indicators of devices that have ever established a Bluetooth connection with the first electronic device 100 but have not currently established a Bluetooth connection.
  • This embodiment of the present application does not limit the user interfaces shown in FIG. 3A to FIG. 3D. These user interfaces can also contain more or less content.
  • the first electronic device 100 can establish a Bluetooth connection with nearby electronic devices, such as the second electronic device 200 , the third electronic device 300 , and the fourth electronic device 201 according to the user’s instruction. connect.
  • one or more of the electronic devices such as the second electronic device 200 , the third electronic device 300 and the fourth electronic device 201 may also request to establish Bluetooth with the first electronic device 100 according to the received user operation connect.
  • the first electronic device 100 when the first electronic device 100 detects a user operation for playing the first audio, it can actively scan for nearby Bluetooth devices and establish a Bluetooth connection.
  • the Bluetooth of the first electronic device 100 is turned on and scans for nearby Bluetooth devices.
  • the electronic devices scanned by the first electronic device 100 may include electronic devices that have ever established a Bluetooth connection with the first electronic device 100 and electronic devices that have never established a Bluetooth connection with the first electronic device 100 .
  • the first electronic device 100 may store information (such as device name, Bluetooth address, connection key, etc.) of the electronic device that has established a Bluetooth connection.
  • the first electronic device 100 can use the above information to establish a Bluetooth connection again with the electronic device that has previously established a Bluetooth connection.
  • the first electronic device 100 may send a Bluetooth connection request to an electronic device that has never established a Bluetooth connection, and establish a Bluetooth connection with the electronic device after the electronic device replies to the request to agree to the connection.
  • the electronic device may display a prompt box 232 as shown in FIG. 3C on the display screen. Or the electronic device does not have a display screen, and the electronic device can prompt the user to request the establishment of a Bluetooth connection from the first electronic device 100 whose device name is "Device100" by means of a voice prompt or the like.
  • the first electronic device 100 may also acquire information of audio collection devices (eg, microphones) of the scanned electronic devices before establishing a Bluetooth connection with the scanned electronic devices.
  • the first electronic device 100 may screen these electronic devices according to whether the electronic devices have an audio collection device.
  • the first electronic device 100 can establish a Bluetooth connection with an electronic device having an audio collection device.
  • This embodiment of the present application does not limit the process of establishing a Bluetooth connection between the foregoing electronic devices.
  • the above-mentioned Bluetooth connection may be a classic bluetooth (classic bluetooth) connection or a low energy bluetooth (bluetooth low energy, BLE) connection.
  • BLE blue low energy
  • the user can instruct the electronic device (such as the first electronic device 100, the second electronic device 200, and the third electronic device 300) to execute the instruction corresponding to the control by touching the position of the control on the display screen (such as scanning for Bluetooth devices, establish a Bluetooth connection with other devices, etc.).
  • the user can also control the electronic device to execute corresponding instructions through the remote control.
  • the first electronic device 100 may also actively establish a communication connection with an electronic device in the same local area network when detecting that the first audio is started to be played. For example, the first electronic device 100 accesses home Wi-Fi. When it is detected that the first audio is started to be played, the first electronic device 100 can actively establish a communication connection with other electronic devices connected to the home Wi-Fi, and communicate with these electronic devices through the Wi-Fi network. Wherein, the first electronic device 100 can acquire the device type of these electronic devices and the information of the audio collection device through the Wi-Fi network.
  • the first electronic device 100 may establish a communication connection with a nearby electronic device through various communication methods. For example, the first electronic device 100 can either scan for nearby Bluetooth devices, and establish a Bluetooth connection with the electronic device whose Bluetooth is turned on. The first electronic device 100 may also establish a communication connection with an electronic device that is in the same home Wi-Fi as itself but has not established a Bluetooth connection through a Wi-Fi network.
  • This embodiment of the present application does not limit the manner in which the first electronic device 100 establishes a communication connection with a nearby electronic device.
  • the first electronic device 100 may also establish a communication connection with a nearby electronic device through a wireless local area network (wireless local area network, WLAN) direct connection when it is detected that the audio starts to be played.
  • the first electronic device 100 may request to cooperate with the electronic device that has established a communication connection with itself to obtain the listening sound effect of the played first audio at the location of the user.
  • WLAN wireless local area network
  • the first electronic device 100 may determine the second electronic device 200 for collecting ambient sound based on the electronic device selected by the user.
  • 4A to 4D exemplarily show schematic diagrams of the first electronic device 100 determining the second electronic device 200 for collecting ambient sound.
  • the first electronic device 100 may receive a user operation of playing music A (ie, the first audio).
  • the first electronic device 100 may display the user interface 240 shown in FIG. 4A .
  • the user interface 240 may be used to display content played by the first electronic device.
  • the user interface 240 may include a music name 241 , a playback progress bar 242 , a previous track control 243 , a playback control 244 , and a next track control 245 . in:
  • the music name 241 may be "music A". This embodiment of the present application does not limit the content of the music name 241 .
  • the music name 241 may be used to indicate that the content playable by the first electronic device 100 is music A.
  • the playing progress bar 242 can be used to compare the played duration of the music with the total duration of the music to indicate the progress of the music playing.
  • the previous control 243 may be used for the first electronic device 100 to play the previous music of the music A.
  • the next track control 245 may be used for the first electronic device 100 to play the next track of music A.
  • the play control 244 may be used for the first electronic device 100 to play the music A.
  • the above-mentioned user operation of playing the music A is the user operation acting on the playing control 244 .
  • the first electronic device 100 may display a prompt box 246 on the user interface 240 .
  • the prompt box 246 can be used to ask the user whether to enable the smart sound effect mode.
  • the first electronic device 100 may execute the sound effect adjustment method in the embodiment of the present application to dynamically adjust the playing sound effect of the music A.
  • the prompt box 246 may include the prompt "Do you want to enable the intelligent sound effect mode? In the intelligent sound effect mode, the playback content will be automatically adjusted to achieve the best sound effect".
  • the embodiments of the present application do not limit the specific content of the above prompts.
  • Prompt box 246 may also include a cancel control 246A and an open control 246B.
  • the cancel control 246A can be used to refuse to enable the smart sound mode.
  • the first electronic device 100 may start to play the music A according to the preset playing sound effect.
  • the above-mentioned preset playing sound effects may refer to the audio parameters in the audio playing process that are preset by the first electronic device 100 at the factory.
  • the first electronic device 100 starts playing music according to the preset playing sound effect, so that the user can have the best listening experience in the best listening position and in a quiet environment.
  • the preset playback sound effects may also refer to a part of audio parameters (eg, loudness) set by the user during the audio playback process, and another part of the audio parameters preset by the first electronic device 100 at the factory.
  • the enabling control 246B can be used to enable the intelligent sound effect mode.
  • the first electronic device 100 may display a device option box 247 on the user interface.
  • the device option box can be used by the user to select an electronic device that captures ambient sounds at their location.
  • the device option box 247 can contain the prompt "Please select a collaborative device (please select the device you carry with you, the collaborative device will turn on the microphone to collect nearby sounds, and the data collected by the microphone is only used for local sound effect adjustment, and will not be stored or uploaded to the cloud.” server)".
  • the above prompt language can be used to prompt the user to select the device he carries with him as a collaborative device to assist the first electronic device 100 to dynamically adjust the audio playback sound effects.
  • the selected electronic device will turn on an audio collection device (eg, a microphone) to collect ambient sound.
  • the embodiments of the present application do not limit the specific content of the above prompts.
  • the device options box 247 may also contain a connected device option 247A, an available device option 247B, and a determination control 247C. in:
  • the connected device option 247A may include a selection control of an electronic device that has a communication connection with the first electronic device 100 currently.
  • the first electronic device 100 establishes a communication connection with the second electronic device 200 whose device name is "Device200" and the third electronic device 300 whose device name is "Device300".
  • a second electronic device selection control and a third electronic device selection control may be included in the connected device option 247A.
  • the aforementioned electronic device selection controls may include icons for device types, device names, and check boxes. If the check box is empty, it means that the electronic device corresponding to the check box is not checked. The inclusion of " ⁇ " in the check box may indicate that the electronic device corresponding to the check box is selected.
  • the first electronic device 100 can send a message to the above one or more Multiple electronic devices send instructions for turning on the audio collection device and collecting ambient sounds.
  • Available device options 247B may include electronic device selection controls for which the first electronic device 100 has discovered that a communication connection can be established but has not yet established a communication connection. For example, when the first electronic device 100 scans for nearby Bluetooth devices, it finds a fourth electronic device 201 (such as a headset) with a device name of "Device201" and a fifth electronic device 301 (such as a mobile phone) with a device name of "Device301" . The first electronic device 100 has never established a Bluetooth connection with the fourth electronic device 201 and the fifth electronic device 301 . A fourth electronic device selection control and a fifth electronic device selection control may be included in the available device options 247B.
  • a fourth electronic device selection control and a fifth electronic device selection control may be included in the available device options 247B.
  • the first electronic device 100 can first communicate with this one or multiple electronic devices to establish a communication connection.
  • the first electronic device 100 may send a Bluetooth connection request to the one or more electronic devices, and establish a Bluetooth connection with the one or more electronic devices after receiving a connection consent message replied by the one or more electronic devices.
  • the one or more electronic devices may display a prompt box 232 as shown in FIG. 3C or prompt the user through a voice prompt or the like to request the first electronic device 100 to establish a Bluetooth connection connect.
  • the first electronic device 100 may send an instruction for turning on the audio collecting apparatus and collecting ambient sounds to the one or more electronic devices.
  • the user may select an electronic device corresponding to one or more electronic device selection controls in the connected device option 247A and the available device option 247B as a cooperating device.
  • the first electronic device 100 determines that the second electronic device 200 corresponding to the second electronic device selection control is in a selected state.
  • the first electronic device 100 may send to the second electronic device 200 an instruction for turning on the audio collection apparatus and collecting ambient sounds.
  • the second electronic device 200 can turn on the audio collection device, and collect the ambient sound at the location of the second electronic device 200 to obtain the ambient audio.
  • the first electronic device 100 may start to play audio (eg, music named "Music A"), and display the user interface 240 as shown in FIG. 4D .
  • the user interface 240 may include a previous track control 243 , a next track control 245 and a pause control 248 .
  • the above-mentioned pause control 248 can be used for the first electronic device 100 to pause and play the music A.
  • This embodiment of the present application does not limit the contents included in the user interface shown in FIG. 4A to FIG. 4D .
  • the user interface described above may also contain more or less content.
  • the scene in which the first electronic device 100 plays audio is not limited to the above-mentioned scene of playing audio, but may also be a scene in which audio is output by an audio output device (eg, a speaker) such as playing video, voice call, and video call.
  • an audio output device eg, a speaker
  • the first electronic device 100 can adjust the playing sound effect of the first audio according to the sound effect evaluation result obtained from the first audio played by the first electronic device 100 and the environmental audio collected by the second electronic device 200 in the first time period, so that the user can listen to the sound effect.
  • the sound effect is not affected by factors such as changes in the user's location and changes in the noise of the user's environment.
  • the first electronic device 100 may determine that the smart sound effect mode is in an on state. Then, the first electronic device 100 may display the user interface 240 as shown in FIG. 4C to instruct the user to select the cooperative device to collect the ambient sound at his own location. That is to say, the first electronic device 100 may no longer display the user interface shown in FIG. 3B to ask the user whether to enable the smart sound effect mode.
  • the first electronic device 100 may determine, according to the device type, the electronic device that is most likely to be carried by the user among the electronic devices that have established a communication connection with itself, and instruct the electronic device to collect ambient sounds.
  • a first priority rule may be stored in the first electronic device 100 .
  • wearable devices such as watches
  • the electronic device carried by the user may also be a mobile phone.
  • the first priority rule may be that the priority of the wearable device is higher than the priority of the mobile phone. That is to say, when the electronic devices that establish a communication connection with the first electronic device 100 include a watch and a mobile phone, the first electronic device 100 can preferentially send an instruction to turn on the audio collection device and collect ambient sounds to the watch.
  • the above-mentioned first priority rule may be preset in the memory of the first electronic device 100 when it leaves the factory. Alternatively, the above-mentioned first priority rule may be set by the user.
  • 5A and 5B exemplarily show schematic diagrams of the first electronic device 100 instructing the second electronic device 200 to turn on the audio collection apparatus.
  • the first electronic device 100 may receive a user operation for playing music A. Wherein, the first electronic device 100 may display the user interface 240 as shown in FIG. 5A .
  • the user interface 240 For the content contained in the user interface 240, reference may be made to the introduction of the user interface 240 shown in FIG. 4A, which will not be repeated here.
  • the first electronic device 100 may start to play the music A.
  • the first electronic device 100 may determine, according to the above-mentioned first priority rule, the electronic device with the highest priority among the electronic devices currently establishing a communication connection with itself.
  • the first electronic device 100 may determine that the second electronic device 200 (ie, the watch) has the highest priority.
  • the first electronic device 100 may send an instruction to turn on the audio collection apparatus to the second electronic device 200 .
  • the second electronic device 200 may display a user interface 250 as shown in FIG. 5B .
  • User interface 250 may include prompt box 251 .
  • the prompt box 251 can be used to ask the user whether to turn on the microphone of the second electronic device 200 .
  • the prompt box 251 may include a text prompt "Device 100 intelligently adjusts sound effects to request collaboration, whether to turn on the microphone?" to prompt the user that the first electronic device 100 whose device name is "Device100" needs to turn on the second electronic device 200 during the process of intelligently adjusting the sound effect.
  • the audio collection device collects ambient sound.
  • the specific content of the above text prompt is not limited in the embodiment of the present application.
  • Prompt box 251 may also include a deny control 251A and an agree control 251B.
  • the rejection control 251A can be used to reject the request of the first electronic device 100 to turn on the microphone.
  • the second electronic device 200 may send a message for rejecting the microphone to be turned on to the first electronic device 100 .
  • the consent control 251B may be used to consent to the request of the first electronic device 100 to turn on the microphone.
  • the second electronic device 200 may turn on the microphone, and send a message to the first electronic device 100 indicating that the microphone is turned on.
  • the first electronic device 100 may acquire the ambient audio collected by the second electronic device 200 in the first time period, and evaluate its own performance in the first time period. Whether the listening sound effect of the first audio played within a period of time at the location of the second electronic device 200 reaches the best sound effect. Further, the first electronic device 100 can adjust the playing sound effect of the first audio in the next time period of the first time period according to the sound effect evaluation result, so that the listening sound effect of the played first audio at the location of the second electronic device 200 reaches the maximum. good sound.
  • the first electronic device 100 may determine, according to the above-mentioned first priority rule, that the priority of the electronic devices that have established a communication connection with itself is lower than that of the first electronic device 100.
  • the electronic device of the second electronic device 200 for example, the third electronic device 300 .
  • the first electronic device 100 may send an instruction to turn on the audio collection apparatus to the third electronic device 300 .
  • the first electronic device 100 may send an instruction to turn on the audio collection apparatus to the third electronic device 300 .
  • the first electronic device 100 may send an instruction to turn on the audio capture device to all the electronic devices having the audio capture device in the electronic device that has established a communication connection with itself.
  • these electronic devices can display a prompt box 250 as shown in FIG. 5B or prompt the user through a voice prompt or the like to prompt the first electronic device 100 to request to turn on the audio collection device of the corresponding electronic device.
  • a user operation agreeing to turn on the audio collection device one or more of these electronic devices may turn on the audio capture device and send a message indicating that the audio capture device is turned on to the first electronic device 100 .
  • the first electronic device 100 may adjust the playback sound effect of playing the first audio by itself.
  • the user can select one or more electronic devices from a plurality of electronic devices (such as watches, mobile phones, etc.) that have received the above-mentioned instruction to turn on the audio capture device to turn on the audio capture device to assist the first electronic device 100 to be intelligent. Adjust sound effects.
  • a plurality of electronic devices such as watches, mobile phones, etc.
  • the selected multiple electronic devices may be electronic devices carried by multiple users.
  • both the watch of the first user and the watch of the second user have their microphones turned on to collect ambient sounds at their own locations.
  • the first electronic device 100 can adjust the playback sound of the first audio by itself, so that the first audio is in the first audio
  • the listening sound effect at the location of the user and the listening sound effect at the location of the second user are both close to the optimal sound effect. That is, both the first user and the second user can have a better sense of hearing when listening to the audio played by the first electronic device 100 .
  • the following describes an implementation method for the sound effect evaluation module to obtain the sound effect evaluation result based on the first audio and the ambient audio.
  • the ambient sound that can be collected by the second electronic device 200 mainly includes the sound played by the first audio and background noise near the second electronic device 200 .
  • the ambient audio collected by the second electronic device 200 mainly includes a playback audio part and a background noise part.
  • the audio signal of the above-mentioned playing audio part comes from the sound of the above-mentioned first audio playing.
  • the audio signal of the above-mentioned background noise portion comes from the background noise near the second electronic device 200 .
  • the sound effect evaluation module can separate the sound source of the above-mentioned ambient audio, and divide the ambient audio into two audio parts: the playing audio part and the background noise part.
  • the sound effect evaluation module may use spectral subtraction to separate out the background noise part in the ambient audio.
  • the ambient audio is the superposition of the audio signal of the playback audio part and the audio signal of the background noise part. That is, the background noise is additive noise.
  • the sound effect evaluation module can estimate the frequency spectrum of the background noise part.
  • the audio evaluation module can subtract the spectrum of the background noise part from the spectrum of the ambient audio to obtain the spectrum of the playing audio part. In this way, the sound effect evaluation module can realize sound source separation of ambient audio.
  • the implementation method of the above-mentioned spectral subtraction is simple and the computation amount is small.
  • the sound effect evaluation module can quickly separate the playing audio part and the background noise part in the ambient audio by using spectral subtraction, and the obtained audio signal of the playing audio part has a high signal-to-noise ratio.
  • the sound effect evaluation module can use the trained neural network to separate out the background noise part in the ambient audio.
  • the neural network may be trained using a large number of training samples.
  • a training sample may be composed of the above-mentioned ambient audio and the playing audio part of the ambient audio.
  • a trained neural network can receive ambient audio and output the playback audio portion of that ambient audio. In this way, the sound effect evaluation module can realize sound source separation of ambient audio.
  • the above-mentioned neural network may be, for example, a convolutional neural network, a deep neural network.
  • the embodiments of the present application do not limit the types of the above-mentioned neural networks.
  • the above-mentioned method for implementing sound source separation using a trained neural network requires a large number of operations to obtain a trained neural network.
  • the trained neural network can better separate the playing audio part and the background noise part in the ambient audio.
  • the sound effect evaluation module may use the blind source separation method to separate the background noise part in the ambient audio.
  • the second electronic device 200 may use two or more microphones to collect ambient sound to obtain ambient audio. Since sounds from different sources (such as the sound of the first audio frequency, the sound of each sound source in the background noise, etc.) are generated by different physical processes, the sounds from different sources are independent of each other.
  • the sound effect evaluation module can determine the directions of different sound sources in the ambient sound (eg, the direction of the sound of the first audio, the direction of each sound source in the background noise, etc.). Further, the sound effect evaluation module may determine audio signals corresponding to sounds from different sources in the ambient audio through independent component analysis. In this way, the sound effect evaluation module can realize sound source separation of ambient audio.
  • the above implementation method using the blind source separation method requires that the electronic device for collecting ambient sound has at least two microphones.
  • the blind source separation method can better realize the separation of the playback audio part and the background noise part in the ambient audio.
  • the sound effect evaluation module can use one or more of the above implementation manners to separate the sound source of the ambient audio. Not limited to the above method of sound source separation, the sound effect evaluation module can also collect other sound source separation methods to separate the above-mentioned playback audio part and the above-mentioned background noise part from the ambient audio.
  • the sound effect evaluation module may obtain the audio signal of the first audio frequency under the best sound effect.
  • the above-mentioned first audio may be an audio file played by the first electronic device 100 , including an audio signal to be output.
  • the first audio frequency may be stored in a buffer area before being output through the speaker.
  • the electronic device can extract the above-mentioned first audio from the buffer area, and pass the first audio to the sound effect evaluation module.
  • This embodiment of the present application does not limit the manner in which the sound effect evaluation module obtains the first audio.
  • the sound effect evaluation module may determine the audio signal of the first audio frequency under the optimal sound effect according to the value range of each audio parameter under the optimal sound effect.
  • the sound effect evaluation module can obtain the sound effect evaluation result by comparing the difference between the audio signal of the first audio frequency under the best sound effect and the audio signal of the playing audio part. This sound evaluation result can be used to indicate the gap between the user's listening sound and the best sound.
  • the gap between the listening sound effect and the best sound effect may specifically refer to the gap between the audio parameters corresponding to playing the first audio with the listening sound effect and the audio parameters corresponding to playing the first audio with the best sound effect. For example, when the first audio is played with the listening sound effect, the loudness is 50 decibels. When playing the first audio with the best sound, the loudness is 60 decibels.
  • the difference between the listening sound effect and the best sound effect may include a difference in loudness among the audio parameters, that is, a difference of 10 decibels. Not limited to the above-mentioned loudness.
  • the above-mentioned difference between the listening sound effect and the best sound effect may also include the difference in value of other parameters in the audio parameters. For example, the difference in center frequency in EQ, the difference in gain, the difference in frequency range in DRC, the difference in compression ratio, etc.
  • the sound effect evaluation module may obtain a plurality of ambient audios.
  • the multiple ambient audios may be collected by multiple different electronic devices (eg, electronic devices carried by multiple users).
  • the sound effect evaluation module can separate the sound source of the multiple ambient audios, and compare the difference between the audio signal of the first audio with the best sound effect and the audio signal of the playing audio part of the multiple ambient audios to obtain the sound effect evaluation result. That is to say, the sound effect evaluation result can indicate the gap between the listening sound effect of multiple users and the best sound effect.
  • the sound effect evaluation module may be configured in one or more electronic devices of the first electronic device 100 , the second electronic device 200 , the third electronic device 300 and other electronic devices. This embodiment of the present application does not limit this.
  • the following describes an implementation method for the sound effect adjustment module to adjust the playing sound effect of the first audio based on the sound effect evaluation result.
  • a sound effect adjustment module may be integrated in the processor 110 of the first electronic device 100 .
  • the sound effect adjustment module can adjust the loudness of the audio played by the first electronic device 100 .
  • the sound effect adjustment module may include an EQ component, a DRC component and other components for adjusting audio signals. Through the above-mentioned EQ component and DRC component, the sound effect adjustment module can apply effects such as equalization and dynamic range control to the first audio frequency, so as to adjust the playback sound effect of the first audio frequency.
  • the sound effect adjustment module can obtain the sound effect evaluation result of the above-mentioned sound effect evaluation module. If the sound effect evaluation result indicates that the difference between the listening sound effect and the best sound effect is smaller than the preset threshold, the sound effect adjustment module can keep the current audio parameters unchanged. If the sound effect evaluation result indicates that the difference between the listening sound effect and the best sound effect is greater than the above-mentioned preset threshold, the sound effect adjustment module can adjust various audio parameters to change the playback sound effect of the first audio, so that the user's listening sound effect is different from the best sound effect. The gap between them is smaller than the above preset threshold. The sound effect adjustment module can process the first audio by using the adjusted audio parameters, and deliver the processed audio signal to the speaker. The speaker can play the above processed audio signal.
  • the above-mentioned sound effect evaluation result may include a gap between the listening sound effect at the location of the plurality of electronic devices and the best sound effect.
  • the sound effect adjustment module can calculate the average value of the difference between the listening sound effect and the best sound effect at the positions of the plurality of electronic devices. Then, the sound effect adjustment module can adjust various audio parameters according to the average value obtained by the above calculation, so as to change the playing sound effect of the first audio frequency. In this way, the first electronic device 100 can enable the users at the locations where the above-mentioned multiple electronic devices are located to have a better sense of hearing when listening to the first audio.
  • the first electronic device 100 can determine the listening sound effect of the user listening to the first audio according to the environmental audio collected by the second electronic device 200 . Furthermore, the first electronic device 100 can dynamically adjust the audio parameters in the process of playing the first audio, so as to reduce the influence of the user's listening sound effects by factors such as changes in the distance, angle, and background noise between the user and the first electronic device 100, so that The user's listening sound can reach or be close to the best sound effect.
  • the sound effect adjustment module may further adjust the loudness of playing the first audio according to the audio signal of the background noise part separated from the ambient audio. For example, the higher the amplitude of the audio signal in the background noise part (that is, the greater the background noise), the greater the adjustment amount by which the sound effect adjusting module adjusts the loudness of the first audio during playback.
  • the first electronic device 100 may increase the loudness to prevent the background noise from drowning out the sound of the first audio played by the first electronic device 100 .
  • the sound effect evaluation module may further evaluate whether the background noise portion contains human voices. If it is determined that the background noise part contains human voices, the sound effect evaluation module may send a message indicating that the background noise part contains human voices to the sound effect adjustment module. Further, the sound effect adjustment module can keep the loudness of the played first audio unchanged, or reduce the loudness of the played first audio.
  • the first electronic device 100 keeps the loudness of playing the first audio unchanged or reduces the loudness to reduce the influence of playing the first audio on the user's chatting or making phone calls, so as to prevent the sound of the first audio from interfering with the sound of the user's speech.
  • the embodiment of the present application does not limit the specific method for evaluating whether the background noise part contains human voice.
  • the sound effect evaluation module can use a support vector machine algorithm to identify whether the audio signal in the background noise part contains human voice.
  • the specific process of evaluating whether the background noise part contains human voice reference may be made to the implementation process of identifying whether the audio contains human voice in the prior art.
  • the following describes a sound effect adjustment method provided by an embodiment of the present application based on a scenario in which the first electronic device 100 evaluates and adjusts sound effects, and the second electronic device 200 collects ambient sounds.
  • FIG. 6 exemplarily shows a flowchart of a sound effect adjustment method provided by an embodiment of the present application.
  • the method may include steps S101-S110.
  • the method is described by taking the first electronic device 100 establishing a Bluetooth connection with a nearby electronic device as an example. in:
  • the first electronic device 100 detects a user operation for playing the first audio.
  • the above-mentioned user operation for playing the first audio can be, for example, the aforementioned user operation acting on the playback control 244 shown in FIG. 4A .
  • the first electronic device 100 may scan for nearby Bluetooth devices and discover the second electronic device 200 (eg, a watch). The first electronic device 100 may establish a Bluetooth connection with the second electronic device 200 and determine the device type of the second electronic device 200 .
  • the first electronic device 100 also discovers a third electronic device 300 (eg, a mobile phone).
  • the first electronic device may establish a Bluetooth connection with the third electronic device 300 and determine the device type of the third electronic device 300 .
  • the first electronic device 100 may scan for nearby Bluetooth devices. For the manner in which the first electronic device 100 establishes a communication connection with a nearby Bluetooth device, reference may be made to the foregoing embodiments, which will not be repeated here.
  • the first electronic device 100 establishes a Bluetooth connection with the second electronic device 200 and the third electronic device 300 .
  • the first electronic device 100 may determine the device type of the second electronic device 200, such as a watch.
  • the first electronic device 100 may determine the device type of the third electronic device 300, such as a mobile phone.
  • the first electronic device 100 may determine that the priority of the second electronic device 200 is higher than the priority of the third electronic device 300 according to a preset first priority rule.
  • the first priority rule can be used to determine the priority of the devices that collect ambient sound.
  • the first priority rule may be that the priority of the wearable device is higher than the priority of the mobile phone.
  • the device type of the second electronic device 200 is a watch (ie, a wearable device).
  • the device type of the third electronic device 300 is a mobile phone. It is more likely that the second electronic device 200 is an electronic device carried by the user.
  • the first electronic device 100 may preferentially request the second electronic device 200 as a cooperative device to collect ambient sounds at the location of the user. For the method for the first electronic device 100 to determine an electronic device that collects ambient sound according to the above-mentioned first priority rule, reference may be made to the descriptions in the foregoing embodiments, which will not be repeated here.
  • the first electronic device 100 may also determine the electronic device for collecting ambient sound based on the electronic device selected by the user.
  • the electronic device 100 may also determine the electronic device for collecting ambient sound based on the electronic device selected by the user.
  • the electronic device selected by the user For a specific implementation method, reference may be made to the foregoing description of the embodiments shown in FIG. 4A to FIG. 4D .
  • the first electronic device 100 may send an instruction to the second electronic device 200 to instruct the second electronic device 200 to turn on the microphone.
  • the second electronic device 200 may turn on the microphone, and collect ambient sound to obtain ambient audio.
  • the second electronic device 200 may directly turn on the microphone to collect ambient sounds.
  • the second electronic device 200 may display a prompt box 251 as shown in FIG. Whether the user agrees to turn on the microphone.
  • the second electronic device 20 can turn on the microphone to collect ambient sounds.
  • the device for collecting ambient sound in the second electronic device 200 is not limited to a microphone, and may also be other types of audio collecting devices.
  • the second electronic device 200 may collect ambient sounds for a preset time length every preset time period to obtain ambient audio.
  • the second electronic device 200 may send the ambient audio collected each time to the first electronic device 100 .
  • a time stamp may be included in the above ambient audio.
  • the time stamp may be used to indicate the acquisition time of the ambient audio. In this way, the first electronic device 100 can evaluate the first audio played in the same time period and the collected ambient audio, and then adjust the playing sound effect of the first audio in the next time period.
  • the second electronic device 200 may send the ambient audio to the first electronic device 100 .
  • the first electronic device 100 may evaluate whether the listening sound effect of the first audio at the location of the second electronic device 200 reaches the best sound effect according to the first audio frequency and the ambient audio.
  • the first electronic device 100 may adjust the playing sound effect of the first audio so that the listening sound effect reaches the best sound effect.
  • the first electronic device 100 can keep the playing sound effect of the first audio unchanged and continue to play the first audio.
  • the first electronic device 100 may include a sound effect evaluation module and a sound effect adjustment module.
  • the sound effect evaluation module when receiving the environmental audio collected by the second electronic device 200, the sound effect evaluation module may obtain a sound effect evaluation result based on the first audio and the environmental audio.
  • the sound effect evaluation result may indicate whether the listening sound effect of the first audio at the location of the second electronic device 200 reaches the best sound effect.
  • the sound effect adjustment module may adjust the audio parameters of playing the first audio based on the above-mentioned sound effect evaluation result, so as to realize the adjustment of the playing sound of the first audio.
  • the communication connection mode between the first electronic device 100 and the nearby electronic devices is not limited to the above-mentioned Bluetooth connection, and may also be other communication connection modes, which are not limited in this embodiment of the present application.
  • the first electronic device 100 when the first electronic device 100 detects that it stops playing audio, the first electronic device 100 may send an instruction for instructing to turn off the microphone of the second electronic device 200 to the second electronic device 200 . Further, the second electronic device 200 can turn off the microphone.
  • the first electronic device playing the first audio can collect the ambient sound at the user's location by means of the second electronic device carried by the user. Based on the sound effect evaluation result of the first audio and the ambient audio at the user's location, the first electronic device may determine the listening sound effect of the first audio at the user's location. The first electronic device can adjust the playing sound effect of the first audio frequency, so that the listening sound effect of the first audio frequency at the location of the user reaches the sound effect in the best listening position and in a quiet environment.
  • the sound effects heard by the user may not be affected by factors such as changes in distance, angle, and ambient noise between the user and the first electronic device.
  • the first electronic device can dynamically adjust the playing sound effect of the first audio according to the change of the user's location and environment, without requiring the user to manually adjust the playing sound effect of the first audio, which greatly improves the user's experience of listening to the audio.
  • the following introduces another sound effect adjustment method provided by the embodiment of the present application based on a scenario in which the second electronic device 200 collects ambient audio and evaluates the sound effect, and the first electronic device 100 adjusts the sound effect.
  • FIG. 7 exemplarily shows a flowchart of another sound effect adjustment method provided by an embodiment of the present application. As shown in Figure 7, the method may include steps S201-S211. in:
  • the first electronic device 100 detects a user operation for playing the first audio.
  • the first electronic device 100 may scan for nearby Bluetooth devices and discover the second electronic device 200 (eg, a watch). The first electronic device 100 may establish a Bluetooth connection with the second electronic device 200 and determine the device type of the second electronic device 200 .
  • the first electronic device 100 also discovers a third electronic device 300 (eg, a mobile phone).
  • the first electronic device may establish a Bluetooth connection with the third electronic device 300 and determine the device type of the third electronic device 300 .
  • the first electronic device 100 may determine that the priority of the second electronic device 200 is higher than the priority of the third electronic device 300 according to a preset first priority rule.
  • the first priority rule can be used to determine the priority of the devices that collect ambient sound.
  • the first priority rule may be that the priority of the wearable device is higher than the priority of the mobile phone.
  • the first electronic device 100 may determine that the second electronic device 200 has a sound effect evaluation module.
  • the first electronic device 100 may inquire whether the electronic device has a sound effect evaluation module. If the electronic device has a sound effect evaluation module, the first electronic device 100 may instruct the electronic device to perform sound effect evaluation and return the sound effect evaluation result.
  • the first electronic device 100 determines that among the electronic devices that establish a communication connection with itself, the second electronic device 200 (watch) has the highest priority.
  • the first electronic device 100 may send a message for inquiring whether the second electronic device 200 has a sound effect evaluation module to the second electronic device 200 . If the second electronic device 200 has a sound effect evaluation module, the second electronic device 200 may send a message to the first electronic device 100 for indicating that it has a sound effect evaluation module. In this way, the first electronic device 100 can determine that the second electronic device 200 has a sound effect evaluation module.
  • the first electronic device 100 may also inquire whether other electronic devices with established communication connections (eg, the third electronic device 300 ) have an audio effect evaluation module.
  • the first electronic device 100 may send an instruction to the second electronic device 200 to instruct the second electronic device 200 to turn on the microphone.
  • the second electronic device 200 may turn on the microphone, and collect ambient sound to obtain ambient audio.
  • the first electronic device 100 may send the first audio to the second electronic device 200 .
  • the second electronic device 200 may evaluate whether the listening sound effect of the first audio at the location of the second electronic device 200 reaches the best sound effect according to the first audio frequency and the ambient audio, and obtain a sound effect evaluation result.
  • the second electronic device 200 may send the above sound effect evaluation result to the first electronic device 100 .
  • the first electronic device 100 may adjust the playing sound effect of the first audio frequency so that the listening sound effect reaches the best sound effect. If the above-mentioned sound effect evaluation result indicates that the above-mentioned listening sound effect reaches the best sound effect, the first electronic device 100 can maintain the playing sound effect of the first audio frequency unchanged.
  • the first electronic device 100 when the first electronic device 100 detects that it stops playing audio, the first electronic device 100 may send an instruction for instructing to turn off the microphone of the second electronic device 200 to the second electronic device 200 . Further, the second electronic device 200 can turn off the microphone.
  • the first electronic device that plays the first audio can collect the ambient sound at the user's location with the help of the second electronic device carried by the user.
  • the first electronic device may instruct the second electronic device having the sound effect evaluation module to perform sound effect evaluation. In this way, the software and hardware resources of the first electronic device and the second electronic device can be reasonably scheduled, and the efficiency of sound effect evaluation can be improved.
  • the first electronic device may determine the listening sound effect of the first audio at the user's location.
  • the first electronic device can adjust the playing sound effect of the first audio frequency, so that the listening sound effect of the first audio frequency at the location of the user reaches the sound effect in the best listening position and in a quiet environment. That is to say, during the audio playback process of the first electronic device, the sound effects heard by the user (that is, listening to sound effects) may not be affected by factors such as changes in distance, angle, and ambient noise between the user and the first electronic device.
  • the first electronic device can dynamically adjust the playing sound effect of the first audio according to the change of the user's location and environment, without requiring the user to manually adjust the playing sound effect of the first audio, which greatly improves the user's experience of listening to the audio.
  • the following describes another sound effect adjustment method provided by the embodiment of the present application based on a scenario in which the first electronic device 100 plays the first audio and adjusts the playing sound effect, the second electronic device 200 collects ambient audio, and the third electronic device 300 evaluates the sound effect.
  • FIG. 8 exemplarily shows another sound effect adjustment method provided by an embodiment of the present application. As shown in FIG. 8, the method may include steps S301-S314. in:
  • the first electronic device 100 detects a user operation for playing the first audio.
  • the first electronic device 100 may scan for nearby Bluetooth devices and discover the second electronic device 200 (eg, a watch). The first electronic device 100 may establish a Bluetooth connection with the second electronic device 200 and determine the device type of the second electronic device 200 .
  • the first electronic device 100 also discovers a third electronic device 300 (eg, a mobile phone).
  • the first electronic device may establish a Bluetooth connection with the third electronic device 300 and determine the device type of the third electronic device 300 .
  • the first electronic device 100 may determine that the priority of the second electronic device 200 is higher than the priority of the third electronic device 300 according to the preset first priority rule.
  • the first priority rule can be used to determine the priority of the devices that collect ambient sound.
  • the first priority rule may be that the priority of the wearable device is higher than the priority of the mobile phone.
  • the first electronic device 100 may determine that the second electronic device 200 has a sound effect evaluation module.
  • the first electronic device 100 may determine that the third electronic device 300 has a sound effect evaluation module.
  • the first electronic device 100 can check whether all the electronic devices that have established a communication connection with it have a sound effect evaluation module. These electronic devices may reply to the first electronic device 100 with a message indicating that the sound effect evaluation module is provided or a message indicating that the sound effect evaluation module is not provided.
  • both the second electronic device 200 and the third electronic device 300 have sound effect evaluation modules.
  • the first electronic device 100 may determine that the second electronic device 200 has a sound effect evaluation module, and determine that the third electronic device 300 has a sound effect evaluation module.
  • the first electronic device 100 may determine that the priority of the third electronic device 300 is higher than the priority of the second electronic device 200 according to the preset second priority rule.
  • the second priority rule may be determined according to the processing capability of the electronic device. The higher the processing capability of the electronic device, the higher the priority of the electronic device in the second priority rule.
  • the above-mentioned second priority rule may be preset in the first electronic device 100 .
  • the processing power of mobile phones is generally higher than that of wearable devices.
  • the priority of the mobile phone can be higher than the priority of the wearable device. That is, according to the second priority rule, the first electronic device 100 can determine that the priority of the third electronic device 300 (mobile phone) is higher than that of the second electronic device 200 (watch). The first electronic device 100 may instruct the third electronic device 300 to perform sound effect evaluation.
  • the priority order in the second priority rule can also be based on the current software and hardware resource occupancy of the electronic device ( ie busy condition) to determine the priority order of each electronic device. This embodiment of the present application does not limit the method for determining the priority order in the second priority rule.
  • the first electronic device 100 may send an instruction to the second electronic device 200 to instruct the second electronic device 200 to turn on the microphone.
  • the second electronic device 200 may turn on the microphone, and collect ambient sound to obtain ambient audio.
  • the second electronic device 200 may send the ambient audio to the first electronic device 100 .
  • the second electronic device 200 may send the ambient audio to the first electronic device 100 .
  • the first electronic device 100 may indicate an electronic device for collecting ambient sound (eg, the second electronic device 200 ) and an electronic device for sound effect evaluation (eg, the third electronic device 300 ) Establish a communication connection.
  • the first electronic device 100 may instruct the electronic device for sound effect evaluation (eg, the third electronic device 300 ) to establish a communication connection with the electronic device for collecting ambient sound (eg, the second electronic device 200 ).
  • the first electronic device 100 may instruct the second electronic device 200 to send the collected ambient audio to the third electronic device 300 . In this way, the second electronic device 200 may not need to forward the ambient audio from the first electronic device 100 to the third electronic device 300 .
  • the first electronic device 100 may send the first audio and the ambient audio to the third electronic device 300 .
  • the first electronic device 100 may transmit the first audio together with the ambient audio to the third electronic device 300 . Also, the first electronic device 100 may instruct the third electronic device 300 to perform sound effect evaluation.
  • the second electronic device 200 establishes a communication connection with the third electronic device 300 .
  • the second electronic device 200 may transmit the ambient audio to the third electronic device 300 .
  • the first electronic device 100 may transmit the first audio to the third electronic device 300 .
  • the third electronic device 300 may evaluate whether the listening sound effect of the first audio at the location of the second electronic device 200 reaches the best sound effect according to the first audio frequency and the ambient audio, and obtain a sound effect evaluation result.
  • the third electronic device 300 may send the above sound effect evaluation result to the first electronic device 100 .
  • the first electronic device 100 may adjust the playing sound effect of the first audio frequency so that the listening sound effect reaches the best sound effect. If the above-mentioned sound effect evaluation result indicates that the above-mentioned listening sound effect reaches the best sound effect, the first electronic device 100 can maintain the playing sound effect of the first audio frequency unchanged.
  • the first electronic device 100 when the first electronic device 100 detects that it stops playing audio, the first electronic device 100 may send an instruction for instructing to turn off the microphone of the second electronic device 200 to the second electronic device 200 . Further, the second electronic device 200 can turn off the microphone.
  • the first electronic device that plays the first audio can collect ambient sounds at the user's location by means of the second electronic device carried by the user.
  • the first electronic device may instruct the electronic device that has established a communication connection with itself and has a sound effect evaluation module to perform sound effect evaluation with a high processing capability or low occupation of software and hardware resources. This can reasonably schedule software and hardware resources of electronic devices near the first electronic device, improve the efficiency of sound effect evaluation, and better perform sound effect adjustment.
  • the first electronic device may determine the listening sound effect of the first audio at the user's location.
  • the first electronic device can adjust the playing sound effect of the first audio frequency, so that the listening sound effect of the first audio frequency at the location of the user reaches the sound effect in the best listening position and in a quiet environment. That is to say, during the audio playback process of the first electronic device, the sound effects heard by the user (that is, listening to sound effects) may not be affected by factors such as changes in distance, angle, and ambient noise between the user and the first electronic device.
  • the first electronic device can dynamically adjust the playing sound effect of the first audio according to the change of the user's location and environment, without requiring the user to manually adjust the playing sound effect of the first audio, which greatly improves the user's experience of listening to the audio.
  • the first electronic device is used to play the first audio.
  • the first electronic device may start to play the first audio after detecting a user operation for playing the first audio.
  • the above-mentioned user operation for playing the first audio can be, for example, the aforementioned user operation acting on the playback control 244 shown in FIG. 4A .
  • the second electronic device is configured to capture the second audio while the first audio is being played.
  • the first electronic device may, after detecting a user operation for playing the first audio, send an instruction for turning on the microphone and collecting the second audio to the second electronic device.
  • the first electronic device may play the first audio with the first sound effect.
  • the above-mentioned first sound effect may be the playing sound effect in the foregoing embodiment.
  • the first electronic device can adjust the first sound effect by changing the loudness, adjusting the EQ of the audio signal, parameters in the DRC and other audio parameters.
  • one of the first electronic device, the second electronic device, and the third electronic device may determine the second sound effect according to the second audio.
  • the second sound effect is the listening sound effect of the second electronic device when the first audio is played with the first sound effect. That is to say, when the first electronic device plays the first audio with the first sound effect, the sound effect heard by the user at the location where the second electronic device is located is the second sound effect.
  • one of the first electronic device, the second electronic device, and the third electronic device can evaluate whether the gap between the second sound effect and the third sound effect exceeds the first gap, and determine whether the difference between the second sound effect and the third sound effect exceeds the first gap.
  • the playing sound effect of the first audio frequency is determined as the fourth sound effect.
  • the fourth sound effect is the playing sound effect in the foregoing embodiment.
  • the result of evaluating whether the difference between the second sound effect and the third sound effect exceeds the first difference is the sound effect evaluation result in the foregoing embodiment.
  • the above-mentioned first gap may be preset.
  • the above-mentioned first difference may include difference in loudness, difference in center frequency in EQ, difference in gain in EQ, difference in frequency band range in DRC, difference in compression rate in DRC and other audio parameter differences.
  • the third sound effect is the best sound effect when the first audio is played with the first sound effect.
  • the third sound effect can be obtained by querying the optimal sound effect mapping table in the foregoing embodiment or using an optimal sound effect calculation algorithm.
  • the difference between the listening sound effect of the second electronic device and the third sound effect is smaller than the first difference.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • General Health & Medical Sciences (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Health & Medical Sciences (AREA)
  • Software Systems (AREA)
  • Acoustics & Sound (AREA)
  • Circuit For Audible Band Transducer (AREA)
  • Telephone Function (AREA)

Abstract

本申请公开了一种音效调节方法及电子设备。在该方法中，播放第一音频的第一电子设备可以指示第二电子设备开启音频采集装置，采集环境声音得到环境音频。第二电子设备为用户随身携带可能性最高的电子设备。基于第一音频和环境音频，第一电子设备可以确定第一音频在第二电子设备所在位置处的收听音效与最佳音效的差距。第一电子设备可以调节播放第一音频的音频参数，使得第一音频在第二电子设备所在位置处的收听音效达到最佳音效。该方法可以动态调节音频的播放音效，使得用户的收听音效不受用户与第一电子设备的距离变化、角度变化、环境噪声变化等因素的影响，提高用户收听音频的体验。

Description

音效调节方法及电子设备
本申请要求于2020年12月23日提交中国专利局、申请号为202011542202.0、申请名称为“音效调节方法及电子设备”的中国专利申请的优先权，其全部内容通过引用结合在本申请中。
技术领域
本申请涉及终端技术领域，尤其涉及一种音效调节方法及电子设备。
背景技术
随着各种音频播放设备(如电视、音箱)的普及应用，用户对音频播放设备播放音频的音效要求也越来越高。合适的音效可以给用户良好的听感。
音频播放设备中播放音频的音效一般是电子设备在出厂前预设的或者由用户手动设定。在音频播放设备播放音频的过程中，音效不会改变或者需要用户手动调节。若在音频播放过程中，用户与设备之间的距离、角度发生变化或者周围环境中噪声较大，音频播放设备播放音频的音效难以给用户带来良好的听感。并且，用户手动调节音效操作也比较繁琐。
发明内容
本申请提供了一种音效调节方法及电子设备，可以利用音频播放设备附近最有可能为用户随身携带的电子设备来采集音频信号，以确定音频播放设备播放的音频在用户所在位置处用户的收听音效。进而，音频播放设备可以根据用户的收听音效来调节音频在播放时的音频参数，使得用户的收听音效达到最佳音效。上述动态调节音效的方法，可以使用户的收听音效不受用户与音频播放设备的距离变化、角度变换、环境噪声变化等因素的影响，提高用户收听音频的体验。
第一方面，本申请提供一种音效调节方法。该方法可应用于音效调节系统。该音效调节系统可包括第一电子设备、第二电子设备。第一电子设备和第二电子设备建立有通信连接。第一电子设备可用于播放第一音频。第二电子设备可用于在第一音频被播放时采集第二音频。该方法包括：在上述第一音频以第一音效被播放时，可以根据上述第二音频确定出第二音效。该第二音效为上述第一音频以上述第一音效被播放时第二电子设备的收听音效。在上述第二音效与第三音效的差距超过第一差距的情况下，将上述第一音频的播放音效确定为第四音效。上述第一音频以上述第四音效被播放时第二电子设备的收听音效与第三音效的差距小于第一差距。上述第三音效为上述第一音频以上述第一音效被播放时的最佳音效。
上述第一音频可以是音乐的音频、视频的音频、语音通话中的音频、视频通话中的音频等等。本申请实施例对上述第一音频的来源不作具体限定。
上述第一音效和上述第四音效均为第一电子设备播放第一音频的播放音效。该播放音效可以指音频在经第一电子设备中的音频输出装置输出时声音的效果。第一电子设备可以通过改变响度、调节音频信号的均衡器以及动态范围控制器中的参数等音频参数来调节该播放音效。
上述第二音效为收听音效。该收听音效可以指用户的人耳所收听到的第一电子设备播放 音频的声音的效果。用户随身携带的电子设备采集到的音频信号可用于确定用户的收听音效。收听音效主要由上述播放音效决定。收听音效还会受到用户与电子设备之间的距离、角度以及环境噪声等因素的影响。其中，上述播放音效可以是用户与音频播放设备之间的距离趋近于零时所收听到的收听音效。
上述第三音效为最佳音效。最佳音效可以指电子设备播放的音频在最佳收听位置、安静环境下声音的效果。可以理解的，最佳音效可以是用户收听电子设备播放的音频听感体验最好的收听音效。
在一种可能的实现方式中，第一电子设备可以获取最佳音效映射表。该最佳音效映射表中可包含不同的音频在以不同的播放音效被播放与上述音频参数在最佳音效下的取值的对应关系。例如，电子设备在音频参数为第一参数(如响度为10分贝、EQ的参数和DRC的参数为预设参数)的情况下播放第一音频。电子设备可以通过上述最佳音效映射表确定第一音频在最佳音效下的音频参数为第二参数。该最佳音效映射表可以是第一电子设备在出厂时预置在第一电子设备中的。最佳音效映射表中各音频参数的取值可以是根据现有技术中调节音频参数的专业指示确定。该最佳音效映射表还可以是第一电子设备从云端服务器中获取的。
在另一种可能的实现方式中，第一电子设备可以利用最佳音效计算算法来确定上述音频参数在最佳音效下的取值。其中，上述最佳音效计算算法可用于指示不同的音频在以不同的音效被播放与上述音频参数在最佳音效下的取值的对应关系。上述最佳音效计算算法可以根据现有技术中调节音频参数的专业指示确定。上述最佳音效计算算法可以存储在第一电子设备本地或者存储在云端服务器中。
结合第一方面，在一些实施例中，在上述第二音效与第三音效的差距未超过第一差距的情况下，第一电子设备可以继续以第一音效播放第一音频。
结合第一方面，在一些实施例中，在第一音频以上述第一音效被播放时，第二电子设备在第一位置的收听音效与第二电子设备在第二位置的收听音效不同。上述第一位置与上述第二位置为不同的位置。
由上述方法可知，播放第一音频的第一电子设备可以借助用户携带的第二电子设备来采集用户所在位置处的环境声音。基于第一音频与用户所在位置处的环境音频的评估结果，第一电子设备可以确定第一音频在用户所在位置处的收听音效。第一电子设备可以调节第一音频的播放音效，使得第一音频在用户所在位置处的收听音效达到最佳收听位置、安静环境下的音效。也即是说，在第一电子设备播放音频的过程中，用户收听到的音效(即收听音效)可以不受用户与第一电子设备的距离变化、角度变化、环境噪声变化等因素的影响。第一电子设备可以根据用户所处位置环境的变化动态调节第一音频的播放音效，提高用户收听音频的体验。
结合第一方面，在一些实施例中，在上述第一音频以第一音效被播放时，可以根据上述第二音频确定出第二音效这一步骤可以由第一电子设备执行，或者由第二电子设备执行。
结合第一方面，在一些实施例中，在上述第二音效与第三音效的差距超过第一差距的情况下，将上述第一音频的播放音效确定为第四音效这一步骤可以由第一电子设备执行，或者由第二电子设备执行。
例如，第一电子设备具有音效评估模块。该音效评估模块可以在上述第一音频以第一音效被播放时，根据第二音频确定出第二音效。该音效评估模块可以在上述第二音效与第三音效的差距超过第一差距的情况下，将上述第一音频的播放音效确定为第四音效。其中，第一电子设备还具有音效调节模块。该音效调节模块可以将第一电子设备播放第一音频的播放音 效从第一音效调节为第四音效。第一电子设备可以以第四音效播放上述第一音频。进一步的，在第一音频以第四音效被播放时，音效评估模块可以根据第二电子设备采集的音频确定第二电子设备的收听音效是否达到第一音频在以第四音效播放时的最佳音效。
其中，第二电子设备采集得到第二音频后，可以将该第二音频发送给第一电子设备。
可选的，第二电子设备具有音效评估模块，可以将上述第一音频的播放音效确定为第四音效。第二电子设备可以将第四音效发送给第一电子设备。第一电子设备的音频调节模块可以将播放第一音频的播放音效从第一音效调节为第四音效。
其中，第一电子设备可以将以第一音效播放的第一音频发送给第二电子设备。
结合第一方面，在一些实施例中，上述音效调节系统还可以包括第三电子设备。第一电子设备可以与第三电子设备建立通信连接。在上述第一音频以第一音效被播放时，可以根据上述第二音频确定出第二音效这一步骤以及在上述第二音效与第三音效的差距超过第一差距的情况下，将上述第一音频的播放音效确定为第四音效这一步骤可以由第三电子设备执行。
例如，第三电子设备可以包含音效评估模块，可以将上述第一音频的播放音效确定为第四音效。第三电子设备可以将第四音效发送给第一电子设备。第一电子设备的音频调节模块可以将播放第一音频的播放音效从第一音效调节为第四音效。
其中，第二电子设备可以将采集得到的第二音频发送给第一电子设备。第一电子设备可以将以第一音效播放的第一音频以及来自第二电子设备的第二音频发送给第三电子设备。可选的，第一电子设备可以指示第二电子设备与第三电子设备建立通信连接。第二电子设备可以将第二音频发送给第三电子设备。第一电子设备可以将以第一音效播放的第一音频发送给第三电子设备。
结合第一方面，在一些实施例中，第一电子设备可以确定与自己建立有通信连接的电子设备(例如第二电子设备、第三电子设备)中具有上述音效评估模块的电子设备。其中，第二电子设备和第三电子设备具有音效评估模块。第一电子设备可以根据电子设备的处理能力强度或根据电子设备的忙碌程度，选择第二电子设备和第三电子设备中的一个在第一音频以第一音效被播放时，根据第二音频确定出第二音效，或在第二音效与第三音效的差距超过第一差距的情况下，将第一音频的播放音效确定为第四音效。
上述方法可以合理调度第一电子设备附近电子设备的软硬件资源，提高音效评估的效率，更好的进行音效调节。
结合第一方面，在一些实施例中，第一电子设备可以在检测到播放第一音频的用户操作之后，以第一音效播放第一音频，并与附近的电子设备建立通信连接(如蓝牙连接、Wi-Fi连接等)。其中，第一电子设备与附近的电子设备首次建立通信连接可以由用户手动操作完成。第一电子设备与附近的电子设备第二次以及之后的通信连接可以由第一电子设备与附近的电子设备自动完成。
结合第一方面，在一些实施例中，第一电子设备可以提供用于选择采集第二音频的电子设备选项。这些电子设备选项包含与第二电子设备对应的选项。第一电子设备接收到选择与第二电子设备对应的选项的用户操作。第一电子设备可以指示第二电子设备采集第二音频。
也即是说，用户可以选择自己随身携带的电子设备来采集第二音频，协助第一电子设备实现动态调节音效。
结合第一方面，在一些实施例中，第一电子设备可以基于第一优先级规则确定第二电子设备是与第一电子设备建立有通信连接的电子设备中优先级最高的电子设备，并指示第二电子设备采集第二音频。第一优先级规则中确定电子设备的优先级顺序的原则为：根据电子设 备的设备类型确定用户随身携带的可能性的高低，用户随身携带的可能性越高的电子设备在第一优先级规则中优先级越高。
示例性的，第一优先级规则可以为可穿戴设备的优先级高于手机的优先级。
上述第一优先级规则可以是预设的。
结合第一方面，在一些实施例中，第二音频可包括第一音频部分和背景噪声部分。上述第二音效由第一音频部分和背景噪声部分确定。其中，背景噪声部分所指示的背景噪声越大，第四音效中的响度比第一音效中的响度越高。
也即是说，当用户所处位置的背景噪声越大，第一电子设备可以将响度调高，以免背景噪声将第一电子设备播放的第一音频的声音淹没。
结合第一方面，在一些实施例中，在上述背景噪声部分包含人声的情况下，第一音效中的响度可以与第一音效中的响度相同，或者，第四音效中的响度比第一音效中的响度低。
也即是说，在上述背景噪声部分包含人声时，用户与他人聊天或正在打电话的可能性较高。第一电子设备保持播放第一音频的响度不变或者降低响度可以降低第一音频播放对用户聊天或打电话的影响，以免第一音频的声音干扰用户说话的声音。
第二方面，本申请还提供一种音效调节方法。该方法包括：第一电子设备可以以第一音效播放第一音频，并与第二电子设备建立通信连接。第一电子设备可以接收来自第二电子设备的第二音频。该第二音频是第二电子设备在第一音频被播放时采集的。第一电子设备可以根据第二音频确定出第二音效。该第二音效为第一音频以第一音效被播放时第二电子设备的收听音效。第一电子设备可以在第二音效与第三音效的差距超过第一差距的情况下，将第一音频的播放音效确定为第四音效。第一音频以第四音效被播放时第二电子设备的收听音效与第三音效的差距小于第一差距。第三音效为第一音频以第一音效被播放时的最佳音效。
由上述方法可知，播放第一音频的第一电子设备可以借助用户携带的第二电子设备来采集用户所在位置处的环境声音。基于第一音频与用户所在位置处的环境音频的评估结果，第一电子设备可以确定第一音频在用户所在位置处的收听音效。第一电子设备可以调节第一音频的播放音效，使得第一音频在用户所在位置处的收听音效达到最佳收听位置、安静环境下的音效。也即是说，在第一电子设备播放音频的过程中，用户收听到的音效(即收听音效)可以不受用户与第一电子设备的距离变化、角度变化、环境噪声变化等因素的影响。第一电子设备可以根据用户所处位置环境的变化动态调节第一音频的播放音效，提高用户收听音频的体验。
结合第二方面，在一些实施例中，第一电子设备可以提供用于选择采集第二音频的电子设备选项。这些电子设备选项包含与第二电子设备对应的选项。第一电子设备接收到选择与第二电子设备对应的选项的用户操作。第一电子设备可以指示第二电子设备采集第二音频。
也即是说，用户可以选择自己随身携带的电子设备来采集第二音频，协助第一电子设备实现动态调节音效。
结合第二方面，在一些实施例中，第一电子设备可以基于第一优先级规则确定第二电子设备是与第一电子设备建立有通信连接的电子设备中优先级最高的电子设备，并指示第二电子设备采集第二音频。第一优先级规则中确定电子设备的优先级顺序的原则为：根据电子设备的设备类型确定用户随身携带的可能性的高低，用户随身携带的可能性越高的电子设备在第一优先级规则中优先级越高。
示例性的，第一优先级规则可以为可穿戴设备的优先级高于手机的优先级。
结合第二方面，在一些实施例中，上述第二音频包括第一音频部分和背景噪声部分。第 二音效可由第一音频部分和背景噪声部分确定。其中，背景噪声部分所指示的背景噪声越大，第四音效中的响度比第一音效中的响度越高。
也即是说，当用户所处位置的背景噪声越大，第一电子设备可以将响度调高，以免背景噪声将第一电子设备播放的第一音频的声音淹没。
结合第二方面，在一些实施例中，在上述背景噪声部分包含人声的情况下，第四音效中的响度可以与第一音效中的响度相同，或者第四音效中的响度可以比第一音效中的响度低。
也即是说，在上述背景噪声部分包含人声时，用户与他人聊天或正在打电话的可能性较高。第一电子设备保持播放第一音频的响度不变或者降低响度可以降低第一音频播放对用户聊天或打电话的影响，以免第一音频的声音干扰用户说话的声音。
结合第二方面，在一些实施例中，上述第一音频从以第一音效被播放调节至以第四音效被播放可以用个音效参数的调节实现。上述音频参数可以包括以下一项或多项：响度、均衡器中的参数、动态范围控制器中的参数。
第三方面，本申请提供一种电子设备。该电子设备为第一电子设备。第一电子设备可包括音频输出装置、通信装置、存储器和处理器。其中，音频输出装置可用于以第一音效播放第一音频。通信装置可用于与第二电子设备建立通信连接，并接收来自第二电子设备的第二音频。第二音频可以是第二电子设备在第一音频被播放时采集的。存储器用于存储计算机程序。处理器可用于调用计算机程序，使得第一电子设备执行上述第二方面中任一种可能的实现方式。
第四方面，本申请提供一种计算机存储介质，包括指令，当上述指令在电子设备上运行时，使得上述电子设备执行上述第一方面中任一种可能的实现方式，或者使得上述电子设备执行上述第二方面中任一种可能的实现方式。
第五方面，本申请实施例提供一种芯片，该芯片应用于电子设备，该芯片包括一个或多个处理器，该处理器用于调用计算机指令以使得该电子设备执行上述第一方面中任一种可能的实现方式，或者使得上述电子设备执行上述第二方面中任一种可能的实现方式。
第六方面，本申请实施例提供一种包含指令的计算机程序产品，当上述计算机程序产品在设备上运行时，使得上述电子设备执行上述第一方面中任一种可能的实现方式，或者使得上述电子设备执行上述第二方面中任一种可能的实现方式。
可以理解地，上述第三方面提供的电子设备、第四方面提供的计算机存储介质、第五方面提供的芯片、第六方面提供的计算机程序产品均用于执行本申请实施例所提供的方法。因此，其所能达到的有益效果可参考对应方法中的有益效果，此处不再赘述。
附图说明
图1是本申请实施例提供的一种音效调节的场景示意图；
图2是本申请实施例提供的一种第一电子设备100的结构示意图；
图3A～图3D是本申请实施例提供的一些第一电子设备100与其它电子设备建立通信连接的用户界面示意图；
图4A～图4D是本申请实施例提供一些音效调节过程中确定采集环境声音的电子设备的用户界面示意图；
图5A和图5B是本申请实施例提供另一些音效调节过程中确定采集环境声音的电子设备的用户界面示意图；
图6是本申请实施例提供的一种音效调节方法流程图；
图7是本申请实施例提供的另一种音效调节方法流程图；
图8是本申请实施例提供的另一种音效调节方法流程图。
具体实施方式
下面将结合附图对本申请实施例中的技术方案进行清楚、详尽地描述。其中，在本申请实施例的描述中，除非另有说明，“/”表示或的意思，例如，A/B可以表示A或B；文本中的“和/或”仅仅是一种描述关联对象的关联关系，表示可以存在三种关系，例如，A和/或B，可以表示：单独存在A，同时存在A和B，单独存在B这三种情况，另外，在本申请实施例的描述中，“多个”是指两个或多于两个。
以下，术语“第一”、“第二”仅用于描述目的，而不能理解为暗示或暗示相对重要性或者隐含指明所指示的技术特征的数量。由此，限定有“第一”、“第二”的特征可以明示或者隐含地包括一个或者更多个该特征，在本申请实施例的描述中，除非另有说明，“多个”的含义是两个或两个以上。
本申请提供一种音效调节方法。如图1所示，在该方法中，播放第一音频的第一电子设备100(如电视)可以与附近的电子设备建立通信连接，例如，蓝牙连接、无线保真(wireless fidelity，Wi-Fi)连接。其中，第一电子设备100与第二电子设备200建立通信连接。该第二电子设备200是用户携带的设备(如手表)。第二电子设备200中配置有麦克风。第一电子设备100在播放第一音频的过程中，可以指示第二电子设备200开启麦克风采集环境声音。该环境声音即为用户所在位置的环境声音。该环境声音中可包含第一电子设备100播放第一音频的声音以及用户所在位置的环境噪声。第一电子设备100还可与第三电子设备300(如手机)建立通信连接。该第三电子设备300具有音效评估模块。第三电子设备300可以获取第一电子设备100播放的第一音频以及第二电子设备200采集环境声音得到的环境音频。根据上述第一音频以及上述环境音频，第三电子设备300中的音效评估模块可以评估第一音频在用户所在位置处的收听音效是否达到最佳音效。上述最佳音效可以是第一电子设备100播放的音频在最佳收听位置、安静环境下的音效。上述最佳收听位置可以为收听第一电子设备播放的音频时听感最好的位置。上述安静环境可以为环境噪声的响度低于预设响度的环境。进一步的，第一电子设备100可以根据上述音效评估模块的评估结果对第一音频的播放音效进行调节，使得第一音频在用户所在位置处的收听音效达到上述最佳音效。
上述第一音频可以是音乐的音频、视频的音频、语音通话中的音频、视频通话中的音频等等。本申请实施例对上述第一音频的来源不作具体限定。
上述第一电子设备100可以具有音效评估模块。即上述第三电子设备300和上述第一电子设备100可以是同一个电子设备。第一电子设备100在指示第二电子设备200采集环境声音后，可以接收到来自第二电子设备200的环境音频。第一电子设备100可以根据自己的音效评估模块得到的评估结果对第一音频的播放音效进行调节。
上述第二电子设备200也可以具有音效评估模块。即上述第三电子设备300和上述第二电子设备200可以是同一个电子设备。第一电子设备100在指示第二电子设备200采集环境声音后，可以将播放的第一音频发送给第二电子设备200。第二电子设备200可以将自己的音效评估模块得到的评估结果发送给第一电子设备100。进而，第一电子设备100可以根据 上述评估结果对第一音频的播放音效进行调节。
由上述方法可知，播放第一音频的第一电子设备可以借助用户携带的第二电子设备来采集用户所在位置处的环境声音。基于第一音频与用户所在位置处的环境音频的评估结果，第一电子设备可以确定第一音频在用户所在位置处的收听音效。第一电子设备可以调节第一音频的播放音效，使得第一音频在用户所在位置处的收听音效达到最佳收听位置、安静环境下的音效。也即是说，在第一电子设备播放音频的过程中，用户收听到的音效(即收听音效)可以不受用户与第一电子设备的距离变化、角度变化、环境噪声变化等因素的影响。第一电子设备可以根据用户所处位置环境的变化动态调节第一音频的播放音效，提高用户收听音频的体验。
为了便于理解本申请实施例中的音效调节方法，这里对本申请实施例中与音效相关的概念进行介绍。
1、播放音效
音效可以指声音的效果。播放音效可以指音频在经电子设备中的音频输出装置输出时声音的效果。电子设备可以通过改变响度(即音量)、调节音频信号的均衡器(equalizer，EQ)以及动态范围控制器(dynamic range control，DRC)中的参数等音频参数来调节播放音效。
其中，上述EQ中的参数可以包括滤波器类型(如低通滤波器、高通滤波器等)、中心频率(center frequency)、增益(gain)、品质因数(quality factor)等。上述DRC中的参数可以包括频带范围、信号阈值、压缩率、信号增益等。
本申请实施例所提及的音效调节方法中调节的音效可以指播放音效。
本申请实施例对电子设备调节播放音效时调节的音频参数不作限定，用于改变播放音效的音频参数还可以为其它。
2、收听音效
收听音效可以指用户的人耳所收听到的电子设备播放音频的声音的效果。收听音效主要由上述播放音效决定。收听音效还会受到用户与电子设备之间的距离、角度以及环境噪声等因素的影响。
可以理解的，上述播放音效可以是用户与音频播放设备之间的距离趋近于零时所收听到的收听音效。
电子设备可以通过调节上述播放音效使得用户的收听音效始终达到最佳音效或与最佳音效接近。这样可以减少用户与电子设备之间的距离、角度以及环境噪声等因素对用户的收听音效的影响，提高用户收听音频的听感体验。
3、最佳音效
最佳音效可以指电子设备播放的音频在最佳收听位置、安静环境下声音的效果。可以理解的，最佳音效可以是用户收听电子设备播放的音频听感体验最好的收听音效。
在一种可能的实现方式中，电子设备中可存储有最佳音效映射表。该最佳音效映射表中可包含不同的音频在以不同的播放音效被播放与上述音频参数在最佳音效下的取值的对应关系。例如，电子设备在音频参数为第一参数(如响度为10分贝、EQ的参数和DRC的参数为预设参数)的情况下播放第一音频。电子设备可以通过上述最佳音效映射表确定第一音频在最佳音效下的音频参数为第二参数。其中，上述音频参数在最佳音效下的取值可以是在电子设备出厂时预置的。这些取值的具体取值可以根据现有技术中调节音频参数的专业知识确定，本申请实施例对此不作限定。
上述最佳音效映射表也可以存储在云端服务器中，电子设备可以从云端服务器获取最佳音效映射表。
在另一种可能的实现方式中，电子设备可以利用最佳音效计算算法来确定上述音频参数在最佳音效下的取值。其中，上述最佳音效计算算法可用于指示不同的音频在以不同的音效被播放与上述音频参数在最佳音效下的取值的对应关系。上述最佳音效计算算法可以根据现有技术中调节音频参数的专业指示确定，本申请实施例对此不作限定。
在本申请实施例中，上述第一电子设备100为具有音频播放能力的电子设备。第一电子设备100可以是电视、音箱、手机、平板电脑、笔记本电脑、超级移动个人计算机(ultra-mobile personal computer，UMPC)、手持计算机、上网本、个人数字助理(personal digital assistant，PDA)、便携式多媒体播放器(portable multimedia player，PMP)、专用媒体播放器等。
上述第二电子设备200为用户可携带、且具有声音采集能力的电子设备。第二电子设备200可以是手表、耳机、手机、PMP等。其中，第二电子设备200与第一电子设备100不为同一个电子设备。
上述第三电子设备300为具有音效评估模块的电子设备。第三电子设备300可以是电视、音箱、手机、手表、平板电脑、笔记本电脑、UMPC、手持计算机、上网本、PDA、PMP、专用媒体播放器等。其中，第三电子设备300可以与第一电子设备100为同一个电子设备。或者，第三电子设备300可以与第二电子设备200为同一个电子设备。
不限于上述列举的各类型的电子设备，第一电子设备100、第二电子设备200、第三电子设备300还可以为其它类型的电子设备。
图2示例性示出了一种第一电子设备100的结构示意图。
第一电子设备100可以包括处理器110，外部存储器接口120，内部存储器121，通用串行总线(universal serial bus，USB)接口130，充电管理模块140，电源管理模块141，电池142，天线1，天线2，移动通信模块150，无线通信模块160，音频模块170，扬声器170A，受话器170B，麦克风170C，耳机接口170D，传感器模块180，按键190，马达191，指示器192，摄像头193，显示屏194，以及用户标识模块(subscriber identification module，SIM)卡接口195等。其中传感器模块180可以包括压力传感器180A，陀螺仪传感器180B，气压传感器180C，磁传感器180D，加速度传感器180E，距离传感器180F，接近光传感器180G，指纹传感器180H，温度传感器180J，触摸传感器180K，环境光传感器180L，骨传导传感器180M等。
可以理解的是，本发明实施例示意的结构并不构成对第一电子设备100的具体限定。在本申请另一些实施例中，第一电子设备100可以包括比图示更多或更少的部件，或者组合某些部件，或者拆分某些部件，或者不同的部件布置。图示的部件可以以硬件，软件或软件和硬件的组合实现。
处理器110可以包括一个或多个处理单元，例如：处理器110可以包括应用处理器(application processor，AP)，调制解调处理器，图形处理器(graphics processing unit，GPU)，图像信号处理器(image signal processor，ISP)，控制器，存储器，视频编解码器，数字信号处理器(digital signal processor，DSP)，基带处理器，和/或神经网络处理器(neural-network processing unit，NPU)等。其中，不同的处理单元可以是独立的器件，也可以集成在一个或多个处理器中。
在本申请的一些实施例中，处理器110可包括音效评估模块和音效调节模块。该音效评估模块和音效调节模块可以集成在不同处理器芯片中，由不同的芯片执行。例如，音效评估模块可以集成在NPU或其他芯片中。音效调节模块可以集成在DSP芯片中。这样，可以在音效评估模块根据第一电子设备100播放的第一音频和获取到其它电子设备采集得到的环境音频得到音效评估结果后，再唤醒音效调节模块所在的芯片根据上述音效评估结果调节第一音频的播放音效，节省功耗。可选的，该音效评估模块和音效调节模块可以集成在相同的处理器芯片中，由同一芯片执行相关功能。例如，该音效评估模块和音效调节模块均可集成中DSP芯片中。
该音效评估模块可以对上述环境音频进行声源分离。具体的，音效评估模块可以将上述环境音频分为两部分音频：播放音频部分和背景噪声部分。上述播放音频部分可以为采集环境声音的电子设备采集第一电子设备100播放第一音频的声音对应的音频。进一步的，音效评估模块可以评估第一音频在最佳音效下的音频信号与上述播放音频部分的音频信号，得到音效评估结果。该音效评估结果可用于指示用户的收听音效与最佳音效之间的差距。音效评估模块可以将上述音效评估结果发送给音效调节模块。
该音效调节模块可以获取第一电子设备100播放的第一音频在最佳音效下上述各项音频参数的取值范围。根据来自音效评估模块的音效评估结果，音效调节模块可以调节播放第一音频的播放音效。即音效调节模块可以调节响度、EQ中的参数、DRC中的参数等音频参数，使得上述播放音频部分中音频信号的各项音频参数的取值达到上述第一音频在最佳音效下各项音频参数的取值范围。
在一种可能的实现方式中，音效调节模块还可以获取上述背景噪声部分的音频信号。其中，背景噪声部分的音频信号的幅值越高(即背景噪声越大)，音效调节模块调节第一音频在播放过程中响度的调节量可以越大。
进一步的，音效调节模块可以将调节好的音频信号交由扬声器170A。扬声器170A可以输出声音。
处理器110中还可以设置存储器，用于存储指令和数据。在一些实施例中，处理器110中的存储器为高速缓冲存储器。该存储器可以保存处理器110刚用过或循环使用的指令或数据。如果处理器110需要再次使用该指令或数据，可从所述存储器中直接调用。避免了重复存取，减少了处理器110的等待时间，因而提高了系统的效率。
在一些实施例中，处理器110可以包括一个或多个接口。接口可以包括集成电路(inter-integrated circuit，I2C)接口，集成电路内置音频(inter-integrated circuit sound，I2S)接口，脉冲编码调制(pulse code modulation，PCM)接口，通用异步收发传输器(universal asynchronous receiver/transmitter，UART)接口，移动产业处理器接口(mobile industry processor interface，MIPI)，通用输入输出(general-purpose input/output，GPIO)接口，用户标识模块(subscriber identity module，SIM)接口，和/或通用串行总线(universal serial bus，USB)接口等。
I2C接口是一种双向同步串行总线，包括一根串行数据线(serial data line，SDA)和一根串行时钟线(derail clock line，SCL)。
I2S接口可以用于音频通信。在一些实施例中，处理器110可以包含多组I2S总线。处理器110可以通过I2S总线与音频模块170耦合，实现处理器110与音频模块170之间的通信。
PCM接口也可以用于音频通信，将模拟信号抽样，量化和编码。在一些实施例中，音频模块170与无线通信模块160可以通过PCM总线接口耦合。
UART接口是一种通用串行数据总线，用于异步通信。该总线可以为双向通信总线。它将要传输的数据在串行通信与并行通信之间转换。在一些实施例中，UART接口通常被用于连接处理器110与无线通信模块160。例如：处理器110通过UART接口与无线通信模块160中的蓝牙模块通信，实现蓝牙功能。
可以理解的是，本发明实施例示意的各模块间的接口连接关系，只是示意性说明，并不构成对第一电子设备100的结构限定。在本申请另一些实施例中，第一电子设备100也可以采用上述实施例中不同的接口连接方式，或多种接口连接方式的组合。
充电管理模块140用于从充电器接收充电输入。
电源管理模块141用于连接电池142，充电管理模块140与处理器110。电源管理模块141接收电池142和/或充电管理模块140的输入，为处理器110，内部存储器121，外部存储器，显示屏194，摄像头193，和无线通信模块160等供电。
第一电子设备100的无线通信功能可以通过天线1，天线2，移动通信模块150，无线通信模块160，调制解调处理器以及基带处理器等实现。天线1和天线2用于发射和接收电磁波信号。第一电子设备100中的每个天线可用于覆盖单个或多个通信频带。不同的天线还可以复用，以提高天线的利用率。
移动通信模块150可以提供应用在第一电子设备100上的包括2G/3G/4G/5G等无线通信的解决方案。在一些实施例中，移动通信模块150的至少部分功能模块可以与处理器110的至少部分模块被设置在同一个器件中。
无线通信模块160可以提供应用在第一电子设备100上的包括无线局域网(wireless local area networks，WLAN)(如Wi-Fi网络)，蓝牙，全球导航卫星系统(global navigation satellite system，GNSS)，调频(frequency modulation，FM)，近距离无线通信技术(near field communication，NFC)，红外技术(infrared，IR)等无线通信的解决方案。
在本申请的一些实施例中，当检测到播放音频的指令，处理器110可以指示无线通信模块160启动上述一种或多种无线通信，使得第一电子设备100与附近的电子设备建立通信连接。例如，处理器110可以指示无线通信模块160启动蓝牙通信，使得第一电子设备100与附近的蓝牙设备建立蓝牙连接。或者，处理器110可以指示无线通信模块160启动Wi-Fi网络通信，使得第一电子设备100与接入同一家庭Wi-Fi的电子设备建立通信连接。
第一电子设备100通过GPU，显示屏194，以及应用处理器等实现显示功能。GPU为图像处理的微处理器，连接显示屏194和应用处理器。GPU用于执行数学和几何计算，用于图形渲染。处理器110可包括一个或多个GPU，其执行程序指令以生成或改变显示信息。
显示屏194用于显示图像，视频等。在一些实施例中，第一电子设备100可以包括1个或N个显示屏194，N为大于1的正整数。
第一电子设备100可以通过ISP，摄像头193，视频编解码器，GPU，显示屏194以及应用处理器等实现拍摄功能。
ISP用于处理摄像头193反馈的数据。例如，拍照时，打开快门，光线通过镜头被传递到摄像头感光元件上，光信号转换为电信号，摄像头感光元件将所述电信号传递给ISP处理，转化为肉眼可见的图像。
摄像头193用于捕获静态图像或视频。在一些实施例中，第一电子设备100可以包括1个或N个摄像头193，N为大于1的正整数。
数字信号处理器用于处理数字信号，除了可以处理数字图像信号，还可以处理数字音频信号等其他数字信号。例如，当第一电子设备100在频点选择时，数字信号处理器用于对频 点能量进行傅里叶变换等。
NPU为神经网络(neural-network，NN)计算处理器，通过借鉴生物神经网络结构，例如借鉴人脑神经元之间传递模式，对输入信息快速处理，还可以不断的自学习。通过NPU可以实现第一电子设备100的智能认知等应用，例如：声源分离、图像识别，人脸识别，语音识别，文本理解等。
外部存储器接口120可以用于连接外部存储卡，例如Micro SD卡，实现扩展第一电子设备100的存储能力。
内部存储器121可以用于存储计算机可执行程序代码，所述可执行程序代码包括指令。处理器110通过运行存储在内部存储器121的指令，从而执行第一电子设备100的各种功能应用以及数据处理。
第一电子设备100可以通过音频模块170，扬声器170A，受话器170B，麦克风170C，耳机接口170D，以及应用处理器等实现音频功能。例如音乐播放，录音等。
音频模块170用于将数字音频信息转换成模拟音频信号输出，也用于将模拟音频输入转换为数字音频信号。音频模块170还可以用于对音频信号编码和解码。在一些实施例中，音频模块170可以设置于处理器110中，或将音频模块170的部分功能模块设置于处理器110中。
扬声器170A，也称“喇叭”，用于将音频电信号转换为声音信号。第一电子设备100可以通过扬声器170A收听音乐，或收听免提通话。
受话器170B，也称“听筒”，用于将音频电信号转换成声音信号。当第一电子设备100接听电话或语音信息时，可以通过将受话器170B靠近人耳接听语音。
麦克风170C，也称“话筒”，“传声器”，用于将声音信号转换为电信号。第一电子设备100可以设置至少一个麦克风170C。在另一些实施例中，第一电子设备100可以设置两个麦克风170C，除了采集声音信号，还可以实现降噪功能。在另一些实施例中，第一电子设备100还可以设置三个，四个或更多麦克风170C，实现采集声音信号，降噪，还可以识别声音来源，实现定向录音功能等。
耳机接口170D用于连接有线耳机。
压力传感器180A用于感受压力信号，可以将压力信号转换成电信号。在一些实施例中，压力传感器180A可以设置于显示屏194。
陀螺仪传感器180B可以用于确定第一电子设备100的运动姿态。在一些实施例中，可以通过陀螺仪传感器180B确定第一电子设备100围绕三个轴(即，x，y和z轴)的角速度。
加速度传感器180E可检测第一电子设备100在各个方向上(一般为三轴)加速度的大小。当第一电子设备100静止时可检测出重力的大小及方向。
指纹传感器180H用于采集指纹。第一电子设备100可以利用采集的指纹特性实现指纹解锁，访问应用锁，指纹拍照，指纹接听来电等。
触摸传感器180K，也称“触控面板”。触摸传感器180K可以设置于显示屏194，由触摸传感器180K与显示屏194组成触摸屏，也称“触控屏”。触摸传感器180K用于检测作用于其上或附近的触摸操作。触摸传感器可以将检测到的触摸操作传递给应用处理器，以确定触摸事件类型。
骨传导传感器180M可以获取振动信号。在一些实施例中，骨传导传感器180M可以获取人体声部振动骨块的振动信号。
按键190包括开机键，音量键等。第一电子设备100可以接收按键输入，产生与第一电 子设备100的用户设置以及功能控制有关的键信号输入。
马达191可以产生振动提示。马达191可以用于来电振动提示，也可以用于触摸振动反馈。
指示器192可以是指示灯，可以用于指示充电状态，电量变化，也可以用于指示消息，未接来电，通知等。
SIM卡接口195用于连接SIM卡。第一电子设备100通过SIM卡和网络交互，实现通话以及数据通信等功能。在一些实施例中，第一电子设备100采用eSIM，即：嵌入式SIM卡。eSIM卡可以嵌在第一电子设备100中，不能和第一电子设备100分离。
不限于图2所示的组件，第一电子设备100还可以包含更多或更少的组件。图2所示的电子设备结构也可以是第二电子设备200和第三电子设备300的结构示意图。不限于图2所示的组件，第二电子设备200、第三电子设备300还可以包含更多或更少的组件。
下面具体介绍第一电子设备100与附近的电子设备建立通信连接的实现过程。其中，以第一电子设备100与附近的电子设备建立蓝牙连接为例进行介绍。
在一些实施例中，第一电子设备100可以根据接收到的用户操作与附近的电子设备建立蓝牙连接。
图3A～图3D示例性示出了第一电子设备100与第二电子设备200建立蓝牙连接的示意图。
如图3A所示，第一电子设备100可以显示蓝牙设置界面210。蓝牙设置界面210可包括标题栏211、设备名称212、蓝牙开关控件213、扫描设备控件214。其中：
标题栏211可包括文字信息“蓝牙”。标题栏211可用于提示用户第一电子设备100当前显示的用户界面为用于设置蓝牙的用户界面。
设备名称211可以是第一电子设备100的设备名称。第一电子设备100的设备名称可以为“Device100”。当第一电子设备100与其它电子设备建立蓝牙连接时，其它电子设备可以显示第一电子设备100的设备名称。
蓝牙开关控件213可用于开启或者关闭第一电子设备100的蓝牙。如图3A所示，第一电子设备100的蓝牙处于开启状态。蓝牙开关控件213上可现实有文字信息“当前可被附近蓝牙设备发现”。
扫描设备控件214可用于第一电子设备100扫描附近的蓝牙设备。上述蓝牙设备可以是蓝牙处于开启状态、以广播的方式通过蓝牙发送广播数据包的电子设备。
响应于作用在扫描设备控件214的用户操作，第一电子设备100可以进入扫描状态，接收附近的蓝牙设备发送的广播数据包。这样，第一电子设备100可以获取附近的蓝牙设备的设备地址以及设备名称等信息。
第一电子设备100可以显示如图3B所示的用户界面220。用户界面220可用于显示第一电子设备100扫描到的蓝牙设备的信息。用户界面220可包括标题栏221、第二电子设备指示控件222、第三电子设备指示控件224、第四电子设备指示控件223。其中：
标题栏221可包括文字信息“可用设备”标题栏可用于提示用户第一电子设备100当前用户界面中的各设备指示控件指示的电子设备为可以建立蓝牙连接的设备。
第二电子设备指示控件222、第三电子设备指示控件224、第四电子设备指示控件223可分别用于第一电子设备100与第二电子设备200、第三电子设备300和第四电子设备201建 立蓝牙连接。
在一些实施例中，第一电子设备100还可以获取扫描到的蓝牙设备的设备类型。示例性的，第一电子设备获取到第二电子设备200的设备类型为手表。第二电子设备指示控件222中可包含手表的图标以及第二电子设备200的设备名称“Device200”。第一电子设备获取到第三电子设备300的设备类型为手机。第三电子设备指示控件224中可包含手机的图标以及第三电子设备300的设备名称“Device300”。第一电子设备获取到第四电子设备400的设备类型为耳机。第四电子设备指示控件223中可包含耳机的图标以及第四电子设备400的设备名称“Device201”。
响应于作用在第二电子设备指示控件222的用户操作，第一电子设备100可以向第二电子设备200发送蓝牙连接请求。该蓝牙连接请求可用于请求与第二电子设备200建立蓝牙连接。
当接收到上述蓝牙连接请求，第二电子设备200可以显示如图3C所示的用户界面230。用户界面230可包括状态栏231、提示框232。其中：
状态栏231中可包括移动通信信号的信号强度指示符、蓝牙指示符、电池状态指示符。
提示框232可用于提示用户设备名称为“Device100”的第一电子设备100请求建立蓝牙连接。提示框232中可包括文字信息“蓝牙连接请求同意与Device100连接吗？”。提示框232中还可包括拒绝控件232A和同意控件232B。该拒绝控件232A可用于拒绝与第一电子设备100建立蓝牙连接。响应于作用在该拒绝控件232A的用户操作，第二电子设备200可以向第一电子设备100发送拒绝连接的消息。该同意控件232B可用于同意与第以电子设备100建立蓝牙连接。响应于作用在该同意控件232B的用户操作，第二电子设备200可以向第一电子设备100发送同意连接的消息。
当接收到来自第二电子设备200同意连接的消息，第一电子设备100与第二电子设备200成功建立蓝牙连接。如图3D所示，第一电子设备100可以在蓝牙设置界面210上显示已配对设备列表215。已配对设备列表215中可包括当前与第一电子设备100建立有蓝牙连接的设备指示符，例如第二电子设备指示符215A。第二电子设备指示符215A中可包括第二电子设备200的设备类型(如手表)的图标、设备名称“Device200”、连接状态提示(如文字提示“已连接”)。已配对设备列表215中还可以包括曾经与第一电子设备100建立有蓝牙连接，但当前未建立有蓝牙连接的设备指示符。
本申请实施例对上述图3A～图3D所示的用户界面不作限定。这些用户界面还可以包含更多或更少的内容。
由上述图3A～图3D所示的场景可知，第一电子设备100可以根据用户的指示与附近的电子设备，例如第二电子设备200、第三电子设备300、第四电子设备201，建立蓝牙连接。
在一些实施例中，第二电子设备200、第三电子设备300和第四电子设备201等电子设备中的一个或多个也可以根据接收到的用户操作，请求与第一电子设备100建立蓝牙连接。
在一些实施例中，第一电子设备100在检测到播放第一音频的用户操作时，可以主动扫描附近的蓝牙设备并建立蓝牙连接。
第一电子设备100的蓝牙处于开启状态并扫描附近的蓝牙设备。第一电子设备100扫描到的电子设备中可包括曾经与第一电子设备100建立过蓝牙连接的电子设备、从未与第一电子设备100建立过蓝牙连接的电子设备。
其中，第一电子设备100中可存储有曾经建立过蓝牙连接的电子设备的信息(如设备名 称、蓝牙地址、连接秘钥等)。第一电子设备100可以利用上述信息与曾经建立过蓝牙连接的电子设备再次建立蓝牙连接。
第一电子设备100可以向从未建立过蓝牙连接的电子设备发送蓝牙连接请求，并在该电子设备回复同意连接的请求后与该电子设备建立蓝牙连接。当接收到来自第一电子设备100的蓝牙连接请求，该电子设备可以在显示屏上显示如图3C所示的提示框232。或者该电子设备不具备显示屏，该电子设备可以通过语音提示等方式来提示用户设备名称为“Device100”的第一电子设备100请求建立蓝牙连接。
在一些实施例中，第一电子设备100还可以在与扫描到的电子设备建立蓝牙连接之前获取这些电子设备的音频采集装置(如麦克风)的信息。第一电子设备100可以根据电子设备是否具有音频采集装置对这些电子设备进行筛选。其中，第一电子设备100可以与具有音频采集装置的电子设备建立蓝牙连接。
本申请实施例对上述电子设备之间建立蓝牙连接的过程不作限定。上述蓝牙连接可以是经典蓝牙(classic bluetooth)连接或者低功耗蓝牙(bluetooth low energy，BLE)连接。具体连接的过程可以参考现有技术中蓝牙连接的实现过程。
本申请实施例对上面提及的以及后续实施例中的各用户操作均不作限定。例如，用户可以通过触摸显示屏上控件所在的位置，来指示电子设备(如第一电子设备100、第二电子设备200、第三电子设备300)执行该控件对应的指令(如扫描蓝牙设备、与其它设备建立蓝牙连接等)。用户还可以通过遥控器控制电子设备执行相应的指令。
不限于上述蓝牙连接的通信方式，在一些实施例中，第一电子设备100在检测到开始播放第一音频时，还可以主动与处于同一个局域网的电子设备建立通信连接。例如，第一电子设备100接入家庭Wi-Fi。当检测到开始播放第一音频，第一电子设备100可以主动与接入该家庭Wi-Fi的其它电子设备建立通信连接，并通过Wi-Fi网络与这些电子设备通信。其中，第一电子设备100可以通过Wi-Fi网络获取这些电子设备的设备类型以及音频采集装置的信息。
在一些实施例中，第一电子设备100可以通过多种通信方式与附近的电子设备建立通信连接。例如，第一电子设备100既可以扫描附近的蓝牙设备，与蓝牙处于开启状态的电子设备建立蓝牙连接。第一电子设备100还可以通过Wi-Fi网络和与自己处于同一个家庭Wi-Fi但未建立蓝牙连接的电子设备建立通信连接。
本申请实施例对第一电子设备100与附近的电子设备建立通信连接的方式不作限定。例如，第一电子设备100还可以在检测到开始播放音频时通过无线局域网(wireless local area network，WLAN)直连的方式与附近的电子设备建立通信连接。进而，第一电子设备100可以请求与自己建立有通信连接的电子设备协同，来获取播放的第一音频在用户所在位置处的收听音效。
下面具体介绍第一电子设备100请求建立有通信连接的电子设备开启麦克风获取环境音频的实现过程。
在一些实施例中，第一电子设备100可以基于用户选择的电子设备来确定用于采集环境声音的第二电子设备200。
图4A～图4D示例性示出了第一电子设备100确定用于采集环境声音的第二电子设备200的示意图。
如图4A所示，第一电子设备100可以接收到播放音乐A(即第一音频)的用户操作。其中，第一电子设备100可以显示如图4A所示的用户界面240。用户界面240可用于显示第一电子设备播放的内容。用户界面240可包括音乐名称241、播放进度条242、上一首控件243、播放控件244和下一首控件245。其中：
音乐名称241可以为“音乐A”。本申请实施例对音乐名称241的内容不做限定。音乐名称241可用于表示第一电子设备100可播放的内容为音乐A。
播放进度条242可用于对比音乐已播放时长和音乐总时长，指示音乐播放的进度。
上一首控件243可用于第一电子设备100播放音乐A的上一首音乐。
下一首控件245可用于第一电子设备100播放音乐A的下一首音乐。
播放控件244可用于第一电子设备100播放音乐A。上述播放音乐A的用户操作即为作用在播放控件244上的用户操作。
如图4B所示，响应于作用在播放控件244上的用户操作，第一电子设备100可以在用户界面240上显示提示框246。该提示框246可用于询问用户是否开启智能音效模式。在上述智能音效模式下，第一电子设备100可以执行本申请实施例中的音效调节方法，动态调节音乐A的播放音效。
提示框246中可包含提示语“是否开启智能音效模式？智能音效模式下，将自动调节播放内容，以实现最佳音效”。本申请实施例对上述提示语的具体内容不作限定。
提示框246还可包含取消控件246A和开启控件246B。该取消控件246A可用于拒绝开启智能音效模式。响应于作用在该取消控件246A的用户操作，第一电子设备100可以按照预设的播放音效开始播放音乐A。上述预设的播放音效可以指音频在播放过程中的音频参数为第一电子设备100在出厂时预置的。第一电子设备100按照预设的播放音效开启播放音乐可以使得用户在最佳收听位置，安静环境下的听感体验最好。或者，上述预设的播放音效也可以指音频在播放过程中的一部分音频参数(如响度)为用户设定的，另一部分音频参数为第一电子设备100在出厂时预置的。
该开启控件246B可用于开启智能音效模式。
如图4C所示，响应于作用在该开启控件246B的用户操作，第一电子设备100可以在用户界面上显示设备选项框247。该设备选项框可用于用户选择采集自己所在位置的环境声音的电子设备。
设备选项框247中可包含提示语“请选择协同设备(请选择您随身携带的设备，协同设备将开启麦克风采集附近声音，麦克风采集数据仅用于本地音效调节，不会存储也不会上传云端服务器)”。上述提示语可用于提示用户选择自己随身携带的设备作为协同设备来协助第一电子设备100动态调节音频的播放音效。其中，被选择的电子设备将会开启音频采集装置(如麦克风)来采集环境声音。本申请实施例对上述提示语的具体内容不作限定。
设备选项框247还可包含已连接设备选项247A、可用设备选项247B和确定控件247C。其中：
已连接设备选项247A中可包含当前与第一电子设备100建立有通信连接的电子设备选择控件。例如，第一电子设备100与设备名称为“Device200”的第二电子设备200、设备名称为“Device300”的第三电子设备300建立有通信连接。已连接设备选项247A中可包含第二电子设备选择控件和第三电子设备选择控件。上述电子设备选择控件可包括设备类型的图 标、设备名称以及勾选框。该勾选框为空可以表示该勾选框对应的电子设备处于未选中状态。该勾选框中包含“√”可以表示该勾选框对应的电子设备处于选中状态。
当已连接设备选项247A中一个或多个电子设备选择控件对应的电子设备处于选中状态，且第一电子设备100检测到作用在确定控件247C的用户操作，第一电子设备100可以向上述一个或多个电子设备发送用于开启音频采集装置，采集环境声音的指令。
可用设备选项247B中可包含第一电子设备100发现可以建立通信连接但当前还未建立通信连接的电子设备选择控件。例如，第一电子设备100在扫描附近的蓝牙设备时，发现了设备名称为“Device201”的第四电子设备201(如耳机)、设备名称为“Device301”的第五电子设备301(如手机)。第一电子设备100与第四电子设备201、第五电子设备301从未建立过蓝牙连接。可用设备选项247B中可包含第四电子设备选择控件和第五电子设备选择控件。
当已连接设备选项247B中一个或多个电子设备选择控件对应的电子设备处于选中状态，且第一电子设备100检测到作用在确定控件247C的用户操作，第一电子设备100可以先与这一个或多个电子设备建立通信连接。例如，第一电子设备100可以向这一个或多个电子设备发送蓝牙连接请求，并在收到这一个或多个电子设备回复的同意连接消息后与这一个或多个电子设备建立蓝牙连接。这一个或多个电子设备在收到来自第一电子设备100的蓝牙连接请求后，可以显示如图3C所示的提示框232或者通过语音提示等方式来提示用户第一电子设备100请求建立蓝牙连接。
当第一电子设备100与这一个或多个电子设备建立了通信连接，第一电子100可以向这一个或多个电子设备发送用于开启音频采集装置，采集环境声音的指令。
也即是说，用户可以选择已连接设备选项247A和可用设备选项247B中的一个或多个电子设备选择控件对应的电子设备作为协同设备。
示例性的，第一电子设备100在接收到作用在确定控件247C上的用户操作时，确定第二电子设备选择控件对应的第二电子设备200处于选中状态。第一电子设备100可以向第二电子设备200发送用于开启音频采集装置，采集环境声音的指令。第二电子设备200接收到上述指令后可以开启音频采集装置，采集第二电子设备200所在位置处的环境声音，得到环境音频。
另外，第一电子设备100可以开始播放音频(如名称为“音乐A”的音乐)，并显示如图4D所示的用户界面240。在图4D中，用户界面240可包含上一首控件243、下一首控件245和暂停播放控件248。上述暂停播放控件248可用于第一电子设备100暂停播放音乐A。
本申请实施例对上述图4A～图4D所示用户界面所包含的内容不作限定。上述用户界面还可以包含更多或更少的内容。其中，第一电子设备100播放音频的场景不限于是上述播放音频的场景，还可以是播放视频、语音通话、视频通话等音频输出装置(如扬声器)输出音频的场景。
第一电子设备100可以根据在第一时间段内第一电子设备100播放的第一音频和第二电子设备200采集的环境音频得到的音效评估结果调节第一音频的播放音效，使得用户的收听音效不受用户位置变化以及用户所在环境的噪声变化等因素的影响。
其中，音效评估的方法以及第一电子设备100根据音效评估结果调节第一音频的播放音效的方法将在后续实施例中具体介绍，这里先不展开。
在一些实施例中，在检测到开始播放音频时，第一电子设备100可以确定智能音效模式 处于开启状态。则第一电子设备100可以显示如图4C所示的用户界面240，来指示用户选择协同设备采集自己所在位置处的环境声音。也即是说，第一电子设备100可以不再显示如图3B所示的用户界面，询问用户是否开启智能音效模式。
在一些实施例中，第一电子设备100可以根据设备类型确定与自己建立有通信连接的电子设备中用户随身携带可能性最高的电子设备，并指示该电子设备采集环境声音。
第一电子设备100中可存储有第一优先级规则。在各类型的电子设备中，可穿戴设备(如手表)为用户随身携带的可能性是最高的。其次，用户随身携带的电子设备还可以是手机。该第一优先级规则可以为可穿戴设备的优先级高于手机的优先级。也即是说，当与第一电子设备100建立通信连接的电子设备中包括手表和手机时，第一电子设备100可以优先向手表发送开启音频采集装置、采集环境声音的指令。
本申请实施例对上述第一优先级规则的具体内容不作限定。上述第一优先级规则可以是第一电子设备100在出厂时预置在存储器中的。或者，上述第一优先级规则可以是由用户设定的。
图5A和图5B示例性示出了第一电子设备100指示第二电子设备200开启音频采集装置的示意图。
如图5A所示，第一电子设备100可以接收到播放音乐A的用户操作。其中，第一电子设备100可以显示如图5A所示的用户界面240。该用户界面240包含的内容可以参考前述图4A所示用户界面240的介绍，这里不再赘述。
当接收到上述播放音乐A的用户操作，第一电子设备100可以开始播放音乐A。并且，第一电子设备100可以根据上述第一优先级规则来判断当前与自己建立有通信连接的电子设备中，优先级最高的电子设备。其中，第一电子设备100可以确定出第二电子设备200(即手表)的优先级最高。第一电子设备100可以向第二电子设备200发送开启音频采集装置的指令。
当接收到上述开启音频采集装置的指令，第二电子设备200可以显示如图5B所示的用户界面250。用户界面250可包括提示框251。该提示框251可用于询问用户是否开启第二电子设备200的麦克风。
提示框251可包括文字提示“Device100智能调节音效请求协同，是否开启麦克风？”，来提示用户设备名称为“Device100”的第一电子设备100在智能调节音效的过程中需要第二电子设备200开启音频采集装置，采集环境声音。本申请实施例对上述文字提示的具体内容不作限定。
提示框251还可以包括拒绝控件251A和同意控件251B。该拒绝控件251A可用于拒绝第一电子设备100开启麦克风的请求。响应于作用在该拒绝控件251A的用户操作，第二电子设备200可以向第一电子设备100发送拒绝开启麦克风的消息。该同意控件251B可用于同意第一电子设备100开启麦克风的请求。响应于作用在该同意控件251B的用户操作，第二电子设备200可以开启麦克风，并向第一电子设备100发送指示麦克风已开启的消息。
在一些实施例中，当接收到来自第二电子设备200指示麦克风已开启的消息，第一电子设备100可以获取第二电子设备200在第一时间段内采集的环境音频，并评估自己在第一时间段内播放的第一音频在第二电子设备200所在位置处的收听音效是否达到最佳音效。进一步的，第一电子设备100可以根据音效评估结果调节第一时间段下一时间段内第一音频的播放音效，使得播放的第一音频在第二电子设备200所在位置处的收听音效达到最佳音效。
在一些实施例中，当接收到来自第二电子设备200拒绝开启麦克风的消息，第一电子设备100可以根据上述第一优先级规则确定与自己建立有通信连接的电子设备中优先级次于第二电子设备200的电子设备，例如第三电子设备300。第一电子设备100可以向第三电子设备300发送开启音频采集装置的指令。可选的，若第一电子设备100在向第二电子设备200发送开启音频采集装置的指令后的预设时间段内，未接收到第二电子设备200的回复消息，第一电子设备100也可以根据上述第一优先级规则确定与自己建立有通信连接的电子设备中优先级次于第二电子设备200的电子设备，例如第三电子设备300。第一电子设备100可以向第三电子设备300发送开启音频采集装置的指令。
在一些实施例中，第一电子设备100可以在与自己建立有通信连接的电子设备中，向所有具有音频采集装置的电子设备发送开启音频采集装置的指令。当接收到上述开启音频采集装置的指令，这些电子设备可以显示如图5B所示的提示框250或者通过语音提示等方式来提示用户第一电子设备100请求开启对应电子设备的音频采集装置。这些电子设备中的一个或多个在接收到同意开启音频采集装置的用户操作后，可以开启音频采集装置并向第一电子设备100发送指示音频采集装置已开启的消息。根据这一个或多个电子设备采集的环境音频以及第一电子设备100播放的第一音频得到的音效评估结果，第一电子设备100可以调节自己播放第一音频的播放音效。
也即是说，用户可以在多个接收到上述开启音频采集装置的指令的电子设备(如手表、手机等)中选择一个或者多个电子设备开启音频采集装置，来协助第一电子设备100智能调节音效。
其中，被选择的多个电子设备可以是多个用户随身携带的电子设备。例如，第一用户的手表和第二用户的手表均开启麦克风采集自己所在位置的环境声音。根据这两个电子设备采集得到的环境音频以及第一电子设备100播放的第一音频的音效评估结果，第一电子设备100可以调节自己播放第一音频的播放音效，使得第一音频在第一用户所在位置处的收听音效和在第二用户所在位置处的收听音效均与最佳音效接近。即第一用户和第二用户在收听第一电子设备100播放的音频时均能有较好的听感。
下面介绍音效评估模块基于第一音频和环境音频得到音效评估结果的实现方法。
在第一电子设备100播放第一音频的过程中，第二电子设备200可以采集到的环境声音主要包括第一音频播放的声音以及第二电子设备200附近的背景噪声。则第二电子设备200采集得到的环境音频主要包括播放音频部分和背景噪声部分。上述播放音频部分的音频信号来自于上述第一音频播放的声音。上述背景噪声部分的音频信号来自于第二电子设备200附近的背景噪声。
音效评估模块可以对上述环境音频进行声源分离，将环境音频分为播放音频部分和背景噪声部分这两部分音频。
在一种可能的实现方式中，音效评估模块可以利用谱减法分离出环境音频中的背景噪声部分。具体的，环境音频是播放音频部分的音频信号与背景噪声部分的音频信号的叠加。即背景噪声是加性噪声。在假定播放音频部分与背景噪声部分不相关，且背景噪声是平稳或者缓慢变化的情况下，音效评估模块可以估计上述背景噪声部分的频谱。进一步的，音频评估模块可以用环境音频的频谱减去背景噪声部分的频谱，得到播放音频部分的频谱。这样，音效评估模块可以实现环境音频的声源分离。
上述谱减法的实现方法简单、运算量小。音效评估模块利用谱减法可以实现快速分离环境音频中的播放音频部分和背景噪声部分，且得到的播放音频部分的音频信号具有较高的信噪比。
在一种可能的实现方式中，音效评估模块可以利用训练好的神经网络分离出环境音频中的背景噪声部分。具体的，神经网络可以是利用大量的训练样本训练好的。其中，一个训练样本可以由上述环境音频以及该环境音频的播放音频部分组成。训练好的神经网络可以接收环境音频，并输出该环境音频中的播放音频部分。这样，音效评估模块可以实现环境音频的声源分离。
神经网络训练的具体过程可以参考现有技术中训练神经网络的实现过程，本申请实施例对此不进行赘述。上述神经网络可以例如是卷积神经网络、深度神经网络。本申请实施例对上述神经网络的类型不作限定。
上述利用训练好的神经网络进行声源分离的实现方法需要经过大量运算以得到训练好的神经网络。训练好的神经网络可以较好地实现分离环境音频中的播放音频部分和背景噪声部分。
在一种可能的实现方式中，音效评估模块可以利用盲源分离法分离出环境音频中的背景噪声部分。具体的，上述第二电子设备200可以利用两个及以上的麦克风来采集环境声音，得到环境音频。由于不同来源的声音(如第一音频的声音、背景噪声中各声源的声音等)是不同的物理过程产生的，不同来源的声音之间是相互独立的。多个麦克风在采集环境声音时，同一个声源的声音被这多个麦克风采集得到的音频存在差异。根据多个麦克风采集得到的环境音频，音效评估模块可以确定环境声音中不同声音来源的方向(如第一音频的声音的方向、背景噪声中各声源的方向等)。进一步的，音效评估模块可以通过独立成分分析确定出环境音频中不同来源的声音对应的音频信号。这样，音效评估模块可以实现环境音频的声源分离。
上述利用盲源分离法的实现方法需要采集环境声音的电子设备具有至少两个麦克风。盲源分离法可以较好地实现分离环境音频中的播放音频部分和背景噪声部分。
音效评估模块可以采用上述一种或多种实现方式对环境音频进行声源分离。不限于上述声源分离的方法，音效评估模块还可以采集其它声源分离的方法从环境音频中分离出上述播放音频部分和上述背景噪声部分。
进一步的，音效评估模块可以获取上述第一音频在最佳音效下的音频信号。上述第一音频可以是第一电子设备100播放的音频文件，包含有待输出的音频信号。在一种可能的实现方式中，第一音频在经过扬声器输出前，可以存储在缓存区域中。电子设备可以从该缓存区域中提取上述第一音频，并将该第一音频交由音效评估模块。本申请实施例对音效评估模块获取第一音频的方式不作限定。当得到上述第一音频，音效评估模块可以根据最佳音效下各项音频参数的取值范围确定第一音频在最佳音效下的音频信号。
通过比较上述第一音频在最佳音效下的音频信号与播放音频部分的音频信号的差距，音效评估模块可以得到音效评估结果。该音效评估结果可用于指示用户的收听音效与最佳音效之间的差距。其中，上述收听音效与最佳音效之间的差距具体可以指以收听音效播放第一音频时对应的音频参数与以最佳音效播放第一音频时对应的音频参数之间的差距。例如，以收听音效播放第一音频时，响度为50分贝。以最佳音效播放第一音频时，响度为60分贝。则上述收听音效与最佳音效之间的差距可以包括音频参数中响度的差距，即10分贝的差距。不限于上述响度。上述收听音效与最佳音效之间的差距还可以包括音频参数中其它参数在数值上的差距。例如，EQ中中心频率的差距、增益的差距，DRC中频带范围的差距、压缩率的 差距等等。
在一些实施例中，音效评估模块可以得到多个环境音频。这多个环境音频可以分别由多个不同的电子设备采集得到(例如多个用户随身携带的电子设备)。音效评估模块可以对这个多个环境音频进行声源分离，并比较上述第一音频在最佳音效下的音频信号与这多个环境音频中播放音频部分的音频信号的差距，得到音效评估结果。也即是说，该音效评估结果可以指示多个用户的收听音效与最佳音效之间的差距。
音效评估模块可以配置在第一电子设备100、第二电子设备200、第三电子设备300等电子设备的一个或多个电子设备中。本申请实施例对此不作限定。
下面介绍音效调节模块基于音效评估结果调节第一音频的播放音效的实现方法。
第一电子设备100的处理器110中可集成有音效调节模块。该音效调节模块可以对第一电子设备100播放音频的响度进行调节。该音效调节模块中可包含有EQ组件、DRC组件等调节音频信号的组件。通过上述EQ组件、DRC组件，音效调节模块可以对第一音频应用均衡、动态范围控制等效应，以调节第一音频的播放音效。
音效调节模块可以获取上述音效评估模块的音效评估结果。若音效评估结果指示收听音效与最佳音效之间的差距小于预设的阈值，音效调节模块可以保持当前各项音频参数不变。若音效评估结果指示收听音效与最佳音效的差距大于上述预设的阈值，音效调节模块可以对各项音频参数进行调节，改变第一音频的播放音效，使得用户的收听音效与最佳音效之间的差距小于上述预设的阈值。音效调节模块可以利用调节后的各项音频参数对第一音频进行处理，并将处理得到的音频信号交由扬声器。扬声器可以播放上述经过处理得到的音频信号。
在一些实施例中，上述音效评估结果中可包含有多个电子设备所在位置处的收听音效与最佳音效之间的差距。当得到该音效评估结果，音效调节模块可以计算多个电子设备所在位置处的收听音效与最佳音效之间的差距的均值。然后，音效调节模块可以根据上述计算得到的均值对各项音频参数进行调节，改变第一音频的播放音效。这样，第一电子设备100可以使得在上述多个电子设备所在位置处的用户收听第一音频时均能有较好的听感。
由上述方法可知，第一电子设备100可以根据第二电子设备200采集的环境音频确定用户收听第一音频的收听音效。进而，第一电子设备100可以在播放第一音频的过程中动态调节音频参数，减少用户的收听音效受用户与第一电子设备100的距离变化、角度变化和背景噪声变化等因素的影响，使得用户的收听音效可以达到或者接近最佳音效。
在一些实施例中，音效调节模块还可以根据从环境音频中分离出来的背景噪声部分的音频信号调节播放第一音频的响度。例如，背景噪声部分的音频信号的幅值越高(即背景噪声越大)，音效调节模块调节第一音频在播放过程中响度的调节量可以越大。
可以理解的，当用户所处位置的背景噪声越大，第一电子设备100可以将响度调高，以免背景噪声将第一电子设备100播放的第一音频的声音淹没。
在一些实施例中，当从环境音频中分离出播放音频部分和背景噪声部分，音效评估模块还可以评估背景噪声部分是否包含人声。若确定出背景噪声部分包含人声，音效评估模块可以向音效调节模块发送指示背景噪声部分包含人声的消息。进一步的，音效调节模块可以保持播放第一音频的响度不变，或者降低播放第一音频的响度。
可以理解的，在上述背景噪声部分包含人声时，用户与他人聊天或正在打电话的可能性 较高。第一电子设备100保持播放第一音频的响度不变或者降低响度可以降低第一音频播放对用户聊天或打电话的影响，以免第一音频的声音干扰用户说话的声音。
本申请实施例对上述评估背景噪声部分是否包含人声的具体方法不作限定，例如，音效评估模块可以利用支持向量机算法来识别背景噪声部分的音频信号中是否包含人声。上述评估背景噪声部分是否包含人声的具体过程可参考现有技术中识别音频中是否包含人声的实现过程。
下面基于第一电子设备100评估并调节音效，第二电子设备200采集环境声音的场景介绍本申请实施例提供的一种音效调节方法。
图6示例性示出了本申请实施例提供的一种音效调节方法的流程图。如图6所示，该方法可包括步骤S101～S110。该方法以第一电子设备100与附近的电子设备建立蓝牙连接为例进行说明。其中：
S101、第一电子设备100(如电视)检测到播放第一音频的用户操作。
上述播放第一音频的用户操作可以例如是前述图4A所示作用在播放控件244上的用户操作。
S102、第一电子设备100可以扫描附近的蓝牙设备并发现第二电子设备200(如手表)。第一电子设备100可以与第二电子设备200建立蓝牙连接并确定第二电子设备200的设备类型。
S103、第一电子设备100还发现第三电子设备300(如手机)。第一电子设备可以与第三电子设备300建立蓝牙连接并确定第三电子设备300的设备类型。
当检测到播放第一音频的用户操作，第一电子设备100可以扫描附近的蓝牙设备。第一电子设备100与附近的蓝牙设备建立通信连接的方式可以参考前述实施例，这里不再赘述。
示例性的，第一电子设备100与第二电子设备200、第三电子设备300建立了蓝牙连接。其中，第一电子设备100可以确定第二电子设备200的设备类型，例如手表。第一电子设备100可以确定第三电子设备300的设备类型，例如手机。
S104、第一电子设备100可以按照预设的第一优先级规则确定第二电子设备200的优先级高于第三电子设备300的优先级。该第一优先级规则可用于确定采集环境声音的设备优先级。该第一优先级规则可以为可穿戴设备优先级高于手机优先级。
由步骤S103可知，第二电子设备200的设备类型为手表(即可穿戴设备)。第三电子设备300的设备类型为手机。第二电子设备200为用户随身携带的电子设备的可能性更高。第一电子设备100可以优先请求第二电子设备200作为协同设备，来采集用户所在位置处的环境声音。第一电子设备100根据上述第一优先级规则确定采集环境声音的电子设备的方法可以参考前述实施例中的描述，这里不再赘述。
不限于根据上述第一优先级规则确定采集环境声音的电子设备，第一电子设备100还可以基于用户选择的电子设备来确定用于采集环境声音的电子设备。具体的实现方法可以参考前述图4A～图4D所示实施例的介绍。
S105、第一电子设备100可以向第二电子设备200发送指示第二电子设备200开启麦克风的指令。
S106、第二电子设备200可以开启麦克风，并采集环境声音得到环境音频。
在一种可能的实现方式中，当接收到上述来自第一电子设备100开启麦克风的指令，第二电子设备200可以直接开启麦克风，采集环境声音。
在另一种可能的实现方式中，当接收到上述来自第一电子设备100开启麦克风的指令，第二电子设备200可以显示如图5B所示的提示框251，来询问第二电子设备200的用户是否同意开启麦克风。当接收到同意开启麦克风的用户操作，第二电子设备20可以开启麦克风，采集环境声音。
其中，第二电子设备200中用于采集环境声音的装置不限于是麦克风，还可以是其他类型的音频采集装置。
在一些实施例中，第二电子设备200可以每隔预设时间段采集预设时间长度的环境声音，得到环境音频。第二电子设备200可以将每次采集得到的环境音频发送给第一电子设备100。上述环境音频中可包含有时间标识。该时间标识可用于指示该环境音频的采集时间。这样，第一电子设备100可以对相同时间段播放的第一音频和采集的环境音频进行评估，进而调节下一时间段第一音频的播放音效。
S107、第二电子设备200可以将环境音频发送给第一电子设备100。
S108、第一电子设备100可以根据第一音频与环境音频，评估第一音频在第二电子设备200所在位置处的收听音效是否达到最佳音效。
S109、若上述第一音频在第二电子设备200所在位置处的收听音效未达到最佳音效，第一电子设备100可以调节第一音频的播放音效，使得上述收听音效达到最佳音效。
S110、若上述第一音频在第二电子设备200所在位置处的收听音效达到了最佳音效，第一电子设备100可以维持第一音频的播放音效不变，继续播放第一音频。
第一电子设备100中可包含有音效评估模块和音效调节模块。其中，当接收到第二电子设备200采集得到的环境音频，音效评估模块可以基于第一音频与环境音频得到音效评估结果。该音效评估结果可以指示第一音频在第二电子设备200所在位置处的收听音效是否达到最佳音效。进一步的，音效调节模块可以基于上述音效评估结果调节播放第一音频的音频参数，实现对第一音频的播放音效的调节。第一电子设备100进行音效评估和音效调节的具体实现方法可以参考前述实施例的介绍，这里不再赘述。
第一电子设备100与附近电子设备的通信连接方式不限于是上述蓝牙连接，还可以是其他的通信连接方式，本申请实施例对此不作限定。
在一些实施例中，当第一电子设备100检测到自己停止播放音频，第一电子设备100可以向第二电子设备200发送用于指示关闭第二电子设备200的麦克风的指令。进一步的，第二电子设备200可以关闭麦克风。
由图6所示的音效调节方法可以看出，播放第一音频的第一电子设备可以借助用户携带的第二电子设备来采集用户所在位置处的环境声音。基于第一音频与用户所在位置处的环境音频的音效评估结果，第一电子设备可以确定第一音频在用户所在位置处的收听音效。第一电子设备可以调节第一音频的播放音效，使得第一音频在用户所在位置处的收听音效达到最佳收听位置、安静环境下的音效。也即是说，在第一电子设备播放音频的过程中，用户收听到的音效(即收听音效)可以不受用户与第一电子设备的距离变化、角度变化、环境噪声变化等因素的影响。第一电子设备可以根据用户所处位置环境的变化动态调节第一音频的播放音效，无需用户手动调节第一音频的播放音效，极大地提高用户收听音频的体验。
下面基于第二电子设备200采集环境音频并评估音效，第一电子设备100调节音效的场景介绍本申请实施例提供的另一种音效调节方法。
图7示例性示出了本申请实施例提供的另一种音效调节方法的流程图。如图7所示，该 方法可包括步骤S201～S211。其中：
S201、第一电子设备100(如电视)检测到播放第一音频的用户操作。
S202、第一电子设备100可以扫描附近的蓝牙设备并发现第二电子设备200(如手表)。第一电子设备100可以与第二电子设备200建立蓝牙连接并确定第二电子设备200的设备类型。
S203、第一电子设备100还发现第三电子设备300(如手机)。第一电子设备可以与第三电子设备300建立蓝牙连接并确定第三电子设备300的设备类型。
S204、第一电子设备100可以按照预设的第一优先级规则确定第二电子设备200的优先级高于第三电子设备300的优先级。该第一优先级规则可用于确定采集环境声音的设备优先级。该第一优先级规则可以为可穿戴设备优先级高于手机优先级。
上述步骤S201～S204的实现过程可以参考前述图6所示步骤S101～S104的介绍，这里不再赘述。
S205、第一电子设备100可以确定第二电子设备200具有音效评估模块。
当根据上述步骤S204确定出用于采集环境声音的电子设备，第一电子设备100可以询问该电子设备是否具有音效评估模块。若该电子设备具有音效评估模块，第一电子设备100可以指示该电子设备进行音效评估并返回音效评估结果。
例如，第一电子设备100根据第一优先级规则确定出与自己建立有通信连接的电子设备中，第二电子设备200(手表)的优先级最高。第一电子设备100可以向第二电子设备200发送用于询问第二电子设备200是否具有音效评估模块的消息。若第二电子设备200具有音效评估模块，第二电子设备200可以向第一电子设备100发送用于指示自己具有音效评估模块的消息。这样，第一电子设备100可以确定第二电子设备200具有音效评估模块。
其中，若第二电子设备200不具有音效评估模块，第一电子设备100还可以询问其它建立有通信连接的电子设备(如第三电子设备300)是否具有音效评估模块。
S206、第一电子设备100可以向第二电子设备200发送指示第二电子设备200开启麦克风的指令。
S207、第二电子设备200可以开启麦克风，并采集环境声音得到环境音频。
上述步骤S206和步骤S207可以分别参考前述图6所示的步骤S105和步骤S106，这里不再赘述。
S208、第一电子设备100可以将第一音频发送给第二电子设备200。
S209、第二电子设备200可以根据第一音频与环境音频，评估第一音频在第二电子设备200所在位置处的收听音效是否达到最佳音效，得到音效评估结果。
S210、第二电子设备200可以将上述音效评估结果发送给第一电子设备100。
S211、若上述音效评估结果指示上述收听音效未达到最佳音效，第一电子设备100可以调节第一音频的播放音效，使得收听音效达到最佳音效。若上述音效评估结果指示上述收听音效达到最佳音效，第一电子设备100可以维持第一音频的播放音效不变。
上述第二电子设备200中的音效评估模块评估音效以及上述第一电子设备100基于音效评估结果调节第一音频的播放音效的实现方法可以参考前述实施例的介绍，这里不再赘述。
在一些实施例中，当第一电子设备100检测到自己停止播放音频，第一电子设备100可以向第二电子设备200发送用于指示关闭第二电子设备200的麦克风的指令。进一步的，第二电子设备200可以关闭麦克风。
由图7所示的音效调节方法可以看出，播放第一音频的第一电子设备可以借助用户携带 的第二电子设备来采集用户所在位置处的环境声音。其中，若第一电子设备不具有音效评估模块或当前软硬件资源消耗过高，第一电子设备可以指示具有音效评估模块的第二电子设备进行音效评估。这样可以合理调度第一电子设备和第二电子设备的软硬件资源，提高音效评估的效率。
基于第一音频与用户所在位置处的环境音频的音效评估结果，第一电子设备可以确定第一音频在用户所在位置处的收听音效。第一电子设备可以调节第一音频的播放音效，使得第一音频在用户所在位置处的收听音效达到最佳收听位置、安静环境下的音效。也即是说，在第一电子设备播放音频的过程中，用户收听到的音效(即收听音效)可以不受用户与第一电子设备的距离变化、角度变化、环境噪声变化等因素的影响。第一电子设备可以根据用户所处位置环境的变化动态调节第一音频的播放音效，无需用户手动调节第一音频的播放音效，极大地提高用户收听音频的体验。
下面基于第一电子设备100播放第一音频并调节播放音效，第二电子设备200采集环境音频，第三电子设备300评估音效的场景介绍本申请实施例提供的另一种音效调节方法。
图8示例性示出了本申请实施例提供的另一种音效调节方法。如图8所示，该方法可包括步骤S301～S314。其中：
S301、第一电子设备100(如电视)检测到播放第一音频的用户操作。
S302、第一电子设备100可以扫描附近的蓝牙设备并发现第二电子设备200(如手表)。第一电子设备100可以与第二电子设备200建立蓝牙连接并确定第二电子设备200的设备类型。
S303、第一电子设备100还发现第三电子设备300(如手机)。第一电子设备可以与第三电子设备300建立蓝牙连接并确定第三电子设备300的设备类型。
S304、第一电子设备100可以按照预设的第一优先级规则确定第二电子设备200的优先级高于第三电子设备300的优先级。该第一优先级规则可用于确定采集环境声音的设备优先级。该第一优先级规则可以为可穿戴设备优先级高于手机优先级。
上述步骤S301～S304可以参考前述图6所示的步骤S101～S104们这里不再赘述。
S305、第一电子设备100可以确定第二电子设备200具有音效评估模块。
S306、第一电子设备100可以确定第三电子设备300具有音效评估模块。
第一电子设备100可以向所有与自己建立有通信连接的电子设备是否具有音效评估模块。这些电子设备可以向第一电子设备100回复用于指示具有音效评估模块或用于指示不具有音效评估模块的消息。
例如，第二电子设备200和第三电子设备300均具有音效评估模块。第一电子设备100可以确定第二电子设备200具有音效评估模块，并确定第三电子设备300具有音效评估模块。
S307、第一电子设备100可以按照预设第二优先级规则确定第三电子设备300的优先级高于第二电子设备200的优先级。第二优先级规则可以根据电子设备的处理能力确定。电子设备的处理能力越高，该电子设备在第二优先级规则中优先级越高。
上述第二优先级规则可以是预置在第一电子设备100中的。手机的处理能力一般高于可穿戴设备的处理能力。在第二优先级规则中，手机的优先级可以高于可穿戴设备的优先级。也即是说，根据第二优先级规则，第一电子设备100可以确定出第三电子设备300(手机)的优先级高于第二电子设备200(手表)的优先级。第一电子设备100可以指示第三电子设备300进行音效评估。
不限于上述根据电子设备的处理能力来确定不同类型的电子设备在第二优先级规则中的优先级顺序，第二优先级规则中的优先级顺序还可以根据电子设备当前软硬件资源占用情况(即忙碌情况)确定各电子设备的优先级顺序。本申请实施例对第二优先级规则中优先级顺序的确定方法不作限定。
S308、第一电子设备100可以向第二电子设备200发送指示第二电子设备200开启麦克风的指令。
S309、第二电子设备200可以开启麦克风，并采集环境声音得到环境音频。
上述步骤S308和步骤S309可以分别参考前述图6所示的步骤S105和步骤S106，这里不再赘述。
S310、第二电子设备200可以将环境音频发送给第一电子设备100。
在一种可能的实现方式中，第二电子设备200可以将环境音频发送给第一电子设备100。
在另一种可能的实现方式中，第一电子设备100可以指示用于采集环境声音的电子设备(如第二电子设备200)与用于进行音效评估的电子设备(如第三电子设备300)建立通信连接。或者，第一电子设备100可以指示用于进行音效评估的电子设备(如第三电子设备300)与用于采集环境声音的电子(如第二电子设备200)设备建立通信连接。进一步的，第一电子设备100可以指示第二电子设备200向采集得到的环境音频发送给第三电子设备300。这样，第二电子设备200可以不用将环境音频交由第一电子设备100转发给第三电子设备300。
S311、第一电子设备100可以将第一音频和环境音频发送给第三电子设备300。
当接收到来自第二电子设备200的环境音频，第一电子设备100可以将第一音频和该环境音频一起发送给第三电子设备300。并且，第一电子设备100可以指示第三电子设备300进行音效评估。
或者，第二电子设备200与第三电子设备300建立有通信连接。第二电子设备200可以将环境音频发送给第三电子设备300。第一电子设备100可以将第一音频发送给第三电子设备300。
S312、第三电子设备300可以根据第一音频与环境音频，评估第一音频在第二电子设备200所在位置处的收听音效是否达到最佳音效，得到音效评估结果。
S313、第三电子设备300可以将上述音效评估结果发送给第一电子设备100。
S314、若上述音效评估结果指示上述收听音效未达到最佳音效，第一电子设备100可以调节第一音频的播放音效，使得收听音效达到最佳音效。若上述音效评估结果指示上述收听音效达到最佳音效，第一电子设备100可以维持第一音频的播放音效不变。
上述第三电子设备300中的音效评估模块评估音效以及上述第一电子设备100基于音效评估结果调节第一音频的播放音效的实现方法可以参考前述实施例的介绍，这里不再赘述。
在一些实施例中，当第一电子设备100检测到自己停止播放音频，第一电子设备100可以向第二电子设备200发送用于指示关闭第二电子设备200的麦克风的指令。进一步的，第二电子设备200可以关闭麦克风。
由图8所示的音效调节方法可以看出，播放第一音频的第一电子设备可以借助用户携带的第二电子设备来采集用户所在位置处的环境声音。其中，第一电子设备可以指示与自己建立有通信连接且具有音效评估模块的电子设备中处理能力较高或者软硬件资源占用不高的电子设备进行音效评估。这可以合理调度第一电子设备附近电子设备的软硬件资源，提高音效评估的效率，更好的进行音效调节。
基于第一音频与用户所在位置处的环境音频的评估结果，第一电子设备可以确定第一音 频在用户所在位置处的收听音效。第一电子设备可以调节第一音频的播放音效，使得第一音频在用户所在位置处的收听音效达到最佳收听位置、安静环境下的音效。也即是说，在第一电子设备播放音频的过程中，用户收听到的音效(即收听音效)可以不受用户与第一电子设备的距离变化、角度变化、环境噪声变化等因素的影响。第一电子设备可以根据用户所处位置环境的变化动态调节第一音频的播放音效，无需用户手动调节第一音频的播放音效，极大地提高用户收听音频的体验。
在本申请实施例中，第一电子设备用于播放第一音频。其中，第一电子设备可以在检测到用于播放第一音频的用户操作后，开始播放第一音频。上述播放第一音频的用户操作可以例如是前述图4A所示作用在播放控件244上的用户操作。第二电子设备用于在第一音频被播放时采集第二音频。其中，第一电子设备可以在检测到用于播放第一音频的用户操作后，向第二电子设备发送用于开启麦克风，采集上述第二音频的指令。
在本申请实施例中，第一电子设备可以以第一音效播放第一音频。上述第一音效可以为前述实施例中的播放音效。第一电子设备可以通过改变响度、调节音频信号的EQ以及DRC中的参数等音频参数来调节第一音效。
在本申请实施例中，第一电子设备、第二电子设备、第三电子设备中的一个可以根据第二音频确定出第二音效。该第二音效为第一音频以上述第一音效被播放时第二电子设备的收听音效。也即是说，在第一电子设备以第一音效播放第一音频时，用户在第二电子设备所在的位置处收听到的声音效果为第二音效。
在本申请实施例中，第一电子设备、第二电子设备、第三电子设备中的一个可以评估上述第二音效与第三音效的差距是否超过第一差距，并在第二音效与第三音效的差距超过第一差距的情况下，将第一音频的播放音效确定为第四音效。该第四音效为前述实施例中的播放音效。上述评估第二音效与第三音效的差距是否超过第一差距的结果即为前述实施例中的音效评估结果。上述第一差距可以是预置的。例如，上述第一差距可以包括响度的差距、EQ中中心频率的差距、EQ中增益的差距、DRC中频带范围的差距、DRC中压缩率的差距等音频参数的差距。上述第三音效为第一音频以第一音效被播放时的最佳音效。其中，第三音效可以通过查询前述实施例中的最佳音效映射表或者利用最佳音效计算算法获得。上述第一音频以上述第四音效被播放时第二电子设备的收听音效与第三音效的差距小于上述第一差距。
以上所述，以上实施例仅用以说明本申请的技术方案，而非对其限制；尽管参照前述实施例对本申请进行了详细的说明，本领域的普通技术人员应当理解：其依然可以对前述各实施例所记载的技术方案进行修改，或者对其中部分技术特征进行等同替换；而这些修改或者替换，并不使相应技术方案的本质脱离本申请各实施例技术方案的范围。

Claims (19)

  1. 一种音效调节方法，所述方法应用于音效调节系统，所述音效调节系统包括第一电子设备、第二电子设备，其特征在于，所述第一电子设备与所述第二电子设备建立有通信连接；
    所述第一电子设备用于播放第一音频，所述第二电子设备用于在所述第一音频被播放时采集第二音频；
    所述方法包括：
    在所述第一音频以第一音效被播放时，根据所述第二音频确定出第二音效，所述第二音效为所述第一音频以所述第一音效被播放时所述第二电子设备的收听音效；
    在所述第二音效与第三音效的差距超过第一差距的情况下，将所述第一音频的播放音效确定为第四音效，所述第一音频以所述第四音效被播放时所述第二电子设备的收听音效与所述第三音效的差距小于所述第一差距，所述第三音效为所述第一音频以所述第一音效被播放时的最佳音效。
  2. 根据权利要求1所述的方法，其特征在于，在所述第一音频以所述第一音效被播放时，所述第二电子设备在第一位置的收听音效与所述第二电子设备在第二位置的收听音效不同。
  3. 根据权利要求1或2所述的方法，其特征在于，所述在所述第一音频以第一音效被播放时，根据所述第二音频确定出第二音效由所述第一电子设备执行，或者由所述第二电子设备执行。
  4. 根据权利要求1-3中任一项所述的方法，其特征在于，所述在所述第二音效与第三音效的差距超过第一差距的情况下，将所述第一音频的播放音效确定为第四音效由所述第一电子设备执行，或者由所述第二电子设备执行。
  5. 根据权利要求1或2所述的方法，其特征在于，所述音效调节系统还包括第三电子设备，其特征在于，所述第一电子设备与所述第三电子设备建立有通信连接；所述在所述第一音频以第一音效被播放时，根据所述第二音频确定出第二音效，以及所述在所述第二音效与第三音效的差距超过第一差距的情况下，将所述第一音频的播放音效确定为第四音效由所述第三电子设备执行。
  6. 根据权利要求1或2所述的方法，其特征在于，所述音效调节系统还包括第三电子设备，其特征在于，所述第一电子设备与所述第三电子设备建立有通信连接；所述方法还包括：
    所述第一电子设备根据电子设备的处理能力强度或根据电子设备的忙碌程度，选择所述第二电子设备和所述第三电子设备中的一个在所述第一音频以所述第一音效被播放时，根据所述第二音频确定出所述第二音效，或在所述第二音效与所述第三音效的差距超过所述第一差距的情况下，将所述第一音频的播放音效确定为所述第四音效。
  7. 根据权利要求1-6中任一项所述的方法，其特征在于，所述方法还包括：
    所述第一电子设备提供用于选择采集所述第二音频的电子设备选项，所述电子设备选项 包含与所述第二电子设备对应的选项；
    所述第一电子设备接收到选择所述与所述第二电子设备对应的选项的用户操作；
    所述第一电子设备指示所述第二电子设备采集所述第二音频。
  8. 根据权利要求1-6中任一项所述的方法，其特征在于，所述方法还包括：
    所述第一电子设备基于第一优先级规则确定所述第二电子设备是与所述第一电子设备建立有通信连接的电子设备中优先级最高的电子设备，并指示所述第二电子设备采集所述第二音频；所述第一优先级规则中确定电子设备的优先级顺序的原则为：根据电子设备的设备类型确定用户随身携带的可能性的高低，用户随身携带的可能性越高的电子设备在所述第一优先级规则中优先级越高。
  9. 根据权利要求1-8中任一项所述的方法，其特征在于，所述第二音频包括第一音频部分和背景噪声部分，所述第二音效由所述第一音频部分和所述背景噪声部分确定，所述背景噪声部分所指示的背景噪声越大，所述第四音效中的响度比所述第一音效中的响度越高。
  10. 根据权利要求1-8中任一项所述的方法，其特征在于，所述第二音频包括第一音频部分和背景噪声部分，所述第二音效由所述第一音频部分和所述背景噪声部分确定；在所述背景噪声部分包含人声的情况下，所述第四音效中的响度与所述第一音效中的响度相同，或者，所述第四音效中的响度比所述第一音效中的响度低。
  11. 根据权利要求1-10中任一项所述的方法，其特征在于，所述第一音频从以所述第一音效被播放调节至以所述第四音效被播放通过音频参数的调节实现，所述音频参数包括以下一项或多项：响度、均衡器中的参数、动态范围控制器中的参数。
  12. 一种音效调节方法，其特征在于，所述方法包括：
    第一电子设备以第一音效播放第一音频，并与第二电子设备建立通信连接；
    所述第一电子设备接收来自所述第二电子设备的第二音频，所述第二音频是所述第二电子设备在所述第一音频被播放时采集的；
    所述第一电子设备根据所述第二音频确定出第二音效，所述第二音效为所述第一音频以所述第一音效被播放时所述第二电子设备的收听音效；
    所述第一电子设备在所述第二音效与第三音效的差距超过第一差距的情况下，将所述第一音频的播放音效确定为第四音效，所述第一音频以所述第四音效被播放时所述第二电子设备的收听音效与所述第三音效的差距小于所述第一差距，所述第三音效为所述第一音频以所述第一音效被播放时的最佳音效。
  13. 根据权利要求12所述的方法，其特征在于，所述方法还包括：
    所述第一电子设备提供用于选择采集所述第二音频的电子设备选项，所述电子设备选项包含与所述第二电子设备对应的选项；
    所述第一电子设备接收到选择所述与所述第二电子设备对应的选项的用户操作；
    所述第一电子设备指示所述第二电子设备采集所述第二音频。
  14. 根据权利要求12所述的方法，其特征在于，所述方法还包括：
    所述第一电子设备基于第一优先级规则确定所述第二电子设备是与所述第一电子设备建立有通信连接的电子设备中优先级最高的电子设备，并指示所述第二电子设备采集所述第二音频；所述第一优先级规则中确定电子设备的优先级顺序的原则为：根据电子设备的设备类型确定用户随身携带的可能性的高低，用户随身携带的可能性越高的电子设备在所述第一优先级规则中优先级越高。
  15. 根据权利要求12-14中任一项所述的方法，其特征在于，所述第二音频包括第一音频部分和背景噪声部分，所述第二音效由所述第一音频部分和所述背景噪声部分确定，所述背景噪声部分所指示的背景噪声越大，所述第四音效中的响度比所述第一音效中的响度越高。
  16. 根据权利要求12-14中任一项所述的方法，其特征在于，所述第二音频包括第一音频部分和背景噪声部分，所述第二音效由所述第一音频部分和所述背景噪声部分确定；在所述背景噪声部分包含人声的情况下，所述第四音效中的响度与所述第一音效中的响度相同，或者，所述第四音效中的响度比所述第一音效中的响度低。
  17. 根据权利要求12-16中任一项所述的方法，其特征在于，所述第一音频从以所述第一音效被播放调节至以所述第四音效被播放通过音频参数的调节实现，所述音频参数包括以下一项或多项：响度、均衡器中的参数、动态范围控制器中的参数。
  18. 一种电子设备，所述电子设备为第一电子设备，其特征在于，所述第一电子设备包括音频输出装置、通信装置、存储器和处理器；
    所述音频输出装置用于播放第一音频；
    所述通信装置用于与第二电子设备建立通信连接，并接收来自所述第二电子设备的第二音频，所述第二音频是所述第二电子设备在所述第一音频被播放时采集的；
    所述存储器用于存储计算机程序；
    所述处理器用于调用所述计算机程序，使得所述第一电子设备执行权利要求12-17中任一项所述的方法。
  19. 一种计算机存储介质，其特征在于，包括：计算机指令；当所述计算机指令在电子设备上运行时，使得所述电子设备执行权利要求1-17中任一项所述的方法。
PCT/CN2021/137362 2020-12-23 2021-12-13 音效调节方法及电子设备 WO2022135201A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
EP21909198.0A EP4246982A4 (en) 2020-12-23 2021-12-13 SOUND EFFECT ADJUSTMENT METHOD AND ELECTRONIC DEVICE
US18/258,883 US20240045645A1 (en) 2020-12-23 2021-12-13 Sound effect adjustment method and electronic device

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202011542202.0A CN114666631B (zh) 2020-12-23 2020-12-23 音效调节方法及电子设备
CN202011542202.0 2020-12-23

Publications (1)

Publication Number Publication Date
WO2022135201A1 true WO2022135201A1 (zh) 2022-06-30

Family

ID=82024578

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/137362 WO2022135201A1 (zh) 2020-12-23 2021-12-13 音效调节方法及电子设备

Country Status (4)

Country Link
US (1) US20240045645A1 (zh)
EP (1) EP4246982A4 (zh)
CN (1) CN114666631B (zh)
WO (1) WO2022135201A1 (zh)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106354471A (zh) * 2016-09-29 2017-01-25 北京小米移动软件有限公司 音频播放控制方法、装置及电子设备
CN108924725A (zh) * 2018-07-10 2018-11-30 惠州市德赛西威汽车电子股份有限公司 一种车载音响系统的音效测试方法
CN109101216A (zh) * 2018-09-04 2018-12-28 Oppo广东移动通信有限公司 音效调整方法、装置、电子设备以及存储介质
CN109121068A (zh) * 2018-07-04 2019-01-01 广州视源电子科技股份有限公司 音效控制方法、装置及电子设备
CN109271128A (zh) * 2018-09-04 2019-01-25 Oppo广东移动通信有限公司 音效设置方法、装置、电子设备及存储介质
US20190394567A1 (en) * 2018-06-22 2019-12-26 EVA Automation, Inc. Dynamically Adapting Sound Based on Background Sound

Family Cites Families (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6069567A (en) * 1997-11-25 2000-05-30 Vlsi Technology, Inc. Audio-recording remote control and method therefor
US20060088174A1 (en) * 2004-10-26 2006-04-27 Deleeuw William C System and method for optimizing media center audio through microphones embedded in a remote control
CN103888877B (zh) * 2012-12-21 2016-05-25 中国移动通信集团公司 一种基于双设备的立体声播放方法、系统及设备
US9525392B2 (en) * 2015-01-21 2016-12-20 Apple Inc. System and method for dynamically adapting playback device volume on an electronic device
US10271157B2 (en) * 2016-05-31 2019-04-23 Gaudio Lab, Inc. Method and apparatus for processing audio signal
CN206743522U (zh) * 2017-01-19 2017-12-12 匡留生 音效调整终端和智能定制音响系统
CN106850320B (zh) * 2017-03-31 2019-04-16 Oppo广东移动通信有限公司 升级控制方法、装置及终端
CN110351213A (zh) * 2018-04-02 2019-10-18 华为技术有限公司 音频播放方法及设备
CN108882139A (zh) * 2018-05-31 2018-11-23 北京橙鑫数据科技有限公司 参数配置方法以及系统
US10511906B1 (en) * 2018-06-22 2019-12-17 EVA Automation, Inc. Dynamically adapting sound based on environmental characterization
CN109348359B (zh) * 2018-10-29 2020-11-10 歌尔科技有限公司 一种音响设备及其音效调整方法、装置、设备、介质
CN111314825A (zh) * 2018-12-11 2020-06-19 无锡华润矽科微电子有限公司 自动调节扬声器频响曲线的系统及方法
CN110989968A (zh) * 2019-12-16 2020-04-10 西安闻泰电子科技有限公司 智能音效处理方法、电子设备、存储介质以及多音效音箱

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106354471A (zh) * 2016-09-29 2017-01-25 北京小米移动软件有限公司 音频播放控制方法、装置及电子设备
US20190394567A1 (en) * 2018-06-22 2019-12-26 EVA Automation, Inc. Dynamically Adapting Sound Based on Background Sound
CN109121068A (zh) * 2018-07-04 2019-01-01 广州视源电子科技股份有限公司 音效控制方法、装置及电子设备
CN108924725A (zh) * 2018-07-10 2018-11-30 惠州市德赛西威汽车电子股份有限公司 一种车载音响系统的音效测试方法
CN109101216A (zh) * 2018-09-04 2018-12-28 Oppo广东移动通信有限公司 音效调整方法、装置、电子设备以及存储介质
CN109271128A (zh) * 2018-09-04 2019-01-25 Oppo广东移动通信有限公司 音效设置方法、装置、电子设备及存储介质

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP4246982A4

Also Published As

Publication number Publication date
US20240045645A1 (en) 2024-02-08
EP4246982A4 (en) 2024-04-10
EP4246982A1 (en) 2023-09-20
CN114666631B (zh) 2024-04-26
CN114666631A (zh) 2022-06-24

Similar Documents

Publication Publication Date Title
CN110138937B (zh) 一种通话方法、设备及系统
CN113169760B (zh) 无线短距离音频共享方法及电子设备
WO2020253844A1 (zh) 多媒体信息的处理方法、装置和存储介质
CN112806067B (zh) 语音切换方法、电子设备及系统
CN112868244A (zh) 一种点对多点的数据传输方法及设备
EP4061027B1 (en) Bluetooth communication method and apparatus
WO2021180083A1 (zh) 蓝牙通信系统和无线通信系统
CN110198362B (zh) 一种在联系人中添加智能家居设备的方法及系统
US10827455B1 (en) Method and apparatus for sending a notification to a short-range wireless communication audio output device
WO2021031865A1 (zh) 通话方法及装置
WO2022242528A1 (zh) 一种音量调节方法及终端设备
CN113921002A (zh) 一种设备控制方法及相关装置
CN112771828B (zh) 一种音频数据的通信方法及电子设备
CN113301544B (zh) 一种音频设备间语音互通的方法及设备
CN113365274B (zh) 一种网络接入方法和电子设备
WO2022135201A1 (zh) 音效调节方法及电子设备
CN115022766B (zh) 音频数据播放方法及设备
WO2023071502A1 (zh) 音量控制方法、装置及电子设备
CN114120987B (zh) 一种语音唤醒方法、电子设备及芯片系统
CN113709906A (zh) 无线音频系统、无线通讯方法及设备
CN114125789A (zh) 通信方法、终端设备及存储介质
WO2023005844A1 (zh) 设备唤醒方法、相关装置及通信系统
WO2023236670A1 (zh) 数据传输管理方法、电子设备及存储介质
CN114691844A (zh) 对话任务管理方法、装置及电子设备
CN114041102A (zh) 服务提供方法及装置

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21909198

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2021909198

Country of ref document: EP

Effective date: 20230613

WWE Wipo information: entry into national phase

Ref document number: 18258883

Country of ref document: US

NENP Non-entry into the national phase

Ref country code: DE