EP4611397A1

EP4611397A1 - Loudspeaker control method and electronic device

Info

Publication number: EP4611397A1
Application number: EP23905330.9A
Authority: EP
Inventors: Yingbo Zhang
Original assignee: Honor Device Co Ltd
Current assignee: Honor Device Co Ltd
Priority date: 2022-12-20
Filing date: 2023-09-08
Publication date: 2025-09-03
Also published as: EP4611397A4; CN118233808A; CN119999233A; WO2024131153A1

Abstract

This application provides a method for controlling a speaker and an electronic device, and relates to the field of intelligent terminal technologies. To resolve an impact on an audio that needs to be played when a sound outlet hole of a speaker is occluded. A specific solution includes: controlling, when it is determined that a first audio and a second audio are to be played, a first speaker to play the first audio, and controlling a second speaker to play the second audio; controlling, when a sound outlet hole of the first speaker is occluded, the first speaker to play the first audio that has been adjusted; or controlling the second speaker to play the first audio.

Description

This application claims priority to Chinese Patent Application No. 202211644169.1, filed with the China National Intellectual Property Administration on December 20, 2022 and entitled "METHOD FOR CONTROLLING SPEAKER AND ELECTRONIC DEVICE", which is incorporated herein by reference in its entirety.

TECHNICAL FIELD

This application relates to the field of intelligent terminal technologies, and in particular, to a method for controlling a speaker and an electronic device.

BACKGROUND

With iteration and update of device hardware, various electronic devices can provide more high-quality services to users. For example, as the quantity of speakers connected to an electronic device increases, a sound field of the electronic device is expanded. In this way, the electronic device can provide a better audio output service to the user.
In some scenarios, a sound outlet hole of a speaker in the electronic device may be occluded. For example, the sound outlet hole of the speaker is occluded by a hand of the user when the user uses the electronic device, or the sound outlet hole of the speaker is blocked by a foreign object. When the sound outlet hole of the speaker is occluded, service quality corresponding to an audio output service of the electronic device is directly affected. For example, a sound volume actually heard by the user and a sound source position audibly perceived by the user are affected. Consequently, experience of using the electronic device by the user is also affected.

SUMMARY

This application provides a method for controlling a speaker and an electronic device, to improve a sound effect of an audio played by an electronic device when a sound outlet hole of a speaker is occluded.
To achieve the foregoing objectives, the following technical solutions are used in embodiments of this application.
According to a first aspect, an embodiment of this application provides a method for controlling a speaker, which is applied to an electronic device. The electronic device includes a first speaker and a second speaker, and the method includes: controlling, when it is determined that a first audio and a second audio are to be played, the first speaker to play the first audio, and controlling the second speaker to play the second audio; controlling, when a sound outlet hole of the first speaker is occluded, the first speaker to play the first audio that has been adjusted; or controlling the second speaker to play the first audio.
In the foregoing embodiment, a manner of playing the first audio by the first speaker is changed, or a manner of playing the first audio by the second speaker is controlled. In this way, even if the first speaker is occluded, a playback effect of the first audio is not affected, quality of an audio output of the electronic device is ensured, and user experience is also improved.
In some embodiments, before the controlling the first speaker to play the first audio that has been adjusted, the method includes: adjusting a sound wave phase and a vibration amplitude that correspond to the first audio.
In the foregoing embodiment, the sound wave phase and the vibration amplitude of the first audio that needs to be played by the first speaker are adjusted, to compensate for a phase shift and vibration amplitude attenuation of a sound wave signal that is actually played after the first speaker is occluded. In this way, after the first speaker is occluded, the user feels no difference in hearing.
In some embodiments, before the adjusting a sound wave phase and a vibration amplitude that correspond to the first audio, the method further includes: determining a first occlusion ratio corresponding to the sound outlet hole of the first speaker; and determining that the first occlusion ratio is less than a first threshold.
In the foregoing embodiment, when the first occlusion ratio is less than the first threshold, the sound wave phase and the vibration amplitude that correspond to the first audio are adjusted, to improve an impact caused by occlusion of the speaker, and reduce overheads of switching the speaker to play the first audio.
In some embodiments, before the adjusting a sound wave phase and a vibration amplitude that correspond to the first audio, the method further includes: determining that a preset priority of the second audio is higher than that of the first audio.
In the foregoing embodiment, when the preset priority of the second audio is higher than that of the first audio, the sound wave phase and the vibration amplitude that correspond to the first audio are adjusted, to improve an impact caused by occlusion of the speaker, and avoid an impact on playback of the second audio.
In some embodiments, before the controlling the second speaker to play the first audio, the method includes: controlling the first speaker to stop playing the first audio.
In the foregoing embodiment, if the second speaker is used to play the first audio, the first speaker may further be controlled to stop playing the first audio. In this way, not only normal playback of the first audio can be ensured, but also impact on a service life of the first speaker can be avoided.
In some embodiments, when the second speaker is controlled to play the first audio, the method further includes: controlling the second speaker to stop playing the second audio; and controlling the first speaker to play the second audio.
In the foregoing embodiment, the first audio is prevented from being affected by interchanging speakers for playing the first audio and the second audio. In other possible embodiments, when the preset priority of the first audio is higher than that of the second audio, the speakers may be interchanged to ensure that the more important first audio is not affected.
In some embodiments, before the controlling the first speaker to stop playing the first audio, the method further includes: determining a first occlusion ratio corresponding to the sound outlet hole of the first speaker; and determining that the first occlusion ratio is not less than a first threshold.
In some embodiments, when the second speaker is controlled to play the first audio, the second speaker continues to play the second audio.
In the foregoing embodiment, it can be ensured that playback of the first audio and playback of the second audio are not simultaneously affected.
In some embodiments, an orientation of the sound outlet hole of the first speaker is the same as that of a sound outlet hole of the second speaker.
In some embodiments, the electronic device includes a third speaker and a fourth speaker, and the method includes: detecting, when both the third speaker and the fourth speaker play a third audio, that a sound outlet hole of the third speaker is occluded; controlling the third speaker to stop playing the third audio; and controlling the fourth speaker to play a fourth audio, where the fourth audio is obtained by adjusting a sound wave phase and a vibration amplitude of the third audio.
In some embodiments, an orientation of a sound outlet hole of the third speaker is the same as that of a sound outlet hole of the fourth speaker.
In some embodiments, the electronic device includes a third speaker and a fourth speaker, and the method includes: detecting, when both the third speaker and the fourth speaker play a fifth audio and a sixth audio, that a sound outlet hole of the third speaker is occluded; controlling the third speaker to play only the sixth audio when the fifth audio is marked as a first type of audio and the sixth audio is not the first type of audio; and controlling the fourth speaker to play a seventh audio and the sixth audio, where the seventh audio is obtained by adjusting a sound wave phase and a vibration amplitude of the fifth audio.
In some embodiments, the electronic device includes a first set, the first set includes a plurality of audio type identifiers, and an audio matching an audio type identifier in the first set is the first type of audio.
According to a second aspect, an embodiment of this application provides an electronic device, including one or more processors and a memory, where the memory is coupled to the processor, the memory is configured to store computer program code, the computer program code includes computer instructions, and when the one or more processors execute the computer instructions, the one or more processors are configured to: control, when it is determined that the first audio and the second audio are to be played, the first speaker to play the first audio, and control the second speaker to play the second audio; control, when a sound outlet hole of the first speaker is occluded, the first speaker to play the first audio that has been adjusted; or control the second speaker to play the first audio.
In some embodiments, before the controlling the first speaker to play the first audio that has been adjusted, the one or more processors are further configured to: adjust a sound wave phase and a vibration amplitude that correspond to the first audio.
In some embodiments, before the adjusting a sound wave phase and a vibration amplitude that correspond to the first audio, the one or more processors are further configured to: determine a first occlusion ratio corresponding to the sound outlet hole of the first speaker; and determine that the first occlusion ratio is less than a first threshold.
In some embodiments, before the adjusting a sound wave phase and a vibration amplitude that correspond to the first audio, the one or more processors are further configured to: determine that a preset priority of the second audio is higher than that of the first audio.
In some embodiments, before the controlling the second speaker to play the first audio, the one or more processors are further configured to: control the first speaker to stop playing the first audio.
In some embodiments, when the second speaker is controlled to play the first audio, the one or more processors are further configured to: control the second speaker to stop playing the second audio; and control the first speaker to play the second audio.
In some embodiments, before controlling the first speaker to stop playing the first audio, the one or more processors are further configured to: determine a first occlusion ratio corresponding to the sound outlet hole of the first speaker; and determine that the first occlusion ratio is not less than a first threshold.
In some embodiments, when the second speaker is controlled to play the first audio, the second speaker continues to play the second audio.
In some embodiments, an orientation of the sound outlet hole of the first speaker is the same as that of a sound outlet hole of the second speaker.
In some embodiments, the electronic device includes a third speaker and a fourth speaker, and the one or more processors are further configured to: detect, when both the third speaker and the fourth speaker play a third audio, that a sound outlet hole of the third speaker is occluded; control the third speaker to stop playing the third audio; and control the fourth speaker to play a fourth audio, where the fourth audio is obtained by adjusting a sound wave phase and a vibration amplitude of the third audio.
In some embodiments, an orientation of a sound outlet hole of the third speaker is the same as that of a sound outlet hole of the fourth speaker.
In some embodiments, the electronic device includes a third speaker and a fourth speaker, and the one or more processors are further configured to: detect, when both the third speaker and the fourth speaker play a fifth audio and a sixth audio, that a sound outlet hole of the third speaker is occluded; control the third speaker to play only the sixth audio when the fifth audio is marked as a first type of audio and the sixth audio is not the first type of audio; and control the fourth speaker to play a seventh audio and the sixth audio, where the seventh audio is obtained by adjusting a sound wave phase and a vibration amplitude of the fifth audio.
In some embodiments, the electronic device includes a first set, the first set includes a plurality of audio type identifiers, and an audio matching an audio type identifier in the first set is the first type of audio.
According to a third aspect, an embodiment of this application provides a computer storage medium, including computer instructions., where the computer instructions, when run on an electronic device, cause the electronic device to perform the method according to the foregoing first aspect and any possible embodiments.
According to a fourth aspect, this application provides a computer program product, where the computer program product, when run on the foregoing electronic device, causes the electronic device to perform the method according to the foregoing first aspect and any possible embodiments.
It may be understood that the electronic device, the computer storage medium, and the computer program product provided in the foregoing aspects are all applied to the foregoing corresponding method. Therefore, for beneficial effects that can be achieved by the electronic device, the computer storage medium, and the computer program product, references may be made to beneficial effects in the foregoing corresponding method. Details are not described herein again.

BRIEF DESCRIPTION OF DRAWINGS

FIG. 1 is a schematic diagram 1 of a tablet computer according to an embodiment of this application;
FIG. 2 is a schematic diagram 2 of a tablet computer according to an embodiment of this application;
FIG. 3 is a schematic diagram of a mobile phone according to an embodiment of this application;
FIG. 4 is a schematic diagram 1 of a scenario in which a user uses an electronic device according to an embodiment of this application;
FIG. 5 is a schematic diagram 2 of a scenario in which a user uses an electronic device according to an embodiment of this application;
FIG. 6 is a schematic diagram 3 of a scenario in which a user uses an electronic device according to an embodiment of this application;
FIG. 7 is a schematic structural diagram 1 of an electronic device according to an embodiment of this application;
FIG. 8 is a schematic structural diagram 2 of an electronic device according to an embodiment of this application;
FIG. 9 is a schematic diagram 1 of an electronic device controlling a speaker channel to play audios according to an embodiment of this application;
FIG. 10 is a schematic diagram 2 of an electronic device controlling a speaker channel to play audios according to an embodiment of this application;
FIG. 11 is a schematic diagram of a sound wave signal obtained by superimposing the sound wave signal with other sound waves before and after the sound wave signal is phase shifted according to an embodiment of this application;
FIG. 12 is a schematic diagram 3 of an electronic device controlling a speaker channel to play audios according to an embodiment of this application;
FIG. 13 is a schematic diagram 4 of an electronic device controlling a speaker channel to play audios according to an embodiment of this application;
FIG. 14 is a schematic diagram 5 of an electronic device controlling a speaker channel to play audios according to an embodiment of this application;
FIG. 15 is a schematic diagram 6 of an electronic device controlling a speaker channel to play audios according to an embodiment of this application;
FIG. 16 is a schematic diagram 7 of an electronic device controlling a speaker channel to play audios according to an embodiment of this application;
FIG. 17 is a schematic diagram 8 of an electronic device controlling a speaker channel to play audios according to an embodiment of this application;
FIG. 18 is a schematic diagram 9 of an electronic device controlling a speaker channel to play audios according to an embodiment of this application;
FIG. 19 is a flowchart of steps of a method for controlling a speaker according to an embodiment of this application; and
FIG. 20 is a schematic diagram of a chip system according to an embodiment of this application.

DESCRIPTION OF EMBODIMENTS

The terms "first" and "second" mentioned below are merely used for a purpose of description and shall not be construed as indication or implication of relative importance or implicit indication of the quantity of indicated technical features. Therefore, a feature defined by "first" or "second" may explicitly or implicitly include one or more features. In the descriptions of embodiments, unless otherwise stated, "a plurality of" means two or more.
With the development of technologies, hardware resources (such as a storage resource, a computing resource, and an input/output resource) configured in various electronic devices are also continuously iterated and upgraded, to provide higher-quality services to users.
An audio output module (for example, a speaker) of an electronic device is used as an example, as the audio output module is continuously iterated and upgraded, the quality of audio output services provided by the electronic device also increases.
For example, upgrade of the audio output module in the electronic device may include an increase in a speaker type. For example, a high frequency speaker and a low-configuration speaker are configured. In this way, audios of different frequencies may be played by different speakers, thereby improving playback quality of the audio.
For another example, upgrade of the audio output module in the electronic device may include an increase in a quantity of speakers. For example, a configuration of two speakers is iteratively upgraded to a configuration of four speakers, or upgraded to a configuration of eight speakers. In this way, more speakers can effectively expand a sound field of the electronic device and increase a three-dimensional feeling of a sound effect of the electronic device. For example, when a user uses the electronic device to play a game, the electronic device may simulate a more three-dimensional game sound effect through a plurality of speakers, so that the user can immersively experience a virtual game world.
In some embodiments, each speaker of the electronic device corresponds to one sound outlet hole. Sound outlet holes corresponding to different speakers have different positions on a housing of the electronic device.
In addition, for different types of electronic devices, there may be differences or similarities in arrangement manners of sound outlet holes of speakers.
In some embodiments, the foregoing electronic device may be an intelligent electronic device such as a mobile phone, a tablet computer, a handheld computer, a PC, a cellular phone, a personal digital assistant (personal digital assistant, PDA), a wearable device (such as a smartwatch), a smart large screen, a game console, and an augmented reality (augmented reality, AR)/a virtual reality (virtual reality, VR) device.
For example, the electronic device is the tablet computer, sound outlet holes of speakers may be deployed on left and right sides of the tablet computer.
For example, when eight speakers are configured in the tablet computer, sound outlet holes of four speakers may be provided on a left side edge of a housing of the tablet computer, and sound outlet holes of four speakers may also be deployed at a right side edge of the housing of the tablet computer. Each sound outlet hole corresponds to one speaker. It may be understood that a sound wave signal generated by the speaker when playing an audio needs to be emitted outward from a corresponding sound outlet hole. In this way, a position of the sound outlet hole on the housing may also be referred to as a configuration position of the speaker.
In other words, if the sound outlet hole corresponding to the speaker is located at the left side edge of the electronic device, it may be referred to that the speaker is deployed at the left side edge of the electronic device. Similarly, if the sound outlet hole corresponding to the speaker is located at the right side edge of the electronic device, it may be referred to that the speaker is deployed at the right side edge of the electronic device.
In addition, in the foregoing example, sound outlet holes are symmetrically provided on the left and right sides of the housing of the electronic device, so that the speakers can be symmetrically deployed on the left and right sides of the electronic device, to form left and right channels, thereby expanding the sound field of the electronic device.
For example, in four sound outlet holes provided on the left side edge of the electronic device, two sound outlet holes are provided on an upper side of the left side edge, and two sound outlet holes are provided on a lower side of the left side edge.
As shown in FIG. 1, there are sound outlet holes of two speakers at the upper side of the left side edge of the tablet computer, and there are also sound outlet holes of two speakers at the lower side of the left side edge of the tablet computer.
Similarly, in the four sound outlet holes provided on the right side edge, two sound outlet holes are provided on an upper side of the right side edge, and two sound outlet holes are provided on a lower side of the right side edge. As shown in FIG. 1, there are sound outlet holes of two speakers at the upper side of the right side edge of the tablet computer, and there are also sound outlet holes of two speakers at the lower side of the right side edge of the tablet computer.
In addition, the sound outlet hole located at the upper side of the left side edge is symmetrical to the sound outlet hole located at the upper side of the right side edge. The sound outlet hole located on the lower side of the left side edge is symmetrical to the sound outlet hole located on the lower side of the right side edge.
It should be noted that, the foregoing upper, lower, left, and right may be directions determined by using the housing of the tablet computer as a reference object. For example, when the tablet computer is rectangular, two relatively short edges on the housing of the tablet computer are respectively a left side edge and a right side edge, and two relatively long edges on the housing of the tablet computer are respectively an upper side edge and a lower side edge.
A part close to the upper side edge on the left side edge may be referred to as the upper side of the left side edge, and a part close to the lower side edge on the left side edge may be referred to as the lower side of the left side edge. Similarly, a part close to the upper side edge on the right side edge may be referred to as the upper side of the right side edge, and a part close to the lower side edge on the right side edge may be referred to as the lower side of the right side edge.
For another example, four sound outlet holes on the left side edge of the electronic device are provided on the lower side (or the upper side) of the left side edge, and the four sound outlet holes are adjacently arranged. Similarly, four sound outlet holes on the right side edge of the electronic device are provided on the lower side (or the upper side) of the right side edge, and the four sound outlet holes are adjacently arranged. For example, as shown in FIG. 2, there are sound outlet holes of four speakers at the lower side of the left side edge of the tablet computer, and sound outlet holes of four speakers at the lower side of the right side edge of the tablet computer.
For another example, the electronic device is the mobile phone, sound outlet holes of speakers may be deployed on upper and lower sides of the mobile phone.
For example, when eight speakers are configured in the mobile phone, four sound outlet holes may be provided on an upper side edge of a housing of the mobile phone, and four sound outlet holes may be provided on a lower side edge of the housing of the mobile phone. In this way, four speakers may be deployed on the upper side edge of the mobile phone, and four speakers are deployed on the lower side edge of the mobile phone. Speakers symmetrically deployed on the upper and lower side edges may also form left and right channels, thereby expanding the sound field of the electronic device. The speaker deployed on the left side of the upper side edge is symmetrical to the speaker deployed on the left side of the lower side edge. The speaker deployed on the right side of the upper side edge is also symmetrical to the speaker deployed on the right side of the lower side edge.
For example, in four speakers deployed on the upper side edge, two speakers are deployed on the left side of the upper side edge, and two speakers are deployed on the right side of the upper side edge. Similarly, in the four speakers deployed on the lower side edge, two speakers are deployed on the left side of the lower side edge, and two speakers are deployed on the right side of the lower side edge.
As shown in FIG. 3, there are sound outlet holes of two speakers at the left side of the upper side edge of the mobile phone, and there are sound outlet holes of two speakers at the right side of the upper side edge of the mobile phone. There are sound outlet holes of two speakers at the left side of the lower side edge of the mobile phone, and there are sound outlet holes of two speakers at the right side of the lower side edge of the mobile phone.
It should be noted that, the upper, lower, left, and right may be directions determined by using the housing of the mobile phone as a reference object. For example, two relatively short edges on the housing of the mobile phone are respectively an upper side edge and a lower side edge, and two relatively long edges on the housing of the mobile phone are respectively a left side edge and a right side edge.
On the housing of the mobile phone, a part close to the left side edge on the upper side edge may be referred to as the left side of the upper side edge, and a part close to the right side edge on the upper side edge may be referred to as the right side of the upper side edge. Similarly, a part close to the left side edge on the lower side edge may be referred to as the left side of the lower side edge, and a part close to the right side edge on the lower side edge may be referred to as the right side of the lower side edge.
In other possible embodiments, speakers of the tablet computer may also be deployed on the upper side edge and the lower side edge. Similarly, speakers of the mobile phone may also be deployed on the left side edge and the right side edge. This is not specifically limited in embodiments of this application.
In some embodiments, deploying the sound outlet hole of the speaker at a side edge (for example, an upper side edge, a lower side edge, a left side edge, or a right side edge) of the housing of the electronic device may expand the sound field of the electronic device, and may also enhance a three-dimensional feeling of the played audio. However, in a process of using the electronic device, the user usually uses a hand to hold the side edge of the electronic device. In this way, the sound outlet hole of the speaker is often occluded.
It may be understood that when an audio is played by the speaker, if the sound outlet hole of the speaker is occluded, the audio actually emitted by the speaker is affected, for example, volume is reduced, and a sound wave phase (which may be briefly referred to as an audio phase) corresponding to the audio is changed.
For example, the electronic device is the tablet computer. As shown in FIG. 4, when the user uses the tablet computer, a left hand holds the lower side of the left side edge of the tablet computer, and a right hand holds the lower side of the right side edge. In this way, not only a spatial position of the tablet computer can be fixed, but also the user can conveniently operate the tablet computer.
In a scenario in which a deployment position of speakers in the tablet computer is shown in FIG. 1, speakers deployed on the lower side of the left side edge and the lower side of the right side edge are inevitably occluded by the hand of the user. When the speakers at the lower side of the left side edge and the lower side of the right side edge are occluded, an effect of playing an audio by the tablet computer is affected.
For example, as shown in FIG. 5, when the tablet computer plays the same audio, if speakers at the lower side of the left side edge and the lower side of the right side edge of the tablet computer are occluded, the user feels, in auditory sense, that playback volumes corresponding to the speakers at the lower side of the left side edge and the lower side of the right side edge decrease.
For another example, when the tablet computer plays an audio, if speakers at the lower side of the left side edge and the lower side of the right side edge of the tablet computer are occluded, audio phases played by the occluded speakers change. In this way, after the audio is superimposed with an audio played by another speaker in the tablet computer, due to cancellation of the audio in some frequency bands, an entire audio phase also changes.
In this way, as shown in FIG. 6, before and after the speakers are occluded, as the entire audio phase changes, the user intuitively feels that a sound source position changes.
For example, when the user uses the tablet computer to play a shooting game, the tablet computer plays footstep sounds from a left side of a game world. If a speaker is unoccluded by a hand of the user, a source of the footstep sound heard by the user is located at a left side of the user. If a speaker is occluded by a hand of the user, a source of the footstep sound heard by the user may deviate to a left front side of the user. Definitely, the tablet computer cannot accurately present a game sound effect at this time, which affects user experience.
In addition, in addition to that when the user uses the electronic device, the sound outlet hole of the speaker is occluded by the hand, a problem that an audio actually generated by the speaker is affected also occurs when a foreign object is blocked in the sound outlet hole of the speaker, or the sound outlet hole is occluded due to an improper protective housing configured in the electronic device.
To improve the foregoing problem, an embodiment of this application provides a method for controlling a speaker. The method for controlling a speaker is applied to an electronic device configured with a plurality of speakers. In this way, the electronic device may adjust, according to an occlusion situation (for example, whether there is occlusion or not, for another example, whether there is blockage or not, for another example, a degree of occlusion, and for another example, a blockage situation) of the sound outlet hole of the speaker, an audio played by at least one speaker in the electronic device, for example, adjust audio content played by the speaker, for another example, adjust an audio phase and audio energy played by the speaker. After the audio phase is adjusted, a phase of a sound wave signal corresponding to the audio changes. After the audio energy is adjusted, a vibration amplitude of the sound wave corresponding to the audio also changes.
It may be understood that, the electronic device may compensate for an impact of the speaker being occluded on a playback effect of an audio by adjusting the audio played by the speaker. For a compensation principle, refer to descriptions in subsequent embodiments, and details are not described herein again. In this way, not only intelligence of the electronic device in an aspect of audio playback is improved, but also user experience can be improved.
FIG. 7 is a schematic structural diagram of an electronic device 100 according to an embodiment of this application.
As shown in FIG. 7, the electronic device 100 may include: a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (universal serial bus, USB) interface 130, a charging management module 140, a power management unit 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a phone receiver 170B, a microphone 170C, a headset jack 170D, a sensor module 180, a key 190, a motor 191, an indicator 192, a camera 193, a display screen 194, a subscriber identification module (subscriber identification module, SIM) card interface 195, and the like.
The foregoing sensor module 180 may include sensors such as a pressure sensor, a gyroscope sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a distance sensor, an optical proximity sensor, a fingerprint sensor, a temperature sensor, a touch sensor, an ambient light sensor, and a bone conduction sensor.
It may be understood that the structure shown in this embodiment constitutes no specific limitation on the electronic device 100. In some other embodiments of this application, the electronic device 100 may include more or fewer components than those shown in the figure, or some components may be combined, or some components may be split, or components are arranged in different manners. The components shown in the figure may be implemented by hardware, software, or a combination of software and hardware.
The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (application processor, AP), a modem processor, a graphics processing unit (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), a controller, a memory, a video codec, a digital signal processor (digital signal processor, DSP), a baseband processor, and/or a neural-network processing unit (neural-network processing unit, NPU). Different processing units may be independent components, or may be integrated into one or more processors.
The controller may be a nerve center and a command center of the electronic device 100. The controller may generate an operation control signal according to instruction operation code and a time-sequence signal, to complete control of fetching instructions and executing the instructions.
A memory may further be arranged in the processor 110, and is configured to store instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may store instructions or data that are/is recently used or cyclically used by the processor 110. If the processor 110 needs to use the instructions or the data again, the processor 110 may directly invoke the instructions or the data from the memory, repeated access is avoided, and waiting time of the processor 110 is reduced, thereby improving system efficiency.
In some embodiments, the processor 110 may include one or more interfaces. The interface may include an inter-integrated circuit (inter-integrated circuit, I2C) interface, an inter-integrated circuit sound (inter-integrated circuit sound, I2S) interface, a pulse code modulation (pulse code modulation, PCM) interface, a universal asynchronous receiver/transmitter (universal asynchronous receiver/transmitter, UART) interface, a mobile industry processor interface (mobile industry processor interface, MIPI), a general-purpose input/output (general-purpose input/output, GPIO) interface, a subscriber identity module (subscriber identity module, SIM) interface, a universal serial bus (universal serial bus, USB) interface, and the like.
It may be understood that an interface connection relationship between modules shown in this embodiment is merely an example for description, and constitutes no limitation on the structure of the electronic device 100. In some other embodiments, the electronic device 100 may alternatively use an interface connection manner different from that in the foregoing embodiment, or use a combination of a plurality of interface connection manners.
The electronic device 100 implements a display function by using the GPU, the display screen 194, the application processor, and the like. The GPU is a microprocessor for image processing, and is connected to the display screen 194 and the application processor. The GPU is configured to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs that execute program instructions to generate or change display information.
The external memory interface 120 may be configured to connect to an external storage card such as a Micro SD card, to expand a storage capability of the electronic device 100. The external storage card communicates with the processor 110 by using the external memory interface 120, to implement a data storage function, for example, store files such as music or a video in the external storage card.
The internal memory 121 may be configured to store computer-executable program code, and the executable program code includes instructions. The internal memory 121 may include a program storage region and a data storage region. The program storage region may store an operating system, an application program required by at least one function (for example, a sound playback function or an image playback function), and the like. The data storage region may store data (for example, audio data and an address book) and the like created when the electronic device 100 is used. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, for example, at least one magnetic disk memory, a flash memory device, or a universal flash storage (universal flash storage, UFS). The processor 110 runs the instructions stored in the internal memory 121, and/or the instructions stored in the memory arranged in the processor, to perform various function applications and data processing of the electronic device 100.
The display screen 194 is configured to display an image, a video, and the like. The display screen 194 includes a display panel. The display panel may be a liquid crystal display (liquid crystal display, LCD), an organic light-emitting diode (organic light-emitting diode, OLED), an active-matrix organic light emitting diode (active-matrix organic light emitting diode, AMOLED), a flexible light-emitting diode (flex light-emitting diode, FLED), a Miniled, a MicroLed, a Micro-oLed, quantum dot light emitting diodes (quantum dot light emitting diodes, QLED), and the like.
The electronic device 100 may implement a photographing function by using the ISP, the camera 193, the video codec, the GPU, the display screen 194, the application processor, and the like.
The ISP is configured to process data fed back by the camera 193. For example, during photographing, a shutter is enabled. Light is transmitted to a photosensitive element of the camera through a lens, and an optical signal is converted into an electrical signal. The photosensitive element of the camera transmits the electrical signal to the ISP for processing, and the electrical signal is converted into an image visible to a naked eye. The ISP may also perform algorithm optimization on noise, brightness, and skin tone of the image. The ISP may also optimize parameters such as exposure and color temperature of a photographing scenario. In some embodiments, the ISP may be arranged in the camera 193.
The camera 193 is configured to capture a static image or a video. An optical image is generated for an object by using the lens and is projected onto the photosensitive element. The photosensitive element may be a charge coupled device (charge coupled device, CCD) or a complementary metal-oxide-semiconductor (complementary metal-oxide-semiconductor, CMOS) phototransistor. The photosensitive element converts an optical signal into an electrical signal, and then transfers the electrical signal to the ISP, to convert the electrical signal into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard format such as RGB and YUV. In some embodiments, the electronic device 100 may include one or N cameras 193, and N is a positive integer greater than 1.
The digital signal processor is configured to process a digital signal, and in addition to a digital image signal, the digital signal processor may further process another digital signal. For example, when the electronic device 100 performs frequency selection, the digital signal processor is configured to perform Fourier transform and the like on frequency energy.
The video codec is configured to compress or decompress a digital video. The electronic device 100 may support one or more video codecs. In this way, the electronic device 100 may play or record videos in a plurality of encoding formats, for example, moving picture experts group (moving picture experts group, MPEG) 1, MPEG 2, MPEG 3, and MPEG 4.
The NPU is a neural-network (neural-network, NN) computing processor that quickly processes input information by referring to a structure of a biological neural network, for example, a transmission mode between neurons in a human brain, and may continuously further perform self-learning. The NPU may be used to implement an application such as intelligent cognition of the electronic device 100, for example, image recognition, facial recognition, speech recognition, and text understanding.
In some embodiments, a large quantity of core components in the electronic device, for example, a processor (a central processing unit, a graphics processing unit, and the like), an internal memory, and a plurality of types of host controls, may be integrated into a main chip. High integration of the main chip helps reduce physical space of the electronic device, and satisfies current requirements of users for pursuing lightweight and portability of the electronic device.
In some embodiments, the foregoing main chip is integrated with the host control configured to manage a speaker, referred to as a speaker controller for short. In addition, the main chip may further correspond to a plurality of audio digital interfaces, such as a time division multiplexing (time division multiplexing, TDM) digital interface. Each audio digital interface corresponds to one speaker. In other words, the speaker configured in the electronic device may be connected to the speaker controller by using the audio digital interface, and receive control instructions sent by the speaker controller. In this way, the speaker controller may control audios played by speakers.
For example, if eight speakers are configured in the electronic device shown in FIG. 8, the main chip of the electronic device may provide at least eight audio digital interfaces. For example, the main chip provides an audio digital interface 1, an audio digital interface 2, an audio digital interface 3, an audio digital interface 4, an audio digital interface 5, an audio digital interface 6, an audio digital interface 7, and an audio digital interface 8. A speaker is connected to each of the foregoing eight audio digital interfaces. Each audio digital interface and the speaker connected to the interface can form a speaker channel.
In some embodiments, the electronic device may group speaker channels corresponding to a plurality of speakers. For example, speaker channels corresponding to at least two speakers are grouped together. In this way, speakers belonging to the same group are used to play the same audio data.
For example, as shown in FIG. 8, when four high frequency speakers and four low frequency speakers are included in the eight speakers of the electronic device, speaker channels corresponding to one high frequency speaker and one low frequency speaker may be grouped together.
For example, the audio digital interface 1 and one low frequency speaker form one speaker channel, the audio digital interface 2 and one high frequency speaker form one speaker channel, and speaker channels corresponding to the audio data interface 1 and the audio digital interface 2 are grouped together. Similarly, speaker channels corresponding to the audio digital interface 3 and the audio digital interface 4 may be grouped together, speaker channels corresponding to the audio digital interface 5 and the audio digital interface 6 may be grouped together, and speaker channels corresponding to the audio digital interface 7 and the audio digital interface 8 may be grouped together.
In this way, when audio data includes a high frequency part and a low frequency part, high frequency speakers in the same group play (play) the high frequency part in the audio data, and low frequency speakers in the same group play the low frequency part in the audio data.
In some embodiments, grouping of speaker channels may be pre-configured, and sound outlet holes of speakers corresponding to the same group of speaker channels are adjacently arranged on the electronic device.
For example, when the electronic device is the tablet computer shown in FIG. 1, speakers at the lower side of the left side edge of the tablet computer may be grouped together, speakers at the upper side of the left side edge of the tablet computer may be grouped together, speakers at the lower side of the right side edge of the tablet computer may be grouped together, and speakers at the upper side of the right side edge of the tablet computer may be grouped together.
In some embodiments, the electronic device may control, by using the main chip, audios that need to be played by each group of speaker channels, or may control energy, a phase, and the like of an audio that needs to be played by each speaker.
It may be understood that when a specific service requirement is detected, the electronic device may play corresponding audio data according to the service requirement. The foregoing specific service requirement may be a service requirement for instructing to play an audio.
For example, the foregoing specific service requirement may be a service requirement generated when triggered by a user operation or service logic of an application program during running of the application program by the electronic device.
For example, a video application is an application program that can play video data a, and the video data a includes audio data a. In this way, when the video application is run, the user performs an operation of instructing to play the video data a, and the electronic device may determine that currently there is a service requirement for playing the audio data a. The service requirement may instruct the electronic device to play the audio data a.
For another example, after starting a game application having a game sound effect, the electronic device may determine that currently there is a service requirement for playing game audio data. The service requirement may instruct the electronic device to play corresponding game audio data.
For another example, a service logic of a social application includes providing a ringing reminder for social information. In this way, when the social application is run and the social information is received, the electronic device may determine that currently there is a service requirement for playing a ring audio. The service requirement may instruct the electronic device to play the ring audio.
In some scenarios, the audio data that the electronic device needs to play may be a single audio, for example, a ring audio.
In a scenario in which audio data played by the electronic device is the single audio, the electronic device may control, by using the main chip, all speaker channels to play the audio, that is, audio content played by all speaker channels is the same. In addition, the electronic device may further control, by using the main chip, an audio phase, audio energy, and the like of audio data played back by each speaker, so that the electronic device can achieve an ideal sound effect when playing the audio data. For a specific implementation, refer to related technology, and details are not described herein again.
In some other scenarios, the audio data that the electronic device needs to play may alternatively be data of a combination of a plurality of types of audios, and different types of audios may correspond to different audio content. For example, game audio data including one or more of background sound, a footstep sound effect, and a gunshot sound effect. For another example, the audio data a including one or more of background sound and a line sound effect.
In a scenario in which audio data played by the electronic device is data of a combination of the plurality of types of audios, the electronic device may determine, from the audio data, an audio that needs to be played by each group of speaker channels, and control, by using the main chip, each group of speaker channels to play a corresponding audio. In each group of speaker channels, a plurality of groups of speaker channels may correspond to the same audio, or different groups of speaker channels may correspond to different audios.
In some embodiments, audios played by speaker channels configured on the same side edge of the electronic device are the same, and audios played by speaker channels configured on different side edges of the electronic device are different.
For example, the electronic device is the tablet computer. As shown in FIG. 9, audio data played by the tablet computer includes a regular sound effect, a specific sound effect 1, and a specific sound effect 2.
The foregoing specific sound effect 1 and specific sound effect 2 are both specific sound effects. The specific sound effect may be a sound effect of a preselected type. It may be understood that the specific sound effect is an important audio in the audio data, or may be an audio whose playback effect is not expected to be affected by the user.
For example, the audio data is game audio data of a shooting game, and the game audio data includes background sound, a footstep sound effect, a gunshot sound effect, and the like. If a sound effect of the preselected type includes the footstep sound effect and the gunshot sound effect, it may be determined that both the footstep sound effect and the gunshot sound effect occurring in the game audio data are specific sound effects. A footstep sound effect and a gunshot sound effect that are from a left side of the game world are determined as the specific sound effect 1. A footstep sound effect and a gunshot sound effect from a right side of the game world are determined as the specific sound effect 2.
In addition, the foregoing regular sound effect may refer to another audio other than the specific sound effect. In the foregoing example, the regular sound effect in the game audio data may be the background sound.
In some examples, the electronic device may be configured with a first set, and the first set includes a plurality of audio types. For example, the first set includes audio types such as a footstep sound effect, a gunshot sound effect, and a dialogue sound effect.
For example, the first set may be a configuration file for recording the specific sound effect in the application program, and the configuration file includes a type identifier of at least one type of sound effect. In this way, when the configuration file of the application program is parsed, the first set corresponding to the application program may be obtained. For example, in the configuration file of the shooting game, the first set obtained through parsing may include the footstep sound effect and the gunshot sound effect. For another example, in the configuration file of the video application, the first set obtained through parsing includes the dialogue sound effect and the like.
For another example, the first set may alternatively be a configuration file for recording the specific sound effect in a system file.
In some embodiments, a sound effect matching the type identifier in the first set is the specific sound effect. The electronic device defaults that a preset priority corresponding to an audio that belongs to the specific sound effect is higher than a preset priority corresponding to an audio that does not belong to the specific sound effect. Definitely, in other possible embodiments, a list may be pre-configured in the electronic device. The list includes a plurality of types of audios and corresponding priorities. In this way, priorities corresponding to various types of audios may be determined through table lookup.
The priority corresponding to the foregoing audio has a high reference value when it is determined whether to exchange speakers corresponding to the audio, and a playback effect corresponding to the audio with a higher priority is ensured to some extent.
In the foregoing example, the speaker channel at the left side edge of the tablet computer may be used to play the regular sound effect and the specific sound effect 1. For example, when the regular sound effect needs to be played, the main chip controls the speaker channel at the left side edge to play the regular sound effect. In this case, a sound wave signal actually played by the speaker channel is a sound wave signal corresponding to a regular audio. Similarly, when the specific sound effect 1 needs to be played, the main chip controls the speaker channel at the left side edge to play the specific sound effect 1. In this case, a sound wave signal actually played by the speaker channel is a sound wave signal corresponding to the specific sound effect 1. When the regular sound effect and the specific sound effect 1 need to be simultaneously played, after mixing the regular sound effect and the specific sound effect 1, the main chip may control the speaker channel at the left side edge to play. In this case, a sound wave signal actually played by the speaker channel is a sound wave signal corresponding to the foregoing sound mixing.
In addition, the speaker channel at the right side edge of the tablet computer may be used to play the regular sound effect and the specific sound effect 2. For example, when the regular sound effect needs to be played, the main chip controls the speaker channel at the right side edge to play the regular sound effect. In this case, a sound wave signal actually played by the speaker channel is a sound wave signal corresponding to a regular audio. Similarly, when the specific sound effect 1 needs to be played, the main chip controls the speaker channel at the right side edge to play the specific sound effect 1. In this case, a sound wave signal actually played by the speaker channel is a sound wave signal corresponding to the specific sound effect 1. When the regular sound effect and the specific sound effect 1 need to be simultaneously played, after mixing the regular sound effect and the specific sound effect 1, the main chip may control the speaker channel at the right side edge to play. In this case, a sound wave signal actually played by the speaker channel is a sound wave signal corresponding to the foregoing sound mixing.
As shown in FIG. 9, speaker channels in the tablet computer have been grouped. In FIG. 9, "Regular sound effect + Specific sound effect 1" or "Regular sound effect + Specific sound effect 2" displayed relative to each group of speaker channels indicates an audio that needs to be cooperatively played by the group of speaker channels.
In addition, in a specific scenario, the audio played by the speaker channel at the left side edge and the audio played by the speaker channel at the right side edge may be interchanged. For example, the specific scenario may be that the tablet computer is rotated, so that a speaker at an original left side edge is oriented to a right side of the user, and a speaker at an original right side edge is oriented to a left side of the user. For example, for the tablet computer shown in FIG. 9, when it is detected that the tablet computer is rotated by 180 degrees, that is, the speaker at the original left side edge is oriented to the right side of the user, and the speaker at the original right side edge is oriented to the left side of the user, a speaker channel at the original left side edge plays the regular sound effect and the specific sound effect 2, and a speaker channel at the original right side edge plays the regular sound effect and the specific sound effect 1.
In some other embodiments, the audio played by speaker channels configured at the same side edges in the electronic device may also be different.
Continuously, for example, the electronic device is the tablet computer. As shown in FIG. 10, when the audio data played by the tablet computer includes the background sound, the specific sound effect 1, and the specific sound effect 2, the specific sound effect 1 may be played by a speaker channel at the lower side of the left side edge of the tablet computer, and the background sound may be played by a speaker channel at the upper side of the left side edge of the tablet computer. In addition, the specific sound effect 2 may be played by a speaker channel at the lower side of the right side edge of the tablet computer, and the background sound may be played by a speaker channel at the upper side of the right side edge of the tablet computer.
In summary, in embodiments of this application, when the electronic device needs to play audio data, the electronic device may identify various specific sound effects from the audio data. Then, a specific speaker channel is controlled to play a specific sound effect. In some examples, a single specific speaker channel may be used to play at least one type of specific sound effect. Definitely, the speaker channel may also be used to play the regular sound effect. In other words, similar to what is shown in FIG. 9, the speaker channel not only can play the specific sound effect, but also can play the regular sound effect. In some other examples, the single specific speaker channel is only used to play the specific sound effect, and the regular sound effect is played through another speaker channel. In other words, similar to that shown in FIG. 10, the specific speaker channel is only used to play the specific sound effect, and another speaker channel is used to play the regular sound effect.
In addition, the foregoing specific speaker channel may be a speaker channel that conforms to a preset rule and that is in the electronic device. For example, the speaker channel that satisfies the preset rule may be any one of the following:

(1) In speaker channels at the same side edge, a speaker is located on a speaker channel at a lower side of the same side edge.
(2) In speaker channels at the same side edge, a speaker is located on a speaker channel on an upper side of the same side edge.
(3) All speaker channels in the electronic device.
(4) A speaker channel to which an audio digital interface marked with a specific identifier belongs. The foregoing specific identifier of the audio digital interface may be pre-configured. For example, the configuration may be performed by a developer of the electronic device, or may be performed by a user of the electronic device. This is not specifically limited in embodiments of this application.

In addition, the foregoing specific identifier may further include a plurality of types of specific identifiers, for example, a left channel specific identifier and a right channel specific identifier.

In an implementation, a mapping relationship table between an audio digital interface and a specific identifier is configured in the electronic device. The electronic device may play a specific sound effect through a specific speaker channel and play a regular sound effect through another speaker channel according to a pre-configured mapping relationship table. For example, a mapping relationship is shown in Table 1:

Table 1

Audio digital interface	Specific identifier
Audio data interface 1	Left channel specific identifier
Audio data interface 2	Left channel specific identifier
Audio data interface 3	"None" identifier
Audio data interface 4	"None" identifier
Audio data interface 5	"None" identifier
Audio data interface 6	"None" identifier
Audio data interface 7	Right channel specific identifier
Audio data interface 8	Right channel specific identifier

As shown in Table 1, the mapping relationship table includes all audio data interfaces in the electronic device, for example, the audio data interface 1 to the audio data interface 8. In addition, the mapping relationship table further includes audio data interfaces marked with specific identifiers, for example, an audio data interface 1, an audio data interface 2, an audio data interface 7, and an audio data interface 8. The foregoing mapping relationship table further includes types of specific identifiers corresponding to audio data interfaces. For example, the audio data interface 1 and the audio data interface 2 correspond to the left channel specific identifier, and the audio data interface 7 and the audio data interface 8 correspond to the right channel specific identifier
In the foregoing implementation, the electronic device may further respond to an operation of the developer or the user, to adjust a correspondence between the audio data interface and each type of specific identifier in the mapping relationship table, to configure the specific identifier corresponding to the audio data interface.
In addition, when the specific identifier includes a plurality of types, the electronic device may further determine, according to a type of the specific identifier, a speaker channel used to play various types of specific sound effects. For example, when playing the game audio data, the electronic device determines to use a speaker channel having the left channel specific identifier to play the specific sound effect from a left side of a game character in the game world, for example, a footstep from the left side. For another example, when playing the game audio data, the electronic device determines to use a speaker channel having the right channel specific identifier to play a specific sound effect from a right side of the game character in the game world, for example, a footstep from the right side.
In an implementation, the electronic device may further pre-configure a correspondence 1 between different types of specific sound effects and various types of specific identifiers. In this way, after the electronic device determines that any type of specific sound effect, for example, referred to as a specific sound effect a, needs to be played, the electronic device may determine, according to the foregoing correspondence 1, a specific identifier corresponding to the specific sound effect a, for example, referred to as a specific identifier a. Then, an audio data interface a corresponding to the specific identifier a is determined with reference to the mapping relationship table. In this way, a speaker channel corresponding to the audio data interface a may be controlled to play the specific sound effect a.
In some embodiments, when playing audio data, if it is detected that the speaker is occluded, the electronic device may adjust the audio played by one or more groups of speaker channels.
In an exemplary scenario, when the user occludes a sound outlet hole of a speaker on the housing of the electronic device by using the hand, the electronic device can detect that the speaker channel is occluded. It may be understood that for an implementation of detecting, by the electronic device, whether the speaker channel is occluded, refer to the related art. For example, whether the speaker channel is occluded and a degree of occlusion are determined by detecting an impedance value corresponding to the speaker. Specific implementation details are not described herein again.
In an exemplary scenario, when the sound outlet hole of the speaker is blocked by the foreign object, the electronic device may also identify that the speaker channel is occluded.
In some embodiments, the electronic device adjusts the audio played by the one or more groups of speaker channels in a plurality of manners:
In a first manner, the electronic device may adjust only the audio played by a speaker channel in which occlusion is performed (that is, a speaker channel whose speaker is occluded, which may be subsequently referred to as a speaker channel a). For example, audio energy and an audio phase of the audio played by the group of speaker channels a are adjusted.
It may be understood that when the speaker channel is occluded or blocked, even if the same audio is played, a sound wave signal actually played by a corresponding speaker channel changes, for example, the phase changes, and the vibration amplitude also changes. As a result of these changes, for the user, the volume heard may be reduced, and a perceived sound source position may also be changed.
As shown in FIG. 11, when the speaker channel a is unoccluded or blocked, and when the speaker channel a plays a corresponding audio, a sound wave signal a actually played is superimposed with a sound wave signal b played by another speaker channel, to obtain a sound wave signal c. When the speaker channel a is occluded or blocked, a phase of the audio played by the speaker channel a may be shifted, that is, a phase of the sound wave signal a actually played by the speaker channel a may be changed. In addition, the phase-shifted sound wave signal a and sound wave signal b are superimposed to obtain a sound wave signal d.
As shown in FIG. 11, a phase between the sound wave signal d and an original sound wave signal c also change. In addition, after the phase of the sound wave signal a changes, sound waves in some frequency bands of the sound wave signal a and the sound wave signal b cancel, and a vibration amplitude of the sound wave signal d obtained after superposition is smaller than that of the sound wave signal c.
In this case, when modulating the audio that needs to be played by the speaker channel a, the electronic device may adjust a phase of the audio, so as to compensate for a phase shift caused by occlusion of the speaker channel a. For example, after the speaker channel a is occluded, the audio actually played is shifted by a phase of half π. Therefore, when the audio played by the speaker channel a needs to be modulated, the phase of half π needs to be compensated.
In addition, as shown in FIG. 11, when the speaker channel a is occluded or blocked, and the speaker channel a plays a corresponding audio, a vibration amplitude of the sound wave signal a actually played is also attenuated.
In this case, when modulating the audio that needs to be played by the speaker channel a, the electronic device may adjust audio energy of the audio, so as to compensate for vibration amplitude attenuation caused by occlusion of the speaker channel a.
In other words, in embodiments of this application, the electronic device may adjust, in a manner such as adjusting the audio phase and the audio energy, the sound wave signal actually played by the speaker channel a to a state in which the speaker channel a is unoccluded before. In addition, in some other embodiments, the sound wave signal actually played by the speaker channel a may also be adjusted, in a manner of adjusting an audio in the related art, to a state in which the speaker channel a is unoccluded before. This is not specifically limited in embodiments of this application. In this way, for the user, whether the speaker channel is occluded does not affect the sound heard by the user.
For example, the electronic device is the tablet computer shown in FIG. 9.
As shown in FIG. 12, when no speaker channel is occluded or blocked, a group of speaker channels configured at the upper side of the left side edge of the tablet computer are used to play the regular sound effect and/or the specific sound effect 1. A group of speaker channels configured at the lower side of the left side edge of the tablet computer are also used to play the regular sound effect and/or the specific sound effect 1. A group of speaker channels configured at the upper side of the right side edge of the tablet computer are used to play the regular sound effect and/or the specific sound effect 2. A group of speaker channels configured at the lower side of the right side edge of the tablet computer are also used to play the regular sound effect and/or the specific sound effect 2.
As shown in FIG. 12, when the group of speaker channels at the lower side of the left side edge are occluded or blocked, that is, when the group of speaker channels at the lower side of the left side edge are speaker channels a, audios played by the group of speaker channels at the lower side of the left side edge are adjusted, that is, the speaker channel is controlled to play the adjusted regular sound effect and/or the specific sound effect 1.
As shown in FIG. 12, when speakers in a group of speaker channels at the lower side of the right side edge are occluded or blocked, that is, when a group of speaker channels at the lower side of the right side edge are speaker channels a, audios played by the group of speaker channels at the lower side of the right side edge are adjusted, that is, the speaker channel is controlled to play the adjusted regular sound effect and/or the specific sound effect 2.
It may be understood that the foregoing adjustment may include adjustment of the audio phase, the audio energy, and the like. For the audio phase and the audio energy, sound wave signals actually played before and after the speaker channel is occluded are similar (for example, a corresponding phase and a vibration amplitude are close to be equal), and volumes actually heard by the user are not changed.
Definitely, FIG. 12 exemplarily shows a scenario in which speaker channels at a lower side of a left side edge and a lower side of a right side edge belong to a speaker channel a. It may be understood that in a scenario in which speakers in another group of speaker channels are occluded or blocked, a processing manner is the same, and details are not described herein again.
In a second manner, the electronic device may pause the use of the group of speaker channels a, and adjust the audio played by a speaker channel (for example, referred to as a speaker channel b) that is on the same side and that is unoccluded.
The adjusting the audio played by a speaker channel b may include adjusting an audio phase and audio energy of the played audio. In addition, the adjusting the audio played by a speaker channel b may further include adjusting the played audio content.
Example 1: For example, the electronic device is a tablet computer shown in FIG. 9. As shown in FIG. 13, when no speaker is occluded or blocked, a group of speaker channels configured at the upper side of the left side edge of the tablet computer are used to play the regular sound effect and/or the specific sound effect 1. A group of speaker channels configured at the lower side of the left side edge of the tablet computer are also used to play the regular sound effect and/or the specific sound effect 1. A group of speaker channels configured at the upper side of the right side edge of the tablet computer are used to play the regular sound effect and/or the specific sound effect 2. A group of speaker channels configured at the lower side of the right side edge of the tablet computer are also used to play the regular sound effect and/or the specific sound effect 2.
As shown in FIG. 13, when speakers in a group of speaker channels at the lower side of the left side edge are occluded or blocked, that is, when a group of speaker channels configured at the lower side of the left side edge are speaker channels a, playback of the audio is paused in the group of speaker channels at the lower side of the left side edge. In addition, a group of speaker channels configured at the upper side of the left side edge, that is, the speaker channel b plays the adjusted regular sound effect and/or the specific sound effect 1.
As shown in FIG. 13, when speakers in a group of speaker channels at the lower side of the right side edge are occluded or blocked, that is, when a group of speaker channels at the lower side of the right side edge are speaker channels a, playback of the audio is paused in the group of speaker channels at the lower side of the right side edge. In addition, a group of speaker channels configured at the upper side of the right side edge, that is, the speaker channel b plays the adjusted regular sound effect and/or the specific sound effect 2.
The adjustment mentioned in the foregoing example 1 may include adjustment in the audio phase, the audio energy, and the like.
It may be understood that before the speaker channel a is occluded or blocked, sound wave signals actually played by the speaker channel a and a corresponding speaker channel b are superimposed to obtain a sound wave signal e. After the speaker channel a is occluded or blocked, sound wave signals actually played by the speaker channel a and the corresponding speaker channel b are superimposed to obtain a sound wave signal f. By adjusting an audio phase and audio energy of an audio that needs to be played by the speaker channel b, a phase difference and a vibration amplitude difference between the sound wave signal e and the sound wave signal f can both be reduced. In addition, the volume actually heard by the user may also not unchanged.
Example 2: For example, the electronic device is a tablet computer shown in FIG. 10. As shown in FIG. 14, when no speaker channel is occluded or blocked, a group of speaker channels configured at the upper side of the left side edge of the tablet computer are used to play the regular sound effect. A group of speaker channels configured at the lower side of the left side edge of the tablet computer are used to play the specific sound effect 1. A group of speaker channels configured at the upper side of the right side edge of the tablet computer are used to play the regular sound effect. A group of speaker channels configured at the lower side of the right side edge of the tablet computer are also used to play the specific sound effect 2.
As shown in FIG. 14, when a group of speaker channels at the lower side of the left side edge are occluded or blocked, that is, when a group of speaker channels at the lower side of the left side edge are speaker channels a, playback of the audio is paused in the group of speaker channels at the lower side of the left side edge. In addition, a group of speaker channels configured at the upper side of the left side edge, that is, the speaker channel b plays the adjusted regular sound effect and/or the specific sound effect 1. In other words, for the speaker channel b that originally does not need to play the specific sound effect 1, when the speaker channels at the lower side of the left side edge are occluded or blocked, in addition to playing the regular sound effect, the specific sound effect 1 further needs to be played. In this way, the electronic device adjusts audio content played by the corresponding speaker channel b.
As shown in FIG. 14, when speakers in a group of speaker channels at the lower side of the right side edge are occluded or blocked, that is, when a group of speaker channels at the lower side of the right side edge are speaker channels a, playback of the audio is paused in the group of speaker channels at the lower side of the right side edge. In addition, a group of speaker channels configured at the upper side of the right side edge, that is, the speaker channel b plays the adjusted regular sound effect and/or the specific sound effect 2. In other words, for the speaker channel b that originally does not need to play the specific sound effect 2, when speaker channels at the lower side of the right side edge are occluded, in addition to playing the regular sound effect, the specific sound effect 2 further needs to be played. In this way, the electronic device adjusts audio content played by the corresponding speaker channel b.
In a third manner, when the audio played by the group of speaker channels a includes the specific sound effect, the electronic device not only can adjust the audio played by the speaker channel a, but also can adjust the audio played by an unoccluded speaker channel (for example, referred to as a speaker channel b) that is on the same side as the speaker channel a. If an unoccluded speaker channel that is on the same side as the speaker channel a does not exist, the audio played by any unoccluded speaker channel may further be adjusted.
For example, the electronic device is a tablet computer shown in FIG. 9. As shown in FIG. 15, when no speaker channel is occluded or blocked, a group of speaker channels configured at the upper side of the left side edge of the tablet computer are used to play the regular sound effect and/or the specific sound effect 1. A group of speaker channels configured at the lower side of the left side edge of the tablet computer are also used to play the regular sound effect and/or the specific sound effect 1. A group of speaker channels configured at the upper side of the right side edge of the tablet computer are used to play the regular sound effect and/or the specific sound effect 2. A group of speaker channels configured at the lower side of the right side edge of the tablet computer are also used to play the regular sound effect and/or the specific sound effect 2.
As shown in FIG. 15, when a group of speaker channels at the lower side of the left side edge are occluded or blocked, that is, when a group of speaker channels configured at the lower side of the left side edge are speaker channels a, the group of speaker channels at the lower side of the left side edge no longer play the specific sound effect 1, but the speaker channel may further continue to play the regular sound effect. In addition, a group of speaker channels configured at the upper side of the left side edge, that is, the corresponding speaker channel b plays the adjusted regular sound effect and/or the specific sound effect 1.
For example, when only the regular audio is played, no processing is performed; when only the specific sound effect 1 is played, a sound wave phase and a vibration amplitude corresponding to the specific sound effect 1 are adjusted and played; and when the specific sound effect 1 and the regular audio need to be simultaneously played, after the regular audio and the specific sound effect 1 are mixed, a sound wave phase and a vibration amplitude corresponding to the sound mixing are adjusted and played. In this way, the electronic device adjusts audios that need to be played by the speaker channel a and the corresponding speaker channel b.
As shown in FIG. 15, when a group of speaker channels at the lower side of the right side edge are occluded or blocked, that is, when the group of speaker channels at the lower side of the right side edge are speaker channels a, the group of speaker channels at the lower side of the right side edge no longer play the specific sound effect 2, but the speaker channel may continue to play the regular sound effect In addition, a group of speaker channels configured at the upper side of the right side edge, that is, the speaker channel b plays the adjusted regular sound effect and/or the specific sound effect 2.
For example, when only the regular audio is played, no processing is performed; when only the specific sound effect 2 is played, a sound wave phase and a vibration amplitude corresponding to the specific sound effect 2 are adjusted and played; and when the specific sound effect 2 and the regular audio need to be simultaneously played, after the regular audio and the specific sound effect 2 are mixed, a sound wave phase and a vibration amplitude corresponding to the sound mixing are adjusted and played. In this way, the electronic device adjusts audios that need to be played by the speaker channel a and the corresponding speaker channel b.
For example, the electronic device is a tablet computer shown in FIG. 10. As shown in FIG. 16, when no speaker channel is occluded or blocked, a group of speaker channels configured at the upper side of the left side edge of the tablet computer are used to play the regular sound effect. A group of speaker channels configured at the lower side of the left side edge of the tablet computer are used to play the specific sound effect 1. A group of speaker channels configured at the upper side of the right side edge of the tablet computer are used to play the regular sound effect. A group of speaker channels configured at the lower side of the right side edge of the tablet computer are also used to play the specific sound effect 2.
As shown in FIG. 16, when a group of speaker channels at the lower side of the left side edge are occluded or blocked, that is, when a group of speaker channels at the lower side of the left side edge is speaker channels a, the electronic device may control the group of speaker channels at the lower side of the left side edge to play only the regular sound effect, and control the group of speaker channels at the upper side of the left side edge to play only the specific sound effect 1. In other words, for the speaker channel b that originally does not need to play the specific sound effect 1, when the speaker channels at the lower side of the left side edge are occluded or blocked, the regular sound effect is no longer played, but the specific sound effect 1 is played. It is ensured that a more important specific sound effect is not affected by occlusion of the speaker.
As shown in FIG. 16, when a group of speaker channels at the lower side of the right side edge are occluded or blocked, that is, when a group of speaker channels at the lower side of the right side edge are speaker channels a, the electronic device may control the group of speaker channels at the lower side of the right side edge to play only the regular sound effect, and control the group of speaker channels at the upper side of the right side edge to play only the specific sound effect 2. In other words, for the speaker channel b that originally plays the regular sound effect, when the speaker channels at the lower side of the right side edge are occluded or blocked, the regular sound effect is no longer played, but the specific sound effect 2 is played. It is ensured that a more important specific sound effect is not affected by occlusion of the speaker.
In other possible embodiments, for different specific scenarios, different processing manners may also be used.
For example, when the audio played by a group of speaker channels a does not include the specific sound effect, the electronic device may also not adjust the audio played by each speaker channel.
For another example, when all speaker channels on one side of the electronic device are occluded or blocked, all audio data may be played by speaker channels on the other side of the electronic device. Alternatively, an effect caused by occlusion of the speaker channel may be compensated by adjusting the audio that needs to be played by the occluded or blocked speaker channel.
For another example, when a channel corresponding to a low frequency speaker in a group of speaker channels a is occluded, but a high frequency speaker is unoccluded, and when a high frequency part of an audio needs to be played by the speaker channel a, it is considered that the speaker channel a is unoccluded, that is, the audio can be normally played, and no additional processing is needed. When a low frequency part of an audio needs to be played by the speaker channel a, it is considered that the speaker channel a is occluded, an audio that needs to be played by one or more groups of speaker channels may be adjusted in the foregoing manner.
In some embodiments, the electronic device may further adjust the audio played by one or more groups of speaker channels according to a degree of occlusion (or a degree of blockage) of the speaker channels. The foregoing degree of occlusion (or the degree of blockage) may be a ratio quantized by the electronic device according to the impedance value of the speaker.
For example, the electronic device may obtain an impedance value a corresponding to each speaker when the speaker is unoccluded and an impedance value b corresponding to each speaker when the speaker is completely occluded, and then set the impedance value a to 0%, and set the impedance value b to 100%. Finally, an impedance value between the impedance value a and the impedance value b may be quantized as a ratio of 0% to 100%.
In this way, the electronic device may determine a degree of occlusion (or a degree of blockage) of a corresponding speaker channel according to a real-time impedance value of each speaker.
After determining a degree of occlusion (or a degree of blockage) corresponding to each speaker channel, the electronic device may determine whether the degree of occlusion (or the degree of blockage) exceeds a preset threshold. The preset threshold may be a system default value, or may be a user-configured value. For example, the preset threshold may be 50%.
When the degree of occlusion exceeds the preset threshold, the second manner in the foregoing embodiment is used to implement adjustment of the audio played by one or more groups of speaker channels. When the degree of occlusion does not exceed the preset threshold and is not 0, the first manner or the third manner in the foregoing embodiment is used to implement adjustment of the audio played by one or more groups of speaker channels.
For example, the electronic device is a tablet computer shown in FIG. 9. As shown in FIG. 17, when a group of speaker channels at the lower side of the left side edge are occluded (or blocked), and a degree of occlusion (or a degree of blockage) does not exceed the preset threshold, the group of speaker channels at the lower side of the left side edge play the adjusted regular sound effect and/or the specific sound effect 1.
As shown in FIG. 17, when a degree of occlusion (or a degree of blockage) of a group of speaker channels at the lower side of the right side edge exceeds the preset threshold, a group of speaker channels at the upper side of the right side edge may be controlled to pause playback of the audio. Meanwhile, a group of speaker channels at the upper side of the right side edge are controlled to play the adjusted regular sound effect and/or the specific sound effect 2.
For example, the electronic device is a tablet computer shown in FIG. 10. As shown in FIG. 18, when a group of speaker channels at the lower side of the left side edge are occluded (or blocked), and a degree of occlusion (or a degree of blockage) does not exceed the preset threshold, the group of speaker channels at the lower side of the left side edge play the regular sound effect, and the group of speaker channels at the upper side of the left side edge play the specific sound effect 1.
As shown in FIG. 18, when a degree of occlusion (or a degree of blockage) of a group of speaker channels at the lower side of the right side edge exceeds the preset threshold, a group of speaker channels at the upper side of the right side edge play the adjusted regular sound effect and/or the specific sound effect 2, and the group of speaker channels at the lower side of the right side edge pause playback of the audio.
In summary, in some embodiments, as shown in FIG. 19, the foregoing method for controlling a speaker may include the following steps:
S101: Determine to-be-played audio data, where the audio data includes a first audio and a second audio.
In some embodiments, the electronic device may determine, according to a detected specific service requirement, audio data that needs to be played. To introduce the foregoing method in terms of aspects, herein, for example, the audio data that needs to be played includes the first audio and the second audio.
In addition, the foregoing first audio and second audio may be different audios. For example, the first audio may be the specific sound effect 1 in the foregoing embodiment, and the second audio may be the regular sound effect in the foregoing embodiment. For another example, the first audio may be the regular sound effect in the foregoing embodiment, and the second audio may be the specific sound effect 1 in the foregoing embodiment. For another example, the first audio may be the regular sound effect and the specific sound effect 1 in the foregoing embodiment, and the second audio may be the regular sound effect and the specific sound effect 2 in the foregoing embodiment.
S102: Control a first speaker to play the first audio, and control a second speaker to play the second audio.
In some embodiments, the foregoing first speaker and second speaker may be examples of two speakers configured at the same side in the electronic device. For example, both the first speaker and the second speaker are configured at the same side edge of the electronic device, that is, corresponding sound outlet holes have the same orientation.
In some embodiments, after the audio data that needs to be played is determined, a part that needs to be played by each speaker further needs to be determined. For a manner of determining the audio that needs to be played by each speaker, refer to the descriptions in the foregoing embodiment. For example, a sound effect that needs to be played by each speaker is determined according to a correspondence between a sound effect type and a speaker channel. In this case, for example, the first speaker plays the first audio and the second speaker plays the second audio.
S103: Adjust an audio played by the first speaker and/or the second speaker when a sound outlet hole of the first speaker is occluded.
For example, when the sound outlet hole of the first speaker is occluded, the first speaker may be controlled to play the first audio that has been adjusted. A manner for adjusting the first audio may be: When the first audio that needs to be played by the first speaker is modulated, a sound wave phase and audio energy of the first audio are changed, so that a phase and a vibration amplitude of the sound wave signal actually played by the first speaker may also be changed.
In some embodiments, in condition 1, the first speaker is controlled to play the first audio that has been adjusted. The foregoing condition 1 may include any one of the following:

(1) Obtaining a first occlusion ratio corresponding to the sound outlet hole of the first speaker (that is, a degree of occlusion of the first speaker), and determining that the first occlusion ratio is less than a first threshold (a preset threshold).
(2) Determining that a preset priority of the second audio is higher than that of the first audio. For example, the second audio is a specific audio and the first audio is a regular audio.

For example, when the sound outlet hole of the first speaker is occluded, the second speaker is controlled to play the first audio.
In some examples, before the second speaker is controlled to play the first audio, the first speaker may be controlled to stop playing the first audio, or may not stop playing the first audio. This is not limited in embodiments of this application.
In some other embodiments, when the preset priority of the first audio is higher than that of the second audio, for example, when the first audio is the specific audio and the second audio is the regular audio, the second speaker may also be controlled to play the first audio while the second speaker is controlled to stop playing the second audio, and the first speaker is controlled to play the second audio. Speakers used by the first audio and the second audio are exchanged to ensure that the first audio with a higher priority can be better played.
In some embodiments, in condition 2, the electronic device selects a manner of controlling the second speaker to play the first audio, which ensures quality of an audio output. The condition 2 includes: obtaining a first occlusion ratio corresponding to a sound outlet hole of a first speaker; and determining that the first occlusion ratio is not less than a first threshold.
In some other embodiments, when the second speaker is controlled to play the first audio, the second speaker continues to play the second audio, which is similar to that shown in FIG. 14.
In some other embodiments, the electronic device may further include a third speaker and a fourth speaker. The third speaker and the fourth speaker may also be configured at the same side edge of the electronic device, that is, an orientation of a sound outlet hole of the third speaker may also be the same as that of a sound outlet hole of the fourth speaker.
When both the third speaker and the fourth speaker play a third audio, it is detected that the sound outlet hole of the third speaker is occluded, and the third speaker may be controlled to stop playing the third audio. The fourth speaker is controlled to play a fourth audio, where the fourth audio is obtained by adjusting a sound wave phase and a vibration amplitude of the third audio.
In some other embodiments, when both the third speaker and the fourth speaker play a fifth audio and a sixth audio, it is detected that the sound outlet hole of the third speaker is occluded; when the fifth audio is a first type of audio, that is, a specific sound effect, and the sixth audio is not the first type of audio, the third speaker is controlled to play only the sixth audio; and the fourth speaker is controlled to play a seventh audio and the sixth audio, where the seventh audio is obtained by adjusting a sound wave phase and a vibration amplitude of the fifth audio, which is similar to that shown in FIG. 15.
In addition, the electronic device includes a first set, the first set includes a plurality of audio type identifiers, and an audio matching an audio type identifier in the first set is the first type of audio.
Implementation effects of the method for controlling a speaker provided in embodiments of this application are described below with reference to several common application scenarios, for example, a scenario in which the user uses the electronic device to play a game and a scenario in which the user uses the electronic device to watch a video.
For ease of description, for example, the electronic device includes a speaker channel 1 and a speaker channel 2, and speaker sound outlet holes corresponding to the speaker channel 1 and the speaker channel 2 may be configured at the same side of the housing of the electronic device.
In a scenario in which the user uses the electronic device to play a gunshot game, game audio data corresponding to the gunshot game includes background sound, a gunshot sound effect, a footstep sound effect, and a game character sound effect. In some examples, when the gunshot sound effect and the footstep sound effect are specified as specific sound effects in a configuration file corresponding to the gunshot game, the electronic device may determine that the gunshot sound effect and the footstep sound effect are specific sound effects, and the background sound and the game character sound effect are regular sound effects. In some other examples, when the gunshot sound effect and the footstep sound effect are specified as specific sound effects in a system configuration file in the electronic device, the electronic device may also determine that the gunshot sound effect and the footstep sound effect are specific sound effects, and the background sound and the game character sound effect are regular sound effects.
For example, when the electronic device runs the gunshot game, both the speaker channel 1 and the speaker channel 2 are used to play the background sound, the gunshot sound effect, the footstep sound effect, and the game character sound effect. In other words, if audio data that needs to be played in real time includes the background sound, both the speaker channel 1 and the speaker channel 2 play the background sound. If the audio data that needs to be played in real time includes the background sound and the footstep sound effect, both the speaker channel 1 and the speaker channel 2 play the mixed background sound and footstep sound effect, and so on.
When the electronic device detects that the speaker channel 1 is occluded, the electronic device may adjust a phase and audio intensity of the audio (for example, the background sound, the gunshot sound effect, the footstep sound effect, and the game character sound effect) that needs to be played by the speaker channel 1.
Alternatively, when detecting that the speaker channel 1 is occluded, the electronic device controls the speaker channel 1 to stop playing the audio, and adjusts a phase and intensity of the audio (for example, the background sound, the gunshot sound effect, the footstep sound effect, and the game character sound effect) that needs to be played by the speaker channel 2.
For another example, when the electronic device runs the gunshot game, the speaker channel 1 is used to play the gunshot sound effect and the footstep sound effect, and the speaker channel 2 is used for the background sound and the game character sound effect.
When detecting that the speaker channel 1 is occluded, the electronic device controls the speaker channel 1 to play the background sound and the game character sound effect. The speaker channel 2 is controlled to play the gunshot sound effect and the footstep sound effect. In other words, audios that need to be played by the speaker channel 1 and the speaker channel 2 are exchanged.
In this way, even if some speakers are occluded, the user can still clearly hear a footstep and a gunshot in the game, and can also accurately determine sound source positions of the heard footstep and gunshot in the game world.
In addition, in a scenario in which the user uses the electronic device to watch the video, audio data corresponding to the video includes background sound and a line sound effect. In some examples, when the line sound effect is specified as a specific sound effect in a configuration file corresponding to the video application, the electronic device may determine that the line sound effect is a specific sound effect and the background sound is a regular sound effect. In some other examples, when the line sound effect is specified as a specific sound effect in the system configuration file in the electronic device, the electronic device may also determine that the line sound effect is the specific sound effect and the background sound is the regular sound effect.
In addition, when the electronic device plays a video, the speaker channel 1 is used to play the line sound effect, and the speaker channel 2 is used to play the background sound.
When detecting that a speaker of the speaker channel 1 is occluded, the electronic device may adjust a phase and intensity of an audio (that is, a line sound effect) that needs to be played by the speaker channel 1.
Alternatively, when detecting that a speaker of the speaker channel 1 is occluded, the electronic device controls the speaker channel 1 to stop playing the audio and controls the speaker channel 2 to play the background sound and the line sound effect.
Alternatively, when detecting that a speaker of the speaker channel 1 is occluded, the electronic device controls the speaker channel 1 to play the background sound and controls the speaker channel 2 to play the line sound effect.
In this way, even if some speakers are occluded, the user can clearly hear lines and dialogues of actors in the video, which does not affect watching experience of the user.
An embodiment of this application further provides an electronic device, and the electronic device may include: a memory and one or more processors. The memory is coupled to the processor. The memory is configured to store computer program code, and the computer program code includes computer instructions. The computer instructions, when executed by the processor, may cause the electronic device to perform steps in the foregoing embodiment. Definitely, the electronic device may include, but is not limited to, the foregoing memory and one or more processors.
An embodiment of this application further provides a chip system, and the chip system may be applied to the terminal device in the foregoing embodiment. As shown in FIG. 20, the chip system includes at least one processor 2201 and at least one interface circuit 2202. The processor 2201 may be a processor in the foregoing electronic device. The processor 2201 and the interface circuit 2202 can be connected to each other by using a line. The processor 2201 can receive and execute computer instructions from the memory in the foregoing electronic device by using the interface circuit 2202. The computer instructions, when executed by the processor 2201, may cause the electronic device to perform steps in the foregoing embodiment. Definitely, the chip system may further include other discrete devices. This is not specifically limited in embodiments of this application.
In some embodiments, through the descriptions of the foregoing implementations, a person skilled in the art may clearly understand that, for the objective of convenient and brief description, only division of the foregoing functional modules is used as an example for description. In actual application, the foregoing functions may be allocated to and completed by different functional modules according to requirements. That is, an internal structure of an apparatus is divided into different functional modules to complete all or some of the functions described above. For a specific working process of the system, apparatus and unit described above, reference may be made to a corresponding process in the foregoing method embodiments, and details are not described herein again.
In embodiments of this application, functional units in the embodiments may be integrated into one processing unit, or each of the units may exist alone physically, or two or more units are integrated into one unit. The foregoing integrated unit may be implemented in a form of hardware, or may be implemented in a form of a software functional unit.
When the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, the integrated unit may be stored in a computer-readable storage medium. Based on such an understanding, the technical solutions of embodiments of this application essentially, or the part contributing to the related art, all or some of the technical solutions may be implemented in a form of a software product. The computer software product is stored in a storage medium, and includes several instructions for instructing a computer device (which may be a personal computer, a server, a network device, or the like) or a processor to perform all or some of the steps of the methods described in embodiments of this application. The foregoing storage medium includes: any medium that can store program code, such as a flash memory, a removable hard disk, a read-only memory, a random access memory, a magnetic disk, or a compact disc.
The foregoing descriptions are merely specific implementations of embodiments of this application, but the protection scope of embodiments of this application is not limited thereto. Any variation or replacement within the technical scope disclosed in embodiments of this application shall fall within the protection scope of embodiments of this application. Therefore, the protection scope of embodiments of this application shall be subject to the protection scope of the claims.

Claims

A method for controlling a speaker, applied to an electronic device, wherein the electronic device comprises a first speaker and a second speaker, and the method comprises:
controlling, when it is determined that a first audio and a second audio are to be played, the first speaker to play the first audio, and controlling the second speaker to play the second audio; and

controlling, when a sound outlet hole of the first speaker is occluded, the first speaker to play the first audio that has been adjusted; or

controlling the second speaker to play the first audio.
The method according to claim 1, wherein before the controlling the first speaker to play the first audio that has been adjusted, the method comprises:
adjusting a sound wave phase and a vibration amplitude that correspond to the first audio.
The method according to claim 2, wherein before the adjusting a sound wave phase and a vibration amplitude that correspond to the first audio, the method further comprises:
determining a first occlusion ratio corresponding to the sound outlet hole of the first speaker; and

determining that the first occlusion ratio is less than a first threshold.
The method according to claim 2, wherein before the adjusting a sound wave phase and a vibration amplitude that correspond to the first audio, the method further comprises:
determining that a preset priority of the second audio is higher than that of the first audio.
The method according to claim 1, wherein before the controlling the second speaker to play the first audio, the method comprises:
controlling the first speaker to stop playing the first audio.
The method according to claim 5, wherein when the second speaker is controlled to play the first audio, the method further comprises:
controlling the second speaker to stop playing the second audio; and

controlling the first speaker to play the second audio.
The method according to claim 5, wherein before the controlling the first speaker to stop playing the first audio, the method further comprises:
determining a first occlusion ratio corresponding to the sound outlet hole of the first speaker; and

determining that the first occlusion ratio is not less than a first threshold.
The method according to claim 1, wherein continuing, by the second speaker, to play the second audio when the second speaker is controlled to play the first audio.
The method according to any one of claims 1 to 8, wherein an orientation of the sound outlet hole of the first speaker is the same as that of a sound outlet hole of the second speaker.
The method according to claim 1, wherein the electronic device comprises a third speaker and a fourth speaker, and the method comprises:
detecting, when both the third speaker and the fourth speaker play a third audio, that a sound outlet hole of the third speaker is occluded;

controlling the third speaker to stop playing the third audio; and

controlling the fourth speaker to play a fourth audio, wherein the fourth audio is obtained by adjusting a sound wave phase and a vibration amplitude of the third audio.
The method according to claim 10, wherein an orientation of a sound outlet hole of the third speaker is the same as that of a sound outlet hole of the fourth speaker.
The method according to claim 1, wherein the electronic device comprises a third speaker and a fourth speaker, and the method comprises:
detecting, when both the third speaker and the fourth speaker play a fifth audio and a sixth audio, that a sound outlet hole of the third speaker is occluded;

controlling the third speaker to play only the sixth audio when the fifth audio is marked as a first type of audio and the sixth audio is not the first type of audio; and

controlling the fourth speaker to play a seventh audio and the sixth audio, wherein the seventh audio is obtained by adjusting a sound wave phase and a vibration amplitude of the fifth audio.
The method according to claim 12, wherein the electronic device comprises a first set, the first set comprises a plurality of audio type identifiers, and an audio matching an audio type identifier in the first set is the first type of audio.
An electronic device, comprising one or more processors and a memory, wherein the memory is coupled to the processor, the memory is configured to store computer program code, the computer program code comprises computer instructions, and when the one or more processors execute the computer instructions, the one or more processors are configured to perform the method according to any one of claims 1 to 13.
A computer storage medium, comprising computer instructions, wherein the computer instructions, when run on an electronic device, cause the electronic device to perform the method according to any one of claims 1 to 13.
A computer program product, comprising a computer program, wherein the program, when run on a computer, causes the computer to perform the method according to any one of claims 1 to 13.