CN116744187A

CN116744187A - Speaker control method and device

Info

Publication number: CN116744187A
Application number: CN202211213394.XA
Authority: CN
Inventors: 蔡智恒
Original assignee: Honor Device Co Ltd
Current assignee: Honor Device Co Ltd
Priority date: 2022-09-30
Filing date: 2022-09-30
Publication date: 2023-09-12
Anticipated expiration: 2042-09-30
Also published as: WO2024066933A9; CN116744187B; WO2024066933A1

Abstract

The embodiment of the application provides a loudspeaker control method and an audio playing device, and relates to the field of loudspeakers, wherein the method is applied to the audio playing device provided with a plurality of loudspeakers and used for indicating a plurality of loudspeakers which are symmetrically distributed and have the number of which is more than or equal to 3 to play audio signals; detecting the running state of each loudspeaker on the audio signal, and if the detection result is abnormal playing, determining the abnormal reason of the abnormal playing and the loudspeaker identification; and adjusting the running state of at least one of the plurality of speakers in the audio playing device to a target state according to the abnormal reason of the abnormal playing and the speaker identification. According to the embodiment of the application, the sound field formed by a plurality of speakers with abnormal speaker play can be reconstructed into the sound field with stereo effect by adjusting the running state of the speakers, so that the problem of abnormal sound field effect caused by abnormal speaker play is solved.

Description

Speaker control method and device

Technical Field

The embodiment of the application relates to the field of speakers, in particular to a speaker control method and device.

Background

Stereophonic sound means sound having a stereoscopic sense, which means that a user can feel the azimuth and the gradation of sound in addition to the loudness, tone and tone of sound.

In the related art, a plurality of speakers are generally configured for an audio playing device to ensure that audio played by the plurality of speakers has a stereoscopic effect, so as to achieve a sound field effect of stereo and panoramic sound, so as to improve the audio experience of a user.

However, in a scene of a plurality of speakers, if one or a plurality of speakers fails, the sound field effect becomes abnormal, and the user experience is deteriorated.

Disclosure of Invention

In order to solve the technical problems, the application provides a loudspeaker control method and equipment. In the method, sound fields formed by a plurality of speakers with abnormal speakers are reconstructed into sound fields with stereo effect by adjusting the running states of the speakers, so that abnormal sound field effect caused by abnormal speaker playing is solved.

In a first aspect, an embodiment of the present application provides a speaker control method, which is applied to an audio playing device configured with a plurality of speakers, including: controlling a plurality of speakers to play audio signals; wherein, a plurality of speakers are symmetrically distributed, and the number is more than or equal to 3; detecting the running state of each loudspeaker on the audio signal to obtain a detection result; if the detection result is abnormal play, determining an abnormal reason of abnormal play and a speaker identification; according to the abnormal reason of the abnormal playing and the speaker identification, adjusting the running state of at least one of the plurality of speakers to a target state; wherein the target state is used to construct a sound field with a stereo or surround effect.

By way of example, fig. 1 is a schematic illustration of an exemplary application scenario. As shown in fig. 1, the positions of the speaker 101 and the speaker 102 on the audio playback device 100 are bilaterally symmetrical, and the positions of the speaker 103 and the speaker 104 on the audio playback device 100 are bilaterally symmetrical.

According to the embodiment of the application, for the audio playing device which is provided with a plurality of speakers and symmetrically arranged with the plurality of speakers, if the speakers with abnormal playing exist, the audio playing device can adjust the running state of the speakers of the audio playing device to the target state according to the abnormal reasons and speaker identifications of the abnormal playing of the speakers, and then reconstruct the sound field formed by the plurality of speakers with abnormal playing into the sound field with stereo effect, so that the problem of abnormal stereo effect caused by abnormal playing of the speakers is solved.

According to a first aspect, detecting an operation state of each speaker on an audio signal to obtain a detection result includes: detecting the running state of each loudspeaker on the audio signal to obtain current state information indicating the running state of each loudspeaker; determining the difference between the current state information and the pre-stored standard state information; the standard state information is used for indicating the running state of the loudspeaker of the audio playing device when no abnormality exists in playing; if the difference is greater than or equal to the difference threshold, determining that the detection result is abnormal play; if the difference is smaller than the difference threshold, determining that the play is abnormal.

According to the embodiment of the application, the abnormal-free running state of the loudspeaker when playing the audio signal can be predetermined, and the audio playing device can further pre-store standard state information for indicating the abnormal-free running state of each loudspeaker. Therefore, when the audio playing device plays the audio signal through each loudspeaker, whether the loudspeaker plays abnormally or not can be determined directly according to the pre-stored standard state information, and the method is more convenient and accurate.

According to a first aspect, or any implementation manner of the first aspect above, the current state information includes at least one of the following information: current input power of the speaker, current theoretical amplitude of the speaker, and current vibration measurement parameters of the speaker; wherein the current input power of the speaker comprises the current input power of the speaker to the speaker by a power amplifier of the speaker; the current theoretical amplitude of the speaker includes an amplitude determined by the power amplifier from the current electrical signal input to the speaker; the current vibration measurement parameters of the speaker include at least one of: and measuring the vibration frequency and the vibration amplitude of the loudspeaker corresponding to each level of power, and obtaining a vibration frequency measurement value and a vibration amplitude measurement value.

In the embodiment of the application, the current state information comprises at least one of the following information: the current input power of the loudspeaker, the current theoretical amplitude of the loudspeaker and the current vibration measurement parameters of the loudspeaker can reflect the more real running state of the loudspeaker, so that the detection accuracy of the running state of the loudspeaker is improved, the accuracy of the subsequent running state adjustment of the loudspeaker is improved, the sound field effect abnormality caused by the abnormal playing of the loudspeaker is further reduced, and the user experience is improved.

According to a first aspect, or any implementation of the first aspect above, the audio signal comprises: a swept frequency acoustic signal, a single frequency acoustic signal, or a pre-established acoustic signal.

According to the embodiment of the application, the single-frequency signal and the sweep frequency signal belong to the audible range of human ears, and the running state of the loudspeaker can be detected when the single-frequency signal and the sweep frequency signal are played, so that the detection accuracy of abnormal playing of the loudspeaker can be improved, the accuracy of the subsequent running state adjustment of the loudspeaker can be improved, the sound field effect abnormality caused by abnormal playing of the loudspeaker can be further reduced, and the user experience can be improved. The preset sound signal is an audio signal formulated by a user, such as music played by the user, and the audio experience requirement exists for the user when the sound signal is played, so that the audio experience of the user can be timely improved based on the sound signal detection.

According to a first aspect, or any implementation manner of the first aspect, the standard state information includes at least one of the following information: a power configuration table of each loudspeaker, a standard theoretical amplitude corresponding to each level of power, and a loudspeaker vibration measurement parameter corresponding to each level of power; wherein the power configuration table comprises: standard input power of each loudspeaker corresponding to each level of volume; the standard input power is used for indicating the input power of each loudspeaker corresponding to each level of volume when the loudspeaker of the audio playing device plays without abnormality; the standard theoretical amplitude corresponding to each level of power includes: when the loudspeaker of the audio playing device plays without abnormality, the theoretical amplitude of each loudspeaker corresponding to each level of input power; the speaker vibration measurement parameters corresponding to each level of power include: when the loudspeaker of the audio playing device plays without abnormality, the amplitude of each loudspeaker corresponding to each level of input power is measured.

In the embodiment of the application, the standard state information comprises at least one of the following information: the power configuration table of each loudspeaker, the standard theoretical amplitude corresponding to each level of power and the loudspeaker vibration measurement parameter corresponding to each level of power are respectively applicable to scenes in which the current state information comprises at least one of the current input power of the loudspeaker, the current theoretical amplitude of the loudspeaker and the current vibration measurement parameter of the loudspeaker, so that the application scene is expanded.

According to a first aspect, or any implementation manner of the first aspect, the exception cause includes: a calibratable anomaly or a non-calibratable anomaly; wherein the calibratable anomalies include anomalies that can be resolved by adjusting the operational state of the speaker playing the anomalies, and the non-calibratable anomalies include anomalies that cannot be resolved by adjusting the operational state of the speaker playing the anomalies.

The embodiment of the application can be suitable for the calibratable abnormality or the non-calibratable abnormality, so that the abnormal playing of the loudspeaker caused by various reasons can be dealt with, the abnormal playing of the loudspeaker is further reduced, and the user experience is improved.

According to the first aspect, or any implementation manner of the first aspect, according to an abnormality cause of the play abnormality and the speaker identification, adjusting an operation state of at least one of the plurality of speakers to a target state includes: if the abnormality is a calibratable abnormality, determining an operation parameter adjustment amount corresponding to the target state according to the difference between the current state information indicating the abnormal operation state of the loudspeaker and the standard state information; the standard state information is used for indicating the running state of the speaker with abnormal playing when the playing is not abnormal; and adjusting the operation parameter of at least one of the plurality of speakers according to the operation parameter adjustment amount and the speaker identification.

In the embodiment of the application, when the abnormality is calibratable, at least one of the plurality of speakers can include a speaker playing abnormality, so that the sound effect of the abnormal speaker can be supplemented by directly adjusting the operation parameters of the abnormal speaker to solve the playing abnormality, thereby constructing a sound field with stereo or surround sound effect.

According to the first aspect, or any implementation manner of the first aspect, according to an abnormality cause of the play abnormality and the speaker identification, adjusting an operation state of at least one of the plurality of speakers to a target state includes: if the abnormality is a non-calibratable abnormality, closing a first speaker symmetrical to the speaker playing the abnormality; determining an operation parameter adjustment amount corresponding to a target state according to the standard operation parameters of the abnormal-playing loudspeaker and the standard operation parameters of the first loudspeaker; adjusting the operation parameters of the second loudspeaker according to the operation parameter adjustment amount and the loudspeaker identification; the second speaker is a speaker except the abnormal speaker and the first speaker in all speakers of the audio playing device.

In the embodiment of the application, when the abnormality is uncorrectable, at least one of the plurality of speakers can comprise speakers except for the speaker playing the abnormality in all the speakers of the audio playing device, so that the operation parameters of the speakers except for the abnormal speaker in the audio playing device are adjusted, and the sound effect of the abnormal speaker can be supplemented to solve the playing abnormality, thereby constructing a sound field with stereo or surround sound effect.

According to the first aspect, or any implementation manner of the first aspect, according to an abnormality cause of the play abnormality and the speaker identification, adjusting an operation state of at least one of the plurality of speakers to a target state includes: detecting whether a target power amplifier corresponding to a speaker playing abnormally is abnormal or not; the audio playing device is also provided with a plurality of power amplifiers, and the power amplifiers are in one-to-one correspondence with the loudspeakers and are respectively used for controlling the corresponding loudspeakers; if abnormal, establishing a current path between the target power amplifier and the power amplifiers in the same group; wherein each two power amplifiers in the plurality of power amplifiers are a group; adjusting the power amplifiers corresponding to the speakers with abnormal playing from the target power amplifiers to the same group of power amplifiers; the operation state of the abnormal playing speaker comprises a power amplifier corresponding to the abnormal playing speaker.

Fig. 7a is a schematic structural diagram of a speaker control device according to an embodiment of the present application. As shown in fig. 7a, the power amplifier PA1 and the power amplifier PA3 are connected and disconnected controllably as the same group of power amplifiers. The power amplifier PA2 and the power amplifier PA4 are used as the same group of power amplifiers, and are connected and disconnected controllably. When there is an abnormality in the same group of power amplifiers (e.g., PA 4), the audio playback device indicates that the connection is on, i.e., establishes a current path between the same group of power amplifiers. Thus, the power amplifiers (such as PA 3) without abnormality in the same group of power amplifiers can control the work of the two paths of speakers so as to solve the speaker abnormality caused by the power amplifier abnormality.

According to the embodiment of the application, whether the power amplifier is abnormal or not is detected, so that a current path between the abnormal power amplifier and the same group of power amplifiers is established, and abnormal running states of the loudspeaker caused by the abnormal power amplifier can be dealt with. In this way, the power amplifier corresponding to the speaker with abnormal playing is adjusted from the target power amplifier to the same group of power amplifiers, so that the running state of the speaker is not abnormal, and the target state is reached.

According to the first aspect, or any implementation manner of the first aspect, after adjusting an operation state of at least one of the plurality of speakers to a target state according to an abnormality cause of the play abnormality and the speaker identifier, the method further includes: outputting inquiry information whether to personalize the adjustment; if receiving the indication information for personalized adjustment, displaying a personalized adjustment interface; receiving sound effect parameters input through a personalized adjustment interface; the operational state of at least one of the plurality of speakers is adjusted according to the sound effect parameters.

According to the embodiment of the application, under the condition that the running state of the loudspeaker can be adjusted, the corresponding adjusting mode, namely, the running state of at least one of the plurality of loudspeakers is adjusted to the target state, so that a user can perceive the corresponding adjusting effect. On the basis, the user can be guided to further adjust and optimize the running state adjustment mode of the loudspeaker executed by the audio playing device according to the self requirement by outputting the inquiry information of whether the individualized adjustment is carried out, so that the playing abnormality of the loudspeaker is further reduced, and the user experience is improved.

According to a first aspect, or any implementation manner of the first aspect, the querying information includes: information prompting the user whether to personalize the adjustment, and at least one of: the location of the speaker playing the anomaly, the speaker identification, the cause of the anomaly, and the target state.

In the embodiment of the application, the inquiry information also comprises at least one of the following information: the position of the speaker playing the abnormality, the speaker identification, the abnormality cause and the target state, so that the user can be informed of the abnormality of the speaker and the processing mode of the audio playing device for the abnormality.

In a second aspect, an embodiment of the present application provides an electronic device, including: a processor and a transceiver; a memory for storing one or more programs; the one or more programs, when executed by the one or more processors, cause the one or more processors to implement the first aspect or the method in any one of the possible implementations of the first aspect.

Any implementation manner of the second aspect and the second aspect corresponds to any implementation manner of the first aspect and the first aspect, respectively. The technical effects corresponding to the second aspect and any implementation manner of the second aspect may be referred to the technical effects corresponding to the first aspect and any implementation manner of the first aspect, which are not described herein.

In a third aspect, embodiments of the present application provide a computer readable medium storing a computer program comprising instructions for performing the method of the first aspect or any possible implementation of the first aspect.

In a fourth aspect, embodiments of the present application provide a computer program comprising instructions for performing the method of the first aspect or any possible implementation of the first aspect.

In a fifth aspect, an embodiment of the present application provides a chip, where the chip includes a processing circuit and a transceiver pin. Wherein the transceiver pin and the processing circuit communicate with each other via an internal connection path, the processing circuit performing the method of the first aspect or any one of the possible implementation manners of the first aspect to control the receiving pin to receive signals and to control the transmitting pin to transmit signals.

Drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are needed in the description of the embodiments of the present application will be briefly described below, it being obvious that the drawings in the following description are only some embodiments of the present application, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.

FIG. 1 is a schematic illustration of an exemplary application scenario;

FIG. 2 is a schematic diagram of an exemplary application scenario;

FIG. 3 is a schematic diagram of an exemplary application scenario;

FIG. 4 is a schematic diagram of an exemplary application scenario;

fig. 5 is a schematic structural diagram of an electronic device 500 according to an embodiment of the present application;

fig. 6 is a schematic software architecture of an electronic device 500 according to an embodiment of the present application;

fig. 7a is a schematic structural diagram of a speaker control device according to an embodiment of the present application;

fig. 7b is a schematic structural diagram of a speaker control system according to an embodiment of the present application;

fig. 8 is a flowchart of a speaker control method according to an embodiment of the present application;

fig. 9 is a schematic diagram of a speaker control process according to an embodiment of the present application;

FIG. 10 is a schematic diagram of a speaker control process according to an embodiment of the present application;

fig. 11 is a flowchart of a speaker control method according to an embodiment of the present application;

fig. 12 is a schematic block diagram of an apparatus provided by an embodiment of the present application.

Detailed Description

The following description of the embodiments of the present application will be made clearly and fully with reference to the accompanying drawings, in which it is evident that the embodiments described are some, but not all embodiments of the application. All other embodiments, which can be made by those skilled in the art based on the embodiments of the application without making any inventive effort, are intended to be within the scope of the application.

The term "and/or" is herein merely an association relationship describing an associated object, meaning that there may be three relationships, e.g., a and/or B, may represent: a exists alone, A and B exist together, and B exists alone.

The terms first and second and the like in the description and in the claims of embodiments of the application, are used for distinguishing between different objects and not necessarily for describing a particular sequential order of objects. For example, the first target object and the second target object, etc., are used to distinguish between different target objects, and are not used to describe a particular order of target objects.

In embodiments of the application, words such as "exemplary" or "such as" are used to mean serving as an example, instance, or illustration. Any embodiment or design described herein as "exemplary" or "e.g." in an embodiment should not be taken as preferred or advantageous over other embodiments or designs. Rather, the use of words such as "exemplary" or "such as" is intended to present related concepts in a concrete fashion.

In the description of the embodiments of the present application, unless otherwise indicated, the meaning of "a plurality" means two or more. For example, the plurality of processing units refers to two or more processing units; the plurality of systems means two or more systems.

Audio playback devices are typically configured with a plurality of speakers. In one embodiment, the stereo, panoramic effect is achieved by a symmetrical layout of a plurality of speakers. The panoramic sound is the sound effect that the space sense of the sound field has a surrounding effect and the space immersion sense is increased. By way of example, fig. 1 is a schematic illustration of an exemplary application scenario. As shown in fig. 1, an audio playback apparatus 100 configured with a plurality of speakers to achieve a stereo, panoramic sound effect may include 4 speakers: speaker 101, speaker 102, speaker 103, and speaker 104. The 4 speakers are arranged in bilateral symmetry, i.e. the positions of speaker 101 and speaker 102 on audio playback device 100 are bilateral symmetry, and the positions of speaker 103 and speaker 104 on audio playback device 100 are bilateral symmetry. Therefore, a plurality of loudspeakers can work simultaneously to bring wider frequency response bandwidth, expand the coverage area of a sound field, obtain a sound field with larger depth and breadth, realize the effects of stereo and panoramic sound, and greatly improve the audio experience of users.

It is understood that the audio playback apparatus 100 may be of various types in particular. Such as computers, tablets, large screens, mobile terminals, bluetooth sound, theatre sound systems, and car sound systems, etc.

In the above scenario, when at least one speaker of the plurality of speakers is abnormal, such as loudness abnormality, frequency abnormality, silence, etc., the sound field of the entire audio playing device is negatively affected or even crashed, the sound field is no longer balanced, resulting in a stereo or surround sound effect. In this way, the audio function of the audio playback apparatus is degraded or lost, and the user experience is deteriorated.

Accordingly, an embodiment of the present application provides a speaker control method to solve the above-mentioned problems. By way of example, by applying the method for controlling speakers provided by the embodiment of the present application, for a sound field of an audio playing device (such as the audio playing device 100) configured with a plurality of speakers, if a playing abnormality exists in the sound field, the sound field can be reconstructed into a sound field with a stereo effect by adjusting an operation state of at least one of the plurality of speakers, so that the abnormality of the sound field effect caused by the abnormal playing of the speakers is solved, and the stereo and panoramic experience of a user is ensured.

The speaker control method provided in the embodiment of the present application may be applied to any of the audio playing devices shown in fig. 2 to 4, in addition to the audio playing device 100 shown in fig. 1. The following is a detailed description with reference to fig. 2 to 4.

By way of example, fig. 2 is a schematic illustration of an exemplary application scenario. As shown in fig. 2, an audio playback apparatus 200 configured with a plurality of speakers to achieve a stereo, panoramic sound effect may include 8 speakers: speaker 201, speaker 202, speaker 203, speaker 204, speaker 205, speaker 206, speaker 207, and speaker 208. The 8 speakers are arranged symmetrically around the audio player 200, i.e. the speaker 201 and the speaker 202 are positioned symmetrically left and right on the audio player 200, the speaker 203 and the speaker 204 are positioned symmetrically left and right on the audio player 200, the speaker 205 and the speaker 206 are positioned symmetrically up and down on the audio player 200, and the speaker 207 and the speaker 208 are positioned symmetrically up and down on the audio player 200.

By way of example, fig. 3 is a schematic illustration of an exemplary application scenario. As shown in fig. 3, an audio playback apparatus 300 configured with a plurality of speakers to achieve a stereo, panoramic sound effect may include 4 speakers: speaker 301, speaker 302, speaker 303, and speaker 304. The 4 speakers are arranged symmetrically up and down, i.e. speaker 301 and speaker 302 are positioned symmetrically up and down on the audio playback device 300, and speaker 303 and speaker 304 are positioned symmetrically up and down on the audio playback device 300.

Illustratively, fig. 4 is a schematic diagram of an exemplary application scenario. As shown in fig. 4, an audio playback apparatus 400 configured with a plurality of speakers to achieve a stereo, panoramic sound effect may include 4 speakers: speaker 401, speaker 402, speaker 403, and speaker 404. The 4 speakers are symmetrically arranged on one side, i.e. the positions of speaker 401 and speaker 402 on audio playback device 100 are symmetrical left and right, and speaker 403 and speaker 404 are symmetrically arranged on a single side on audio playback device 400.

Before describing the technical scheme of the embodiment of the present application, an audio playing device of the embodiment of the present application is first described with reference to the accompanying drawings. Taking an audio playing device as an example of an electronic device, fig. 5 is a schematic structural diagram of an electronic device 500 according to an embodiment of the present application. The electronic device may be, for example, a tablet, a computer, a mobile phone, etc., which is not limited in this embodiment of the present application.

It should be understood that the electronic device 500 shown in fig. 5 is only one example of an electronic device, and that the electronic device 500 may have more or fewer components than shown in the figures, may combine two or more components, or may have a different configuration of components. The various components shown in fig. 5 may be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and/or application specific integrated circuits.

The electronic device 500 may include: processor 510, external memory interface 520, internal memory 521, universal serial bus (universal serial bus, USB) interface 530, charge management module 540, power management module 541, battery 542, antenna 1, antenna 2, mobile communication module 550, wireless communication module 560, audio module 570, speaker 570A, receiver 570B, microphone 570C, headset interface 570D, sensor module 580, keys 590, motor 591, indicator 592, camera 593, display 594, and subscriber identity module (subscriber identification module, SIM) card interface 595, among others. The sensor module 580 may include a pressure sensor 580A, a gyroscope sensor 580B, an air pressure sensor 580C, a magnetic sensor 580D, an acceleration sensor 580E, a distance sensor 580F, a proximity sensor 580G, a fingerprint sensor 580H, a temperature sensor 580J, a touch sensor 580K, an ambient light sensor 580L, a bone conduction sensor 580M, and the like.

Processor 510 may include one or more processing units, such as: processor 510 may include an application processor (application processor, AP), a modem processor, a graphics processor (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), a controller, a memory, a video codec, a digital signal processor (digital signal processor, DSP), a baseband processor, and/or a neural network processor (neural-network processing unit, NPU), etc. Wherein the different processing units may be separate devices or may be integrated in one or more processors.

The controller may be a neural hub and a command center of the electronic device 500, among others. The controller can generate operation control signals according to the instruction operation codes and the time sequence signals to finish the control of instruction fetching and instruction execution.

A memory may also be provided in the processor 510 for storing instructions and data. In some embodiments, the memory in processor 510 is a cache memory. The memory may hold instructions or data that has just been used or recycled by the processor 510. If the processor 510 needs to reuse the instruction or data, it may be called directly from the memory. Repeated accesses are avoided and the latency of the processor 510 is reduced, thereby improving the efficiency of the system.

In some embodiments, processor 510 may include one or more interfaces. The interfaces may include an integrated circuit (inter-integrated circuit, I2C) interface, an integrated circuit built-in audio (inter-integrated circuit sound, I2S) interface, a pulse code modulation (pulse code modulation, PCM) interface, a universal asynchronous receiver transmitter (universal asynchronous receiver/transmitter, UART) interface, a mobile industry processor interface (mobile industry processor interface, MIPI), a general-purpose input/output (GPIO) interface, a subscriber identity module (subscriber identity module, SIM) interface, and/or a universal serial bus (universal serial bus, USB) interface, among others.

The I2C interface is a bi-directional synchronous serial bus comprising a serial data line (SDA) and a serial clock line (derail clock line, SCL). In some embodiments, processor 510 may contain multiple sets of I2C buses. The processor 510 may be coupled to the touch sensor 580K, charger, flash, camera 593, etc., respectively, through different I2C bus interfaces. For example: processor 510 may couple touch sensor 580K through an I2C interface, causing processor 510 to communicate with touch sensor 580K through an I2C bus interface, implementing the touch functionality of electronic device 500.

The I2S interface may be used for audio communication. In some embodiments, processor 510 may contain multiple sets of I2S buses. Processor 510 may be coupled to audio module 570 via an I2S bus to enable communication between processor 510 and audio module 570. In some embodiments, the audio module 570 may communicate audio signals to the wireless communication module 560 via an I2S interface to enable answering a call via a bluetooth headset.

PCM interfaces may also be used for audio communication to sample, quantize and encode analog signals. In some embodiments, the audio module 570 and the wireless communication module 560 may be coupled by a PCM bus interface. In some embodiments, the audio module 570 may also communicate audio signals to the wireless communication module 560 via a PCM interface to enable phone answering via a bluetooth headset. Both the I2S interface and the PCM interface may be used for audio communication.

The UART interface is a universal serial data bus for asynchronous communications. The bus may be a bi-directional communication bus. It converts the data to be transmitted between serial communication and parallel communication. In some embodiments, a UART interface is typically used to connect the processor 510 with the wireless communication module 560. For example: the processor 510 communicates with a bluetooth module in the wireless communication module 560 through a UART interface to implement a bluetooth function. In some embodiments, the audio module 570 may communicate audio signals to the wireless communication module 560 through a UART interface to implement a function of playing music through a bluetooth headset.

The MIPI interface may be used to connect the processor 510 to peripheral devices such as the display screen 594, the camera 593, and the like. The MIPI interfaces include camera serial interfaces (camera serial interface, CSI), display serial interfaces (display serial interface, DSI), and the like. In some embodiments, processor 510 and camera 593 communicate through a CSI interface to implement the shooting functionality of electronic device 500. Processor 510 and display screen 594 communicate via a DSI interface to implement the display functionality of electronic device 500.

The GPIO interface may be configured by software. The GPIO interface may be configured as a control signal or as a data signal. In some embodiments, a GPIO interface may be used to connect processor 510 with camera 593, display 594, wireless communication module 560, audio module 570, sensor module 580, and the like. The GPIO interface may also be configured as an I2C interface, an I2S interface, a UART interface, an MIPI interface, etc.

The USB interface 530 is an interface conforming to the USB standard specification, and may specifically be a Mini USB interface, a Micro USB interface, a USB Type C interface, or the like. The USB interface 530 may be used to connect a charger to charge the electronic device 500, or may be used to transfer data between the electronic device 500 and a peripheral device. And can also be used for connecting with a headset, and playing audio through the headset. The interface may also be used to connect other electronic devices, such as AR devices, etc.

It should be understood that the connection between the modules illustrated in the embodiments of the present application is only illustrative, and does not limit the structure of the electronic device 500. In other embodiments of the present application, the electronic device 500 may also employ different interfacing manners in the above embodiments, or a combination of multiple interfacing manners.

The charge management module 540 is configured to receive a charge input from a charger. The charger can be a wireless charger or a wired charger. In some wired charging embodiments, the charge management module 540 may receive a charging input of a wired charger through the USB interface 530. In some wireless charging embodiments, the charge management module 540 may receive wireless charging input through a wireless charging coil of the electronic device 500. The charging management module 540 may also provide power to the electronic device through the power management module 541 while charging the battery 542.

The power management module 541 is configured to connect the battery 542, the charge management module 540, and the processor 510. The power management module 541 receives input from the battery 542 and/or the charge management module 540 and provides power to the processor 510, the internal memory 521, the external memory, the display 594, the camera 593, the wireless communication module 560, and the like. The power management module 541 may also be configured to monitor battery capacity, battery cycle number, battery health (leakage, impedance), etc. In other embodiments, the power management module 541 may also be disposed in the processor 510. In other embodiments, the power management module 541 and the charge management module 540 may be disposed in the same device.

The wireless communication function of the electronic device 500 may be implemented by the antenna 1, the antenna 2, the mobile communication module 550, the wireless communication module 560, the modem processor, the baseband processor, and the like.

The antennas 1 and 2 are used for transmitting and receiving electromagnetic wave signals. Each antenna in electronic device 500 may be used to cover a single or multiple communication bands. Different antennas may also be multiplexed to improve the utilization of the antennas. For example: the antenna 1 may be multiplexed into a diversity antenna of a wireless local area network. In other embodiments, the antenna may be used in conjunction with a tuning switch.

The mobile communication module 550 may provide a solution for wireless communication including 2G/3G/4G/5G, etc., applied on the electronic device 500. The mobile communication module 550 may include at least one filter, switch, power amplifier, low noise amplifier (low noise amplifier, LNA), etc. The mobile communication module 550 may receive electromagnetic waves from the antenna 1, perform processes such as filtering, amplifying, and the like on the received electromagnetic waves, and transmit the processed electromagnetic waves to the modem processor for demodulation. The mobile communication module 550 can amplify the signal modulated by the modem processor, and convert the signal into electromagnetic waves through the antenna 1 to radiate. In some embodiments, at least some of the functional modules of the mobile communication module 550 may be disposed in the processor 510. In some embodiments, at least some of the functional modules of the mobile communication module 550 may be disposed in the same device as at least some of the modules of the processor 510.

The modem processor may include a modulator and a demodulator. The modulator is used for modulating the low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used for demodulating the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low frequency baseband signal to the baseband processor for processing. The low frequency baseband signal is processed by the baseband processor and then transferred to the application processor. The application processor outputs sound signals through an audio device (not limited to speaker 570A, receiver 570B, etc.), or displays images or video through display screen 594. In some embodiments, the modem processor may be a stand-alone device. In other embodiments, the modem processor may be provided in the same device as the mobile communication module 550 or other functional module, independent of the processor 510.

The wireless communication module 560 may provide solutions for wireless communication including wireless local area network (wireless local area networks, WLAN) (e.g., wireless fidelity (wireless fidelity, wi-Fi) network), bluetooth (BT), global navigation satellite system (global navigation satellite system, GNSS), frequency modulation (frequency modulation, FM), near field wireless communication technology (near field communication, NFC), infrared technology (IR), etc., applied to the electronic device 500. The wireless communication module 560 may be one or more devices integrating at least one communication processing module. The wireless communication module 560 receives electromagnetic waves via the antenna 2, modulates the electromagnetic wave signals, filters the electromagnetic wave signals, and transmits the processed signals to the processor 510. The wireless communication module 560 may also receive a signal to be transmitted from the processor 510, frequency modulate it, amplify it, and convert it to electromagnetic waves for radiation via the antenna 2.

In some embodiments, antenna 1 and mobile communication module 550 of electronic device 500 are coupled, and antenna 2 and wireless communication module 560 are coupled, such that electronic device 500 may communicate with a network and other devices through wireless communication techniques. The wireless communication techniques may include the Global System for Mobile communications (global system for mobile communications, GSM), general packet radio service (general packet radio service, GPRS), code division multiple access (code division multiple access, CDMA), wideband code division multiple access (wideband code division multiple access, WCDMA), time division code division multiple access (time-division code division multiple access, TD-SCDMA), long term evolution (long term evolution, LTE), BT, GNSS, WLAN, NFC, FM, and/or IR techniques, among others. The GNSS may include a global satellite positioning system (global positioning system, GPS), a global navigation satellite system (global navigation satellite system, GLONASS), a beidou satellite navigation system (beidou navigation satellite system, BDS), a quasi zenith satellite system (quasi-zenith satellite system, QZSS) and/or a satellite based augmentation system (satellite based augmentation systems, SBAS).

Electronic device 500 implements display functionality through a GPU, a display screen 594, and an application processor, among others. The GPU is a microprocessor for image processing, and is connected to the display screen 594 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 510 may include one or more GPUs that execute program instructions to generate or change display information.

The display screen 594 is used to display images, videos, and the like. The display screen 594 includes a display panel. The display panel may employ a liquid crystal display (liquid crystal display, LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED) or an active-matrix organic light-emitting diode (matrix organic light emitting diode), a flexible light-emitting diode (flex), a mini, a Micro led, a Micro-OLED, a quantum dot light-emitting diode (quantum dot light emitting diodes, QLED), or the like. In some embodiments, electronic device 500 may include 1 or N displays 594, N being a positive integer greater than 1.

The electronic device 500 may implement shooting functions through an ISP, a camera 593, a video codec, a GPU, a display screen 594, an application processor, and the like.

The ISP is used to process the data fed back by the camera 593. For example, when photographing, the shutter is opened, light is transmitted to the camera photosensitive element through the lens, the optical signal is converted into an electric signal, and the camera photosensitive element transmits the electric signal to the ISP for processing and is converted into an image visible to naked eyes. ISP can also optimize the noise, brightness and skin color of the image. The ISP can also optimize parameters such as exposure, color temperature and the like of a shooting scene. In some embodiments, the ISP may be provided in the camera 593.

The camera 593 is used to capture still images or video. The object generates an optical image through the lens and projects the optical image onto the photosensitive element. The photosensitive element may be a charge coupled device (charge coupled device, CCD) or a Complementary Metal Oxide Semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, which is then transferred to the ISP to be converted into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV, or the like format. In some embodiments, electronic device 500 may include 1 or N cameras 593, N being a positive integer greater than 1.

The digital signal processor is used for processing digital signals, and can process other digital signals besides digital image signals. For example, when the electronic device 500 is selecting a frequency bin, the digital signal processor is used to fourier transform the frequency bin energy, or the like.

Video codecs are used to compress or decompress digital video. The electronic device 500 may support one or more video codecs. In this way, the electronic device 500 may play or record video in a variety of encoding formats, such as: dynamic picture experts group (moving picture experts group, MPEG) 1, MPEG2, MPEG3, MPEG4, etc.

The NPU is a neural-network (NN) computing processor, and can rapidly process input information by referencing a biological neural network structure, for example, referencing a transmission mode between human brain neurons, and can also continuously perform self-learning. Applications such as intelligent awareness of the electronic device 500 may be implemented through the NPU, for example: image recognition, face recognition, speech recognition, text understanding, etc.

The external memory interface 520 may be used to connect an external memory card, such as a Micro SD card, to enable expansion of the memory capabilities of the electronic device 500. The external memory card communicates with the processor 510 via an external memory interface 520 to implement data storage functions. For example, files such as music, video, etc. are stored in an external memory card.

The internal memory 521 may be used to store computer-executable program code that includes instructions. The processor 510 executes various functional applications of the electronic device 500 and data processing by executing instructions stored in the internal memory 521. The internal memory 521 may include a storage program area and a storage data area. The storage program area may store an application program (such as a sound playing function, an image playing function, etc.) required for at least one function of the operating system, etc. The storage data area may store data created during use of the electronic device 500 (e.g., audio data, phonebook, etc.), and so on. In addition, the internal memory 521 may include a high-speed random access memory, and may further include a nonvolatile memory such as at least one magnetic disk storage device, a flash memory device, a universal flash memory (universal flash storage, UFS), and the like.

Electronic device 500 may implement audio functionality through audio module 570, speaker 570A, receiver 570B, microphone 570C, ear speaker interface 570D, and an application processor or the like. Such as music playing, recording, etc.

The audio module 570 is configured to convert digital audio information to an analog audio signal output and also to convert an analog audio input to a digital audio signal. The audio module 570 may also be used to encode and decode audio signals. In some embodiments, the audio module 570 may be provided in the processor 510 or some functional modules of the audio module 570 may be provided in the processor 510.

Speaker 570A, also referred to as a "horn," is used to convert audio electrical signals into sound signals. The electronic device 500 may listen to audio, such as music, or to hands-free calls through the speaker 570A. In an embodiment of the present application, the number of speakers 570A is an even number greater than or equal to 4, and is symmetrically arranged on the electronic device 800, such as the symmetrical arrangement shown in fig. 1-4.

A receiver 570B, also referred to as a "earpiece," is used to convert the audio electrical signal into a sound signal. When electronic device 500 is answering a telephone call or voice message, voice may be received by placing receiver 570B close to the human ear.

Microphone 570C, also referred to as a "microphone" or "microphone", is used to convert acoustic signals into electrical signals. When making a call or transmitting voice information, the user can sound near the microphone 570C through the mouth, inputting a sound signal to the microphone 570C. The electronic device 500 may be provided with at least one microphone 570C. In other embodiments, the electronic device 500 may be provided with two microphones 570C, and may implement a noise reduction function in addition to collecting sound signals. In other embodiments, the electronic device 500 may also be provided with three, four, or more microphones 570C to enable collection of sound signals, noise reduction, identification of sound sources, directional recording functions, etc.

The earphone interface 570D is used to connect a wired earphone. The earphone interface 570D may be a USB interface 530 or a 3.5mm open mobile electronic device platform (open mobile terminal platform, OMTP) standard interface, a american cellular telecommunications industry association (cellular telecommunications industry association of the USA, CTIA) standard interface.

The pressure sensor 580A is used to sense a pressure signal, which can be converted into an electrical signal. In some embodiments, pressure sensor 580A may be provided on display screen 594. The pressure sensor 580A is of various kinds, such as a resistive pressure sensor, an inductive pressure sensor, a capacitive pressure sensor, and the like. The capacitive pressure sensor may be a capacitive pressure sensor comprising at least two parallel plates with conductive material. When a force is applied to the pressure sensor 580A, the capacitance between the electrodes changes. The electronic device 500 determines the strength of the pressure from the change in capacitance. When a touch operation is applied to the display screen 594, the electronic apparatus 500 detects the intensity of the touch operation according to the pressure sensor 580A. The electronic device 500 may also calculate the location of the touch based on the detection signal of the pressure sensor 580A. In some embodiments, touch operations that act on the same touch location, but at different touch operation strengths, may correspond to different operation instructions. For example: and executing an instruction for checking the short message when the touch operation with the touch operation intensity smaller than the first pressure threshold acts on the short message application icon. And executing an instruction for newly creating the short message when the touch operation with the touch operation intensity being greater than or equal to the first pressure threshold acts on the short message application icon.

The gyro sensor 580B may be used to determine a motion gesture of the electronic device 500. In some embodiments, the angular velocity of electronic device 500 about three axes (i.e., x, y, and z axes) may be determined by gyro sensor 580B. The gyro sensor 580B may be used for photographing anti-shake. For example, when the shutter is pressed, the gyro sensor 580B detects the shake angle of the electronic device 500, calculates the distance to be compensated by the lens module according to the angle, and makes the lens counteract the shake of the electronic device 500 through the reverse motion, thereby realizing anti-shake. The gyro sensor 580B may also be used for navigation, somatosensory of game scenes.

The air pressure sensor 580C is used to measure air pressure. In some embodiments, electronic device 500 calculates altitude from barometric pressure values measured by barometric pressure sensor 580C, aiding in positioning and navigation.

The magnetic sensor 580D includes a hall sensor. The electronic device 500 may detect the opening and closing of the flip holster using the magnetic sensor 580D. In some embodiments, when the electronic device 500 is a flip machine, the electronic device 500 may detect the opening and closing of the flip according to the magnetic sensor 580D. And then according to the detected opening and closing state of the leather sheath or the opening and closing state of the flip, the characteristics of automatic unlocking of the flip and the like are set.

The acceleration sensor 580E may detect the magnitude of acceleration of the electronic device 500 in various directions (typically three axes). The magnitude and direction of gravity may be detected when the electronic device 500 is stationary. The electronic equipment gesture recognition method can also be used for recognizing the gesture of the electronic equipment, and is applied to horizontal and vertical screen switching, pedometers and other applications.

A distance sensor 580F for measuring distance. The electronic device 500 may measure the distance by infrared or laser. In some embodiments, the electronic device 500 may range using the distance sensor 580F to achieve fast focus.

The proximity light sensor 580G may include, for example, a Light Emitting Diode (LED) and a light detector, such as a photodiode. The light emitting diode may be an infrared light emitting diode. The electronic device 500 emits infrared light outward through the light emitting diode. The electronic device 500 detects infrared reflected light from nearby objects using a photodiode. When sufficient reflected light is detected, it may be determined that an object is in the vicinity of the electronic device 500. When insufficient reflected light is detected, the electronic device 500 may determine that there is no object in the vicinity of the electronic device 500. The electronic device 500 may use the proximity light sensor 580G to detect that the user holds the electronic device 500 close to the ear for talking, so as to automatically extinguish the screen for power saving. The proximity light sensor 580G may also be used in holster mode, pocket mode to automatically unlock and lock the screen.

The ambient light sensor 580L is used to sense ambient light level. The electronic device 500 may adaptively adjust the brightness of the display screen 594 based on the perceived ambient light level. The ambient light sensor 580L may also be used to automatically adjust white balance during photographing. Ambient light sensor 580L may also cooperate with proximity light sensor 580G to detect whether electronic device 500 is in a pocket to prevent false touches.

The fingerprint sensor 580H is used to collect a fingerprint. The electronic device 500 may utilize the collected fingerprint feature to unlock the fingerprint, access the application lock, photograph the fingerprint, answer the incoming call, etc.

The temperature sensor 580J is for detecting temperature. In some embodiments, the electronic device 500 performs a temperature processing strategy using the temperature detected by the temperature sensor 580J. For example, when the temperature reported by temperature sensor 580J exceeds a threshold, electronic device 500 performs a reduction in performance of a processor located in the vicinity of temperature sensor 580J in order to reduce power consumption to implement thermal protection. In other embodiments, when the temperature is below another threshold, the electronic device 500 heats the battery 542 to avoid the low temperature causing the electronic device 500 to be abnormally shut down. In other embodiments, when the temperature is below a further threshold, the electronic device 500 performs boosting of the output voltage of the battery 542 to avoid abnormal shutdown caused by low temperatures.

The touch sensor 580K is also referred to as a "touch panel". The touch sensor 580K may be disposed on the display screen 594, and the touch sensor 580K and the display screen 594 form a touch screen, which is also called a "touch screen". The touch sensor 580K is for detecting a touch operation acting thereon or thereabout. The touch sensor may communicate the detected touch operation to the application processor to determine the touch event type. Visual output related to touch operations may be provided through the display screen 594. In other embodiments, the touch sensor 580K may also be disposed on a surface of the electronic device 500 at a different location than the display screen 594.

The bone conduction sensor 580M may acquire a vibration signal. In some embodiments, bone conduction sensor 580M may acquire a vibration signal of a human vocal tract vibrating bone pieces. The bone conduction sensor 580M may also contact the pulse of the human body to receive the blood pressure pulsation signal. In some embodiments, bone conduction sensor 580M may also be provided in a headset, in combination with an osteoinductive headset. The audio module 570 may analyze the voice signal based on the vibration signal of the vocal part vibration bone piece obtained by the bone conduction sensor 580M, so as to implement a voice function. The application processor can analyze heart rate information based on the blood pressure beat signals acquired by the bone conduction sensor 580M, so as to realize a heart rate detection function.

The keys 590 include a power key, a volume key, etc. The keys 590 may be mechanical keys. Or may be a touch key. The electronic device 500 may receive key inputs, generate key signal inputs related to user settings and function controls of the electronic device 500.

Motor 591 may generate a vibration alert. Motor 591 may be used for incoming call vibration alerting as well as for touch vibration feedback. For example, touch operations acting on different applications (e.g., photographing, audio playing, etc.) may correspond to different vibration feedback effects. Touch operations on different areas of the display screen 594 may also correspond to different vibration feedback effects by the motor 591. Different application scenarios (such as time reminding, receiving information, alarm clock, game, etc.) can also correspond to different vibration feedback effects. The touch vibration feedback effect may also support customization.

The indicator 592 may be an indicator light, may be used to indicate a state of charge, a change in charge, may be used to indicate a message, missed call, notification, or the like.

The SIM card interface 595 is used to connect to a SIM card. The SIM card may be inserted into the SIM card interface 595 or removed from the SIM card interface 595 to enable contact and separation with the electronic device 500. The electronic device 500 may support 1 or N SIM card interfaces, N being a positive integer greater than 1. The SIM card interface 595 may support Nano SIM cards, micro SIM cards, and the like. The same SIM card interface 595 may be used to insert multiple cards simultaneously. The types of the plurality of cards may be the same or different. The SIM card interface 595 may also be compatible with different types of SIM cards. The SIM card interface 595 may also be compatible with external memory cards. The electronic device 500 interacts with the network through the SIM card to realize functions such as communication and data communication. In some embodiments, the electronic device 500 employs esims, namely: an embedded SIM card. The eSIM card can be embedded in the electronic device 500 and cannot be separated from the electronic device 500.

The software system of the electronic device 500 may employ a layered architecture, an event driven architecture, a microkernel architecture, a microservice architecture, or a cloud architecture. In the embodiment of the application, taking an Android system with a layered architecture as an example, a software structure of the electronic device 500 is illustrated.

Fig. 6 is a software block diagram of an electronic device 500 according to an embodiment of the present application.

The layered architecture of the electronic device 500 divides the software into several layers, each with a distinct role and division of labor. The layers communicate with each other through a software interface. In some embodiments, the Android system is divided into four layers, from top to bottom, an application layer, an application framework layer, an Zhuoyun row (Android run) and system libraries, and a kernel layer, respectively.

The application layer may include a series of application packages.

As shown in fig. 6, the application package may include applications for cameras, gallery, calendar, phone calls, maps, navigation, WLAN, bluetooth, music, video, short messages, etc.

The application framework layer provides an application programming interface (application programming interface, API) and programming framework for application programs of the application layer. The application framework layer includes a number of predefined functions.

As shown in fig. 6, the application framework layer may include a window manager, a content provider, a view system, a phone manager, a resource manager, a notification manager, and the like.

The window manager is used for managing window programs. The window manager can acquire the size of the display screen, judge whether a status bar exists, lock the screen, intercept the screen and the like.

The content provider is used to store and retrieve data and make such data accessible to applications. The data may include video, images, audio, calls made and received, browsing history and bookmarks, phonebooks, etc.

The view system includes visual controls, such as controls to display text, controls to display pictures, and the like. The view system may be used to build applications. The display interface may be composed of one or more views. For example, a display interface including a text message notification icon may include a view displaying text and a view displaying a picture.

The telephony manager is used to provide the communication functions of the electronic device 500. Such as the management of call status (including on, hung-up, etc.).

The resource manager provides various resources for the application program, such as localization strings, icons, pictures, layout files, video files, and the like.

The notification manager allows the application to display notification information in a status bar, can be used to communicate notification type messages, can automatically disappear after a short dwell, and does not require user interaction. Such as notification manager is used to inform that the download is complete, message alerts, etc. The notification manager may also be a notification in the form of a chart or scroll bar text that appears on the system top status bar, such as a notification of a background running application, or a notification that appears on the screen in the form of a dialog window. For example, a text message is prompted in a status bar, a prompt tone is emitted, the electronic device vibrates, and an indicator light blinks, etc.

Android run time includes a core library and virtual machines. Android run time is responsible for scheduling and management of the Android system.

The core library consists of two parts: one part is a function which needs to be called by java language, and the other part is a core library of android.

The application layer and the application framework layer run in a virtual machine. The virtual machine executes java files of the application program layer and the application program framework layer as binary files. The virtual machine is used for executing the functions of object life cycle management, stack management, thread management, security and exception management, garbage collection and the like.

The system library may include a plurality of functional modules. For example: surface manager (surface manager), media Libraries (Media Libraries), three-dimensional graphics processing Libraries (e.g., openGL ES), 2D graphics engines (e.g., SGL), etc.

The surface manager is used to manage the display subsystem and provides a fusion of 2D and 3D layers for multiple applications.

Media libraries support a variety of commonly used audio, video format playback and recording, still image files, and the like. The media library may support a variety of audio and video encoding formats, such as MPEG4, h.264, MP3, AAC, AMR, JPG, PNG, etc.

The three-dimensional graphic processing library is used for realizing three-dimensional graphic drawing, image rendering, synthesis, layer processing and the like.

The 2D graphics engine is a drawing engine for 2D drawing.

The kernel layer is a layer between hardware and software. The inner core layer at least comprises a display driver, a camera driver, an audio driver and a sensor driver.

It will be appreciated that the components contained in the application framework layer, the system libraries, and the runtime kernel layer shown in FIG. 6 do not constitute a particular limitation on the electronic device 500. In other embodiments of the application, electronic device 500 may include more or fewer components than shown, or may combine certain components, or split certain components, or a different arrangement of components.

In one example, fig. 7a is a schematic structural diagram of a speaker control device according to an embodiment of the present application. As shown in fig. 7a, the audio playing device 700 may include: processor 701, bus 702, memory 703, speaker 704, speaker 705, speaker 706, speaker 707, power amplifier P1, power amplifier P2, power amplifier P3, and power amplifier P4. The processor 701 is communicatively connected to the memory 703 via the bus 702, the power amplifier P1 is connected to the speaker 704, the power amplifier P2 is connected to the speaker 706, the power amplifier P3 is connected to the speaker 705, and the power amplifier P4 is connected to the speaker 707. A power amplifier (e.g., power amplifier P2) is used to control the amplified power of the speaker on the audio signal. In an alternative embodiment, a controllable connection may be established and broken between every two power amplifiers, i.e. a pair of power amplifiers. In general, the connection is disconnected, and when one of the pair of power amplifiers is abnormal, the connection may be connected, and the two speakers are controlled by the power amplifier without abnormality to cope with the speaker abnormality caused by the power amplifier abnormality. The connection may be, for example, a switching circuit controlled by a level signal. For example, as shown in fig. 7a, the power amplifier P1 is abnormal, the audio playing device controls the connection of the power amplifier P1 and the power amplifier P2 to be in a connected state, and the audio playing device can control the amplifying power of the speaker 704 and the speaker 706 to the audio signal through the power amplifier P2.

It will be appreciated that the illustration of fig. 7a may be another illustration of the configuration of the electronic device of fig. 5 described above. The audio playback apparatus 700 shown in fig. 7a is only one example of an audio playback apparatus, and the audio playback apparatus 700 may have more or fewer components than shown in the drawings, may combine two or more components, or may have a different configuration of components. The various components shown in fig. 7a may be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and/or application specific integrated circuits.

Fig. 7b is a schematic structural diagram of a speaker control system according to an embodiment of the present application. As shown in fig. 7b, the speaker control system 800 may comprise a communicatively connected speaker device 801 and a control device 802. The communication connection may be a wired connection or a wireless connection, as embodiments of the application are not limited in this respect. The speaker apparatus 801 includes a speaker 8011, a speaker 8012, a speaker 8013, a speaker 8014, a power amplifier P1, a power amplifier P2, a power amplifier P3, and a power amplifier P4. The control device 802 includes a processor 8021, a bus 8022, and a memory 8023. The speaker, power amplifier, processor and bus in fig. 7b are similar to those in fig. 7a and will not be described here again for the same parts. The difference is that the speaker 801 and the control device 802 in fig. 7b are independent, for example, the control device 802 may be a mobile phone, and the speaker 801 may be a stereo connected to bluetooth of the mobile phone.

It will be appreciated that the speaker control system 800 shown in fig. 7b is only one example of a speaker control system, and that the speaker control system 800 may have more or fewer components than shown, may combine two or more components, or may have a different configuration of components. The various components shown in fig. 7b may be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and/or application specific integrated circuits.

The following describes a speaker control method according to an embodiment of the present application with reference to fig. 8 to 11.

Fig. 8 is a flowchart illustrating a speaker control method according to an embodiment of the present application. As shown in fig. 8, the method for controlling a speaker provided by the embodiment of the present application, which is applied to an audio playing device configured with a plurality of speakers, may include the following steps:

s801, playing an audio signal through a plurality of speakers; wherein, a plurality of speakers are symmetrically distributed, and the number is more than or equal to 3.

The audio playback apparatus may be, for example, a tablet, a car audio system, or the like, and may play audio signals through a plurality of speakers of the audio playback apparatus to detect whether the plurality of speakers are abnormal. In an alternative example, the audio signal played by the audio playing device through the plurality of speakers may be a specified audio signal, that is, a specified audio source, for example, may be a single frequency signal with a resonance frequency (F0) ±100Hz, or a swept frequency signal with a frequency variation range belonging to [20Hz,20khz ]. The resonance frequency (F0) is a frequency corresponding to a point where the diaphragm vibrates most strongly when the speaker starts vibrating from the bass range. The single-frequency signal is an acoustic wave signal whose frequency generated by simple harmonic vibration is fixed and varies sinusoidally. The sweep frequency signal, i.e., the sinusoidal sweep frequency signal, refers to a signal whose frequency varies continuously over a range of frequency bands. In an alternative example, the audio signal played by the audio playing device through the plurality of speakers may be a predetermined sound signal, for example, an audio signal (music played through the speaker of the mobile phone) made by a user (such as a mobile phone user).

In the embodiment of the application, the abnormal-free running state of the loudspeaker when playing the audio signal can be predetermined, and the audio playing device can further pre-store standard state information for indicating the abnormal-free running state of each loudspeaker. Therefore, when the audio playing device plays the audio signal through each loudspeaker, whether the loudspeaker plays abnormally or not can be determined directly according to the pre-stored standard state information, and the method is more convenient and accurate.

In addition, the single-frequency signal and the sweep frequency signal in the above-mentioned alternative examples belong to the audible range of the human ear, and the running state of the loudspeaker can be detected when being played, so that the detection accuracy of abnormal playing of the loudspeaker can be improved, the accuracy of the subsequent running state adjustment of the loudspeaker can be improved, the sound field effect abnormality caused by abnormal playing of the loudspeaker can be further reduced, and the user experience can be improved. The preset sound signal is an audio signal formulated by a user, such as music played by the user, and the audio experience requirement exists for the user when the sound signal is played, so that the audio experience of the user can be timely improved based on the sound signal detection.

In an alternative embodiment, the audio playing device may perform step S801 described above at start-up. Or, the audio playing device may display a user interaction interface for inquiring whether to start calibration when starting, and execute the above step S801 when receiving the instruction information for starting calibration through the user interaction interface. Or, the audio playing device may periodically display a user interaction interface for inquiring whether to start calibration during the operation, and execute the step S801 when receiving the instruction information for starting calibration through the user interaction interface. The embodiment of the present application does not limit the execution conditions of the above step S801.

In addition, the layout of the plurality of speakers on the audio playing device may be referred to the descriptions of fig. 1 to 4 of the present application, and will not be repeated here. The audio playing device may be described with reference to fig. 5 to 7b of the present application, and will not be described herein.

S802, detecting the running state of each loudspeaker on the audio signal to obtain a detection result.

After the audio playing device plays the audio signals through the plurality of speakers, the running state of each speaker on the audio signals can be detected, and a detection result is obtained. Wherein, the detection result of the operation state of each speaker on the audio signal may include: play abnormality or play abnormality. Illustratively, detecting the operation state of each speaker on the audio signal to obtain a detection result may include: detecting the running state of each loudspeaker on the audio signal to obtain current state information indicating the running state of each loudspeaker; determining the difference between the current state information and the standard state information; if the difference is greater than or equal to the difference threshold, determining that the detection result is abnormal play; if the difference is smaller than the difference threshold, determining that the play is abnormal. The standard state information is used for indicating the operation state of the loudspeaker of the audio playing device when no abnormality exists in the playing.

The manner in which the audio playback apparatus obtains the current state information and the detection result will be specifically described below.

In an alternative embodiment, in the case that the audio playing device is configured with a Microphone (MIC), the audio playing device may collect an audio signal played by the audio playing device by using the MIC to obtain a first sound field audio signal; determining a difference between the first sound field audio signal and a pre-stored second sound field audio signal; if the difference is larger than the preset signal difference, determining that the detection result is abnormal play. In an alternative embodiment, the audio playing device collects the audio signal played by the audio playing device by using the MIC to obtain a first sound field audio signal, which may include: the audio playing device controls each loudspeaker to independently play audio signals, and the MIC is utilized to respectively collect the audio signals played by each loudspeaker so as to obtain the first sound field audio signals of the loudspeaker. Accordingly, for each speaker, determining a difference between a first sound field audio signal of the speaker and a pre-stored second sound field audio signal of the speaker; if the difference is larger than the preset signal difference, determining that the detection result of the loudspeaker is abnormal playing.

For example, the number of microphones may be plural, and the configuration position may be near each speaker of the audio playing device. Alternatively, the number of microphones may be one, and the configuration position may be an intermediate position of all speakers of the audio playing device, for example, intermediate between the speaker 401 and the speaker 402 of the audio playing device shown in fig. 4 of the present application, and the same distance as the distance between the speaker 403 and the speaker 404. The first sound field audio signal corresponds to current state information. The second sound field audio signal corresponds to standard state information, and is an audio signal played by the audio playing device collected by the microphone when the playing of the loudspeaker of the audio playing device is abnormal. The second sound field audio signal may be pre-acquired by a manufacturer of the audio playback apparatus and stored in the audio playback apparatus. The difference between the first sound field audio signal and the pre-stored second sound field audio signal may be a difference in signal characteristics such as waveform, frequency, etc. of the signals, and/or may be a difference in loudness.

In an alternative example, as shown in fig. 7a and 7b of the present application, one power amplifier may be configured for each speaker of the audio playback device. The audio playing device can acquire the current input power of the loudspeaker corresponding to each power amplifier from each power amplifier; acquiring the current volume level of each loudspeaker; according to the current volume level of each loudspeaker, searching standard input power corresponding to the current volume level from a pre-stored power configuration table of each loudspeaker; determining a difference between the current volume level of each speaker and the found standard input power; if the difference is greater than or equal to a preset power difference threshold, determining that the detection result is abnormal in playing, and if the difference is less than the preset power difference, determining that the detection result is abnormal in playing. The pre-stored power profile may include: the standard input power of each speaker corresponding to each level of volume. The standard input power is used for indicating the input power of each loudspeaker corresponding to each level of volume when the loudspeaker of the audio playing device plays no abnormality. For example, the audio playing device is a primary volume, and the standard input power of the speaker is a first power; the audio playing device is of a secondary volume, and the standard input power of the loudspeaker is of a second power.

In an alternative example, as shown in fig. 7a and 7b of the present application, one power amplifier may be configured for each speaker of the audio playback device. The audio playing device can acquire the current theoretical amplitude and the current input power of the loudspeaker corresponding to each power amplifier from each power amplifier; searching the corresponding relation between the pre-stored standard theoretical amplitude of each loudspeaker and each level of power to obtain the standard theoretical amplitude corresponding to the current input power; determining a difference between the current volume level of each speaker and the found standard theoretical amplitude; if the difference is larger than or equal to the preset theoretical amplitude threshold, determining that the detection result is abnormal in playing, and if the difference is smaller than the preset theoretical amplitude difference, determining that the detection result is abnormal in playing. The standard theoretical amplitude may include: the loudspeaker of the audio playing device plays the theoretical amplitude of each loudspeaker corresponding to the input power of each stage when no abnormality exists. The theoretical amplitude of each speaker for each stage of power may include: the power amplifier (for example, may be an intelligent power amplifier SmartPA) of the audio playing device calculates the amplitude of the speaker according to the electrical signal of the speaker corresponding to each level of power.

In an alternative example, each speaker of the audio playback apparatus may be configured with a vibration measurement sensor (e.g., an electroacoustic sensor, a small acceleration sensor, etc.), that is, an electroacoustic sensor, a small acceleration sensor, etc. are mounted in one-to-one correspondence with the speaker of the audio playback apparatus near the corresponding speaker, e.g., at a distance from the corresponding speaker that is less than or equal to a distance threshold. Accordingly, the audio playing device may measure the current vibration measurement parameters of the speaker corresponding to each vibration measurement sensor. Wherein, the speaker vibration measurement parameter corresponding to each level of power may include at least one of: and measuring the vibration frequency and the vibration amplitude of the loudspeaker corresponding to each level of power, and obtaining a vibration frequency measurement value and a vibration amplitude measurement value. The audio playing device can acquire the current input power of the loudspeaker corresponding to each power amplifier from each power amplifier; searching the corresponding relation between the pre-stored standard measurement amplitude of each loudspeaker and each level of power to obtain the standard measurement amplitude corresponding to the current input power; determining a difference between the current volume level of each speaker and the looked-up standard measurement amplitude; if the difference is larger than or equal to the preset measurement amplitude threshold value, determining that the detection result is abnormal in playing, and if the difference is smaller than the preset measurement amplitude difference, determining that the detection result is abnormal in playing. The standard measured amplitude may include: the loudspeaker of the audio playing device plays the measured amplitude of each loudspeaker corresponding to each level of input power when no abnormality exists.

The playback anomalies determined by the audio playback device based on the current input power may indicate speaker loudness anomalies, e.g., loudness greater than standard, i.e., loudness less than loudness lesser. The playback anomalies determined by the audio playback device based on the current theoretical amplitude and the current vibration measurement parameters may indicate speaker frequency anomalies, such as frequencies greater than the standard frequency, i.e., higher frequencies, and frequencies less than the standard loudness, i.e., lower frequencies. The playback abnormality determined when any one of the current input power, the current theoretical amplitude, and the current vibration measurement parameter is 0 may indicate a speaker damage abnormality, for example, an abnormality of speaker silence, line disconnection, or the like.

It can be understood that the audio playing device may detect at least one of the current input power, the current vibration theoretical parameter and the current vibration measurement parameter of the speaker as the current state information, and may specifically be set according to the application requirement. Accordingly, the structure of the audio playing device is suitable for the measured parameter, and the description of the corresponding structure can be referred to the above description of the embodiment for obtaining the current state information, which is not repeated herein.

For example, the standard state information may be pre-stored in the audio playing device, for example, the standard state information may be an initial parameter, that is, a built-in algorithm for implementing the speaker control method provided by the embodiment of the present application in the audio playing device may be pre-implanted with an initial parameter indicating that the speaker has no abnormal operation state. Wherein the initial parameters may include at least one of the following parameters: a power configuration table of the speakers at each position, theoretical amplitudes of the speakers corresponding to each level of power, and vibration measurement parameters of the speakers corresponding to each level of power.

In addition, the audio playing device can detect the running state of each loudspeaker on the audio signal at the same time. Alternatively, the audio playback apparatus may detect the operation states of each speaker for audio signals in a loop, that is, one by one, for example, referring to fig. 4, the audio playback apparatus may detect the operation states of the speaker 401, the speaker 403, the speaker 404, and the speaker 402 in order, or detect the operation states of the speaker 401, the speaker 402, the speaker 404, and the speaker 403 in order, that is, in a "loop" form. The embodiments of the present application are not limited in this regard.

In the embodiment of the application, the initial parameters for indicating the running state of the loudspeaker without abnormality can comprise the loudspeaker vibration measurement parameters corresponding to each level of power, and can reflect the more real running state of the loudspeaker compared with the mode of only comprising theoretical amplitude or power, thereby improving the detection accuracy of the running state of the loudspeaker, improving the accuracy of the subsequent running state adjustment of the loudspeaker, further reducing the abnormal sound field effect caused by the abnormal playing of the loudspeaker and improving the user experience.

S803, if the detection result is that the playing is abnormal, determining an abnormal reason of the playing abnormality and a speaker identification.

The audio playing device detects the running state of each loudspeaker on the audio signal, and after the detection result is obtained, if the detection result is abnormal playing, the abnormal reason of the abnormal playing and the loudspeaker identification can be determined. In this way, the subsequent audio playing device may construct a new sound field formed by the speakers with abnormal playback and the speakers without abnormal playback by adopting the adjustment manner adapted to the abnormal cause of abnormal playback and the speaker identification in step S804, and the new sound field has a sound field effect of stereo or surround sound.

S803 will be specifically described below in connection with fig. 9 and 10 by way of an exemplary illustration for ease of understanding.

Fig. 9 is a schematic diagram of a speaker control process according to an embodiment of the present application, where the speaker control method according to the embodiment of the present application is applied to the audio playing device 700 shown in fig. 7a, and includes the following steps:

s901, detecting whether to adjust the running state of a loudspeaker; if the adjustment is performed, S902 is executed; if not, S905 is performed.

The steps S901 and S801 to S802 in the embodiment of fig. 8 are similar steps, and the same parts are not repeated here, and detailed descriptions of the embodiment of fig. 8 are described in detail. The difference is in S901:

The detection result obtained by the audio playing device may be specifically an abnormal reason, and if the abnormal reason is not null, the detection result is indicated to be abnormal playing, and if the abnormal reason is null, the detection result is indicated to be abnormal playing. For example, the cause of the anomaly may include a calibratable anomaly or a non-calibratable anomaly. The calibratable abnormality refers to an abnormality that can be solved by adjusting the operation state of the speaker that plays the abnormality, for example, an abnormality of loudness of the speaker, an abnormality of frequency response, or the like. A non-calibratable anomaly refers to an anomaly that cannot be resolved by adjusting the operational state of a speaker playing the anomaly, for example, a damage anomaly of the speaker. For loudness anomalies, frequency response anomalies, and damage anomalies of the speaker, reference may be made to the descriptions already provided above in the description of S802.

If the abnormality is a calibratable abnormality, the operating state of the speakers can be adjusted no matter how many speakers are playing the abnormality. For example, for an audio playback apparatus configured with N (N. Gtoreq.4) speakers, S902 may be performed when M (M. Gtoreq.N) speakers are abnormal and are calibratable. Referring to fig. 9, the abnormality of the speaker 706 is a loudness that is small, and the abnormality of the speaker 705 is a loudness that is large.

S902, speaker identifications "705" and "706" of playback anomalies are determined.

The power amplifier P3 and the power amplifier P2 may feed back the detection result to a chip side (codec) of the audio playing device, for example, may be the processor 701 in fig. 9. In this way, the audio playback apparatus can extract the speaker identifications "705" and "706" of the playback abnormality from the detection results fed back by the power amplifier P3 and the power amplifier P2 for subsequent determination of at least one of the plurality of speakers and operation state adjustment.

Fig. 10 is a schematic diagram of a speaker control process according to an embodiment of the present application, where the process is exemplified by applying the speaker control method according to the embodiment of the present application to the audio playing device shown in fig. 7a, and includes the following steps:

s1001, detecting whether to adjust the operation state of a loudspeaker; if the adjustment is performed, S1002 is executed; if not, S1005 is executed.

The step S1001 is similar to the step S901 of the embodiment of fig. 9 of the present application, and the same parts are not repeated here, and detailed descriptions of the embodiment of fig. 9 of the present application are described. The difference is in S1001: if the abnormality is not calibratable and the number of speakers playing abnormality is less than or equal to half of the total number of speakers of the audio playing device, the operation state of the speakers can be adjusted, that is, a new sound field can be constructed. For example, for an audio playback apparatus configured with N (N. Gtoreq.4) speakers, if K (K < N/2) speakers are abnormal and are non-calibratable, S1002 may be executed. If the abnormality is not calibratable and the number of speakers playing the abnormality is greater than half of the total number of speakers of the audio playing device, S1005 is executed to output a speaker repair prompt. As shown in fig. 10, N/2=4/2=2, and when the number of abnormal speakers is greater than 2, a speaker repair report is output.

The speaker repair reminder may be at least one of a voice reminder, a text reminder, and an image reminder, for example. The speaker repair prompt can indicate the number, position, identification, reason of abnormality and other information of the speakers playing abnormally. For example, a speaker repair reminder may present the cause of an abnormality of speaker 707 as shown in fig. 10 of the present application: silence.

In addition, the audio signals played by the audio playing device through the plurality of speakers are audio signals selected by a user, for example, when the audio signals such as music, movies, audio books and the like are played through the speakers, the current state information when the speakers play the audio signals of different contents generally has a large difference. At this time, the audio playing device may execute S802 according to a preset period, so as to obtain a more accurate running state and obtain a more accurate detection result.

S1002, a speaker identification "707" of the playback abnormality is determined.

The step S1002 is similar to the step S902 of the embodiment of fig. 9 of the present application, and the same parts are not repeated here, and detailed descriptions of the embodiment of fig. 9 of the present application are described. The difference is that the speaker whose playback is abnormal in S1002 is identified as "707".

S804, according to the abnormal reason of abnormal playing and the speaker identification, adjusting the running state of at least one of the plurality of speakers to a target state; wherein the target state is used to construct a sound field with a stereo or surround effect.

After the audio playing device determines the abnormal reason and the speaker identification of the playing abnormality, the running state of at least one of the plurality of speakers in the audio playing device can be adjusted to the target state according to the abnormal reason and the speaker identification of the playing abnormality. At least one of the plurality of speakers is a speaker for supplementing the sound effect of the abnormal speaker among all speakers of the audio playing device.

In an alternative embodiment, the anomaly cause is that when the anomaly can be calibrated, at least one of the plurality of speakers can include a speaker that plays the anomaly. That is, for an abnormal speaker that can calibrate the abnormality, the sound effect of the abnormal speaker can be supplemented by directly adjusting the operation parameters of the abnormal speaker to solve the play abnormality, thereby constructing a sound field having a stereophonic or surround sound effect. Accordingly, the adjusting, by the audio playing device, the operation state of at least one of the plurality of speakers in the audio playing device to the target state according to the abnormal cause of the playing abnormality and the speaker identification may include: the audio playing device determines an operation parameter adjustment amount corresponding to the target state according to the difference between the current state information and the standard state information of the abnormal speaker, and adjusts the operation parameter of at least one of the plurality of speakers according to the operation parameter adjustment amount and the speaker identification.

The operation parameter adjustment amounts may be parameters such as a power compensation value, a gain compensation value, and an EQ (equalization effect for adjusting the sound effect) compensation value. The audio playing device can perform the processing of reducing power, reducing gain and adjusting EQ on the loudspeaker with the abnormal large loudness according to the power compensation value, the gain compensation value and the EQ compensation value; and (5) carrying out power and gain increasing and EQ adjusting treatment on the loudspeaker with low loudness abnormal sound. Thus, the exception handling can be completed in time, and the audio playing device can be restored to the original playing level. For example, as shown in fig. 9, the processing procedure of the speaker control method may further include: s903, the processor 701 instructs the speaker 705 to adjust the gain down and the speaker 706 adjusts the gain up.

In an alternative embodiment, when the abnormality is a non-calibratable abnormality, at least one of the plurality of speakers may include a speaker other than the speaker playing the abnormality among all speakers of the audio playing device. That is, for an abnormal speaker for which an abnormality cannot be calibrated, the operation parameters of speakers other than the abnormal speaker in the audio playback apparatus may be adjusted to supplement the sound effect of the abnormal speaker to solve the playback abnormality, thereby constructing a sound field having a stereophonic or surround sound effect. Accordingly, the adjusting, by the audio playing device, the operation state of at least one of the plurality of speakers in the audio playing device to the target state according to the abnormal cause of the playing abnormality and the speaker identification may include: the audio playing device closes a first loudspeaker symmetrical to the position of the abnormal loudspeaker, determines an operation parameter adjustment amount corresponding to the target state according to the standard operation parameters of the abnormal loudspeaker and the standard operation parameters of the first loudspeaker, and adjusts the operation parameters of a second loudspeaker according to the operation parameter adjustment amount and the loudspeaker mark; the second speaker is a speaker except the abnormal speaker and the first speaker in the speakers of the audio playing device.

As illustrated in fig. 10, the processing procedure of the speaker control method may further include: s1003, the processor 701 instructs the speaker 706 to turn off, and the speakers 704 and 705 up-regulate the gain. That is, the speaker 707 is a speaker which plays an abnormal, the speaker 706 is a first speaker, and the speakers 704 and 705 are second speakers. The processor 701 gives an instruction to the speaker 706 which is symmetrical to the speaker 707 in position, the signal input of the speaker 706 is turned off, and the processor 701 controls the power amplifiers of the other two speakers, namely, the speaker 704 and the speaker 705, to increase the gain, increase the input power and perform EQ adjustment according to the operation parameter adjustment amount.

In an alternative embodiment, after detecting that the speaker is abnormal, the audio playing device may further detect whether the power amplifier corresponding to the speaker is abnormal, and if so, establish a current path between the power amplifier and the power amplifiers in the same group. Wherein every two power amplifiers with the shortest distance can be used as a group of power amplifiers. Alternatively, each of the two speakers with symmetrical positions may be used as a set of power amplifiers. Every second power amplifier can be used as a group of power amplifiers to reduce control and hardware costs. The embodiments of the present application are not limited in this regard.

For example, the audio playing device may detect whether the electrical signal fed back by the power amplifier corresponding to the speaker playing the abnormality is abnormal, and if so, determine that the power amplifier is abnormal. An anomaly of the power amplifier may be, for example, the power amplifier stopping. As shown in fig. 9 or 10, the power amplifier PA1 and the power amplifier PA3 are connected and disconnected controllably as the same group of power amplifiers. The power amplifier PA2 and the power amplifier PA4 are used as the same group of power amplifiers, and are connected and disconnected controllably. When there is an abnormality in the same group of power amplifiers (e.g., PA 4), the audio playback device indicates that the connection is on, i.e., establishes a current path between the same group of power amplifiers. Thus, the power amplifiers (such as PA 3) without abnormality in the same group of power amplifiers can control the work of the two paths of speakers so as to solve the speaker abnormality caused by the power amplifier abnormality. For example, the present embodiment corresponds to the audio playing device adjusting the operation state of the abnormal speaker (e.g. speaker 707) from being controlled by the abnormal power amplifier (e.g. PA 4) to being controlled by the power amplifier without abnormality (e.g. PA 3).

Fig. 11 is a flowchart of a speaker control method according to an embodiment of the present application, where the method may include the following steps:

s1101, starting sound field detection;

s1102, determining speaker information;

s1103, determining whether to adjust the operation state of the loudspeaker according to the loudspeaker information; if the adjustment is performed, S1104 is executed, and if the adjustment is not performed, S1105 is executed;

s1104, executing an operation state adjustment mode corresponding to the speaker information;

s1105, outputting a speaker repair report;

the steps S1101 to S1105 are similar to the steps of the present application that have the same functions in fig. 8 to 10, and for the same parts, the description thereof will not be repeated here, and reference may be made to the existing descriptions in fig. 8 to 10 of the present application. The difference is that in this embodiment the speaker information may include current status information of the speaker and speaker identification.

S1106, outputting inquiry information of whether to personalize adjustment;

the query information may be in the form of audio, video, text, etc., as the application is not limited in this regard. In an alternative embodiment, the query information may include at least one of the following in addition to prompting the user for personalized adjustments: information such as the identification, location, cause of abnormality, etc. of the speaker playing abnormality, and the operation state adjustment mode (such as the operation state adjustment mode performed in fig. 9 or 10) performed by the audio playing device.

S1107, whether an instruction information for personalized adjustment is received or not; if so, S1108 is performed; if not, executing S1109;

the indication information for performing personalized adjustment may be a voice indication of the user, a click command of the user on the query information to indicate the adjustment control, and the embodiment of the application is not limited thereto.

S1108, displaying a personalized adjustment interface, wherein the personalized adjustment interface is used for adjusting sound effect parameters of a loudspeaker by a user;

the personalized adjustment interface can display a parameter adjustment control of at least one of a plurality of speakers contained in the running state adjustment mode, and components such as user-adjustable parameter values and parameter ranges can be preset in the parameter adjustment control so as to guide a user to reasonably adjust.

S1109, closing inquiry information and maintaining the current running state of the loudspeaker.

Under the condition that the audio playing device does not receive the indication information for personalized adjustment, the audio playing device indicates that a user approves the mode of adjusting the running state of the loudspeaker, so that the inquiry information can be closed, and the current running state of the loudspeaker is maintained.

According to the embodiment of the application, under the condition that the running state of the loudspeaker can be adjusted, the corresponding adjusting mode, namely, the running state of at least one of the plurality of loudspeakers is adjusted to the target state, so that a user can perceive the corresponding adjusting effect. On the basis, the abnormal condition of the loudspeaker can be informed to the user by outputting the inquiry information whether to adjust the individuation or not, and the processing mode of the abnormal condition is informed to the audio playing device by the user, so that the user can further adjust and optimize the running state adjusting mode of the loudspeaker executed by the audio playing device according to the self requirement, thereby further reducing the playing abnormality of the loudspeaker and improving the user experience.

It will be appreciated that an audio playback apparatus, such as an electronic device, for example, in order to achieve the above-described functions, comprises corresponding hardware and/or software modules for performing the respective functions. The present application can be implemented in hardware or a combination of hardware and computer software, in conjunction with the example algorithm steps described in connection with the embodiments disclosed herein. Whether a function is implemented as hardware or computer software driven hardware depends upon the particular application and design constraints imposed on the solution. Those skilled in the art may implement the described functionality using different approaches for each particular application in conjunction with the embodiments, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.

In one example, FIG. 12 is a schematic block diagram of an apparatus provided by an embodiment of the present application. As shown in fig. 12, the apparatus 1200 may include: the processor 1201 and transceiver/transceiving pin 1202, optionally, also include a memory 1203.

The various components of the apparatus 1200 are coupled together by a bus 1204, where the bus 1204 includes a power bus, a control bus, and a status signal bus in addition to a data bus. For clarity of illustration, the various buses are referred to in the figures as bus 1204.

Alternatively, the memory 1203 may be used for instructions in the foregoing method embodiments. The processor 1201 may be configured to execute instructions in the memory 1203 and control the receive pins to receive signals and the transmit pins to transmit signals.

The apparatus 1200 may be an electronic device or a chip of an electronic device in the above-described method embodiments.

All relevant contents of each step related to the above method embodiment may be cited to the functional description of the corresponding functional module, which is not described herein.

The present embodiment also provides a computer storage medium having stored therein computer instructions which, when executed on an electronic device, cause the electronic device to perform the above-described related method steps to implement the speaker control method in the above-described embodiments.

The present embodiment also provides a computer program product which, when run on a computer, causes the computer to perform the above-described relevant steps to implement the loudspeaker control method in the above-described embodiments.

In addition, embodiments of the present application also provide an apparatus, which may be embodied as a chip, component or module, which may include a processor and a memory coupled to each other; the memory is configured to store computer-executable instructions, and when the device is operated, the processor may execute the computer-executable instructions stored in the memory, so that the chip executes the speaker control method in the above method embodiments.

The electronic device, the computer storage medium, the computer program product, or the chip provided in this embodiment are used to execute the corresponding methods provided above, so that the beneficial effects thereof can be referred to the beneficial effects in the corresponding methods provided above, and will not be described herein.

It will be appreciated by those skilled in the art that, for convenience and brevity of description, only the above-described division of the functional modules is illustrated, and in practical application, the above-described functional allocation may be performed by different functional modules according to needs, i.e. the internal structure of the apparatus is divided into different functional modules to perform all or part of the functions described above.

In the several embodiments provided by the present application, it should be understood that the disclosed apparatus and method may be implemented in other manners. For example, the apparatus embodiments described above are merely illustrative, e.g., the division of modules or units is merely a logical function division, and there may be additional divisions when actually implemented, e.g., multiple units or components may be combined or integrated into another apparatus, or some features may be omitted or not performed. Alternatively, the coupling or direct coupling or communication connection shown or discussed with each other may be an indirect coupling or communication connection via some interfaces, devices or units, which may be in electrical, mechanical or other form.

The units described as separate parts may or may not be physically separate, and the parts shown as units may be one physical unit or a plurality of physical units, may be located in one place, or may be distributed in a plurality of different places. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

In addition, each functional unit in the embodiments of the present application may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit. The integrated units may be implemented in hardware or in software functional units.

Any of the various embodiments of the application, as well as any of the same embodiments, may be freely combined. Any combination of the above is within the scope of the application.

The integrated units, if implemented in the form of software functional units and sold or used as stand-alone products, may be stored in a readable storage medium. Based on such understanding, the technical solution of the embodiments of the present application may be essentially or a part contributing to the prior art or all or part of the technical solution may be embodied in the form of a software product stored in a storage medium, including several instructions for causing a device (may be a single-chip microcomputer, a chip or the like) or a processor (processor) to perform all or part of the steps of the methods of the embodiments of the present application. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read Only Memory (ROM), a random access memory (random access memory, RAM), a magnetic disk, or an optical disk, or other various media capable of storing program codes.

The embodiments of the present application have been described above with reference to the accompanying drawings, but the present application is not limited to the above-described embodiments, which are merely illustrative and not restrictive, and many forms may be made by those having ordinary skill in the art without departing from the spirit of the present application and the scope of the claims, which are to be protected by the present application.

The steps of a method or algorithm described in connection with the present disclosure may be embodied in hardware, or may be embodied in software instructions executed by a processor. The software instructions may be comprised of corresponding software modules that may be stored in random access Memory (Random Access Memory, RAM), flash Memory, read Only Memory (ROM), erasable programmable Read Only Memory (Erasable Programmable ROM), electrically Erasable Programmable Read Only Memory (EEPROM), registers, hard disk, a removable disk, a compact disc Read Only Memory (CD-ROM), or any other form of storage medium known in the art. An exemplary storage medium is coupled to the processor such the processor can read information from, and write information to, the storage medium. In the alternative, the storage medium may be integral to the processor. The processor and the storage medium may reside in an application specific integrated circuit (Application Specific Integrated Circuit, ASIC). In addition, the ASIC may reside in an electronic device. The processor and the storage medium may reside as discrete components in an electronic device.

Those skilled in the art will appreciate that in one or more of the examples described above, the functions described in the embodiments of the present application may be implemented in hardware, software, firmware, or any combination thereof. When implemented in software, these functions may be stored on or transmitted over as one or more instructions or code on a computer-readable medium. Computer-readable media includes both computer storage media and communication media including any medium that facilitates transfer of a computer program from one place to another. A storage media may be any available media that can be accessed by a general purpose or special purpose computer.

Claims

1. A speaker control method applied to an audio playback apparatus configuring a plurality of speakers, the method comprising:

Controlling the plurality of speakers to play audio signals; wherein the plurality of speakers are symmetrically arranged, and the number of the speakers is more than or equal to 3;

detecting the running state of each loudspeaker on the audio signal to obtain a detection result;

if the detection result is abnormal play, determining an abnormal reason of abnormal play and a speaker identification;

according to the abnormal reason of the abnormal playing and the speaker identification, adjusting the running state of at least one of the plurality of speakers to a target state; wherein the target state is used to construct a sound field having a stereo or surround effect.

2. The method of claim 1, wherein detecting the operational status of each speaker with respect to the audio signal to obtain the detection result comprises:

detecting the running state of each loudspeaker on the audio signal to obtain current state information indicating the running state of each loudspeaker;

determining the difference between the current state information and pre-stored standard state information; the standard state information is used for indicating the running state of the loudspeaker of the audio playing device when no abnormality exists in playing;

if the difference is greater than or equal to the difference threshold, determining that the detection result is abnormal play;

If the difference is smaller than the difference threshold, determining that the play is abnormal.

3. The method of claim 2, wherein the current state information comprises at least one of:

current input power of the speaker, current theoretical amplitude of the speaker, and current vibration measurement parameters of the speaker;

wherein the current input power of the loudspeaker comprises the current input power of a power amplifier of the loudspeaker;

the current theoretical amplitude of the speaker includes an amplitude determined by the power amplifier from an electrical signal currently input to the speaker;

the current vibration measurement parameters of the speaker include at least one of: and measuring the vibration frequency and the vibration amplitude of the loudspeaker corresponding to each level of power, and obtaining a vibration frequency measurement value and a vibration amplitude measurement value.

4. A method according to claim 3, wherein the audio signal comprises: a swept frequency acoustic signal, a single frequency acoustic signal, or a pre-established acoustic signal.

5. The method according to any of claims 2-4, wherein the standard state information comprises at least one of the following:

A power configuration table of each loudspeaker, a standard theoretical amplitude corresponding to each level of power, and a loudspeaker vibration measurement parameter corresponding to each level of power;

wherein the power configuration table comprises: standard input power of each loudspeaker corresponding to each level of volume; the standard input power is used for indicating the input power of each loudspeaker corresponding to each level of volume when the loudspeaker of the audio playing device plays without abnormality;

the standard theoretical amplitude corresponding to each level of power comprises: when the loudspeaker of the audio playing device plays without abnormality, the theoretical amplitude of each loudspeaker corresponding to each level of input power;

the speaker vibration measurement parameters corresponding to each level of power comprise: when the loudspeaker of the audio playing device plays without abnormality, the amplitude of each loudspeaker corresponding to each level of input power is measured.

6. The method of any one of claims 1-5, wherein the cause of the anomaly comprises: a calibratable anomaly or a non-calibratable anomaly;

wherein the calibratable anomalies include anomalies that can be resolved by adjusting the operational state of the speaker playing the anomalies, and the non-calibratable anomalies include anomalies that cannot be resolved by adjusting the operational state of the speaker playing the anomalies.

7. The method of claim 6, wherein adjusting the operational state of at least one of the plurality of speakers to the target state based on the cause of the playback abnormality and the speaker identification comprises:

if the abnormality is a calibratable abnormality, determining an operation parameter adjustment amount corresponding to the target state according to the difference between the current state information indicating the abnormal playing speaker operation state and the standard state information; the standard state information is used for indicating the running state of the speaker with abnormal playing when the speaker with abnormal playing is not abnormal;

and adjusting the operation parameter of at least one of the plurality of speakers according to the operation parameter adjustment amount and the speaker identification.

8. The method according to claim 6 or 7, wherein adjusting the operation state of at least one of the plurality of speakers to the target state according to the abnormality cause of the playback abnormality and the speaker identification comprises:

if the abnormality is a non-calibratable abnormality, closing a first speaker symmetrical to the speaker playing the abnormality;

determining an operation parameter adjustment amount corresponding to a target state according to the standard operation parameters of the speakers with abnormal playing and the standard operation parameters of the first speakers;

Adjusting the operation parameters of a second loudspeaker according to the operation parameter adjustment amount and the loudspeaker mark; the second speaker is a speaker except the abnormal speaker and the first speaker in all speakers of the audio playing device.

9. The method of any of claims 1-8, wherein adjusting the operational state of at least one of the plurality of speakers to a target state based on the abnormality cause of the playback abnormality and the speaker identification comprises:

detecting whether the target power amplifier corresponding to the speaker with abnormal playing is abnormal or not; the audio playing device is also provided with a plurality of power amplifiers, and the power amplifiers are in one-to-one correspondence with the loudspeakers and are respectively used for controlling the corresponding loudspeakers;

if abnormal, establishing a current path between the target power amplifier and the power amplifiers in the same group; wherein each two power amplifiers of the plurality of power amplifiers are a group;

adjusting the power amplifier corresponding to the abnormal playing loudspeaker from the target power amplifier to the same group of power amplifiers; the running state of the abnormal playing loudspeaker comprises a power amplifier corresponding to the abnormal playing loudspeaker.

10. The method of any of claims 1-8, wherein after adjusting the operational state of at least one of the plurality of speakers to a target state based on the abnormality cause of the playback abnormality and the speaker identification, the method further comprises:

outputting inquiry information whether to personalize the adjustment;

if receiving the indication information for personalized adjustment, displaying a personalized adjustment interface;

receiving sound effect parameters input through the personalized adjustment interface;

and adjusting the operation state of at least one of the plurality of speakers according to the sound effect parameters.

11. The method of claim 10, wherein the querying information comprises: information prompting the user whether to personalize the adjustment, and at least one of:

the location of the speaker playing the abnormality, the speaker identification, the cause of the abnormality, and the target state.

12. An electronic device, comprising:

a processor and a transceiver;

a memory for storing one or more programs;

the one or more programs, when executed by the one or more processors, cause the one or more processors to implement the method of any of claims 1-11.

13. A computer readable storage medium comprising a computer program, characterized in that the computer program, when run on a camera, causes the camera to perform the method according to any one of claims 1 to 10.

14. A chip comprising one or more interface circuits and one or more processors; the interface circuit is configured to receive a signal from a memory of an electronic device and to send the signal to the processor, the signal including computer instructions stored in the memory; the computer instructions, when executed by the processor, cause the electronic device to perform the method of any one of claims 1 to 11.

15. A computer program product comprising a computer program which, when executed by an electronic device, causes the electronic device to perform the method of any one of claims 1 to 11.