WO2021036970A1 - Loudspeaker box control method, loudspeaker box, and loudspeaker box system - Google Patents

Abstract

A loudspeaker box control method, a loudspeaker box, and a loudspeaker box system. The method pertains to the fields of smart terminals, human-machine interaction, and the like. The method comprises: a first loudspeaker box acquiring a first sound signal, and a second loudspeaker box acquiring a second sound signal; the first loudspeaker box determining a position of a sound source according to the first sound signal and the second sound signal, and determining a first distance of the sound source to the first loudspeaker box and a second distance of the sound source to the second loudspeaker box; the first loudspeaker box determining a delay difference on the basis of the first distance and the second distance; the first loudspeaker box instructing the second loudspeaker box to emit sound at a second time, the second time being determined according to a first time and the delay difference, and the first time being a sound emission time of the first loudspeaker box; and the first loudspeaker box emitting a third sound signal at the first time, and the second loudspeaker box emitting a fourth sound signal at the second time, wherein the third sound signal and the fourth sound signal are signals of different sound channels of the same audio file. This manner provides users with an improved stereo sound effect for different locations in a room.

Description

Sound box control method, sound box and sound box system

Cross-references to related applications

This application claims the priority of a Chinese patent application filed with the Chinese Patent Office on August 23, 2019, the application number is 201910785595.9, and the application title is "A speaker control method, speaker and speaker system", the entire content of which is incorporated by reference In this application.

Technical field

This application relates to the technical field of terminals, and in particular to a speaker control method, a speaker, and a speaker system.

Background technique

At present, more and more households install speakers to enhance the effect of audio playback. Generally, the main activity area (which can be referred to as the active area) of the people in the room is relatively fixed. For example, if a person spends a long time on the sofa (resting/watching TV/listening to music/reading, etc.), then the area where the sofa is located is the active area. After the speakers are placed in a fixed position in the room, the corresponding position where you can hear better sound effects is also determined. Take two speakers as an example. Suppose that when speaker 1 and speaker 2 are set on both sides of the TV cabinet, there is only a fixed area opposite the TV cabinet (the fixed area is equal to the area 1 where the speaker 1 is located and the area 2 where the speaker 2 is located. Triangular area) can obtain a better stereo sound effect, while in other areas, such as the restaurant area, the stereo sound effect of the speakers will be weakened, which affects the user experience.

Summary of the invention

The purpose of this application is to provide a speaker control method, a speaker, and a speaker system, so that users can obtain better stereo sound effects at different positions in the room.

The above objectives and other objectives will be achieved through the features in the independent claims. Further implementations are embodied in the dependent claims, description and drawings.

In a first aspect, a speaker control method is provided, which can be applied to a speaker group, the speaker group includes a first speaker and a second speaker, the first speaker and the second speaker are set at different positions , The method includes: the first sound box collects a first sound signal, the second sound box collects a second sound signal; the first sound box determines the sound signal according to the first sound signal and the second sound signal. The position of the source; the first sound box determines the first distance between the sound source and the first sound box and the second distance between the sound source and the second sound box; the first sound box is based on the first sound box The time delay difference between the distance and the second distance is determined; the first sound box sends a first instruction to the second sound box, and the first instruction is used to instruct the second sound box to emit a sound at the second time, the The second time is determined based on the first time and the time delay difference. The first time is the sounding time of the first speaker; the first speaker emits a third sound signal at the first time, so The second sound box emits a fourth sound signal at the second moment; wherein, the third sound signal and the fourth sound signal are signals of different channels of the same audio file.

It should be understood that in the speaker control method provided by the present application, the speaker group can adjust the sound parameters (for example, the sounding time) of the first speaker and the second speaker according to the user's position, so that the user can obtain a better sound regardless of where the user is in the room. Good stereo sound effect.

In a possible design, the first sound box determines a first loudness gain according to the first distance; the first sound box determines a second loudness gain according to the second distance; the first sound box determines a second loudness gain according to the The first loudness gain adjusts the loudness of the first sound box; the first sound box sends a second instruction to the second sound box, and the second instruction is used to instruct the second sound box to adjust based on the second loudness gain The loudness of the second sound box.

It should be understood that in the speaker control method provided by the present application, the speaker group can adjust the sound parameters (for example, the sound loudness) of the first speaker and the second speaker according to the user's position, so that the user can obtain a better sound regardless of where the user is in the room. Good stereo sound effect.

In a possible design, the first sound box determining the position of the sound source according to the first sound signal and the second sound signal includes: the first sound box determining the position of the sound source according to the first sound signal The first angle of the sound source in the first coordinate system; the first sound box determines the second angle of the sound source in the first coordinate system according to the second sound signal; the first sound box The position of the sound source is determined according to the first angle, the second angle, and the distance between the first sound box and the second sound box.

It should be understood that in the speaker control method provided by the present application, the speaker group can adjust the sound parameters of the first speaker and the second speaker (for example, sounding time, sound loudness, etc.) according to the user's position, so that no matter where the user is in the room Both can obtain better stereo sound effects. Specifically, the first speaker in the speaker group can perform the calculation process of the user's position. For example, the first speaker collects the user's first sound signal, the second speaker collects the user's second sound signal, and the second application combines the second sound The signal is sent to the first sound box. In this case, the first sound box can determine the first angle of the sound source in the first coordinate system according to the first sound signal; according to the second sound signal, determine that the sound source is in the first coordinate system. The second angle in the coordinate system; and then according to the first angle, the second angle, and the distance between the first sound box and the second sound box, the position of the sound source is determined. Of course, the calculation process of the user position performed by the first speaker can also be performed by the second speaker, that is, the first speaker sends the first sound signal to the second speaker, and the second speaker executes the foregoing process. Of course, another possible implementation is that the first speaker performs the process of calculating the first angle, the second speaker performs the process of calculating the second angle, and then the second speaker sends the calculated second angle information to the first For a sound box, the first sound box determines the position of the sound source according to the received second angle and the first angle calculated by itself, as well as the distance between the first sound box and the second sound box.

In a possible design, before the first sound box determines the position of the sound source according to the first sound signal and the second sound signal, the first sound box determines the first sound signal and the The second sound signal includes a wake-up word.

It should be understood that in the speaker control method provided by the present application, the user can wake up the speaker group (one or more speakers in the speaker group can be awakened), and when the speaker group detects that the sound signal sent by the user includes a wake-up word, the user’s Position, and then adjust the sound parameters of the first and second speakers (for example, sounding time, loudness, etc.) according to the user's position. In this case, when the user makes a sound but does not wake up the speaker group, the speaker group may not perform the above speaker control Method, and when the speaker group is awakened, it can make the user get a better stereo sound effect no matter where the user is in the room.

In a possible design, after the first sound box determines the position of the sound source according to the first sound signal and the second sound signal, and the first sound box emits the first sound at the first moment Three sound signals. Before the second sound box emits the fourth sound signal at the second moment, it is determined that the position of the sound source is in the active area; wherein the active area is that the number of times the user uses the sound box group is greater than The first preset threshold or the area where the frequency of using the speaker group is greater than the second preset threshold.

It should be understood that in the speaker control method provided by the embodiments of the present application, the user can wake up the speaker group. When the speaker group detects that the sound signal sent by the user includes a wake-up word, the user's location is determined. If the user is in the active area, the above is executed. If the speaker control method is not in the active area, the above speaker control method is not executed. When the speaker group implements the speaker control method, the sound parameters of the first speaker and the second speaker can be adjusted according to the user's position (for example, sounding time, sound loudness, etc.), so that no matter where the user is in the room, they can get better Stereo sound effect.

In a possible design, the third sound signal is the left channel signal of the audio file, and the fourth sound information is the right channel signal of the audio file; or, the fourth sound signal Is the left channel signal of the audio file, and the third sound information is the right channel signal of the audio file.

It should be understood that in order to enhance the stereo sound effect, the first speaker in the speaker group can send out the left channel signal, and the second speaker can send out the right channel signal, or the first speaker can send out the right channel signal, and the second speaker can send out Left channel signal.

In a possible design, the first sound box determines the time delay difference based on the first distance and the second distance, including: the first sound box determines the sound propagation speed according to the current temperature; the first sound box According to the first distance and the sound propagation speed, determine a first time length; the first sound box determines a second time length according to the second distance and the sound propagation speed; the first sound box determines a second time length according to the first time length and the sound propagation speed; The second time length determines the time delay difference.

It should be understood that the distance between the user and the first speaker and the second speaker of the speaker group is different. In the speaker control method provided by the present application, the first speaker can determine the time delay difference according to the first distance between the user and the first speaker and the second distance between the user and the second speaker, and then adjust the first speaker and the second speaker according to the time delay difference. The sounding time of the second speaker enables the user to obtain a better stereo sound effect no matter where the user is in the room.

In a possible design, the first sound box determines the sound propagation speed according to the current temperature, including: the first sound box detects the current temperature value; the first sound box detects the current temperature value according to the temperature value and the formula c=331.3+0.606 T, determine the sound propagation speed; where T is the temperature value, and c is the sound propagation speed; or, the first sound box is based on the temperature value and formula

Determine the sound propagation speed; where γ is the ratio of the constant pressure specific heat to the constant volume specific heat, R is the gas constant, T is the temperature value, M is the molar mass of the gas, and c is the sound propagation speed; Or, the first sound box is based on the temperature value and formula

Determine the sound propagation speed; where Pw is the partial pressure of water vapor in the air, T is the temperature value, P is the pressure value detected by the first sound box, and c is the sound propagation speed.

It should be understood that in the speaker control method provided by the embodiments of the present application, when the first speaker calculates the sound propagation speed, the current temperature value is taken into account, so that the calculated sound propagation speed is more accurate, so that the time of the first speaker and the second speaker is more accurate. The delay is more accurate, and the stereo sound effect of the speaker group can be realized more accurately.

In a possible design, the first sound box determines the delay difference according to the first duration and the second duration, including: when the first distance is greater than the second distance, the The first time length is greater than the second time length, the first sound box determines that the difference between the first time length and the second time length is the time delay difference; the second time is the delay of the first time The moment after the time delay difference; when the first distance is less than the second distance, the first time length is less than the second time length, and the first sound box determines the second time length and the first time length The difference in time length is the time delay difference; the second time is a time when the first time is advanced by the time delay difference.

It should be understood that in the speaker control method provided by the embodiments of the present application, when the user is far from the first speaker and closer to the second speaker, the first speaker can emit sound first, and the second speaker can delay sound, so that no matter where the user is A good stereo sound effect can be obtained from any position in the room.

In a possible design, when the first distance is greater than the second distance, the first sound box adjusts the loudness of the first sound box according to the first loudness gain, including: the first sound box Increase the current loudness of the first speaker according to the first loudness gain; the second instruction is used to instruct the second speaker to decrease the current loudness of the second speaker according to the second loudness gain; When the first distance is smaller than the second distance, adjusting the loudness of the first sound box by the first sound box according to the first loudness gain includes: the first sound box reduces the loudness of the first sound box according to the first loudness gain The current loudness of the first sound box; the second instruction is used to instruct the second sound box to increase the current loudness of the second sound box according to the second loudness gain.

It should be understood that in the speaker control method provided by the embodiments of the present application, when the user is far from the first speaker and closer to the second speaker, the first speaker can increase the sound loudness, and the second speaker can reduce the sound loudness, so that No matter where the user is in the room, a better stereo sound effect can be obtained.

In the second aspect, the embodiments of the present application also provide a sound box, which includes modules/units that execute the first aspect or any one of the possible design methods of the first aspect; these modules/units can be implemented by hardware, It can also be implemented by hardware executing corresponding software.

In a third aspect, an embodiment of the present application also provides a speaker, which includes: one or more processors, one or more memories, one or more speakers, one or more microphones, and a communication module; among them, one One or more microphones are used to collect sound signals; a communication module is used to communicate with other speakers; one or more speakers are used to emit sound signals; one or more processors are coupled to the one or more memories; Wherein, one or more memories are used to store computer-executable program codes; wherein, the program codes include instructions, when the one or more processors execute the instructions, the speakers will execute the first aspect and Any possible design technical solution in the first aspect.

In a fourth aspect, an embodiment of the present application provides a chip, which is coupled with a memory in a sound box to implement the first aspect of the embodiment of the present application and any possible design technical solution of the first aspect; in the embodiment of the present application " "Coupled" means that two components are directly or indirectly connected to each other.

In a fifth aspect, a sound box system provided by an embodiment of the present application includes one or more sound boxes, wherein at least one sound box is the sound box described in the second and third aspects above, and the sound box can perform the above All or part of the steps of the first speaker in the first aspect.

In a sixth aspect, an embodiment of the present application provides a sound box system, the sound box system includes a first sound box and a second sound box, the first sound box and the second sound box are set at different positions; the first sound box The sound box and the second sound box can communicate; the first sound box is the sound box described in the second and third aspects above (the sound box can be any one of the possible designs of the first aspect and the first aspect above) The first speaker in the technical solution).

In a seventh aspect, a computer-readable storage medium according to an embodiment of the present application. The computer-readable storage medium includes a computer program. When the computer program runs on a computer, the computer executes the first aspect and Any possible design technical solution in the first aspect.

In an eighth aspect, a program product in the embodiments of the present application, when the computer program product runs on a computer, causes the computer to execute the first aspect of the embodiments of the present application and any possible design technology of the first aspect Program.

Description of the drawings

FIG. 1 is a schematic diagram of an application scenario provided by an embodiment of this application;

FIG. 2 is a schematic diagram of the structure of a sound box provided by an embodiment of the application;

FIG. 3 is a schematic diagram of the structure of a sound box provided by an embodiment of the application;

4A is a schematic diagram of the structure of a sound box provided by an embodiment of the application;

FIG. 4B is a schematic diagram of the speaker box provided in an embodiment of the application for determining the user's position; FIG.

FIG. 5 is a schematic flowchart of a method for controlling a speaker provided by an embodiment of the application;

FIG. 6 is a schematic diagram of establishing a coordinate system between a master speaker and a slave speaker provided by an embodiment of the application;

FIG. 7A is a schematic diagram of determining the position of the sound source of the main speaker provided by an embodiment of the application; FIG.

FIG. 7B is a schematic diagram of determining the position of the sound source of the main speaker provided by an embodiment of the application;

FIG. 8 is a schematic flowchart of another method for controlling a speaker provided by an embodiment of the application;

FIG. 9 is a schematic diagram of determining the position of the sound source of the main speaker provided by an embodiment of the application;

FIG. 10 is a schematic diagram of determining an active area of a speaker provided by an embodiment of the application.

detailed description

The technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application.

Hereinafter, some terms in the embodiments of the present application will be explained to facilitate the understanding of those skilled in the art.

The multiple mentioned in the embodiments of the present application refer to greater than or equal to two. It should be noted that in the description of the embodiments of the present application, words such as "first" and "second" are only used for the purpose of distinguishing description, and cannot be understood as indicating or implying relative importance, nor can it be understood as indicating Or imply the order.

The terms used in the following embodiments are only for the purpose of describing specific embodiments, and are not intended to limit the application. As used in the specification and appended claims of this application, the singular expressions "a", "an", "said", "above", "the" and "this" are intended to also This includes expressions such as "one or more" unless the context clearly indicates to the contrary. It should also be understood that in the embodiments of the present application, "one or more" refers to one, two, or more than two; "and/or" describes the association relationship of associated objects, indicating that there may be three relationships; for example, A and/or B can mean the situation where A exists alone, A and B exist at the same time, and B exists alone, where A and B can be singular or plural. The character "/" generally indicates that the associated objects before and after are in an "or" relationship.

References described in this specification to "one embodiment" or "some embodiments", etc. mean that one or more embodiments of the present application include a specific feature, structure, or characteristic described in conjunction with the embodiment. Therefore, the sentences "in one embodiment", "in some embodiments", "in some other embodiments", "in some other embodiments", etc. appearing in different places in this specification are not necessarily All refer to the same embodiment, but mean "one or more but not all embodiments" unless it is specifically emphasized otherwise. The terms "including", "including", "having" and their variations all mean "including but not limited to", unless otherwise specifically emphasized.

Fig. 1 shows a schematic diagram of an application scenario provided by an embodiment of the present application. As shown in Figure 1, it is a schematic diagram of a living room in a family. As shown in Figure 1, there are speakers in the living room (for example, speakers on the left and right sides of a TV cabinet, such as speaker 1 and speaker 2). When the user moves from one position to another, the two speakers adjust the time delay, gain and other parameters of the sound in real time, so that the user hears the sound in different positions in a synchronized and three-dimensional manner. The position of is fixed, and the position where a better stereo sound effect can be obtained is also fixed.

Fig. 2 shows a functional block diagram of a speaker provided by an embodiment of the present application. In some embodiments, the speaker 100 may include one or more input devices (input devices) 101, one or more output devices (output devices) 102, and one or more processors (processors) 103. The input device 101 can detect various types of input signals (may be abbreviated as input), and the output device 104 can provide various types of output information (may be abbreviated as: output). The processor 103 may receive input signals from one or more input devices 101, generate output information in response to the input signals, and output through one or more output devices 102.

In some embodiments, one or more input devices 101 can detect various types of inputs and provide signals (for example, input signals) corresponding to the detected inputs, and then one or more input devices 101 can input The signal is provided to one or more processors 103. In some examples, the one or more input devices 101 may include any components or components capable of detecting input signals. For example, the input device 101 may include audio sensors (such as one or more microphones), distance sensors, optical or visual sensors (such as cameras, visible light sensors or invisible light sensors), proximity light sensors, touch sensors, pressure sensors, and mechanical A device (for example, a crown, a switch, a button or a key, etc.), a temperature sensor, a communication device (for example, a wired or wireless communication device), etc., or the input device 101 may also be some combination of the above-mentioned various components.

In some embodiments, one or more output devices 102 may provide various types of output. For example, one or more output devices 102 may receive one or more signals (for example, an output signal provided by one or more processors 103), and provide an output corresponding to the signal. In some examples, the output device 102 may include any suitable components or components for providing output. For example, the output device 102 may include an audio output device (for example, one or more speakers), a visual output device (for example, one or more lights or displays), a tactile output device, and a communication device (for example, a wired or wireless communication device) Etc., or the output device 102 may also be some combination of the above-mentioned various components.

In some embodiments, one or more processors 103 may be coupled to the input device 101 and the output device 102. The processor 103 can communicate with the input device 101 and the output device 102. For example, one or more processors 103 may receive input signals from the input device 101 (for example, input signals corresponding to the input detected by the input device 101). The one or more processors 103 may parse the received input signal to determine whether to provide one or more corresponding outputs in response to the input signal. If so, one or more processors 103 may send output signals to the output device 102 to provide output.

FIG. 3 shows a functional block diagram of a speaker 300 provided by another embodiment of the present application. The sound box 300 may be an example of the sound box 100 described in FIG. 2. As shown in FIG. 3, the speaker 300 includes a microphone 301, a speaker 302, a processor 303, a memory 304, and a sensor module 306. It is understandable that the components shown in FIG. 3 do not constitute a specific limitation to the speaker 300, and the speaker 300 may also include more or fewer components than those shown in the figure, or combine certain components, or split certain components. Or different component arrangements.

The processor 303 may include one or more processing units. For example, the processor 303 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), and an image signal processor. (image signal processor, ISP), controller, memory, video codec, digital signal processor (digital signal processor, DSP), baseband processor, and/or neural-network processing unit (NPU) Wait. Among them, the different processing units may be independent devices or integrated in one or more processors. Among them, the controller may be the nerve center and command center of the speaker 30. The controller can generate operation control signals according to the instruction operation code and timing signals to complete the control of fetching and executing instructions. In other embodiments, the processor 303 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 303 is a cache memory. The memory can store instructions or data that have just been used or recycled by the processor 303. If the processor 303 needs to use the instruction or data again, it can be directly called from the memory, which avoids repeated access and reduces the waiting time of the processor 303, thereby improving the efficiency of the system. The processor 303 may run the software code/module of the speaker control method provided in some embodiments of the present application to realize the function of controlling the speaker.

The microphone 301, also known as a "microphone" or a "microphone", is used to collect sound signals (for example, collecting sounds made by users) and convert the sound signals into electrical signals. In some embodiments, one or more microphones 301 may be provided on the speaker 300, such as a microphone array. In other embodiments, in addition to collecting sound signals, the microphone 301 can also realize the function of noise reduction on the sound signals, or can also identify the source of the sound signals, realize the function of directional recording, and so on.

The speaker 302, also called a "speaker", is used to convert audio electrical signals into sound signals. The speaker 300 can play sound signals such as music through the speaker 302.

In some embodiments, the microphone 301 and the speaker 302 are coupled to the processor 303. For example, after the microphone 301 receives the sound signal, it sends the sound signal or the audio electrical signal converted from the sound signal to the processor 303. The processor 303 determines whether to respond to the sound signal or audio electrical signal, and if so, outputs a corresponding output signal, such as playing music through the speaker 302.

The memory 304 may be used to store computer executable program code, where the executable program code includes instructions. The processor 303 executes various functional applications and data processing of the speaker 300 by running instructions stored in the memory. The memory may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, a universal flash storage (UFS), etc., which are not limited in the embodiment of the present application. In some embodiments, the memory 304 may store information such as "wake-up words". In other embodiments, the memory 304 may also store audio information (for example, songs, cross talk, storytelling, etc.).

The sensor module 306 may include an air pressure sensor 306A, a temperature sensor 306B, and so on. It should be understood that FIG. 3 only lists several examples of sensors. In practical applications, the speaker 300 may also include more or fewer sensors, or use other sensors with the same or similar functions to replace the above-listed sensors, etc. , The embodiments of this application are not limited.

The air pressure sensor 306A is used to measure air pressure. In some embodiments, the processor 303 may be coupled with the air pressure sensor 306A, and use the air pressure value measured by the air pressure sensor 306A to assist in the calculation, such as calculating the attenuation coefficient of the sound.

The temperature sensor 306B is used to detect temperature. In some embodiments, the processor 303 may be coupled with the temperature sensor 306B, and use the temperature value measured by the temperature sensor 306B to assist in the calculation, such as calculating the attenuation coefficient of the sound.

The communication module 305 may be a wireless communication module (such as Bluetooth, wireless). The speaker 300 is connected to other devices, such as another speaker, mobile phone, TV, etc., through the communication module 305.

In some embodiments, the speaker 300 may include a display (or display screen), or may not include a display. The display can be used to display the display interface of the application, such as the currently playing song. The display includes a display panel. The display panel can adopt liquid crystal display (LCD), organic light-emitting diode (OLED), active matrix organic light-emitting diode or active-matrix organic light-emitting diode (active-matrix organic light-emitting diode). AMOLED, flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, quantum dot light-emitting diode (QLED), etc. In some embodiments, a touch sensor may be provided in the display to form a touch screen, which is not limited in the embodiment of the present application. The touch sensor is used to detect touch operations acting on or near it. The touch sensor may transmit the detected touch operation to the processor 303 to determine the type of the touch event. The processor 303 may provide visual output related to the touch operation through the display.

In some embodiments, FIG. 3 may also include more devices, such as batteries, USB ports, etc., which are not described in detail in the embodiments of the present application.

FIG. 4A shows a schematic structural diagram of a sound box provided by an embodiment of the present application. The sound box 400 may be an example of the sound box described in FIG. 2 or FIG. 3. As shown in FIG. 4A, the sound box 400 may include a base 401 and a housing 402.

In some embodiments, the base 401 can function as a support. For example, the base 401 can support the housing 402 and the components enclosed in the housing 402 (for example, a processor, a microphone, a speaker, etc.). In some examples, the base 401 may be made of any other supporting material such as metal, plastic, ceramic, etc., or a combination of these materials.

In some embodiments, one or more speakers 406 may be supported on the base 401. For example, the base 401 may support a fixing member 404, and one or more speakers 406 may be provided on the fixing member 404. In some examples, the base 401 may support the fixing member 404 through a supporting column 405 or other methods. The fixing member 404 can be any shape, such as a circle, a square, and so on. In some embodiments, one or more speakers 406 may be arranged on the fixing member 404 in a certain arrangement. For example, one or more speakers 406 may be evenly distributed on the edge of the fixing member 404, for example, the distance between each speaker is the same. In some embodiments, one or more speakers 406 may be coupled with the processor 403. The processor 403 may output audio signals through one or more speakers 406.

In some embodiments, the housing 402 may be any three-dimensional shape such as a cylinder, a cube, or a cube. The housing 402 may enclose components such as the processor 403, the fixing member 404, and one or more speakers 406. The housing 402 may be a single housing member or composed of more than two housing members. For example, the housing 402 may include an upper housing 402a and a side housing 402b. The one or more shell members may be metal, plastic, ceramic, crystal, or a combination of these materials, or any other shell members suitable to be arranged on the sound box, and so on. In some embodiments, the side shell 402b may be a shell with a mesh structure, for example, the mesh may be a round hole, a square hole, a hexagonal hole, or the like. The shell of the mesh structure can play the role of decoration, dustproof, and protection of the internal components of the shell (such as speakers, microphones, etc.), and the shell of the mesh structure can reduce the blocking of the sound output by the speaker.

In some embodiments, the upper casing 402a may be a mesh structure or a casing that is not a mesh structure. The upper housing 402a can be provided with input devices, such as switches, buttons or keys. For example, the switch is used to turn the speaker on or off. Buttons or keys can be used to adjust functions such as volume. In other embodiments, a display screen 409 (such as a touch screen) can be provided on the upper housing 402a, which can be used to receive input, provide visual output, and so on. For example, the name of the song currently playing, the name of the singer, etc. can be displayed on the display screen 409. Of course, the display screen may not be provided on the speaker, which is not limited in the embodiment of the present application.

In some embodiments, the upper housing 402a may be connected to the fixing member 407. One or more microphones 408 can be provided on the fixing member 407. The fixing member 407 can be any shape, such as a circle, a square, and so on. In some embodiments, one or more microphones 408 may be arranged on the fixing member 407 in a certain arrangement. For example, one or more microphones 408 may be evenly distributed on the edge of the fixing member 407, for example, the distance between each microphone is the same. For another example, the center angle a corresponding to each two adjacent microphones (for example, the angle formed by the straight line connecting the two microphones to the center point of the fixing member 407) may be fixed, such as 30 degrees, 60 degrees, and so on.

In some embodiments, one or more microphones 408 may be coupled with the processor 403. The processor 403 may obtain an input signal (such as a sound signal sent by a user) through one or more speakers 406.

In the following embodiments of the present application, the application scenario of FIG. 1 is taken as an example, and the speaker 1 and/or the speaker 2 in FIG. 1 is the speaker 400 shown in FIG. 4A as an example. For the convenience of description, one of the speaker 1 and the speaker 2 is called the main speaker, and the other is called the slave speaker. In some embodiments, the main sound box and the slave sound box may be used in conjunction. For example, the main speaker is used to play the left channel, the slave speaker is used to play the right channel, or the main speaker is used to play the right channel, and the slave speaker is used to play the left channel. In other words, the cooperation of the main speaker and the slave speaker can achieve the stereo sound effect of the audio. In some embodiments, whether a speaker is a master speaker or a slave speaker can be set before the speaker leaves the factory, or it can be user-defined (for example, the speaker accesses the input operation through the touch screen, and the input operation is used to select Whether the speaker is the main speaker or the slave speaker).

In some embodiments, the structure of the main sound box and the slave sound box may be the same. For example, the main sound box and the slave sound box both have the structure shown in FIG. 4A. In other embodiments, the structure of the main speaker and the slave speaker may not be exactly the same. For example, the master speaker may be provided with a display screen, but the slave speaker may not be provided with a display screen. In other embodiments, the functions of some parts of the main speaker and the slave speaker may not be exactly the same. For example, the processor in the main speaker can be used to calculate the delay difference (for example, the time difference between the first duration and the second duration. The first duration can be the time required for the sound from the main speaker to the user, and the second duration can be It is the time required for the sound from the speaker to the user), loudness gain, etc., and the processor in the slave speaker does not have this function.

In some embodiments, audio files (for example, songs, cross talks, storytelling, etc.) can be stored in the memory in the master speaker and/or the slave speaker, and the master speaker and the slave speaker can play the stored audio files. For example, the main speaker can receive input (for example, receiving input operations through the touch screen, or receiving language input through the microphone), and the input can be used to activate the main speaker and/or the slave speaker, or to control the main speaker and the playback of the slave speaker , Switch songs, etc. In some embodiments, one or more microphones in the main speaker collect a sound signal (for example, a sound signal sent by a user), the processor recognizes that the sound signal contains "wake-up word + play song", and the processor determines the memory When the song does not exist in the file, the song can be downloaded from the network side, or prompt information (such as language information) can be output to prompt the user that the song does not exist.

In other embodiments, the master speaker and/or the slave speaker can be connected to other electronic devices (such as mobile phones, televisions), and can be connected in a wired or wireless manner. Take the connection between the main speaker and the mobile phone (for example, Bluetooth connection) as an example. The mobile phone can send the audio signal to the main speaker, so that the main speaker and the slave speaker can play the audio signal (for example, after the main speaker receives the audio signal, the audio signal can be sent to the slave speaker). For example, if the mobile phone is running a music playing application (for example, Kugou Music), and is playing the song "All the Way North", the mobile phone can send the audio signal of the song to the main speaker, so that the main speaker and the slave speaker can play the audio signal. In other embodiments, after the main speaker is connected to the mobile phone, the user can control the mobile phone to perform corresponding operations through the main speaker. Continuing to take the previous example as an example, the user sends out the sound signal "Xiaobai plays songs and listens to her mother" in the room. The main speaker collects the sound signal and can pause the playback all the way to the north. Instead, it outputs the prompt message "It is for you." Seek to listen to what my mother says." For example, the main speaker can find from the local storage whether there is a song listening to mom’s words. If it does not exist, the main speaker can download it from the network side, or the main speaker can send an instruction to the mobile phone. The instruction user instructs the mobile phone to play listening to mom’s words and the phone receives After the instruction is reached, download or play the song online, and send the audio signal of the song to the main speaker, so that the main speaker and the slave speaker play the audio signal of the song (that is, listening to mother's words).

In some embodiments, both the master speaker and the slave speaker can activate the function of automatically recognizing the "wake word". Take the main speaker as an example. After the main speaker activates the function of automatically recognizing the "wake word", all or part of the components (for example, one or more microphones, processors, etc.) in the main speaker are in an enabled state. The sound signal sent by the user in the room is received by one or more microphones in the main speaker. One or more microphones send the received sound signal to the processor, and when the processor determines that the sound signal contains the "wake-up word", it activates other components (for example, one or more speakers). In some embodiments, the "wake-up word" can be set by default when the speaker is shipped from the factory, or it can be user-defined. For example, the "wake-up word" can be "Xiaobai", "Xiaoyin", "Xiaoyi" and so on.

In other embodiments, both the master speaker and the slave speaker can activate the function of automatically recognizing the "wake-up word + play song". Taking the main speaker as an example, after the main speaker activates the function of the automatic device "wake word + play song", all or part of the components (for example, one or more microphones, processors, etc.) in the main speaker are in an enabled state. The sound signal sent by the user in the room is received by one or more microphones in the main speaker. One or more microphones send the received sound signal to the processor, and when the processor determines that the sound signal contains "wake-up word + play song", it activates other components (for example, one or more speakers). For example, the user sends out "Xiaobai play all the way north" in the room. The sound signal collected by the microphone in the main speaker is then sent to the processor. The processor recognizes that the sound signal includes the wake-up word: Xiaobai. It also includes: playing a song, and the processor activates other components (such as one or more speakers). ).

In some embodiments, the main speaker can receive input operations through an input device (such as a touch screen on the main speaker) or through other devices connected to the main speaker, such as a mobile phone. "Or "Wake up word + play song" function, the main speaker can send an instruction to the slave speaker, this instruction is used to instruct the slave speaker to start the automatic recognition of "wake word" or "wake up word + play song" function.

In some embodiments, the main speakers and the slave speakers are placed in different positions in the room. The main sound box can detect the distance D between the main sound box and the slave sound box for use. The distance can be the straight line distance between the main sound box and the slave sound box. After the main speaker detects the distance D, the distance D can be sent to the slave speaker, and the slave speaker does not need to detect the distance D; or the slave speaker can detect the distance D from the main speaker itself for use. Of course, the slave speaker can detect the distance D from the main speaker and then send it to the master speaker, that is, the master speaker does not need to detect the distance D and so on.

Taking the main speaker as an example, as an example, the main speaker can detect the distance between the main speaker and the slave speaker through a distance sensor. The distance sensor may be a laser distance sensor, an infrared distance sensor, or the like. For example, the distance sensor on the main sound box emits infrared light of a specific frequency, which is reflected from the sound box, and the main sound box receives the light emitted from the sound box. The main sound box can calculate the distance between the main sound box and the slave sound box according to the first time when the infrared light is emitted and the second time when the reflected light is received. As another example, the master speaker can also communicate with the slave speaker to achieve the purpose of measuring the distance between the master speaker and the slave speaker. For example, the main speaker transmits a detection signal to the slave speaker, and after receiving the detection signal, the slave speaker sends a feedback signal to the main speaker, and the main speaker receives the feedback signal. The main speaker can determine the distance between the main speaker and the slave speaker according to the second time when the feedback signal is received and the first time when the detection signal is sent. As another example, the main speaker may also receive an input operation through an input device (such as a touch screen on the main speaker), and the input operation is used to input the distance between the main speaker and the slave speaker.

In some embodiments, the user may be anywhere in the room, and the distance between the main speaker and the slave speaker and the user may be different. The main speaker and the slave speaker activate the function of automatically recognizing "wake word" or "wake word + play song". The main speaker and the speaker in the slave speaker collect sound signals. When the main and slave speakers determine that the sound signal contains "wake-up words" or "wake-up words + play songs", the user's position can be judged, and then the sound parameters of the main and slave speakers can be controlled according to the user's position. For example, the sound parameters may include the time delay difference between the main speaker and the slave speaker, loudness gain, and so on. Therefore, in this embodiment, when the master speaker and the slave speaker recognize that the collected sound signal contains "wake word" or "wake word + play song", the sound parameters of the master speaker and slave speaker are adjusted according to the user's position .

Taking the structure shown in FIG. 4A as an example, the process of determining the position of the user by the main speaker and the slave speaker may include: the main speaker collects the sound signal 1. The sound signal is collected from the speaker 2. The main speaker determines that the sound signal 1 includes the "wake-up word", and the slave speaker determines that the sound signal 2 includes the "wake-up word". Of course, in order to improve accuracy, the slave speaker can also send the "wake-up word" included in sound signal 2 or sound signal 2 to the main speaker, and the master speaker determines whether the "wake-up word" in sound signal 1 and sound signal 2 is The same wake word. The main speaker can determine the first direction/azimuth of the user relative to the main speaker according to the sound signal 1. For example, the first direction/azimuth can be expressed as the first angle between the user and the x-axis in the coordinate system constructed by the main speaker . The slave speaker can determine the second direction/azimuth of the user relative to the slave speaker according to the sound signal 2. For example, the second direction/azimuth can be expressed as the second direction of the user between the x-axis and the coordinate system constructed by the slave speaker. angle. The slave speaker can send the second angle to the master speaker, and the master speaker determines the user's position according to the first angle and the second angle, and the distance D between the master speaker and the slave speaker. Specifically, the construction of the coordinate system of the main speaker and the slave speaker, and the process of determining the position of the user by the master speaker and the slave speaker will be described in detail later.

Continuing to take the structure shown in FIG. 4A as an example, the main speaker can determine the first direction/azimuth of the user relative to the main speaker according to the sound signal 1 in many ways. For example, microphone array positioning technology (for example, estimation of the sound source position based on the time difference between the sound signals received by at least two microphones in the microphone array on the main speaker), the beam-direction (steered-beamformer) positioning method, based on high resolution High-resolution spectral analysis (high-resolution spectral analysis) positioning methods, and sound source positioning techniques based on sound time-delay estimation (TDE), etc., are not limited in the embodiment of the present application. Taking the microphone array positioning technology as an example, the process of determining the first direction/azimuth of the user relative to the main speaker by the main speaker according to the sound signal 1 may include; the microphone array 408 in the main speaker collects the sound signal, assuming that the microphone 408-1 and the microphone The strength of the sound signal collected by 408-2 is relatively high. The main speaker can use the first time t1 when the sound signal is collected by the microphone 408-1 and the second time t2 when the sound signal is collected by the microphone 408-2, and the microphone 408- The distance L1 between 1 and the microphone 408-2 (the distance can be stored in the main speaker after leaving the factory), and the sound source, that is, the first position of the user relative to the main speaker is calculated. As shown in Figure 4B, the main speaker can determine the angle A of the user relative to the microphone 408-1 according to (t1-t2)*c and L1, and the trigonometric function relationship. This angle A can be used as the user relative to the main speaker Or, because the included angle A is the included angle of the user relative to the microphone 408-1, the main speaker can transform the included angle A into the coordinate system constructed by the main speaker to obtain the included angle B, The included angle B can also be used as the user's first orientation relative to the main speaker. The structure of the slave speaker and the main speaker can be the same, so the process of determining the second orientation of the user relative to the slave speaker can be similar to the above process.

In other embodiments, in the process of the user continuously emitting sound signals, the main speaker and the slave speaker can collect sound signals in real time and continuously (the sound signals may not include "wake-up words" or "wake-up words + play songs". "), and then determine the user's location, adjust the sound parameters of the main speaker and the slave speaker according to the user's location, until a sound signal containing "wake-up words" or "wake-up words + play songs" is detected, the adjusted sound parameters (For example, the delay difference between the main speaker and the slave speaker, loudness gain, etc.) parameters control the main speaker and the slave speaker to play audio signals.

The following embodiment introduces possible implementations of controlling the sound parameters of the main speaker and the slave speaker according to the user's position.

FIG. 5 shows a schematic flowchart of a speaker control method provided by an embodiment of the present application. As shown in Figure 5, the process can include:

501: The main speaker collects sound signals.

502: Collect sound signals from speakers.

In some embodiments, both the master speaker and the slave speaker are the speakers 400 shown in FIG. 4A. One or more microphones in the main speaker and the slave speaker can always be enabled. Therefore, the microphones in the main speaker and the slave speaker can collect sound signals (for example, the sound signals sent by the user). Taking the main sound box as an example, one or more microphones 408 in the main sound box collect sound signals sent by the user. The one or more microphones 408 send the collected sound signals to the processor 403. The processor 403 recognizes the sound signal. For example, the processor 403 can determine whether the sound signal contains a "wake-up word". If so, the processor 403 activates the main speaker, for example, other components in the main speaker (such as one or more speakers 406, a display screen 409, etc.) Supply power to enable it.

503: The main speaker calculates the first angle of the sound source relative to the main speaker.

504: Calculate the second angle of the sound source from the sound box relative to the sound box.

Taking the main sound box as an example, and taking the main sound box having the structure shown in FIG. 4A as an example, referring to FIG. 6, the main sound box can establish a first coordinate system. For example, take the edge of the display screen on the main speaker as the coordinate origin, the gravity direction as the z-axis direction, the short side of the display screen is the x direction, and the long side is the y-axis direction to establish the x1-y1-z1 coordinate system. The main speaker can determine the first position of the sound source level user in the coordinate system, for example, the first angle between the user and the x1 axis

Or, the functional relationship between the position of the user and the ray formed by the origin of the first coordinate system in the x1-y1-z1 coordinate system. In other embodiments, if the display screen is not provided on the main sound box, the coordinate system can also be constructed in other ways. For example, the coordinate system is constructed with the center point of the main sound box as the coordinate origin, the direction of gravity as the z-axis direction, and the direction from the center point to a microphone in the main sound box as the x-axis direction. The way.

In some embodiments, as shown in FIG. 6, the second coordinate system (such as the x2-y2-z2 coordinate system in the figure) can also be established from the sound box. The way of constructing the coordinate system from the speaker and the main speaker can be the same. The second position of the user in the coordinate system constructed by the speaker can be determined, such as the second angle l between the user and x2.

As described above, the process of determining the first orientation of the user relative to the main speaker by the master speaker, and determining the second orientation of the user relative to the slave speaker by the slave speaker, will not be repeated here.

505: The slave speaker sends the calculation result to the master speaker.

In some embodiments, after constructing the second coordinate system from the sound box, that is, the x2-y2-z2 coordinate system, the calculation result from the sound box may be the second angle l. Therefore, the secondary speaker can send the second angle l to the main speaker. The main speaker can determine the position of the user according to the first angle and the second angle, and the distance D between the main speaker and the slave speaker. Of course, in some other embodiments, the calculation result of the slave speaker can also be the function of the second ray formed by the second included angle l in the second coordinate system, that is, the x2-y2-z2 coordinate system, that is, the position of the user The functional relationship of the ray formed in the second coordinate system with the origin of the second coordinate system, and the secondary speaker can send the functional relationship of the second ray to the main speaker.

506: The main speaker calculates the position of the sound source.

Example 1, if the second angle l is sent from the speaker to the main speaker. Referring to FIG. 7A, after the main sound box receives the second angle l sent from the sound box, the second ray can be determined according to the second angle l in the x1-y1-z1 coordinate system, such as the second ray shown in FIG. 7A. The main speaker can also be based on the first angle

Determine the first ray in the x1-y1-z1 coordinate system. The main speaker determines that the intersection Q between the first ray and the second ray is the position of the user.

Example 2: If the slave speaker sends the second ray function relationship formed by the second angle l in the second coordinate system, that is, the x2-y2-z2 coordinate system, to the main speaker. Then the main speaker receives the functional relationship of the second ray (for example, y=ax+b), and the functional relationship is determined in the coordinate system constructed from the speaker, which is not the same coordinate as the coordinate system constructed by the main speaker system. Therefore, the main sound box can perform coordinate conversion on the function relationship of the second ray, and convert it to the function relationship of the third ray in the x1-y1-z1 coordinate system constructed by the main sound box. In this case, the main speaker can determine that the intersection between the first ray and the third ray is the position of the user. Exemplarily, referring to FIG. 7B, after the main sound box receives the functional relationship of the second ray corresponding to the second angle l, the second ray is identified in the x1-y1-z1 coordinate system, because the second ray is not at x1. -y1-z1 coordinate system, so the second ray can be translated by the distance D along the z1 direction to obtain the third mathematical relationship. The third ray corresponding to the third mathematical relationship is the second ray in the main speaker x1-y1 -The representation in the z1 coordinate system. After the main speaker performs coordinate conversion of the second ray, the intersection point between the first ray and the third ray can be determined (for example, solving the equation formed by the first mathematical relationship corresponding to the first ray and the third mathematical relationship corresponding to the third ray Group), the intersection is the location of the sound source (for example, the user).

507: The main speaker determines the first distance d1 from the sound source to the main speaker, and the second distance d2 from the sound source to the slave speaker.

In some embodiments, after the main sound box determines the intersection point between the first ray and the third ray, the distance d1 between the intersection point and the main sound box (such as the origin of the first coordinate system) can be determined according to the law of triangles, or it can be determined The distance d2 between the intersection point and the secondary speaker (for example, the distance between the intersection point and the intersection point A of the third ray and the -z1 axis on the first coordinate system).

508: The main speaker calculates the time delay difference according to the first distance d1 and the second distance d2.

In some embodiments, the main speaker can determine the time delay difference between the first distance d1 and the second distance d2 according to the following formula:

d1/c=t1;

d2/c=t2;

t1-t2=Δt;

Among them, c is the sound propagation speed, t1 is the time required for the sound signal to travel from the main speaker to the user, t2 is the time required for the sound signal to travel from the speaker to the user, Δt is the sound signal propagating in the first distance d1 and the second distance d2 The delay is poor. In some embodiments, the sound propagation speed may be affected by various factors, such as temperature and air pressure. The following embodiments introduce several possible ways of determining c.

Method 1: c can be obtained based on the following formula:

c=331.3+0.606T

Where T is the temperature value detected by the temperature sensor in the main speaker.

Method 2: c can also be obtained based on the following formula:

Among them, γ is the ratio of constant pressure specific heat to constant volume specific heat, and the value of γ can be fixed, such as γ=1.4; R is the gas constant of 287J/(kg·K), and T is the temperature detected by the temperature sensor ( For example, absolute temperature); M is the molar mass of the gas, and the value of M can be fixed, such as 22.4L/mol.

Method 3: c can also be obtained based on the following formula:

Pw is the partial pressure of water vapor in the air (for example, Pw=saturated vapor pressure and relative humidity of water), and Pw can be a fixed value, such as a value pre-stored in the main speaker. T is the temperature value detected by the temperature sensor in the main speaker, and P is the pressure value detected by the air pressure sensor in the main speaker.

In some embodiments, after the main speaker determines the time delay difference Δt, the time delay of the sound of the main speaker or the slave speaker can be adjusted based on the time delay difference Δt, so that the time for the sound from the main speaker and the slave speaker to reach the user is consistent. .

For example, when the main speaker determines that d1>d2, one or more speakers in the slave speaker can be controlled to delay sound by Δt. For example, the master speaker can send a command to the slave speaker, and the command can carry the sounding time point of the master speaker and the length of time the slave speaker needs to delay. After receiving the instruction from the speaker, the sounding time of the main speaker and the length of time the slave speaker needs to be delayed can be determined. In this case, delaying the sound from the speaker can make the sound from the main speaker and the slave speaker reach the user at the same time.

For another example, when the master speaker determines that d1<d2, the master speaker can issue an instruction to the slave speaker, and the instruction is used to indicate the sounding time point of the slave speaker. The main speaker controls its own one or more speakers to delay a certain period of time based on the sounding time point before sounding. In this case, the sound of the main speaker is delayed so that the sound from the main speaker and the slave speaker can reach the user at the same time.

For another example, when the master speaker determines that d1=d2, the master speaker can issue an instruction to the slave speaker, and the instruction is used to indicate the sounding time point of the slave speaker. The main speaker controls its own one or more speakers to sound at the sounding time point.

509: The main speaker calculates the loudness gain according to the first distance d1 and the second distance d2.

In some embodiments, the main speaker can determine the loudness gain by the following formula:

e1=d1×α1;

e2=d2×α2;

Among them, e1 and e2 are loudness gains, d1 is the distance between the main speaker and the sound source, d2 is the distance between the slave speaker and the sound source, and α1 and α2 are the sound attenuation coefficients. Because the sound attenuation coefficient will be affected by many factors, such as air pressure, temperature and so on. The following embodiments introduce several possible ways of determining the sound attenuation coefficient.

Method 1: The sound attenuation coefficient can be obtained by the following formula:

Among them, P0 is the standard atmospheric pressure (1013.25 hPa), P is the pressure value detected by the pressure sensor, T0 is 293K, and T is the temperature detected by the temperature sensor. f is the sound frequency of the speaker. In some embodiments, the value of f may be preset by the sound box. For example, f may be related to the performance specifications of the speaker in the sound box. The sound frequency of the sound box is set before the sound box leaves the factory.

Method 2: The sound attenuation coefficient can be obtained by the following formula:

α=α _c1 +α _rot +α _vib (O ₂ )+α _vib (N ₂ )

Among them, α _cl is the classical part caused by viscosity and thermal conductivity, α _rot is the rotational relaxation part caused by the relaxation process of rotating excited molecules, and the vibration relaxation part caused by the relaxation process of _{α vib vibration excited molecules.} In some embodiments, α _cl , α _rot and α _vib can be obtained by the following formula:

Among them, P0 is the standard atmospheric pressure (1013.25 hPa), P is the pressure value detected by the pressure sensor, T0 is 293K, and T is the temperature detected by the temperature sensor. f is the sound frequency of the speaker. f _r,o represents the vibrational relaxation frequency of oxygen molecules; f _r,N represents the vibrational relaxation frequency of nitrogen molecules; f _r,o and _fr,N can be obtained by the following formula:

Among them, q is the specific humidity, when a given wet pressure e, q=100ep, p is the pressure detected by the air pressure sensor, p0 is 101325N/m2, T is the temperature detected by the temperature sensor, and T0 is 293K. Among them, the wet pressure e can be used to indicate the vapor pressure in the air. For example, the sound box includes a sensor, which can be used to detect the water vapor pressure in the air; for another example, the sound box can query the water vapor pressure in the current control on the network side (for example, weather service).

In some embodiments, after the master speaker determines e1 and e2, the loudness gain of one or more speakers in the master speaker and the slave speaker can be adjusted based on e1 and e2.

In some embodiments, the main speaker can control the loudness of one or more speakers to increase e1. The master speaker can also send an instruction to the slave speaker, which is used to instruct the loudness of one or more speakers in the slave speaker to increase by e2.

In other embodiments, when the main speaker determines that d1>d2, the loudness of one or more speakers in the main speaker can be controlled to increase e1, and the loudness of the slave speaker may not increase. Or, when the main speaker determines that d1<d2, the main speaker may send an instruction to the slave speaker, which is used to instruct the loudness of one or more speakers in the slave speaker to increase by e2, and the loudness of the main speaker may not increase. Or, when the main speaker determines that d1=d2, both the main speaker and the slave speaker may not increase the loudness, or the loudness of the main speaker increases by e1, and the loudness of the slave speaker increases by e2.

510: The main speaker controls the sound playback of the main speaker and the slave speaker according to the delay difference and loudness gain. Specifically, 510 includes 510a and 510b, where 510a controls the playback of the main speaker, and 510b controls the playback of the master speaker and the slave speaker.

In some embodiments, the process of calculating the delay difference and the loudness gain of the main speaker may occur simultaneously or differently, which is not limited in the embodiment of the present application.

In some embodiments, the above process of calculating the position of the sound source based on the first ray and the second ray may also be performed by the slave speaker. For example, after the master speaker determines the first angle, the related information of the first angle (such as the first angle, Or the first mathematical relationship of the first ray formed by the first angle in the first coordinate system) is sent to the slave speaker, and the slave speaker calculates the position of the sound source, the time delay difference, and the loudness gain.

In other embodiments, the slave speaker may not have the computing capability (for example, it does not have the computing capability of calculating the second orientation of the sound source relative to the slave speaker). Refer to FIG. 8, which is a schematic flowchart of a speaker control method provided by another embodiment of this application. As shown in Figure 8, the process may include:

801: The main speaker collects sound signals.

802: Collect sound signals from speakers.

The description of 801 and 802 can refer to the description of 501 and 502 in the embodiment shown in FIG. 5, which is not repeated here.

803: Send the collected sound signal from the speaker to the main speaker.

804: The main speaker calculates the first angle of the sound source relative to the main speaker, and the second angle of the sound source relative to the slave speaker.

In some embodiments, the slave speaker does not have the calculation ability (for example, it does not have the calculation ability to calculate the second orientation of the sound source relative to the slave speaker), so the slave speaker cannot calculate the second angle of the sound source relative to the slave speaker. The slave speaker can send the collected sound signal to the main speaker. In some embodiments, one or more microphones are included in the sound box, and the sound signals collected by each microphone are different. From the speaker, the sound signal collected by each microphone can be sent to the main speaker. In some examples, if the distribution of microphones in the microphone array in the main speaker and the slave speaker are the same, when the main speaker receives the sound signal collected by each microphone sent from the speaker, it can be mapped to the microphone in the main speaker. Exemplarily, each microphone in the main speaker and the slave speaker is set with a number. The sound signal sent from the sound box to the main sound box includes: sound signal 1 corresponding to microphone 1, sound signal 2 corresponding to microphone 2, and sound signal 3 corresponding to microphone 3. After the main speaker receives the sound signal (for example, the sound signal group composed of sound signal 1, sound signal 2 and sound signal 3), it can be mapped to the microphone in the main speaker, that is, the microphone 1 in the main speaker collects the sound signal 1. The microphone 2 collects the sound signal 2, and the microphone 3 collects the sound signal 3. Therefore, for the main speaker, two/groups of sound signals are collected, one/group of sound signals is collected and sent by the user, and the other/group of sound signals is received and sent from the speaker. The two/groups of sound signals can be different, for example, different loudness, etc. The main speaker can calculate an angle according to each/group of sound signals to get two angles, such as the first angle

And the second angle l.

805: The main speaker calculates the position of the sound source.

See Figure 9, the main speaker can be based on the first angle

The first ray is determined, and the second ray is determined according to the second angle l and the distance D. The main sound box determines the intersection of the first ray and the second ray, and the intersection is the location of the user.

806: The main speaker calculates the first distance between the sound source and the main speaker, and the second distance between the sound source and the slave speaker.

In some embodiments, after the main sound box determines the intersection of the first ray and the second ray, the first distance d1 between the sound source and the main sound box and the second distance d2 between the sound source and the main sound box can be determined according to the triangle law.

807: The main speaker calculates the delay difference and/or loudness gain based on the first distance and the second distance.

For the process of determining sound parameters such as time delay difference and loudness gain, refer to the introduction of the embodiment shown in FIG. 5, such as steps 508 and 509 in FIG. 5.

808, the main speaker controls the sound playback of the main speaker and the slave speaker according to the delay difference and loudness gain. Specifically, 808 includes 808a and 808b, where 808a controls the playback of the main speaker, and 808b controls the playback of the slave speaker.

In other embodiments, the main speaker may not have the computing capability (for example, it does not have the computing capability to calculate the first orientation of the sound source relative to the main speaker). Therefore, the execution steps of the slave speaker in Figure 8 are executed by the master speaker. The steps of the speaker are performed by the slave speaker.

In some embodiments, after the main speaker and/or the slave speaker are turned on (every time it is turned on or the first time after purchase), the location where the user often listens to music can be counted. In some examples, as shown in FIG. 10, the main speaker and/or the slave speaker receive a voice command, the voice command is used to activate the speaker, and the master speaker and/or the slave speaker determine the user's first position based on the voice command. The master speaker and/or the slave speaker store the first position. When the main sound box and/or the slave sound box detects a voice command again, the sound command is used to start the sound box to play a song, and the master sound box and/or the slave sound box determine the user's second position based on the voice command, and store the second position. Therefore, the main speaker and/or the slave speaker can determine several positions of the user. For example, all the black solid points in Figure 10 are the user's position determined by the main speaker and/or the slave speaker. The main speaker and/or the slave speaker can determine all the coordinate points of the position where the distance between the two coordinate points is less than the preset distance, and then the area constituted by these coordinate points can be determined according to the minimum envelope circle. That is, the area where the user listens to music for a long time can be called the active area, such as the area formed by densely distributed points in FIG.

In some embodiments, the main sound box and the slave sound box collect the sound signals emitted by the sound source. When the main speaker determines that the sound signal includes "wake-up word" or "wake-up word + play song", the location of the sound source is determined. The main speaker can determine whether the sound source position is in the active area. If so, control the sound of the main speaker and the slave speaker based on the process shown in Figure 5 or Figure 7 above. If not, you do not need to use the sound source shown in Figure 5 or Figure 7 above. The process controls the sound of the master speaker and the slave speaker. In some embodiments, the "active area" may be a location where users often listen to music.

For example, the user emits the sound source "Xiaobai plays all the way north" at the door. The main speaker receives the sound signal, determines that the sound signal includes "wake-up word + play song", and determines the user's location. If the main speaker determines that the position is not in the active area, there is no need to adjust the sound parameters of the main speaker and the slave speaker (such as loudness gain, delay difference, etc.), for example, the main speaker and the slave speaker sound at the same time, or use the last used sound Parameters control the sound, or use the default sound parameters (for example, the factory default settings) to control the sound. In this case, the main speaker judges that the user is not in the active area, so there is no need to adjust the sound parameters (such as loudness gain, delay difference) according to the user's location, which helps to save power consumption.

The various embodiments of the present application can be combined arbitrarily to achieve different technical effects.

In the above-mentioned embodiments provided by the present application, the method provided by the embodiments of the present application has been introduced from the perspective of a speaker (main speaker and/or slave speaker) as the execution subject. In order to implement the functions in the methods provided in the above embodiments of the present application, the terminal device may include a hardware structure and/or a software module, and implement the above functions in the form of a hardware structure, a software module, or a hardware structure plus a software module. Whether a certain function of the above-mentioned functions is executed by a hardware structure, a software module, or a hardware structure plus a software module depends on the specific application and design constraint conditions of the technical solution.

As used in the above embodiments, depending on the context, the term "when" or "after" can be interpreted as meaning "if..." or "after" or "in response to determining..." or "in response to detecting …". Similarly, depending on the context, the phrase "when determining..." or "if detected (statement or event)" can be interpreted as meaning "if determined..." or "in response to determining..." or "when detected (Condition or event stated)" or "in response to detection of (condition or event stated)". In addition, in the above embodiments, relationship terms such as first and second are used to distinguish one entity from another entity, and any actual relationship and order between these entities are not limited.

In the above-mentioned embodiments, it may be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented by software, it can be implemented in the form of a computer program product in whole or in part. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on the computer, the processes or functions described in the embodiments of the present invention are generated in whole or in part. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions may be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions may be transmitted from a website, computer, server, or data center. Transmission to another website site, computer, server or data center via wired (such as coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (such as infrared, wireless, microwave, etc.). The computer-readable storage medium may be any available medium that can be accessed by a computer or a data storage device such as a server or a data center integrated with one or more available media. The usable medium may be a magnetic medium (for example, a floppy disk, a hard disk, and a magnetic tape), an optical medium (for example, a DVD), or a semiconductor medium (for example, a solid state disk (SSD)).

It should be pointed out that a part of this patent application file contains content protected by copyright. Except for making copies of the patent documents or the contents of the recorded patent documents of the Patent Office, the copyright owner reserves the copyright.

Claims (14)

1. A sound box control method, applied to a sound box group, the sound box group including a first sound box and a second sound box, the first sound box and the second sound box are arranged in different positions, characterized in that the method includes :

   The first sound box collects a first sound signal, and the second sound box collects a second sound signal;

   Determining the position of the sound source by the first sound box according to the first sound signal and the second sound signal;

   Determining, by the first sound box, a first distance between the sound source and the first sound box and a second distance between the sound source and the second sound box;

   Determining, by the first sound box, a time delay difference based on the first distance and the second distance;

   The first sound box sends a first instruction to the second sound box. The first instruction is used to instruct the second sound box to emit a sound at a second time. The second time is based on the first time and the time. If the delay is determined, the first moment is the sounding time of the first speaker;

   The first sound box emits a third sound signal at the first moment, and the second sound box emits a fourth sound signal at the second moment; wherein the third sound signal and the fourth sound signal are Signals of different channels of the same audio file.
2. The method of claim 1, wherein the method further comprises:

   Determining, by the first speaker, a first loudness gain according to the first distance;

   Determining, by the first speaker, a second loudness gain according to the second distance;

   Adjusting the loudness of the first sound box according to the first loudness gain by the first sound box;

   The first sound box sends a second instruction to the second sound box, where the second instruction is used to instruct the second sound box to adjust the loudness of the second sound box based on the second loudness gain.
3. The method according to claim 1 or 2, wherein the first sound box determining the position of the sound source according to the first sound signal and the second sound signal comprises:

   Determining, by the first sound box, a first angle of the sound source in a first coordinate system according to the first sound signal;

   Determining, by the first sound box, a second angle of the sound source in the first coordinate system according to the second sound signal;

   The first sound box determines the position of the sound source according to the first angle, the second angle, and the distance between the first sound box and the second sound box.
4. The method according to any one of claims 1 to 3, wherein before the first sound box determines the position of the sound source according to the first sound signal and the second sound signal, the method further comprises:

   The first sound box determines that the first sound signal and the second sound signal include a wake-up word.
5. The method according to any one of claims 1 to 4, wherein after the first sound box determines the position of the sound source according to the first sound signal and the second sound signal, and after the first sound box determines the position of the sound source The sound box emits a third sound signal at the first time, and before the second sound box emits a fourth sound signal at the second time, the method further includes:

   Determining that the position of the sound source is in the active area;

   Wherein, the active area is an area where the number of times the user uses the speaker group is greater than a first preset threshold or the frequency of using the speaker group is greater than a second preset threshold.
6. The method according to any one of claims 1 to 5, wherein the third sound signal is the left channel signal of the audio file, and the fourth sound information is the right channel signal of the audio file Or, the fourth sound signal is the left channel signal of the audio file, and the third sound information is the right channel signal of the audio file.
7. The method according to any one of claims 1 to 6, wherein the first sound box determining the time delay difference based on the first distance and the second distance comprises:

   The first sound box determines the sound propagation speed according to the current temperature;

   The first sound box determines a first duration according to the first distance and the sound propagation speed;

   The first sound box determines a second duration according to the second distance and the sound propagation speed;

   The first sound box determines the time delay difference according to the first time length and the second time length.
8. 8. The method according to claim 7, wherein the first sound box determining the sound propagation speed according to the current temperature comprises:

   Detecting the current temperature value of the first speaker;

   The first sound box determines the sound propagation speed according to the temperature value and the formula c=331.3+0.606T; where T is the temperature value, and c is the sound propagation speed;

   or,

   The first sound box is based on the temperature value and formula

   

   Determine the sound propagation speed; where γ is the ratio of the constant pressure specific heat to the constant volume specific heat, R is the gas constant, T is the temperature value, M is the molar mass of the gas, and c is the sound propagation speed;

   or,

   The first sound box is based on the temperature value and formula

   

   Determine the sound propagation speed; where Pw is the partial pressure of water vapor in the air, T is the temperature value, P is the pressure value detected by the first sound box, and c is the sound propagation speed.
9. The method according to claim 7 or 8, wherein the first sound box determining the delay difference according to the first time length and the second time length comprises:

   When the first distance is greater than the second distance, the first duration is greater than the second duration, and the first sound box determines that the difference between the first duration and the second duration is the time Delay; the second moment is the moment after the first moment is delayed by the delay difference;

   When the first distance is less than the second distance, the first time length is less than the second time length, and the first sound box determines that the difference between the second time length and the first time length is the time Delay; the second moment is a moment when the first moment is advanced by the delay difference.
10. 9. The method according to any one of claims 2-9, wherein the method further comprises:

    When the first distance is greater than the second distance, adjusting the loudness of the first sound box according to the first loudness gain by the first sound box includes: increasing the first sound box according to the first loudness gain Increase the current loudness of the first sound box; the second instruction is used to instruct the second sound box to reduce the current loudness of the second sound box according to the second loudness gain;

    When the first distance is less than the second distance, adjusting the loudness of the first sound box according to the first loudness gain by the first sound box includes: reducing the first sound box according to the first loudness gain The current loudness of the first sound box; the second instruction is used to instruct the second sound box to increase the current loudness of the second sound box according to the second loudness gain.
11. A speaker, characterized by comprising: one or more processors, one or more memories, one or more microphones, one or more speakers, and a communication module;

    The one or more microphones are used to collect sound signals;

    The communication module is used to communicate with other speakers;

    The one or more speakers are used to emit sound signals;

    The one or more memories are used to store program instructions, and the program instructions are executed by the one or more processors, so that the sound box executes the method according to any one of claims 1-10.
12. A sound box system, comprising: a first sound box and a second sound box, the first sound box and the second sound box are arranged at different positions; the first sound box and the second sound box can communicate with each other; It is characterized in that, the first sound box is the sound box according to claim 11.
13. A computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and the computer program includes program instructions, and when executed by a computer, the program instructions cause the computer to execute The method described in any one of 1-10.
14. A program product, characterized in that the program product stores a computer program, the computer program includes program instructions, and when the program instructions are executed by a computer, the computer executes any one of claims 1-10. The method described in the item.

Images