CN114390426A - Volume calibration method and device - Google Patents

Abstract

A volume calibration method and device are provided, the method comprises: the terminal equipment sends a first audio to the first loudspeaker box and sends a second audio to the second loudspeaker box. The terminal equipment collects audio data corresponding to the first audio played by the first sound box and audio data corresponding to the second audio played by the second sound box on the first reference point. The terminal device may determine a first volume to be calibrated according to audio data corresponding to the first audio played by the first sound box, determine a second volume to be calibrated according to audio data corresponding to the second audio played by the second sound box, and determine a volume adjustment scheme according to the first volume to be calibrated and the second volume to be calibrated. Therefore, the terminal equipment can realize the volume calibration of the first sound box and the second sound box according to the volume adjustment scheme, and further realize the reduction of the influence of the sound field deviation phenomenon on the sound effect.

Description

Volume calibration method and device

The present application claims priority of the chinese patent application entitled "a volume calibration method and apparatus" filed by the intellectual property office of the people's republic of china, application No. 202011140931.3, on 22/10/2020 and incorporated herein by reference in its entirety.

Technical Field

The embodiment of the application relates to the field of terminals, in particular to a volume calibration method and device.

Background

Currently, a terminal device may choose to project audio onto other devices for playback. For example, devices such as mobile phones, tablets (pads), computers (PCs), Televisions (TVs), etc. may project audio onto other devices (e.g., speakers) for playback.

Illustratively, two enclosures may be combined into a stereo enclosure that includes a left channel and a right channel. When the mobile phone is connected with the two sound boxes, the mobile phone can trigger a certain video to be projected to the television for playing, and audio corresponding to the video is projected to the two sound boxes for playing, so that the two sound boxes can respectively play the sound of the left sound channel and the sound of the right sound channel in the audio.

Further, when the two speakers play audio, a user may feel a difference in volume between the two speakers at a location where the user is located, and the difference in volume between the two speakers may cause the user to experience a deviation of the sound field, thereby affecting the reproduction of the sound effect.

Disclosure of Invention

The embodiment of the application provides a volume calibration method and device, which are used for solving the problem that sound effect is influenced by deviation of a sound field at the position of a user.

In a first aspect, an embodiment of the present application provides a volume calibration method, where the method includes: the terminal equipment sends a first audio to the first loudspeaker box and sends a second audio to the second loudspeaker box. The terminal equipment collects first audio data and second audio data on a first reference point, the first audio data are audio data corresponding to a first audio played by a first sound box, and the second audio data are audio data corresponding to a second audio played by a second sound box. The terminal equipment determines a first volume to be calibrated according to the first audio data, determines a second volume to be calibrated according to the second audio data, and determines a volume adjustment scheme according to the first volume to be calibrated and the second volume to be calibrated. By adopting the method, the first audio and the second audio are respectively played by configuring the first sound box and the second sound box, the first audio data corresponding to the first audio and the second audio data corresponding to the second audio are acquired, the first volume to be calibrated and the second volume to be calibrated can be determined, and then the volume adjustment scheme can be determined according to the first volume to be calibrated and the second volume to be calibrated, so that the influence of the sound field offset phenomenon on the sound effect is reduced, and better user experience is ensured.

In one possible design, the first audio and the second audio have different frequencies in a preset part of sound waves, and/or the first audio and the second audio have different waveforms in the preset part of sound waves. With the adoption of the design, the terminal equipment can distinguish the first audio data and the second audio data in the collected data through the difference of the first audio and the second audio.

In one possible design, the first audio and the second audio have swept waveforms. By adopting the design, the volume calibration in a larger frequency range can be realized.

In one possible design, the first reference point is determined according to a distance between the terminal device and the first speaker, orientation information of the first speaker with respect to the terminal device, a distance between the terminal device and the second speaker, and orientation information of the second speaker with respect to the terminal device. By adopting the design, the position relation among the terminal equipment, the first sound box and the second sound box can be determined.

In a possible design, the first volume to be calibrated is a volume corresponding to a frequency range corresponding to the first audio data, and the second volume to be calibrated is a volume corresponding to a frequency range corresponding to the second audio data.

By adopting the design, the first volume to be calibrated and the second volume to be calibrated can be determined more simply and conveniently, and then the volume calibration can be realized through the first volume to be calibrated and the second volume to be calibrated, so that the problem of sound field offset is reduced.

In a possible design, the first volume to be calibrated is an average value of volumes corresponding to a plurality of frequency ranges corresponding to the first audio data, and the second volume to be calibrated is an average value of volumes corresponding to a plurality of frequency ranges corresponding to the second audio data. By adopting the design, the first volume to be calibrated and the second volume to be calibrated can be determined more simply and conveniently, so that the volume calibration can be realized through the first volume to be calibrated and the second volume to be calibrated, and the effect of reducing the sound field offset is obvious.

In a possible design, the first volume to be calibrated includes volumes corresponding to a plurality of frequency ranges corresponding to the first audio data, respectively, and the second volume to be calibrated includes volumes corresponding to a plurality of frequency ranges corresponding to the second audio data, respectively. By adopting the design, the volume calibration can be accurately carried out aiming at different frequency ranges by determining a plurality of first volumes to be calibrated and a plurality of second volumes to be calibrated, and the problem of sound field deviation can be obviously improved.

In one possible design, further comprising: and the terminal equipment sends first information to the first loudspeaker box or the second loudspeaker box according to the volume adjustment scheme, wherein the first information is used for indicating the difference value between the first volume to be calibrated and the second volume to be calibrated. By adopting the design, the volume calibration can be realized more simply and conveniently.

In one possible design, further comprising: and the terminal equipment sends second information to the first loudspeaker box according to the volume adjustment scheme and sends third information to the second loudspeaker box, wherein the second information is used for indicating a first volume adjustment amount, the third information is used for indicating a second volume adjustment amount, and the first volume adjustment amount and the second volume adjustment amount are determined according to the difference value of the first volume to be calibrated and the second volume to be calibrated. By adopting the design, the volume calibration can be realized more simply and conveniently.

In one possible design, the method further includes: the terminal equipment adjusts the waveform of the third audio according to the volume adjustment scheme; the terminal equipment sends the adjusted third audio to the first sound box and sends the fourth audio to the second sound box; or the terminal equipment adjusts the waveform of the fourth audio according to the volume adjustment scheme; and the terminal equipment sends the third audio to the first sound box and sends the adjusted fourth audio to the second sound box. By adopting the design, the volume calibration can be realized by adjusting the waveform of the third audio or the waveform of the fourth audio.

In one possible design, the third audio is the same as the fourth audio.

In a possible design, before the terminal device sends the first audio to the first sound box and sends the second audio to the second sound box, the terminal device detects a first operation of the user, and the first operation is used for triggering to project the sound which the user is ready to listen to the first sound box and the second sound box for playing. The design can be adopted to realize the trigger volume calibration.

In one possible design, further comprising: after the terminal device detects the first operation, the terminal device displays a first prompt box on a user interface; the first prompt box is used for prompting a user whether to execute volume calibration; and the terminal equipment detects a second operation of the user aiming at the first prompt box, and the second operation indicates to execute volume calibration. By adopting the design, the user can be prompted to trigger execution of volume calibration.

In one possible design, the position of the first enclosure is fixed and the position of the second enclosure is fixed; the method further comprises the following steps: when the terminal equipment determines that the first operation is not detected for the first time, the terminal equipment determines a second reference point; and if the distance between the first reference point and the second reference point is smaller than a preset threshold value, the terminal equipment determines to adopt the volume adjustment scheme. By adopting the design, the terminal equipment can quickly calibrate the volume of the first sound box and the second sound box by utilizing the stored volume adjustment scheme.

In one possible design, the user interface of the terminal device includes a first option; the first option is used for triggering execution of volume calibration; before the terminal equipment sends a first audio to the first sound box and sends a second audio to the second sound box, the terminal equipment detects that the user triggers the operation of the first option. By adopting the design, the volume calibration can be started at any time in the playing process by a user.

In one possible design, further comprising: the terminal device detects that the microphone is shielded by the user, and the terminal device displays a prompt box for reminding the user to check whether the microphone is shielded or not on a user interface. By adopting the method, the error caused by shielding the microphone to the volume calibration can be avoided.

In one possible design, further comprising: and the terminal equipment displays a prompt box for reminding a user to keep the terminal equipment vertical to the ground on a user interface. By adopting the design, the error caused by the directivity of the microphone to the volume calibration can be avoided.

In a second aspect, embodiments of the present application provide a communication apparatus, which includes means for performing any one of the possible designs of the first aspect and the first aspect.

In a third aspect, an embodiment of the present application provides a communication device, including a processor and an interface circuit, where the interface circuit is configured to receive a signal from a communication device other than the communication device and transmit the signal to the processor or send the signal from the processor to the communication device other than the communication device, and the processor is configured to implement any one of the possible designs of the first aspect and the first aspect through a logic circuit or by executing code instructions.

In a fourth aspect, the present application provides a computer-readable storage medium, in which a computer program or instructions are stored, and when the computer program or instructions are executed by a communication device, the computer program or instructions implement any one of the possible designs of the first aspect and the first aspect.

In a fifth aspect, embodiments of the present application provide a computer program product containing a program, which when run on a communication apparatus, causes the communication apparatus to perform any one of the possible designs of the first aspect and the first aspect.

Drawings

Fig. 1 is a schematic structural diagram of a mobile phone according to an embodiment of the present application;

fig. 2 is a schematic diagram of a frequency sweep waveform provided by an embodiment of the present application;

FIG. 3 is a schematic diagram of a frequency response curve provided by an embodiment of the present application;

fig. 4 is a schematic view of a variation curve of the volume of the audio played by the sound box recorded by the mobile phone according to the embodiment of the present application;

fig. 5 is a schematic diagram of microphone distribution in a mobile phone provided by an embodiment of the present application;

fig. 6 is a schematic diagram of a position relationship between a mobile phone and a first sound box and a second sound box according to an embodiment of the present application;

fig. 7 is a schematic diagram of a positional relationship between a mobile phone and 5 speakers according to an embodiment of the present application;

FIG. 8 is a schematic diagram of a waveform of a first audio provided by an embodiment of the present application;

fig. 9 is a flowchart of an overview of a volume calibration method provided by an embodiment of the present application;

FIG. 10 is one of schematic diagrams of a user interface provided by an embodiment of the present application;

FIG. 11 is a second schematic diagram of a user interface provided by an embodiment of the present application;

FIG. 12 is a third schematic diagram of a user interface provided by an embodiment of the present application;

FIG. 13 is a fourth schematic diagram of a user interface provided by an embodiment of the present application;

FIG. 14 is a fifth schematic diagram of a user interface provided by an embodiment of the present application;

fig. 15 is a sixth schematic view of a user interface provided in an embodiment of the present application.

Detailed Description

The application can be applied to terminal devices in general, such as mobile phones, tablet computers, notebook computers, smart watches, televisions, car machines, sound boxes, earphones, glasses, Virtual Reality (VR) devices, Augmented Reality (AR) devices, cameras, game machines and other electronic devices. The terminal equipment can be carried on

Or other operating system.

Taking the terminal device as a mobile phone as an example, fig. 1 shows a schematic structural diagram of a mobile phone 100.

The mobile phone 100 may include a processor 110, an external memory interface 120, an internal memory 121, a Universal Serial Bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 151, a wireless communication module 152, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a key 190, a motor 191, an indicator 192, a camera 193, a display screen 194, a Subscriber Identification Module (SIM) card interface 195, and the like. The sensor module 180 may include a gyroscope sensor 180A, an acceleration sensor 180B, a fingerprint sensor 180H, a temperature sensor 180J, and a touch sensor 180K (of course, the mobile phone 100 may also include other sensors, such as a pressure sensor, an acceleration sensor, a gyroscope sensor, a color temperature sensor, a bone conduction sensor, and the like, which are not shown in the figure).

It is to be understood that the illustrated structure of the embodiment of the present invention does not specifically limit the mobile phone 100. In other embodiments of the present application, the handset 100 may include more or fewer components than shown, or some components may be combined, some components may be separated, or a different arrangement of components may be used. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

Among other things, processor 110 may include one or more processing units, such as: the processor 110 may include an Application Processor (AP), a modem processor, a Graphics Processing Unit (GPU), an Image Signal Processor (ISP), a controller, a memory, a video codec, a Digital Signal Processor (DSP), a baseband processor, and/or a neural-Network Processing Unit (NPU), etc. The different processing units may be separate devices or may be integrated into one or more processors. The controller may be a neural center and a command center of the cell phone 100, among others. The controller can generate an operation control signal according to the instruction operation code and the timing signal to complete the control of instruction fetching and instruction execution.

A memory may also be provided in processor 110 for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may hold instructions or data that have just been used or recycled by the processor 110. If the processor 110 needs to reuse the instruction or data, it can be called directly from the memory, avoiding repeated accesses, reducing the latency of the processor 110, and thus increasing the efficiency of the system.

The processor 110 may operate the volume calibration method provided in the embodiment of the present application, so as to solve the problem that the sound field is shifted due to the difference in the volumes of different speakers, thereby affecting the sound effect, and improve the user experience. When the processor 110 integrates different devices, such as a CPU and a GPU, the CPU and the GPU may cooperate to perform the volume calibration method provided in the embodiment of the present application, for example, part of the volume calibration method is performed by the CPU, and another part of the volume calibration method is performed by the GPU.

The display screen 194 is used to display images, video, and the like. The display screen 194 includes a display panel. The display panel may adopt a Liquid Crystal Display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (active-matrix organic light-emitting diode, AMOLED), a flexible light-emitting diode (FLED), a miniature, a Micro-oeld, a quantum dot light-emitting diode (QLED), and the like. In some embodiments, the cell phone 100 may include 1 or N display screens 194, with N being a positive integer greater than 1.

The camera 193 (front camera or rear camera) is used to capture still images or video. In general, the camera 193 may include a photosensitive element such as a lens group including a plurality of lenses (convex lenses or concave lenses) for collecting an optical signal reflected by an object to be photographed and transferring the collected optical signal to an image sensor, and an image sensor. And the image sensor generates an original image of the object to be shot according to the optical signal. After the camera 193 captures the raw image, the raw image may be sent to the processor 110. In addition, camera 193 shown in FIG. 1 may include 1-N cameras.

The internal memory 121 may be used to store computer-executable program code, which includes instructions. The processor 110 executes various functional applications of the cellular phone 100 and data processing by executing instructions stored in the internal memory 121. The internal memory 121 may include a program storage area and a data storage area. Wherein, the storage program area can store the codes of the operating system and the application program, etc. The data storage area may store data created during use of the cellular phone 100, and the like.

The internal memory 121 may also store codes of the volume calibration method provided by the embodiment of the present application. When the code of the method for calling the service stored in the internal memory 121 is run by the processor 110, the problem that the sound field is shifted due to the difference of the sound volumes of different speakers, so that the sound effect is affected is solved, and the user experience is improved.

In addition, the internal memory 121 may include a high-speed random access memory, and may further include a nonvolatile memory, such as at least one magnetic disk storage device, a flash memory device, a universal flash memory (UFS), and the like.

Of course, the code of the method for volume calibration provided by the embodiment of the present application may also be stored in the external memory. In this case, the processor 110 may run the code of the volume calibration method stored in the external memory through the external memory interface 120, and may also solve the problem that the sound field is shifted due to the difference in the volumes of different speakers, thereby affecting the sound effect, and improving the user experience.

The function of the sensor module 180 is described below.

The gyro sensor 180A may be used to determine the motion attitude of the cellular phone 100. In some embodiments, the angular velocity of the handpiece 100 about three axes (i.e., the x, y, and z axes) may be determined by the gyro sensor 180A. I.e., the gyro sensor 180A may be used to detect the current state of motion of the handset 100, such as shaking or standing still.

The acceleration sensor 180B can detect the magnitude of acceleration of the cellular phone 100 in various directions (typically three axes). I.e., the gyro sensor 180A may be used to detect the current state of motion of the handset 100, such as shaking or standing still.

The gyro sensor 180A (or the acceleration sensor 180B) may transmit the detected motion state information (such as an angular velocity) to the processor 110. The processor 110 determines whether the mobile phone is currently in the hand-held state or the tripod state (for example, when the angular velocity is not 0, it indicates that the mobile phone 100 is in the hand-held state) based on the motion state information.

The processor 110 determines the user's behavior, e.g., whether the user is stationary or moving, through the gyro sensor 180A and/or the acceleration sensor 180B.

The fingerprint sensor 180H is used to collect a fingerprint. The mobile phone 100 can utilize the collected fingerprint characteristics to unlock the fingerprint, access the application lock, take a photograph of the fingerprint, answer an incoming call with the fingerprint, and the like.

The touch sensor 180K is also referred to as a "touch panel". The touch sensor 180K may be disposed on the display screen 194, and the touch sensor 180K and the display screen 194 form a touch screen, which is also called a "touch screen". The touch sensor 180K is used to detect a touch operation applied thereto or nearby. The touch sensor may communicate the detected touch operation to the processor 110 to determine the touch event type. Visual output associated with the touch operation may be provided through the display screen 194. In other embodiments, the touch sensor 180K may be disposed on the surface of the mobile phone 100, different from the position of the display 194. The touch sensor 180K may communicate the detected user gesture to the processor 110.

Illustratively, the display screen 194 of the handset 100 displays a main interface that includes icons for a plurality of applications.

The wireless communication function of the mobile phone 100 can be realized by the antenna 1, the antenna 2, the mobile communication module 151, the wireless communication module 152, the modem processor, the baseband processor, and the like.

The antennas 1 and 2 are used for transmitting and receiving electromagnetic wave signals. Each antenna in terminal device 100 may be used to cover a single or multiple communication bands. Different antennas can also be multiplexed to improve the utilization of the antennas. For example: the antenna 1 may be multiplexed as a diversity antenna of a wireless local area network. In other embodiments, the antenna may be used in conjunction with a tuning switch.

The mobile communication module 151 may provide a solution including 2G/3G/4G/5G wireless communication and the like applied to the terminal device 100. The mobile communication module 151 may include at least one filter, a switch, a power amplifier, a Low Noise Amplifier (LNA), and the like. The mobile communication module 151 may receive electromagnetic waves from the antenna 1, filter, amplify, etc. the received electromagnetic waves, and transmit the electromagnetic waves to the modem processor for demodulation. The mobile communication module 150 may also amplify the signal modulated by the modem processor, and convert the signal into electromagnetic wave through the antenna 1 to radiate the electromagnetic wave. In some embodiments, at least some of the functional modules of the mobile communication module 151 may be provided in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 151 may be disposed in the same device as at least some of the modules of the processor 110.

The modem processor may include a modulator and a demodulator. The modulator is used for modulating a low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used for demodulating the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then passes the demodulated low frequency baseband signal to a baseband processor for processing. The low frequency baseband signal is processed by the baseband processor and then transferred to the application processor. The application processor outputs a sound signal through an audio device (not limited to the speaker 170A, the receiver 170B, etc.) or displays an image or video through the display screen 194. In some embodiments, the modem processor may be a stand-alone device. In other embodiments, the modem processor may be provided in the same device as the mobile communication module 150 or other functional modules, independent of the processor 110.

The wireless communication module 152 may provide a solution for wireless communication applied to the terminal device 100, including Wireless Local Area Networks (WLANs) (e.g., wireless fidelity (Wi-Fi) networks), bluetooth (bluetooth, BT), Global Navigation Satellite System (GNSS), Frequency Modulation (FM), Near Field Communication (NFC), Infrared (IR), and the like. The wireless communication module 152 may be one or more devices integrating at least one communication processing module. The wireless communication module 152 receives electromagnetic waves via the antenna 2, performs frequency modulation and filtering processing on electromagnetic wave signals, and transmits the processed signals to the processor 110. The wireless communication module 152 may also receive a signal to be transmitted from the processor 110, frequency-modulate it, amplify it, and convert it into electromagnetic waves via the antenna 2 to radiate it.

In addition, the mobile phone 100 can implement an audio function through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the earphone interface 170D, and the application processor. For example, when the user input is voice, the handset 100 may detect the user input through the microphone 170C. The handset 100 may receive key 190 inputs, generating key signal inputs relating to user settings and function controls of the handset 100. For example, when the user input is a key, the cell phone 100 may detect the user input through the key 190. The handset 100 can generate a vibration alert (e.g., an incoming call vibration alert) using the motor 191. The indicator 192 in the mobile phone 100 may be an indicator light, and may be used to indicate a charging status, a power change, or a message, a missed call, a notification, etc. The SIM card interface 195 in the handset 100 is used to connect a SIM card. The SIM card can be attached to and detached from the cellular phone 100 by being inserted into the SIM card interface 195 or being pulled out from the SIM card interface 195.

It should be understood that in practical applications, the mobile phone 100 may include more or less components than those shown in fig. 1, and the embodiment of the present application is not limited thereto.

It is to be understood that the terminology used in the following embodiments is for the purpose of describing particular embodiments only, and is not intended to be limiting of the application. It should be understood that in the embodiments of the present application, "one or more" means one, two or more; "and/or" describes the association relationship of the associated objects, indicating that three relationships may exist; for example, a and/or B, may represent: a alone, both A and B, and B alone, where A, B may be singular or plural. In addition, the character "/" herein generally indicates that the former and latter related objects are in an "or" relationship, unless otherwise specified. Moreover, in the description of the embodiments of the present invention, the terms "first," "second," and the like are used for descriptive purposes only and not for purposes of indicating or implying relative importance, nor for purposes of indicating or implying order.

Technical terms related to the embodiments of the present application are briefly described below.

1. Swept waveform

The sweep waveform is a continuous waveform, and the frequency of the sweep waveform changes continuously, wherein the sweep waveform is as shown in fig. 2, and the frequency of the sweep waveform gradually increases from sparse to dense.

2. Frequency response

The frequency response is a phenomenon that when an audio signal output by constant voltage is connected with a system, sound pressure generated by a sound box is increased or attenuated along with the change of frequency, and the phase is changed along with the change of frequency, and the associated change relationship between the sound pressure and the phase and the frequency is called frequency response. Fig. 3 is a schematic diagram of a frequency response curve, where a frequency response curve 1 is an ideal frequency response curve, and a frequency response curve 2 and a frequency response curve 3 are real frequency response curves of two speakers respectively. On the frequency response curve 1, the volume does not change with the change of the frequency of the audio signal. On the frequency response curve 2 and the frequency response curve 3, the volume is increased or attenuated along with the change of the frequency of the audio signal, that is, the output volume of the sound boxes is different at different frequencies of the audio signal, and the frequency response curve 2 is different from the frequency response curve 3, that is, the frequency response curves of different sound boxes are also generally different. For example, in the frequency range of about 3KH or less, the sound volume of the speaker is lower than the sound volume corresponding to the frequency response curve 1, and in the frequency range of about 3KH or more, the sound volume of the speaker is higher than the sound volume corresponding to the frequency response curve 1, taking the frequency response curve 3 as an example, and the sound volume of the speaker changes according to the change of the frequency of the audio signal.

3. Microphone directivity

Microphone directivity is a description of the sensitivity of a microphone to sound coming from various directions in space, and is an important attribute of a microphone. In short, due to the different relative positions between the sound source and the microphone, the sound volume collected by the microphone is different even though the distance between the sound source and the microphone is constant all the time. Taking a general mobile phone as an example, the volume of the audio data of the audio played by the sound box collected when the mobile phone is placed on the desktop is different from the volume of the audio data of the audio played by the sound box collected when the mobile phone is placed perpendicular to the ground.

For example, as shown in fig. 4, assuming that the mobile phone is placed horizontally on a desktop, the microphone is located at the bottom of the mobile phone, and the sound box is configured to play some audio, and the volume is kept unchanged. When the position of the mobile phone is kept constant, the distance between the sound box and the mobile phone is kept constant, the sound box is made to rotate around the mobile phone for a circle, and fig. 4 is a change curve of the volume of the sound box recorded by the mobile phone for playing the audio. Wherein the unit of the two coordinate axes is sound intensity (dB). According to the curve, the sound box has different directions relative to the mobile phone, and the volume of the audio recorded by the mobile phone is different. When the sound box is positioned at the bottom (in the south direction) of the mobile phone, the sound volume is maximum, namely when the sound box is positioned in the direction pointed by the microphone, the sound volume of the audio recorded by the mobile phone is maximum, and when the sound box is positioned at the top (in the north direction) of the mobile phone, the sound volume is smaller, namely when the sound box is positioned in the opposite direction pointed by the microphone, the sound volume of the audio recorded by the mobile phone is smaller. When the sound box is positioned in the west direction of the mobile phone and the east direction of the mobile phone, the size of the sound box is different. Therefore, when a plurality of sound boxes exist in the space, if the mobile phone is horizontally placed on the desktop, the sound boxes may be located at different directions of the microphone, so that the volume of the audio data of the sound boxes acquired by the mobile phone cannot reflect the real output volume of the sound boxes, and the accuracy of volume calibration is affected. It is therefore desirable to keep the handset positioned perpendicular to the ground so that the microphone is directed in the same direction for each of the above-mentioned plurality of speakers, i.e. downwards perpendicular to the ground, thus avoiding errors introduced to the volume calibration by the microphone directivity.

4. Volume of sound

It should be noted that the embodiments of the present application relate to three types of sound volumes in total.

The first volume is the volume at which the terminal device is configured as a loudspeaker (which may also be referred to as the input volume). Specifically, the input volume refers to a volume that is adopted by a sound box configured for the sound box by the terminal device to play the audio when the terminal device projects the audio to the sound box to play. Illustratively, the terminal device sends configuration information to the loudspeaker, which indicates the input volume in a digitally encoded manner, e.g. 50% or 65% or the like.

The second type of volume is the volume of audio data corresponding to the audio collected in a preset distance and a preset direction (also called output volume) when the speaker plays the audio. It can be understood that, when the sound box leaves the factory to check the volume, the input volume is configured for the sound box, and the audio data corresponding to the audio when the sound box plays the audio is collected in the preset distance and the preset direction, so as to determine the volume (i.e. the output volume) of the audio data, and if the difference between the output volume and the input volume is within the preset range, it indicates that the sound box volume is qualified for checking.

It will be appreciated that even if two enclosures are configured with the same input volume, the output volumes of the two enclosures will generally not be the same, since the performance of the two enclosures will generally not be identical.

The third type of volume is the volume (which may be called relative volume or volume to be calibrated) of audio data corresponding to the audio collected at the position of the user or the position of the terminal device when the sound box plays the audio. In the embodiment of the application, the user location and the terminal device location have the same meaning. The embodiment of the application mainly calibrates the volume to be calibrated of two or more than two sound boxes, so that the difference of the volume of two or more than two sound boxes on the position of the terminal equipment is reduced, a better sound restoration effect is ensured, and better sound experience is provided for a user.

5. Sound field and sound field offset

The sound field refers to a region in which sound waves exist in a medium, and the sound field changes with time, and specifically, the volume, the propagation direction, and the like of various sounds in the sound field change with time. If the sound felt by the user fails to well restore the sound field environment of the sound at the time of recording, a sound field offset phenomenon occurs. For example, in order to restore the voice of the person in front, two sound boxes with the same volume as the two equidistant sound boxes on the left side and the right side of the user can be configured, so that the voice of the person in front can be restored. However, if the sound volume of the speaker on the left side of the user is large or the speaker on the left side of the user is close to the user, the user feels that the human voice comes from the front left. This phenomenon is known as sound field drift.

6. Relative position of mobile phone and sound box

Fig. 5 is a schematic diagram showing microphone distribution in the mobile phone. In fig. 5, the microphone corresponding to the label 1 is a main microphone, the microphone corresponding to the label 2 is a sub-microphone, and the microphone corresponding to the label 3 is a noise reduction microphone. The following description will be made of a specific scheme for determining the relative position between the mobile phone and the sound box, taking the mobile phone including 3 microphones as an example. It should be understood that the embodiments of determining the relative position between the mobile phone and the speaker are only examples, and are not limited to the embodiments of the present application.

The mobile phone may determine the location information of the mobile phone through a Global Positioning System (GPS), a beidou satellite navigation system, a WiFi identifier, or a cellular base station identifier, that is, determine the longitude and latitude of the mobile phone. Further, the mobile phone further includes a motion sensor, such as a gyro sensor 180A, an acceleration sensor 180B, a compass, and the like. Among them, the acceleration sensor 180B can recognize that the acceleration direction of a constant magnitude g is the geocentric direction. Therefore, the mobile phone can determine the direction of the earth center through the acceleration, and in addition, the mobile phone can also determine the current space attitude relative to the ground plane by combining with the magnetic field direction information obtained by other sensors such as a gyroscope, a compass and the like at the position of the mobile phone.

Assuming that the sound box plays a positioning audio, the time for receiving the audio data corresponding to the positioning audio by the 3 microphones in the mobile phone is different, specifically, the time difference for receiving the audio data corresponding to the positioning audio by each two microphones is caused by the difference between the distances between the sound box and the two microphones, where the time difference is about 3 microseconds every 1 mm. The propagation speed of sound in air is constant, the magnitude is 340m/s, and the propagation speed of sound in all directions is the same. Further, 3 spherical surfaces can be drawn by taking the 3 microphones as the spherical centers, and the radius of the 3 spherical surfaces is determined according to the time difference corresponding to each two microphones, for example, if the time difference corresponding to the microphone corresponding to the mark 1 and the microphone corresponding to the mark 2 is 15 microseconds, the radius of the spherical surface with the microphone corresponding to the mark 1 as the spherical center is different from the radius of the spherical surface with the microphone corresponding to the mark 2 as the spherical center by 5 millimeters. Further, the radius of the 3 spherical surfaces is increased according to the same amplitude until the 3 spherical surfaces intersect at a point in space, and the position of the point is the position of the sound box. Further, the relative position information of the mobile phone and the sound box can be determined by combining the space posture of the mobile phone. Illustratively, the position information of the mobile phone relative to the sound box includes a distance between the sound box and the mobile phone and an orientation of the sound box relative to the mobile phone.

Specifically, the center of the mobile phone is used as an origin, the geocentric direction is a Z-axis direction, and a plane (i.e., a horizontal plane) perpendicular to the geocentric direction determines an X-axis direction and a Y-axis direction to establish a three-dimensional coordinate system. In the three-dimensional coordinate system, specific coordinates of 3 microphones can be identified, and coordinates of intersection points of 3 spherical surfaces, namely coordinates of the sound box, can be determined according to the above contents, so that the distance between the sound box and the center of the mobile phone, an included angle between the sound box and the Z-axis direction, an included angle between the sound box and a horizontal plane, an included angle between the sound box and the plane where the mobile phone is located and the like can be obtained.

The embodiment of the application can be applied to a scene that at least two sound boxes form a stereo sound box.

Scene 1: the two enclosures may be combined into a stereo enclosure that includes a left channel and a right channel.

Illustratively, since the two enclosures may be different brands or different models of enclosures, there may be differences in output volume even for the same digital audio input. Or even if the two sound boxes are the same in brand and model, the output volume may be deviated due to the individual difference of the sound boxes. Or because the distance between the user and the two sound boxes is different, the user can feel the difference of the sound volumes of the two sound boxes at the position of the user. Or the environment around the two sound boxes is different, so that the user can feel the difference of the sound volumes of the two sound boxes at the position where the user is located. For example, one of the enclosures may be closer to the curtain, while the other enclosure may be more spacious.

Further, the difference in the volume of the two speakers in these scenes may make people feel the deviation of the sound field, and thus the sound effect is affected. It should be understood that the above scenarios are only examples and are not intended to limit the embodiments of the present application.

As shown in fig. 6, in the living room, it is assumed that the user sits on the sofa with the mobile phone held by the user, and the mobile phone, the first speaker and the second speaker are connected to the same wireless network. The first sound box and the second sound box are combined into a stereo sound box comprising a left sound channel and a right sound channel. It is understood that the handset may determine the position information of the handset relative to the first speaker, for example, the position of the handset relative to the first speaker includes a distance between the first speaker and the handset (i.e., a first distance), and an orientation of the first speaker relative to the handset. Similarly, the mobile phone may determine the position information of the mobile phone relative to the second sound box, for example, the position of the mobile phone relative to the second sound box includes a distance (i.e., a second distance) between the second sound box and the mobile phone, and an orientation of the second sound box relative to the mobile phone. Furthermore, a first reference point is defined according to the position information of the mobile phone relative to the first sound box and the position information of the mobile phone relative to the first sound box, namely the position relationship among the mobile phone, the first sound box and the second sound box.

Assuming that only the position relationship among the mobile phone, the first sound box and the second sound box is considered, and the influence of other factors on the sound field is not considered, if the difference between the first distance and the second distance is small, for example, if the first distance and the second distance are approximately equal, the sound field deviation phenomenon will not occur on the first reference point basically, and the user can obtain a better sound restoration effect. If the difference between the first distance and the second distance is large, for example, the first distance is much larger than the second distance, the sound field deviation phenomenon at the first reference point is obvious. And the larger the difference between the first distance and the second distance is, the more obvious the sound field deviation phenomenon is.

Scene 2: more than two enclosures may constitute a surround sound enclosure comprising a plurality of sound channels.

Illustratively, the N enclosures comprise a surround sound enclosure including a plurality of sound channels. N is a positive integer greater than 2. Since the N speakers may be different brands or different models of speakers, the output volume of the N speakers may be different even though the same digital audio is input. Or even if the N sound boxes are sound boxes of the same brand and the same model, the output volumes of the N sound boxes may be different due to individual differences of the sound boxes. Or because the distance between the user and the N sound boxes is different, the user can feel the difference of the sound volume of the N sound boxes at the position where the user is located. Or the environment around the N sound boxes is different, which may also cause the user to feel the difference in the sound volume of the N sound boxes at the location.

Further, the difference in the sound volumes of the N sound boxes in the scenes may cause a person to experience the deviation of the sound field, thereby affecting the reproduction of the sound effect. It should be understood that the above scenarios are only examples and are not intended to limit the embodiments of the present application.

As shown in fig. 7, in the living room, for example, it is assumed that a user sits on a sofa with a mobile phone held by the user, and a multi-channel surround sound box is composed of 5 sound boxes (including a sound box a, a sound box B, a sound box C, a sound box D, and a sound box E). The mobile phone can determine the position information of the mobile phone relative to the sound box A, the position information of the mobile phone relative to the sound box B, the position information of the mobile phone relative to the sound box C, the position information of the mobile phone relative to the sound box D and the position information of the mobile phone relative to the sound box E. The position of the mobile phone relative to the sound box a includes a distance (i.e., a first distance) between the sound box a and the mobile phone, and an orientation of the sound box a relative to the mobile phone. The position of the handset relative to the speaker B includes the distance (i.e., the second distance) between the speaker B and the handset, and the orientation of the speaker B relative to the handset. The position of the handset relative to the speaker C includes the distance (i.e., the third distance) between the speaker C and the handset, and the orientation of the speaker C relative to the handset. The position of the handset relative to the speaker D includes the distance (i.e., the fourth distance) between the speaker D and the handset, and the orientation of the speaker D relative to the handset. The position of the handset relative to the speaker E includes the distance between the speaker E and the handset (i.e., the fifth distance), and the orientation of the speaker E relative to the handset. Further, according to the position information of the mobile phone relative to the sound box a, the position information of the mobile phone relative to the sound box B, the position information of the mobile phone relative to the sound box C, the position information of the mobile phone relative to the sound box D, and the position information of the mobile phone relative to the sound box E, that is, the position relationship between the mobile phone and the 5 sound boxes, a first reference point is defined, that is, the first reference point is used for indicating the position of the mobile phone relative to the sound box a, the position of the mobile phone relative to the sound box B, the position of the mobile phone relative to the sound box C, the position of the mobile phone relative to the sound box D, and the position of the mobile phone relative to the sound box E.

When the difference between the first distance, the second distance, the third distance, the fourth distance and the fifth distance is small, the phenomenon of sound field deviation on the first reference point is relatively unobvious, and a user can obtain a good sound restoration effect. If any at least two of the first distance, the second distance, the third distance, the fourth distance and the fifth distance are smaller in difference, the phenomenon of sound field deviation on the first reference point is obvious.

Scene 3: two or more than two sound boxes can form a single sound channel multi-sound box combination.

Illustratively, similar to scene 2, scene 3 differs from scene 2 in that in scene 2, each loudspeaker plays a sound of one channel, and the sounds of multiple channels are combined into a surround sound effect.

It is understood that the above scenarios 1-3 are merely examples and are not intended to limit the present application.

It should be noted that the embodiment of the present application may be applied to a bluetooth speaker and a WiFi speaker.

The following describes the calibration of the sound volumes of the two speakers. Suppose the terminal device is a mobile phone, and the two sound boxes are respectively a first sound box and a second sound box. The first sound box and the second sound box can be used for playing the sound of the left sound channel and the sound of the right sound channel respectively, or the first sound box and the second sound box are both used for playing a single sound channel. Wherein, the first speaker and the second speaker respectively play the sound of the left channel and the right channel, or play a single sound channel, generally depending on the audio source. It can be understood that the mobile phone is connected with the first sound box and the second sound box respectively, and the input volume of the first sound box is the same as the input volume of the second sound box.

Assuming that the position of the mobile phone is a first reference point, the mobile phone may control the two speakers to play a first audio and a second audio respectively, and acquire audio data (hereinafter referred to as first audio data) corresponding to the first audio played by the first speaker and audio data (hereinafter referred to as second audio data) corresponding to the second audio played by the second speaker at the first reference point. Further, the mobile phone may determine a first volume to be calibrated according to the first audio data, and determine a second volume to be calibrated according to the second audio data. Finally, the mobile phone can determine a volume adjustment scheme according to the first volume to be calibrated and the second volume to be calibrated, wherein the volume adjustment scheme is used for reducing the phenomenon of sound field deviation on the first reference point. Fig. 9 shows a detailed description of an embodiment of the present application.

The first audio and the second audio related to the embodiment of the present application are calibration audio specifically designed in the present application, and the first audio and the second audio may not need to distinguish between a left channel and a right channel.

The length of the first audio and the length of the second audio may be the same or different, and taking the first audio as an example, the length of the first audio may be 3-5S. Typically, the first audio and the second audio are both provided with frequency swept waveforms, and the frequency range of the first audio and the frequency range of the second audio may each be, for example, 40Hz to 20 KHz. The frequency sweep waveform is shown in fig. 2, and the frequency of the waveform gradually increases from sparse to dense.

Wherein the first audio and the second audio may be the same or different. When the first audio and the second audio are different, the difference between the first audio and the second audio may be embodied in that the frequency and/or the waveform of the preset part of the sound wave are different. For example, the frequency of the preset partial sound wave of the first audio is different from the frequency of the preset partial sound wave of the second audio. Or the waveform of the preset partial sound wave of the first audio frequency is different from the waveform of the preset partial sound wave of the second audio frequency. Or the waveform of the preset part of the sound wave of the first audio frequency is different from the waveform of the preset part of the sound wave of the second audio frequency, and the frequency of the preset part of the sound wave of the first audio frequency is different from the frequency of the preset part of the sound wave of the second audio frequency. Here, the preset partial sound wave here may refer to a sound wave for a preset time period, for example, 2 nd to 3 rd seconds in the first audio and 2 nd to 3 rd seconds in the second audio.

Illustratively, as shown in fig. 8, taking the first audio as an example, the waveform of the first audio may be divided into four parts, namely, a start detection waveform, an identification waveform, a volume calibration waveform, and an end detection waveform. The start detection waveform is used for indicating that the first loudspeaker box is ready to start audio playing after detecting the part. The identification waveform is used for identifying the following playing audio as the audio played by the first loudspeaker box. The volume calibration waveform is a swept frequency waveform and is used for calibrating the volume of the first sound box. The end detection waveform indicates that the audio playing is ended after the first loudspeaker box detects the portion, and the detection is not required to be continued. As can be seen from fig. 8, the identification waveform included in the waveform of the first audio is different from the identification waveform included in the waveform of the second audio, and the mobile phone can recognize the first audio data and the second audio data accordingly. It should be understood that the waveform shown in fig. 8 is only an example and not a limitation of the embodiment of the present application, and in addition, if the second speaker plays the second audio after the first speaker completes playing the first audio, in this case, the waveform of the first audio may also be the same as the waveform of the second audio, and the waveform of the first audio may not include the identification waveform portion.

Furthermore, the embodiments of the present application can be applied to the following cases:

case (1): before the mobile phone projects the audio to be listened by the user to the two sound boxes for playing, the user initiates volume calibration.

Case (2): during the process of listening to the audio by the user, if the user feels the sound field offset, the user initiates the volume calibration.

It should be noted that for case (2), in some embodiments, the user may pause the current audio playback and then initiate the volume calibration, which is similar to case (1) above.

In some embodiments, the user may not need to pause the current audio playback. At this time, it should be noted that, taking the first audio as an example, the mobile phone may encode and play the first audio and the original audio (i.e., the current audio) together, or the first audio may be encoded independently. Furthermore, in order not to affect the user's experience of listening to the audio currently, the frequency range of the first audio may mainly relate to the high frequency range, so that the user cannot hear the first audio, thereby having no effect on the current audio listening.

A schematic flow chart of calibrating the volume by the mobile phone 100 is described below with reference to the embodiment of the present application applied to the mobile phone architecture shown in fig. 1. The method is described below as applied to the handset 100 shown in fig. 9, and the term "when …" may be interpreted to mean "if …" or "after …" or "in response to a determination of …" or "in response to a detection of …" hereinafter. Similarly, depending on the context, the phrase "at the time of determination …" or "if (a stated condition or event) is detected" may be interpreted to mean "if the determination …" or "in response to the determination …" or "upon detection (a stated condition or event)" or "in response to detection (a stated condition or event)".

S901: the mobile phone sends a first audio to the first sound box.

S902: and the mobile phone sends a second audio to the second sound box.

Exemplarily, if the first speaker is a bluetooth speaker, the mobile phone needs to convert the first audio into an audio streaming media of bluetooth coding, and send the audio streaming media to the first speaker. If first audio amplifier is the wiFi audio amplifier, the cell-phone can directly send first audio frequency to first audio amplifier, and first audio amplifier can decode first audio frequency and broadcast by oneself this moment.

It is understood that the first audio and the second audio may be pre-stored by the handset, or the first audio and the second audio may be generated by the handset in real-time.

S903: after the first sound box receives the first audio from the mobile phone, the first sound box plays the first audio.

S904: and after the second sound box receives a second audio from the mobile phone, the second sound box plays the second audio.

In some embodiments, the first speaker and the second speaker may play the first audio and the second audio sequentially. For example, the second speaker may start playing the second audio after the first audio is played by the first speaker. Or the first sound box starts to play the first audio, and the second sound box starts to play the second audio before the first sound box finishes playing the first audio.

In some embodiments, the first speaker and the second speaker may play simultaneously.

S905: the mobile phone collects first audio data and second audio data on a first reference point. The first audio data is audio data corresponding to the first audio played by the first sound box, and the second audio data is audio data corresponding to the second audio played by the second sound box.

It can be understood that the mobile phone can record through the microphone when the first sound box plays the first audio and the second sound box plays the second audio, and analyze the obtained recording file to obtain the first audio data and the second audio data. Or, the mobile phone can also perform data acquisition through the microphone when the first sound box plays the first audio and the second sound box plays the second audio, without storing the recording file.

In some embodiments, the first speaker and the second speaker may sequentially play the first audio and the second audio, and at this time, the first audio and the second audio may be the same or different. For example, the first speaker plays the first audio first, and the mobile phone collects audio data (i.e., the first audio data) corresponding to the first audio played by the first speaker at the first reference point. After the first sound box is played, the second sound box plays a second audio, and the mobile phone collects audio data (namely, second audio data) corresponding to the second audio played by the second sound box on the first reference point.

It can be understood that, when the mobile phone collects the first audio data and the second audio data, the positional relationship among the mobile phone, the first sound box and the second sound box is not changed, that is, the first reference point is not changed.

In addition, when the mobile phone collects the first audio data and the second audio data, the mobile phone may also collect audio data corresponding to the environment background (i.e. environment background sound), and since the characteristics of the first audio and the characteristics of the second audio are known by the mobile phone, the mobile phone may remove the audio data corresponding to the environment background when collecting the first audio data and the second audio data. Here, the characteristic of the first audio is a frequency and a waveform of the first audio, and the characteristic of the second audio is a frequency and a waveform of the second audio.

In some embodiments, the first speaker and the second speaker may also play simultaneously, or the second speaker may start playing the second audio before the first speaker finishes playing the first audio. At this time, the audio data collected by the mobile phone includes both the audio data (i.e., the first audio data) corresponding to the first audio played by the first speaker and the audio data (i.e., the second audio data) corresponding to the second audio played by the second speaker. And the mobile phone needs to identify the first audio data and the second audio data from the collected audio data. At this time, the first audio is different from the second audio. For example, the difference between the first audio and the second audio may be embodied in the frequency difference and/or the waveform difference of the preset part of the sound waves, which is described in detail above, and the repeated parts are not described again. In one example, as shown in fig. 6, it is assumed that the waveform of the preset partial sound wave of the first audio is different from the waveform of the preset partial sound wave of the second audio. At this time, the mobile phone may identify the first audio data and the second audio data from the collected audio data according to the waveform of the preset part of the sound wave of the first audio and the waveform of the preset part of the sound wave of the second audio.

S906: the mobile phone determines a first volume to be calibrated according to the first audio data, and determines a second volume to be calibrated according to the second audio data.

For example, the mobile phone may determine, according to the first audio data, a volume corresponding to the first audio data, and use the volume as the first volume to be calibrated. Similarly, the mobile phone may determine, according to the second audio data, a volume corresponding to the second audio data, and use the volume as the second volume to be calibrated. The first volume to be calibrated indicates the volume of the first audio played by the first sound box measured on the first reference point, and the second volume to be calibrated indicates the volume of the second audio played by the second sound box measured on the first reference point.

A specific manner of determining the first volume to be calibrated and the second volume to be calibrated by the mobile phone is described below, and it should be understood that the following manners 1 to 3 are only examples and are not limited to the embodiments of the present application. The mobile phone can extract amplitude features from the first audio data, determine the volume corresponding to the first audio data according to the amplitude features, extract frequency features from the first audio data, and determine the frequency range corresponding to the first audio data according to the frequency features. The mobile phone can extract the amplitude feature from the second audio data, determine the volume corresponding to the second audio data according to the amplitude feature, extract the frequency feature from the second audio data, and determine the frequency range corresponding to the second audio data according to the frequency feature. The frequency range of the first audio frequency is the same as or approximately the same as the frequency range of the second audio frequency, the frequency range corresponding to the first audio frequency data is the same as the frequency range of the first audio frequency, and the frequency range corresponding to the second audio frequency data is the same as the frequency range of the second audio frequency, so that the frequency range corresponding to the first audio frequency data is the same as or approximately the same as the frequency range corresponding to the second audio frequency data.

Mode 1: the mobile phone determines a first volume to be calibrated and a second volume to be calibrated, wherein the first volume to be calibrated is the volume corresponding to the frequency range corresponding to the first audio data, and the second volume to be calibrated is the volume corresponding to the frequency range corresponding to the second audio data. It should be noted that the frequency range corresponding to the first audio data is a complete frequency range corresponding to the first audio data, and the frequency range corresponding to the second audio data is a complete frequency range corresponding to the second audio data.

By adopting the mode 1, the first volume to be calibrated and the second volume to be calibrated can be determined more simply and conveniently, and then the volume calibration can be realized through the first volume to be calibrated and the second volume to be calibrated, so that the problem of sound field offset is reduced.

Mode 2: the mobile phone determines a first volume to be calibrated and a second volume to be calibrated, wherein the first volume to be calibrated is an average value of volumes corresponding to a plurality of frequency ranges corresponding to the first audio data, and the second volume to be calibrated is an average value of volumes corresponding to a plurality of frequency ranges corresponding to the second audio data. At this time, the complete frequency range corresponding to the first audio data is divided into a plurality of frequency ranges, amplitude features are extracted from the audio data corresponding to each frequency range, the volume corresponding to each frequency range is determined, an average value is obtained according to the obtained plurality of volume, and the average value is used as the first volume to be calibrated. Similarly, the complete frequency range corresponding to the second audio data is divided into a plurality of frequency ranges, the division modes of the complete frequency range and the frequency ranges are the same, amplitude features are extracted from the audio data corresponding to each frequency range, the volume corresponding to each frequency range is determined, an average value is obtained according to the obtained plurality of volumes, and the average value is used as the second volume to be calibrated.

By adopting the mode 2, the first volume to be calibrated and the second volume to be calibrated can be determined more simply and conveniently, further, the volume calibration can be realized through the first volume to be calibrated and the second volume to be calibrated, and the effect of reducing the sound field offset is obvious.

For example, taking the frequency range corresponding to the first audio data as 100 to 400Hz, the whole frequency range corresponding to the first audio data may be divided into 2 frequency ranges, and a corresponding volume is determined for each frequency range, so that 2 volumes may be obtained, that is, a volume to be calibrated (hereinafter, referred to as volume 1) of the first audio data in the frequency range of 100 to 200Hz and a volume to be calibrated (hereinafter, referred to as volume 2) of the first audio data in the frequency range of 200 to 400Hz, and then an average value of the obtained 2 volumes is obtained, that is, an average value of the volume 1 and the volume 2 is calculated as the first volume to be calibrated.

Mode 3: it should be noted that the frequency response curve of the first sound box is generally different from the frequency response curve of the second sound box. In order to calibrate the volume of the two sound boxes at each frequency, the mobile phone may determine, according to the first audio data, the volume corresponding to each of the multiple frequency ranges corresponding to the first audio data, and obtain multiple volumes to be calibrated corresponding to the first audio data (obtain multiple first volumes to be calibrated). Similarly, the mobile phone may determine, according to the second audio data, the volumes corresponding to the multiple frequency ranges corresponding to the second audio data, respectively, to obtain multiple volumes to be calibrated corresponding to the second audio data (obtain multiple second volumes to be calibrated). For example, the mobile phone can determine the volume to be calibrated of the first audio data in the frequency range of 100-200 Hz and the volume to be calibrated of the second audio data in the frequency range of 100-200 Hz, and the volume to be calibrated of the first audio data in the frequency range of 200-400 Hz.

By adopting the mode 3, the sound volume calibration can be accurately performed aiming at different frequency ranges by determining the plurality of first volumes to be calibrated and the plurality of second volumes to be calibrated, and the problem of sound field deviation can be obviously improved.

It can be understood that each of the above frequency ranges can be adjusted according to the requirement, and the smaller the frequency range is, the more accurate the volume calibration is. For example, the mobile phone can determine the volume to be calibrated of the first audio data in the frequency range of 100-110 Hz, the volume to be calibrated of the second audio data in the frequency range of 100-110 Hz, the volume to be calibrated of the first audio data in the frequency range of 110-120 Hz, and the volume to be calibrated of the second audio data in the frequency range of 110-120 Hz.

S907: and the mobile phone determines a volume adjustment scheme according to the first volume to be calibrated and the second volume to be calibrated. The volume adjusting scheme is used for reducing the difference between the first volume to be calibrated and the second volume to be calibrated. The mobile phone reduces the influence of sound field deviation on sound effect through a volume adjustment scheme.

In some embodiments, the mobile phone determines first information according to the volume adjustment scheme, and sends the first information to the first sound box or the second sound box, where the first information is used to indicate a difference between the first volume to be calibrated and the second volume to be calibrated. The volume adjustment method may also be referred to as a post-processing method.

For example, if the first volume to be calibrated is higher than the second volume to be calibrated by Xdb, the mobile phone may send a first message to the first sound box, where the first message indicates that the input volume of the first sound box is lower by Xdb. After the first sound box receives the first information, the input volume of the first sound box is adjusted according to the first information, namely the input volume of the first sound box is reduced by Xdb, so that the volumes of the two sound boxes determined at the position of the mobile phone are the same or approximately the same when the audio is formally played. Or, the mobile phone may send the first information to the second sound box, where the first information indicates that the input volume of the second sound box is increased by Xdb. And after the second sound box receives the first information, the input volume of the second sound box is adjusted according to the first information, namely the input volume of the second sound box is increased by Xdb.

For example, if the first volume to be calibrated is higher than the second volume to be calibrated by Xdb, the mobile phone may send a first message to the first sound box, where the first message indicates that the input volume of the first sound box is decreased by Xdb. Further, the mobile phone may repeat the above steps S901 to S906 to determine whether the volume calibration effect is achieved. Specifically, after the first sound box adjusts the input volume, the mobile phone determines whether the redetermined first volume to be calibrated and the second volume to be calibrated are the same, or whether the absolute value of the difference between the redetermined first volume to be calibrated and the second volume to be calibrated is smaller than a preset threshold, if the redetermined first volume to be calibrated and the second volume to be calibrated are the same, or the absolute value of the difference between the redetermined first volume to be calibrated and the second volume to be calibrated is smaller than the preset threshold, it indicates that the volume calibration is completed, and can continue to play the audio that the user is ready to listen to, that is, the audio that the user is ready to listen to is sent to the first sound box and the second sound box. For example, the audio that the user is prepared to listen to includes the audio of the left channel and the audio of the right channel, the first speaker is used for playing the audio of the left channel, and the second speaker is used for playing the audio of the right channel. Therefore, the mobile phone sends the audio of the left sound channel to the first sound box, and sends the audio of the right sound channel to the second sound box.

In addition, it can be understood that the mobile phone may further determine second information and third information according to the volume adjustment scheme, where the second information is used to indicate a first volume adjustment amount, the third information is used to indicate a second volume adjustment amount, the first volume adjustment amount and the second volume adjustment amount are determined according to a difference between the first volume to be calibrated and the second volume to be calibrated, and the mobile phone sends the first volume adjustment amount to the first sound box and sends the second volume adjustment amount to the second sound box. For example, if the first volume to be calibrated is 6db higher than the second volume to be calibrated, the mobile phone may send a second message to the first sound box, where the second message indicates that the input volume of the first sound box is decreased by 3db, and the third message indicates that the input volume of the second sound box is increased by 3 db.

In other embodiments, the handset may adjust the waveform of the third audio and/or the waveform of the fourth audio according to a volume adjustment scheme before sending the third audio to the first audio enclosure and sending the fourth audio to the second audio enclosure. The above-described volume adjustment method may also be referred to as a preprocessing method. The third audio and the fourth audio are the audio required to be projected by the mobile phone. The third audio is the audio required to be played by the first sound box, and the fourth audio is the audio required to be played by the second sound box. For example, the third audio and the fourth audio are the audio of the left channel and the audio of the right channel, respectively. For example, for the above case (1), before the mobile phone projects the audio that the user is ready to listen to the two speakers for playing, the user initiates volume calibration, where the third audio and the fourth audio are the audio that the user is ready to listen to. For another example, in the process of listening to audio by the user in the above case (2), if the user senses the sound field deviation, the user initiates the volume calibration. The third audio and the fourth audio are audio that needs to be played continuously after the volume calibration is completed.

Note that, if the audio to be listened to by the user is not distinguished between the left and right channels, the third audio and the fourth audio are the same audio.

Illustratively, if the first volume to be calibrated is higher than the second volume to be calibrated by Xdb, the handset increases the waveform of the fourth audio by the gain of Xdb, or decreases the waveform of the third audio by the gain of X db.

It is to be understood that the above-described volume adjustment scheme may be applied to the mode 1 and the mode 2 in the above-described S906.

In addition, before the mobile phone sends the third audio to the first sound box and sends the fourth audio to the second sound box, the mobile phone reduces the waveform of the first audio by the gain of Xdb, and repeats the above steps S901 to S906 to determine whether the volume calibration effect is achieved. Specifically, the mobile phone determines whether the redetermined first volume to be calibrated and the second volume to be calibrated are the same or not, or whether the absolute value of the difference between the redetermined first volume to be calibrated and the second volume to be calibrated is smaller than a preset threshold, if the redetermined first volume to be calibrated and the second volume to be calibrated are the same or the absolute value of the difference between the redetermined first volume to be calibrated and the second volume to be calibrated is smaller than the preset threshold, the volume calibration is completed, the audio to be listened to by the user can be continuously played, namely, according to the waveform of the third audio, the Xdb gain is reduced, then the adjusted third audio is sent to the first sound box, and the fourth audio is sent to the second sound box.

Further, as for the mode 3 in S906, the mobile phone determines a plurality of volumes to be calibrated corresponding to the first audio data and a plurality of volumes to be calibrated corresponding to the second audio data, and the mobile phone adjusts the waveform of the third audio and/or the waveform of the fourth audio for the two volumes to be calibrated in each frequency range.

Exemplarily, the mobile phone determines that the volume to be calibrated of the first audio data in the frequency range of 100-200 Hz is 1db higher than the volume to be calibrated of the second audio data in the frequency range of 100-200 Hz, and the volume to be calibrated of the first audio data in the frequency range of 200-400 Hz is 0.5db higher than the volume to be calibrated of the second audio data in the frequency range of 200-400 Hz. The mobile phone increases the gain of 1db for the waveform of the fourth audio within the frequency range of 100-200 Hz, or decreases the gain of 1db for the waveform of the third audio within the frequency range of 100-200 Hz. The mobile phone increases the gain of 0.5db for the waveform of the fourth audio within the frequency range of 200-400 Hz, or decreases the gain of 0.5db for the waveform of the third audio within the frequency range of 100-200 Hz.

In addition, in some embodiments, after the handset completes the volume calibration, the handset may also save a first file, which includes, but is not limited to, networking information, network element information, volume adjustment scheme, and information of the first reference point. The networking information is used for indicating each router forming the network and the relationship among the routers. The network element information includes connection route information of a sending (source) end (namely, a mobile phone) and a receiving (sink) end (namely, a first sound box and a second sound box), and an equipment identifier of the sink end. The volume adjustment scheme includes gain information (i.e., a waveform gain) of each sink terminal or a volume adjustment amount of each sink terminal. The information of the first reference point may include a distance between the mobile phone and the first sound box, orientation information of the first sound box relative to the mobile phone, a distance between the mobile phone and the second sound box, and orientation information of the second sound box relative to the mobile phone. Therefore, if the mobile phone detects the first instruction next time and the position relationship between the mobile phone and the first sound box and the position relationship between the mobile phone and the second sound box meet the preset conditions, the mobile phone can calibrate the volume according to the volume adjustment scheme in the first file. For example, the preset condition may be that, assuming that the positions of the first sound box and the second sound box are fixed, the mobile phone determines the second reference point when the first instruction is detected next time, and if the distance between the second reference point and the first reference point is less than a preset threshold (for example, 1 meter), the mobile phone may perform volume calibration according to the volume adjustment scheme in the first file. When the sound box is newly added, the mobile phone needs to calibrate the volume of the newly added sound box again. Or when the distance between the second reference point and the first reference point is greater than or equal to the preset threshold, the mobile phone needs to calibrate the volume of the two sound boxes again. It can be understood that the specific method for determining the second reference point by the mobile phone is the same as the specific method for determining the first reference point by the mobile phone, and repeated descriptions are omitted.

The following further describes a specific implementation process of the above embodiment shown in fig. 9.

For the above S901:

in some embodiments, in view of the above situation (1), before the mobile phone projects the audio that the user is ready to listen to the two sound boxes for playing, the user initiates volume calibration, when the mobile phone detects a first operation of the user, the first operation is used to trigger the sound that the user is ready to listen to be projected to the first sound box and the second sound box for playing, the mobile phone may display a first prompt box on the current user interface, and the first prompt box is used to prompt the user whether to perform volume calibration. The mobile phone detects a second operation of the user on the first prompt box, the second operation is used for triggering volume calibration, and the mobile phone sends a first audio to the first sound box and sends a second audio to the second sound box.

Illustratively, the mobile phone is connected to two speakers, and the mobile phone detects an operation for triggering a certain video to be projected onto a television for playing, where the two speakers are used for playing an audio corresponding to the video, and a current user interface of the mobile phone is as shown in fig. 10. The user clicks the virtual button corresponding to "yes" on the display interface shown in fig. 10, and in response to the operation, the mobile phone sends the first audio to the first sound box and sends the second audio to the second sound box.

In addition, if the mobile phone detects a second operation of the user, the mobile phone may further display a second prompt box on the current user interface, where the second prompt box is used to remind the user to keep the surrounding environment quiet, as shown in fig. 11. Or if the mobile phone detects the second operation, the user is reminded to keep the ambient environment quiet through a voice mode.

In some embodiments, the handset is configured to automatically initiate the volume calibration upon detecting a first operation by the user. The first operation is used for triggering sound to be projected to the first sound box and the second sound box to be played. For example, the mobile phone may display a first option on the speaker connection configuration interface, where the first option is used to indicate whether to start automatic volume calibration. As shown in fig. 12, if the auto volume calibration option is turned on, the handset automatically starts the volume calibration when detecting the first operation. In addition, when the mobile phone detects the first operation, the mobile phone may further display a second session interface on the current user interface, where the second session interface includes a second prompt box, and the second prompt box is used to remind the user to keep the surrounding environment quiet, as shown in fig. 11. Or when the mobile phone detects the first operation, the user is reminded to keep the ambient environment quiet in a voice mode.

In some embodiments, in the process of listening to audio by the user for the above case (2), if the user perceives the sound field offset, the user initiates the volume calibration. In the audio playing process, a user can directly trigger volume calibration through a newly added first option on a current playing interface, and in response to the operation, the mobile phone sends a first audio to the first sound box and sends a second audio to the second sound box. Wherein the first option is for being in performing a volume calibration.

Exemplarily, as shown in fig. 13, the current playing interface includes a start volume calibration option, and when the user clicks a virtual button corresponding to the start volume calibration option shown in fig. 13, the mobile phone sends a first audio to the first sound box and sends a second audio to the second sound box in response to the operation.

For the above S905:

in some embodiments, the mobile phone may further display a third prompt box through the current user interface, where the third prompt box is used to remind the user not to obscure the microphone, as shown in fig. 14. Alternatively, in some embodiments, when the mobile phone detects that the user may block the microphone, a third prompt box is displayed through the current user interface, and the third prompt box is used to remind the user to check whether to block the microphone, as shown in fig. 14. Alternatively, in some embodiments, the handset prompts the user to check whether the microphone is occluded by voice when it detects that the user may occlude the microphone.

Illustratively, the mobile phone may instruct the first speaker to play the first audio K times, and instruct the second speaker to play the second audio K times at the same time, where K is a positive integer greater than or equal to 2. Furthermore, the mobile phone collects audio data corresponding to the K first audios respectively, determines K volumes according to the audio data corresponding to the K first audios respectively, and judges that the microphone is possibly shielded when the difference value between the maximum volume in the K volumes and the minimum volume in the K volumes is larger than a preset threshold value. Similarly, the mobile phone can also judge whether the condition of shielding the microphone exists according to the collected audio data corresponding to the K second audios respectively.

Assuming that K is 2, the mobile phone acquires audio data (hereinafter referred to as data 1) of the first audio played by the first speaker at 1 st time, and the mobile phone acquires audio data (hereinafter referred to as data 2) of the first audio played by the first speaker at 2 nd time. The mobile phone determines the volume (hereinafter referred to as volume 1) corresponding to the data 1 according to the data 1, and determines the volume (hereinafter referred to as volume 2) corresponding to the data 2 according to the data 2. And if the difference value between the volume 1 and the volume 2 is greater than the preset threshold value, displaying a third prompt box through the current user interface by the mobile phone, wherein the third prompt box is used for reminding a user to check whether the microphone is shielded or not.

By adopting the design, the influence on the volume calibration caused by the shielding of the microphone can be avoided, and the accuracy of the volume calibration is ensured.

In some embodiments, the mobile phone may further display a fourth prompt box through the current user interface, where the fourth prompt box is used to remind a user to keep an included angle between a plane where the mobile phone is located and the ground to be 90 degrees or remind the user to keep the mobile phone perpendicular to the ground; or, in some embodiments, when the mobile phone detects that the absolute value of the difference between the included angle between the plane where the mobile phone is located and the ground and 90 degrees is greater than the preset angle, the mobile phone displays a fourth prompt box through the current user interface, where the fourth prompt box is used to remind the user to keep the included angle between the plane where the mobile phone is located and the ground at 90 degrees, or remind the user to keep the mobile phone perpendicular to the ground, or remind the user to adjust the position of the mobile phone. Illustratively, when the mobile phone is horizontally placed on a desktop, or the tilt angle of the mobile phone is too large, the mobile phone displays a fourth prompt box through the current user interface, as shown in fig. 15. For example, the preset angle may be from 3 degrees to 8 degrees, for example, the preset angle is 5 degrees. When the absolute value of the difference between the 90 degrees and the included angle between the plane where the mobile phone is located and the ground is detected to be less than 5 degrees, the mobile phone determines that the mobile phone is approximately perpendicular to the ground (namely, the included angle between the plane where the mobile phone is located and the ground is about 90 degrees). And when the absolute value of the difference between the included angle between the plane where the mobile phone is located and the ground and 90 degrees is detected to be larger than 5 degrees, the mobile phone displays a fourth prompt box through the current user interface. Specifically, a given straight line, such as a horizontal line and/or a vertical line, may be displayed on the display interface in combination with the level function of the mobile phone, and once the straight line is deviated, the user is prompted to adjust the position of the mobile phone, for example, a fourth prompt box is displayed through the current user interface. It can be understood that, if an angle between a plane where the mobile phone is located and the ground is not specified, a large error may exist between the determined first volume to be calibrated and the determined second volume to be calibrated due to a directivity problem of the microphone, as shown in fig. 4 for details, the above design is adopted to ensure that the angle between the plane where the mobile phone is located and the ground is 90 degrees or approximately 90 degrees, so as to reduce the influence of the directivity problem of the microphone on volume calibration.

It is understood that, based on the same concept, the above embodiments can also be applied to a scenario in which three or more speakers perform volume calibration, as shown in fig. 7.

In the embodiments of the present application, unless otherwise specified or conflicting with respect to logic, the terms and/or descriptions in different embodiments have consistency and may be mutually cited, and technical features in different embodiments may be combined to form a new embodiment according to their inherent logic relationship.

In the present application, "at least one" means one or more, "a plurality" means two or more. "and/or" describes the association relationship of the associated objects, meaning that there may be three relationships, e.g., a and/or B, which may mean: a exists alone, A and B exist simultaneously, and B exists alone, wherein A and B can be singular or plural. In the description of the text of the present application, the character "/" generally indicates that the former and latter associated objects are in an "or" relationship; in the formula of the present application, the character "/" indicates that the preceding and following related objects are in a relationship of "division".

It is to be understood that the various numerical references referred to in the embodiments of the present application are merely for descriptive convenience and are not intended to limit the scope of the embodiments of the present application. The sequence numbers of the above-mentioned processes do not mean the execution sequence, and the execution sequence of the processes should be determined by their functions and inherent logic.

Claims (19)

1. A method for volume calibration, the method comprising:

the terminal equipment sends a first audio to the first sound box and sends a second audio to the second sound box;

the terminal equipment collects first audio data and second audio data on a first reference point, wherein the first audio data are audio data corresponding to the first audio played by the first sound box, and the second audio data are audio data corresponding to the second audio played by the second sound box;

the terminal equipment determines a first volume to be calibrated according to the first audio data and determines a second volume to be calibrated according to the second audio data;

and the terminal equipment determines a volume adjustment scheme according to the first volume to be calibrated and the second volume to be calibrated.

2. The method of claim 1, wherein the first audio and the second audio have different frequencies and/or have different waveforms in a predetermined portion of the sound wave.

3. The method of claim 1 or 2, wherein the first audio and the second audio have swept waveforms.

4. The method of any of claims 1-3, wherein the first reference point is determined based on a distance between the terminal device and the first speaker, orientation information of the first speaker relative to the terminal device, a distance between the terminal device and the second speaker, and orientation information of the second speaker relative to the terminal device.

5. The method according to any one of claims 1-4, wherein the first volume to be calibrated is a volume corresponding to a frequency range corresponding to the first audio data, and the second volume to be calibrated is a volume corresponding to a frequency range corresponding to the second audio data.

6. The method according to any one of claims 1-4, wherein the first volume to be calibrated is an average of volumes corresponding to a plurality of frequency ranges corresponding to the first audio data, respectively, and the second volume to be calibrated is an average of volumes corresponding to a plurality of frequency ranges corresponding to the second audio data, respectively.

7. The method according to any one of claims 1-4, wherein the first volume to be calibrated includes volumes corresponding to a plurality of frequency ranges corresponding to the first audio data, respectively, and the second volume to be calibrated includes volumes corresponding to a plurality of frequency ranges corresponding to the second audio data, respectively.

8. The method of claim 5 or 6, further comprising:

and the terminal equipment sends first information to the first loudspeaker box or the second loudspeaker box according to the volume adjustment scheme, wherein the first information is used for indicating the difference value between the first volume to be calibrated and the second volume to be calibrated.

9. The method of claim 5 or 6, further comprising:

and the terminal equipment sends second information to the first loudspeaker box according to the volume adjustment scheme and sends third information to the second loudspeaker box, wherein the second information is used for indicating a first volume adjustment amount, the third information is used for indicating a second volume adjustment amount, and the first volume adjustment amount and the second volume adjustment amount are determined according to the difference value of the first volume to be calibrated and the second volume to be calibrated.

10. The method of any one of claims 5-7, further comprising:

the terminal equipment adjusts the waveform of a third audio frequency according to the volume adjustment scheme;

the terminal equipment sends the adjusted third audio to the first sound box and sends a fourth audio to the second sound box;

or the terminal equipment adjusts the waveform of a fourth audio according to the volume adjustment scheme;

and the terminal equipment sends a third audio to the first sound box and sends an adjusted fourth audio to the second sound box.

11. The method of claim 10, wherein the third audio is the same as the fourth audio.

12. The method of any of claims 1-11, wherein prior to the terminal device transmitting the first audio to the first speaker and the second audio to the second speaker, further comprising:

the terminal device detects a first operation of a user, and the first operation is used for triggering the sound which is ready to be listened by the user to be projected to the first sound box and the second sound box for playing.

13. The method of claim 12, further comprising:

after the terminal device detects the first operation, the terminal device displays a first prompt box on a user interface; the first prompt box is used for prompting a user whether to execute volume calibration;

and the terminal equipment detects a second operation of the user aiming at the first prompt box, and the second operation indicates to execute volume calibration.

14. The method of claim 12 or 13, wherein the first enclosure is fixed in position and the second enclosure is fixed in position;

the method further comprises the following steps:

when the terminal equipment determines that the first operation is not detected for the first time, the terminal equipment determines a second reference point;

and if the distance between the first reference point and the second reference point is smaller than a preset threshold value, the terminal equipment determines to adopt the volume adjustment scheme.

15. The method of any of claims 1-14, wherein the user interface of the terminal device includes a first option; the first option is used for triggering execution of volume calibration;

before the terminal equipment sends first audio frequency to first audio amplifier, sends the second audio frequency to the second audio amplifier, still include:

and the terminal equipment detects that the user triggers the operation of the first option.

16. The method of any one of claims 1-15, further comprising:

the terminal device detects that the microphone is shielded by the user, and the terminal device displays a prompt box for reminding the user to check whether the microphone is shielded or not on a user interface.

17. The method of any one of claims 1-16, further comprising:

and the terminal equipment displays a prompt box for reminding a user to keep the terminal equipment vertical to the ground on a user interface.

18. An electronic device, wherein the electronic device comprises memory and one or more processors; wherein the memory is to store computer program code comprising computer instructions; the computer instructions, when executed by the processor, cause the electronic device to perform a display method as claimed in any one of claims 1-17 applied to an electronic device.

19. A computer-readable storage medium, in which a computer program or instructions is stored which, when executed by a communication apparatus, carries out the method of any one of claims 1-17.

Images