CN113824838A

CN113824838A - Sound production control method and device, electronic equipment and storage medium

Info

Publication number: CN113824838A
Application number: CN202110990921.7A
Authority: CN
Inventors: 凌华东
Original assignee: Realme Chongqing Mobile Communications Co Ltd
Current assignee: Realme Chongqing Mobile Communications Co Ltd
Priority date: 2021-08-26
Filing date: 2021-08-26
Publication date: 2021-12-21
Anticipated expiration: 2041-08-26
Also published as: CN113824838B

Abstract

The embodiment of the application provides a sound production control method and device, electronic equipment and a storage medium. The method comprises the following steps: acquiring the loudness of a sound signal played by a sound production component in the electronic equipment; acquiring the loudness of an environmental noise signal collected by a specified microphone of the electronic equipment; detecting whether a sound leakage event occurs or not based on the loudness of the sound signal and the loudness of the environmental noise signal, wherein the sound leakage event is an event that the leakage amount of the sound signal meets a preset condition; and if the sound leakage event occurs, adjusting the sounding parameters of the sounding component, wherein the sounding parameters are used for controlling the loudness of the sound signal. The technical scheme that this application embodiment provided provides an incident is revealed to automated inspection sound for electronic equipment can perceive the incident is revealed to sound, later adjusts through the sound production parameter to vocal parts in time, so that sound signal no longer takes place to reveal, effectively protects user's privacy.

Description

Sound production control method and device, electronic equipment and storage medium

Technical Field

The present disclosure relates to the field of sound technology, and more particularly, to a sound production control method and apparatus, an electronic device, and a storage medium.

Background

At present, the bluetooth technology is widely used, and after the bluetooth connection is established between the wireless earphone and the mobile terminal, the communication audio or the media audio sent by the mobile terminal can be played.

In the related art, when the wireless headset is worn by a user and is used for playing the call audio or the media audio, if the loudness of the played sound signal is high, a sound leakage event may occur, and people around the user can also hear the sound signal played by the wireless headset.

Disclosure of Invention

The embodiment of the application provides a sound production control method and device, electronic equipment and a storage medium.

In a first aspect, some embodiments of the present application provide a sound emission control method, which is applied to an electronic device, and includes: acquiring the loudness of a sound signal played by a sound production component in the electronic equipment; acquiring the loudness of an environmental noise signal collected by a specified microphone of the electronic equipment; detecting whether a sound leakage event occurs or not based on the loudness of the sound signal and the loudness of the environmental noise signal, wherein the sound leakage event is an event that the leakage amount of the sound signal meets a preset condition; and if the sound leakage event occurs, adjusting the sounding parameters of the sounding component, wherein the sounding parameters are used for controlling the loudness of the sound signal.

In a second aspect, some embodiments of the present application provide a sound emission control device, the device comprising: the first obtaining module is used for obtaining the loudness of a sound signal played by a sound production component in the electronic equipment; the second acquisition module is used for acquiring the loudness of the environmental noise signal acquired by a specified microphone of the electronic equipment; the event detection module is used for detecting whether a sound leakage event occurs or not based on the loudness of the sound signal and the loudness of the environmental noise signal, wherein the sound leakage event is an event that the leakage amount of the sound signal meets a preset condition; and the parameter adjusting module is used for adjusting the sounding parameters of the sounding component if the sound leakage event occurs, and the sounding parameters are used for controlling the loudness of the sound signal.

In a third aspect, some embodiments of the present application provide an electronic device comprising a processor and a memory, the memory storing computer program instructions, the computer program instructions being invoked by the processor to perform the method according to the first aspect as described above. In some embodiments, the electronic device is a mobile terminal. In other embodiments, the electronic device is a wireless headset.

In a fourth aspect, some embodiments of the present application provide a computer-readable storage medium having program code stored therein, the program code being invoked by a processor to perform the method according to the first aspect.

In a fifth aspect, some embodiments of the present application provide a computer program product for, when executed, implementing the method of the first aspect as described above.

The embodiment of the application provides a sound production control method, a sound production control device, electronic equipment and a storage medium, when a sound production component of the electronic equipment produces a sound signal, whether a sound production sound leakage event occurs is detected through the loudness of the sound signal and the loudness of an environmental noise signal collected by a specified microphone in the electronic equipment, if the sound leakage event occurs, the sound production parameter of the sound production component is adjusted to reduce the loudness of the sound signal until the sound leakage event does not occur any more; the technical scheme that this application embodiment provided provides an incident is revealed to automated inspection sound for electronic equipment can perceive the incident is revealed to sound, later adjusts through the sound production parameter to vocal parts in time, so that sound signal no longer takes place to reveal, effectively protects user's privacy.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.

FIG. 1 is a schematic diagram of an application scenario provided by an embodiment of the present application;

FIG. 2 is a schematic diagram of an application scenario provided by another embodiment of the present application;

FIG. 3 is a flow chart of a method of controlling speech provided by an embodiment of the present application;

FIG. 4 is a block diagram of an electronic device according to one embodiment of the present application;

FIG. 5 is a schematic illustration of an experimental environment provided by an embodiment of the present application;

fig. 6 is a block diagram of a sound emission control device provided in an embodiment of the present application;

FIG. 7 is a block diagram of an electronic device provided by one embodiment of the present application;

FIG. 8 is a block diagram of a computer-readable storage medium provided by one embodiment of the present application.

Detailed Description

Reference will now be made in detail to embodiments of the present application, examples of which are illustrated in the accompanying drawings, wherein like or similar reference numerals refer to the same or similar elements or elements having the same or similar function throughout. The embodiments described below with reference to the accompanying drawings are exemplary only for the purpose of explaining the present application and are not to be construed as limiting the present application.

In order to make the technical solutions of the present application better understood by those skilled in the art, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application. It is to be understood that the embodiments described are only a few embodiments of the present application and not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

In the related art, when a user wears the wireless headset, the user cannot perceive a sound leakage event, and adjustment measures cannot be taken for the sound leakage event, so that the privacy of the user is damaged.

Based on this, the embodiment of the present application provides a sound emission control method, when a sound emission component of an electronic device emits a sound signal, detecting whether a sound emission sound leakage event occurs or not according to the loudness of the sound signal and the loudness of an environmental noise signal collected by a specified microphone in the electronic device, and if the sound leakage event occurs, adjusting sound emission parameters of the sound emission component to reduce the loudness of the sound signal until the sound leakage event does not occur any more; the technical scheme that this application embodiment provided provides an incident is revealed to automated inspection sound for electronic equipment can perceive the incident is revealed to sound, later adjusts through the sound production parameter to vocal parts in time, so that sound signal no longer takes place to reveal, effectively protects user's privacy.

According to the technical scheme provided by the embodiment of the application, the main execution body of each step is electronic equipment, and the electronic equipment comprises an electroacoustic transducer, namely an electronic device for converting an electric signal into a sound signal, such as a loudspeaker. In some embodiments, the electronic device further comprises an acousto-electric transducer device, i.e. an electronic device that converts a sound signal into an electrical signal, such as a microphone. The embodiment of the application does not limit the number and the positions of the electroacoustic transducer devices and the electroacoustic transducer devices in the electronic equipment. In the embodiment of the present application, the electronic device further has a sound leakage event detection function, that is, whether a sound leakage event occurs is detected based on the loudness of the sound signal emitted by the electroacoustic transducer and the intensity of the environmental noise signal collected by the electroacoustic transducer.

In one embodiment, the electronic device is a wireless headset, the wireless headset includes a speaker unit and a microphone, the speaker unit is disposed in a sound pickup hole of the wireless headset, the microphone is disposed on an outer side of the wireless headset (e.g., on a side of the wireless headset away from an ear canal of a user), and when the wireless headset is worn by the user, a sound pickup port of the microphone faces an outer portion of the ear canal so as to facilitate picking up a sound signal. Referring to fig. 1, an application scenario provided by an embodiment of the present application is shown. The user wears the wireless earphone 11, the wireless earphone 11 establishes communication connection with the mobile terminal 12, and plays media audio or conversation audio sent by the mobile terminal 12, at this time, whether a sound leakage event occurs needs to be detected, and if the sound leakage event occurs, the loudness of a sound signal sent by the speaker unit needs to be reduced.

In another embodiment, the electronic device is a mobile terminal 21, the mobile terminal 21 includes a speaker and a microphone, the speaker may be disposed on the top end, the bottom end, and the back panel of the mobile terminal, and the microphone is disposed on the bottom end of the mobile terminal. Referring to fig. 2, an application scenario provided by an embodiment of the present application is shown. The mobile terminal 21 plays the call audio, and the user places the mobile terminal 21 near the ear to call with other people, and at this time, it is necessary to detect whether a sound leakage event occurs, and if the sound leakage event occurs, the loudness of the sound signal emitted by the speaker needs to be reduced.

As shown in fig. 3, the embodiment of the present application further provides a sound emission control method, which includes the following steps (step 301-304).

Step 301, obtaining the loudness of a sound signal played by a sound generating component in the electronic device.

The electronic device may be a mobile terminal or a wireless headset. When the electronic device is a mobile terminal, the sound production part of the electronic device is a loudspeaker assembly, which can be arranged at the top end of the mobile terminal, or can be arranged at the bottom end of the mobile terminal, or can be arranged at the back of the mobile terminal. When the electronic device is a wireless earphone, the sound production component in the electronic device is a loudspeaker unit, and the loudspeaker unit is arranged in an earphone part of the wireless earphone.

Loudness, i.e., volume, describes how loud a sound is, which represents the subjective perception of the sound by the human ear, and is measured in sons, which defines a loudness of 1 sons with a sound pressure level of 40dB pure tone.

In some embodiments, the loudness of the sound signal is determined by the volume level and the loudness of the source signal. The volume level is in positive correlation with the loudness of the sound signal, i.e., the higher the volume level is, the higher the loudness of the sound signal is, the lower the volume level is, and the lower the loudness of the sound signal is. The loudness of the sound source signal and the loudness of the sound signal are in positive correlation, namely the higher the loudness of the sound source signal is, the higher the loudness of the sound signal is, the lower the loudness of the sound source signal is, and the lower the loudness of the sound signal is. The loudness of the set sound signal is represented by S, the volume level is represented by L, the loudness of the sound source signal is represented by M, and the loudness of the sound signal S can be represented by the following formula.

S＝m(L+M)。

Wherein m is a preset coefficient. Since M is a preset coefficient, which is a fixed value, in the following embodiment, the loudness of the sound signal is represented by (L + M).

In other embodiments, the electronic device further includes an Automatic Gain Control (AGC) circuit, which is an Automatic Control circuit that automatically adjusts the Gain of the amplification circuit according to the signal strength. The first end of the AGC circuit is electrically connected with the appointed microphone, and the second end of the AGC circuit is electrically connected with the sounding component. Optionally, the electronic device further includes a Digital-to-Analog Converter (DAC) and an Analog-to-Digital Converter (ADC), wherein the DAC is disposed between the AGC circuit and the sound generating component, and the ADC is disposed between the AGC circuit and the specified microphone. Optionally, the AGC circuit is provided inside the DSP circuit.

Referring to fig. 4, the electronic device further includes a DSP circuit 41, a DAC circuit 44, and an ADC circuit 45, the DSP circuit 41 including an AGC411, the DAC circuit 44 being provided between the DSP circuit 41 and the sound emitting part 43 (i.e., S), and the ADC circuit 45 being provided between the AGC circuit and the specified microphone 42.

In this embodiment, the loudness of the sound signal is determined by the volume level, the loudness of the source signal, and the gain value of the AGC circuit. When the input signal is small, the AGC circuit is not in use, and only when the input signal is increased to a certain degree, the AGC circuit is in control action, so that the gain is reduced along with the increase of the input signal. The gain value of the AGC circuit is in positive correlation with the loudness of the sound signal, namely the larger the gain value of the AGC circuit is, the higher the loudness of the sound signal is, the smaller the gain value of the AGC circuit is, and the lower the loudness of the sound signal is. The loudness of the set sound signal is represented by S, the volume level is represented by L, the loudness of the sound source signal is represented by M, the gain value of the AGC circuit is G, and the loudness of the sound signal S can be represented by the following formula.

S＝b(L+M+G)。

Wherein b is a preset coefficient. Since b is a preset coefficient, which is a fixed value, in the following embodiment, the loudness of the sound signal is represented by (L + M + G).

In some embodiments, when the electronic device is a mobile terminal, step 301 is implemented as: the loudness of a sound signal played by a specified sound production component in the electronic equipment is obtained, wherein the specified sound production component is a loudspeaker assembly arranged at the top end of the mobile terminal. When the appointed sound production component works, the mobile terminal is in a call state, a requirement for preventing sound leakage exists, and the mobile terminal executes a subsequent detection step of a sound leakage event so as to avoid call audio from being leaked.

Step 302, obtaining the loudness of the ambient noise signal collected by a specified microphone of the electronic device.

When the electronic device is a mobile terminal, the designated microphone is a noise reduction microphone, which can be arranged at the bottom end of the mobile terminal or at the back of the mobile terminal. When the electronic device is a wireless earphone, the designated microphone is arranged on the outer side of the wireless earphone (for example, on the side of the wireless earphone departing from the ear canal of the user), and when the wireless earphone is worn by the user, the sound pickup port of the microphone faces the outside of the ear canal, so that the environment noise signal is facilitated. The electronic equipment obtains the loudness of the environment noise signal collected by the appointed microphone through a noise estimation method. Noise estimation methods include, but are not limited to: a noise estimation algorithm based on minimum statistics, a recursive averaging algorithm based on minimum statistics control, an adaptive continuous noise spectrum estimation method, and the like.

Step 303, detecting whether a sound leakage event occurs based on the loudness of the sound signal and the loudness of the ambient noise signal.

The sound leakage event refers to an event that the leakage amount of the sound signal satisfies a preset condition. The leakage amount of the sound signal refers to the loudness of the sound signal collected by the specified microphone.

The preset conditions are set according to experiments or experience. In some embodiments, the preset condition is that the loudness of the leakage amount of the sound signal is greater than the loudness of the ambient noise signal, in which case, other users can also hear the sound signal played by the sound emitting component of the electronic device, resulting in privacy leakage. In other embodiments, the preset condition refers to that the loudness of the leakage amount of the sound signal is greater than a preset loudness, and the preset loudness is set according to experiments or experience, which is not limited in this application.

The determination condition under which the electronic device determines whether a sound leakage event occurs may be determined in a laboratory environment. Referring to fig. 5, a schematic diagram of an experimental environment provided by an embodiment of the present application is shown, the experimental environment including: artificial ear 51, electronic device 52, test microphone mic1, and sound 53. The electronic device 52 includes a speaker and a microphone, where the speaker in the electronic device 52 is denoted as S, and the microphone is denoted as mic 2.

The distance between the artificial ear 51 and the test microphone mic1 is actually determined, and in one example, the distance between the artificial ear 51 and the test microphone mic1 is approximately 50 centimeters. The stereo 53 is used to simulate an ambient noise signal and is disposed to the right of the test microphone mic 1. The experimenter sets up to play the first test sound signal S through a speaker S in the electronic device 52₀And a second test sound signal s₁The stereo 53 plays the ambient noise signal N. First test sound signal s₀And a second test sound signal s₁May be the same or different.

The test system records a first test sound signal s collected by a microphone mic2 of the electronic device₀And the loudness s of the first test sound signal collected by the test microphone mic1₀The difference between them, as the first difference. That is, the first difference value X is represented by the following first formula: x is mic2(s)₀)-mic1(s₀) That is, X is mic2(S) -mic1 (S).

The test system records as a second difference the loudness of the test noise signal N picked up by the test microphone mic1, and the loudness of the test noise signal N picked up by the microphone mic1 of the electronic device 52. That is, the second difference value Y is represented by the second formula: y mic1(N) -mic2 (N).

The test system records a second test sound signal s₁And the second test sound signal s collected by the microphone mic2 of the electronic device 52₁As a third difference value. The third difference a is represented by a third formula as follows: a ═ s₁-mic2(s₁) That is, a is S-mic2 (S).

In a laboratory environment, if it is determined that a sound leakage event does not occur, the ambient noise signal mic1(N) collected by the test microphone mic1 needs to be greater than the collected test sound signal mic1 (S). That is, mic1(S) <mic 1(N) (fourth formula).

However, according to the first formula, mic1(S) is mic2(S) -X (fifth formula).

From the second formula, one can obtain: mic1(N) is mic2(N) + Y (sixth formula).

By combining the fourth formula, the fifth formula and the sixth formula, the following can be obtained:

mic2(S) -X < (mic 2(N) + Y, that is, mic2(S) < (mic 2(N) + Y + X (seventh formula).

Further, according to the third formulA, mic2(S) is S-A (eighth formulA).

From the seventh and eighth equations, one can obtain: S-A < mic2(N) + Y + X, S < mic2(N) + Y + X + A (ninth formulA).

When S is represented by (L + M), that is, (L + M) <mic 2(N) + Y + X + a. In this case, it is determined that the sound safety condition, which is a condition to be satisfied without the occurrence of the sound leakage event, is satisfied. On the contrary, if (L + M) > mic2(N) + Y + X + a, it indicates that a sound leakage event occurs.

When S is represented by (L + M + G), that is, (L + M + G) <mic 2(N) + Y + X + a. In this case, it is determined that the sound safety condition is satisfied, whereas if (L + M + G) > mic2(N) + Y + X + a, it is interpreted that a sound leakage event occurs.

In combination with the above-mentioned determination condition of the sound leakage event determined in the laboratory environment, the electronic device detects whether the sound leakage event occurs by the following steps.

Step 303a, a first difference, a second difference and a third difference are obtained.

The first difference is a difference between a loudness of a first test sound signal picked up by a designated microphone of the electronic device and a loudness of a first test sound signal picked up by a test microphone, the first test sound signal being emitted by a sound emitting component of the electronic device. The second difference is the difference between the loudness of the test noise signal collected by the test microphone and the loudness of the test noise signal collected by the designated microphone of the electronic device. The third difference is a difference between a loudness of the second test sound signal emitted by the sound emitting component of the electronic device and a loudness of the second test sound signal collected by a designated microphone of the electronic device.

The process of obtaining the first difference, the second difference, and the third difference refers to the above embodiments.

Step 303b, if the loudness of the sound signal is greater than the sum of the loudness of the ambient noise signal, the first difference, the second difference, and the third difference, it is determined that a sound leakage event occurs.

When S is represented by (L + M), if (L + M) <mic 2(N) + X + Y + a, it indicates that no sound leakage event has occurred; if (L + M) > mic2(N) + X + Y + a, it indicates that a sound leakage event has occurred.

When S is represented by (L + M + G), if (L + M + G) <mic 2(N) + X + Y + a, it indicates that no sound leakage event has occurred; on the contrary, if (L + M + G) > mic2(N) + X + Y + a, it indicates that a sound leakage event occurs.

And 304, if a sound leakage event occurs, adjusting the sounding parameters of the sounding component, wherein the sounding parameters are used for controlling the loudness of the sound signal.

After the sound leakage event is determined, the electronic equipment automatically adjusts the sounding parameters of the sounding component, wherein the sounding parameters comprise volume levels and/or gain values of an AGC circuit, so that the loudness of the sound signal is reduced, the sound signal is not leaked any more, and the privacy of a user can be effectively protected.

The embodiment of the application provides a sound production control method, when a sound production component of electronic equipment produces a sound signal, whether a sound production sound leakage event occurs is detected through the loudness of the sound signal and the loudness of an environmental noise signal collected by a specified microphone in the electronic equipment, if the sound leakage event occurs, the sound production parameter of the sound production component is adjusted to reduce the loudness of the sound signal until the sound leakage event does not occur any more; the technical scheme that this application embodiment provided provides an incident is revealed to automated inspection sound for electronic equipment can perceive the incident is revealed to sound, later adjusts through the sound production parameter to vocal parts in time, so that sound signal no longer takes place to reveal, effectively protects user's privacy.

In a first implementation, the sound generation parameter of the sound generation component includes a volume level, and the electronic device adjusts the loudness of the sound signal through adjustment of the volume level. This implementation is described below.

In some embodiments, adjusting the volume level specifically includes the following steps (steps 401-403).

Step 401, if a sound leakage event is sent out, a prompt message is sent out.

The prompt message is used for prompting the occurrence of a sound leakage event. When the electronic device is a mobile terminal, the prompt information may be at least one of a voice prompt mode, a text prompt mode and a flashing prompt mode. When the electronic device is a wireless earphone, the prompt message may be at least one of a voice prompt mode and a flashing prompt mode.

In one example, the wireless headset emits a "sound leak please treat in time" to prompt the user.

In another example, the mobile terminal displays a floating window that includes a prompt message "sound leak, please handle in time".

In step 402, a first adjustment amount of the volume level is obtained in response to an adjustment signal for the volume level.

The adjustment signal for the volume level is used to adjust the volume level. When the electronic device detects a sound leakage event, the loudness of the sound signal needs to be decreased, and therefore the volume level needs to be decreased, that is, in the embodiment of the present application, the adjustment signal for the volume level is used to decrease the volume level.

When the electronic equipment is a mobile terminal, a volume adjusting button is arranged on a side frame of the mobile terminal, and when the pressing operation aiming at the volume adjusting button is received, the mobile terminal receives an adjusting signal aiming at the volume level. Specifically, the volume adjustment button includes a decrease button, and when the mobile terminal receives a pressing operation for the decrease button, an adjustment signal for decreasing the volume level is received.

In some embodiments, the first adjustment amount of the volume level is in a positive correlation with the number of pressing operations, that is, the larger the number of pressing operations is, the larger the first adjustment amount of the volume level is, the smaller the number of pressing operations is, and the smaller the first adjustment amount of the volume level is. Optionally, a first mapping relationship exists between the first adjustment amount of the volume level and the operation times of the pressing signal, and after receiving the pressing operation, the mobile terminal obtains the operation times of the pressing operation, and then determines the first adjustment amount of the volume level based on the first mapping relationship. The first mapping relation may be a functional relation, or may be a corresponding relation between different operation times and different adjustment amounts.

In other embodiments, the first adjustment amount of the volume level is in a positive correlation with the operation duration of the pressing operation, that is, the longer the operation duration of the pressing operation is, the larger the first adjustment amount of the volume level is, the shorter the operation duration of the pressing operation is, and the smaller the first adjustment amount of the volume level is. Optionally, a second mapping relationship exists between the first adjustment amount of the volume level and the operation time of the press signal, and after receiving the press operation, the mobile terminal obtains the number of times of the press operation, and then determines the first adjustment amount of the volume level based on the second mapping relationship. The second mapping relation may be a functional relation, or may be a corresponding relation between different operation durations and different adjustment amounts.

When the electronic equipment is a wireless earphone, the ear handle part of the wireless earphone is provided with a volume adjusting button, and when a pressing signal aiming at the volume adjusting button is received, the wireless earphone receives an adjusting signal aiming at the volume level. Specifically, the volume adjustment button includes a decrease button, and when the wireless headset receives a pressing operation for the decrease button, an adjustment signal for decreasing the volume level is received. In other possible implementation manners, the wireless headset receives an adjustment signal for the volume level, which is sent by the mobile terminal and carries the first adjustment amount. Wherein a communication connection, such as a bluetooth connection, is established between the wireless headset and the mobile terminal.

Step 403, adjusting the volume level according to the first adjustment amount of the volume level.

In some embodiments, the electronic device subtracts the first adjustment amount from the original volume level to obtain an adjusted volume level, and then adjusts the volume level to the adjusted volume level. Illustratively, the original volume level is 36, the first adjustment amount of the volume level is 10, and the adjusted volume level is 26, then the electronic device adjusts the volume level to 26.

In other embodiments, adjusting the volume level specifically includes the following steps 404 and 406.

At step 404, a leak rating of the acoustic leak event is obtained.

The leak level is used to characterize the severity of the acoustic leak event. In some embodiments, the leak level is determined based on an interval to which the fourth difference belongs. The fourth difference is the loudness of the sound signal and the difference between the loudness of the ambient noise signal and the sum of the first difference, the second difference and the third difference.

When S is expressed by (L + M), the fourth difference value Z is expressed by the following formula.

Z＝(L+M)-(mic2(N)+X+Y+A)。

The larger the value of Z, the higher the severity of the sound leakage event; the larger the value of Z, the lower the severity of the sound leakage event. In some embodiments, the electronic device sets a third mapping relationship between the value range of Z and the leakage level, and determines the leakage level based on the third mapping relationship after calculating Z.

At step 405, a second adjustment amount for the volume level is determined based on the leak level of the acoustic leak event.

The leakage grade and the second adjustment quantity have positive correlation. The higher the leakage level, the larger the second adjustment amount, the lower the leakage level, the smaller the second adjustment amount. In some embodiments, the electronic device presets a fourth mapping relationship between the leakage level and the volume level, and determines the second adjustment amount based on the fourth mapping relationship after determining the leakage level.

Step 406, adjusting the volume level according to the second adjustment amount of the volume level.

In some embodiments, the electronic device subtracts the first adjustment amount from the original volume level to obtain an adjusted volume level, and then adjusts the volume level to the adjusted volume level.

In other embodiments, the adjusting the volume level specifically includes the following steps (steps 407 and 409).

Step 407, obtaining the loudness of the sound source signal of the sound signal, the first difference, the second difference, and the third difference.

Step 408, determining a target volume level based on the sound safety condition, the loudness of the sound source signal, the first difference, the second difference, and the third difference.

The acoustic safety condition is used to characterize the condition satisfied by the absence of an acoustic leak event. When S is represented by (L + M), if (L + M) <mic 2(N) + X + Y + a, it indicates that no sound leakage event has occurred.

In some embodiments, the electronic device determines the difference between the loudness of the ambient noise signal, the sum of the first difference, the second difference, and the third difference, and the loudness of the sound source signal as the target volume level on the premise that the sound leakage event does not occur. I.e., L < ═ mic2(N) + X + Y + a-M, the electronic device determines any volume level that satisfies the above formula as the target volume level.

In some embodiments, the method F of adjusting the volume level provided in steps 407-409 may be expressed as the following formula.

That is, when L + M is equal to or less than mic2(N) + Y + X + a, the volume level L is maintained as the user's original setting value, and when L + M > mic2(N) + Y + X + a, the volume level L is adjusted to L ═ mic2(N) + Y + X + a-M.

Step 409, the volume level is adjusted to the target volume level.

The electronic device adjusts the volume level to a target volume level.

The embodiment of the application provides a sound production control method, and after a sound leakage event is determined, the volume level of a sound production component is adjusted to reduce the loudness of a sound signal, so that the sound signal is not leaked any more, and the privacy of a user is effectively protected.

In a second implementation, the sound generation parameters of the sound generation component include a gain value of the AGC circuit, and the electronic device adjusts the loudness of the sound signal by adjusting the gain value. This implementation is described below.

In some embodiments, adjusting the gain value of the AGC circuit specifically includes the following steps (steps 501-503).

Step 501, obtaining a leakage grade of a sound leakage event.

The leak level is used to characterize the severity of the acoustic leak event. The leak level is used to characterize the severity of the acoustic leak event. In some embodiments, the leak level is determined based on an interval to which the fourth difference belongs. The fourth difference is the loudness of the sound signal and the difference between the loudness of the ambient noise signal and the sum of the first difference, the second difference and the third difference.

When S is expressed by (L + M + G), the fourth difference value Z is expressed by the following formula.

Z＝(L+M+G)-(mic2(N)+X+Y+A)。

Step 502 determines an amount of adjustment of the gain value based on the leakage level of the acoustic leakage event.

The leakage level is in positive correlation with the adjustment amount of the gain value. The leakage level is in positive correlation with the adjustment amount of the gain value. That is, the higher the leakage level, the larger the adjustment amount of the gain value, and the lower the leakage level, the smaller the adjustment amount of the gain value. In some embodiments, the electronic device presets a fifth mapping relationship between the leakage level and the gain value, and after determining the leakage level, determines an adjustment amount for the gain value based on the fifth mapping relationship.

Step 503, adjusting the volume level according to the adjustment amount of the gain.

In some embodiments, the electronic device subtracts the adjustment amount from the original gain value to obtain an adjusted gain value, and then adjusts the gain value of the AGC circuit to the adjusted volume level.

In some embodiments, adjusting the gain value of the AGC circuit specifically includes the following steps (step 504-506).

Step 504, a volume level, a loudness of a sound source signal of the sound signal, a first difference, a second difference, and a third difference are obtained.

And 505, determining a target gain value based on the sound safety condition, the volume level, the loudness of the sound source signal, the first difference value, the second difference value and the third difference value.

The acoustic safety condition is used to characterize the condition satisfied by the absence of an acoustic leak event. When S is represented by (L + M + G), if (L + M + G) <mic 2(N) + X + Y + a, it indicates that no sound leakage event has occurred.

In some embodiments, the electronic device determines the difference between the sum of the loudness of the ambient noise signal, the first difference, the second difference, and the third difference, and the sum of the loudness of the sound source signal and the volume level as the target volume level on the premise that the sound leakage event does not occur. That is, G < ═ mic2(N) + X + Y + a- (L + M), the electronic device determines any gain value that satisfies the above formula as the target gain value.

In some embodiments, the method F of adjusting the gain value of the AGC provided in steps 504-506 can be expressed as the following equation.

That is, when L + M + G is less than or equal to mic2(N) + Y + X + A, the gain G of the AGC module is not set accordingly, and when L + M + G is greater than mic2(N) + Y + X + A, the gain G of the AGC module needs to satisfy G is less than or equal to mic2(N) + Y + X + A-M-L.

Step 506, the gain value of the AGC circuit is adjusted to a target gain value.

The electronic device adjusts the gain value of the AGC circuit to a target gain value.

The embodiment of the application provides a sounding parameter adjusting method, and after a sound leakage event is determined, the gain value of an AGC circuit is adjusted to reduce the loudness of a sound signal, so that the sound signal is not leaked any more, and the privacy of a user is effectively protected. In addition, because of the operating characteristics of the AGC circuit, the AGC circuit does not function when the input signal is small, and the AGC circuit functions only when the input signal is increased to a certain degree, there can be an appropriate gain even when the loudness of the sound signal of the sound emitting part is small, so that the user can hear it clearly.

In some embodiments, the electronic device performs the subsequent sound leakage event detection step when the privacy mode is in the on state, so as to avoid that the electronic device performs the above steps in a scenario where the sound leakage event does not need to be detected (for example, music is played out through a mobile phone), which results in unnecessary power consumption waste on the one hand, and on the other hand, the loudness of the sound signal is reduced in the scenario where the sound leakage event does not need to be detected, which may violate the actual needs of the user and bring inconvenience to the user.

In view of the above problem, the present embodiment further provides a method for adjusting vocalization parameters, and in an alternative embodiment provided based on the embodiment shown in fig. 3, before step 301, the following steps are further included.

Step 601, acquiring the on-off state of the privacy mode.

The on-off state of the privacy mode includes an on state and an off state.

And if the on-off state of the privacy mode is the on state, executing the step of acquiring the loudness of the sound signal played by the sound generating component in the electronic equipment. Under the condition that the privacy mode is in an open state, the user is determined to have a privacy protection requirement, whether a sound leakage event exists or not needs to be detected at the moment, and after the sound leakage event is determined to occur, the sounding parameters are adjusted in time to reduce the loudness of the sound signals until the sound leakage does not occur any more, so that the privacy of the user is effectively protected.

And if the switching state of the privacy mode is the closing state, not executing the subsequent steps. And under the condition that the privacy mode is in a closed state, determining that the user does not have the privacy protection requirement, and not executing the subsequent steps at the moment, so that the power consumption of the electronic equipment is saved.

Before step 601, the electronic device opens the door privacy mode according to the setting of the user or according to the privacy protection requirement in different scenes. Both cases are described below.

When the electronic device is a mobile terminal, in some embodiments, the mobile terminal switches the on-off state of the privacy mode to the on-off state when monitoring an incoming communication event.

The communication incoming call event refers to an event that an opposite-end mobile terminal requests to establish a call with a home-end mobile terminal, the communication incoming call event indicates that the mobile terminal is about to enter a call scene, and if a privacy protection requirement exists, a privacy mode needs to be opened, so that a sound leakage event can be detected in time and sounding parameters can be adjusted in time, and sound leakage is avoided.

Optionally, after receiving a call instruction for a number of an SIM card built in the home terminal, the opposite mobile terminal sends a call request to the home terminal, and at this time, the home terminal monitors an incoming communication event. Optionally, after receiving a voice call instruction or a video call instruction for a specified account in a specified application program, the opposite-end mobile terminal sends a call request to the home-end mobile terminal, and at this time, the home-end mobile terminal monitors a call incoming event, where the specified account is a user account that is logged in by the specified application program in the home-end mobile terminal, and the specified application program is an application program having a voice call function or a video call function, such as a social application program.

In other embodiments, the mobile terminal displays a switch of the privacy mode, acquires a first open instruction for the switch of the privacy mode, and switches the switch state of the privacy mode to the open state based on the first open instruction.

The first open indication is triggered by a user for triggering the opening of the privacy mode. The first open indication includes at least one of: a specified operation signal for a switch of the privacy mode, a specified voice signal.

The above-mentioned specified operation signals include, but are not limited to: a long press operation signal, a single click operation signal, a double click operation signal, a slide operation signal, and a drag operation signal. In the embodiment of the present application, only the case where the designation operation signal is the one-click operation signal will be described. In one example, the user speaks "turn on privacy mode" when the mobile terminal receives a specified voice signal.

When the electronic device is a wireless headset, in some embodiments, if the wireless headset receives call data sent by the mobile terminal, the switch state of the privacy mode is switched to the on state. If the wireless earphone receives the call data sent by the mobile terminal, the wireless earphone indicates that the wireless earphone is about to enter a call scene, a privacy protection requirement exists, and a privacy mode needs to be opened so that a sound leakage event can be detected in time and sounding parameters can be adjusted in time to avoid sound leakage.

In some embodiments, the wireless headset receives a second turn-on indication sent by the mobile terminal, and switches to the turn-on state based on the switch state of the second turn-on indication privacy mode. In this embodiment, the user turns on the privacy mode in the mobile terminal, and the mobile terminal synchronizes the on-off state of the privacy mode to the wireless headset. The steps of the user turning on the privacy mode in the mobile terminal are described above and are not described herein.

The embodiment of the application provides a sound production control method, wherein the electronic equipment executes subsequent sound leakage event detection steps when a privacy mode is in an open state, so that the electronic equipment is prevented from executing the steps under a scene without detecting a sound leakage event, and the power consumption of the electronic equipment is saved on the premise of protecting the privacy of a user.

And the privacy mode is automatically opened in the conversation scene, so that the electronic equipment can timely detect the sound leakage event in the conversation scene and timely adjust the sounding parameters, and the conversation data leakage is avoided.

As shown in fig. 6, an embodiment of the present application further provides a sound emission control device, including: a first acquisition module 610, a second acquisition module 620, an event detection module 630, and a parameter adjustment module 640.

The first obtaining module 610 is configured to obtain loudness of a sound signal played by a sound generating component in the electronic device.

A second obtaining module 620, configured to obtain a loudness of the ambient noise signal collected by a specified microphone of the electronic device.

An event detecting module 630, configured to detect whether a sound leakage event occurs based on the loudness of the sound signal and the loudness of the ambient noise signal, where the sound leakage event is an event in which a leakage amount of the sound signal satisfies a preset condition.

And the parameter adjusting module 640 is configured to adjust a sounding parameter of the sounding component if the sound leakage event occurs, where the sounding parameter is used to control the loudness of the sound signal.

The embodiment of the application provides a sound production control device, when a sound production component of electronic equipment produces a sound signal, whether a sound production sound leakage event occurs is detected through the loudness of the sound signal and the loudness of an environmental noise signal collected by a specified microphone in the electronic equipment, if the sound leakage event occurs, the sound production parameter of the sound production component is adjusted to reduce the loudness of the sound signal until the sound leakage event does not occur any more; the technical scheme that this application embodiment provided provides an incident is revealed to automated inspection sound for electronic equipment can perceive the incident is revealed to sound, later adjusts through the sound production parameter to vocal parts in time, so that sound signal no longer takes place to reveal, effectively protects user's privacy.

In some embodiments, the parameter of the utterance includes a volume level, and the parameter adjustment module 640 is configured to adjust the volume level.

In some embodiments, the parameter adjusting module 640 is configured to send a prompt message if the sound leakage event occurs, where the prompt message is used to prompt that the sound leakage event occurs; acquiring a first adjustment amount of the volume level in response to an adjustment signal for the volume level; and adjusting the volume level according to the first adjustment amount of the volume level.

In some embodiments, the parameter adjusting module 640 is configured to obtain a leak level of the acoustic leak event, where the leak level is used to characterize a severity of the acoustic leak event; determining a second adjustment amount of the volume level based on a leakage level of the sound leakage event, wherein the leakage level and the second adjustment amount have a positive correlation; and adjusting the volume level according to the second adjustment amount of the volume level.

In some embodiments, the parameter adjusting module 640 is configured to obtain loudness of a sound source signal of the sound signal, a first difference value, a second difference value, and a third difference value; determining a target volume level based on an acoustic safety condition, the loudness of the audio source signal, the first difference, the second difference, and the third difference, the acoustic safety condition characterizing a condition that is satisfied by the absence of the acoustic leak event; adjusting the volume level to the target volume level; wherein the first difference is a difference between a loudness of a first test sound signal collected by a designated microphone of the electronic device and a loudness of the first test sound signal collected by a test microphone, the first test sound signal emitted by a sound emitting component of the electronic device; the second difference is a difference between a loudness of a test noise signal collected by a test microphone and a loudness of the test noise signal collected by a designated microphone of the electronic device; the third difference is a difference between a loudness of a second test sound signal and a loudness of the second test sound signal collected by a designated microphone of the electronic device, where the second test sound signal is emitted by a sound emitting component of the electronic device.

In some embodiments, the electronic device further includes an automatic gain control circuit, a first end of the automatic gain control circuit is electrically connected to the designated microphone, a second end of the automatic gain control circuit is electrically connected to the sound generating component, and the sound generating parameter includes a gain value of the automatic gain control circuit; the parameter adjusting module 640 is configured to adjust a gain value of the AGC circuit.

In some embodiments, the parameter adjusting module 640 is configured to obtain a leak level of the acoustic leak event, where the leak level is used to characterize a severity of the acoustic leak event; determining an adjustment amount of the gain value based on a leakage level of the sound leakage event, wherein the leakage level and the adjustment amount of the gain value have a positive correlation; and adjusting the volume level according to the adjustment amount of the gain.

In some embodiments, the parameter adjusting module 640 is configured to obtain a volume level, a loudness of a sound source signal of the sound signal, a first difference, a second difference, and a third difference; determining a target gain value based on an acoustic safety condition characterizing conditions satisfied by the absence of the acoustic leak event, the volume level, the loudness of the audio source signal, the first difference, the second difference, and the third difference; and adjusting the gain value of the AGC circuit to the target gain value.

In some embodiments, the event detecting module 630 is configured to obtain a first difference value, a second difference value, and a third difference value; and if the loudness of the sound signal is greater than the sum of the loudness of the ambient noise signal, the first difference, the second difference and the third difference, determining that the sound leakage event occurs.

In some embodiments, a switch state control module (not shown in fig. 6).

And the switch state control module is used for acquiring the switch state of the privacy mode.

The first obtaining module 610 is configured to, if the on-off state of the privacy mode is an on state, perform the step of obtaining the loudness of the sound signal played by the sound generating component in the electronic device.

In some embodiments, when the electronic device is a wireless headset, the switch state control module is configured to switch the switch state of the privacy mode to the on state if call data sent by a mobile terminal is received; or receiving a second opening instruction sent by the mobile terminal, and switching the switch state of the privacy mode to the opening state based on the second opening instruction.

In some embodiments, when the electronic device is a mobile terminal, the switch state control module is configured to switch the switch state of the privacy mode to the on state if call data sent by the mobile terminal is received; or receiving a second opening instruction sent by the mobile terminal, and switching the switch state of the privacy mode to the opening state based on the second opening instruction.

It can be clearly understood by those skilled in the art that, for convenience and brevity of description, the specific working processes of the above-described apparatuses and modules may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.

In the several embodiments provided in the present application, the coupling between the modules may be electrical, mechanical or other type of coupling.

In addition, functional modules in the embodiments of the present application may be integrated into one processing module, or each of the modules may exist alone physically, or two or more modules are integrated into one module. The integrated module can be realized in a hardware mode, and can also be realized in a software functional module mode.

As shown in fig. 7, an electronic device 700 is further provided in the embodiments of the present application, where the electronic device 700 includes a processor 710 and a memory 720, and the memory 720 stores computer program instructions.

Processor 710 may include one or more processing cores. The processor 710 interfaces with various interfaces and circuitry throughout the battery management system to perform various functions of the battery management system and process data by executing or executing instructions, programs, code sets, or instruction sets stored in the memory 720 and invoking data stored in the memory 720. Alternatively, the processor 710 may be implemented in hardware using at least one of Digital Signal Processing (DSP), Field-Programmable Gate Array (FPGA), and Programmable Logic Array (PLA). The processor 710 may integrate one or more of a Central Processing Unit (CPU) 710, a Graphics Processing Unit (GPU) 710, a modem, and the like. Wherein, the CPU mainly processes an operating system, a user interface, an application program and the like; the GPU is used for rendering and drawing display content; the modem is used to handle wireless communications. It is understood that the modem may not be integrated into the processor 710, but may be implemented by a communication chip.

The Memory 720 may include a Random Access Memory (RAM) 720 and a Read-Only Memory (Read-Only Memory) 720. The memory 720 may be used to store instructions, programs, code sets, or instruction sets. The memory 720 may include a stored program area and a stored data area, wherein the stored program area may store instructions for implementing an operating system, instructions for implementing at least one function (such as a touch function, a sound playing function, an image playing function, etc.), instructions for implementing various method embodiments described below, and the like. The storage data area can also store data (such as a phone book, audio and video data, chatting record data) created by the electronic device map in use and the like.

As shown in fig. 8, an embodiment of the present application further provides a computer-readable storage medium 800, where computer program instructions 810 are stored in the computer-readable storage medium 800, and the computer program instructions 810 can be called by a processor to execute the method described in the above embodiment.

The computer-readable storage medium may be an electronic memory such as a flash memory, an EEPROM (electrically erasable programmable read only memory), an EPROM, a hard disk, or a ROM. Alternatively, the computer-readable storage medium includes a non-volatile computer-readable storage medium. The computer readable storage medium 800 has a storage space for program code for performing any of the method steps of the method described above. The program code can be read from or written to one or more computer program products. The program code may be compressed, for example, in a suitable form.

Although the present application has been described with reference to the preferred embodiments, it is to be understood that the present application is not limited to the disclosed embodiments, but rather, the present application is intended to cover various modifications, equivalents and alternatives falling within the spirit and scope of the present application.

Claims

1. A sound production control method is applied to an electronic device, and the method comprises the following steps:

acquiring the loudness of a sound signal played by a sound production component in the electronic equipment;

obtaining the loudness of an environmental noise signal collected by a specified microphone of the electronic equipment;

detecting whether a sound leakage event occurs or not based on the loudness of the sound signal and the loudness of the environmental noise signal, wherein the sound leakage event is an event that the leakage amount of the sound signal meets a preset condition;

and if the sound leakage event occurs, adjusting the sounding parameters of the sounding component, wherein the sounding parameters are used for controlling the loudness of the sound signal.

2. The method of claim 1, wherein the sound production parameters include volume level, and wherein adjusting the sound production parameters of the sound production component includes:

and adjusting the volume level.

3. The method of claim 2, wherein the adjusting the volume level comprises:

if the sound leakage event occurs, sending prompt information, wherein the prompt information is used for prompting the occurrence of the sound leakage event;

acquiring a first adjustment amount of the volume level in response to an adjustment signal for the volume level;

and adjusting the volume level according to the first adjustment amount of the volume level.

4. The method of claim 2, wherein the adjusting the volume level comprises:

acquiring a leakage grade of the sound leakage event, wherein the leakage grade is used for representing the severity of the sound leakage event;

determining a second adjustment amount of the volume level based on a leakage level of the sound leakage event, wherein the leakage level and the second adjustment amount have a positive correlation;

and adjusting the volume level according to the second adjustment amount of the volume level.

5. The method of claim 2, wherein said adjusting said volume level comprises:

obtaining loudness, a first difference value, a second difference value and a third difference value of a sound source signal of the sound signal;

determining a target volume level based on an acoustic safety condition, the loudness of the audio source signal, the first difference, the second difference, and the third difference, the acoustic safety condition characterizing a condition that is satisfied by the absence of the acoustic leak event;

adjusting the volume level to the target volume level;

wherein the first difference is a difference between a loudness of a first test sound signal collected by a designated microphone of the electronic device and a loudness of the first test sound signal collected by a test microphone, the first test sound signal emitted by a sound emitting component of the electronic device;

the second difference is a difference between a loudness of a test noise signal collected by a test microphone and a loudness of the test noise signal collected by a designated microphone of the electronic device;

the third difference is a difference between a loudness of a second test sound signal and a loudness of the second test sound signal collected by a designated microphone of the electronic device, where the second test sound signal is emitted by a sound emitting component of the electronic device.

6. The method of claim 1, wherein the electronic device further comprises an automatic gain control circuit, a first terminal of the automatic gain control circuit is electrically connected to the designated microphone, a second terminal of the automatic gain control circuit is electrically connected to the sound generating component, and the sound generating parameter comprises a gain value of the automatic gain control circuit;

the adjusting of the sounding parameters of the sounding component comprises:

and adjusting the gain value of the automatic gain control circuit.

7. The method of claim 6, wherein the adjusting the gain value of the AGC circuit comprises:

determining an adjustment amount of the gain value based on a leakage level of the sound leakage event, wherein the leakage level and the adjustment amount of the gain value have a positive correlation;

and adjusting the volume level according to the adjustment amount of the gain.

8. The method of claim 6, wherein the adjusting the gain value of the automatic gain control circuit comprises:

acquiring a volume level, the loudness of a sound source signal of the sound signal, a first difference value, a second difference value and a third difference value;

determining a target gain value based on an acoustic safety condition characterizing conditions satisfied by the absence of the acoustic leak event, the volume level, the loudness of the audio source signal, the first difference, the second difference, and the third difference;

adjusting the gain value of the AGC circuit to the target gain value;

9. The method of any of claims 1-8, wherein detecting whether a sound leakage event has occurred based on the loudness of the sound signal and the loudness of the ambient noise signal comprises:

acquiring a first difference value, a second difference value and a third difference value;

and if the loudness of the sound signal is greater than the sum of the loudness of the ambient noise signal, the first difference, the second difference and the third difference, determining that the sound leakage event occurs.

10. A sound emission control device, characterized in that the device comprises:

the first obtaining module is used for obtaining the loudness of a sound signal played by a sound production component in the electronic equipment;

the second acquisition module is used for acquiring the loudness of the environmental noise signal acquired by a specified microphone of the electronic equipment;

the event detection module is used for detecting whether a sound leakage event occurs or not based on the loudness of the sound signal and the loudness of the environmental noise signal, wherein the sound leakage event is an event that the leakage amount of the sound signal meets a preset condition;

and the parameter adjusting module is used for adjusting the sounding parameters of the sounding component if the sound leakage event occurs, and the sounding parameters are used for controlling the loudness of the sound signal.

11. An electronic device comprising a processor and a memory, the memory storing computer program instructions that are invoked by the processor to perform the method of any of claims 1-9.

12. A computer-readable storage medium having program code stored therein, the program code being invoked by a processor to perform the method of any one of claims 1 to 9.