CN113299310B

CN113299310B - Sound signal processing method and device, electronic equipment and readable storage medium

Info

Publication number: CN113299310B
Application number: CN202010106329.1A
Authority: CN
Inventors: 杜秉聰; 熊飞飞; 冯津伟
Original assignee: Alibaba Group Holding Ltd
Current assignee: Alibaba Group Holding Ltd
Priority date: 2020-02-21
Filing date: 2020-02-21
Publication date: 2022-05-13
Anticipated expiration: 2040-02-21
Also published as: CN113299310A

Abstract

The embodiment of the disclosure discloses a sound signal processing method, a sound signal processing device, an electronic device and a readable storage medium, wherein the sound signal processing method comprises the steps of acquiring a first input sound signal; acquiring a first processing parameter; determining a second processing parameter at least based on the amplitude of the first input sound signal and the first processing parameter; and processing the first input sound signal according to the second processing parameter to obtain a target output sound signal. The technical scheme can improve the effect of outputting sound and improve user experience.

Description

Sound signal processing method and device, electronic equipment and readable storage medium

Technical Field

The present disclosure relates to the field of computer application technologies, and in particular, to a sound signal processing method and apparatus, an electronic device, and a readable storage medium.

Background

With the development of internet technology, more and more users conduct a teleconference or a video conference through electronic devices. During the conference, the user can control the volume of an audio playing device (such as a loudspeaker) in the electronic device by using a volume controller in the electronic device, so that the user can clearly listen to the speech of the remote user. However, the position of the fader of the related art corresponds to a fixed gain, and the input sound signal varies widely, and therefore, when the input sound signal is amplified using the fixed gain, a satisfactory output signal is often not obtained.

Disclosure of Invention

In order to solve the problems in the related art, embodiments of the present disclosure provide a sound signal processing method and apparatus, an electronic device, and a readable storage medium.

In a first aspect, a sound signal processing method is provided in the disclosed embodiments.

Specifically, the sound signal processing method includes:

acquiring a first input sound signal;

acquiring a first processing parameter;

determining a second processing parameter at least based on the amplitude of the first input sound signal and the first processing parameter;

and processing the first input sound signal according to the second processing parameter to obtain a target output sound signal.

With reference to the first aspect, the present disclosure provides in a first implementation manner of the first aspect, wherein the determining a second processing parameter according to at least the amplitude of the first input sound signal and the first processing parameter is performed by a first electronic device.

With reference to the first aspect, in a second implementation manner of the first aspect, the determining a second processing parameter according to at least the amplitude of the first input sound signal and the first processing parameter is performed by a server.

With reference to the first aspect, in a third implementation manner of the first aspect, the first input sound signal includes: a sound signal received from a second electronic device in communication with the first electronic device; or a sound signal derived based on a first audio or video file;

the target output sound signal includes a sound signal output from the first electronic device.

With reference to the first aspect, in a fourth implementation manner of the first aspect, the determining a second processing parameter according to at least the amplitude of the first input sound signal and the first processing parameter includes:

determining the second processing parameter based on the amplitude of the first input sound signal, the first processing parameter, and at least one of the following influencing factors: a signal-to-noise ratio of the first input sound signal, an amplitude of an expected output sound signal, whether a second input sound signal is acquired while the first input sound signal is acquired, and an amplitude of the second input sound signal acquired while the first input sound signal is acquired, wherein the expected output sound signal is acquired by processing the first input sound signal according to a current gain.

With reference to the fourth implementation manner of the first aspect, the present disclosure provides in a fifth implementation manner of the first aspect, where the first input sound signal includes a sound signal received from a second electronic device communicating with a first electronic device, the target output sound signal includes a sound signal output from the first electronic device, and the second input sound signal includes:

a sound signal generated based on sound received by a microphone of the first electronic device; or

A sound signal derived based on the second audio or video file.

With reference to the fourth implementation manner of the first aspect, the present disclosure provides in a sixth implementation manner of the first aspect, where the first input sound signal includes a sound signal obtained based on a first audio or video file, the target output sound signal includes a sound signal output from the first electronic device, and the second input sound signal includes:

a sound signal received from a second electronic device in communication with the first electronic device; or

A sound signal derived based on the second audio or video file.

With reference to the first aspect or the fourth implementation manner of the first aspect, in a seventh implementation manner of the first aspect, the first processing parameter includes:

a specified first gain; or

The sound signal amplitude is specified.

With reference to the seventh implementation manner of the first aspect, in an eighth implementation manner of the first aspect, when the first processing parameter includes the specified first gain, the determining a second processing parameter according to at least the amplitude of the first input sound signal and the first processing parameter includes adjusting the first gain according to at least the following manner, and taking the adjusted first gain as the second processing parameter:

increasing the first gain when the amplitude of the first input sound signal is less than a first preset threshold.

With reference to the seventh implementation manner of the first aspect, in a ninth implementation manner of the first aspect, when the first processing parameter includes the specified first gain, the determining the second processing parameter according to the amplitude of the first input sound signal, the first processing parameter, and at least one of the following influencing factors: the signal-to-noise ratio of the first input sound signal, the amplitude of an expected output sound signal, whether a second input sound signal is acquired while acquiring the first input sound signal, and the amplitude of the second input sound signal acquired while acquiring the first input sound signal include adjusting the first gain according to the following manner, and taking the adjusted first gain as the second processing parameter:

increasing the first gain when the amplitude of the first input sound signal is less than a first preset threshold; and is

The following operations are performed: when the signal-to-noise ratio of the first input sound signal is smaller than a second preset threshold value, reducing the first gain; and/or

Decreasing the first gain when the amplitude of the expected output sound signal is greater than a third preset threshold; and/or

Reducing the first gain when a second input sound signal is acquired simultaneously with acquiring the first input sound signal; and/or

Determining an adjustment magnitude of the first gain according to a magnitude of the second input sound signal.

With reference to the seventh implementation manner of the first aspect, in a tenth implementation manner of the first aspect, when the first processing parameter includes the specified sound signal amplitude, the determining a second processing parameter according to at least the amplitude of the first input sound signal and the first processing parameter includes:

determining a second gain based on the specified sound signal amplitude and the amplitude of the first input sound signal.

With reference to the seventh implementation manner of the first aspect, in an eleventh implementation manner of the first aspect, when the first processing parameter includes the specified sound signal amplitude, the determining the second processing parameter according to the amplitude of the first input sound signal, the first processing parameter, and at least one of the following influencing factors: the signal-to-noise ratio of the first input sound signal, the amplitude of an expected output sound signal, whether a second input sound signal is acquired while acquiring the first input sound signal, and the amplitude of the second input sound signal acquired while acquiring the first input sound signal include determining a second gain according to the specified sound signal amplitude and the amplitude of the first input sound signal, adjusting the second gain according to the following manner, and taking the adjusted second gain as the second processing parameter:

when the signal-to-noise ratio of the first input sound signal is smaller than a second preset threshold value, reducing the second gain; and/or

Decreasing the second gain when the amplitude of the expected output sound signal is greater than a third preset threshold; and/or

Reducing the second gain when a second input sound signal is acquired simultaneously with acquiring the first input sound signal; and/or

Determining an adjustment magnitude of the second gain according to a magnitude of the second input sound signal.

With reference to the fourth implementation manner of the first aspect, the present disclosure provides in a twelfth implementation manner of the first aspect, wherein the determining the second processing parameter is performed according to the amplitude of the first input sound signal, the first processing parameter, and at least one of the following influencing factors: a signal-to-noise ratio of the first input sound signal, an amplitude of an expected output sound signal, whether a second input sound signal was acquired while the first input sound signal was acquired, an amplitude of the second input sound signal acquired while the first input sound signal was acquired, comprising:

and determining the second processing parameter according to the amplitude of the first input sound signal, the first processing parameter and the preset corresponding relation between the at least one influencing factor and the second processing parameter.

With reference to the fourth implementation manner of the first aspect, the present disclosure provides in a thirteenth implementation manner of the first aspect, wherein the determining the second processing parameter is performed according to the amplitude of the first input sound signal, the first processing parameter, and at least one of the following influencing factors: a signal-to-noise ratio of the first input sound signal, an amplitude of an expected output sound signal, whether a second input sound signal was acquired while the first input sound signal was acquired, an amplitude of the second input sound signal acquired while the first input sound signal was acquired, comprising:

determining the second processing parameter using a pre-trained adjustment model based on the amplitude of the first input sound signal, the first processing parameter, and the at least one influencing factor, the pre-trained model being trained using sample data of the amplitude of the first input sound signal, sample data of the first processing parameter, and sample data of the at least one influencing factor.

With reference to the first aspect, in a fourteenth implementation manner of the first aspect, the present disclosure further includes:

acquiring an initial input sound signal;

and processing the initial input sound signal according to the specified processing parameters to obtain the first input sound signal.

With reference to the fourteenth implementation manner of the first aspect, in a fifteenth implementation manner of the first aspect, the specified processing parameter is determined according to an amplitude of the initial input sound signal and/or a signal-to-noise ratio of the initial input sound signal.

With reference to the fourteenth implementation manner of the first aspect, in a sixteenth implementation manner of the first aspect, the obtaining an initial input sound signal and the processing the initial input sound signal are performed by a server.

With reference to the first aspect, the present disclosure provides in a seventeenth implementation manner of the first aspect, the determining a second processing parameter according to at least the amplitude of the first input sound signal and the first processing parameter includes determining the second processing parameter according to at least the amplitude and the voiceprint characteristics of the first input sound signal and the first processing parameter.

With reference to the first aspect, in an eighteenth implementation manner of the first aspect, the processing the first input sound signal according to the second processing parameter includes processing the denoised first input sound signal according to the second processing parameter.

In a second aspect, an embodiment of the present disclosure provides a sound signal processing apparatus.

Specifically, the sound signal processing apparatus includes:

a first acquisition module configured to acquire a first input sound signal;

a second obtaining module configured to obtain the first processing parameter;

a determination module configured to determine a second processing parameter based on at least the amplitude of the first input sound signal and the first processing parameter;

a third obtaining module configured to process the first input sound signal according to the second processing parameter to obtain a target output sound signal.

With reference to the second aspect, in a first implementation manner of the second aspect, the determining a second processing parameter according to at least the amplitude of the first input sound signal and the first processing parameter is performed by a first electronic device.

With reference to the second aspect, in a second implementation manner of the second aspect, the determining a second processing parameter according to at least the amplitude of the first input sound signal and the first processing parameter is performed by a server.

With reference to the second aspect, in a third implementation manner of the second aspect, the first input sound signal includes: a sound signal received from a second electronic device in communication with the first electronic device; or a sound signal derived based on a first audio or video file;

With reference to the second aspect, in a fourth implementation manner of the second aspect, the determining a second processing parameter according to at least the amplitude of the first input sound signal and the first processing parameter includes:

With reference to the fourth implementation manner of the second aspect, the present disclosure is directed to a fifth implementation manner of the second aspect, wherein the first input sound signal includes a sound signal received from a second electronic device communicating with a first electronic device, the target output sound signal includes a sound signal output from the first electronic device, and the second input sound signal includes:

A sound signal derived based on the second audio or video file.

With reference to the fourth implementation manner of the second aspect, the present disclosure is directed to a sixth implementation manner of the second aspect, wherein the first input sound signal includes a sound signal obtained based on a first audio or video file, the target output sound signal includes a sound signal output from the first electronic device, and the second input sound signal includes:

A sound signal derived based on the second audio or video file.

With reference to the second aspect or the fourth implementation manner of the second aspect, in a seventh implementation manner of the second aspect, the first processing parameter includes:

a specified first gain; or

The sound signal amplitude is specified.

With reference to the seventh implementation manner of the second aspect, in an eighth implementation manner of the second aspect, when the first processing parameter includes the specified first gain, the determining a second processing parameter according to at least the amplitude of the first input sound signal and the first processing parameter includes adjusting the first gain according to at least the following manner, and taking the adjusted first gain as the second processing parameter:

With reference to the seventh implementation manner of the second aspect, in a ninth implementation manner of the second aspect, when the first processing parameter includes the specified first gain, the determining the second processing parameter according to the amplitude of the first input sound signal, the first processing parameter, and at least one of the following influencing factors: the signal-to-noise ratio of the first input sound signal, the amplitude of an expected output sound signal, whether a second input sound signal is acquired while acquiring the first input sound signal, and the amplitude of the second input sound signal acquired while acquiring the first input sound signal include adjusting the first gain according to the following manner, and taking the adjusted first gain as the second processing parameter:

With reference to the seventh implementation manner of the second aspect, in a tenth implementation manner of the second aspect, when the first processing parameter includes the specified sound signal amplitude, the determining a second processing parameter according to at least the amplitude of the first input sound signal and the first processing parameter includes:

With reference to the seventh implementation manner of the second aspect, in an eleventh implementation manner of the second aspect, when the first processing parameter includes the specified sound signal amplitude, the determining the second processing parameter according to the amplitude of the first input sound signal, the first processing parameter, and at least one of the following influencing factors: the signal-to-noise ratio of the first input sound signal, the amplitude of an expected output sound signal, whether a second input sound signal is acquired while acquiring the first input sound signal, and the amplitude of the second input sound signal acquired while acquiring the first input sound signal include determining a second gain according to the specified sound signal amplitude and the amplitude of the first input sound signal, adjusting the second gain according to the following manner, and taking the adjusted second gain as the second processing parameter:

With reference to the fourth implementation manner of the second aspect, in a twelfth implementation manner of the second aspect, the determining the second processing parameter is performed according to the amplitude of the first input sound signal, the first processing parameter, and at least one of the following influencing factors: a signal-to-noise ratio of the first input sound signal, an amplitude of an expected output sound signal, whether a second input sound signal was acquired while the first input sound signal was acquired, an amplitude of the second input sound signal acquired while the first input sound signal was acquired, comprising:

With reference to the fourth implementation manner of the second aspect, in a thirteenth implementation manner of the second aspect, the determining the second processing parameter is performed according to the amplitude of the first input sound signal, the first processing parameter, and at least one of the following influencing factors: a signal-to-noise ratio of the first input sound signal, an amplitude of an expected output sound signal, whether a second input sound signal was acquired while the first input sound signal was acquired, an amplitude of the second input sound signal acquired while the first input sound signal was acquired, comprising:

With reference to the second aspect, in a fourteenth implementation manner of the second aspect, the present disclosure further includes:

a fourth acquisition module configured to acquire an initial input sound signal;

a fifth obtaining module configured to process the initial input sound signal according to a specified processing parameter, resulting in the first input sound signal.

With reference to the fourteenth implementation manner of the second aspect, in a fifteenth implementation manner of the second aspect, the specified processing parameter is determined according to the amplitude of the initial input sound signal and/or the signal-to-noise ratio of the initial input sound signal.

With reference to the fourteenth implementation manner of the second aspect, in a sixteenth implementation manner of the second aspect, the acquiring an initial input sound signal and the processing the initial input sound signal are performed by a server.

With reference to the second aspect, in a seventeenth implementation manner of the second aspect, the determining a second processing parameter according to at least the amplitude of the first input sound signal and the first processing parameter includes determining the second processing parameter according to at least the amplitude and the voiceprint characteristics of the first input sound signal and the first processing parameter.

With reference to the second aspect, the present disclosure provides in an eighteenth implementation manner of the second aspect, the processing the first input sound signal according to the second processing parameter includes processing the denoised first input sound signal according to the second processing parameter.

In a third aspect, the present disclosure provides an electronic device, including a memory and a processor, where the memory is configured to store one or more computer instructions, where the one or more computer instructions are executed by the processor to implement the method according to any one of the first aspect, the first implementation manner to the eighteenth implementation manner of the first aspect.

In a fourth aspect, an embodiment of the present disclosure provides a readable storage medium, on which computer instructions are stored, and the computer instructions, when executed by a processor, implement the method according to any one of the first aspect, the first implementation manner to the eighteenth implementation manner of the first aspect.

According to the technical scheme provided by the embodiment of the disclosure, the second processing parameter can be obtained according to the amplitude of the first input sound signal and the first processing parameter, the first input sound signal is processed by using the second processing parameter, and the target output sound signal is obtained, so that the sound output effect is improved, and the user experience is improved.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.

Drawings

Other features, objects, and advantages of the present disclosure will become more apparent from the following detailed description of non-limiting embodiments when taken in conjunction with the accompanying drawings. In the drawings:

fig. 1 shows a flow chart of a sound signal processing method according to an embodiment of the present disclosure;

fig. 2A and 2B illustrate schematic diagrams of a first input sound signal according to an embodiment of the present disclosure;

FIG. 3 shows a schematic diagram of first and second input sound signals according to an embodiment of the disclosure;

fig. 4A and 4B show schematic diagrams of first and second input sound signals according to an embodiment of the disclosure;

fig. 5 shows a schematic diagram of a sound signal processing method according to an embodiment of the present disclosure;

fig. 6 shows a block diagram of a structure of a sound signal processing apparatus according to an embodiment of the present disclosure;

FIG. 7 shows a block diagram of an electronic device according to an embodiment of the present disclosure;

fig. 8 shows a schematic structural diagram of a computer system suitable for implementing a sound signal processing method according to an embodiment of the present disclosure.

Detailed Description

Hereinafter, exemplary embodiments of the present disclosure will be described in detail with reference to the accompanying drawings so that those skilled in the art can easily implement them. Furthermore, parts that are not relevant to the description of the exemplary embodiments have been omitted from the drawings for the sake of clarity.

In the present disclosure, it is to be understood that terms such as "including" or "having," etc., are intended to indicate the presence of the disclosed features, numbers, steps, actions, parts, portions, or combinations thereof, and are not intended to preclude the possibility that one or more other features, numbers, steps, actions, parts, portions, or combinations thereof, are present or added.

It should be further noted that the embodiments and features of the embodiments in the present disclosure may be combined with each other without conflict. The present disclosure will be described in detail below with reference to the accompanying drawings in conjunction with embodiments.

As described above, when a user controls the volume of an audio playing device in an electronic device by using a volume controller in the electronic device, since each gear of the volume controller corresponds to a fixed gain in the prior art, and input sound signals are very different, when the input sound signals are amplified by using the fixed gain, a satisfactory output signal is often not obtained, thereby affecting the effect of a teleconference or a video conference.

The present disclosure is made to solve, at least in part, the problems in the prior art that the inventors have discovered.

Fig. 1 shows a flow chart of a sound signal processing method according to an embodiment of the present disclosure. As shown in fig. 1, the sound signal processing method includes the following steps S101 to S104:

in step S101, a first input sound signal is acquired;

in step S102, a first processing parameter is acquired;

in step S103, determining a second processing parameter at least according to the amplitude of the first input sound signal and the first processing parameter;

in step S104, the first input audio signal is processed according to the second processing parameter, so as to obtain a target output audio signal.

According to an embodiment of the present disclosure, the first input sound signal includes: a sound signal received from a second electronic device in communication with a first electronic device, or a sound signal derived based on a first audio or video file, the target output sound signal including a sound signal output from the first electronic device.

According to an embodiment of the present disclosure, a first input sound signal may be acquired by a first electronic device (e.g., a near-end electronic device or a local electronic device in a two-or multi-party call). In the present disclosure, a sound signal refers to an electrical signal corresponding to sound. The first input sound signal may be derived from one or more other second electronic devices (e.g., a far-end electronic device in a two-party or multi-party call), for example, an electrical signal obtained by converting sound acquired by the second electronic device, or may be derived from the first electronic device, for example, an electrical signal generated by playing a multimedia file such as audio or video by the first electronic device, which is not specifically limited in this disclosure. The electronic device may be, for example, a handheld terminal device, a notebook computer, a cellular phone, a smart phone, a personal digital assistant computer, a tablet computer, a cordless phone, an internet of things device (IOT device), or other terminal devices, which are not specifically limited in this disclosure.

According to an embodiment of the present disclosure, after the first input sound signal is acquired, a first processing parameter corresponding to the first input sound signal may be acquired, wherein the first processing parameter may be, for example, a specified gain for the first input sound signal or a specified sound signal amplitude.

As described above, when an input sound signal is amplified using a fixed gain, a satisfactory output signal is often not obtained. According to an embodiment of the present disclosure, a second processing parameter may be determined based on at least an amplitude of the first input sound signal and the first processing parameter, and the first input sound signal may be processed using the second processing parameter to improve the output sound signal.

According to an embodiment of the disclosure, the determining of the second processing parameter at least from the amplitude of the first input sound signal and the first processing parameter is performed by the first electronic device. Alternatively, according to an embodiment of the present disclosure, the determining the second processing parameter at least according to the amplitude of the first input sound signal and the first processing parameter is performed by a server (e.g. a conference server of a multi-party conference or an edge server in a network).

According to the embodiment of the present disclosure, when the operation of determining the second processing parameter is performed by the first electronic device, the second processing parameter can be determined locally more quickly, the real-time performance is better, and when the operation of determining the second processing parameter is performed by the server, the load of local processing can be reduced.

According to an embodiment of the disclosure, the determining a second processing parameter from at least the amplitude of the first input sound signal and the first processing parameter comprises:

The influencing factor may comprise a parameter of the first input sound signal, such as a signal-to-noise ratio of the first input sound signal. The influencing factors may comprise a parameter of the expected output sound signal of the first electronic device, such as an amplitude of the expected output sound signal. In this disclosure, a sound signal obtained by processing (e.g., amplifying) a first input sound signal with a current gain is referred to as an intended output sound signal. The influencing factor may include whether the second input sound signal is acquired at the same time as the first input sound signal is acquired, for example, the voice of the user is acquired through a microphone of the near-end electronic device or an audio/video file is played through the near-end electronic device. If the second input sound signal is obtained simultaneously with the first input sound signal, the influencing factor may comprise a parameter of the second input sound signal, such as the amplitude of the second input sound signal.

According to the embodiment of the disclosure, the second processing parameter can be obtained according to the amplitude of the first input sound signal, the first processing parameter and one or more factors of the above influencing factors, and the target output sound signal is obtained by processing the first input sound signal by using the second processing parameter, so that the effect of outputting sound is improved, and the user experience is improved.

According to an embodiment of the present disclosure, the second processing parameter may also be determined from the first processing parameter and one or more of: an amplitude of the first input sound signal, a signal-to-noise ratio of the first input sound signal, an amplitude of an expected output sound signal, whether a second input sound signal was acquired while the first input sound signal was acquired, an amplitude of the second input sound signal acquired while the first input sound signal was acquired.

According to an embodiment of the present disclosure, the first input sound signal includes:

A sound signal derived based on the first audio or video file.

Fig. 2A and 2B illustrate schematic diagrams of a first input sound signal according to an embodiment of the present disclosure.

As shown in fig. 2A, the user 201A communicates with the user 202A using the second electronic device 202B through the first electronic device 201B, and it should be understood that this example is only used as an example and is not a limitation of the present disclosure, and the number and the kind of the electronic devices in the present disclosure may be set according to actual needs, which is not specifically limited by the present disclosure.

According to an embodiment of the present disclosure, the user 201A makes a real-time voice call with the user 202A, and when the user 202A inputs a sound through a sound input device (e.g., a microphone) of the second electronic device 202B, the second electronic device 202B converts the sound into a sound signal and transmits the sound signal as the first input sound signal 201C to the first electronic device 201B, i.e., the first input sound signal includes a sound signal received from the second electronic device 202B communicating with the first electronic device 201B.

As shown in fig. 2B, according to an embodiment of the disclosure, the user 201A may play a first audio or video file through the first electronic device 201B, and the first electronic device 201B may obtain a first input sound signal 201C based on the first audio or video file, that is, the first input sound signal includes a sound signal obtained based on the first audio or video file.

According to an embodiment of the present disclosure, the first input sound signal comprises a sound signal received from a second electronic device in communication with the first electronic device, the second input sound signal comprises:

A sound signal derived based on the second audio or video file.

Fig. 3 shows a schematic diagram of first and second input sound signals according to an embodiment of the present disclosure.

As shown in fig. 3, the user 301A communicates with the user 302A using the second electronic device 302B through the first electronic device 301B, it should be understood that this example is only used as an example and is not a limitation to the present disclosure, and the number and kinds of the electronic devices in the present disclosure may be set according to actual needs, which is not specifically limited by the present disclosure.

According to the embodiment of the present disclosure, when the communication state between the first electronic device 301B and the second electronic device 302B is in the "talk-two" state, the user 301A may acquire the second input sound signal through the first electronic device 301B while acquiring the first input sound signal 301C originated from the second electronic device 302B.

According to an embodiment of the present disclosure, when the user 301A inputs a sound through the microphone of the first electronic device 301B, the first electronic device 301B may capture the sound and convert it into a second input sound signal, i.e., the second input sound signal includes a sound signal generated based on the sound received by the microphone of the first electronic device 301B. For example, when the user 301A makes a real-time voice call with the user 302A, the first electronic device 301A may simultaneously acquire a first input sound signal 301C originating from the second electronic device 302B and a second input sound signal generated based on sound received by a microphone of the first electronic device 301B.

Alternatively, according to the embodiment of the present disclosure, the user 301A plays the second audio or video file through the first electronic device 301B, and the first electronic device 301B may acquire the second input sound signal based on the second audio or video file, that is, the second input sound signal includes a sound signal obtained based on the second audio or video file. For example, when the user 301A makes a real-time voice call with the user 302A, the first electronic device 301A may simultaneously acquire the first input sound signal 302C from the second electronic device 302B and the second input sound signal obtained by the first electronic device 301B based on the second audio or video file.

According to an embodiment of the present disclosure, the first input sound signal comprises a sound signal derived based on a first audio or video file, and the second input sound signal comprises:

A sound signal generated based on sound received by a microphone of the first electronic device; or alternatively

A sound signal derived based on the second audio or video file.

Fig. 4A and 4B illustrate schematic diagrams of first and second input sound signals according to an embodiment of the present disclosure.

As shown in fig. 4A, a user 401A uses a first electronic device 401B, and a user 402A uses a second electronic device 402B, it should be understood that this example is only used as an example, and is not a limitation to the present disclosure, and the number and kinds of electronic devices in the present disclosure may be set according to actual needs, and the present disclosure does not specifically limit this.

According to an embodiment of the present disclosure, the second input sound signal may also be acquired while the first electronic device 401B derives the first input sound signal 401C based on the first audio or video file.

According to an embodiment of the present disclosure, while the first electronic device 401B plays the first audio or video file, the user 401A may communicate with the user 402A using the second electronic device 402B through the first electronic device 401B, and acquire a second input sound signal converted from a sound input by the user 402A through the second electronic device 402B, that is, the second input sound signal includes a sound signal received from the second electronic device 402B communicating with the first electronic device 401B. For example, while a first audio or video file is being played by the first electronic device 401B, the user 401A makes a real-time voice call with the user 402A, and at this time, the first electronic device 401A can simultaneously acquire a first input sound signal 401C originating from the first electronic device 401B and a second input sound signal originating from the second electronic device 402B.

As shown in fig. 4B, according to an embodiment of the present disclosure, while the first electronic device 401B plays the first audio or video file, the user 401A may also input a sound signal through a microphone of the first electronic device 401B, and the first electronic device 401B may acquire the sound signal and convert into a second input sound signal, i.e., the second input sound signal includes a sound signal generated based on sound received by the microphone of the first electronic device 401B. For example, while playing a first audio or video file through the first electronic device 401B, the user 401A may also input sound through a microphone of the first electronic device 401B, at which point the first electronic device 401A may simultaneously acquire a first input sound signal 401C originating from the first electronic device 401B and a sound signal generated based on sound received by the microphone of the first electronic device 401B.

Alternatively, as shown in fig. 4B, according to the embodiment of the disclosure, while the first audio or video file is played by the first electronic device 401B, the user 401A may also play a second audio or video file by the first electronic device 401B, and the first electronic device 401B may acquire a sound signal based on the second audio or video file, that is, the second input sound signal includes a sound signal obtained based on the second audio or video file. For example, while a first audio or video file is being played by the first electronic device 401B, the user 401A plays a second audio or video file by the first electronic device 401B, and at this time, the first electronic device 401A can simultaneously acquire a first input sound signal 401C originating from the first electronic device 401B and a second input sound signal derived based on the second audio or video file.

According to an embodiment of the present disclosure, the first processing parameter includes:

a specified first gain; or

The sound signal amplitude is specified.

According to the embodiment of the disclosure, a user can select a first gain through a volume controller on a first electronic device, wherein the first gain and a gear of the volume controller have a one-to-one mapping relation. For example, assuming that the volume controller has 0-7 steps, it can be expressed as: [0,1,2, 3., 7], assuming that the first gain corresponding to the 8 th gear is expressed as [ - ∞ -9, -6, -3,0,3,6,9], the user can specify the first gain by specifying the gear, for example, when the user selects the 4 th gear, the specified first gain is "-3", that is, the first processing parameter is the first gain "-3".

According to an embodiment of the present disclosure, the user may specify the amplitude of the sound signal, and the second gain is determined by dividing the specified sound signal amplitude by the amplitude of the first input sound signal. For example, assuming that the sound signal amplitude is specified to be divided into n steps, it can be expressed as: n-1, where 0 ≦ i < n-1, the user may specify the i-th range sound signal amplitude, and the second gain Gi may be expressed as the specified sound signal amplitude Ti corresponding to the specified range i divided by the amplitude M of the first input sound signal, i.e., Gi ═ Ti/M.

According to an embodiment of the present disclosure, when the first processing parameter includes a specified first gain, the current gain refers to a current first gain, and when the first processing parameter includes a specified output sound signal amplitude, the current gain refers to a current second gain.

According to an embodiment of the present disclosure, when the first processing parameter includes the specified first gain, the determining a second processing parameter according to at least the amplitude of the first input sound signal and the first processing parameter includes adjusting the first gain according to at least the following manner, taking the adjusted first gain as the second processing parameter: increasing the first gain when the amplitude of the first input sound signal is less than a first preset threshold.

According to an embodiment of the present disclosure, when the first processing parameter includes the specified first gain, the determining the second processing parameter is based on the amplitude of the first input sound signal, the first processing parameter, and at least one of the following influencing factors: the signal-to-noise ratio of the first input sound signal, the amplitude of an expected output sound signal, whether a second input sound signal is acquired while acquiring the first input sound signal, and the amplitude of the second input sound signal acquired while acquiring the first input sound signal, include adjusting the first gain according to the following manner, taking the adjusted first gain as the second processing parameter:

increasing the first gain when the amplitude of the first input sound signal is less than a first preset threshold; and performing the following operations: when the signal-to-noise ratio of the first input sound signal is smaller than a second preset threshold value, reducing the first gain; and/or reducing the first gain when the amplitude of the expected output sound signal is greater than a third preset threshold; and/or reducing the first gain when a second input sound signal is acquired simultaneously with the acquisition of the first input sound signal; and/or determining an adjusted magnitude of the first gain based on a magnitude of the second input sound signal.

According to an embodiment of the disclosure, when the first processing parameter comprises the specified first gain, the determining a second processing parameter from the first processing parameter and one or more of: the amplitude of the first input sound signal, the signal-to-noise ratio of the first input sound signal, the amplitude of an expected output sound signal, whether a second input sound signal is acquired while the first input sound signal is acquired, and the amplitude of the second input sound signal acquired while the first input sound signal is acquired include adjusting the first gain according to the following manner, and taking the adjusted first gain as the second processing parameter:

increasing the first gain when the amplitude of the first input sound signal is less than a first preset threshold; and/or

When the signal-to-noise ratio of the first input sound signal is smaller than a second preset threshold value, reducing the first gain; and/or

According to the embodiment of the present disclosure, since the amplitude of the first input sound signal may affect the expected output sound signal, the first preset threshold may be preset, and the amplitude of the first input sound signal is compared with the first preset threshold, the first preset threshold is not specifically limited by the present disclosure, and may be selected according to actual needs. When the amplitude of the first input sound signal is smaller than the first preset threshold, indicating that the level of the first input sound signal is smaller, the first processing parameter may be increased, that is, the specified first gain is increased, so as to increase the volume of the output sound.

According to the embodiment of the disclosure, since the signal-to-noise ratio of the first input sound signal may affect the expected output sound signal, the second preset threshold may be preset, and the signal-to-noise ratio of the first input sound signal is compared with the second preset threshold. When the signal-to-noise ratio of the first input sound signal is smaller than the second preset threshold, which indicates that the noise in the first input sound signal is larger, the first processing parameter may be reduced, that is, the specified first gain is reduced, so as to reduce the volume of the noise in the output sound.

According to an embodiment of the present disclosure, the first electronic device comprises an echo canceller, wherein a reference signal of the echo canceller has a limit amplitude, and when a magnitude of the first input sound signal is greater than or equal to the limit amplitude, a performance of the echo canceller may deteriorate. The limit amplitude of the reference signal may be set to a third preset threshold, and the amplitude of the first input sound signal is compared with the third preset threshold, and when the amplitude of the first input sound signal is greater than the third preset threshold, it indicates that the amplitude of the first input sound signal exceeds the limit amplitude of the reference signal of the echo canceller, which may cause performance degradation of the echo canceller, and may reduce the first processing parameter, that is, reduce the specified first gain, so that the echo canceller may perform normal performance.

According to the embodiment of the present disclosure, when the second input sound signal is acquired while the first input sound signal is acquired, in order to enable the user to listen to the sound corresponding to each of the first input sound signal and the second input sound signal at the same time, the first processing parameter, that is, the specified first gain, may be reduced, so that the user can clearly hear the sound of the other party and the sound of the user when the two parties are in a conversation, and both the sounds can be clearly heard by the user when the first electronic device outputs both the sounds at the same time.

According to the embodiment of the present disclosure, the adjustment magnitude of the first processing parameter may be determined according to the acquired magnitude of the second input sound signal. For example, when the amplitude of the second input sound signal is large, the first processing parameter may be finely adjusted within a small range, i.e., the reduction value of the specified first gain is small. For another example, when the amplitude of the second input sound signal is small, the first processing parameter may be adjusted in a wide range, that is, the reduction value of the specified first gain is large. Thus, the user can clearly hear the voice of the other party and the voice of the user when the two parties are in a conversation, and both the voices can be clearly heard by the user when the first electronic device outputs the two voices simultaneously.

According to embodiments of the present disclosure, the first processing parameter may be adjusted while taking into account one or more of the above-mentioned influencing factors. When the first processing parameter is adjusted by considering a plurality of influencing factors, the first processing parameter may be adjusted one by one in the above manner, or an appropriate adjustment amount may be determined according to the above principle, and the first processing parameter is adjusted by using the adjustment amount.

According to an embodiment of the present disclosure, when the first processing parameter includes the specified sound signal amplitude, the determining a second processing parameter from at least the amplitude of the first input sound signal and the first processing parameter includes:

For example, the second gain may be determined by dividing the specified sound signal amplitude by the amplitude of the first input sound signal.

According to an embodiment of the present disclosure, when the first processing parameter includes the specified sound signal amplitude, the determining the second processing parameter is based on the amplitude of the first input sound signal, the first processing parameter, and at least one of the following influencing factors: the signal-to-noise ratio of the first input sound signal, the amplitude of an expected output sound signal, whether a second input sound signal is acquired while acquiring the first input sound signal, and the amplitude of the second input sound signal acquired while acquiring the first input sound signal include determining a second gain according to the specified sound signal amplitude and the amplitude of the first input sound signal, adjusting the second gain according to the following manner, and taking the adjusted second gain as the second processing parameter:

Determining an adjusted magnitude of the second gain according to a magnitude of the second input sound signal.

According to an embodiment of the present disclosure, when the first processing parameter comprises a specified sound signal amplitude, the determining a second processing parameter from the first processing parameter and one or more of: the amplitude of the first input sound signal, the signal-to-noise ratio of the first input sound signal, the amplitude of an expected output sound signal, whether a second input sound signal was acquired while the first input sound signal was acquired, the amplitude of the second input sound signal acquired while the first input sound signal was acquired, comprising:

determining a second gain according to the specified sound signal amplitude and the amplitude of the first input sound signal; or

Determining a second gain according to the specified sound signal amplitude and the amplitude of the first input sound signal and performing the following operations: when the signal-to-noise ratio of the first input sound signal is smaller than a second preset threshold value, reducing the second gain; and/or decreasing the second gain when the amplitude of the expected output sound signal is greater than a third preset threshold; and/or reducing the second gain when a second input sound signal is acquired simultaneously with acquiring the first input sound signal; and/or determining an adjusted magnitude of the second gain based on a magnitude of the second input sound signal.

According to the embodiment of the disclosure, since the signal-to-noise ratio of the first input sound signal may affect the expected output sound signal, the second preset threshold may be preset, and the signal-to-noise ratio of the first input sound signal is compared with the second preset threshold. When the signal-to-noise ratio of the first input sound signal is smaller than the second preset threshold, it indicates that the noise in the first input sound signal is larger, and the second gain can be reduced, thereby reducing the noise volume in the output sound.

According to an embodiment of the present disclosure, the first electronic device comprises an echo canceller, wherein a reference signal of the echo canceller has a limit amplitude, and when a magnitude of the first input sound signal is greater than or equal to the limit amplitude, a performance of the echo canceller may deteriorate. The limit amplitude of the reference signal may be set to a third preset threshold, and the amplitude of the first input sound signal is compared with the third preset threshold, and when the amplitude of the first input sound signal is greater than the third preset threshold, it indicates that the amplitude of the first input sound signal exceeds the limit amplitude of the reference signal of the echo canceller, which may cause performance degradation of the echo canceller, and may reduce the second gain, so that the echo canceller may perform normal performance.

According to the embodiment of the disclosure, when the first input sound signal is acquired and the second input sound signal is acquired simultaneously, in order to enable a user to listen to the sound corresponding to each of the first input sound signal and the second input sound signal simultaneously, the second gain may be reduced, so that the user can clearly hear the sound of the other party and the sound of the user when the two parties are in a conversation, and both the sounds can be clearly heard by the user when the first electronic device outputs both the sounds simultaneously.

According to the embodiment of the present disclosure, the adjustment magnitude of the first processing parameter may be determined according to the acquired magnitude of the second input sound signal. For example, when the amplitude of the second input sound signal is large, the reduction value of the second gain may be made small. For another example, when the amplitude of the second input sound signal is small, the reduction value of the second gain may be made large. Thus, the user can clearly hear the voice of the other party and the voice of the user when the two parties are in a conversation, and both the voices can be clearly heard by the user when the first electronic device outputs the two voices simultaneously.

According to an embodiment of the present disclosure, the second gain may be adjusted while taking into account one or more of the above-mentioned influencing factors. When the second gain is adjusted by considering a plurality of influence factors, the second gain may be adjusted one by one in the above manner, or an appropriate adjustment amount may be determined according to the above principle, and the second gain may be adjusted by using the adjustment amount.

According to an embodiment of the disclosure, the determining the second processing parameter is based on the amplitude of the first input sound signal, the first processing parameter and at least one influencing factor of: a signal-to-noise ratio of the first input sound signal, an amplitude of an expected output sound signal, whether a second input sound signal was acquired while the first input sound signal was acquired, an amplitude of the second input sound signal acquired while the first input sound signal was acquired, comprising: and determining the second processing parameter according to the amplitude of the first input sound signal, the first processing parameter and the preset corresponding relation between the at least one influencing factor and the second processing parameter.

According to an embodiment of the disclosure, the preset corresponding relationship between the amplitude of the first input sound signal, the first processing parameter, and the at least one influencing factor and the second processing parameter may be set, for example, one or more value ranges are set for each of the amplitude of the first input sound signal, the first processing parameter, and the at least one influencing factor, and a combination of different value ranges of the amplitude of the first input sound signal, the first processing parameter, and the different influencing factors corresponds to a corresponding adjustment value. In this way, when performing adjustment, which value ranges the amplitude of the first input sound signal, the first processing parameter, and each influence factor are in respectively can be determined according to actual conditions, and an adjustment value is determined according to a combination of the value ranges.

According to an embodiment of the present disclosure, a correspondence table of the amplitude of the first input sound signal, the first processing parameter, and the at least one influence factor and the second processing parameter may be established in advance. For example, when the amplitude of the first input signal is in a first value range, the first processing parameter is a first specific value, the signal-to-noise ratio is in a second value range, the amplitude of the output sound signal is in a third value range, the second input sound signal is acquired while the first input sound signal is acquired, and the amplitude of the second input sound signal is in a fourth value range, the value of the second processing parameter is a second specific value.

Table 1 illustrates the preset correspondence relationship by taking the first processing parameter as the specific value X1, the first input sound signal amplitudes as B1 and B2, and taking the influence factor "signal-to-noise ratio of the first input sound signal" as an example.

TABLE 1

	Signal to noise ratio range a1	Signal to noise ratio range a2
			First input sound signal amplitude B1	Second processing parameter C1	Second processing parameter C2
First input sound signal amplitude B2	Second processing parameter C3	Second processing parameter C4

As shown in table 1, when the signal-to-noise ratio of the first input signal is in the range a1 and the amplitude of the first input sound signal is in the range B1, the second processing parameter is C1; when the signal-to-noise ratio of the first input signal is in a range A2 and the amplitude of the first input sound signal is in a range B1, the second processing parameter is C2; when the signal-to-noise ratio of the first input signal is in a range A2 and the amplitude of the first input sound signal is in a range B1, the second processing parameter is C3; when the signal-to-noise ratio of the first input signal is in the range a2 and the amplitude of the first input sound signal is in the range B2, the second processing parameter is C4.

According to an embodiment of the disclosure, the determining the second processing parameter is based on the amplitude of the first input sound signal, the first processing parameter and at least one of the following influencing factors: a signal-to-noise ratio of the first input sound signal, an amplitude of an expected output sound signal, whether a second input sound signal was acquired while the first input sound signal was acquired, an amplitude of the second input sound signal acquired while the first input sound signal was acquired, comprising:

According to an embodiment of the present disclosure, sample data of an adjustment model may be acquired, where the sample data includes: sample data of the amplitude of the first input sound signal, sample data of the first processing parameter, and sample data of the influencing factor. The adjustment model can be trained based on sample data of the adjustment model, and parameters of the adjustment model are determined, so that the trained adjustment model is obtained. A second processing parameter may be determined using a pre-trained adjustment model based on the amplitude of the first input sound signal, the first processing parameter, and the at least one influencing factor.

Since the influencing factors include a plurality of influencing factors, the corresponding adjustment models may be trained based on different influencing factors, for example, the adjustment model applicable to the influencing factor being the amplitude of the second input sound may be trained based on sample data of the amplitude of the first input sound signal, sample data of the first processing parameter, and amplitude sample data of the second input sound signal.

The sample data of the multiple influencing factors may also be used to train the adjustment model, for example, sample data of the amplitude of the first input sound signal, sample data of the signal-to-noise ratio of the first input sound signal, sample data of an expected output sound signal, sample data representing whether the second input sound signal is acquired while the first input sound signal is acquired, and multiple sample data in the sample data of the amplitude of the second input sound signal may be used to train the adjustment model, so as to acquire the adjustment model.

Fig. 5 shows a schematic diagram of a sound signal processing method according to an embodiment of the present disclosure.

As shown in fig. 5, a user 501A communicates with a user 502A using a second electronic device 502B through a first electronic device 501B, it should be understood that this example is only used as an example and is not a limitation of the present disclosure, and the number and kinds of electronic devices in the present disclosure may be set according to actual needs, which is not specifically limited by the present disclosure.

When the user 502A inputs sound through the microphone of the second electronic device 502B, the second electronic device 502B may convert the received sound into a first input sound signal 501C to be transmitted to the first electronic device 501B, and the first electronic device 501B may acquire the first input sound signal 501C.

The first electronic device 501B may determine a first processing parameter from the acquired first input sound signal 501C and determine a second processing parameter based on the first input sound signal amplitude, the first processing parameter, and one or more of the plurality of influencing factors. Assuming that the first electronic device 501B detects that the snr of the first input audio signal 501C is smaller than the second preset threshold, and the first electronic device 501B detects that the communication state of the first electronic device 501B is currently in the "talk-through" state, for example, when the first electronic device 501A receives the first input audio signal 501C from the second electronic device 502B, the first electronic device 501A further obtains a second input audio signal 501D obtained by converting the sound received by the microphone of the first electronic device 501B, and at this time, the gain of the first input audio signal may be reduced to obtain the second processing parameter. The first input sound signal 501C may be processed according to the second processing parameter to obtain the target output sound signal, so that the noise in the target output sound is small and the user can clearly hear the sound of the user 502A and his own sound at the same time.

According to an embodiment of the present disclosure, the sound signal processing method further includes:

acquiring an initial input sound signal;

For example, when a server (e.g., a conference server of a network conference or an edge server of a network) receives a sound signal from the second electronic device, the sound signal may be used as an initial input sound signal, and the initial input sound signal may be processed according to a specified processing parameter to obtain a first input sound signal.

According to an embodiment of the present disclosure, the specified processing parameter is determined according to an amplitude of the initial input sound signal and/or a signal-to-noise ratio of the initial input sound signal.

For example, if the initial sound signal amplitude is small, the initial sound signal may be amplified according to a specified processing parameter (e.g., a specified gain) such that the sound signal arriving at the first electronic device has a suitable amplitude. Alternatively, if the signal-to-noise ratio of the initial sound signal is large, the initial sound signal may not be amplified or attenuated appropriately to avoid the sound signal reaching the first electronic device being too noisy. Alternatively, the amplitude and signal-to-noise ratio of the initial sound signal may be considered together to select the appropriate specified processing parameters.

According to embodiments of the present disclosure, the specified processing parameters may include gain and/or noise reduction filtering parameters.

According to an embodiment of the present disclosure, the obtaining an initial input sound signal and the processing the initial input sound signal are performed by a server.

According to an embodiment of the disclosure, the determining a second processing parameter at least from the amplitude of the first input sound signal and the first processing parameter comprises determining the second processing parameter at least from the amplitude and voiceprint characteristics of the first input sound signal and the first processing parameter.

For example, the source of the sound can be judged according to the voiceprint characteristics, so that the sound signals from different sources can be correspondingly processed in a targeted manner.

According to an embodiment of the present disclosure, the processing the first input sound signal according to the second processing parameter includes processing the denoised first input sound signal according to the second processing parameter. The first input sound signal is amplified after being denoised, so that the signal-to-noise ratio of the output sound signal can be improved, and the sound quality is improved.

According to the embodiment of the present disclosure, after determining the second processing parameter, a third processing parameter may be determined based on the second processing parameter in consideration of other factors, and the target output sound signal may be processed using the third processing parameter, so as to achieve more diversified sound processing requirements.

Fig. 6 illustrates a block diagram of a structure of a sound signal processing apparatus according to an embodiment of the present disclosure. The apparatus may be implemented as part or all of an electronic device through software, hardware, or a combination of both. As shown in fig. 6, the sound signal processing apparatus 600 includes a first obtaining module 610, a second obtaining module 620, a determining module 630 and a third obtaining module 640.

The first obtaining module 610 is configured to obtain a first input sound signal;

the second obtaining module 620 is configured to obtain a first processing parameter;

the determining module 630 is configured to determine a second processing parameter at least based on the amplitude of the first input sound signal and the first processing parameter;

the third obtaining module 640 is configured to process the first input sound signal according to the second processing parameter, resulting in a target output sound signal.

According to an embodiment of the disclosure, the determining of the second processing parameter at least from the amplitude of the first input sound signal and the first processing parameter is performed by the first electronic device.

According to an embodiment of the present disclosure, the determining of the second processing parameter at least from the amplitude of the first input sound signal and the first processing parameter is performed by a server.

According to an embodiment of the present disclosure, the first input sound signal includes: a sound signal received from a second electronic device in communication with the first electronic device; or a sound signal derived based on a first audio or video file;

According to an embodiment of the disclosure, the determining a second processing parameter at least from the amplitude of the first input sound signal and the first processing parameter comprises:

According to an embodiment of the present disclosure, the first input sound signal includes a sound signal received from a second electronic device communicating with a first electronic device, the target output sound signal includes a sound signal output from the first electronic device, and the second input sound signal includes:

A sound signal derived based on the second audio or video file.

According to an embodiment of the present disclosure, the first input sound signal includes a sound signal derived based on a first audio or video file, the target output sound signal includes a sound signal output from the first electronic device, and the second input sound signal includes:

A sound signal derived based on the second audio or video file.

a specified first gain; or

The sound signal amplitude is specified.

According to an embodiment of the present disclosure, when the first processing parameter includes the specified first gain, the determining a second processing parameter according to at least the amplitude of the first input sound signal and the first processing parameter includes adjusting the first gain according to at least the following manner, taking the adjusted first gain as the second processing parameter:

According to an embodiment of the present disclosure, when the first processing parameter includes the specified first gain, the determining the second processing parameter is based on the amplitude of the first input sound signal, the first processing parameter, and at least one of the following influencing factors: the signal-to-noise ratio of the first input sound signal, the amplitude of an expected output sound signal, whether a second input sound signal is acquired while acquiring the first input sound signal, and the amplitude of the second input sound signal acquired while acquiring the first input sound signal include adjusting the first gain according to the following manner, and taking the adjusted first gain as the second processing parameter:

Determining an adjusted magnitude of the first gain according to a magnitude of the second input sound signal.

According to an embodiment of the disclosure, the determining the second processing parameter is based on the amplitude of the first input sound signal, the first processing parameter and at least one influencing factor of: a signal-to-noise ratio of the first input sound signal, an amplitude of an expected output sound signal, whether a second input sound signal was acquired while the first input sound signal was acquired, an amplitude of the second input sound signal acquired while the first input sound signal was acquired, comprising:

According to an embodiment of the present disclosure, further comprising:

a fourth obtaining module 650 configured to obtain an initial input sound signal;

a fifth obtaining module 660 configured to process the initial input sound signal according to a specified processing parameter, resulting in the first input sound signal.

According to an embodiment of the present disclosure, the processing the first input sound signal according to the second processing parameter includes processing the denoised first input sound signal according to the second processing parameter.

The present disclosure also discloses an electronic device, and fig. 7 shows a block diagram of the electronic device according to an embodiment of the present disclosure.

As shown in fig. 7, the electronic device 700 includes a memory 701 and a processor 702; wherein the content of the first and second substances,

the memory 701 is used to store one or more computer instructions, which are executed by the processor 702 to implement a method according to an embodiment of the present disclosure.

The method according to the embodiment of the disclosure can be executed on an electronic device, and also can be executed on a server (such as a cloud server). Alternatively, the steps of the method according to the embodiments of the present disclosure may be performed on the electronic device and the server, respectively. For example, steps that consume less computing resources may be performed on the electronic device and steps that consume more computing resources may be performed on the server.

As shown in fig. 8, the computer system 800 includes a Central Processing Unit (CPU)801 which can execute various processes in the above-described embodiments in accordance with a program stored in a Read Only Memory (ROM)802 or a program loaded from a storage section 808 into a Random Access Memory (RAM) 803. In the RAM 803, various programs and data necessary for the operation of the system 800 are also stored. The CPU 801, ROM 802, and RAM 803 are connected to each other via a bus 804. An input/output (I/O) interface 805 is also connected to bus 804.

The following components are connected to the I/O interface 805: an input portion 806 including a keyboard, a mouse, and the like; an output section 807 including a signal such as a Cathode Ray Tube (CRT), a Liquid Crystal Display (LCD), and the like, and a speaker; a storage portion 808 including a hard disk and the like; and a communication section 809 including a network interface card such as a LAN card, a modem, or the like. The communication section 809 performs communication processing via a network such as the internet. A drive 810 is also connected to the I/O interface 805 as necessary. A removable medium 811 such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like is mounted on the drive 810 as necessary, so that a computer program read out therefrom is mounted on the storage section 808 as necessary.

In particular, the above described methods may be implemented as computer software programs according to embodiments of the present disclosure. For example, embodiments of the present disclosure include a computer program product comprising a computer program tangibly embodied on a medium readable thereby, the computer program comprising program code for performing the above-described object class determination method. In such an embodiment, the computer program can be downloaded and installed from a network through the communication section 809 and/or installed from the removable medium 811.

The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.

The units or modules described in the embodiments of the present disclosure may be implemented by software or by programmable hardware. The units or modules described may also be provided in a processor, and the names of the units or modules do not in some cases constitute a limitation of the units or modules themselves.

As another aspect, the present disclosure also provides a computer-readable storage medium, which may be a computer-readable storage medium included in the electronic device or the computer system in the above embodiments; or it may be a separate computer readable storage medium not incorporated into the device. The computer readable storage medium stores one or more programs for use by one or more processors in performing the methods described in the present disclosure.

The foregoing description is only exemplary of the preferred embodiments of the disclosure and is illustrative of the principles of the technology employed. It will be appreciated by those skilled in the art that the scope of the invention in the present disclosure is not limited to the specific combination of the above-mentioned features, but also encompasses other embodiments in which any combination of the above-mentioned features or their equivalents is possible without departing from the inventive concept. For example, the above features and (but not limited to) the features disclosed in this disclosure having similar functions are replaced with each other to form the technical solution.

Claims

1. A sound signal processing method, comprising:

acquiring a first input sound signal;

acquiring a first processing parameter;

processing the first input sound signal according to the second processing parameter to obtain a target output sound signal;

wherein the determining a second processing parameter based on at least the amplitude of the first input sound signal and the first processing parameter comprises: determining the second processing parameter based on the amplitude of the first input sound signal, the first processing parameter, and a first influencing factor, the first influencing factor comprising at least one of: whether a second input sound signal is acquired while the first input sound signal is acquired, an amplitude of the second input sound signal acquired while the first input sound signal is acquired;

when a second input sound signal is acquired simultaneously with the acquisition of the first input sound signal, adjusting the first processing parameter according to the following manner, and taking the adjusted first processing parameter as a second processing parameter:

reducing the first processing parameter; and/or

Determining an adjustment magnitude of the first processing parameter according to a magnitude of the second input sound signal.

2. The method of claim 1, wherein determining the second processing parameter based on at least the magnitude of the first input sound signal and the first processing parameter is performed by a first electronic device.

3. The method of claim 1, wherein determining a second processing parameter based on at least the amplitude of the first input sound signal and the first processing parameter is performed by a server.

4. The method of claim 1, wherein:

the first input sound signal includes: a sound signal received from a second electronic device in communication with the first electronic device; or a sound signal derived based on a first audio or video file;

5. The method of claim 1, wherein the first influencing factor further comprises at least one of: a signal-to-noise ratio of the first input sound signal, an amplitude of an expected output sound signal, wherein the expected output sound signal is obtained by processing the first input sound signal according to a current gain.

6. The method of claim 5, wherein the first input sound signal comprises a sound signal received from a second electronic device in communication with a first electronic device, wherein the target output sound signal comprises a sound signal output from the first electronic device, and wherein the second input sound signal comprises:

A sound signal derived based on the second audio or video file.

7. The method of claim 5, wherein the first input sound signal comprises a sound signal derived based on a first audio or video file, wherein the target output sound signal comprises a sound signal output from a first electronic device, and wherein the second input sound signal comprises:

A sound signal derived based on the second audio or video file.

8. The method of claim 1 or 5, wherein the first processing parameter comprises:

a specified first gain; or

The sound signal amplitude is specified.

9. The method of claim 8 when dependent on claim 1, wherein when the first processing parameter comprises the specified first gain, the determining the second processing parameter from the amplitude of the first input sound signal, the first processing parameter and a first influencing factor comprises adjusting the first gain as the second processing parameter at least in the following manner:

The following operations are performed: reducing the first gain when a second input sound signal is acquired simultaneously with acquiring the first input sound signal; and/or determining an adjusted magnitude of the first gain based on a magnitude of the second input sound signal.

10. The method according to claim 8 when dependent on claim 5, wherein when the first processing parameter comprises the specified first gain, the determining the second processing parameter based on the amplitude of the first input sound signal, the first processing parameter and the first influencing factor comprises adjusting the first gain as the second processing parameter by:

The following operations are performed: reducing the first gain when a second input sound signal is acquired simultaneously with acquiring the first input sound signal; and/or determining an adjusted magnitude of the first gain from a magnitude of the second input sound signal; and is

The following operations are performed: when the signal-to-noise ratio of the first input sound signal is smaller than a second preset threshold value, reducing the first gain; and/or decreasing the first gain when the amplitude of the desired output sound signal is greater than a third preset threshold.

11. The method of claim 8 when dependent on claim 1, wherein when the first processing parameter comprises the specified sound signal amplitude, the determining a second processing parameter based on the amplitude of the first input sound signal, the first processing parameter and a first influencing factor comprises:

determining a second gain according to the specified sound signal amplitude and the amplitude of the first input sound signal; and is

Reducing the second gain when a second input sound signal is acquired while the first input sound signal is acquired; and/or

12. The method according to claim 8 when dependent on claim 5, wherein when the first processing parameter comprises the specified sound signal amplitude, the determining the second processing parameter based on the amplitude of the first input sound signal, the first processing parameter and the first influencing factor comprises determining a second gain based on the specified sound signal amplitude and the amplitude of the first input sound signal, adjusting the second gain according to the following manner, and using the adjusted second gain as the second processing parameter:

reducing the second gain when a second input sound signal is acquired simultaneously with acquiring the first input sound signal; and/or determining an adjusted magnitude of the second gain from a magnitude of the second input sound signal; and is

When the signal-to-noise ratio of the first input sound signal is smaller than a second preset threshold value, reducing the second gain; and/or decreasing the second gain when the amplitude of the desired output sound signal is greater than a third preset threshold.

13. The method of claim 5, wherein determining the second processing parameter based on the amplitude of the first input sound signal, the first processing parameter, and the first influencing factor comprises:

and determining the second processing parameter according to the preset corresponding relation between the amplitude of the first input sound signal, at least one influence factor of the first processing parameter and the first influence factor and the second processing parameter.

14. The method of claim 5, wherein determining the second processing parameter based on the amplitude of the first input sound signal, the first processing parameter, and the first influencing factor comprises:

determining the second processing parameter by using a pre-trained adjustment model based on at least one influencing factor of the amplitude of the first input sound signal, the first processing parameter and the first influencing factor, wherein the pre-trained adjustment model is obtained by training sample data of the amplitude of the first input sound signal, the sample data of the first processing parameter and the sample data of the at least one influencing factor.

15. The method of claim 1, further comprising:

acquiring an initial input sound signal;

16. The method of claim 15, wherein the specified processing parameter is determined based on an amplitude of the initial input sound signal and/or a signal-to-noise ratio of the initial input sound signal.

17. The method of claim 15, wherein said obtaining an initial input sound signal and said processing the initial input sound signal are performed by a server.

18. The method of claim 1, wherein determining a second processing parameter based on at least the magnitude of the first input sound signal and the first processing parameter comprises determining the second processing parameter based on at least the magnitude and voiceprint characteristics of the first input sound signal and the first processing parameter.

19. The method of claim 1, wherein the processing the first input sound signal according to the second processing parameters comprises processing the denoised first input sound signal according to the second processing parameters.

20. An acoustic signal processing apparatus, comprising:

a first acquisition module configured to acquire a first input sound signal;

a second obtaining module configured to obtain the first processing parameter;

a third obtaining module configured to process the first input sound signal according to the second processing parameter to obtain a target output sound signal;

reducing the first processing parameter; and/or

21. An electronic device comprising a memory and a processor; wherein the memory is configured to store one or more computer instructions, wherein the one or more computer instructions are executed by the processor to implement the method steps of any of claims 1-19.

22. A readable storage medium having stored thereon computer instructions, characterized in that the computer instructions, when executed by a processor, carry out the method steps of any of claims 1-19.