CN111787458A

CN111787458A - Audio signal processing method and electronic equipment

Info

Publication number: CN111787458A
Application number: CN202010686560.2A
Authority: CN
Inventors: 半场道男; 邢文峰
Original assignee: Hisense Visual Technology Co Ltd
Current assignee: Hisense Visual Technology Co Ltd
Priority date: 2020-07-16
Filing date: 2020-07-16
Publication date: 2020-10-16
Anticipated expiration: 2040-07-16
Also published as: CN111787458B

Abstract

The embodiment of the application provides an audio signal processing method and electronic equipment, wherein the method comprises the following steps: if at least two users are detected, acquiring a first position of the right ear of the leftmost user and a second position of the left ear of the rightmost user; determining a first input signal of a left positive speaker and a second input signal of a left negative speaker according to an original left channel signal and a first position, so that a NULL area of an output sound field of the left speaker points to the first position; determining a third input signal of the right positive speaker and a fourth input signal of the right negative speaker according to the original right channel signal and the second position, so that a NULL area of an output sound field of the right speaker points to the second position; according to the first input signal, the second input signal, the third input signal and the fourth input signal, the left positive speaker, the left negative speaker, the right positive speaker and the right negative speaker are respectively driven, control over the NULL direction of a speaker sound field is achieved, and the listening effect of a user is effectively improved.

Description

Audio signal processing method and electronic equipment

Technical Field

The present application relates to the field of multimedia technologies, and in particular, to a method for processing an audio signal and an electronic device.

Background

In the audio field, the practical use of directional speaker systems is one of the methods of bass reproduction. Currently, two directional speakers, which may be called a left speaker and a right speaker, are disposed on the left and right sides of a television device, respectively, and are used for playing a left channel signal and a right channel signal of the television, so that a user can hear the sound of the television.

However, in the prior art, since the direction of the directional speaker is forward, for the left user, the sound of the left speaker is mainly heard, and the sound heard by the right speaker is very little. This results in the user hearing a sound field that is to the left, and the user hearing a sound field that is to the right. The sound field of the speaker cannot be effectively controlled, which makes the sound heard by the users on the left and right sides less effective.

Therefore, how to effectively control the sound field of the speaker and improve the listening effect of the user becomes a technical problem which needs to be solved urgently.

Disclosure of Invention

The embodiment of the application provides an audio signal processing method and electronic equipment, and aims to overcome the defects that in the prior art, the sound field direction of a loudspeaker cannot be controlled, the listening effect of a user is poor, and the like.

In a first aspect, an embodiment of the present application provides a method for processing an audio signal, including:

if at least two users are detected, acquiring a first position of the right ear of the leftmost user and a second position of the left ear of the rightmost user;

determining a first input signal of a left positive speaker and a second input signal of a left negative speaker according to an original left channel signal and the first position, so that a NULL area of output sound fields of the left positive speaker and the left negative speaker points to the first position; determining a third input signal of a right positive speaker and a fourth input signal of a right negative speaker according to an original right channel signal and the second position, so that a NULL area of output sound fields of the right positive speaker and the right negative speaker points to the second position; the NULL region is a zero sound pressure region;

driving the left positive speaker, the left negative speaker, the right positive speaker, and the right negative speaker according to the first input signal, the second input signal, the third input signal, and the fourth input signal, respectively.

In a second aspect, an embodiment of the present application provides an electronic device, including:

the acquisition module is used for acquiring a first position of the right ear of the leftmost user and a second position of the left ear of the rightmost user if at least two users are detected currently;

a processing module, configured to determine, according to an original left channel signal and the first position, a first input signal of a left positive speaker and a second input signal of a left negative speaker, so that a NULL region of output sound fields of the left positive speaker and the left negative speaker points to the first position; determining a third input signal of a right positive speaker and a fourth input signal of a right negative speaker according to an original right channel signal and the second position, so that a NULL area of output sound fields of the right positive speaker and the right negative speaker points to the second position; the NULL region is a zero sound pressure region;

and the output module is used for respectively driving the left positive loudspeaker, the left negative loudspeaker, the right positive loudspeaker and the right negative loudspeaker according to the first input signal, the second input signal, the third input signal and the fourth input signal.

In a third aspect, an embodiment of the present application provides an electronic device, including: at least one processor and memory;

the memory stores computer-executable instructions;

the at least one processor executes computer-executable instructions stored by the memory to cause the at least one processor to perform the method as set forth in the first aspect above and in various possible designs of the first aspect.

A fourth aspect of the present application provides a computer-readable storage medium having stored thereon computer-executable instructions that, when executed by a processor, implement a method as set forth in the first aspect and various possible designs of the first aspect.

The audio signal processing method and the electronic device provided by the embodiment of the application perform corresponding processing on the original left channel signal and the original right channel signal based on the first position of the right ear of the leftmost user and the second position of the left ear of the rightmost user, and determine the corresponding input signals of the left positive speaker, the left negative speaker, the right positive speaker and the right negative speaker, so that a NULL region of a sound field of the left speaker points to the position of the right ear of the leftmost user, a NULL region of the sound field of the right speaker points to the position of the left ear of the rightmost user, the sound of the left speaker cannot be heard by the right ear of the leftmost user, the sound of the right speaker cannot be heard by the left ear of the rightmost user, and the effect of listening to the sound by the user is improved by controlling the direction of the NULL region of the directional speaker.

Drawings

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly introduced below, and it is obvious that the drawings in the following description are some embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to these drawings without inventive exercise.

FIG. 1 is a schematic diagram of an architecture of a processing system according to an embodiment of the present application;

fig. 2 is a flowchart illustrating a method for processing an audio signal according to an embodiment of the present application;

FIG. 3 is a schematic diagram of a NULL region of a speaker according to an embodiment of the present application;

fig. 4 is a schematic block diagram of a flow of a method for processing an audio signal according to an embodiment of the present application;

fig. 5 is a flowchart illustrating a method for processing an audio signal according to another embodiment of the present application;

fig. 6 is a schematic diagram illustrating a principle of directional control of a NULL region of a speaker according to an embodiment of the present application;

fig. 7 is a schematic flow chart of signal processing according to an embodiment of the present application;

FIG. 8 is a schematic view of a single-user viewing scenario provided by an embodiment of the present application;

fig. 9 is a schematic structural diagram of an electronic device according to an embodiment of the present application;

fig. 10 is a schematic structural diagram of an electronic device according to another embodiment of the present application.

With the above figures, there are shown specific embodiments of the present application, which will be described in more detail below. These drawings and written description are not intended to limit the scope of the disclosed concepts in any way, but rather to illustrate the concepts of the disclosure to those skilled in the art by reference to specific embodiments.

Detailed Description

In order to make the objects, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some embodiments of the present application, but not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

The terms referred to in this application are explained first:

a NULL region: refers to a zero sound pressure region in a sound field formed by a directional speaker. The directional loudspeaker may be implemented by two loudspeakers close together, for example, the simplest directional loudspeaker may be implemented by a dipole type loudspeaker. Obtain left channel signal and right channel signal from the TV in this application, each way signal corresponds two speakers to the left channel signal is the example, and corresponding left speaker, including two speakers, two speakers play left channel signal and left channel antiphase signal respectively, can be called left positive loudspeaker and left negative speaker respectively, and the same reason, right speaker that right channel signal corresponds, including two speakers of right positive loudspeaker and right negative speaker. In the sound field formed by the positive and negative loudspeakers, a zero sound pressure region, called a NULL region, is generated due to the positive and negative cancellation.

In the audio field, the practical use of directional speaker systems is one of the methods of bass reproduction. Currently, two directional speakers, which may be called a left speaker and a right speaker, are disposed on the left and right sides of a television device, respectively, and are used for playing a left channel signal and a right channel signal of the television, so that a user can hear the sound of the television. However, in the prior art, since the direction of the directional speaker is forward, for the left user, the sound of the left speaker is mainly heard, and the sound heard by the right speaker is very little. This results in the user hearing a sound field that is to the left, and the user hearing a sound field that is to the right. The sound field of the speaker cannot be effectively controlled, which makes the sound heard by the users on the left and right sides less effective.

In order to solve the above problems, the present invention inventively finds that a directional speaker is formed by two speakers close together, and the sound field formed by the directional speaker has a zero sound pressure region, so that a user does not hear the sound of the directional speaker in the zero sound pressure region, and the direction of the zero sound pressure region in the sound field can be controlled by performing corresponding digital signal processing on a television original channel signal.

The audio signal processing method provided by the embodiment of the application is suitable for application scenes of users watching television. Fig. 1 is a schematic diagram of an architecture of a processing system according to an embodiment of the present application. The processing system may include a television apparatus, a camera apparatus, and a user. The image pickup device may be provided on the television device, or may be an independent device connected to the television device for communication. The television equipment is provided with a left loudspeaker and a right loudspeaker, or the left loudspeaker and the right loudspeaker are independently arranged outside the television equipment to be connected with the television equipment for communication. The left loudspeaker and the right loudspeaker are directional loudspeakers, the left loudspeaker comprises a left positive loudspeaker and a left negative loudspeaker, and the right loudspeaker comprises a right positive loudspeaker and a right negative loudspeaker. The camera equipment is used for detecting users, and combine AI (Artificial Intelligence) technology location user's left and right ear position, television equipment is after obtaining user's quantity and left and right ear position, based on user's left and right ear position, carry out digital signal processing to former left channel signal of TV and former right channel signal, and obtain the input signal of each speaker after the power amplifier, be used for driving each speaker, make the NULL region of the sound field of left speaker point to the user's on the left side right ear position, the NULL region of the sound field of right speaker points to the user's on the right side left ear position, user's effect of listening has effectively been improved.

It should be noted that the audio signal processing method provided by the embodiment of the present application is not only applicable to an application scenario in which a user watches a television, but also applicable to any similar scenario, such as a notebook computer, a desktop computer, a tablet computer, and the like, and the listening effect of the user can be improved by the method of the embodiment of the present application.

Furthermore, the terms "first", "second", etc. are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. In the description of the following examples, "plurality" means two or more unless specifically limited otherwise.

The following several specific embodiments may be combined with each other, and details of the same or similar concepts or processes may not be repeated in some embodiments. Embodiments of the present application will be described below with reference to the accompanying drawings.

An embodiment of the present application provides a method for processing an audio signal, which is used to perform corresponding processing on an original channel signal of a television to drive a speaker, so as to improve a listening effect of a user. The execution subject of this embodiment is an electronic device, and the electronic device may be a television device or an electronic device provided in a television device.

As shown in fig. 2, a schematic flow chart of a processing method of an audio signal provided in this embodiment is shown, where the method includes:

step 101, if at least two users are detected, a first position of a right ear of a leftmost user and a second position of a left ear of the rightmost user are obtained.

The camera device may be provided on the television device, for example, a camera may be embedded in the television device to detect the number of users currently watching, and to locate the ear positions of the users based on AI locating technology. Specifically, an AI positioning analysis module may be provided in the image pickup apparatus, or an AI positioning analysis module may be provided in the television apparatus, so as to position the ear position of the user. The specific positioning method is the prior art and is not described herein again.

When at least two users are detected, a first position of the right ear of the leftmost user and a second position of the left ear of the rightmost user can be obtained, and NULL region pointing of sound fields of the left loudspeaker and the right loudspeaker is controlled based on the first position and the second position, so that the right ear of the left user can not hear the sound emitted by the left loudspeaker, the left ear of the right user can not hear the sound emitted by the right loudspeaker, and the listening effect of the users is improved.

And 102, determining a first input signal of the left positive speaker and a second input signal of the left negative speaker according to the original left channel signal and the first position, so that a NULL area of output sound fields of the left positive speaker and the left negative speaker points to the first position.

And 103, determining a third input signal of the right positive speaker and a fourth input signal of the right negative speaker according to the original right channel signal and the second position, so that a NULL area of output sound fields of the right positive speaker and the right negative speaker points to the second position.

Wherein, the NULL region is a zero sound pressure region.

After determining that the number of users is at least two, and acquiring the right ear position (i.e., the first position) of the leftmost user and the left ear position (i.e., the second position) of the rightmost user, based on the first position and the second position, corresponding signal processing may be performed on the original channel signal to determine the input signal of the left speaker and the input signal of the right speaker, and specifically, for the original left channel signal and the first position, the first input signal of the left positive speaker and the second input signal of the left negative speaker are determined, so that a NULL region of output sound fields of the left positive speaker and the left negative speaker is directed to the first position, that is, to the right ear position of the leftmost user, and the right ear of the leftmost user does not hear the sound of the left speaker.

Similarly, according to the original right channel signal and the second position, the third input signal of the right positive speaker and the fourth input signal of the right negative speaker are determined, so that the NULL region of the output sound fields of the right positive speaker and the right negative speaker points to the second position, namely to the left ear position of the rightmost user, and the left ear of the rightmost user cannot hear the sound of the right speaker. When the number of users is more than two, the sound transitions naturally.

Illustratively, as shown in fig. 3, the NULL region of the speaker provided for this embodiment is directed schematically. Wherein, A is a positive speaker, B is a negative speaker, namely A plays the positive phase signal of the original signal, B plays the inverse signal of the original signal. Any point S on the line L1 is equidistant from the two speakers, so that the signal reaches any point on the line L1, and the positive and negative signals are exactly cancelled out to become a zero sound pressure region, namely a NULL region.

For example, the signal processing of the original left channel signal and the original right channel signal may be implemented by a gain module, a digital delay module, a digital filtering module, and a power amplifier module. Through the direction in gain module and digital delay module control NULL region, can optimize the spectral response through digital filter module, carry out power amplification to the signal through power amplifier module, the input signal of the speaker that obtains after the power amplification just can drive the speaker, the sound field of playing through the speaker has realized that left speaker NULL region points to the user's on the leftmost right ear position promptly, and right speaker NULL region points to the user's on the rightmost right left ear position.

It should be noted that step 102 and step 103 are not in sequence.

And 104, respectively driving the left positive speaker, the left negative speaker, the right positive speaker and the right negative speaker according to the first input signal, the second input signal, the third input signal and the fourth input signal.

After the first input signal, the second input signal, the third input signal and the fourth input signal are determined, the first input signal, the second input signal, the third input signal and the fourth input signal respectively drive corresponding speakers, specifically, the first input signal is input to the left positive speaker to drive the left positive speaker, the second input signal is input to the left negative speaker to drive the left negative speaker, the third input signal is input to the right positive speaker to drive the right positive speaker, and the fourth input signal is input to the right negative speaker to drive the right negative speaker. Exemplarily, as shown in fig. 4, a schematic block diagram of a flow of a processing method of an audio signal provided for the present embodiment is provided. The method comprises the steps of obtaining two paths of signals of an original left sound channel signal and an original right sound channel signal from a television, wherein each path of signal corresponds to two loudspeakers, namely, the original left sound channel signal needs to be processed in two paths to obtain a first input signal for driving a left positive loudspeaker and a second input signal for driving a left negative loudspeaker, and similarly, the original right sound channel signal is processed in two paths to obtain a third input signal for driving a right positive loudspeaker and a fourth input signal for driving a right negative loudspeaker.

The audio signal processing method provided in this embodiment performs corresponding processing on an original left channel signal and an original right channel signal based on a first position of a right ear of a leftmost user and a second position of a left ear of the rightmost user, and determines input signals corresponding to a left positive speaker, a left negative speaker, a right positive speaker and a right negative speaker, so that a NULL region of a sound field of the left speaker points to the position of the right ear of the leftmost user, a NULL region of the sound field of the right speaker points to the position of the left ear of the rightmost user, so that the right ear of the leftmost user cannot hear the sound of the left speaker, and the left ear of the rightmost user cannot hear the sound of the right speaker, thereby achieving the effect of improving the effect of the user in listening to the sound by controlling the direction of the NULL region of the directional speaker.

The method provided by the above embodiment is further described in an additional embodiment of the present application.

As shown in fig. 5, a flow chart of the audio signal processing method provided in this embodiment is schematically shown.

As an implementable manner, on the basis of the above-mentioned embodiment, optionally, determining the first input signal of the left positive speaker and the second input signal of the left negative speaker according to the original left channel signal and the first position, so that a NULL region of an output sound field of the left positive speaker and the left negative speaker points to the first position, includes:

step 2011, determining a first delay time of the left positive speaker and a second delay time of the left negative speaker according to the first position and the positions of the left positive speaker and the left negative speaker.

Step 2012, determining a first gain corresponding to the left positive loudspeaker and a second gain corresponding to the left negative loudspeaker according to the position of the left zero sound pressure line and the positions of the left positive loudspeaker and the left negative loudspeaker.

Step 2013, determining a first input signal according to the original left channel signal, the first delay time and the first gain.

Step 2014, determining a second input signal according to the original left channel signal, the second delay time and the second gain.

Wherein, the step 2011 and the step 2012 are not in sequence, and the step 2013 and the step 2014 are not in sequence.

Illustratively, as shown in fig. 6, a schematic diagram of a direction control principle of a NULL region of a speaker is provided for the present embodiment. Wherein, a represents a left positive speaker, B represents a left negative speaker, C represents a first position of a right ear of a leftmost user, a delay of a is required in order to make a sound field NULL region of a and B point to C, which is actually equivalent to moving a to a position of D, so that a distance from C to D is equal to a distance from C to B, a central line L is determined as a zero sound pressure line, it is seen that the zero sound pressure line is shifted to the left, and a region where the zero sound pressure line is located is the NULL region. That is, according to the positions of B and C, the distance from C to B can be determined, the distance from C to D needs to be equal to the distance from C to B, and D is equivalent to A moving backwards along the dashed line L2, therefore, the position of D can be determined according to the distance from C to D, so that it can be determined that L1 is directed to C, the time (namely, the first delay time) that A needs to delay can be determined according to the positions of D and A, in this case, B does not need to delay, and the second delay time is 0.

In order to ensure that the sound pressure in the NULL region is zero, it is also necessary to ensure that the energy of a and B at any point on L1 is equal, as shown in fig. 6, C is a short distance from a, and B is a long distance from B, so that a needs to be decreased in volume, and the original channel signal can be processed by the gain module to control the volume. Specifically, the first gain corresponding to a and the second gain corresponding to B may be determined according to the fact that the energy of a and B at any point on L1 is equal, and the ratio of the signal amplitude of a to the signal amplitude of B may be determined according to the fact that the sound energy and the square of the distance are inversely proportional, so that the first gain corresponding to a may be determined. It can be understood that if only a needs to reduce the volume, the second gain corresponding to B may be 0, or the second gain corresponding to B may also be set according to actual requirements, and the first gain corresponding to a is set according to a corresponding proportion, for example, the second gain corresponding to B is 2, the first gain corresponding to a is 50% of the second gain, and the first gain corresponding to a is 1; or for example, B corresponds to a second gain of 1 and a corresponds to a first gain of 0.5. The setting is specifically set according to actual requirements, and the embodiment is not limited.

After the first delay time and the first gain of the left positive speaker and the second delay time and the second gain of the left negative speaker are determined, the first input signal may be determined according to the original left channel signal, the first delay time and the first gain, and similarly, the second input signal may be determined according to the left negative speaker, the second delay time and the second gain.

Optionally, taking the left front speaker as an example, after performing gain and digital delay on the original left channel signal, digital filtering and power amplification may be performed, and the signal is converted into an analog signal to drive the left front speaker. The other speakers are similar and are not described in detail herein.

Similarly, determining a third input signal of the right positive speaker and a fourth input signal of the right negative speaker according to the original right channel signal and the second position, so that a NULL region of an output sound field of the right positive speaker and the right negative speaker points to the second position, comprises:

step 2021, determining a third delay time of the right positive speaker and a fourth delay time of the right negative speaker according to the second position and the positions of the right positive speaker and the right negative speaker.

Step 2022, determining a third gain corresponding to the right positive speaker and a fourth gain corresponding to the right negative speaker according to the position of the right zero sound pressure line and the positions of the right positive speaker and the right negative speaker.

Step 2023, determining a third input signal according to the original right channel signal, the third delay time and the third gain.

Step 2024, determining a fourth input signal according to the original right channel signal, the fourth delay time and the fourth gain.

Wherein, the step 2021 and the step 2022 are not in sequence, and the step 2023 and the step 2024 are not in sequence.

It should be noted that, for the right speaker, the principle of signal processing is the same as or similar to that of the left speaker, and is not described in detail here.

Optionally, determining the first input signal according to the original left channel signal, the first delay time, and the first gain specifically includes:

the original left channel signal is processed through the first gain module, and is output to the first digital delay module to delay a first delay time, and is output to the first power amplifier module after passing through the first digital filter module, so that a first input signal is obtained.

Similarly, optionally, determining the second input signal according to the original left channel signal, the second delay time, and the second gain specifically includes:

and the original left channel signal is processed by the second gain module, is output to the second digital delay module to delay a second delay time, and is output to the second power amplifier module after passing through the second digital filtering module to obtain a second input signal.

Similarly, optionally, determining the third input signal according to the original right channel signal, the third delay time, and the third gain specifically includes:

the original right sound channel signal is processed through a third gain module, is output to a third digital delay module to delay a third delay time, and is output to a third power amplifier module after passing through a third digital filtering module to obtain a third input signal;

similarly, optionally, determining the fourth input signal according to the original right channel signal, the fourth delay time, and the fourth gain specifically includes:

and the original right sound channel signal is processed by the fourth gain module, is output to the fourth digital delay module to delay a fourth delay time, and is output to the fourth power amplifier module after passing through the fourth digital filtering module to obtain a fourth input signal.

Exemplarily, as shown in fig. 7, a schematic flow chart of signal processing provided for the present embodiment is shown. The method comprises the steps of obtaining two paths of signals of an original left sound channel signal and an original right sound channel signal from a television, wherein each path of signal corresponds to two loudspeakers, so that each path of signal needs to be processed by two paths of signals, and an input signal of a left positive loudspeaker, an input signal of a left negative loudspeaker, an input signal of a right positive loudspeaker and an input signal of a right negative loudspeaker are obtained respectively to drive each loudspeaker.

Optionally, determining a first gain corresponding to the left positive speaker and a second gain corresponding to the left negative speaker according to the position of the left zero sound pressure line and the positions of the left positive speaker and the left negative speaker, including:

step 2031, determining a first distance between any position on the left zero sound pressure line and the left positive loudspeaker and a second distance between any position on the left zero sound pressure line and the left negative loudspeaker according to the position of the left zero sound pressure line and the positions of the left positive loudspeaker and the left negative loudspeaker;

step 2032, determining the sound energy of the left acoustic speaker at any position according to the first distance and the signal amplitude of the left acoustic speaker at any position; determining the sound energy of the left negative loudspeaker at any position according to the second distance and the signal amplitude of the left negative loudspeaker at any position;

step 2033, determining a first gain and a second gain according to the fact that the sound energy of the left positive speaker and the sound energy of the left negative speaker at any position are equal.

Specifically, as shown in fig. 6, taking C as an example of any position, the sound energy of points a and B at C is as follows:

wherein E is_ARepresenting the sound energy of A loudspeaker, E_BRepresenting the sound energy of the B loudspeaker, A_ARepresenting the signal amplitude of the A loudspeaker, A_BRepresenting the signal amplitude, L, of the B loudspeaker_CADenotes the distance of C to A, L_CBRepresents the distance of C to B.

According to E_A＝E_BA can be determined_AAnd A_BThe percentage of the first gain to the second gain can be determined, the second gain can be set according to actual requirements, and the first gain is determined according to the percentage of the first gain to the second gain.

Optionally, determining a third gain corresponding to the right positive speaker and a fourth gain corresponding to the right negative speaker according to the position of the right zero sound pressure line and the positions of the right positive speaker and the right negative speaker, specifically including:

step 2041, determining a third distance between any position on the right zero sound pressure line and the right positive loudspeaker and a fourth distance between any position on the right zero sound pressure line and the left negative loudspeaker according to the position of the right zero sound pressure line and the positions of the right positive loudspeaker and the right negative loudspeaker;

step 2042, determining the sound energy of the right positive speaker at any position according to the third distance and the signal amplitude of the right positive speaker at any position; determining the sound energy of the right negative loudspeaker at any position according to the fourth distance and the signal amplitude of the right negative loudspeaker at any position;

step 2043, according to the fact that the sound energy of the right positive speaker and the sound energy of the right negative speaker at any position are equal, determining a third gain and a fourth gain.

It should be noted that the determination principle of the third gain and the fourth gain is the same as or similar to that of the first gain and the second gain, and is not repeated here.

As a practical way, on the basis of the above embodiment, optionally, the method further includes: the number of users is detected by the image pickup apparatus.

Specifically, the image capturing device may be disposed on the television device, or may be an independent device that is connected to the television device for communication, and the image capturing device may capture an image of a user, and determine the number of current users according to the image of the user.

As a practical way, on the basis of the above embodiment, optionally, the method further includes:

according to a first correction rule, correcting the original left channel signal to obtain a corrected left channel signal;

and according to a second correction rule, correcting the original right channel signal to obtain a corrected right channel signal.

Specifically, in practical application, the left ear of the left user can be influenced by the right speaker while listening to the sound of the left speaker, and the right ear of the right user can also be influenced by the left speaker, so as to further optimize the listening effect of the user, the influence degree of the right speaker on the left ear of the left user can be controlled by correcting the original channel signal of the left speaker, and the influence degree of the left speaker on the right ear of the right user can be controlled by correcting the original channel signal of the right speaker. Modification rules may be set for the left channel signal and the right channel signal, respectively, for modification.

Specifically, according to a first modification rule, modifying an original left channel signal to obtain a modified left channel signal, specifically including:

according to the following formula, the original left channel signal S_LCorrecting to obtain a corrected left channel signal S_LX：

S_LX＝S_L-aL*S_ULR☉H_NLL

S_ULR＝S_R☉H_LR

According to a second modification rule, modifying the original right channel signal to obtain a modified right channel signal, specifically comprising:

for the original right channel signal S according to the following formula_RCorrecting to obtain a corrected right channel signal S_RX：

S_RX＝S_R-aR*S_URL☉H_NRR

S_URL＝S_L☉H_RL

Wherein ☉ denotes a convolution operation, aL and aR denote adjustment coefficients, which range from [0,1 ]]，S_ULRRepresenting the left ear of the left user hearing the original signal part of the right loudspeaker comprising a right positive loudspeaker and a right negative loudspeaker, H_NLL＝1/H_LL，H_LLRepresenting a pre-obtained transfer function, H, from the left loudspeaker to the left ear of the left user_LRRepresenting a pre-obtained transfer function, S, from the right loudspeaker to the right ear of the left user_URLIndicating that the right ear of the right user hears the original signal portion of the left speaker, H_NRR＝1/H_RR，H_RRRepresenting a pre-obtained transfer function from the right loudspeaker to the right ear of the right user, H_RLRepresenting a pre-obtained transfer function from the left speaker to the left ear of the right user.

Wherein H_LLAnd H_RLThe method is related to the watching environment of the user at home, and comprises the position of the user relative to a television, the length, the width and the height of a living room, the reflection effect of a wall surface and the like, and the method can be obtained through actual measurement, can also confirm a default value according to statistical values, and can be finely adjusted according to a plurality of parameters. aL is used to control the degree of influence of the right speaker on the left ear of the left user, and aR is used to control the degree of influence of the left speaker on the right ear of the right user. Since aL has a recursive relationship with the effect of the left speaker on the right ear of the right user, the value may be 0.5. Similarly, aR can also take the value 0.5.

Specifically, the correction process may be implemented by a digital filtering module.

step 2051, if only one user is detected currently, a third position of the left ear of the user and a fourth position of the right ear of the user are obtained.

Step 2052, determining a fifth input signal of the left positive speaker and a sixth input signal of the left negative speaker according to the original left channel signal and the fourth position, so that a NULL area of output sound fields of the left positive speaker and the left negative speaker points to the fourth position; and determining a seventh input signal of the right positive speaker and an eighth input signal of the right negative speaker according to the original right channel signal and the third position, so that a NULL area of output sound fields of the right positive speaker and the right negative speaker points to the third position.

And step 2053, driving the left positive speaker, the left negative speaker, the right positive speaker and the right negative speaker respectively according to the fifth input signal, the sixth input signal, the seventh input signal and the eighth input signal.

Specifically, for a single user, the positions of both ears of the user can be located through the AI technology, and for a speaker (left speaker) on the left side of the television, since only the left ear of the user is expected to hear the sound of the left speaker, and the right ear cannot hear the sound of the left speaker, the sound field NULL direction of the left speaker is directed to the right ear of the user, so that the right ear cannot hear the sound of the left speaker, and the amplitude of the signal of the left ear can be controlled through signal processing. Similarly, for the right loudspeaker, the NULL direction of the right loudspeaker is controlled to point to the left ear of the user, so that the right ear of the user only hears the sound of the right loudspeaker, and the left ear only hears the sound of the left loudspeaker, thereby effectively improving the listening effect of the user.

Illustratively, as shown in fig. 8, a schematic view of a single-user viewing scene is provided for the present embodiment. The NULL direction of the left speaker is directed to the right ear of the user and the NULL direction of the right speaker is directed to the left ear of the user

It should be noted that, for how to control the NULL direction of the left speaker to point to the right ear of the user, and control the NULL direction of the right speaker to point to the left ear of the user, the principle is the same as or similar to the above process, and the details are not repeated here.

It should be noted that the respective implementable modes in the present embodiment may be implemented individually, or may be implemented in combination in any combination without conflict, and the present application is not limited thereto.

The audio signal processing method provided in this embodiment performs corresponding processing on an original left channel signal and an original right channel signal based on a first position of a right ear of a leftmost user and a second position of a left ear of the rightmost user, and determines input signals corresponding to a left positive speaker, a left negative speaker, a right positive speaker and a right negative speaker, so that a NULL region of a sound field of the left speaker points to the position of the right ear of the leftmost user, a NULL region of the sound field of the right speaker points to the position of the left ear of the rightmost user, so that the right ear of the leftmost user cannot hear the sound of the left speaker, and the left ear of the rightmost user cannot hear the sound of the right speaker, thereby achieving the effect of improving the effect of the user in listening to the sound by controlling the direction of the NULL region of the directional speaker. The influence degree of the right loudspeaker on the left ear of the left user can be controlled by correcting the original sound channel signal of the left loudspeaker, the influence degree of the left loudspeaker on the right ear of the right user is controlled by correcting the original sound channel signal of the right loudspeaker, and the listening effect of the user is further improved. And for a single user, the right ear of the user can be controlled to only hear the sound of the right loudspeaker, and the left ear of the user can only hear the sound of the left loudspeaker, so that the listening effect of the user is effectively improved.

Yet another embodiment of the present application provides an electronic device for performing the method of the above embodiment.

As shown in fig. 9, is a schematic structural diagram of the electronic device provided in this embodiment. The electronic device 30 comprises an acquisition module 31, a processing module 32 and an output module 33.

The device comprises an acquisition module, a processing module and a control module, wherein the acquisition module is used for acquiring a first position of the right ear of a leftmost user and a second position of the left ear of a rightmost user if at least two users are detected currently; the processing module is used for determining a first input signal of the left positive speaker and a second input signal of the left negative speaker according to the original left channel signal and the first position, so that a NULL area of an output sound field of the left positive speaker and the output sound field of the left negative speaker point to the first position; determining a third input signal of the right positive speaker and a fourth input signal of the right negative speaker according to the original right channel signal and the second position, so that a NULL area of output sound fields of the right positive speaker and the right negative speaker points to the second position; the NULL area is a zero sound pressure area; and the output module is used for respectively driving the left positive loudspeaker, the left negative loudspeaker, the right positive loudspeaker and the right negative loudspeaker according to the first input signal, the second input signal, the third input signal and the fourth input signal.

With regard to the electronic device in the present embodiment, the specific manner in which each module performs operations has been described in detail in the embodiment related to the method, and will not be elaborated here.

According to the electronic equipment provided by the embodiment, based on the first position of the right ear of the leftmost user and the second position of the left ear of the rightmost user, the original left channel signal and the original right channel signal are correspondingly processed, and the input signals corresponding to the left positive loudspeaker, the left negative loudspeaker, the right positive loudspeaker and the right negative loudspeaker are determined, so that the NULL region of the sound field of the left loudspeaker points to the position of the right ear of the leftmost user, the NULL region of the sound field of the right loudspeaker points to the position of the left ear of the rightmost user, the sound of the left loudspeaker cannot be heard by the right ear of the leftmost user, the sound of the right loudspeaker cannot be heard by the left ear of the rightmost user, and the effect of controlling the direction of the NULL region of the directional loudspeaker and improving the sound listening effect of the user is realized.

The electronic device provided by the above embodiment is further described in an additional embodiment of the present application.

As a practical manner, on the basis of the foregoing embodiments, optionally, the processing module is specifically configured to:

determining a first delay time of the left positive loudspeaker and a second delay time of the left negative loudspeaker according to the first position and the positions of the left positive loudspeaker and the left negative loudspeaker;

determining a first gain corresponding to the left positive loudspeaker and a second gain corresponding to the left negative loudspeaker according to the position of the left zero sound pressure line and the positions of the left positive loudspeaker and the left negative loudspeaker;

determining a first input signal according to the original left channel signal, the first delay time and the first gain; determining a second input signal according to the original left channel signal, the second delay time and the second gain;

determining a third delay time of the right positive speaker and a fourth delay time of the right negative speaker according to the second position and the positions of the right positive speaker and the right negative speaker;

determining a third gain corresponding to the right positive loudspeaker and a fourth gain corresponding to the right negative loudspeaker according to the position of the right zero sound pressure line and the positions of the right positive loudspeaker and the right negative loudspeaker;

determining a third input signal according to the original right channel signal, the third delay time and the third gain; and determining a fourth input signal according to the original right channel signal, the fourth delay time and the fourth gain.

Optionally, the processing module is specifically configured to:

the original left sound channel signal is processed through a first gain module, and is output to a first digital delay module to delay a first delay time, and is output to a first power amplifier module after passing through a first digital filtering module to obtain a first input signal;

the original left sound channel signal is processed through a second gain module, is output to a second digital delay module to delay a second delay time, and is output to a second power amplifier module after passing through a second digital filtering module to obtain a second input signal;

Optionally, the processing module is specifically configured to:

determining a first distance between any position on the left zero sound pressure line and the left positive loudspeaker and a second distance between any position on the left zero sound pressure line and the left negative loudspeaker according to the position of the left zero sound pressure line and the positions of the left positive loudspeaker and the left negative loudspeaker;

determining the sound energy of the left front speaker at any position according to the first distance and the signal amplitude of the left front speaker at any position; determining the sound energy of the left negative loudspeaker at any position according to the second distance and the signal amplitude of the left negative loudspeaker at any position;

and determining a first gain and a second gain according to the fact that the sound energy of the left positive loudspeaker and the sound energy of the left negative loudspeaker at any position are equal.

As another practicable manner, on the basis of the foregoing embodiment, optionally, the obtaining module is further configured to obtain a user image from the image capturing apparatus, and determine the number of users according to the user image.

As another implementable manner, on the basis of the foregoing embodiment, optionally, the processing module is further configured to:

Optionally, the processing module is specifically configured to:

S_LX＝S_L-aL*S_ULR☉H_NLL

S_ULR＝S_R☉H_LR

According to a second modification rule, modifying the original right channel signal to obtain a modified right channel signal, including:

S_RX＝S_R-aR*S_URL☉H_NRR

S_URL＝S_L☉H_RL

Wherein aL and aR represent adjustment coefficients in the range of [0, 1%]，S_ULRRepresenting the left ear of the left user hearing the original signal part of the right loudspeaker comprising a right positive loudspeaker and a right negative loudspeaker, H_NLL＝1/H_LL，H_LLRepresenting a pre-obtained transfer function, H, from the left loudspeaker to the left ear of the left user_LRRepresenting a pre-obtained transfer function, S, from the right loudspeaker to the right ear of the left user_URLIndicating that the right ear of the right user hears the original signal portion of the left speaker, H_NRR＝1/H_RR，H_RRRepresenting a pre-obtained transfer function from the right loudspeaker to the right ear of the right user, H_RLRepresenting a pre-obtained transfer function from the left speaker to the left ear of the right user.

The specific manner in which each module performs operations has been described in detail in the embodiment of the method with respect to the server in the present embodiment, and will not be elaborated here.

According to the electronic equipment of the embodiment, based on the first position of the right ear of the leftmost user and the second position of the left ear of the rightmost user, the original left channel signal and the original right channel signal are correspondingly processed, and the input signals corresponding to the left positive loudspeaker, the left negative loudspeaker, the right positive loudspeaker and the right negative loudspeaker are determined, so that a NULL region of a sound field of the left loudspeaker points to the position of the right ear of the leftmost user, a NULL region of the sound field of the right loudspeaker points to the position of the left ear of the rightmost user, the sound of the left loudspeaker cannot be heard by the right ear of the leftmost user, the sound of the right loudspeaker cannot be heard by the left ear of the rightmost user, and the effect of controlling the direction of the NULL region of the directional loudspeaker and improving the sound listening effect of the user is achieved. The influence degree of the right loudspeaker on the left ear of the left user can be controlled by correcting the original sound channel signal of the left loudspeaker, the influence degree of the left loudspeaker on the right ear of the right user is controlled by correcting the original sound channel signal of the right loudspeaker, and the listening effect of the user is further improved. And for a single user, the right ear of the user can be controlled to only hear the sound of the right loudspeaker, and the left ear of the user can only hear the sound of the left loudspeaker, so that the listening effect of the user is effectively improved.

Yet another embodiment of the present application provides an electronic device for performing the method provided by the foregoing embodiment. The electronic device may be a television device, or may be an electronic device independent of a television device.

As shown in fig. 10, a schematic structural diagram of the electronic device provided in this embodiment is shown. The electronic device 50 includes: at least one processor 51 and memory 52;

the memory stores computer-executable instructions; the at least one processor executes computer-executable instructions stored by the memory to cause the at least one processor to perform a method as provided by any of the embodiments above.

Yet another embodiment of the present application provides a computer-readable storage medium, in which computer-executable instructions are stored, and when the processor executes the computer-executable instructions, the method provided in any one of the above embodiments is implemented.

According to the computer-readable storage medium of the embodiment, based on the first position of the right ear of the leftmost user and the second position of the left ear of the rightmost user, the original left channel signal and the original right channel signal are correspondingly processed, and the input signals corresponding to the left positive speaker, the left negative speaker, the right positive speaker and the right negative speaker are determined, so that the NULL region of the sound field of the left speaker points to the position of the right ear of the leftmost user, the NULL region of the sound field of the right speaker points to the position of the left ear of the rightmost user, the sound of the left speaker is not heard by the right ear of the leftmost user, the sound of the right speaker is not heard by the left ear of the rightmost user, and the effect of improving the sound listening effect of the user by controlling the direction of the NULL region of the directional speaker is realized. The influence degree of the right loudspeaker on the left ear of the left user can be controlled by correcting the original sound channel signal of the left loudspeaker, the influence degree of the left loudspeaker on the right ear of the right user is controlled by correcting the original sound channel signal of the right loudspeaker, and the listening effect of the user is further improved. And for a single user, the right ear of the user can be controlled to only hear the sound of the right loudspeaker, and the left ear of the user can only hear the sound of the left loudspeaker, so that the listening effect of the user is effectively improved.

In the several embodiments provided in the present application, it should be understood that the disclosed apparatus and method may be implemented in other ways. For example, the above-described apparatus embodiments are merely illustrative, and for example, the division of the units is only one logical division, and other divisions may be realized in practice, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.

The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, or in a form of hardware plus a software functional unit.

The integrated unit implemented in the form of a software functional unit may be stored in a computer readable storage medium. The software functional unit is stored in a storage medium and includes several instructions to enable a computer device (which may be a personal computer, a server, or a network device) or a processor (processor) to execute some steps of the methods according to the embodiments of the present application. And the aforementioned storage medium includes: various media capable of storing program codes, such as a usb disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk.

It is obvious to those skilled in the art that, for convenience and simplicity of description, the foregoing division of the functional modules is merely used as an example, and in practical applications, the above function distribution may be performed by different functional modules according to needs, that is, the internal structure of the device is divided into different functional modules to perform all or part of the above described functions. For the specific working process of the device described above, reference may be made to the corresponding process in the foregoing method embodiment, which is not described herein again.

Finally, it should be noted that: the above embodiments are only used for illustrating the technical solutions of the present application, and not for limiting the same; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features may be equivalently replaced; and the modifications or the substitutions do not make the essence of the corresponding technical solutions depart from the scope of the technical solutions of the embodiments of the present application.

Claims

1. A method of processing an audio signal, comprising:

2. The method of claim 1, wherein determining a first input signal of a left positive speaker and a second input signal of a left negative speaker from an original left channel signal and the first location such that a NULL region of an output sound field of the left positive speaker and the left negative speaker is directed to the first location comprises:

determining a first delay time of the left positive speaker and a second delay time of the left negative speaker according to the first position and the positions of the left positive speaker and the left negative speaker;

determining the first input signal according to the original left channel signal, the first delay time and the first gain; determining the second input signal according to the original left channel signal, the second delay time and the second gain;

determining a third input signal of a right positive speaker and a fourth input signal of a right negative speaker according to an original right channel signal and the second position so that a NULL region of an output sound field of the right positive speaker and the right negative speaker is directed to the second position, comprising:

determining the third input signal according to the original right channel signal, the third delay time and the third gain; and determining the fourth input signal according to the original right channel signal, the fourth delay time and the fourth gain.

3. The method of claim 2, wherein the determining the first input signal is based on the original left channel signal, the first delay time, and the first gain; and determining the second input signal according to the original left channel signal, the second delay time and the second gain, including:

processing the original left channel signal through a first gain module, outputting the processed original left channel signal to a first digital delay module to delay a first delay time, and outputting the delayed original left channel signal to a first power amplifier module after passing through a first digital filtering module to obtain a first input signal;

processing the original left channel signal through a second gain module, outputting the processed original left channel signal to a second digital delay module to delay a second delay time, and outputting the delayed original left channel signal to a second power amplifier module after passing through a second digital filtering module to obtain a second input signal;

determining the third input signal according to the original right channel signal, the third delay time and the third gain; and determining the fourth input signal according to the original right channel signal, the fourth delay time and the fourth gain, including:

processing the original right sound channel signal through a third gain module, outputting the processed original right sound channel signal to a third digital delay module to delay a third delay time, and outputting the delayed original right sound channel signal to a third power amplifier module after passing through a third digital filtering module to obtain a third input signal;

and processing the original right sound channel signal through a fourth gain module, outputting the processed original right sound channel signal to a fourth digital delay module to delay a fourth delay time, and outputting the delayed original right sound channel signal to a fourth power amplifier module after passing through a fourth digital filtering module to obtain a fourth input signal.

4. The method of claim 2, wherein determining the first gain corresponding to the left positive loudspeaker and the second gain corresponding to the left negative loudspeaker according to the position of the left zero sound pressure line and the positions of the left positive loudspeaker and the left negative loudspeaker comprises:

and determining the first gain and the second gain according to the fact that the sound energy of the left positive loudspeaker and the sound energy of the left negative loudspeaker at any position are equal.

5. The method of claim 1, further comprising:

the number of users is detected by the image pickup apparatus.

6. The method of claim 1, further comprising:

7. The method of claim 6, wherein the modifying the original left channel signal according to the first modification rule to obtain a modified left channel signal comprises:

for the original left channel signal S according to the following formula_LCorrecting to obtain a corrected left channel signal S_LX：

S_LX＝S_L-aL*S_ULR☉H_NLL

S_ULR＝S_R☉H_LR

The modifying the original right channel signal according to the second modification rule to obtain a modified right channel signal includes:

S_RX＝S_R-aR*S_URL☉H_NRR

S_URL＝S_L☉H_RL

Wherein aL and aR represent adjustment coefficients in the range of [0, 1%]，S_ULRRepresenting the left ear of the left user hearing the original signal part of the right loudspeaker comprising said right positive loudspeaker and said right negative loudspeaker, H_NLL＝1/H_LL，H_LLRepresenting a pre-obtained transfer function, H, from the left loudspeaker to the left ear of the left user_LRRepresenting a pre-obtained transfer function, S, from the right loudspeaker to the right ear of the left user_URLIndicating that the right ear of the right user hears the original signal portion of the left speaker, H_NRR＝1/H_RR，H_RRIndicating pre-acquired right-to-right from the right speakerTransfer function of the user's right ear, H_RLRepresenting a pre-obtained transfer function from the left speaker to the left ear of the right user.

8. The method according to any one of claims 1-7, further comprising:

if only one user is detected currently, acquiring a third position of the left ear of the user and a fourth position of the right ear of the user;

determining a fifth input signal of the left positive speaker and a sixth input signal of the left negative speaker according to the original left channel signal and the fourth position, so that a NULL region of output sound fields of the left positive speaker and the left negative speaker points to the fourth position; determining a seventh input signal of the right positive speaker and an eighth input signal of the right negative speaker according to the original right channel signal and the third position, so that a NULL area of output sound fields of the right positive speaker and the right negative speaker points to the third position;

driving the left positive speaker, the left negative speaker, the right positive speaker, and the right negative speaker according to the fifth input signal, the sixth input signal, the seventh input signal, and the eighth input signal, respectively.

9. An electronic device, comprising:

10. The electronic device of claim 9, wherein the obtaining module is further configured to obtain a third position of the left ear of the user and a fourth position of the right ear of the user if only one user is detected currently;

the processing module is further configured to determine a fifth input signal of the left positive speaker and a sixth input signal of the left negative speaker according to the original left channel signal and the fourth position, so that a NULL region of output sound fields of the left positive speaker and the left negative speaker points to the fourth position; determining a seventh input signal of the right positive speaker and an eighth input signal of the right negative speaker according to the original right channel signal and the third position, so that a NULL area of output sound fields of the right positive speaker and the right negative speaker points to the third position;

the output module is further configured to drive the left positive speaker, the left negative speaker, the right positive speaker, and the right negative speaker according to the fifth input signal, the sixth input signal, the seventh input signal, and the eighth input signal, respectively.