CN109587619B

CN109587619B - Method, equipment, storage medium and device for reconstructing non-center point sound field of three channels

Info

Publication number: CN109587619B
Application number: CN201811653726.XA
Authority: CN
Inventors: 王松
Original assignee: Wuhan Polytechnic University
Current assignee: Wuhan Zhuoyue Audio Visual Technology Co ltd
Priority date: 2018-12-29
Filing date: 2018-12-29
Publication date: 2021-01-22
Anticipated expiration: 2038-12-29
Also published as: CN109587619A

Abstract

The invention discloses a method, equipment, a storage medium and a device for reconstructing a non-central point sound field of three channels. The method comprises the steps of calculating the distance between a non-central point and an original position point, constructing a virtual spherical surface which takes the non-central point as a spherical center and the distance as a radius, mapping a position point of a preset reconstruction loudspeaker to a point on the virtual spherical surface as a virtual point, determining a virtual sound signal at the virtual point, and determining a reconstruction sound signal to be output according to the virtual sound signal so as to reconstruct a sound field. The method maps the preset reconstruction loudspeaker to the virtual spherical surface, and determines the virtual loudspeaker corresponding to the preset reconstruction loudspeaker, so that the virtual sound signal to be output at the virtual loudspeaker can be determined by applying a VBAP technology, the reconstruction sound signal to be output can be further determined, the sound field is constructed aiming at the non-central point, the sound field quality of the reconstructed sound field is ensured, and the technical problem that the sound field quality of the reconstructed sound field at the non-central listening point is poor is solved.

Description

Method, equipment, storage medium and device for reconstructing non-center point sound field of three channels

Technical Field

The invention relates to the technical field of three-dimensional audio, in particular to a method, equipment, a storage medium and a device for reconstructing a non-central point sound field of three channels.

Background

When hearing the sound output based on the three-dimensional audio technology, people can perceive the obvious directional characteristic in the sound, thereby bringing more stereo auditory perception to people.

In order to restore the directivity of sound as much as possible, a sound field reconstruction technique is often used to reconstruct a sound field space that meets the requirements. For example, a sound field can be reconstructed Based on a Vector Based Amplitude Panning (VBAP) technique, and specifically, the sound field reconstruction method determines a center of sphere position first, and then sets physical positions of a plurality of speakers on the same spherical surface of the center of sphere, so that sounds output by the plurality of speakers are synthesized into a virtual sound source, thereby achieving the purpose of sound localization; the sound field can also be reconstructed based on the derivative technology of VBAP, specifically, the sound output by the three speakers can also be synthesized into a virtual sound source, and the sound pressure and particle velocity generated by the virtual sound source at the center of the sphere, i.e. the center listening point, are ensured to be equal to the sound pressure and particle velocity generated by the three speakers at the center listening point, so that the reconstruction of the sound field is completed, and the purpose of sound positioning is achieved.

However, obviously, when the sound field is reconstructed according to the VBAP technology and the VBAP-based derivative technology, limited by the technical limitations of the VBAP technology itself, it is limited to reconstruct the sound field with a spherical center, i.e., a center listening point. If the VBAP technology intends to reconstruct the sound field for the non-center listening point, the quality of the finally reconstructed sound field is poor.

Therefore, it is considered that there is a technical problem that the sound field quality of the sound field reconstructed at the non-center listening point is poor.

The above is only for the purpose of assisting understanding of the technical aspects of the present invention, and does not represent an admission that the above is prior art.

Disclosure of Invention

The invention mainly aims to provide a method, equipment, a storage medium and a device for reconstructing a non-central point sound field of three sound channels, and aims to solve the technical problem that the sound field quality of a sound field reconstructed at a non-central listening point is poor.

In order to achieve the above object, the present invention provides a method for reconstructing a non-center point sound field of three channels, which includes the following steps:

when a sound field reconstruction instruction is received, determining position information of a non-central point and an original position point of a preset original loudspeaker for constructing a preset original sound field according to the sound field reconstruction instruction, wherein the position information of the non-central point is different from the position information of a central listening point in the preset original sound field;

calculating the distance between the non-central point and the original position point, and constructing a virtual spherical surface which takes the non-central point as a spherical center and the distance as a radius;

mapping the position points of the preset reconstruction loudspeaker to spherical points on the virtual spherical surface as virtual points;

determining a virtual sound signal corresponding to the virtual loudspeaker at the virtual point based on a preset vector basis amplitude phase shift model;

and determining a reconstructed sound signal to be output by the preset reconstruction loudspeaker according to the virtual sound signal, so as to reconstruct a sound field taking the non-central point as a center by outputting the reconstructed sound signal.

Preferably, the number of speakers of the preset original speaker is 1.

Preferably, the position point of the preset original speaker and the position point of the preset reconstruction speaker are on a preset deployment sphere.

Preferably, the mapping the position points of the preset reconstruction speakers to spherical points on the virtual spherical surface as virtual points includes:

and establishing a ray from the non-central point to the position point of the preset reconstruction loudspeaker, and taking the intersection point between the ray and the virtual spherical surface as a virtual point.

Preferably, the determining, according to the virtual sound signal, a reconstructed sound signal to be output by the preset reconstruction speaker, so as to reconstruct a sound field centered on the non-central point by outputting the reconstructed sound signal, includes:

determining the virtual particle velocity generated by the virtual sound signal at the non-central point through a preset virtual particle velocity calculation formula;

and determining the reconstructed particle velocity of the preset reconstructed loudspeaker at the non-central point through a preset particle velocity reconstruction model according to the virtual particle velocity, and determining a reconstructed acoustic signal to be output by the preset reconstructed loudspeaker according to the reconstructed particle velocity so as to reconstruct a sound field taking the non-central point as a center by outputting the reconstructed acoustic signal.

Preferably, the preset particle velocity reconstruction model comprises a preset reconstruction particle velocity calculation formula and a preset particle velocity maintenance formula;

the determining, according to the virtual particle velocity, a reconstructed particle velocity of the preset reconstructed speaker at the non-central point through a preset particle velocity reconstruction model, and determining a reconstructed acoustic signal to be output by the preset reconstructed speaker according to the reconstructed particle velocity, so as to reconstruct a sound field centered at the non-central point by outputting the reconstructed acoustic signal, includes:

determining the speed of the reconstruction particles to be selected, which are generated by the preset reconstruction loudspeaker at the non-central point, through the preset reconstruction particle speed calculation formula;

selecting a target reconstruction particle speed corresponding to the virtual particle speed from the to-be-selected reconstruction particle speeds through the preset particle speed holding formula, and determining a reconstruction distribution coefficient corresponding to the preset reconstruction loudspeaker according to the target reconstruction particle speed;

and determining a reconstructed sound signal to be output by the preset reconstructed loudspeaker according to the reconstructed distribution coefficient and the original sound signal output by the preset original loudspeaker, so as to reconstruct a sound field taking the non-central point as a center by outputting the reconstructed sound signal.

Preferably, the determining a virtual sound signal corresponding to a virtual speaker at the virtual point based on a preset vector basis amplitude phase shift model includes:

when the virtual point of the virtual loudspeaker and the original position point of the preset original loudspeaker are positioned on the virtual spherical surface, determining a virtual distribution coefficient corresponding to the virtual loudspeaker through a preset vector basis amplitude phase shift model according to the virtual point where the virtual loudspeaker is positioned and the original position point where the preset original loudspeaker is positioned;

and determining the virtual sound signal output by the virtual loudspeaker according to the virtual distribution coefficient and the original sound signal output by the preset original loudspeaker.

Furthermore, to achieve the above object, the present invention also proposes an audio apparatus comprising a memory, a processor and a three-channel non-center point sound field reconstruction program stored on the memory and executable on the processor, the three-channel non-center point sound field reconstruction program being configured to implement the steps of the three-channel non-center point sound field reconstruction method as described above.

Further, to achieve the above object, the present invention also proposes a storage medium having stored thereon a three-channel non-center point sound field reconstruction program, which when executed by a processor, implements the steps of the three-channel non-center point sound field reconstruction method as described above.

In addition, to achieve the above object, the present invention further provides a three-channel non-center point sound field reconstruction apparatus, including:

the non-central point determining module is used for determining the position information of a non-central point and an original position point of a preset original loudspeaker for constructing a preset original sound field according to a sound field reconstruction instruction when the sound field reconstruction instruction is received, wherein the position information of the non-central point is different from the position information of a central listening point in the preset original sound field;

the virtual spherical surface determining module is used for calculating the distance between the non-central point and the original position point and constructing a virtual spherical surface which takes the non-central point as a spherical center and the distance as a radius;

the virtual loudspeaker determining module is used for mapping the position points of the preset reconstruction loudspeaker to spherical points on the virtual spherical surface as virtual points;

the virtual sound signal determining module is used for determining a virtual sound signal corresponding to a virtual loudspeaker at the virtual point based on a preset vector base amplitude phase shift model;

and the sound field reconstruction module is used for determining a reconstructed sound signal to be output by the preset reconstruction loudspeaker according to the virtual sound signal so as to reconstruct a sound field taking the non-central point as a center by outputting the reconstructed sound signal.

The method comprises the steps of firstly calculating the distance between a non-central point and an original position point, then constructing a virtual spherical surface by taking the non-central point as a spherical center and the distance as a radius, mapping a position point of a preset reconstruction loudspeaker to a spherical point on the virtual spherical surface as a virtual point, then determining a virtual sound signal corresponding to the virtual loudspeaker at the virtual point based on a preset vector base amplitude phase shift model, and determining a reconstruction sound signal to be output according to the virtual sound signal so as to reconstruct a sound field. The method is characterized in that the preset reconstruction loudspeaker is mapped to a virtual spherical surface where the preset original loudspeaker is located, the virtual loudspeaker corresponding to the preset reconstruction loudspeaker is determined, so that a virtual sound signal to be output at the virtual loudspeaker can be determined by applying a VBAP technology, the reconstructed sound signal to be output is further determined, the sound field is constructed by the spherical center of the virtual spherical surface instead of the central listening point originally adopted by the preset original loudspeaker, the sound field is constructed aiming at the non-central point, the sound field quality of the reconstructed sound field is ensured, and the technical problem that the sound field quality of the reconstructed sound field at the non-central listening point is poor is solved.

Drawings

FIG. 1 is a schematic diagram of an audio device in a hardware operating environment according to an embodiment of the present invention;

FIG. 2 is a schematic flow chart of a first embodiment of a method for reconstructing a non-center point sound field of three channels according to the present invention;

FIG. 3 is a schematic view of the position of the speaker of the present invention;

FIG. 4 is a flowchart illustrating a method for reconstructing a non-center point sound field of three channels according to a second embodiment of the present invention;

FIG. 5 is a flowchart illustrating a method for reconstructing a non-center point sound field of three channels according to a third embodiment of the present invention;

FIG. 6 is a block diagram of a first embodiment of a three-channel non-center point sound field reconstruction apparatus according to the present invention.

The objects, features and advantages of the present invention will be further explained with reference to the accompanying drawings.

Detailed Description

It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.

Referring to fig. 1, fig. 1 is a schematic structural diagram of an audio device in a hardware operating environment according to an embodiment of the present invention.

As shown in fig. 1, the audio device may include: a processor 1001, such as a CPU, a communication bus 1002, a user interface 1003, a network interface 1004, and a memory 1005. Wherein a communication bus 1002 is used to enable connective communication between these components. The user interface 1003 may include a Display screen (Display), and the optional user interface 1003 may further include a standard wired interface and a wireless interface, and the wired interface for the user interface 1003 may be a USB interface in the present invention. The network interface 1004 may optionally include a standard wired interface, a wireless interface (e.g., WI-FI interface). The memory 1005 may be a high-speed RAM memory or a non-volatile memory (e.g., a magnetic disk memory). The memory 1005 may alternatively be a storage device separate from the processor 1001.

Those skilled in the art will appreciate that the configuration shown in fig. 1 does not constitute a limitation of the audio device and may include more or fewer components than those shown, or some components may be combined, or a different arrangement of components.

As shown in fig. 1, a memory 1005, which is a kind of computer storage medium, may include therein an operating system, a network communication module, a user interface module, and a three-channel non-center point sound field reconstruction program.

In the audio device shown in fig. 1, the network interface 1004 is mainly used for connecting to a backend server and performing data communication with the backend server; the user interface 1003 is mainly used for connecting peripheral equipment; the audio apparatus calls, through the processor 1001, a three-channel non-center point sound field reconstruction program stored in the memory 1005, and performs the following operations:

Further, the processor 1001 may call the non-center point sound field reconstruction program for three channels stored in the memory 1005, and further perform the following operations:

In this embodiment, a distance between a non-center point and an original position point is calculated, a virtual sphere is constructed by using the non-center point as a sphere center and the distance as a radius, a position point of a preset reconstruction speaker is mapped to a spherical point on the virtual sphere as a virtual point, a virtual sound signal corresponding to the virtual speaker at the virtual point is determined based on a preset vector basis amplitude phase shift model, and a reconstruction sound signal to be output is determined according to the virtual sound signal to reconstruct a sound field. Different from a sound field reconstruction method for reconstructing a sound field by using a central point of a preset original sound field, in the embodiment, a preset reconstruction speaker is mapped onto a virtual spherical surface where the preset original speaker is located, and a virtual speaker corresponding to the preset reconstruction speaker is determined, so that a virtual sound signal to be output at the virtual speaker can be determined by applying a VBAP technology, and then a reconstructed sound signal to be output is determined, and thus, a sound field is constructed by using the spherical center of the virtual spherical surface instead of necessarily using a central listening point originally adopted by the preset original speaker, the sound field is constructed by aiming at a non-central point, the sound field quality of the reconstructed sound field is ensured, and the technical problem that the sound field quality of the reconstructed sound field at the non-central listening point is poor is solved.

Based on the hardware structure, the embodiment of the non-center point sound field reconstruction method of the three channels is provided.

Referring to fig. 2, fig. 2 is a flowchart illustrating a first embodiment of a method for reconstructing a non-center point sound field of three channels according to the present invention.

In a first embodiment, the method for reconstructing the non-center point sound field of the three channels comprises the following steps:

step S10: when a sound field reconstruction instruction is received, determining position information of a non-central point and an original position point of a preset original loudspeaker for constructing a preset original sound field according to the sound field reconstruction instruction, wherein the position information of the non-central point is different from the position information of a central listening point in the preset original sound field.

It can be understood that, considering that the VBAP technology reconstructs a sound field by taking a central listening point as a center, the central listening point, i.e. a spherical center, may be denoted as O, and is simply referred to as a center point. In order to reconstruct the sound field for the non-central point and ensure the quality of the sound field reconstructed for the non-central point, the sound field reconstruction operation may be performed based on the technical solution described in this embodiment.

It should be understood that the execution subject of the present embodiment is an audio device, and the audio device may include a plurality of preset reconstruction speakers, or may not include the preset reconstruction speakers and be connected with the preset reconstruction speakers by wire or wirelessly. Wherein, the number of the speakers of the preset reconstruction speaker can be 3, and three-channel surround is formed.

In a specific implementation, when the sound field reconstruction instruction is received, a reconstruction operation for reconstructing the sound field at the non-central listening point may be performed, for example, position information of the non-central listening point may be determined and an original position point of an original speaker may be preset. The central point O is a central position targeted by the preset original speaker when the preset original sound field is constructed, and the non-central point is a central position targeted by the current sound field reconstruction operation to restore the sound field quality of the preset original sound field as much as possible. The non-center point is a position different from the center point O, and may be denoted as n (n) if expressed by a rectangular coordinate system_x,n_y,n_z) (ii) a Expressed in a polar coordinate system, it is expressed as n ═ ρ (ρ)_n,θ_n,ψ_n). Where ρ is_nIs the distance between the point n and the origin O, θ_nIs the angle, psi, between the X-axis projection and the X-axis of the line connecting the pointing n and the origin O_nIs the angle between the line connecting the point n and the origin O and the XOY plane.

Note that, referring to fig. 3, the center point O may be set as the origin (0, 0, 0) of the coordinate system for easy observation. A speaker for constructing a preset original sound field by using an original sound signal is referred to as a preset original speaker, the number of speakers of the preset original speaker is 1, an original position point which is position information of the preset original speaker may be recorded as lpo, and if the original position point is expressed by an orthogonal coordinate system, it is recorded as lpo ═ ξ (ξ)_0x,ξ_0y,ξ_0z) (ii) a Expressed in a polar coordinate system, it is represented by lpo ═ ρ (ρ ═ ρ₀,θ₀,ψ₀). Where ρ is₀Is the distance between the pointing point lpo and the origin O, θ₀Is the angle, ψ, between the X-axis projection and the X-axis of the line connecting the pointing point lpo and the origin O₀Is the angle between the line connecting the pointing point lpo and the origin O and the XOY plane.

Step S20: and calculating the distance between the non-central point and the original position point, and constructing a virtual spherical surface by taking the non-central point as a spherical center and the distance as a radius.

In a specific implementation, referring to fig. 3, a length of a distance between a non-center point n and a point lpo where an original speaker is located is determined, and the length can be denoted as Len. Then, a sphere is built by taking the non-central point n as the sphere center and the distance Len as the sphere radius, and the sphere of the sphere can be used as a virtual sphere to be used. Obviously, the preset original speaker lpo falls on the virtual sphere.

Step S30: and mapping the position points of the preset reconstruction loudspeaker to spherical points on the virtual spherical surface to be used as virtual points.

Note that, the speaker that performs the sound field reconstruction operation this time to obtain the reconstructed sound field is referred to as a preset reconstructed speaker ξ_jJ is 1, 2, 3. The 3 preset reconstructed loudspeakers are respectively marked as xi₁、ξ₂And xi₃Expressed in a rectangular coordinate system, is expressed as ξ₁＝(ξ_1x,ξ_1y,ξ_1z)、ξ₂＝(ξ_2x,ξ_2y,ξ_2z) And xi₃＝(ξ_3x,ξ_3y,ξ_3z) (ii) a Expressed in polar coordinate system, is marked as xi₁＝(ρ₁,θ₁,ψ₁)、ξ₂＝(ρ₂,θ₂,ψ₂) And xi₃＝(ρ₃,θ₃,ψ₃). Where ρ is_jIs pointing xi_jDistance from origin O, theta_jIs pointing xi_jAngle, ψ, between X-axis projection and X-axis of line connecting with origin O_jIs pointing xi_jAnd the angle between the line connecting the origin O and the XOY plane.

It should be understood that, in order to finally determine the reconstructed acoustic signal to be output by the preset reconstructed speaker, a virtual point on the virtual sphere is determined, and the sound field quality constructed by the reconstructed acoustic signal to be output finally is indirectly determined according to the sound field quality at the virtual point.

It can be understood that, referring to fig. 3, if the number of speakers of the preset reconstruction speaker is 3, after a virtual sphere with the non-central point n as the center of the sphere is constructed, then 3 preset reconstruction speakers ξ are centered on the non-central point n₁、ξ₂And xi₃And mapping to a virtual sphere. Wherein the number of virtual points is the same as the number of preset reconstruction speakers. And, the preset can be reconstructed to loudspeaker xi₁The virtual point on the virtual sphere is denoted as v₁To preset and reconstruct loudspeaker xi₂The virtual point on the virtual sphere is denoted as v₂To preset and reconstruct loudspeaker xi₃The virtual point on the virtual sphere is denoted as v₃。

Step S40: and determining a virtual sound signal corresponding to the virtual loudspeaker at the virtual point based on a preset vector basis amplitude phase shift model.

It will be appreciated that, after determining the location of the virtual point, the speaker assumed to be at the virtual point may be referred to as a virtual speaker and the acoustic signal emitted by the virtual speaker may be referred to as a virtual acoustic signal. It is to be understood that virtual speakers are not actually present speakers.

It should be understood that, after the virtual speakers at the corresponding positions are determined according to the preset reconstructed speaker, because the original position point of one preset original speaker and the virtual points where the three virtual speakers are located are both located on the virtual spherical surface which takes the non-central point n as the spherical center and takes the distance Len as the radius, the technical limitation of the VBAP technology is satisfied, that is, the reconstruction center of the preset original speaker is to be consistent with the reconstruction center of the virtual speaker, and at this time, the reconstruction centers of the two are both non-central points n. Therefore, the virtual sound signal generated at the virtual loudspeaker can be determined by applying a preset vector base amplitude phase shift model based on the VBAP technology, so that the sound field quality after the three virtual sound signals are synthesized is close to the sound field quality obtained by presetting the original sound signal output by the original loudspeaker.

Step S50: and determining a reconstructed sound signal to be output by the preset reconstruction loudspeaker according to the virtual sound signal, so as to reconstruct a sound field taking the non-central point as a center by outputting the reconstructed sound signal.

It is understood that each virtual speaker corresponds to an actually existing preset reconstruction speaker, so that the reconstructed acoustic signal output by the preset reconstruction speaker can be obtained based on the virtual acoustic signal output by the virtual speaker. The preset reconstruction loudspeaker outputs the determined reconstruction sound signal, so that a reconstruction sound field meeting the requirement can be constructed, and the sound field quality of the reconstruction sound field is ensured. Obviously, the reconstructed sound field constructed by the technical solution described in this embodiment will be centered on a non-central point n, rather than on a central point O originally adopted by the original speaker.

Referring to fig. 4, fig. 4 is a flowchart illustrating a non-center point sound field reconstruction method for three channels according to a second embodiment of the present invention, and the non-center point sound field reconstruction method for three channels according to the second embodiment of the present invention is proposed based on the first embodiment illustrated in fig. 2.

In the second embodiment, when the preset original speakers and the preset reconstruction speakers are deployed, the number of the speakers of the preset original speakers may be set to 1, and the number of the speakers of the preset reconstruction speakers may be set to 3. In the orientation of the speakers, referring to fig. 3, a spherical surface can be constructed with the origin O as the center of sphere, so that 1 preset original speaker and 3 preset reconstructed speakers all fall on the spherical surface, which may be referred to as a preset deployment spherical surface. The preset deployment sphere is not the same as the virtual sphere.

Note that the location points of the 1 preset original speakers can be recorded as lpo ═ p (ρ₀,θ₀,ψ₀) The location points of the 3 preset reconstruction loudspeakers can be recorded as xi₁＝(ρ₁,θ₁,ψ₁)、ξ₂＝(ρ₂,θ₂,ψ₂) And xi₃＝(ρ₃,θ₃,ψ₃). Obviously, ρ at this time₀＝ρ₁＝ρ₂＝ρ₃Therefore, the preset deployment sphere is centered on the origin O and ρ₀Is a spherical surface with a spherical radius. By making 1 preset original loudspeaker and 3 preset reconstruction loudspeakers fall on the same spherical surface, the position point of 1 preset original loudspeaker falls in the interior of a spherical triangle formed by the position points of 3 preset reconstruction loudspeakers, thereby smoothly completing sound field reconstructionAnd (5) operating.

Further, the mapping the position points of the preset reconstruction speakers to spherical points on the virtual spherical surface as virtual points includes:

It is understood that, referring to fig. 3, a virtual sphere may be constructed by using the non-central point n as the center of the sphere, and then, a preset reconstructed speaker ξ may be reconstructed by using the non-central point n as the center_jAnd mapping to a virtual sphere. In other words, a speaker ξ from the non-central point n to the preset reconstruction ξ is created_jA ray of a point of location, e.g. connecting point n with point xi₁Point n and point xi₂And point n and point xi₃Three rays L are obtained₁、L₂And L₃. Then, the intersection point between the three rays and the virtual sphere is taken as a virtual point, and the virtual point can be recorded as v₁、v₂And v₃。

When the non-center point n is set as the center of the coordinate system, the virtual point v is set to be the center of the coordinate system₁、v₂And v₃Can be respectively represented as

And

wherein the content of the first and second substances,

if the non-center point n is taken as the center of the coordinate system, the default original speaker lpo may be represented as (ρ'₀，θ′₀，ψ'₀) Wherein, in the step (A),

of course, if the center point O is the center of the coordinate system, the virtual point v is₁、v₂And v₃May be respectively represented as (v)_1x,v_1y,v_1z)、(v_2x,v_2y,v_2z) And (v)_3x,v_3y,v_3z) Wherein, in the step (A),

further, the step S50 includes:

step S501: and determining the virtual particle velocity generated by the virtual sound signal at the non-central point through a preset virtual particle velocity calculation formula.

It is understood that the sound field quality of the reconstructed sound signal generated at the non-center point may be determined with reference to the sound field quality of the virtual sound signal at the non-center point, so that the particle velocity of the virtual sound signal at the non-center point n may be obtained first after the virtual sound signal output by the virtual speaker is determined. Specifically, the virtual sound signal and the position information of the non-center point b may be input into a preset virtual particle velocity calculation formula to be calculated, so as to obtain the virtual particle velocity. As for the preset virtual particle velocity calculation formula, specifically,

wherein, the preset virtual particle velocity calculation formula takes the central point O as the coordinate center,

representing the velocity of a virtual particle generated by a virtual sound signal output by a virtual speaker at a non-central point n, G representing the proportionality coefficient between the sound pressure generated by a speaker at a unit distance from the speaker and the sound pressure generated at the speaker, k 2 pi f/c being the wave number, f being the frequency of the sound signal, c being the velocity of sound propagation,

a virtual sound signal output for a virtual speaker.

Step S502: and determining the reconstructed particle velocity of the preset reconstructed loudspeaker at the non-central point through a preset particle velocity reconstruction model according to the virtual particle velocity, and determining a reconstructed acoustic signal to be output by the preset reconstructed loudspeaker according to the reconstructed particle velocity so as to reconstruct a sound field taking the non-central point as a center by outputting the reconstructed acoustic signal.

It will be appreciated that after the virtual particle velocity is determined, a preset particle velocity reconstruction model may be used to equate the particle velocity produced by the virtual speaker at the off-center point to the actually operating preset reconstructed speaker xi_jThe velocity of the particles generated at the non-central point. After the preset reconstructed loudspeaker xi is determined_jAfter the particle speed parameter of the emitted sound at the non-central point, a preset reconstruction loudspeaker xi can be deduced according to the particle speed parameter of the sound signal_jThe real value of the sound signal actually emitted, and the reconstructed sound signal is the preset reconstructed loudspeaker xi_jThe actual sound signal emitted.

Further, the determining, according to the virtual particle velocity, a reconstructed particle velocity of the preset reconstructed speaker at the non-central point through a preset particle velocity reconstruction model, and determining a reconstructed acoustic signal to be output by the preset reconstructed speaker according to the reconstructed particle velocity, so as to reconstruct a sound field centered on the non-central point by outputting the reconstructed acoustic signal, includes:

It will be appreciated that in order to finally obtain the reconstructed acoustic signal, the particle velocity generated by the preset reconstruction loudspeaker at the non-central point may be first determined by a preset reconstruction particle velocity calculation formula. As for the preset reconstructed particle velocity calculation formula, specifically,

wherein, the preset reconstruction particle velocity calculation formula takes the central point O as the coordinate center,

representing a preset reconstructed loudspeaker ξ_jThe speed of the reconstructed particle to be selected generated by the output sound signal at a non-central point n, G represents a proportionality coefficient between sound pressure generated by a loudspeaker at a unit distance from the loudspeaker and sound pressure generated by the loudspeaker, k is 2 pi f/c is wave number, f is frequency of the sound signal, c is speed of sound propagation, n represents position information of the non-central point, and xi_jPosition information indicating a preset reconstruction speaker,

representing and predefining reconstructed speaker xi_jThe output acoustic signal corresponds to the distribution coefficient to be selected, and s (ω) is the original acoustic signal output from the preset original speaker lpo.

It should be noted that the distribution coefficient to be selected here

There are various values and the screening will be based on the particle velocity requirements in this example. The speed of the reconstruction particles to be selected corresponds to the distribution coefficient to be selected, the actually required speed of the reconstruction particles to be selected is called the target reconstruction particle speed, and the actually required speed of the reconstruction particles to be selected corresponds to the target reconstruction particle speedThe desired partition coefficient is called the reconstructed partition coefficient.

It should be understood that in order to select a desired reconstructed partition coefficient from a plurality of partition coefficients to be selected, the velocity of the reconstructed particle to be selected is obtained

Then, a reconstructed distribution coefficient corresponding to the target reconstructed particle velocity may be determined based on the criterion that the virtual particle velocity is the same as the target reconstructed particle velocity. If the velocity of the virtual particle is recorded as

The preset particle velocity hold formula is,

and, based on the preset particle velocity maintenance formula,

where λ is a regularization factor, -1 represents the inverse of the matrix, I represents the identity matrix, and H represents the conjugate transpose.

It should be noted that the distribution coefficient to be selected is taken into consideration

The method has various values, and the multiple reconstructed particle speeds to be selected can be correspondingly obtained through a preset reconstructed particle speed calculation formula

However, if the virtual particle velocity is used as the reference particle velocity, the numerical value of the reconstructed particle velocity to be selected can be limited, and the actual value of the reconstructed distribution coefficient is determined, so that the reconstruction sound field can be optimized by using the particle velocity index as the screening condition. Thus, the reconstructed partition coefficients can be finally determined

The actual value of (c). Wherein the finally determined reconstructed distribution coefficients

j is 1, 2, 3, wherein

j is 1, 2 and 3, and the reconstruction distribution coefficients of the three preset reconstruction loudspeakers are respectively.

It will be appreciated that the partition coefficients are reconstructed by a joint reconstruction

The reconstructed acoustic signal can be obtained from the original acoustic signal s (omega), and can be recorded as s_jJ is 1, 2, 3, and

s is used to represent the original acoustic signal, S ═ S (ω). The reconstruction sound signal is a sound signal output by a preset reconstruction loudspeaker actually operated at the time.

In this embodiment, in order to determine the reconstructed sound signal actually output by the preset reconstructed speaker based on the virtual sound signal of the virtual speaker, the particle velocity may be used as an evaluation reference of sound, so that the sound field quality generated by the reconstructed sound signal at the non-central point is close to the sound field quality generated by the virtual sound signal at the non-central point, and the sound field quality of the reconstructed sound field is ensured.

Referring to fig. 5, fig. 5 is a flowchart illustrating a method for reconstructing a non-center point sound field of three channels according to a third embodiment of the present invention, and the method for reconstructing a non-center point sound field of three channels according to the third embodiment of the present invention is provided based on the first embodiment illustrated in fig. 2.

In the third embodiment, the step S40 includes:

step S401: and when the virtual point of the virtual loudspeaker and the original position point of the preset original loudspeaker are positioned on the virtual spherical surface, determining a virtual distribution coefficient corresponding to the virtual loudspeaker through a preset vector basis amplitude phase shift model according to the virtual point where the virtual loudspeaker is positioned and the original position point where the preset original loudspeaker is positioned.

It will be appreciated that when the number of speakers of the original speaker is preset to 1, see fig. 3, the virtual point v of the virtual speaker₁、v₂And v₃The VBAP technique can be applied to a case where the original position point lpo of a preset original speaker and the sound field construction center of a virtual speaker are located on a spherical surface, because the sound field construction center of the preset original speaker and the sound field construction center of the virtual speaker are located on the same point.

In a specific implementation, the position information of the virtual point and the position information of the original position point can be input into a preset vector base amplitude phase shift model to determine a virtual allocation coefficient corresponding to the virtual loudspeaker, and the virtual allocation coefficient is consistent with the virtual sound signal and can be used for representing the virtual sound signal. As for the predetermined vector basis amplitude phase shift model, it can be expressed as,

wherein the content of the first and second substances,

indicating the virtual distribution coefficient corresponding to the virtual loudspeaker, the virtual point v at which the virtual loudspeaker is located₁、v₂And v₃Can be respectively represented as

And

the original location point lpo at which the original speaker is preset may be represented as (ρ'₀，θ′₀，ψ'₀) Where k is 2 pi f/c, f is the frequency of the sound signal, and c is the speed of sound propagation.

Step S402: and determining the virtual sound signal output by the virtual loudspeaker according to the virtual distribution coefficient and the original sound signal output by the preset original loudspeaker.

It should be understood that if the number of speakers of the reconstruction speaker is 3, the number of virtual speakers is 3, and j is 1, 2, and 3. Thus, the virtual partition coefficient will be

And

it will be appreciated that the virtual sound signal can be obtained by multiplying the virtual partition coefficient by the original sound signal, for example, s (ω) is the original sound signal output by the preset original speaker lpo

And

a virtual sound signal output for a virtual speaker. It can be seen that the virtual allocation coefficient coincides with the value of the virtual sound signal, which can characterize the virtual sound signal.

In this embodiment, the virtual point of the virtual speaker and the original position point of the preset original speaker are both located on one spherical surface, so that the VBAP technology can be applied to obtain the determined value of the virtual acoustic signal.

Furthermore, an embodiment of the present invention further provides a storage medium, where a three-channel non-center point sound field reconstruction program is stored on the storage medium, and when executed by a processor, the three-channel non-center point sound field reconstruction program implements the following operations:

Further, the non-center point sound field reconstruction program for three channels when executed by the processor further realizes the following operations:

In addition, referring to fig. 6, an embodiment of the present invention further provides a device for reconstructing a non-center point sound field of three channels, where the device for reconstructing a non-center point sound field of three channels includes:

a non-central point determining module 10, configured to determine, when a sound field reconstruction instruction is received, position information of a non-central point and an original position point of a preset original speaker for constructing a preset original sound field according to the sound field reconstruction instruction, where the position information of the non-central point is different from position information of a central listening point in the preset original sound field.

The virtual spherical surface determining module 20 is configured to calculate a distance between the non-center point and the original position point, and construct a virtual spherical surface with the non-center point as a spherical center and the distance as a radius.

And the virtual speaker determining module 30 is configured to map the position points of the preset reconstructed speaker to spherical points on the virtual spherical surface as virtual points.

And the virtual sound signal determining module 40 is configured to determine a virtual sound signal corresponding to the virtual speaker at the virtual point based on a preset vector basis amplitude phase shift model.

A sound field reconstruction module 50, configured to determine, according to the virtual sound signal, a reconstructed sound signal to be output by the preset reconstruction speaker, so as to reconstruct, by outputting the reconstructed sound signal, a sound field with the non-central point as a center.

In an embodiment, the virtual speaker determining module 30 is further configured to establish a ray from the non-central point to the position point of the preset reconstructed speaker, and use an intersection point between the ray and the virtual spherical surface as the virtual point.

In an embodiment, the sound field reconstruction module 50 is further configured to determine a virtual particle velocity generated by the virtual sound signal at the non-central point through a preset virtual particle velocity calculation formula; and determining the reconstructed particle velocity of the preset reconstructed loudspeaker at the non-central point through a preset particle velocity reconstruction model according to the virtual particle velocity, and determining a reconstructed acoustic signal to be output by the preset reconstructed loudspeaker according to the reconstructed particle velocity so as to reconstruct a sound field taking the non-central point as a center by outputting the reconstructed acoustic signal.

In an embodiment, the sound field reconstruction module 50 is further configured to determine a to-be-selected reconstruction particle velocity generated by the preset reconstruction speaker at the non-center point through the preset reconstruction particle velocity calculation formula; selecting a target reconstruction particle speed corresponding to the virtual particle speed from the to-be-selected reconstruction particle speeds through the preset particle speed holding formula, and determining a reconstruction distribution coefficient corresponding to the preset reconstruction loudspeaker according to the target reconstruction particle speed; and determining a reconstructed sound signal to be output by the preset reconstructed loudspeaker according to the reconstructed distribution coefficient and the original sound signal output by the preset original loudspeaker, so as to reconstruct a sound field taking the non-central point as a center by outputting the reconstructed sound signal.

In an embodiment, the virtual acoustic signal determining module 40 is further configured to determine, when the virtual point of the virtual speaker and the original position point of the preset original speaker are located on the virtual spherical surface, a virtual allocation coefficient corresponding to the virtual speaker through a preset vector basis amplitude phase shift model according to the virtual point where the virtual speaker is located and the original position point where the preset original speaker is located; and determining the virtual sound signal output by the virtual loudspeaker according to the virtual distribution coefficient and the original sound signal output by the preset original loudspeaker.

Other embodiments or specific implementation manners of the three-channel non-center point sound field reconstruction device according to the present invention may refer to the above method embodiments, and are not described herein again.

It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or system that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or system. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or system that comprises the element.

The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments. In the unit claims enumerating several means, several of these means may be embodied by one and the same item of hardware. The use of the words first, second, third, etc. do not denote any order, but rather the words first, second, third, etc. are to be interpreted as names.

Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal device (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present invention.

The above description is only a preferred embodiment of the present invention, and not intended to limit the scope of the present invention, and all modifications of equivalent structures and equivalent processes, which are made by using the contents of the present specification and the accompanying drawings, or directly or indirectly applied to other related technical fields, are included in the scope of the present invention.

Claims

1. A method for reconstructing a non-center point sound field of three channels is characterized by comprising the following steps:

determining a reconstructed sound signal to be output by the preset reconstruction loudspeaker according to the virtual sound signal, and reconstructing a sound field taking the non-central point as a center by outputting the reconstructed sound signal;

the predetermined vector basis magnitude phase shift model may be expressed as,

wherein the content of the first and second substances,

And

2. The method of reconstructing a three-channel non-center point sound field according to claim 1, wherein the number of speakers of the original speaker is 1.

3. The method of claim 2, wherein the location points of the default original speakers and the location points of the default reconstructed speakers are on a default deployment sphere.

4. The method for reconstructing an off-center sound field of a three-channel as claimed in claim 1, wherein said mapping the location points of the preset reconstructed speakers to spherical points on the virtual sphere as virtual points comprises:

5. The method for reconstructing a non-center point sound field of a three-channel as claimed in claim 1, wherein the determining a reconstructed sound signal to be output by the preset reconstruction speaker according to the virtual sound signal, so as to reconstruct the sound field centered on the non-center point by outputting the reconstructed sound signal, comprises:

6. The method of claim 5, wherein the predetermined particle velocity reconstruction model comprises a predetermined reconstructed particle velocity calculation formula and a predetermined particle velocity maintenance formula;

7. The method for reconstructing a non-center point sound field of three channels according to any one of claims 1 to 6, wherein the determining a virtual sound signal corresponding to a virtual speaker at the virtual point based on a preset vector basis amplitude phase shift model comprises:

8. An audio device, characterized in that the audio device comprises: memory, a processor and a three-channel non-center point soundfield reconstruction program stored on the memory and executable on the processor, the three-channel non-center point soundfield reconstruction program when executed by the processor implementing the steps of the three-channel non-center point soundfield reconstruction method of any of claims 1 to 7.

9. A storage medium having stored thereon a three-channel non-center point sound field reconstruction program, which when executed by a processor, implements the steps of the three-channel non-center point sound field reconstruction method according to any one of claims 1 to 7.

10. A three-channel non-center point sound field reconstruction apparatus, comprising:

a sound field reconstruction module, configured to determine, according to the virtual sound signal, a reconstructed sound signal to be output by the preset reconstruction speaker, so as to reconstruct, by outputting the reconstructed sound signal, a sound field centered on the non-central point;

the predetermined vector basis magnitude phase shift model may be expressed as,

wherein the content of the first and second substances,

And