CN117750295A

CN117750295A - Control method, control device and sounding equipment

Info

Publication number: CN117750295A
Application number: CN202311862649.XA
Authority: CN
Inventors: 王冉; 刘扬
Original assignee: Lenovo Beijing Ltd
Current assignee: Lenovo Beijing Ltd
Priority date: 2023-12-29
Filing date: 2023-12-29
Publication date: 2024-03-22

Abstract

The application discloses a control method, a control device and sound production equipment, and relates to the technical field of sound control. The method comprises the following steps: determining a sound emission angle of the sound emission device based on the audio parameters of the target sound source; controlling a corresponding sounding module of the sounding device to output corresponding audio data of a target sound source at a corresponding sounding angle; wherein, the working parameters of at least one sounding module of the sounding device under the condition of different sound sources are different.

Description

Control method, control device and sounding equipment

Technical Field

The present disclosure relates to the field of sound control technologies, and in particular, to a control method, a control device, and a sound generating device.

Background

The reality and the richness of sound reproduction are improved by the appearance and the development of the surround sound technology, and the surround sound technology can be widely applied to various scenes such as music, films and videos, conferences, games and the like. Stereo surround sound requires a multi-channel audio decoding and multi-channel sound system at a hardware driving layer, and a device configuration process requires technical guidance by a professional, so that the stereo surround sound is inconvenient for families or individuals. To reduce the user's threshold, virtual surround sound technology is rapidly evolving. For example, a user may experience virtual surround sound effects using a personal device such as an in-ear or headset. However, because the earphone device brings the in-head effect, when the user listens to the audio, the audio appears to exist in the brain rather than the space, and the user cannot be provided with an on-site feeling, so that the user is difficult to bring high-quality listening experience.

Disclosure of Invention

The first aspect of the present application provides a control method, including:

determining a sound emission angle of the sound emission device based on the audio parameters of the target sound source;

controlling a corresponding sounding module of the sounding device to output corresponding audio data of the target sound source at a corresponding sounding angle;

wherein, at least one sound generating module of the sound generating device has different working parameters under the condition of different sound sources.

In an optional implementation manner, the determining the sound emission angle of the sound emission device based on the audio parameter of the target sound source includes at least one of the following:

determining respective sounding angles of at least two sounding modules of the sounding device based on the vocal tract parameters of the target sound source;

determining respective sounding angles of at least two sounding modules of the sounding device based on azimuth information carried by the target sound source;

the method comprises the steps of obtaining environmental parameters of a space environment where the sound generating device is located, and determining respective sound generating angles of at least two sound generating modules of the sound generating device based on the environmental parameters and audio parameters of a target sound source.

In an alternative implementation manner, determining respective sound emission angles of at least two sound emission modules of the sound emission device based on the channel parameters of the target sound source includes:

Determining the number and/or the type of the channels of the target sound source;

and determining the respective sounding angles of the at least two sounding modules based on the number of sound channels and/or the type of the sound channels by using determined target reference data, wherein the target reference data is determined based on a first position relationship between the sounding device and a target receiving object and/or a second position relationship between the sounding device and a target sound wave reflecting structure.

In an optional implementation manner, determining the sounding angles of the at least two sounding modules respectively according to the determined target reference data based on the number of channels and/or the channel type comprises at least one of the following steps:

if the number of the sound channels is not greater than a first threshold value, determining respective sound emission angles of sound emission modules corresponding to the number of the sound channels by using first reference data, wherein the first reference data is determined at least based on the first position relation;

if the number of the sound channels is not smaller than a first threshold value and the target sound source has a first sound channel type, determining respective sound emission angles of sound emission modules corresponding to the number of the sound channels according to first reference data and second reference data, wherein the first reference data is determined at least based on the first position relation, and the second reference data is determined based on the second position relation;

If the target sound source has a first sound channel type, determining respective sound emission angles of sound emission modules corresponding to the number of the sound channels according to first reference data and second reference data, wherein the first reference data is determined at least based on the first position relation, and the second reference data is determined based on the second position relation;

and if the target sound source has a second sound type, determining the respective sound emission angles of the sound emission modules corresponding to the number of the sound channels by using first reference data, wherein the first reference data is determined at least based on the first position relation.

In an optional implementation manner, determining respective sounding angles of at least two sounding modules of the sounding device based on azimuth information carried by the target sound source includes:

determining the number of azimuth information carried by the target sound source, and determining the sounding angles of the at least two sounding modules respectively according to the determined target reference data based on the azimuth information and the number thereof;

the target reference data is determined based on a first position relation between the sound generating device and the target receiving object and/or a second position relation between the sound generating device and the target sound wave reflecting structure.

In an optional implementation manner, determining respective sound emission angles of at least two sound emission modules of the sound emission device based on the environmental parameter and the audio parameter of the target sound source includes:

obtaining modeling data of a spatial environment in which sound generating equipment is located, wherein the modeling data comprises distance data between the sound generating equipment and a target sound wave reflecting structure in the spatial environment;

obtaining positioning data of a target receiving object in the space environment;

and determining the respective sounding angles of at least two sounding modules of the sounding device based on the modeling data and/or the positioning data.

In an optional implementation manner, controlling the corresponding sound generating module of the sound generating device to output the corresponding audio data of the target sound source at the corresponding sound generating angle includes:

determining working parameters of each sounding module of the sounding device based on the audio parameters of the target sound source;

and controlling the corresponding sounding module to output the corresponding audio data of the target sound source at the corresponding sounding angle based on the working parameters.

In an alternative implementation, at least one of the following is further included:

the method comprises the steps that a monitoring target receives motion information of an object, and the sounding angle and/or the working parameter of a sounding module corresponding to sounding equipment are adjusted based on the motion information, or the sounding equipment is controlled to move based on the motion information;

And obtaining a target configuration operation of a target receiving object, and configuring a corresponding sounding module and a sounding angle thereof based on the target configuration operation and the audio parameters.

A second aspect of the present application provides a control apparatus, comprising:

the sound emission angle determining module is used for determining the sound emission angle of the sound emission device based on the audio parameters of the target sound source;

the audio output module is used for controlling the corresponding sounding module of the sounding device to output the corresponding audio data of the target sound source at the corresponding sounding angle;

A third aspect of the present application provides a sound emitting device comprising: the sound generating device comprises a plurality of sound generating modules, a memory and a processor which are connected in a communication way; wherein,

the memory has a computer program stored thereon;

the processor is configured to execute the computer program in the memory to implement the following operations:

determining the sounding angle of the sounding module based on the audio parameters of the target sound source;

controlling the sounding module to output corresponding audio data of the target sound source at a corresponding sounding angle;

Drawings

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings that are required in the embodiments or the description of the prior art will be briefly described below, it being obvious that the drawings in the following description are only some embodiments of the present application, and that other drawings may be obtained according to these drawings without inventive faculty for a person skilled in the art.

Fig. 1 is a flowchart of a control method provided in an embodiment of the present application;

fig. 2 is a schematic structural diagram of a binaural channel of an ultrasound apparatus according to an embodiment of the present application;

fig. 3 is a schematic diagram of a sound wave transmission direction of a virtual surround sound formed by an ultrasonic device according to an embodiment of the present application;

fig. 4 is a schematic diagram of a 2.1 channel of a speaker array according to an embodiment of the present disclosure;

fig. 5 is a schematic diagram of a 5.1 channel of an ultrasonic device according to an embodiment of the present application;

fig. 6 is a schematic diagram of a 7.1 channel of an ultrasound apparatus according to an embodiment of the present application;

fig. 7 is a schematic diagram of a 4.0 channel of an ultrasonic device according to an embodiment of the present application;

fig. 8 is a schematic diagram of a sound wave transmission direction of virtual surround sound formed by another ultrasonic device according to an embodiment of the present application;

Fig. 9 is a schematic structural diagram of a control device according to an embodiment of the present application;

fig. 10 is a schematic structural diagram of a sound generating device according to an embodiment of the present application.

Detailed Description

In order to make the present application solution better understood by those skilled in the art, the following description will clearly and completely describe the technical solution in the embodiments of the present application with reference to the accompanying drawings in the embodiments of the present application, and it is apparent that the described embodiments are only some embodiments of the present application, not all embodiments. All other embodiments, which can be made by one of ordinary skill in the art without undue burden from the present disclosure, are within the scope of the present disclosure.

Fig. 1 is a flowchart of a control method provided in an embodiment of the present application. As shown in fig. 1, the control method in the present application includes:

step 101, determining the sound emission angle of the sound emission device based on the audio parameters of the target sound source.

The target sound source is a sound source that the sound generating apparatus in the present application needs to output. The audio parameters of the target audio source include, but are not limited to, parameters such as the number of audio channels, audio bearing information, and the number of audio.

The number of audio channels refers to the number of channels of audio. For example, the number of audio channels of 2.1 channels and 3.0 channels is 3; the number of audio channels of 3.1 channels is 4,5.1 channels is 6, and so on.

The azimuth information of the audio refers to azimuth information carried by the audio itself. The azimuth information generally corresponds to the channel of audio. For example, in a 2-azimuth scene, there are 2 azimuth information, channel 1 may be used to represent the front sound, and channel 2 may be used to represent the left sound; as another example, in a 4-azimuth scene, there are 4 azimuth information, channel 1 may be used to represent a front sound, channel 2 may be used to represent a left sound, channel 3 may be used to represent a rear sound, and channel 4 may be used to represent a right sound.

The number of audio refers to the number of audio sources included in the target audio source. The number of the audio frequency in the application can be 1 or a plurality of audio frequencies.

The sound production equipment in this application includes a plurality of sound production modules, and every sound production module is located planar normal direction and is the sound production direction of this sound production module. The sounding modules can be integrated on the same flat plate or on a plurality of flat plates. If the plurality of sounding modules are integrated on the plurality of flat plates, the sounding device is a discrete sounding device, and if the plurality of sounding modules are integrated on the same flat plate, the sounding device is an integrated sounding device.

The sound generating device in the application can be an ultrasonic device or a loudspeaker device. If the ultrasonic equipment is adopted, each sound generating module consists of one or more ultrasonic units; in the case of a speaker device, each sound module consists of one or more omni-directional speakers. In other embodiments, the speaker device may also be a device composed of a directional speaker or a device composed of a directional speaker and an omni-directional speaker together.

It should be noted that, since the ultrasonic unit has better high-frequency performance, the ultrasonic device is only used for outputting the audio frequency of the non-low-frequency channel, so the ultrasonic device needs to be matched with the heavy bass sound equipment. The sound generating module of the speaker device is composed of a plurality of omni-directional speakers or directional speakers, so that the speaker device can output audio of various frequencies.

The sounding angle is the corresponding audio data of the target sound source propagated by the corresponding sounding module of the sounding device along which direction. For example, if the sound emission angle is-45 °, the corresponding sound emission module of the sound emission device may rotate 45 ° counterclockwise along its initial normal line, and transmit the corresponding audio data of the target sound source.

Specifically, the respective sounding angles of at least two sounding modules of the sounding device can be determined through at least one of the vocal tract parameters of the target sound source, the azimuth information carried by the target sound source and the environmental parameters of the spatial environment where the sounding device is located.

The channel parameters of the target sound source refer to the number of channels and the type of channels of the target sound source. The number of channels is the number of channels in the foregoing embodiments; the channel type refers to whether the channel is a first channel type or a second channel type,

the first channel type is a channel associated with surround sound, such as a left surround channel and a right surround channel in 5.1 channels, and a left front surround channel, a left rear surround channel, a right front surround channel and a right rear surround channel in 7.1 channels, for example.

The second channel type is a channel independent of the surround channel, such as the left channel, center channel, and right channel of the 5.1 channel and 7.1 channel; and for example, the left and right channels of the two channels.

The environmental parameters of the space environment where the sound generating device is located refer to the size of the space where the sound generating device is located, the position information of the sound generating device in the space environment, noise of the space environment where the sound generating device is located, and the like.

Specifically, at least one of the number of channels and the type of channels of the target sound source is first determined; then determining target reference data; and finally, determining the sounding angles of two or more sounding modules in the sounding device according to at least one of the number of sound channels and the type of sound channels and the target reference data.

The number of the channels of the target sound source is the number of the channels, and the channel types of the target sound source comprise a first channel type and a second channel type. After determining the target sound source, those skilled in the art can determine the number of channels of the target sound source and the channel type of the target sound source, which is not described in detail in this application.

Wherein the target reference data is determined based on at least one of a first positional relationship between the sound emitting device and the target receiving object and a second positional relationship between the sound emitting device and the target reflecting structure.

In an alternative implementation, determining the target reference data based on the first positional relationship between the sound emitting device and the target receiving object may be: the corresponding relation between the numerical value of the linear distance between the sounding device and the target receiving object and the numerical value of the first reference data is preset. For example, if the above straight-line distance is m meters, the first reference data is θ degrees, where θ is any angle between 0 ° or more and 45 ° or less.

It should be noted that, the corresponding relationship between the magnitude of the straight line distance between the sound generating device and the target receiving object and the magnitude of the first reference data may be determined by a person skilled in the art according to the existing calculation method, or may be data based on experimental test.

It should be noted that, a possible implementation manner of determining the target reference data based on the first positional relationship is schematically given herein, and a person skilled in the art may determine the target reference data based on the first positional relationship in other possible manners.

In an alternative implementation, determining the target reference data based on the second positional relationship between the sound emitting device and the target reflective structure may be: determining a first linear distance between the sound generating device and the target reflecting structure and a second linear distance between the sound generating device and the target receiving object; and determining an anticcosine angle corresponding to the ratio of the second linear distance to the first linear distance as target reference data. The target sound wave reflecting structure can be a wall of a space where the sound generating device is located or other objects capable of reflecting sound waves.

It should be noted that a possible implementation of determining the target reference data based on the second positional relationship is schematically presented herein, and that a person skilled in the art may determine the target reference data based on the second positional relationship in other possible ways.

In an alternative implementation manner, determining the target reference data based on the first position relationship and the second position relationship refers to obtaining the target reference data A1 determined based on the first position relationship and the target reference data A2 determined based on the second position relationship according to the method described in the foregoing embodiment, respectively; and carrying out mathematical operation on the target reference data A1 and the target reference data A2 to obtain target reference data. Specifically, the target reference data A1 determined based on the first positional relationship may be added to the target reference data A2 determined based on the second positional relationship to obtain target reference data.

In the application, at least one of the following four schemes can be adopted to determine the respective sounding angles of at least two sounding modules based on the number of sound channels and/or the type of the sound channels according to the determined target reference data.

The first scheme is as follows: and if the number of the sound channels of the target sound source is not greater than a first threshold value, determining the respective sound emission angles of the sound emission modules corresponding to the number of the sound channels by using first reference data, wherein the first reference data is determined at least based on the first position relation.

Specifically, the first threshold in this application is 4. When the number of the sound channels of the target sound source is not more than 4, the respective sound emitting angles of the sound emitting modules corresponding to the number of the sound channels can be determined by using the first reference data. For example, for 2.1 channels and 3.0 channels, the number of channels is 3, and the sounding angles of the corresponding 3 sounding modules can be determined by using the first parameter; for 3.1 channels, the number of channels is 4, and the corresponding sounding angles of the 4 sounding modules can be determined by using the first parameter.

The first embodiment will be described in detail with reference to specific examples.

Case 1:

the sound emitting device in this case is an integrated ultrasound device. If the number of the sound channels of the determined target sound source is 2, a person skilled in the art can divide the plurality of ultrasonic units of the ultrasonic device into 2 ultrasonic modules according to the preset ultrasonic unit distribution ratio. It should be noted that, in the present application, a specific implementation manner of dividing a plurality of ultrasonic units of an ultrasonic apparatus into two ultrasonic modules is not limited, and how many ultrasonic units are respectively included in the two ultrasonic modules is not limited.

Fig. 2 is a schematic structural diagram of a binaural channel of an ultrasound apparatus according to an embodiment of the present application. Referring to fig. 2, when the number of channels of the target sound source is 2, the number of sounding modules of the ultrasonic device is 2, which are a sounding module of a left channel and a sounding module of a right channel, respectively.

After the number of the sound channels of the target sound source is determined, determining a first position relation (linear distance between the sound generating equipment and the target receiving object) between the sound generating equipment and the target receiving object; and determining first reference data according to the first position relation, and determining respective sounding angles of the sounding modules of the left channel and the sounding modules of the right channel based on the first reference data.

As can be seen from the foregoing embodiments, the first reference data may be determined by presetting the correspondence relationship between the magnitude of the straight line distance between the sound generating apparatus and the target receiving object and the magnitude of the first reference data.

Assuming that the determined first reference data is θ, the method for determining the sounding angles of the sounding module of the left channel and the sounding module of the right channel based on the first reference data θ is as follows:

firstly, determining the vertical direction of the plane of an ultrasonic unit of the integrated ultrasonic equipment as the initial normal direction of the ultrasonic equipment.

And then, according to the first reference data theta and the initial normal direction, determining the sounding angles of the sounding modules of the left channel and the sounding modules of the right channel respectively.

For example, for the sounding module of the left channel, the sounding angle can be set to deflect θ counterclockwise along the original normal phase direction ₁ The method comprises the steps of carrying out a first treatment on the surface of the For the sounding module of the right sound channel, the sounding angle can be set to deflect theta clockwise along the initial normal direction ₂ Thereby determining the respective sounding angles of the sounding modules of the left channel and the sounding modules of the right channel.

Note that θ ₁ And theta ₂ Are all obtained by mathematical operation based on the first reference data theta and a preset adjustment rule, and theta ₁ And theta ₂ Are all angles of more than or equal to 0 DEG and less than or equal to 45 DEG, and theta ₁ And theta ₂ The values of (2) may be the same or different.

It should be noted that, in the present application, the sounding direction of the sounding module of the left channel and the sounding direction of the sounding module of the right channel in the ultrasound apparatus are required to be located at two sides of the initial normal direction. Because only in this case, the audio data in the target sound source can be transmitted in different directions and reflected by different sound wave reflecting structures, a virtual surround sound effect is formed.

Fig. 3 is a schematic diagram of a sound wave transmission direction of a virtual surround sound formed by an ultrasonic device according to an embodiment of the present application. Referring to fig. 3, if the ultrasound device needs to adapt to the 2.1 channel, the ultrasound device is divided into a left channel sounding module and a right channel sounding module according to the method in case 1, and then a subwoofer for outputting low-frequency audio is configured, so that the virtual surround sound shown in fig. 3 can be obtained.

Specifically, a sounding module of a left sound channel in the ultrasonic equipment transmits corresponding audio data in a target sound source along a corresponding sounding direction, and the corresponding audio data is transmitted to a wall on the left side of a listening area and reflected by the wall to form a left virtual sound source; transmitting corresponding audio data in a target sound source along a corresponding sound producing direction by a sound producing module of a right channel, transmitting the corresponding audio data to a wall on the right side of a listening area, and reflecting the corresponding audio data by the wall to form a right virtual sound source; the subwoofer transmits audio data of a non-high frequency target sound source according to a preset direction, and finally forms virtual surround sound shown in fig. 3.

Case 2:

the sound emitting device in this case is an integrated speaker device. Since the speaker units in the present application are all the interdigital speaker units, the speaker apparatus in the present application can output audio data of respective frequencies. It is emphasized that the number of speaker units in the integrated speaker apparatus in the present application needs to be 9 or more.

If the number of channels of the target sound source is 3, the person skilled in the art can divide the speaker device into 3 sound emitting modules according to the preset distribution ratio of the speaker units. In this application, the specific implementation manner of dividing the plurality of speaker units of the speaker device into 3 sound emitting modules is not limited, and how many speaker units are in each sound emitting module is not limited.

Fig. 4 is a schematic diagram of a 2.1 channel of a speaker array according to an embodiment of the present application. Referring to fig. 4, when the number of channels of the target sound source is 3, the number of sound emitting modules of the speaker device is 3, which are respectively a sound emitting module of a left channel, a sound emitting module of a middle channel, and a sound emitting module of a right channel.

After the number of the sound channels of the target sound source is determined, determining a first position relation (linear distance between the sound generating equipment and the target receiving object) between the sound generating equipment and the target receiving object; and determining first reference data according to the first position relation, and determining respective sounding angles of the sounding module of the left channel, the sounding module of the middle channel and the sounding module of the right channel based on the first reference data.

Assuming that the determined first reference data is θ, the method for determining the sounding angles of the sounding module of the left channel, the sounding module of the middle channel and the sounding module of the right channel based on the first reference data θ is as follows:

first, it is determined that the vertical direction of the plane in which the speaker array of the integrated speaker apparatus is located is the initial normal direction of the speaker apparatus.

And then, according to the first reference data theta and the initial normal direction, determining respective sounding angles of the sounding module of the left channel, the sounding module of the middle channel and the sounding module of the right channel.

For example, for the sounding module of the left channel, the sounding angle can be set to deflect θ counterclockwise along the original normal phase direction ₁ The method comprises the steps of carrying out a first treatment on the surface of the For the sounding module of the right sound channel, the sounding angle can be set to deflect theta clockwise along the initial normal direction ₂ The method comprises the steps of carrying out a first treatment on the surface of the For the sounding module of the middle-set sound channel, the sounding angle can be set to be polarized theta along the initial normal direction ₃ 。

Note that θ ₁ 、θ ₂ And theta ₃ Are all obtained by mathematical operation based on the first reference data theta and a preset adjustment rule, and theta ₃ And theta ₁ And theta ₂ Are all different in value, θ ₁ And theta ₂ The values of (2) may be the same or different, but θ ₁ 、θ ₂ And theta ₃ Are all angles of 0 DEG or more and 45 DEG or less.

It should be noted that, in the present application, the sounding direction of the sounding module of the left channel and the sounding direction of the sounding module of the right channel in the ultrasonic module are required to be located at two sides of the initial normal direction; because only in this case, the audio data in the target sound source can be transmitted in different directions and reflected by different sound wave reflecting structures, a virtual surround sound effect is formed.

Case 3:

the sound emitting device in this case is a separate ultrasound device or a separate speaker device. If the number of the sound channels of the determined target sound source is 4, 4 sound production modules of the sound production equipment are obtained; namely, 4 sounding modules of the ultrasonic device (a heavy bass sound device configured with an additional output of non-high frequency audio data) or 4 sounding modules of the speaker device are obtained.

The 4 sounding modules can be arranged around the target receiving object in a scattered manner, the first reference data corresponding to the sounding modules are determined through the linear distance between each sounding module and the target receiving object, and the sounding angle corresponding to the sounding modules is determined. The specific implementation manner of determining the sounding angle based on the first reference data is described in case 1, and will not be described herein.

The second scheme is as follows:

if the number of the sound channels of the target sound source is not smaller than a first threshold value and the target sound source has a first sound channel type, determining the respective sound emission angles of the sound emission modules corresponding to the number of the sound channels according to the first reference data and the second reference data. Wherein the first reference data is determined based at least on the first positional relationship and the second reference data is determined based on the second positional relationship.

As can be seen from the foregoing, the first threshold is 4. The first channel type is a channel associated with surround sound, such as a left surround channel and a right surround channel in 5.1 channels, and a left front surround channel, a left rear surround channel, a right front surround channel and a right rear surround channel in 7.1 channels, for example.

It should be noted that, for a specific implementation manner of determining the first reference data based on the first positional relationship in the present application, reference may be made to the description of determining the target reference data based on the first positional relationship described in the foregoing embodiments of the present application. Specific implementation of determining the second reference data based on the second positional relationship in the present application may be referred to the description of determining the target reference data based on the second positional relationship described in the foregoing embodiments of the present application.

The second scheme will be described in detail with reference to specific examples.

Case 4:

the sound emitting device in this case is an integrated ultrasound device. If the number of the channels of the determined target sound source is 5 and the target sound source has the first channel type, a person skilled in the art can divide the plurality of ultrasonic units of the ultrasonic device into 5 ultrasonic modules according to the preset ultrasonic unit allocation proportion. It should be noted that, in the present application, a specific implementation manner of dividing a plurality of ultrasound units of the ultrasound apparatus into 5 ultrasound modules is not limited, and how many ultrasound units are in each ultrasound module is not limited.

Fig. 5 is a schematic diagram of a 5.1 channel of an ultrasound apparatus according to an embodiment of the present application. Referring to fig. 5, when the number of channels of the target sound source is 5, the number of sounding modules of the ultrasonic device is 5, which may be according to preset 3:1:2:1:3, dividing the ultrasonic equipment into a sounding module of a left surround channel, a sounding module of a left channel, a sounding module of a middle channel, a sounding module of a right channel and a sounding module of a right surround channel.

In fig. 5, the left channel, the center channel, and the right channel are independent of surround sound, and are not of the first channel type, and the sounding angles corresponding to the sounding modules of the left channel, the sounding angles corresponding to the sounding modules of the center channel, and the sounding angles corresponding to the sounding modules of the right channel may be determined by using the first reference data. The content may be referred to in case 1 or case 2, and will not be described here.

In fig. 5, the left surround channel and the right surround channel are surround channels, which belong to a first channel type, and a sounding angle corresponding to a sounding module of the left surround channel and a sounding angle corresponding to a sounding module of the right surround channel need to be determined by using second reference data.

As can be seen from the foregoing embodiments, the second reference data may be obtained by determining the first linear distance between the sound generating device and the target reflecting structure, and the second linear distance between the sound generating device and the target receiving object, based on the inverse cosine angle of the ratio of the second linear distance to the first linear distance.

Assuming that the determined second reference data is phi, the method for determining the sounding angles of the sounding modules of the left surround channel and the sounding modules of the right surround channel based on the second reference data phi is as follows: and determining respective sounding angles of the sounding modules of the left surround channel and the sounding modules of the right surround channel according to the second reference data phi and the initial normal direction of the ultrasonic equipment.

For example, for the sounding module of the left surround channel, the sounding angle can be set to be along the initial directionThe initial method phase direction is anticlockwise deflected phi ₁ The method comprises the steps of carrying out a first treatment on the surface of the For the sounding module of the right surround channel, the sounding angle can be set to deflect phi clockwise along the initial normal direction ₂ 。

Incidentally, phi ₁ And phi ₂ Are all obtained by mathematical operation based on the second reference data phi and a preset adjustment rule, phi ₁ And phi ₂ The values of (2) may be the same or different.

In the application, the sounding direction of the sounding module of the left surround channel and the sounding direction of the sounding module of the right surround channel in the ultrasonic module are required to be positioned at two sides of the initial normal direction; the sounding direction of the sounding module of the left sound channel and the sounding direction of the right sound channel module are positioned at two sides of the initial normal direction; the sounding direction of the sounding module of the left surround sound channel and the sounding direction of the sounding module of the left sound channel are positioned on the same side of the initial normal direction. Because only in this case, the audio data in the target sound source can be transmitted in different directions and reflected by different sound wave reflecting structures, a virtual surround sound effect is formed.

Case 5:

the sound emitting device in this case is an integrated ultrasound device. If the number of the channels of the determined target sound source is 7 and the target sound source has the first channel type, a person skilled in the art can divide the plurality of ultrasonic units of the ultrasonic device into 7 ultrasonic modules according to the preset ultrasonic unit allocation proportion. If necessary, a subwoofer for outputting non-high frequency audio data can be configured for use with the ultrasound device.

Fig. 6 is a schematic diagram of a 7.1 channel of an ultrasound apparatus according to an embodiment of the present application. Referring to fig. 6, when the number of channels of the target sound source is 7, the number of sounding modules of the ultrasonic device is 7, according to preset 2:2:1:2:1:2:2, dividing the ultrasonic equipment into a sounding module of a left front surrounding sound channel, a sounding module of a left rear surrounding sound channel, a sounding module of a left sound channel, a sounding module of a middle sound channel, a sounding module of a right rear surrounding sound channel and a sounding module of a right front surrounding sound channel.

In fig. 6, the left channel, the center channel and the right channel are irrelevant to surround sound, and are not of the first channel type, and the sounding angles corresponding to the sounding modules of the left channel, the sounding angles corresponding to the sounding modules of the center channel and the sounding angles corresponding to the sounding modules of the right channel can be determined by using the first reference data. The content may be referred to in case 1 or case 2, and will not be described here.

The left front surround channel, the left rear surround channel, the right rear surround channel, and the right front surround channel in fig. 6 are surround channels belonging to the first channel type.

For the left rear surround channel and the right rear surround channel, the second reference data can be used for determining the sounding angles corresponding to the sounding modules of the left rear surround channel and the sounding angles corresponding to the sounding modules of the right rear surround channel. The detailed description of the process is shown in case 4, and the description of the sounding angle corresponding to the sounding module of the left surround channel and the sounding angle corresponding to the sounding module of the right surround channel is omitted here.

For the left front surround channel and the right front surround channel, the first reference data and the second reference data can be used for determining third reference data, and then the third reference data is used for determining the sounding angle corresponding to the sounding module of the left front surround channel and the sounding angle corresponding to the sounding module of the right front surround channel. The foregoing embodiments detail an implementation manner of determining the third reference data based on the first reference data and the second reference data, which is not described herein.

Assuming that the determined third reference data is ω, the method for determining the sounding angles corresponding to the sounding modules of the left front surround channel and the sounding modules of the right front surround channel based on the third reference data ω is: and determining the sounding angles corresponding to the sounding modules of the left front surrounding channel and the sounding modules of the right front surrounding channel respectively according to the third reference data omega and the initial normal direction of the ultrasonic equipment.

For example, for the sounding module of the left front surround channel, the sounding angle can be set to deflect counter-clockwise by ω along the original normal direction ₁ The method comprises the steps of carrying out a first treatment on the surface of the For the sounding module of the right surround channel, the sounding angle can be set asClockwise deflection omega along initial normal direction ₂ 。

Omega, omega ₁ And omega ₂ Are all obtained by mathematical operation based on third reference data omega and preset adjustment rules ₁ And omega ₂ The values of (2) may be the same or different.

In the application, the sounding direction of the sounding module of the left rear surrounding sound channel and the sounding direction of the sounding module of the right rear surrounding sound channel in the ultrasonic module are required to be positioned at two sides of the initial normal direction; the sounding direction of the sounding module of the left sound channel and the sounding direction of the right sound channel module are positioned at two sides of the initial normal direction; the sounding direction of the sounding module of the left front surrounding sound channel and the sounding direction of the sounding module of the right front surrounding sound channel are positioned at two sides of the initial normal direction; the sounding direction of the sounding module of the left front surrounding sound channel, the sounding module of the left sound channel and the sounding direction of the sounding module of the left rear sound channel are positioned on the same side of the initial normal direction. Because only in this case, the audio data in the target sound source can be transmitted in different directions and reflected by different sound wave reflecting structures, a virtual surround sound effect is formed.

The methods described in case 4 and case 5 are also applicable to the discrete ultrasonic apparatus.

Third scheme:

and if the target sound source has a first sound channel type, determining the sound emission angles of the sound emission modules corresponding to the number of the sound channels according to first reference data and second reference data, wherein the first reference data is determined at least based on the first position relation, and the second reference data is determined based on the second position relation.

In the scheme, the number of the channels of the target sound source is not considered, and only whether the channels of the target sound source have the first channel type is needed to be determined. If the sound channel of the target sound source is of the first type, determining the sound emitting angles corresponding to the sound emitting modules corresponding to the number of the sound channels by using the first reference data and the second reference data.

As can be seen from the foregoing, the first channel type is a surround-sound related channel, which may be a left surround channel and a right surround channel in 5.1 channels, or a left front surround channel, a left rear surround channel, a right rear surround channel, and a right front surround channel in 7.1 channels.

The specific implementation manner of determining the sounding angle corresponding to the left surround channel and the sounding angle corresponding to the right surround channel based on the second reference data is described in detail in case 4, and will not be repeated here.

For a specific implementation manner of determining the sounding angle corresponding to the left back surround channel and the sounding angle corresponding to the right back surround channel based on the second reference data, reference may also be made to the description of determining the sounding angle corresponding to the left surround channel and the sounding angle corresponding to the right surround channel based on the second reference data in case 4, which will not be described herein.

For the specific implementation manner of determining the sounding angle corresponding to the sounding module of the front left surround channel and the sounding angle corresponding to the sounding module of the front right surround channel by using the third reference data obtained by performing mathematical operation based on the first reference data and the second reference data, reference may be made to the detailed description in case 5, and details are not repeated here.

Fourth scheme:

In the scheme, the number of the channels of the target sound source is not considered, and only whether the channels of the target sound source are of the second channel type is needed to be determined. If the sound channels of the target sound source are of the second type, determining the sound emission angles corresponding to the sound emission modules corresponding to the number of the sound channels by using the first reference data.

As can be seen from the foregoing, the second channel type is a channel unrelated to surround sound, and may be a left channel and a right channel in 2.0 channels, or may be a left channel, a center channel and a right channel in 3.0 channels. But also the left and right channels in the 2.1 channel.

For a specific implementation manner of determining the sounding angles corresponding to the sounding module of the left channel, the sounding module of the right channel and the sounding module of the middle channel based on the first reference data, reference may be made to the related descriptions in case 1, case 2 and case 3, which are not repeated herein.

The number of azimuth information carried by the target sound source has a corresponding relation with the number of sounding modules of the sounding device. If the number of azimuth information carried by the target sound source is 2, at least 2 sounding modules are needed; if the number of azimuth information carried by the target sound source is 4, at least 4 sounding modules are needed.

After the number of azimuth information carried by the target sound source is determined, the number of sounding modules required by the target sound source can be determined based on the corresponding relation between the number of azimuth information and the number of channels. After determining the number of sounding modules, if the number of sounding modules is smaller than a first threshold, that is, smaller than 4, determining sounding angles corresponding to each sounding module by using the methods recorded in case 1, case 2 and case 3; if the number of sounding modules is greater than 4 and the target sound source has the first channel type, the sounding angles corresponding to the sounding modules can be determined by using the methods described in case 4 and case 5.

If the number of azimuth information carried by the target sound source is determined to be 4, a person skilled in the art can divide a plurality of ultrasonic units of the ultrasonic device into 4 ultrasonic modules according to a preset ultrasonic unit distribution ratio. If necessary, a subwoofer for outputting non-high frequency audio data can be configured for use with the ultrasound device.

Fig. 7 is a schematic diagram of a 4.0 channel of an ultrasonic device according to an embodiment of the present application. Referring to fig. 7, the number of azimuth information carried by the target sound source is 4, and the number of sounding modules of the ultrasonic device is 4, which can be set to 2:1:1:2, dividing the ultrasonic apparatus into a left channel, a right channel, a front channel and a rear channel. Wherein the left and right channels are of a first type and are surround channels; the front channel and the rear channel are of a second type and are non-surround channels.

Because the front sound channel and the rear sound channel are of the first type, first reference data can be determined based on the first position relation, and sound production angles corresponding to the sound production modules of the front sound channel and the sound production modules of the rear sound channel respectively are determined based on the first reference data. The process is the same as the method for determining the sounding angles corresponding to the sounding modules of the left channel and the sounding modules of the right channel based on the first reference data described in the case 1 and the case 2, and is not repeated here.

Because the left sound channel and the right sound channel are the second type sound channel, second parameter data which can be determined based on the second position relation can be used for determining sound production angles corresponding to the sound production modules of the left sound channel and the right sound channel respectively based on the second reference data. The procedure is the same as the method for determining the sounding angles corresponding to the sounding modules of the left surround channel and the sounding modules of the right surround channel based on the second reference data described in case 4, and will not be repeated here.

Fig. 8 is a schematic diagram of a sound wave transmission direction of virtual surround sound formed by another ultrasonic device according to an embodiment of the present application. Referring to fig. 8, for the integrated ultrasonic device in fig. 7, the sounding module controlling the left channel propagates the audio data corresponding to the target sound source along the corresponding sounding angle, propagates to the wall on the left side of the listening area, and is reflected by the wall to form left sound; the sound production module controlling the right sound channel propagates the audio data corresponding to the target sound source along the corresponding sound production angle, propagates to the wall on the right side of the listening area, and is reflected by the wall to form right sound; the sound generating module controlling the front sound channel transmits the audio data corresponding to the target sound source along the corresponding sound generating angle, and in fig. 7, the audio data is transmitted along the front of the listener and received by the listener; the sound generating module for controlling the back sound channel transmits the audio data corresponding to the target sound source along the corresponding sound generating angle, and in fig. 7, the audio data is transmitted along the direction opposite to the transmission direction corresponding to the front sound channel, and is transmitted to the back wall of the listening device, and is reflected by the wall to form back sound.

When the sound wave array is transmitted to the wall of the space where the ultrasonic equipment is located, the wall can reflect the sound wave array back to the space where the ultrasonic equipment is located based on strong reflectivity of the ultrasonic wave, so that a target receiving object in the space can feel sound information from multiple directions, and good virtual surround listening experience is presented for the target receiving object.

It should be noted that, in this scheme, besides the integrated ultrasonic device, a separate ultrasonic device may be used, and both the integrated ultrasonic device and the separate ultrasonic device may use the control method disclosed in this application to present virtual surround sound.

Firstly, spatial modeling is carried out on a spatial environment where the sound generating device is located, such as a conference room or a video-audio room, by a method based on laser radar or acoustic detection, and a plurality of target sound wave reflecting structures of the space where the sound generating device is located and the distance between the sound generating device and the target sound wave reflecting structures in the spatial environment are determined.

For example, assume that a sound emitting device is placed in a conference room, and that the target sound wave reflecting structure included in the conference room is a wall in the conference room. After the sound emitting device is placed close to one wall in the conference room, the distance L1 between the wall on the left side of the sound emitting device and the sound emitting device in the conference room and the distance L2 between the wall on the right side of the sound emitting device and the sound emitting device in the conference room can be obtained.

Secondly, positioning data of a target receiving object in a space environment where the sound generating device is located are obtained. For example, the distance L of the target receiving object from the sound emitting device may be determined using a sound feedback technique.

Then, mathematical operations are performed on the modeling data and the positioning data to obtain target parameter data, for example, at least one of an inverse cosine value of a ratio of the distance L to the distance L1 and an inverse cosine value of a ratio of the distance L to the distance L2 is used as target reference data.

And finally, determining respective sounding angles of two or more sounding modules of the sounding device based on the target parameters. It should be noted that, determining the respective sounding angles of two or more sounding modules of the sounding device based on the target parameter may refer to the description in the foregoing embodiments of the present application, which is not repeated herein.

Step 102, controlling the corresponding sounding module of the sounding device to output the corresponding audio data of the target sound source at the corresponding sounding angle.

As can be seen from the foregoing, the target audio source in the present application may include a plurality of audio data, and each audio data may correspond to a plurality of audio channels or may carry different azimuth information.

After determining the sounding angle of the sounding device according to the method in step 101, determining the working parameters of each sounding module of the sounding device based on the parameters of the target audio, namely the information such as the channel number, azimuth information and audio number of the target audio; the operating parameters of the sounding module include, but are not limited to: whether to emit the corresponding audio data, when to emit the corresponding audio data, the sounding power, the sounding mode (directional or omnidirectional), or the sounding frequency (low frequency, high frequency or ultra-high frequency), etc. And controlling the corresponding sounding module to output the audio data corresponding to the target sound source at the corresponding sounding angle according to the working parameters.

For the ultrasonic equipment, the audio data of each sounding module in the ultrasonic equipment can be transmitted along the corresponding sounding angle through the phased array principle. Since phased array principles are a relatively mature technology, nothing in this application will be described in too much detail.

For the speaker device, the audio data of each sounding module in the speaker device can be transmitted along the corresponding sounding angle through algorithms such as sound pressure matching, acoustic energy contrast control and the like. Since algorithms such as acoustic pressure matching and acoustic energy contrast control are mature techniques, much description is not made here.

In an alternative implementation manner, the control method of the present application further includes:

and the monitoring target receives the motion information of the object, adjusts the sounding angle and/or the working parameter of the sounding module corresponding to the sounding device based on the motion information, or controls the sounding device to move based on the motion information.

Specifically, when the change of the relative position relationship between the target receiving object and the sounding device is monitored, the target reference data is re-acquired by using the method mentioned in the previous embodiment of the application based on the latest relative position relationship between the target receiving object and the sounding device, so as to determine the sounding angle of the corresponding sounding module.

Or after the situation that the target receiving object leaves the space where the target sound source is located is monitored, the working state of the sound generating module corresponding to the sound generating device is adjusted, for example, the playing of the corresponding sound source data is stopped.

Or when the current position of the target receiving object is monitored to be too large or too small with the intervals of the sounding modules of the sounding device, controlling the sounding device to move, and adjusting the relative position relation between the sounding modules in the sounding device and the target receiving object.

By the method, the problem that a target receiving object cannot keep good virtual surround listening experience in the moving process is solved.

It should be noted that, for the ultrasonic device in the present application, since the device forms directional sound by nonlinear demodulation in air using ultrasonic waves of different frequencies, and is limited by rayleigh distance limitation, the distance between the user and the system should be greater than 1m; meanwhile, the hearing effect of the ultrasonic equipment is limited by the room size and the maximum output power of the directional sound system, and the difference of the hearing effect has strong subjectivity, so the room size and the system power are not limited in the application, and the setting of another parameter can be adjusted by fixing the system power or the room size in actual application, so that the better hearing effect is realized.

It should be noted that, the sound generating device in the present application may be integrated as a module in a conference system or a computer system, and used as an external audio output device to implement an integrated spatial virtual surround sound effect.

It should be noted that, the sound source is not limited in the present application, and the present application is only used as a current standard sound source or a game scene set by a user, such as a four-way surround sound system. Therefore, the audio source is not recoded and parsed in this application, and is used only as an output device.

The ultrasonic device has the advantages that: the hardware system is simplified, and the hardware cost of multi-channel arrangement is saved; the sound field can be automatically adjusted and regulated according to the played content and the user position, and the listening experience of the user is improved.

Specifically, before the sounding device starts to work, the target receiving object performs parameter configuration on the sounding device according to the self-listening preference, and then configures a sounding module of the sounding device and a sounding angle corresponding to the sounding module according to target configuration operation and audio parameters of the target receiving object.

Based on the control method provided in the foregoing embodiment, the present application further provides a control device. Fig. 9 is a schematic structural diagram of a control device according to an embodiment of the present application. As shown in fig. 9, the control device 900 includes:

the sound emission angle determining module 901 is configured to determine a sound emission angle of the sound emission device based on an audio parameter of a target sound source;

an audio output module 902, configured to control a corresponding sound emitting module of the sound emitting device to output corresponding audio data of the target sound source at a corresponding sound emitting angle;

In an alternative implementation, the sound emission angle determining module 901 includes:

the first sounding angle determining sub-module is used for determining respective sounding angles of at least two sounding modules of the sounding device based on the sound channel parameters of the target sound source;

the second sounding angle determining sub-module is used for determining respective sounding angles of at least two sounding modules of the sounding device based on azimuth information carried by the target sound source;

and the third sounding angle determining sub-module is used for obtaining the environmental parameters of the space environment where the sounding device is positioned and determining the sounding angles of at least two sounding modules of the sounding device based on the environmental parameters and the audio parameters of the target sound source.

In an alternative implementation, the first sound angle determination submodule includes:

a sound source data acquisition unit, configured to determine the number of channels and/or the type of channels of the target sound source;

and the first sounding angle determining unit is used for determining the sounding angles of the at least two sounding modules respectively according to the number of the sound channels and/or the type of the sound channels and determined target reference data, and the target reference data is determined according to a first position relation between the sounding device and a target receiving object and/or a second position relation between the sounding device and a target sound wave reflecting structure.

In an alternative implementation, the first sound emission angle determining unit includes:

a first sounding angle determining subunit, configured to determine, if the number of channels is not greater than a first threshold, respective sounding angles of sounding modules corresponding to the number of channels with first reference data, where the first reference data is determined based at least on the first positional relationship;

a second sounding angle determining subunit, configured to determine, if the number of channels is not less than a first threshold and the target audio source has a first channel type, respective sounding angles of sounding modules corresponding to the number of channels with first reference data and second reference data, where the first reference data is determined based at least on the first positional relationship and the second reference data is determined based on the second positional relationship;

A third sounding angle determining subunit, configured to determine, if the target sound source has a first channel type, respective sounding angles of sounding modules corresponding to the number of channels with first reference data and second reference data, where the first reference data is determined based on at least the first positional relationship, and the second reference data is determined based on the second positional relationship;

and the fourth sounding angle determining subunit is used for determining the sounding angles of the sounding modules corresponding to the number of the sound channels according to first reference data if the target sound source has the second sound channel type, and the first reference data is determined at least based on the first position relation.

In an alternative implementation, the second sound emission angle determination submodule includes:

a fifth sounding angle determining subunit, configured to determine the number of azimuth information carried by the target sound source, and determine, based on the azimuth information and the number thereof, respective sounding angles of the at least two sounding modules with determined target reference data;

In an alternative implementation, the third sound emission angle determination submodule includes:

the environment modeling unit is used for obtaining modeling data of a space environment where the sound generating equipment is located, wherein the modeling data comprises distance data between the sound generating equipment and a target sound wave reflecting structure in the space environment;

a positioning data acquisition unit, configured to acquire positioning data of a target receiving object in the spatial environment;

and the sixth sounding angle determining subunit is used for determining respective sounding angles of at least two sounding modules of the sounding device based on the modeling data and/or the positioning data.

In an alternative implementation, the audio output module 902 includes:

the working parameter determining unit is used for determining working parameters of each sounding module of the sounding device based on the audio parameters of the target sound source;

and the sounding control unit is used for controlling the corresponding sounding module to output the corresponding audio data of the target sound source at the corresponding sounding angle based on the working parameters.

In an alternative implementation, the control device 900 further includes:

the motion information collection module is used for monitoring motion information of a target receiving object, adjusting a sounding angle and/or a working parameter of a corresponding sounding module of the sounding device based on the motion information, or controlling the sounding device to move based on the motion information;

The target configuration operation module is used for obtaining target configuration operation of a target receiving object, and configuring a corresponding sounding module and a sounding angle thereof based on the target configuration operation and the audio parameters.

Based on the control method and the device provided by the foregoing embodiments, correspondingly, the present application further provides a sound generating device. Fig. 10 is a schematic structural diagram of a sound generating device according to an embodiment of the present application. The sound generating apparatus includes:

a memory 1001 on which a computer program is stored;

a processor 1002 for executing the computer program in the memory to perform the following operations:

Of course, the sound emitting device may also have more or fewer components than in fig. 10, without limitation.

It should be noted that, in the present specification, each embodiment is described in a progressive manner, and identical and similar parts of each embodiment are all referred to each other, and each embodiment is mainly described in a different point from other embodiments. In particular, for the apparatus and device embodiments, since they are substantially similar to the method embodiments, the description is relatively simple, and reference is made to the description of the method embodiments for relevant points. The apparatus and device embodiments described above are merely illustrative, wherein elements illustrated as separate elements may or may not be physically separate, and elements presented as elements may or may not be physical elements, may be located in one place, or may be distributed over a plurality of network elements. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of this embodiment. Those of ordinary skill in the art will understand and implement the present invention without undue burden.

The foregoing is merely one specific embodiment of the present application, but the protection scope of the present application is not limited thereto, and any changes or substitutions that can be easily conceived by those skilled in the art within the technical scope of the present application should be covered in the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims

1. A control method, comprising:

2. The method of claim 1, the determining a sound emission angle of the sound emission device based on the audio parameters of the target sound source, comprising at least one of:

3. The method of claim 2, wherein determining the respective voicing angle of the at least two voicing modules of the voicing device based on the vocal tract parameters of the target sound source comprises:

4. The method of claim 3, wherein determining the respective voicing angle of the at least two voicing modules with the determined target reference data based on the number of channels and/or the channel type comprises at least one of:

5. The method of claim 2, wherein determining the respective voicing angle of the at least two voicing modules of the voicing device based on the azimuth information carried by the target audio source comprises:

6. The method of claim 2, wherein determining the respective voicing angle of at least two voicing modules of a voicing device based on the environmental parameter and an audio parameter of a target sound source comprises:

7. The method of claim 1, wherein controlling the corresponding sound emitting module of the sound emitting device to output the corresponding audio data of the target sound source at the corresponding sound emitting angle comprises:

8. The method of claim 1, further comprising at least one of:

9. A control apparatus comprising:

10. A sound emitting device comprising: the sound generating device comprises a plurality of sound generating modules, a memory and a processor which are connected in a communication way; wherein,

the memory has a computer program stored thereon;