WO2022206228A1

WO2022206228A1 - Sound pickup device and microphone array structure

Info

Publication number: WO2022206228A1
Application number: PCT/CN2022/077741
Authority: WO
Inventors: 黄伟隆; 冯津伟; 李威
Original assignee: 阿里巴巴（中国）有限公司
Priority date: 2021-03-31
Filing date: 2022-02-24
Publication date: 2022-10-06
Also published as: CN113301476A; CN113301476B

Abstract

Disclosed are a sound pickup device and a microphone array structure. The sound pickup device comprises at least three groups of linear microphone arrays disposed in different axial directions. Each group of linear microphone arrays comprises at least two microphones, and the axial directions are used for representing arrangement directions that are formed by the positions of each microphone in the linear microphone arrays. The at least three groups of linear microphone arrays are used for forming a plurality of wave beams, each wave beam indicating one sound pickup area. The plurality of wave beams each comprise a first wave beam formed on the basis of one group of linear microphone arrays and a second wave beam formed on the basis of two groups of linear microphone arrays. Therefore, overlaying of the sound pickup areas indicated by the plurality of wave beams provided by the sound pickup device can meet sound pickup requirements of a wide range of scenario areas. In addition, the entire structure of the sound pickup device is compact, and in practical applications, the sound pickup device can be fixedly mounted in one position (for example, the top part of a building) without needing to provide a sound pickup device in a plurality of different positions.

Description

Pickup equipment and microphone array structure

technical field

The present disclosure relates to the field of signal processing, and in particular, to a sound pickup device and a microphone array structure.

Background technique

How to pick up sound in a large-scale scene area is a technical problem that needs to be solved urgently.

In the industry, it is mainly through arranging multiple microphones in different positions to achieve sound pickup in a wide range of scene areas. This solution makes the structure of the pickup device not compact, and it is more troublesome to arrange.

Therefore, it is necessary to design a more compact pickup device for a wide range of sound pickup scenarios.

SUMMARY OF THE INVENTION

A technical problem to be solved by the present disclosure is to provide a sound pickup device with a more compact structure for a wide range of sound pickup scenarios.

According to a first aspect of the present disclosure, a sound pickup device is provided, comprising: at least three groups of linear microphone arrays arranged along different axial directions, each group of linear microphone arrays includes at least two microphones, and the axial direction is used to characterize the linear microphones the arrangement direction formed by the position of each microphone in the array, at least three groups of linear microphone arrays are used to form multiple beams, each beam indicates a sound pickup area, and the multiple beams include a first beam formed based on a group of linear microphone arrays, and a second beam formed based on two sets of linear microphone arrays.

According to a second aspect of the present disclosure, a microphone array structure is provided, comprising: at least three groups of linear microphone arrays arranged along different axial directions, each group of linear microphone arrays includes at least two microphones, and the axial direction is used to characterize the linear microphones The arrangement direction formed by the position of each microphone in the array, at least three groups of linear microphone arrays are configured to form a plurality of beams, each beam indicates a pickup area, and the plurality of beams include a first beam formed based on a group of linear microphone arrays , and a second beam formed based on two sets of linear microphone arrays.

According to a third aspect of the present disclosure, a method for designing a sound pickup device is provided, including: determining the number of linear microphone arrays and the number of linear microphone arrays used to pick up sound in the sound pickup area by analyzing the sound pickup area The microphone array is used to form multiple beams, and the multiple beams include a first beam formed based on a set of linear microphone arrays and a second beam formed based on two sets of linear microphone arrays; the positions of the number of linear microphone arrays are determined based on the multiple beams relationship so that the number of linear microphone arrays can form multiple beams.

According to a fourth aspect of the present disclosure, a method for debugging a sound pickup device is provided, wherein the sound pickup device includes at least three groups of linear microphone arrays arranged along different axes, and each group of linear microphone arrays includes at least two Microphone, the axial direction is used to characterize the arrangement direction of the microphones in the linear microphone array and/or the pickup direction of the microphones, the at least three groups of linear microphone arrays are used to form a plurality of beams, each beam indicates a pickup area, the The plurality of beams includes a first beam formed based on one set of linear microphone arrays, and a second beam formed based on two sets of linear microphone arrays, the method comprising: adjusting the at least three sets based on fluctuating requirements for the plurality of beams The positional relationship of the linear microphone arrays is such that the adjusted at least three groups of linear microphone arrays can form beams that meet the changing requirements.

According to a fifth aspect of the present disclosure, there is provided a method for assembling a sound pickup device, comprising: based on a predetermined positional relationship that needs to be satisfied when at least three groups of linear microphone arrays form multiple beams, arranging the At least three groups of linear microphone arrays, each group of linear microphone arrays includes at least two microphones, and the axial direction is used to characterize the arrangement direction of the microphones in the linear microphone array and/or the pickup direction of the microphones, and the plurality of beams include a set of linear microphone arrays. A first beam formed by a microphone array, and a second beam formed based on two sets of linear microphone arrays.

According to a sixth aspect of the present disclosure, there is provided a building, comprising: the sound pickup device mentioned in the first aspect of the present disclosure, wherein a sound pickup area indicated by a plurality of beams formed by the sound pickup device covers the At least part of a space area within a building.

According to a seventh aspect of the present disclosure, there is provided a vehicle, comprising: the sound pickup device mentioned in the first aspect of the present disclosure, wherein a sound pickup area indicated by a plurality of beams formed by the sound pickup device covers the vehicle The area where at least some of the personnel are located.

According to an eighth aspect of the present disclosure, there is provided a suspended ceiling, comprising: the sound pickup device mentioned in the first aspect of the present disclosure, wherein a sound pickup area indicated by a plurality of beams formed by the sound pickup device covers a building At least part of the space area.

Therefore, the present disclosure can provide not only one or more first beams formed based on a single group of linear microphone arrays, but also one or more second beams formed based on two groups of linear microphone arrays by using multiple groups of linear microphone arrays , so it can meet the sound pickup requirements of a wide range of scene areas. Moreover, the overall structure is compact, and in practical applications, multiple groups of linear microphone arrays can be installed in a fixed position (eg, on the top of a building) without being distributed in multiple different positions.

Description of drawings

The above and other objects, features and advantages of the present disclosure will become more apparent from the more detailed description of the exemplary embodiments of the present disclosure taken in conjunction with the accompanying drawings, wherein the same reference numerals generally refer to the exemplary embodiments of the present disclosure. same parts.

FIG. 1 shows a schematic structural diagram of a sound pickup device according to an embodiment of the present disclosure.

FIG. 2 shows a schematic structural diagram of a group of linear microphone arrays and a first beam formed by the group of linear microphone arrays.

FIG. 3 shows a schematic diagram of a second beam formed based on two sets of linear microphone arrays.

FIG. 4 shows a schematic diagram of a topology structure of a microphone array of a sound pickup device according to an embodiment of the present disclosure.

FIG. 5 shows a schematic diagram of the spatial structure of the microphone array topology shown in FIG. 2 .

FIG. 6 shows a schematic diagram of the projection of the microphone array topology on a vertical plane.

Figure 7 shows a schematic diagram of the beams in the vertical plane of the microphone array topology.

Figure 8 shows a schematic diagram of the beam on the horizontal plane of the microphone array topology.

FIG. 9 shows a schematic diagram of the directions of beams formed by two sets of linear microphone arrays corresponding to the second body diagonal combination.

FIG. 10 shows a schematic diagram of a microphone array structure according to an embodiment of the present disclosure.

Detailed ways

Preferred embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While preferred embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited by the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art.

The pickup device 100 includes at least three sets of linear microphone arrays. As shown in FIG. 1 , the sound pickup device 100 may include m groups of linear microphone arrays, that is, linear microphone array 1 , linear microphone array 2 . . . linear microphone array m. Among them, m is a positive integer greater than or equal to 3.

Each set of linear microphone arrays includes at least two microphones. A linear microphone array, also known as a one-dimensional microphone array, refers to a microphone array in which the centers of the array elements are located on the same straight line.

The microphones in the linear microphone array may be directional microphones, and the directional microphones may be, but not limited to, any of omnidirectional, cardioid, supercardioid, and figure-8.

The at least three groups of linear microphone arrays included in the sound pickup device 100 are arranged along different axes. The axial direction is used to characterize the arrangement direction formed by the positions of the individual microphones in the linear microphone array.

The at least three sets of linear microphone arrays are used to form a plurality of beams, each beam indicating a pickup area. The plurality of beams includes a first beam formed based on one set of linear microphone arrays, and a second beam formed based on two sets of linear microphone arrays.

The number of first beams may be equal to the number of groups of the linear microphone array. That is, each group of linear microphone arrays can be used to form one first beam.

By comprehensively processing the pickup signals of all (or some) microphones in a group of linear microphone arrays, the group of linear microphone arrays can be combined into a strong directional microphone that meets the requirements, forming a directional characteristic called a beam, That is, the first beam. The beam forming mechanism is a mature technology in the art, and will not be repeated here.

The direction of the beam is also the pickup direction, and the area covered by the pickup direction is the pickup area. The direction of the first beam may be consistent with or substantially the same as the axial direction of the linear microphone array corresponding to the first beam. That is, each group of linear microphone arrays can be used to form beams that are coinciding or substantially coinciding with the axial direction of the linear microphone array to pick up sound in an area indicated by the axial direction.

As shown in Figure 2, a group of linear microphone arrays can be composed of four microphones. The centers of the array elements of the four microphones are on a straight line, and the direction of the straight line is the arrangement formed by the positions of the microphones in the linear microphone array. direction, that is, the axial direction of the linear microphone array.

The sound pickup directions of the microphones in the linear microphone array may be the same, and all are consistent with the axial direction of the linear microphone array. The first beam formed by the linear microphone array is shown as the ellipse in the figure, and the space area that the first beam can cover is the sound pickup area indicated by the first beam.

The number of the second beams may be equal to or less than the number of two combinations of the at least three groups of linear microphone arrays. That is, one or more pairs of linear microphone arrays may be selected from all groups of linear microphone arrays included in the sound pickup device, and each pair of linear microphone arrays may form a second beam. Wherein, each pair of linear microphone arrays includes two groups of linear microphone arrays.

The (part or all) microphones in the two sets of linear microphone arrays can be regarded as a new microphone array, and the new microphone array can be combined to meet the requirements by comprehensive processing of the pickup signals of the microphones in the new microphone array. A strong directional microphone forms a directional characteristic called a beam, that is, a second beam.

As shown in FIG. 3 , two sets of linear microphone arrays arranged in different axial directions can form the second beam shown in the elliptical part in the figure, and the space area that the second beam can cover is the sound pickup area indicated by the second beam.

The second beam may be calculated by using a beamforming algorithm (eg, a beamforming algorithm based on a differential microphone array) for two sets of linear microphone arrays. The calculation principle of the beamforming algorithm (eg, the beamforming algorithm based on the differential microphone array) is not the focus of the present disclosure, and will not be described in detail in the present disclosure.

The at least three sets of linear microphone arrays can be set according to the positional relationship that needs to be satisfied by the two groups of linear microphone arrays corresponding to the second beam when a beamforming algorithm (such as a beamforming algorithm based on a differential microphone array) is used to calculate a second beam that meets the requirements. Microphone array.

That is, the positional relationship of the at least three groups of linear microphone arrays included in the sound pickup device is based on the second beam that meets the requirements when a beamforming algorithm (such as a beamforming algorithm based on a differential microphone array) is used to calculate the second beam. The corresponding two sets of linear microphone arrays need to be set in a positional relationship.

The multiple beams (the first beam and the second beam) mentioned in the present disclosure may be determined at the beginning of the design according to the sound pickup area that the sound pickup device needs to cover in a specific application scenario. For example, multiple beams may be determined according to the sound pickup area to be covered in the application scenario, so that the superposition of the sound pickup area indicated by the multiple beams can cover or basically cover the sound pickup area in the application scenario.

After the multiple beams are determined, the microphone array structure of the sound pickup device can be designed according to the multiple beams, so that the microphone array structure of the sound pickup device can form the multiple beams.

Therefore, the number of linear microphone arrays in the sound pickup device and their positional relationship can be set according to a plurality of predetermined beams.

Specifically, the number of linear microphone arrays and the axial direction of the linear microphone array can be determined according to the number and beam direction of the first beams in the multiple beams. For example, the same number of linear microphone arrays can be set according to the number of the first beams. The axial direction of the group of linear microphone arrays is the same or substantially the same as the direction of the first beam.

The specific positions of the microphones in the linear microphone array may be determined according to the number of the second beams in the multiple beams and the beam directions. For example, for each second beam, the microphones in the two sets of linear microphone arrays that participate in forming the second beam may be obtained by calculating the second beam according to the two sets of linear microphone arrays used to form the second beam using a beamforming algorithm. The positions of the microphones participating in forming the second beam in the two sets of linear microphone arrays are set according to the positional relationship that needs to be satisfied. Therefore, when setting the specific positions of the microphones in each group of linear microphone arrays, it is only necessary to follow the positional relationship that needs to be satisfied by the microphones in the linear microphone array when the beamforming algorithm is used to calculate the second beam.

By using multiple groups of linear microphone arrays, the sound pickup device of the present disclosure can not only provide one or more first beams formed based on a single group of linear microphone arrays, but also provide one or more second beams formed based on two groups of linear microphone arrays. beam.

When the sound pickup device of the present disclosure is used for sound pickup in a large-scale scene area in a building such as classrooms, lecture halls, and large conference rooms, the sound pickup area may refer to a space area in the building, and the sound pickup device provides many The superposition of the pickup areas indicated by the various beams can cover or basically cover the entire space area, so as to meet the sound pickup requirements of a large-scale scene area. Moreover, the overall structure of the pickup device is compact, and in practical applications, the pickup device can be fixedly installed in one position (it can be set close to the top of the building, for example, it can be set on the top of the building in a suspended ceiling or ceiling) without the need for Set up a sound pickup device at a number of different locations.

In addition, the sound pickup device of the present disclosure can also be used in other complex sound pickup scenarios. For example, when a specific area (such as the interior of a vehicle) needs to be picked up, the sound pickup device of the present disclosure can also be used to realize the pickup of a specific area. sound. Specifically, according to a specific area that needs to pick up sound, a beam corresponding to the specific area superimposed by multiple sound pickup areas can be determined, and the microphone array structure of the sound pickup device can be designed accordingly. For the specific design process, refer to the above related description, which will not be repeated here.

With the sound pickup device of the present disclosure, sound pickup can be performed on the sound pickup areas indicated by multiple beams. By processing the pickup signal collected by the pickup device, the pickup results of each pickup area can be obtained. Briefly, for each sound pickup area, the sound pickup result of the sound pickup area can be obtained by processing the sound pickup signals of the microphones in the linear microphone array on which the beam forming of the sound pickup area depends. The specific processing process is a mature technology in the art, and will not be repeated here.

In the following, the microphone array topology of the sound pickup device is exemplarily described by taking the sound pickup device used for pickup of sound in a large-scale scene area as an example.

As shown in FIG. 4 , the microphone array topology of the pickup device can be composed of four groups of linear microphone arrays. The axial directions of the four groups of linear microphone arrays form the body diagonal of the hexahedron, and the axial direction of each group of linear microphone arrays has a predetermined angle with the vertical plane. That is, the four body diagonals shown in FIG. 4 respectively correspond to a group of linear microphone arrays, and the microphones in each group of linear microphone arrays are linearly arranged at different positions on the body diagonal corresponding to the group of linear microphone arrays.

FIG. 5 shows a schematic diagram of the spatial structure of the microphone array topology shown in FIG. 4 .

As shown in FIG. 5 , each linear microphone array may consist of four microphones. Thus, the entire microphone array topology can be a microphone array composed of 16 microphones in 3D space. Wherein, the microphones located at the endpoints of each group of linear microphone arrays may be on a spherical surface. That is, the microphone array topology can form a spherical microphone array. Therefore, the sound pickup device including the microphone array topology can also be designed in the form of a ball microphone, that is, a spherical structure. The axes of different groups of linear microphone arrays can intersect at one point.

The distance between two adjacent microphones in each group of linear microphone arrays may increase sequentially from bottom to top. As shown in FIG. 6 , the distances between two adjacent microphones in the bottom-up four microphones in each group of linear microphone arrays may be 2 cm, 4 cm, and 9 cm, respectively. Also, the included angle between the projections of the axial directions of the two sets of linear microphone arrays (eg, A and C) in diagonal positions on the vertical plane may be 90°.

The microphone array topologies shown in Figures 4 to 6 can form 9 beams.

The 9 beams are: 4 beams formed based on each group of linear microphone arrays (first beam); 4 beams formed based on two groups of linear microphone arrays corresponding to the first body diagonal combination (second beam) ; and a beam (second beam) formed based on two sets of linear microphone arrays corresponding to the second body-diagonal combination.

The first body-diagonal combination refers to two body-diagonals formed by taking the two sides of the upper top surface and the lower bottom surface of the hexahedron as vertices. For example, body diagonal A and body diagonal B, body diagonal B and body diagonal C, body diagonal C and body diagonal D, body diagonal D and The body diagonal A can be regarded as a combination of the first body diagonal.

The second body diagonals are combined into two body diagonals formed with two sides of the side faces of the hexahedron as vertices. For example, the body diagonal A and the body diagonal C, the body diagonal B and the body diagonal D shown in FIG. 2 can all be regarded as a second body diagonal combination.

The four beams formed based on each group of linear microphone arrays and the four beams formed based on two groups of linear microphone arrays corresponding to the first body diagonal combination are all inclined beams with different directions. The included angle between the beams formed based on the two sets of linear microphone arrays corresponding to the second body diagonal combination and the vertically downward direction may be greater than or equal to 0° and less than or equal to the first threshold. The first threshold may be a value slightly larger than 0°, such as 5°.

Optionally, the angle between the beams formed based on the two sets of linear microphone arrays corresponding to the second body diagonal combination and the vertical downward direction may be equal to 0°, that is, based on the second body diagonal combination. The beams formed by the corresponding two sets of linear microphone arrays may be vertically downward beams.

Therefore, when the sound pickup device designed based on the microphone array topology shown in Figure 4 is installed above the space (such as a ceiling or ceiling setting), the superposition of the pickup areas indicated by the nine beams can basically cover the entire 3D space.

The nine beams formed by the above-mentioned microphone array topology can be referred to as shown in FIG. 7 to FIG. 9 .

As shown in FIG. 7 , the beam on the left refers to the beam (the first beam) formed by the linear microphone array corresponding to the body diagonal A in the same direction as the axial direction.

The beam on the right refers to the beam (first beam) formed by the linear microphone array corresponding to the body diagonal C and the direction of which is the same as the axial direction.

The beam in the middle refers to a vertical downward beam (second beam) formed by the linear microphone array corresponding to the body diagonal A and the linear microphone array corresponding to the body diagonal C.

The 8 beams shown in FIG. 8 are respectively: 4 beams formed based on each group of linear microphone arrays; and 4 beams formed based on two groups of linear microphone arrays corresponding to the two first body diagonals.

As shown in FIG. 9 , based on two sets of linear microphone arrays A and C (or B and D), a second beam whose sound pickup direction is substantially vertically downward can be formed.

So far, with reference to FIG. 4 to FIG. 9 , taking the sound pickup device including four groups of linear microphone arrays as an example, the beams that can be formed by the four groups of linear microphone arrays have been exemplarily described.

It should be known that, based on the design principles of the present disclosure, the sound pickup device may further include three groups of linear microphone arrays, five groups of linear microphone arrays, or more groups of linear microphone arrays. Also, other numbers and directions of beams (first beam/second beam) can be formed based on more or less sets of linear microphone arrays.

For example, the sound pickup device may include N groups of linear microphone arrays arranged along different axes, and N is greater than or equal to 3. The multiple beams formed by the N groups of linear microphone arrays may include N first beams formed based on each group of linear microphone arrays, and a plurality of second beams formed based on combinations of different linear microphone arrays. The number and direction of the first beam and the second beam can be set according to the actual range of sound pickup. For example, it can be determined based on the principle that the multiple beams formed by the N groups of linear microphone arrays can cover as large a sound pickup range as possible. first beam, second beam.

The present disclosure also provides a microphone array structure. FIG. 10 shows a schematic diagram of a microphone array structure according to an embodiment of the present disclosure.

The microphone array structure 200 includes at least three sets of linear microphone arrays. As shown in FIG. 10 , the microphone array structure 200 includes m groups of linear microphone arrays, that is, linear microphone array 1 , linear microphone array 2 . . . linear microphone array m. Among them, m is a positive integer greater than or equal to 3.

Each set of linear microphone arrays includes multiple microphones. A linear microphone array, also known as a one-dimensional microphone array, refers to a microphone array in which the centers of the array elements are located on the same straight line.

The at least three groups of linear microphone arrays included in the microphone array structure 200 are arranged along different axes. The axial direction is used to characterize the arrangement direction formed by the positions of the individual microphones in the linear microphone array.

For the position setting manner of the first beam, the second beam, and the linear microphone array, reference may be made to the above related descriptions, which will not be repeated here.

The microphone array structure of the present disclosure can be installed in various devices with a sound pickup function.

The present disclosure also provides a method for designing a sound pickup device, which can design a sound pickup device that can meet actual sound pickup requirements according to an application scenario of the sound pickup device, such as a specific sound pickup range. The design method may include the following steps.

S11. By analyzing the sound pickup area, determine the number of linear microphone arrays used to pick up sound in the sound pickup area and the multiple beams formed by the number of linear microphone arrays.

The pickup area is used to characterize the range that needs to be picked up. It can be an enclosed or semi-enclosed space, such as but not limited to classrooms, conference rooms and other building spaces, and the area where the people (drivers, passengers) in the vehicle are located.

As mentioned above, a single threaded microphone array can not only form the first beam, but also cooperate with other linear microphone arrays to form the second beam. As a result, a larger number of beams can be formed using a smaller number of linear microphone arrays, and different beams can be responsible for different parts of the pickup area. Therefore, by designing a sound pickup device including a plurality of linear microphone arrays, the superposition of the beams formed by the plurality of linear microphone arrays can cover or substantially cover the entire sound pickup area (that is, cover the entire or most of the sound pickup area), that is, Pickup equipment that meets specific pickup needs is available.

Based on the above principles, when designing a sound pickup device for picking up sound in a sound pickup area, you can first determine the number of linear microphone arrays used for sound pickup in the sound pickup area and the number of linear microphone arrays used to form of multiple beams.

Each beam indicates a partial sound pickup area, and the superposition of the partial sound pickup areas indicated by multiple beams may cover the whole or most of the sound pickup area. The plurality of beams includes a first beam formed based on one set of linear microphone arrays and a second beam formed based on two sets of linear microphone arrays. For the first beam and the second beam, reference may be made to the above related descriptions.

As an example, when determining the number of linear microphone arrays used to pick up sound in the pickup area, it is possible to use as few linear microphones as possible while being able to form multiple beams that cover or substantially cover the entire pickup area Arrays are designed to target pickups to keep costs down.

S12. Determine the positional relationship of the number of linear microphone arrays based on the multiple beams, so that the number of linear microphone arrays can form the multiple beams.

After the number of linear microphone arrays and the multiple beams to be formed are determined, the positional relationship of the number of linear microphone arrays may be determined based on the multiple beams.

When determining the positional relationship of the number of linear microphone arrays, a first positional relationship that needs to be satisfied by the linear microphone array used to form the first beam may be determined for the first beam in the plurality of beams; and for the first beam in the plurality of beams For the second beam, a beamforming algorithm based on a differential microphone array is used to obtain a second positional relationship that needs to be satisfied by the two sets of linear microphone arrays corresponding to the second beam when the second beam is formed.

Thus, the number of linear microphone arrays can be set based on the first positional relationship and the second positional relationship. That is, the number of linear microphone arrays is set on the principle that the number of linear microphone arrays can satisfy the first positional relationship and the second positional relationship at the same time.

The present disclosure also provides a debugging method for a sound pickup device. The debugging method can be used to debug the linear microphone array in the pickup device according to specific application scenarios, such as the specific pickup range, after the sound pickup device is designed and installed, so that the debugged linear microphone array can Meet the sound pickup requirements in practical application scenarios.

The pickup device may refer to the pickup device mentioned above. That is, the sound pickup device may include at least three groups of linear microphone arrays arranged along different axial directions, each group of linear microphone arrays includes at least two microphones, and the axial direction is used to characterize the arrangement direction of the microphones in the linear microphone array and/or the pickup of the microphones. sound direction, the at least three groups of linear microphone arrays are used to form a plurality of beams, each beam indicates a sound pickup area, and the plurality of beams include a first beam formed based on one group of linear microphone arrays, and a first beam formed based on two groups of linear microphone arrays The second beam formed by the microphone array.

The design method may include the steps of: adjusting the positional relationship of the at least three groups of linear microphone arrays based on the changing requirements for the plurality of beams, so that the adjusted at least three groups of linear microphone arrays can form a shape that satisfies the Beams with fluctuating needs. Wherein, the change requirement may include a change in the beam pickup direction and/or an increase or decrease in the number of beams.

Taking the change of the pickup direction of the beam as an example, the first positional relationship that needs to be satisfied by the linear microphone array used to form the changed first beam can be determined for the first beam that needs to be changed among the multiple beams; For the second beam that needs to be changed, the beamforming algorithm based on the differential microphone array is used to calculate the second positional relationship that needs to be satisfied by the two sets of linear microphone arrays corresponding to the second beam when the changed second beam is formed; and based on the first positional relationship At least three groups of linear microphone arrays are adjusted in relation to the second position.

The present disclosure also provides an assembly method of the sound pickup device. The assembly method can be used to assemble a pickup device. The assembling method may include the steps of: arranging the at least three groups of linear microphone arrays along different axes based on a predetermined positional relationship that needs to be satisfied when at least three groups of linear microphone arrays form multiple beams, and each group of linear microphone arrays includes at least three groups of linear microphone arrays. Two microphones, the axial direction is used to characterize the arrangement direction of the microphones in the linear microphone array and/or the pickup direction of the microphones, and the plurality of beams include a first beam formed based on a set of linear microphone arrays, and based on two sets of linear microphones The second beam formed by the array. For the determination of the positional relationship, reference may be made to the above related description, which will not be repeated here.

The present disclosure can also be implemented as a building including the above-mentioned sound pickup device, wherein the superposition of sound pickup areas indicated by a plurality of beams formed by the sound pickup device covers at least part of the space area in the building, such as Cover most or all of the space area within a building.

The present disclosure can also be implemented as a vehicle, including the above-mentioned sound pickup device, wherein the superposition of sound pickup areas indicated by multiple beams formed by the sound pickup device covers the area where at least part of the people in the vehicle are located, such as covering The area where most or all of the occupants of the vehicle are located.

The present disclosure can also be implemented as a suspended ceiling, including the above-mentioned sound pickup device, wherein the superposition of sound pickup areas indicated by multiple beams formed by the sound pickup device covers at least part of the space area in the building, such as can cover Most or all of the space within a building.

Various embodiments of the present invention have been described above, and the foregoing descriptions are exemplary, not exhaustive, and not limiting of the disclosed embodiments. Numerous modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described embodiments. The terminology used herein was chosen to best explain the principles of the various embodiments, the practical application or improvement over the technology in the marketplace, or to enable others of ordinary skill in the art to understand the various embodiments disclosed herein.

Claims

A sound pickup device, comprising:

At least three groups of linear microphone arrays arranged along different axial directions, each group of linear microphone arrays includes at least two microphones, and the axial direction is used to represent the arrangement direction formed by the positions of the respective microphones in the linear microphone array,

The at least three sets of linear microphone arrays are used to form a plurality of beams, each beam indicating a pickup area, the plurality of beams include a first beam formed based on one set of linear microphone arrays, and a first beam formed based on two sets of linear microphone arrays the second beam.
The sound pickup device according to claim 1, wherein,

The second beam is calculated by using a beamforming algorithm based on differential microphone arrays for two sets of linear microphone arrays.
The sound pickup device according to claim 2, wherein,

The at least three groups of linear microphone arrays are set according to the positional relationship that needs to be satisfied by the two sets of linear microphone arrays corresponding to the second beam when the second beam that meets the requirements is calculated by using the beamforming algorithm based on the differential microphone array.
The sound pickup device according to claim 1, wherein,

The direction of the first beam is consistent with or substantially the same as the axial direction of the linear microphone array corresponding to the first beam, and/or

The direction of the second beam is different from the axial direction of the linear microphone array corresponding to the second beam.
The sound pickup device according to claim 1, wherein the sound pickup device comprises four groups of linear microphone arrays, the axial directions of the four groups of linear microphone arrays form the body diagonal of the hexahedron, and the axis of each group of linear microphone arrays The direction has a predetermined angle with the vertical plane.
The sound pickup device of claim 5, wherein the plurality of beams comprises:

Four first beams formed based on each group of linear microphone arrays;

Four second beams formed based on two sets of linear microphone arrays corresponding to the first body diagonal combination, where the first body diagonal combination takes the two sides of the upper top surface and the lower bottom surface of the hexahedron as vertices two body diagonals formed; and

A second beam formed based on two sets of linear microphone arrays corresponding to a second body-diagonal combination, the second body-diagonal combination being two body-diagonals formed with two sides in the sides of the hexahedron as vertices Wire.
The sound pickup device according to claim 6, wherein,

The included angle between the direction of the second beam formed based on the two sets of linear microphone arrays corresponding to the two second body diagonals and the vertically downward direction is greater than or equal to 0° and less than or equal to the first threshold.
The sound pickup device according to claim 5, wherein,

The microphones located at the endpoints of each group of linear microphone arrays lie on a spherical surface.
The sound pickup device according to claim 1, wherein the microphone is a directional microphone.
The sound pickup device according to any one of claims 1 to 9, wherein the sound pickup area is a space area in a building, and the sound pickup device is arranged near the top of the building.
A microphone array structure, comprising:

At least three groups of linear microphone arrays arranged along different axial directions, each group of linear microphone arrays includes at least two microphones, and the axial direction is used to represent the arrangement direction formed by the positions of the respective microphones in the linear microphone array,

The at least three sets of linear microphone arrays are configured to form a plurality of beams, each beam indicating a pickup area, the plurality of beams including a first beam formed based on one set of linear microphone arrays, and a first beam formed based on two sets of linear microphone arrays formed second beam.
A design method of a sound pickup device, comprising:

By analyzing the sound pickup area, determine the number of linear microphone arrays used to pick up sound in the sound pickup area and multiple beams formed by the number of linear microphone arrays. The multiple beams include a set of linear microphone arrays. a first beam and a second beam formed based on two sets of linear microphone arrays;

The positional relationship of the plurality of linear microphone arrays is determined based on the plurality of beams, so that the plurality of linear microphone arrays can form the plurality of beams.
The design method according to claim 12, wherein the step of determining the positional relationship of the number of linear microphone arrays based on the plurality of beams comprises:

For a first beam in the plurality of beams, determining a first positional relationship that needs to be satisfied by the linear microphone array used to form the first beam;

For the second beam in the plurality of beams, a beamforming algorithm based on a differential microphone array is used to calculate a second positional relationship that needs to be satisfied by the two sets of linear microphone arrays corresponding to the second beam when the second beam is formed.
A method for debugging a sound pickup device, wherein the sound pickup device includes at least three groups of linear microphone arrays arranged along different axial directions, each group of linear microphone arrays includes at least two microphones, and the axial direction is used to characterize the linear microphone array. The arrangement direction of the microphones and/or the sound pickup direction of the microphones, the at least three groups of linear microphone arrays are used to form a plurality of beams, each beam indicates a sound pickup area, and the plurality of beams include a set of linear microphone arrays. The first beam of the , and the second beam formed based on two sets of linear microphone arrays, the method includes:

Based on the changing requirements for the plurality of beams, the positional relationship of the at least three groups of linear microphone arrays is adjusted, so that the adjusted at least three groups of linear microphone arrays can form beams that meet the changing requirements.
The debugging method according to claim 14, wherein the step of adjusting the positional relationship of the at least three groups of linear microphone arrays based on the changing requirements for the plurality of beams comprises:

For the first beam that needs to be changed among the plurality of beams, determining a first positional relationship that needs to be satisfied by the linear microphone array used to form the changed first beam;

For the second beam that needs to be changed among the plurality of beams, a beamforming algorithm based on a differential microphone array is used to calculate the second positional relationship that needs to be satisfied by the two sets of linear microphone arrays corresponding to the second beam when the changed second beam is formed ;as well as

The at least three sets of linear microphone arrays are adjusted based on the first positional relationship and the second positional relationship.
A method for assembling a sound pickup device, comprising:

Based on a predetermined positional relationship that needs to be satisfied when at least three groups of linear microphone arrays form multiple beams, the at least three groups of linear microphone arrays are arranged along different axial directions, each group of linear microphone arrays includes at least two microphones, and the axial direction is used for Characterize the arrangement direction of the microphones in a linear microphone array and/or the pickup direction of the microphones,

The plurality of beams includes a first beam formed based on one set of linear microphone arrays, and a second beam formed based on two sets of linear microphone arrays.
A building comprising:

The sound pickup device according to any one of claims 1 to 10, wherein the superposition of the sound pickup areas indicated by the plurality of beams formed by the sound pickup device covers at least part of the space area in the building.
A vehicle comprising:

The sound pickup device according to any one of claims 1 to 10, wherein the superposition of the sound pickup areas indicated by the plurality of beams formed by the sound pickup device covers the area where at least part of the people in the vehicle are located.
A suspended ceiling comprising:

The sound pickup device according to any one of claims 1 to 10, wherein the superposition of the sound pickup areas indicated by the plurality of beams formed by the sound pickup device covers at least part of the space area in the building.