CN114994607B - Acoustic imaging method supporting zooming - Google Patents
Acoustic imaging method supporting zooming Download PDFInfo
- Publication number
- CN114994607B CN114994607B CN202210924179.4A CN202210924179A CN114994607B CN 114994607 B CN114994607 B CN 114994607B CN 202210924179 A CN202210924179 A CN 202210924179A CN 114994607 B CN114994607 B CN 114994607B
- Authority
- CN
- China
- Prior art keywords
- sound source
- array
- microphone
- sound
- doa
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S5/00—Position-fixing by co-ordinating two or more direction or position line determinations; Position-fixing by co-ordinating two or more distance determinations
- G01S5/18—Position-fixing by co-ordinating two or more direction or position line determinations; Position-fixing by co-ordinating two or more distance determinations using ultrasonic, sonic, or infrasonic waves
- G01S5/20—Position of source determined by a plurality of spaced direction-finders
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01R—MEASURING ELECTRIC VARIABLES; MEASURING MAGNETIC VARIABLES
- G01R31/00—Arrangements for testing electric properties; Arrangements for locating electric faults; Arrangements for electrical testing characterised by what is being tested not provided for elsewhere
- G01R31/12—Testing dielectric strength or breakdown voltage ; Testing or monitoring effectiveness or level of insulation, e.g. of a cable or of an apparatus, for example using partial discharge measurements; Electrostatic testing
- G01R31/1209—Testing dielectric strength or breakdown voltage ; Testing or monitoring effectiveness or level of insulation, e.g. of a cable or of an apparatus, for example using partial discharge measurements; Electrostatic testing using acoustic measurements
Abstract
An acoustic imaging method supporting zooming belongs to the technical field of acoustic imaging. The method comprises the steps of S01, acquiring sound signals collected by a microphone array in real time; s02, based on the sound signals, carrying out DOA sound source direction positioning in a far-field mode; step S03, according to the direction of a sound source, carrying out linear directional scanning on the sound in the direction of the sound source to obtain a linear focusing array, and determining the distance between the sound source and the center of a microphone array based on the linear focusing array; and S04, obtaining a DOA popular array in a near field mode matched with the distance of the sound source based on the sound source direction positioned in the S02 and the distance between the sound source and the center of the microphone array determined in the S03. The invention can detect and obtain the sound source information under the near field mode algorithm in the far field mode, accurately position the sound source and carry out amplification close-up.
Description
Technical Field
The invention relates to the technical field of acoustic imaging, in particular to an acoustic imaging method supporting zooming.
Background
The existing DOA (Direction of arrival, DOA) acoustic imaging technology uses a popular array with a fixed distance, and uses a closer distance as an array surface of the popular array in order to be able to image effectively; in actual use, after an operator finds a sound source through the acoustic imager, the operator needs to go close to the sound source and then confirm the sound source, because the imaging cloud covers an area when the sound source is far away from the equipment. Particularly, in a scene of detecting partial discharge, an operator cannot approach the high-voltage cable too much, and if the detection is performed by using an imager realized by the existing DOA acoustic imaging technology, the discharge position cannot be accurately positioned.
The invention patent application CN103308889A discloses a passive sound source two-dimensional DOA estimation method under a complex environment, and specifically discloses a method comprising (1) collecting voice signals in a room by using a uniform circular array; (2) Preprocessing a voice signal received by a uniform circular array microphone array by using a spectral subtraction method; (3) Estimating the relative time delay of each microphone by adopting an M _ AEDA algorithm; (4) determining a direction coefficient vector according to a direction coefficient formula; (5) The direction coefficient vector is multiplied by the voice signal after the second step of preprocessing correspondingly to be used as an input signal of the minimum variance undistorted response; (6) Processing the input signal by adopting a minimum variance distortionless response algorithm; (7) And performing spectral peak search on the output average power to obtain an estimated value of the two-dimensional DOA of the sound source. The invention still adopts a popular array with fixed distance, which can solve the problem of accurate positioning of the sound source under the environment of reverberation and low signal-to-noise ratio, but can not solve the problem of accurate positioning of the remote sound source.
The invention patent application CN113030983A discloses a near-field point-by-point focusing DOA method based on a sounding side-scan sonar, and specifically discloses a method comprising S1, transmitting and receiving sound waves by adopting a multi-subarray sonar transducer to obtain sonar receiving data; s2, carrying out digital interpolation and filtering on sonar receiving data to obtain multi-subarray filtering data; s3, forming a wave beam according to the multi-subarray filtering data; and S4, focusing point by point according to the result of beam forming, and carrying out DOA estimation. The method still adopts a popular array with a fixed distance, can realize higher depth sounding precision in a near field range, and cannot solve the problem of precise positioning of a remote sound source.
Disclosure of Invention
The invention aims to solve the problem that the sound source is not accurately positioned when an acoustic imager detects remotely, therefore, the invention provides the acoustic imaging method supporting zooming, the sound source does not need to be confirmed in a mode of being close to the sound source, and the condition that an imaging cloud picture covers an area when the distance between the sound source and equipment is far can be avoided; particularly, the method can be used in special inaccessible scenes such as partial discharge detection scenes, and can accurately position the sound source under the condition that an operator is located at a safe distance.
The invention provides an acoustic imaging method supporting zooming, which comprises the following steps:
step S01, acquiring a sound signal acquired by a microphone array in real time;
s02, based on the sound signals, carrying out DOA sound source direction positioning in a far-field mode;
step S03, according to the direction of a sound source, carrying out linear directional scanning on the sound in the direction of the sound source to obtain a linear focusing array, and determining the distance between the sound source and the center of a microphone array based on the linear focusing array;
and S04, obtaining a DOA popular array in a near field mode matched with the distance of the sound source based on the sound source direction positioned in the S02 and the distance between the sound source and the center of the microphone array determined in the S03.
The invention combines surface acoustic imaging scanning and linear scanning to calculate the direction and distance of the sound source, and generates a popular array matched with the sound source according to the distance of the sound source, thereby greatly improving the signal-to-noise ratio of DOA imaging and accurately positioning the sound source without approaching a detection sound source.
Preferably, the step S02 includes:
step S21, based on the sound signal, obtaining a DOA popular array in a far field mode;
step S22, calculating the cross-power spectrum of each focus point on the DOA popular array in the far-field mode,To the focus positionFrequency ofThe output of the time-of-day,for the sound actually picked up by the microphone array,is a cross power spectrum; and determining the sound source direction in which the focus point with the maximum cross-power spectrum is positioned as the positioned sound source direction.
Preferably, the step S21 is specifically:
step S21.1, assuming N focusing points of the sound source, and calculating the time delay of the sound source of each focusing point to the microphone array,
Wherein the content of the first and second substances,for the delay assumption of the sound source propagation to the mth microphone at the focus point,a vector pointing the focus point to the center position of the microphone array,a vector pointing to the center position of the microphone array for the m-th microphone,a vector from a focusing point to an m-th microphone, and c is a sound propagation speed;
step S21.2, based on the calculated time delay, according to the formulaComputing the output quantity at each focus point, and then forming a popular array,
wherein, the first and the second end of the pipe are connected with each other,to a focus positionFrequency ofThe output of the time-of-day,is the signal received by the m microphone, is acquired by the microphone array,actually collecting signals for the microphone array;
preferably, the step S03 includes:
step S31, assuming N focusing points of the sound source according to the sound source direction positioned in the step S2, and calculating the time delay of the sound source of the focusing point on each array beam to propagate to the microphone array,,
wherein, the first and the second end of the pipe are connected with each other,for the delay assumption of the sound source propagating to the mth microphone at the focus point,a vector pointing the focus point to the center position of the microphone array,the m-th microphone is directed to a vector at the center position of the microphone array,a vector from a focusing point to an m-th microphone, and c is a sound propagation speed;
step S32, based on the calculated time delay, according toCalculating the output quantity at the focus point on each array beam, and then forming a linear focusing array,
wherein the content of the first and second substances,to a focus positionFrequency ofThe output of the time-delay circuit is output,is the signal received by the m-th microphone,actually collecting signals for the microphone;
step S33, determining the distance between the sound source and the center of the microphone array by a distance formula based on the linear focusing array.
Preferably, the focusing points are focusing points which can be evenly distributed in a camera picture, the number of the focusing points is set according to a camera view angle and equipment calculation force, and the position of each focusing point is determined according to the camera view angle and an initial setting distance.
Preferably, the step S04 includes: assuming that the distance between a sound source and the center of a microphone array is smaller than or equal to the distance between a newly generated DOA array and the center of the microphone array in a near-field mode; and obtaining the DOA popular array in the near field mode based on the sound source direction positioned in the step S02 and the distance between the sound source and the center of the microphone array determined in the step S03.
Preferably, the distance of the sound source from the center of the microphone array is equal to the distance of the newly generated DOA array from the center of the microphone array.
Preferably, the method further comprises a step S05 of forming an acoustic cloud based on the DOA prevalence array in the near field mode obtained in the step S04.
Preferably, the method further comprises a step S05',
sending the DOA popular array in the near field mode obtained in the step S04 into a directional sound pickup device, wherein the directional sound pickup device is used for picking up sound source audio; alternatively, the first and second liquid crystal display panels may be,
sending the DOA popular array in the near field mode obtained in the step S04 into a voiceprint recognition device, wherein the voiceprint recognition device is used for recognizing voice data to determine the identity of a user; alternatively, the first and second electrodes may be,
and (4) sending the DOA popular array in the near field mode obtained in the step (S04) into a camera device, zooming and magnifying the image of the appointed area according to the position of the sound source so as to magnify and close up the sound source.
Preferably, the method is applied to an imager.
The invention has the following beneficial effects:
the invention relates to an acoustic imaging method supporting zooming, which is characterized in that surface acoustic imaging scanning and linear scanning are combined to calculate the direction and the distance of a sound source, a DOA popular array obtained in a far-field mode is converted, and based on a near-field mode algorithm, the DOA popular array in a near-field mode can be obtained without being close to the sound source, namely, the sound source is accurately positioned without being close to the sound source; particularly, when dangerous scenes such as partial discharge and the like are detected, the method can ensure that an operator is positioned at a safe distance to accurately detect the sound source. In addition, the sound source information identified by the method can be sent to a directional sound pickup device, a voiceprint identification device or a camera device to achieve other application purposes, such as increasing the accurate pickup characteristic of a target sound source, providing a target audio with high signal-to-noise ratio for voiceprint identification, and controlling the camera device to zoom and amplify an image of a designated area so as to close up the sound source.
Drawings
FIG. 1 is a flow chart of a method of acoustic imaging supporting zoom of the present invention;
fig. 2 is an example of a cloud image of an implementation process of an acoustic imaging method supporting zoom according to the present invention.
Detailed Description
The following are specific embodiments of the present invention and are further described with reference to the drawings, but the present invention is not limited to these embodiments.
Referring to fig. 1, an acoustic imaging method supporting zooming of the present invention includes:
step S01, acquiring a sound signal acquired by a microphone array in real time;
s02, based on the sound signals, carrying out DOA sound source direction positioning in a far field mode;
step S03, according to the direction of a sound source, carrying out linear directional scanning on the sound in the direction of the sound source to obtain a linear focusing array, and determining the distance between the sound source and the center of a microphone array based on the linear focusing array;
and S04, obtaining a DOA popular array in a near field mode matched with the distance of the sound source based on the sound source direction positioned in the step S02 and the distance between the sound source and the center of the microphone array determined in the step S03.
The method is used for processing and analyzing the acquired sound signals, and is applied to sound signal processing equipment such as an imager and the like. When a microphone array (for example, a 128-path microphone array) is used to collect sound signals in the environment in step S01, the collected sound signals are sent to the imager for processing.
Far field pattern refers to a sound source position outside the scanned scene, that is, the distance of the sound source from the center of the microphone array is greater than the distance of the DOA epidemic array (the DOA epidemic array obtained in far field pattern) from the center of the microphone array (see fig. 2). The near-field mode refers to a sound source position inside a scanning scene, that is, a distance of the sound source from the center of the microphone array is equal to or less than a distance of a DOA popular array (DOA popular array obtained in the near-field mode) from the center of the microphone array (see fig. 2).
In the prior art, an operator detects a detection device in a mode of approaching the detection device to a detection sound source, namely, the device is in a near field mode, a DOA popular array at the moment is only a DOA popular array in the near field mode, a fixed distance is adopted, and the detection mode cannot be suitable for other dangerous detection environments such as partial discharge detection and the like; or, the operator positions the detection device at a far position to detect the sound source, that is, the device is in a far-field mode, and the popular array of DOAs at this time is only the popular array of DOAs in the far-field mode, and the detection accuracy is not high due to the fixed distance, and the operator needs to approach the device to further confirm the position of the detection sound source.
In view of the above problems, the present invention processes a sound signal in a far-field mode by placing a sound signal processing device such as an imager at a far end; based on the sound source direction of the surface acoustic imaging scanning positioning in the far field mode and the distance between the sound source determined by the linear scanning and the center of the microphone array, the DOA popular array in the near field mode is obtained through conversion (at this time, sound signal processing equipment such as an imager does not need to be moved to the inside of a scanning scene, but the DOA popular array is updated through an algorithm, so that the detection effect of the prior art when the sound signal processing equipment such as the imager is moved to the inside of the scanning scene is achieved). According to the invention, the actual detection distance is not changed, and the update (namely zooming) of the DOA popular array is realized through an algorithm, so that the popular array with a fixed distance is not used in the acoustic imaging process, and a sound source can be accurately detected; the problem that the short-distance detection cannot be carried out under the dangerous detection environment is particularly solved.
The step S02 includes:
step S21, based on the sound signal, obtaining a DOA popular array in a far-field mode; specifically, the step S21 includes,
step S21.1, assuming N focusing points of the sound source, and calculating the time delay of the sound source of each focusing point to the microphone arrayWherein, in the process,for the delay assumption of the sound source propagation to the mth microphone at the focus point,a vector pointing the focus point to the center position of the microphone array,for the m microphoneThe vector of the central position of the wind-control array,taking the vector from a focusing point to the mth microphone, and taking the propagation speed of sound as c, wherein the propagation speed of sound is 340m/s;
the focusing points are the focusing points which can be evenly distributed in a camera picture, the number of the focusing points is set according to the camera view angle and the equipment calculation force, and the position of each focusing point is determined according to the camera view angle and the initial setting distance. For example, it is general to select a camera resolution length/width of 1/10, such as a camera resolution 640 × 480, where N = 64 × 48 (i.e. 64 rows and 48 columns of focusing points are evenly distributed on the camera screen, and the position of each focusing point may be calculated with a camera view angle and an initial set distance (the camera view angle is a parameter of the camera itself, and the initial distance is a distance from the focusing point to the center of the microphone array, and is generally 1 m)).
Step S21.2, based on the calculated time delay, according to the formulaComputing the output quantity at each focus point, and then forming a popular array,
wherein the content of the first and second substances,to a focus positionFrequency ofThe output of the time-of-day,is the signal received by the m microphone, is acquired by the microphone array,the signals are actually collected for the microphone array.
Step S22, calculating the cross-power spectrum of each focus point on the DOA popular array in the far-field mode,To a focus positionFrequency ofThe output of the time-of-day,for the sound actually picked up by the microphone array,is a cross power spectrum; and determining the sound source direction of the focus point with the maximum cross power spectrum as the positioned sound source direction. Wherein the content of the first and second substances,for the angular frequency of the sound, it is set as desired, for example, the target sound source frequency is concentrated between 10KHz and 20KHz, then the frequency bandwidth of 10KHz to 20KHz is selected, the frequency resolution is 100Hz, then w = [10000, 10100, 10200., 20000]。
The calculation of the cross-power spectrum of each focusing point is realized by using a cross-power spectrum method, and the phase difference of two signals under any frequency can be obtained by conjugating the product of the frequency spectrums of the two signals. After calculating the cross-power spectrums of all the focusing points in step S22, the focusing point with the largest cross-power spectrum is called a "main lobe", and the sound source direction is determined according to the sound source coordinates (including the spatial angle between the sound source and the microphone array) of the focusing point.
After determining the sound source direction, step S03 performs a linear directional scan of the actual scene in the sound source direction. The scanning process can be carried out by an operator to hold the imager to rotate towards the direction, or the rotating platform receives an instruction to rotate the sound signal processing equipment to the sound source direction to carry out linear directional scanning. Alternatively, after the sound source direction is determined, step S03 does not perform scanning of the actual scene, but directly forms a focal point in the sound source direction in the signal processing device, and proceeds to the distance calculation process of step S03.
The step S03 performs linear directional scanning on the sound source, the scanning principle of which is similar to that of DOA scanning, and the difference is that DOA scanning is performed on the planar popular arrays one by one, and linear directional scanning is mainly performed on array beams in one direction. For this purpose, the step S03 includes:
step S31, assuming N focusing points of the sound source according to the sound source direction positioned in the step S2, and calculating the time delay of the sound source of the focusing point on each array beam to propagate to the microphone array,wherein, in the step (A),for the delay assumption of the sound source propagating to the mth microphone at the focus point,a vector pointing the focus point to the center position of the microphone array,a vector pointing to the center position of the microphone array for the m-th microphone,a vector from a focusing point to an m-th microphone, and c is a sound propagation speed;
the focusing points are the focusing points which can be evenly distributed in a camera picture, the number of the focusing points is set according to the camera view angle and the equipment calculation force, and the position of each focusing point is determined according to the camera view angle and the initial setting distance. For example, it is general to select a camera resolution length/width of 1/10, such as a camera resolution 640 × 480, where N = 64 × 48 (i.e. 64 rows and 48 columns of focusing points are evenly distributed on the camera screen, and the position of each focusing point may be calculated with a camera view angle and an initial set distance (the camera view angle is a parameter of the camera itself, the initial distance is a distance from the focusing point to the center of the microphone array, and the initial distance is generally 1 m)).
Although the two steps are implemented by the same formula method in the process of calculating the focus point and the time delay, step S31 and step S21.1 are different according to different scanning modes, and step S31 scans according to the specific sound source direction after positioning in step S2, so that the assumed focus points (including the number of focus points and the position of the focus point) in the two steps are different, and the calculated time delay is also different.
Step S32, based on the calculated time delay, according toThe output at the focal point on each array beam is calculated, which in turn forms a linear focusing array, wherein,to a focus positionFrequency ofThe output of the time-delay circuit is output,is the signal received by the m-th microphone,actually collecting signals for the microphone array; wherein, the first and the second end of the pipe are connected with each other,for the angular frequency of the sound, set as desired, e.g. with a target sound source frequency centred at 10KHz to 20KBetween Hz, a frequency bandwidth of 10KHz to 20KHz is then selected, the frequency resolution is 100Hz, and w = [10000, 10100,10200]. The focusing precision of the linear focusing array is 2cm (the wavelength of ultrasonic waves above 20KHz is less than 2 cm).
Step S33, determining the distance between the sound source and the center of the microphone array by a distance formula based on the linear focusing array.
Based on the sound source coordinates (x, y, z) of the focusing point, the distance between the sound source and the center of the microphone array can be calculated by using a distance formula between the coordinates.
The step S04 includes: assuming that the distance between a sound source and the center of a microphone array is smaller than or equal to the distance between a newly generated DOA array and the center of the microphone array in a near-field mode; and obtaining the DOA popular array in the near field mode based on the sound source direction positioned in the step S02 and the distance between the sound source and the center of the microphone array determined in the step S03. Preferentially, when the DOA algorithm is in a near-field mode and the distance from a sound source to the center of the microphone array is equal to the distance from a popular array to the center of the microphone array, the time delay calculated by a focusing point is consistent with the actual time delay of the actual sound transmitted to the microphone array, and the signal-to-noise ratio of the calculated cross-power spectrum is the largest. In the calculation process, the center of the microphone array can be designed as a spherical center point.
Taking fig. 2 as an example to illustrate, when scanning is performed in a far-field mode (the distance from a sound source to the center of a microphone array is greater than the distance from a popular array to the center of the microphone array), a DOA popular array is formed by using the microphone array as a spherical center point, and the field angle is larger at this time; after the sound source direction is determined, linear scanning is carried out, the distance between the sound source and the center of the microphone array is calculated, the distance is used as a radius to construct a spherical surface, and a new popular array is determined by combining the sound source direction. In the process, the coordinates of the focus point (x, y, z) are converted into coordinates in a spherical coordinate system. Therefore, the original popular array with a large field angle and a short distance is switched to the popular array with a small field angle and the distance matched with the distance of the sound source, so that the signal to noise ratio of the DOA imaging is greatly improved.
The method further comprises a step S05 of forming an acoustic cloud map (as shown in FIG. 2) based on the DOA popular array in the near-field mode obtained in the step S04.
The method of the invention further comprises a step S05', which is specifically as follows:
sending the DOA popular array in the near field mode obtained in the step S04 into a directional sound pickup device, wherein the directional sound pickup device is used for picking up sound source audio; the directivity pickup device can increase the resolving power to different sound sources in the same direction and accurately pick up the audio of the sound source instead of picking up all the sound in the single direction. Alternatively, the first and second liquid crystal display panels may be,
sending the DOA popular array in the near field mode obtained in the step S04 to a voiceprint recognition device, wherein the voiceprint recognition device is used for recognizing voice data to determine the identity of a user; the voiceprint recognition device can obtain a voiceprint recognition input signal with a higher signal-to-noise ratio, and is favorable for accurately recognizing the identity of a user according to voice data. Alternatively, the first and second liquid crystal display panels may be,
and (4) sending the DOA popular array in the near field mode obtained in the step (S04) into a camera device, zooming and magnifying the image of the appointed area according to the position of the sound source so as to magnify and close up the sound source.
It will be appreciated by persons skilled in the art that the embodiments of the invention described above and shown in the drawings are given by way of example only and are not limiting of the invention. The objects of the present invention have been fully and effectively accomplished. The functional and structural principles of the present invention have been shown and described in the embodiments, and any variations or modifications may be made to the embodiments of the present invention without departing from the principles described.
Claims (8)
1. A method of acoustic imaging supporting zoom, comprising:
step S01, acquiring a sound signal acquired by a microphone array in real time;
s02, based on the sound signals, carrying out DOA sound source direction positioning in a far field mode; the step S02 includes:
step S21, obtaining a DOA manifold array in a far field mode based on the sound signal;
step S22, calculating the cross-power spectrum of each focus point on the DOA manifold array in the far-field mode,Vector pointing focus point to center position of microphone arrayFrequency ofThe output of the time-of-day,for the sound actually picked up by the microphone array,is a cross power spectrum; determining the sound source direction of the focus point with the maximum cross power spectrum as the positioned sound source direction;
step S03, according to the direction of a sound source, carrying out linear directional scanning on the sound in the direction of the sound source to obtain a linear focusing array, and determining the distance between the sound source and the center of a microphone array based on the linear focusing array; the step S03 includes:
step S31, according to the sound source direction positioned in step S2, assuming N focusing points of the sound source, and calculating the time delay of the sound source of the focusing point on each array beam to propagate to the microphone array,,
wherein the content of the first and second substances,for the delay assumption of the sound source propagating to the mth microphone at the focus point,pointing a microphone for a focused pointThe vector of the position of the center of the column,a vector pointing to the center position of the microphone array for the m-th microphone,a vector from a focus point to the m microphone, and c is a sound propagation speed;
step S32, based on the calculated time delay, according toCalculating the output quantity at the focus point on each array beam, and then forming a linear focusing array,
wherein, the first and the second end of the pipe are connected with each other,to a focus positionFrequency ofThe output of the time-delay circuit is output,is the signal received by the m-th microphone,actually acquiring signals for the microphones, wherein M is the number of the microphones;
and S04, obtaining a DOA manifold array in a near field mode matched with the distance of the sound source based on the sound source direction positioned in the step S02 and the distance between the sound source and the center of the microphone array determined in the step S03.
2. The acoustic imaging method supporting zooming according to claim 1, wherein the step S21 is specifically:
step S21.1, assuming N focusing points of the sound source, and calculating the time delay of the sound source of each focusing point to propagate to the microphone array,
Wherein, the first and the second end of the pipe are connected with each other,for the delay assumption of the sound source propagation to the mth microphone at the focus point,a vector pointing to the center position of the microphone array for the focus point,a vector pointing to the center position of the microphone array for the m-th microphone,a vector from a focusing point to an m-th microphone, and c is a sound propagation speed;
step S21.2, based on the calculated time delay, according to the formulaCalculating the output quantity at each focus point, and then forming a manifold array,
3. The acoustic imaging method supporting zooming according to claim 1 or 2, wherein the focusing points are focusing points which can be evenly distributed in a camera frame, the number of the focusing points is set according to a camera view angle and device calculation force, and the position of each focusing point is determined according to the camera view angle and an initial set distance calculation.
4. The method of claim 1, wherein the step S04 comprises: assuming that the distance between a sound source and the center of a microphone array is smaller than or equal to the distance between a newly generated DOA array and the center of the microphone array in a near-field mode; and obtaining the DOA manifold array in the near field mode based on the sound source direction positioned in the step S02 and the distance between the sound source and the center of the microphone array determined in the step S03.
5. The method of claim 4, wherein a distance of the sound source from a center of the microphone array is equal to a distance of the newly generated DOA array from the center of the microphone array.
6. The method according to claim 1, further comprising a step S05 of forming an acoustic cloud based on the DOA manifold array in the near-field mode obtained in the step S04.
7. The method of claim 1, further comprising a step S05',
sending the DOA manifold array in the near field mode obtained in the step S04 to a directional sound pickup device, wherein the directional sound pickup device is used for picking up sound source audio; alternatively, the first and second electrodes may be,
sending the DOA manifold array in the near field mode obtained in the step S04 to a voiceprint recognition device, wherein the voiceprint recognition device is used for recognizing voice data to determine the identity of a user; alternatively, the first and second electrodes may be,
and (4) sending the DOA manifold array in the near field mode obtained in the step (S04) into a camera device, zooming and magnifying the image of the specified area according to the position of the sound source so as to magnify and feature the sound source.
8. The method of claim 1, applied to an imager.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202210924179.4A CN114994607B (en) | 2022-08-03 | 2022-08-03 | Acoustic imaging method supporting zooming |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202210924179.4A CN114994607B (en) | 2022-08-03 | 2022-08-03 | Acoustic imaging method supporting zooming |
Publications (2)
Publication Number | Publication Date |
---|---|
CN114994607A CN114994607A (en) | 2022-09-02 |
CN114994607B true CN114994607B (en) | 2022-11-04 |
Family
ID=83020867
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202210924179.4A Active CN114994607B (en) | 2022-08-03 | 2022-08-03 | Acoustic imaging method supporting zooming |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN114994607B (en) |
Families Citing this family (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN115452141B (en) * | 2022-11-08 | 2023-03-31 | 杭州兆华电子股份有限公司 | Non-uniform acoustic imaging method |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103954931A (en) * | 2014-04-28 | 2014-07-30 | 西安交通大学 | Method for locating far field and near field mixed signal sources |
CN111693942A (en) * | 2020-07-08 | 2020-09-22 | 湖北省电力装备有限公司 | Sound source positioning method based on microphone array |
CN113868583A (en) * | 2021-12-06 | 2021-12-31 | 杭州兆华电子有限公司 | Method and system for calculating sound source distance focused by subarray wave beams |
CN114624689A (en) * | 2022-05-12 | 2022-06-14 | 杭州兆华电子股份有限公司 | Near-field focusing sound source distance calculation method and system based on acoustic imaging instrument |
Family Cites Families (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
GB2517690B (en) * | 2013-08-26 | 2017-02-08 | Canon Kk | Method and device for localizing sound sources placed within a sound environment comprising ambient noise |
CN111044973B (en) * | 2019-12-31 | 2021-06-01 | 山东大学 | MVDR target sound source directional pickup method for microphone matrix |
-
2022
- 2022-08-03 CN CN202210924179.4A patent/CN114994607B/en active Active
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103954931A (en) * | 2014-04-28 | 2014-07-30 | 西安交通大学 | Method for locating far field and near field mixed signal sources |
CN111693942A (en) * | 2020-07-08 | 2020-09-22 | 湖北省电力装备有限公司 | Sound source positioning method based on microphone array |
CN113868583A (en) * | 2021-12-06 | 2021-12-31 | 杭州兆华电子有限公司 | Method and system for calculating sound source distance focused by subarray wave beams |
CN114624689A (en) * | 2022-05-12 | 2022-06-14 | 杭州兆华电子股份有限公司 | Near-field focusing sound source distance calculation method and system based on acoustic imaging instrument |
Also Published As
Publication number | Publication date |
---|---|
CN114994607A (en) | 2022-09-02 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN104106267B (en) | Signal enhancing beam forming in augmented reality environment | |
CN111044973B (en) | MVDR target sound source directional pickup method for microphone matrix | |
JP4469887B2 (en) | Ultrasonic camera tracking system and related method | |
US6198693B1 (en) | System and method for finding the direction of a wave source using an array of sensors | |
JP4296197B2 (en) | Arrangement and method for sound source tracking | |
WO2016183791A1 (en) | Voice signal processing method and device | |
CA2498444C (en) | High precision beamsteerer based on fixed beamforming approach beampatterns | |
CN113281706B (en) | Target positioning method, device and computer readable storage medium | |
US20160165338A1 (en) | Directional audio recording system | |
CN205621437U (en) | Remote voice acquisition device that audio -video was jointly fixed a position | |
CN114994607B (en) | Acoustic imaging method supporting zooming | |
CN111445920A (en) | Multi-sound-source voice signal real-time separation method and device and sound pick-up | |
US20160161594A1 (en) | Swarm mapping system | |
CN106887236A (en) | A kind of remote speech harvester of sound image combined positioning | |
JP6977448B2 (en) | Device control device, device control program, device control method, dialogue device, and communication system | |
US20160161589A1 (en) | Audio source imaging system | |
CN110322892B (en) | Voice pickup system and method based on microphone array | |
KR101664733B1 (en) | Omnidirectional high resolution tracking and recording apparatus and method | |
KR101542647B1 (en) | A Method for Processing Audio Signal Using Speacker Detection and A Device thereof | |
CN115453300B (en) | Partial discharge positioning system and method based on acoustic sensor array | |
JP6471955B2 (en) | Monitoring system and directivity control method in monitoring system | |
Matsumoto et al. | A miniaturized adaptive microphone array under directional constraint utilizing aggregated microphones | |
JP5050935B2 (en) | Sonar receiver | |
CN114001816A (en) | Acoustic imager audio acquisition system based on MPSOC | |
JP2009100372A (en) | Call device |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |