CN114136432A - Single sound source acoustic imaging method and terminal equipment - Google Patents

Single sound source acoustic imaging method and terminal equipment Download PDF

Info

Publication number
CN114136432A
CN114136432A CN202111423194.2A CN202111423194A CN114136432A CN 114136432 A CN114136432 A CN 114136432A CN 202111423194 A CN202111423194 A CN 202111423194A CN 114136432 A CN114136432 A CN 114136432A
Authority
CN
China
Prior art keywords
sound field
area
data
sound
acoustic
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202111423194.2A
Other languages
Chinese (zh)
Inventor
贺武君
党建新
蒙进
罗华
吴杨
孙永涛
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shaanxi Jintadpole Intelligent Technology Co ltd
Original Assignee
Shaanxi Jintadpole Intelligent Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shaanxi Jintadpole Intelligent Technology Co ltd filed Critical Shaanxi Jintadpole Intelligent Technology Co ltd
Priority to CN202111423194.2A priority Critical patent/CN114136432A/en
Publication of CN114136432A publication Critical patent/CN114136432A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01HMEASUREMENT OF MECHANICAL VIBRATIONS OR ULTRASONIC, SONIC OR INFRASONIC WAVES
    • G01H11/00Measuring mechanical vibrations or ultrasonic, sonic or infrasonic waves by detecting changes in electric or magnetic properties

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Measurement Of Velocity Or Position Using Acoustic Or Ultrasonic Waves (AREA)

Abstract

The invention discloses a single sound source acoustic imaging method and terminal equipment, belonging to the technical field of acoustic imaging, and comprising the steps of collecting multi-channel data of an acoustic array and preprocessing the multi-channel data; roughly dividing a to-be-tested area formed by multi-channel data into grids; carrying out sound field reconstruction processing on the multi-channel data to obtain a sound field of a preset area and obtain the position of the maximum point of the sound field; using the maximum position of sound field as center of circle, RdThe radius is a target area; carrying out mesh fine division on the area to be tested, and calculating the sound field value of a point positioned in the target area; based on a preset sound field threshold value, the sound field value of a point in a target area is subjected to de-marginalization processing, and RGB parameter conversion is performed on the sound field according to the sound field range subjected to de-marginalization processing and an RGB conversion rule to obtain a color image, so that the purpose of performing acoustic imaging on the multi-channel data of the acoustic array is achieved. The invention effectively solves the problem of large positioning calculation amount of a single sound source sound field through two-stage data processing.

Description

Single sound source acoustic imaging method and terminal equipment
Technical Field
The invention belongs to the technical field of acoustic imaging, and particularly relates to a single sound source acoustic imaging method and terminal equipment.
Background
Acoustic imaging (acoustic imaging) is based on a microphone array measurement technology, and is characterized in that the position of a sound source is determined according to a phased array principle by measuring the phase difference of signals of sound waves in a certain space reaching each microphone, the amplitude of the sound source is measured, and the distribution of the sound source in the space is displayed in an image mode, namely a cloud image-sound image of the spatial sound field distribution is obtained, wherein the color and the brightness of the image represent the strength of the sound.
However, in the case of high sound field resolution requirement, that is, in the case of dividing the sound field space into dense grids, the conventional method needs to perform inverse extrapolation on the sound source of each point in the space, so that the number of calculation points is large, the calculation amount is large, and the actual calculation and display by the portable device are difficult.
Disclosure of Invention
In view of the above problems, the present invention provides a single sound source acoustic imaging method and a terminal device, where the method includes:
collecting multi-channel data of an acoustic array, and preprocessing the multi-channel data;
roughly dividing a to-be-tested area formed by the preprocessed multi-channel data into grids;
carrying out sound field reconstruction processing on the multi-channel data after the grid rough division to obtain a sound field of a preset area;
searching and scanning the sound field of the preset area and obtaining the position of the maximum point of the sound field;
taking the maximum position of the sound field as the center of a circle, RdThe radius is a target area;
carrying out mesh subdivision on the area to be tested, and calculating a sound field value of a point located in the target area;
based on a preset sound field threshold value, performing de-marginalization processing on the sound field value of the point in the target area, and performing RGB parameter conversion on the sound field according to the sound field range and RGB conversion rule of the de-marginalization processing to obtain a color image, so as to achieve the purpose of performing acoustic imaging on the multi-channel data of the sound array.
Preferably, preprocessing the multi-channel data includes performing a de-averaging process on each piece of single-channel data.
Preferably, the area to be tested is coarsely gridded and the resolution is divided into 32x24 grids.
Preferably, the performing a sound field reconstruction process on the multi-channel data after the coarse mesh division to obtain a sound field of a predetermined region includes:
determining a covariance matrix according to the multi-channel acoustic data;
determining a steering vector and a conjugate vector of the steering vector based on the coarse mesh partition resolution;
determining sound field values of all positions of a sound field space corresponding to the area to be detected according to the product of the covariance matrix, the guide vector and the conjugate vector;
and determining the sound field of the preset area according to the sound field values of all positions of the sound field space corresponding to the area to be detected.
Preferably, the preprocessing the multichannel data further includes filtering the multichannel acoustic data to determine a covariance matrix according to the filtered multichannel acoustic data.
Preferably, the mesh subdivision of the region to be tested and the calculation of the sound field value at the point in the target region include:
carrying out grid fine division on the region to be tested, dividing the resolution into 640x480 grids, and screening out points in the target region;
determining a steering vector and a conjugate vector of the steering vector based on the tessellation resolution;
and determining the sound field value of each position of the target area according to the product of the covariance matrix, the guide vector and the conjugate vector.
Preferably, the RGB conversion rule includes:
judging whether the point of the region to be tested is positioned in the target region, if not, converting the RGB color of the pixel corresponding to the point into transparent color (255, 255, 255);
if the point is located, judging whether the sound field value of the point is larger than the sound field threshold value, if not, converting the RGB color of the pixel corresponding to the point into transparent color (255, 255, 255);
and if so, converting the sound field value of the point into gray data, and converting the gray data into RGB data.
The present invention also provides a single sound source acoustic imaging system, comprising:
the multichannel data acquisition module is used for acquiring multichannel sound data of a target sound source and preprocessing the multichannel sound data;
the grid rough dividing module is used for carrying out grid rough dividing on the area to be tested formed by the preprocessed multi-channel data;
the sound field determining module is used for carrying out sound field reconstruction processing on the multi-channel data after the grid rough division to obtain a sound field of a preset area;
the target area determining module is used for searching and scanning the sound field of the preset area and obtaining the maximum point position of the sound field; taking the maximum position of the sound field as the center of a circle, RdThe radius is a target area; carrying out mesh subdivision on the area to be tested, and calculating a sound field value of a point located in the target area;
and the acoustic imaging module is used for performing de-edging treatment on the sound field value of the point in the target area based on a preset sound field threshold value, and performing RGB parameter conversion on the sound field according to the sound field range subjected to de-edging treatment and the RGB conversion rule to obtain a color image so as to achieve the purpose of performing acoustic imaging on the multi-channel data of the sound array.
An embodiment of the present invention provides an electronic device, which includes at least one processing unit and at least one storage unit, where the storage unit stores a program, and when the program is executed by the processing unit, the processing unit is enabled to execute the method described above.
An embodiment of the present invention provides a computer-readable storage medium, which stores a computer program executable by an electronic device, and when the program runs on the electronic device, the program causes the electronic device to execute the method described above.
Compared with the prior art, the invention has the beneficial effects that:
the method carries out twice grid division on the multi-channel acoustic data, roughly estimates the calculated acoustic space for the first time, roughly positions the position of the acoustic source, determines the position of the acoustic source, accurately calculates the position of the acoustic source for the second time, and simultaneously ensures enough resolution.
Drawings
FIG. 1 is a flow chart of a single acoustic source acoustic imaging method of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. All other embodiments, which can be obtained by a person skilled in the art without any inventive step based on the embodiments of the present invention, are within the scope of the present invention.
In this application, the sound field refers to a region in a medium where sound waves exist. The physical quantities of the sound field can be described by sound pressure, particle vibration velocity, displacement or medium density, which are generally functions of position and time. The relation between the change of the physical quantity along with the space position and the change along with the time in the sound field is described by an acoustic wave equation, and the distribution of the sound field along with the space, the change along with the time, the energy relation and the like can be known by solving the solution of the sound wave equation which meets the boundary condition.
Referring to fig. 1, the present invention provides a single sound source acoustic imaging method, including:
step S101: collecting multi-channel data of the acoustic array, and preprocessing the multi-channel data;
specifically, the multi-channel acoustic data is used to characterize audio data detected by each of a plurality of acoustic sensors constituting the microphone array, that is, audio data detected by each of a plurality of acoustic sensor channels.
Further, the preprocessing the multi-channel data includes performing a mean value removing process on each piece of single-channel data, and the formula is as follows:
Figure BDA0003378154440000041
wherein: n is the number of sampling points, and is usually 2^ L, M microphone numbers;
and further, filtering the multi-channel acoustic data to determine a covariance matrix according to the filtered multi-channel acoustic data.
Step S102: roughly dividing a to-be-tested area formed by the preprocessed multi-channel data into grids;
specifically, the area to be tested is roughly divided into grids, the resolution is divided into 32 × 24 grids, and then the calculation formula of the sound field scanning points is as follows:
Figure BDA0003378154440000042
wherein: a and b are the boundaries of the area to be tested, respectively;
step S103: carrying out sound field reconstruction processing on the multi-channel data after the grid rough division to obtain a sound field of a preset area;
further, determining a covariance matrix according to the multi-channel acoustic data;
determining a guide vector and a conjugate vector of the guide vector based on the coarse grid division resolution;
determining sound field values of all positions of a sound field space corresponding to the area to be detected according to the product of the covariance matrix, the guide vector and the conjugate vector;
and determining the sound field of the preset area according to the sound field values of all positions of the sound field space corresponding to the area to be detected.
Specifically, the specific procedure of the sound field reconstruction processing is as follows:
the covariance matrix Rx is calculated as follows:
Figure BDA0003378154440000051
wherein: 1<i<M represents the ith column of the data matrix after filtering processing, and M is a microphone array; xiThe length of the column vector of the filtered data matrix is N points; xi TIs XiTransposing;
roughly dividing grids according to the area to be tested, dividing the grids into 32x24 grids according to the resolution, loading a vector W [32] [24] [32], decomposing the grids into 32x24 modules, and calculating a 32x24 point sound pressure value P [32] [24] of a test sound field space at the same time of a clock beat;
wherein the vector w (x)i,yj) The calculation formula of (a) is as follows:
Figure BDA0003378154440000052
in the formula: e is an index;
j is an imaginary unit;
f test acoustic signal frequency (analysis frequency on which filtering processing is based);
c is the sound velocity 340 m/s;
pkis the coordinate of the microphone on the array, (ax)k,ayk) For microphone array coordinates pkK is more than or equal to 1 and less than or equal to M;
the embodiment of the application calculates any point (x) in space through vectors and covariance matrixesi,yjH) the sound field value P (i, j) at h) is calculated as follows:
P(i,j)=w(xi,yj)·Rx·w(xi,yj)T
wherein, w (x)i,yj)TIs w (x)i,yj) The conjugate transpose of (1); p (i, j) is 32x24 sound field data, floating point type;
calculating the sound field distribution by performing the following operation on the sound field value:
P(i,j)=|P(i,j)|;
step S104: searching and scanning a sound field of a preset area, and obtaining the position of the maximum point of the sound field;
in particular, when
Figure BDA0003378154440000061
When P (i, j) takes the maximum value P (i)0,j0)=Pmax(i,j);
At this time, the corresponding sound field is at position a:
Figure BDA0003378154440000062
further, taking the maximum position of the sound field as the center of a circle, RdThe radius is a target area;
step S105: carrying out mesh fine division on the area to be tested, and calculating the sound field value of a point positioned in the target area;
specifically, the area to be tested is subjected to grid subdivision, and the resolution is divided into 640x480 grids:
Figure BDA0003378154440000063
wherein: a and b are the boundaries of the area to be tested, respectively;
screening out points located in the target area through a formula, wherein the formula is as follows:
Figure BDA0003378154440000064
determining a steering vector and a conjugate vector of the steering vector based on the mesh subdivision resolution;
and determining the sound field value of each position of the target area according to the product of the covariance matrix, the guide vector and the conjugate vector.
Step S106: based on a preset sound field threshold value, the sound field value of a point in a target area is subjected to de-marginalization processing, and RGB parameter conversion is performed on the sound field according to the sound field range subjected to de-marginalization processing and an RGB conversion rule to obtain a color image, so that the purpose of performing acoustic imaging on the multi-channel data of the acoustic array is achieved.
Specifically, the sound field value of the target region is normalized in the following manner:
Figure BDA0003378154440000065
wherein max (max ()) is the operation of obtaining the maximum value; int () represents data rounding;
secondly, performing edge removing processing, comparing the threshold value with the sound field, and setting the threshold value to be the lowest, so that the sound pointed out by the maximum value of the sound can be highlighted and more visually displayed;
Figure BDA0003378154440000071
wherein, P (x)i,yj) Is the midpoint (x) of the sound fieldi,yj) The sound pressure value of (a); pthIs the field threshold. In particular, Pth0.2. After normalization and edge deletion, the sound field range is P (x)i,yj)∈[Pth 1]。
Still further, the RGB conversion rule includes:
judging whether the sound image data has a target area, if not, converting the RGB color of the pixel corresponding to the point into transparent color (255, 255, 255);
if yes, judging whether the sound field value of the point is larger than a sound field threshold value, if not, converting the RGB color of the pixel corresponding to the point into transparent color (255, 255 and 255);
if the sound field value is larger than the preset value, converting the sound field value of the point into gray data, wherein the conversion formula is as follows:
Figure BDA0003378154440000072
wherein: l is 255; int () represents rounding the data;
next, conversion of the gray data into RGB data is performed, and the conversion formula is referred to as follows:
Figure BDA0003378154440000073
after these series of transformations, the sound field values are converted into RGB-represented color data. The sound field data is matched with the video data acquired by the camera, so that the sound can be directly reflected where the sound is generated, and the position of the fault can be visually judged.
In this embodiment, RdSetting the position as 0.5, carrying out twice grid division on multi-channel acoustic data, roughly estimating a calculated acoustic space for the first time, roughly positioning the position of an acoustic source, determining the position of the acoustic source, accurately calculating the position of the acoustic source for the second time, and simultaneously ensuring enough resolution; in addition, by judging whether the target range is located or not to perform RGB conversion and whether the target range is greater than the threshold value of the sound field or not, a large amount of calculation is reduced, the effect of data is guaranteed, and the data processing speed is improved.
The present invention also provides a single sound source acoustic imaging system, comprising:
the multichannel data acquisition module is used for acquiring multichannel sound data of a target sound source and preprocessing the multichannel sound data;
the grid rough dividing module is used for carrying out grid rough dividing on the to-be-tested area formed by the preprocessed multi-channel data;
the sound field determining module is used for carrying out sound field reconstruction processing on the multi-channel data after the grid rough division to obtain a sound field of a preset area;
the target area determining module is used for searching and scanning the sound field of the preset area and obtaining the maximum point position of the sound field; using the maximum position of sound field as center of circle, RdThe radius is a target area; carrying out mesh fine division on the area to be tested, and calculating the sound field value of a point positioned in the target area;
and the acoustic imaging module is used for performing de-edging treatment on the sound field value of the point positioned in the target area based on a preset sound field threshold value, and performing RGB parameter conversion on the sound field according to the sound field range subjected to de-edging treatment and the RGB conversion rule to obtain a color image so as to achieve the purpose of performing acoustic imaging on the multi-channel data of the acoustic array.
An embodiment of the present invention provides an electronic device, which includes at least one processing unit and at least one storage unit, where the storage unit stores a program, and when the program is executed by the processing unit, the processing unit is enabled to execute the method described above.
An embodiment of the present invention provides a computer-readable storage medium, which stores a computer program executable by an electronic device, and when the program runs on the electronic device, the program causes the electronic device to execute the method described above.
The above is only a preferred embodiment of the present invention, and is not intended to limit the present invention, and various modifications and changes will occur to those skilled in the art. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims (10)

1. A method of single source acoustic imaging, comprising:
collecting multi-channel data of an acoustic array, and preprocessing the multi-channel data;
roughly dividing a to-be-tested area formed by the preprocessed multi-channel data into grids;
carrying out sound field reconstruction processing on the multi-channel data after the grid rough division to obtain a sound field of a preset area;
searching and scanning the sound field of the preset area and obtaining the position of the maximum point of the sound field;
taking the maximum position of the sound field as the center of a circle, RdThe radius is a target area;
carrying out mesh subdivision on the area to be tested, and calculating a sound field value of a point located in the target area;
based on a preset sound field threshold value, performing de-marginalization processing on the sound field value of the point in the target area, and performing RGB parameter conversion on the sound field according to the sound field range and RGB conversion rule of the de-marginalization processing to obtain a color image, so as to achieve the purpose of performing acoustic imaging on the multi-channel data of the sound array.
2. The single acoustic source acoustic imaging method of claim 1, wherein preprocessing the multi-channel data comprises de-averaging each piece of single-channel data.
3. The single acoustic source acoustic imaging method of claim 2, wherein the area to be tested is coarsely gridded and the resolution is divided into 32x24 grids.
4. The single-sound-source acoustic imaging method according to claim 3, wherein performing sound field reconstruction processing on the multi-channel data after coarse mesh division to obtain a sound field of a predetermined region comprises:
determining a covariance matrix according to the multi-channel acoustic data;
determining a steering vector and a conjugate vector of the steering vector based on the coarse mesh partition resolution;
determining sound field values of all positions of a sound field space corresponding to the area to be detected according to the product of the covariance matrix, the guide vector and the conjugate vector;
and determining the sound field of the preset area according to the sound field values of all positions of the sound field space corresponding to the area to be detected.
5. The method of single acoustic source acoustic imaging of claim 4, wherein preprocessing the multi-channel acoustic data further comprises filtering the multi-channel acoustic data to determine a covariance matrix based on the filtered multi-channel acoustic data.
6. The single acoustic source acoustic imaging method of claim 5, wherein tessellating the area to be tested and calculating the transform rule at the target RGB comprises:
carrying out grid fine division on the region to be tested, dividing the resolution into 640x480 grids, and screening out points in the target region;
determining a steering vector and a conjugate vector of the steering vector based on the tessellation resolution;
and determining the sound field value of each position of the target area according to the product of the covariance matrix, the guide vector and the conjugate vector.
7. The single acoustic source acoustic imaging method of claim 6, wherein the RGB conversion rule comprises:
judging whether the point of the region to be tested is positioned in the target region, if not, converting the RGB color of the pixel corresponding to the point into transparent color (255, 255, 255);
if the point is located, judging whether the sound field value of the point is larger than the sound field threshold value, if not, converting the RGB color of the pixel corresponding to the point into transparent color (255, 255, 255);
and if so, converting the sound field value of the point into gray data, and converting the gray data into RGB data.
8. A single acoustic source acoustic imaging system, comprising:
the multichannel data acquisition module is used for acquiring multichannel sound data of a target sound source and preprocessing the multichannel sound data;
the grid rough dividing module is used for carrying out grid rough dividing on the area to be tested formed by the preprocessed multi-channel data;
the sound field determining module is used for carrying out sound field reconstruction processing on the multi-channel data after the grid rough division to obtain a sound field of a preset area;
the target area determining module is used for searching and scanning the sound field of the preset area and obtaining the maximum point position of the sound field; taking the maximum position of the sound field as the center of a circle, RdThe radius is a target area; carrying out mesh subdivision on the area to be tested, and calculating a sound field value of a point located in the target area;
and the acoustic imaging module is used for performing de-edging treatment on the sound field value of the point in the target area based on a preset sound field threshold value, and performing RGB parameter conversion on the sound field according to the sound field range subjected to de-edging treatment and the RGB conversion rule to obtain a color image so as to achieve the purpose of performing acoustic imaging on the multi-channel data of the sound array.
9. An electronic device, comprising at least one processing unit and at least one memory unit, wherein the memory unit stores a computer program that, when executed by the processing unit, causes the processing unit to perform the method of any of claims 1 to 7.
10. A storage medium storing a computer program executable by an electronic device, the program, when run on the electronic device, causing the electronic device to perform the method of any one of claims 1 to 7.
CN202111423194.2A 2021-11-26 2021-11-26 Single sound source acoustic imaging method and terminal equipment Pending CN114136432A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111423194.2A CN114136432A (en) 2021-11-26 2021-11-26 Single sound source acoustic imaging method and terminal equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111423194.2A CN114136432A (en) 2021-11-26 2021-11-26 Single sound source acoustic imaging method and terminal equipment

Publications (1)

Publication Number Publication Date
CN114136432A true CN114136432A (en) 2022-03-04

Family

ID=80388439

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111423194.2A Pending CN114136432A (en) 2021-11-26 2021-11-26 Single sound source acoustic imaging method and terminal equipment

Country Status (1)

Country Link
CN (1) CN114136432A (en)

Similar Documents

Publication Publication Date Title
JP6061693B2 (en) Abnormality diagnosis apparatus and abnormality diagnosis method using the same
US8403850B2 (en) Rapid two/three-dimensional sector strain imaging
CN113267330A (en) GIS equipment mechanical fault detection system and method based on acoustic imaging
CN113240587B (en) Super-resolution scan conversion method, device, ultrasonic apparatus and storage medium
US11087466B2 (en) Methods and system for compound ultrasound image generation
CN115797335B (en) Euler movement amplification effect evaluation and optimization method for bridge vibration measurement
CN110840488A (en) Imaging method, system and device based on shear wave
CN111820948B (en) Fetal growth parameter measuring method and system and ultrasonic equipment
CN110163907B (en) Method and device for measuring thickness of transparent layer of fetal neck and storage medium
CN111563880B (en) Transverse process spinous process detection positioning method based on target detection and clustering
KR20120094415A (en) Precision measurement of waveforms
CN111562584B (en) Passive sonar azimuth history map processing method, device and equipment
CN111681668A (en) Acoustic imaging method and terminal equipment
CN102867292B (en) Stepped mean filtering method aimed at imaging data of multibeam forward-looking sonars
CN114136432A (en) Single sound source acoustic imaging method and terminal equipment
CN108877902B (en) Ultrasonic image brightness adjusting method and adjusting system
CN111260606B (en) Diagnostic device and diagnostic method
CN111242853B (en) Medical CT image denoising method based on optical flow processing
US20100130862A1 (en) Providing Volume Information On A Periodically Moving Target Object In An Ultrasound System
CN112884635A (en) Submarine environment visualization method and device based on ROV carrying dual-frequency forward-looking sonar
CN112826460B (en) Physiological signal frequency extraction method, device, physiological signal acquisition equipment and medium
CN115049661B (en) Target structure circumference measuring method and device, ultrasonic equipment and storage medium
CN117528065B (en) Camera disturbance effect evaluation and elimination method, device, equipment and storage medium
CN117008863B (en) LOFAR long data processing and displaying method and device
JP2022190994A (en) Magnetic resonance imaging apparatus, noise removal method and image processing apparatus

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination