CN110426675A - A kind of sound phase instrument auditory localization result evaluation method based on image procossing - Google Patents

A kind of sound phase instrument auditory localization result evaluation method based on image procossing Download PDF

Info

Publication number
CN110426675A
CN110426675A CN201910571533.8A CN201910571533A CN110426675A CN 110426675 A CN110426675 A CN 110426675A CN 201910571533 A CN201910571533 A CN 201910571533A CN 110426675 A CN110426675 A CN 110426675A
Authority
CN
China
Prior art keywords
sound
auditory localization
sound phase
sound source
image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201910571533.8A
Other languages
Chinese (zh)
Inventor
郑慧峰
张沫
朱勤丰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
China Jiliang University
Original Assignee
China Jiliang University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by China Jiliang University filed Critical China Jiliang University
Priority to CN201910571533.8A priority Critical patent/CN110426675A/en
Publication of CN110426675A publication Critical patent/CN110426675A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S5/00Position-fixing by co-ordinating two or more direction or position line determinations; Position-fixing by co-ordinating two or more distance determinations
    • G01S5/18Position-fixing by co-ordinating two or more direction or position line determinations; Position-fixing by co-ordinating two or more distance determinations using ultrasonic, sonic, or infrasonic waves
    • G01S5/20Position of source determined by a plurality of spaced direction-finders
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/70Determining position or orientation of objects or cameras
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10004Still image; Photographic image

Abstract

The sound phase instrument auditory localization result evaluation method based on image procossing that the present invention relates to a kind of.The present invention is proposed using the azimuth angle error of auditory localization result in sound phase cloud atlas captured by sound phase instrument and pitching angle error as the evaluation index of sound phase instrument auditory localization error.Then the target sound source of image processing techniques extraction sound phase cloud atlas is utilized, and calculates the centre coordinate of target sound source.Location coordinate information of the target sound source on actual physics space is obtained by image calibration.Finally the Sound Source Center coordinate by target sound source in sound phase cloud atlas compares with its practical physical spatial location coordinate, and azimuth angle error and pitching angle error is calculated.The present invention starts with from image processing techniques, the problem of the more difficult evaluation of sound phase instrument auditory localization result when overcoming remote, the assessment method of proposition can the auditory localization result accurately to sound phase instrument evaluate, in order to the performance evaluation to sound phase instrument, and image processing techniques is easy to operate.

Description

A kind of sound phase instrument auditory localization result evaluation method based on image procossing
Technical field
The present invention relates to acoustic measurement field, in particular to a kind of sound phase instrument auditory localization result based on image procossing is commented Determine method.
Background technique
In recent years, auditory localization technology is because the advantages such as strong antijamming capability, good concealment, positioning accuracy height are in video council The fields such as view, navigation, radar, intelligent robot, sonar and battlefield monitoring occupy very important status.When mechanical equipment occurs When failure, failure part portion can issue abnormal sound, can use auditory localization technological orientation guilty culprit region.Quick localization of sound source Position has very important significance in terms of providing test decision support, discovery in time.
Sound source visualizes a kind of means as auditory localization, and the identification of sound source is made to become quick, accurate.However, passing through Conventional method completes sound source visualization and needs a large amount of manual work.Such as the sound source in order to identify movement, it is necessary to which shooting is a large amount of Image, and rebuild manually with it is synchronous, cause heavy workload and reduce working efficiency.
In recent years, with the development of digital camera technology, occur carrying out sound source visual work using sound phase instrument.Sound The imaging of phase instrument is that the signal phase of each microphone is reached by the sound wave in measurement certain space based on Microphone array measurement technology Potential difference is different, and the position of sound source is determined according to phased array principle, measures the amplitude of sound source, and show sound source in sky in a manner of image Between distribution.In spatial distribution, space sound-filed simulation cloud atlas i.e. acoustic picture is obtained, wherein with the color and brightness of image The power of representative voice.Image and the video image of the camera being mounted on array capture are pellucidly stacked, to form quilt It surveys the visual of object and analyzes noise states, referred to as sound Xiang Yuntu.Acoustic imaging analysis is hotspot approach studied both at home and abroad at present, And it is widely used in every profession and trade.
But most sound phase instrument can only provide quantitative data at present, captured by sound phase cloud atlas lack it is unified Measurement standard.Critical index of the position error as sound phase instrument then needs to find a kind of method and carrys out sound to sound phase cloud atlas Source positioning result is evaluated.
Summary of the invention
To solve the above-mentioned problems, the present invention provides a kind of sound phase instrument auditory localization result evaluation based on image procossing Method is evaluated for the auditory localization error result objectively to sound phase instrument, starts with from image processing techniques, overcomes remote Apart from when the more difficult evaluation of sound phase instrument auditory localization result problem.
To achieve the goals above, the present invention is realized using following technical scheme:
Present invention signal generation apparatus emits different signals, and sound source work is driven after power amplifier amplifies.Sound phase Instrument positions sound source in real time, and positioning result is stored in computer.It proposes sound Xiang Yuntu captured by sound phase instrument The azimuth angle error and evaluation index of the pitching angle error as sound phase instrument auditory localization error of middle auditory localization result.Utilize figure As the target sound source of processing technique extraction sound phase cloud atlas, and calculate the centre coordinate of target sound source.It is obtained by image calibration Location coordinate information of the target sound source on actual physics space.Finally the Sound Source Center by target sound source in sound phase cloud atlas is sat Azimuth angle error and pitching angle error is calculated compared with its practical physical spatial location coordinate in mark.
The image processing techniques extraction sound phase cloud atlas target sound source uses following methods:
Operation sound phase instrument is captured respectively when issuing sound Shi Yuwei sounding to sound source;The sound for being shot front and back using difference shadow method There are the picture containing auditory localization imaging results and the background picture of the not imaging results containing auditory localization to be subtracted each other in phase cloud atlas, It is filtered again, to improve picture quality, keeps objective contour clear, boundary intensity variation is obvious;Threshold value is arranged to carry out The target sound source in sound phase cloud atlas is extracted after binarization of gray value and corrosion expansion, and target sound is acquired using average weighted method The center in source, i.e., (coordinate is indicated in the form of the pixel of image to the position coordinates at auditory localization center in sound phase cloud atlas );Sound phase instrument system acquired image is demarcated in face plane identical with sound source placement position, determines sound phase The size of the corresponding full size of unit pixel in cloud atlas image;After calibration, sound phase can be acquired according to calibration result Sound source is missed in the true location coordinate in actual physics space, the azimuth for further acquiring sound phase instrument auditory localization result in cloud atlas Difference and pitching angle error.
The beneficial effects of the present invention are:
1. this method is used to evaluate the auditory localization error result of sound phase instrument, breaches sound phase cloud atlas and lack unified measurement mark Standard also conducts a research for relevant departments convenient for the performance evaluation to sound phase instrument and provides technical thought;
2. sound source is different to the influence degree of positioning result apart from the far and near of microphone array during using sound phase instrument 's.Effectively captured and be limited in scope due to sound phase instrument, and when sound source apart from sound phase instrument farther out when, auditory localization error is larger, positioning As a result it is difficult to directly evaluate.This method propose using the azimuth angle error of auditory localization result and pitching angle error as sound Xiang Yun The evaluation index of figure auditory localization error.Start with from image processing techniques, auditory localization result is more difficult when overcoming remote comments Fixed problem;
3. this method calculates resulting azimuth and pitch angle and sits compared to the auditory localization center that sound phase instrument system directly exports Mark calculates resulting azimuth and pitch angle and calculates resulting azimuth in actual physics spatial position coordinate closer to sound source And pitch angle, can the sound phase cloud atlas auditory localization result accurately to sound phase instrument evaluate, and image processing techniques operate Simply.
Detailed description of the invention
Fig. 1 is azimuth angle error and pitching angle error schematic diagram in the present invention;
Fig. 2 is the schematic diagram of sound phase instrument auditory localization experimental system of the present invention;
Fig. 3 is image processing flow figure in the present invention;
Fig. 4 is image processing process figure in the present invention.
Specific embodiment
Assessment method of the invention is further described below with reference to a specific embodiment of the invention and attached drawing, thus Beneficial effects of the present invention will be further appreciated.
It is as shown in Figure 1 the azimuth angle error of sound phase instrument auditory localization result and pitching angle error schematic diagram.Sound phase instrument Auditory localization result 1-1 and the physical location 1-2 of sound source have certain deviations in sound phase cloud atlas, by its auditory localization result It projects on transverse and longitudinal direction (direction x, y), and will be calculated separately relative to coordinate origin in all directions by the coordinate system of foundation Azimuth angle error 1- is obtained compared with the true bearing angle of sound source and pitch angle to azimuth and pitch angle, and then by calculated result 3 and pitching angle error 1-4, and using two indices as the evaluation index of sound phase instrument sound phase cloud atlas auditory localization error.
A kind of sound phase instrument auditory localization result evaluation method based on image procossing, comprising the following steps:
Step 1: being illustrated in figure 2 the schematic diagram of sound phase instrument auditory localization experimental system, mainly includes sound source (loudspeaker) 2-1, sound Phase instrument 2-2, power amplifier 2-3, signal generation apparatus 2-4 and computer 2-5.Signal generation apparatus 2-4 emits different letters Number, the driving sound source 2-1 work after power amplifier 2-3 amplification.Sound phase instrument 2-2 positions sound source in real time, and will determine Position result is stored in computer 2-5.
Step 2: Fig. 3, Fig. 4 are the flow chart that the present invention is handled auditory localization result using image processing techniques With procedure chart.Sound phase instrument is captured respectively when issuing sound Shi Yuwei sounding to sound source.Get the image of sound phase instrument candid photograph After I1 and I2, there will be the picture I1 containing auditory localization imaging results in sound phase cloud atlas that front and back is shot using difference shadow method and do not contain The background picture I2 of auditory localization imaging results carries out subtracting each other removal background, as a result as shown in Figure 4 (b), obtains image I3.Then It is filtered, and threshold value is set and carries out binarization of gray value, as shown in Figure 4 (c).Then sound is extracted after carrying out corrosion expansion Target sound source in phase cloud atlas, as a result as shown in Fig. 4 (d).The center of target sound source is finally acquired using average weighted method, The position coordinates (coordinate is indicated in the form of the pixel of image) at auditory localization center i.e. in sound phase cloud atlas.
Step 3: to sound phase instrument system acquired image I1, I2 in face plane identical with sound source placement position It is demarcated, the big of the corresponding full size of unit pixel in phase cloud atlas image of speaking is determined by standard gridiron pattern It is small.After calibration, sound source in sound phase cloud atlas is acquired in the true location coordinate in actual physics space, into one according to calibration result Step acquires the azimuth angle error and pitching angle error of sound phase instrument auditory localization result.
Step 4: by the Sound Source Center position coordinates extracted based on image processing techniques calculate resulting azimuth angle error and The auditory localization center position coordinates that pitching angle error is directly exported with sound phase instrument system respectively calculate resulting azimuth angle error With pitch angle application condition, the sound phase cloud atlas auditory localization result that assessment method of the invention can accurately to sound phase instrument is verified It is evaluated.
The above is only presently preferred embodiments of the present invention, is not intended to limit the invention in any way, it is all according to the present invention Technical spirit any simple modification to the above embodiments, change and equivalent structural changes, still fall within skill of the present invention In the protection scope of art scheme.To sum up, the present invention provides assessment method to the auditory localization result of sound phase instrument, and builds sound phase Instrument auditory localization experimental system mainly includes sound source, sound phase instrument, power amplifier, signal generation apparatus and computer.Utilize figure As the target sound source of processing technique extraction sound phase cloud atlas, and calculate the centre coordinate of target sound source.By target sound source in sound phase Azimuth angle error and pitch angle is calculated compared with its practical physical spatial location coordinate in Sound Source Center coordinate in cloud atlas Error can accurately evaluate auditory localization error, in order to the performance evaluation to sound phase instrument, and image processing techniques It is easy to operate.

Claims (2)

1. proposing to miss at the azimuth of positioning result in a kind of sound phase instrument auditory localization result evaluation method based on image procossing Difference and evaluation index of the pitching angle error as sound phase instrument auditory localization error.It is characterized by:
Using the target sound source of image processing techniques extraction sound phase cloud atlas, and calculate Sound Source Center coordinate.Pass through image calibration Obtain location coordinate information of the target sound source on actual physics space.Finally by target sound source in the sound source in sound phase cloud atlas Azimuth angle error and pitching angle error is calculated compared with its practical physical spatial location coordinate in heart coordinate, can be accurate Auditory localization error is evaluated on ground, and in order to the performance evaluation to sound phase instrument, and image processing techniques is easy to operate.
2. special in a kind of sound phase instrument auditory localization result evaluation method based on image procossing according to claim 1 Sign is:
The concrete mode of the image procossing are as follows:
Step 1, operation sound phase instrument are captured respectively when issuing sound Shi Yuwei sounding to sound source, obtain image I1 and I2;
Step 2, will have in sound phase cloud atlas that front and back is shot using difference shadow method the picture I1 containing auditory localization imaging results with not The background picture I2 of the imaging results containing auditory localization carries out subtracting each other removal background, obtains image I3;
Step 3 is filtered image I3, and setting threshold value extracts sound Xiang Yun after carrying out binarization of gray value and corrosion expansion Target sound source in figure acquires the center of target sound source, i.e. auditory localization center in sound phase cloud atlas using average weighted method Position coordinates (coordinate is indicated in the form of the pixel of image);
Step 4 demarcates sound phase instrument system acquired image in face plane identical with sound source placement position, really Determine the size of the corresponding full size of unit pixel in sound phase cloud atlas image;
Step 5, according to calibration result, acquire sound source in sound phase cloud atlas in the true location coordinate in actual physics space, further Calculate the azimuth angle error and pitching angle error for acquiring sound phase instrument auditory localization result.
CN201910571533.8A 2019-06-28 2019-06-28 A kind of sound phase instrument auditory localization result evaluation method based on image procossing Pending CN110426675A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910571533.8A CN110426675A (en) 2019-06-28 2019-06-28 A kind of sound phase instrument auditory localization result evaluation method based on image procossing

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910571533.8A CN110426675A (en) 2019-06-28 2019-06-28 A kind of sound phase instrument auditory localization result evaluation method based on image procossing

Publications (1)

Publication Number Publication Date
CN110426675A true CN110426675A (en) 2019-11-08

Family

ID=68409878

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910571533.8A Pending CN110426675A (en) 2019-06-28 2019-06-28 A kind of sound phase instrument auditory localization result evaluation method based on image procossing

Country Status (1)

Country Link
CN (1) CN110426675A (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111915918A (en) * 2020-06-19 2020-11-10 中国计量大学 System and method for calibrating automobile whistling snapshot device on site based on dynamic characteristics
CN113838128A (en) * 2021-11-23 2021-12-24 珠海视熙科技有限公司 Method, system and device for mapping sound and picture of video image and video conference equipment
CN115049698A (en) * 2022-08-17 2022-09-13 杭州兆华电子股份有限公司 Cloud picture display method and device of handheld acoustic imaging equipment

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1764828A (en) * 2003-01-30 2006-04-26 应用计算机科学促进协会 Method and device for imaged representation of acoustic objects, a corresponding information program product and a recording support readable by a corresponding computer
CN104748764A (en) * 2015-04-01 2015-07-01 清华大学 Method for calibrating space angle of acoustic image plane in acoustic field visualization system
KR20150141114A (en) * 2014-11-19 2015-12-17 이승철 The remote tuning broadcasting device monitored in real time and broadcasting system of earthquake-proof
JP2016191661A (en) * 2015-03-31 2016-11-10 株式会社熊谷組 Structure inspection device
CN107333120A (en) * 2017-08-11 2017-11-07 吉林大学 A kind of integrated sensor based on microphone array and stereoscopic vision
CN109409353A (en) * 2017-08-18 2019-03-01 上海其高电子科技有限公司 Vehicle whistle monitoring method and system based on DCNN target identification

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1764828A (en) * 2003-01-30 2006-04-26 应用计算机科学促进协会 Method and device for imaged representation of acoustic objects, a corresponding information program product and a recording support readable by a corresponding computer
KR20150141114A (en) * 2014-11-19 2015-12-17 이승철 The remote tuning broadcasting device monitored in real time and broadcasting system of earthquake-proof
JP2016191661A (en) * 2015-03-31 2016-11-10 株式会社熊谷組 Structure inspection device
CN104748764A (en) * 2015-04-01 2015-07-01 清华大学 Method for calibrating space angle of acoustic image plane in acoustic field visualization system
CN107333120A (en) * 2017-08-11 2017-11-07 吉林大学 A kind of integrated sensor based on microphone array and stereoscopic vision
CN109409353A (en) * 2017-08-18 2019-03-01 上海其高电子科技有限公司 Vehicle whistle monitoring method and system based on DCNN target identification

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
孙昊 等: "正四面体麦克风阵列声源定位模型研究", 《计算机仿真》 *
邵林 等: "基于双目视觉和声阵列的声学摄像机的开发", 《仪器仪表学报》 *

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111915918A (en) * 2020-06-19 2020-11-10 中国计量大学 System and method for calibrating automobile whistling snapshot device on site based on dynamic characteristics
CN113838128A (en) * 2021-11-23 2021-12-24 珠海视熙科技有限公司 Method, system and device for mapping sound and picture of video image and video conference equipment
CN115049698A (en) * 2022-08-17 2022-09-13 杭州兆华电子股份有限公司 Cloud picture display method and device of handheld acoustic imaging equipment
CN115049698B (en) * 2022-08-17 2022-11-04 杭州兆华电子股份有限公司 Cloud picture display method and device of handheld acoustic imaging equipment

Similar Documents

Publication Publication Date Title
CN110426675A (en) A kind of sound phase instrument auditory localization result evaluation method based on image procossing
CN102879080B (en) Sound field analysis method based on image recognition positioning and acoustic sensor array measurement
CN107462741B (en) Moving object speed and acceleration measuring device
CN110533649B (en) Unmanned aerial vehicle general structure crack identification and detection device and method
CN110208771B (en) Point cloud intensity correction method of mobile two-dimensional laser radar
CN104776977A (en) Coastal engineering silt physical model test bottom bed dynamic and comprehensive observation method
CN110411339A (en) A kind of submarine target dimension measuring apparatus and method based on collimated laser beam
CN113240747B (en) Outdoor structure vibration displacement automatic monitoring method based on computer vision
CN103617611A (en) Automatic threshold segmentation detection method for center and size of light spot
CN109141255A (en) A kind of bow net monitoring method
CN106840011A (en) Steel tower deformation measuring device and its method
CN109341668A (en) Polyphaser measurement method based on refraction projection model and beam ray tracing method
CN109239099A (en) Road surface breakage real-time detecting system and its detection method under multi-machine collaborative environment
CN114323571A (en) Multi-optical-axis consistency detection method for photoelectric aiming system
CN111179335A (en) Standing tree measuring method based on binocular vision
CN113884011A (en) Non-contact concrete surface crack measuring equipment and method
CN109523592A (en) A kind of interior flame localization method based on camera
CN113850868A (en) Wave climbing image identification method
CN109489559A (en) Point light source space-location method based on time frequency analysis and optical field imaging technology
CN116883483A (en) Fish body measuring method based on laser camera system
CN116543141A (en) Unmanned aerial vehicle identification and positioning method based on acoustic signal and image fusion
CN112858998B (en) On-site verification system and method for automobile whistle snapshot device
CN114235347B (en) Lens quality assessment method and device
CN115773720A (en) Underwater target size measuring device and method based on optical vision
CN113884058A (en) High-precision remote sensing quantitative detection method for landform in deep sea micro-area

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
WD01 Invention patent application deemed withdrawn after publication
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20191108