CN116990755A - Method and system for positioning whistle sound source, electronic equipment and readable storage medium - Google Patents

Method and system for positioning whistle sound source, electronic equipment and readable storage medium Download PDF

Info

Publication number
CN116990755A
CN116990755A CN202311226357.7A CN202311226357A CN116990755A CN 116990755 A CN116990755 A CN 116990755A CN 202311226357 A CN202311226357 A CN 202311226357A CN 116990755 A CN116990755 A CN 116990755A
Authority
CN
China
Prior art keywords
data
whistle
audio data
whistle sound
sound
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202311226357.7A
Other languages
Chinese (zh)
Inventor
王丹
崔洋洋
杨登舟
林东跃
高治良
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Haining Micro Nano Sensing Computing Technology Co ltd
Original Assignee
Haining Micro Nano Sensing Computing Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Haining Micro Nano Sensing Computing Technology Co ltd filed Critical Haining Micro Nano Sensing Computing Technology Co ltd
Priority to CN202311226357.7A priority Critical patent/CN116990755A/en
Publication of CN116990755A publication Critical patent/CN116990755A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S5/00Position-fixing by co-ordinating two or more direction or position line determinations; Position-fixing by co-ordinating two or more distance determinations
    • G01S5/18Position-fixing by co-ordinating two or more direction or position line determinations; Position-fixing by co-ordinating two or more distance determinations using ultrasonic, sonic, or infrasonic waves
    • G01S5/22Position of source determined by co-ordinating a plurality of position lines defined by path-difference measurements

Abstract

The application provides a whistle sound source positioning method, a whistle sound source positioning system, electronic equipment and a readable storage medium. The method comprises the following steps: acquiring audio data acquired by each radio device, volume information of each audio data and corresponding installation position information; for each piece of audio data, determining the noise type corresponding to each piece of whistling sound data in the audio data by utilizing band samples of different audio types in the database; and determining the positioning position of the whistle sound source corresponding to the whistle sound data according to the volume information of a plurality of whistle sound data belonging to the same noise type and the installation position information corresponding to each whistle sound data aiming at various noise types. According to the application, the positioning position of the whistling sound source is determined through the audio data, and the sound receiving equipment is only required to be arranged, so that the sound receiving equipment and the camera are not required to be arranged, and the cost can be reduced; meanwhile, only one type of data is required to be processed, and two types of data are not required to be processed, so that the data transmission quantity can be reduced, and the data operation efficiency can be improved.

Description

Method and system for positioning whistle sound source, electronic equipment and readable storage medium
Technical Field
The application belongs to the technical field of positioning, and particularly relates to a method and a system for positioning a whistle sound source, electronic equipment and a readable storage medium.
Background
As the number of vehicles increases, road noise pollution is also becoming serious, wherein the whistling noise emitted by the vehicles occupies a major part. In order to better suppress noise emitted by urban motor vehicles and to rapidly locate the source of noise pollution, it is common to locate it by imaging using whistle information.
The traditional whistle sound source positioning system is formed by combining the sound receiving equipment and the camera, and the working principle is that the data of the field scene are comprehensively sampled through the cooperation of the sound receiving equipment and the camera, and the whistle sound source is determined according to the data acquired by the sound receiving equipment and the camera. However, this positioning method has high cost, large data transmission amount and low efficiency.
Disclosure of Invention
The embodiment of the application provides a method, a system, electronic equipment, a readable storage medium and a computer program product for locating a whistle sound source, which can solve the problems of high cost, large data transmission quantity and low efficiency of the traditional whistle sound source locating system.
In a first aspect, an embodiment of the present application provides a method for positioning a whistle sound source, including:
Acquiring audio data acquired by each radio receiving device, volume information of each audio data and installation position information of each radio receiving device;
for each piece of audio data, determining the noise type corresponding to each piece of whistling sound data in the audio data by utilizing band samples of different audio types in a database;
and determining the positioning position of the whistle sound source corresponding to the whistle sound data according to the volume information of a plurality of whistle sound data belonging to the same noise type and the installation position information corresponding to each whistle sound data aiming at various noise types.
In one embodiment, the acquiring the audio data collected by each sound receiving device, the volume information of each audio data, and the installation position information of each sound receiving device includes:
receiving radio reception data sent by radio reception equipment and the installation position information of each radio reception device in the radio reception equipment;
decompressing and classifying the radio data to obtain the audio data collected by each radio device, wherein the radio data is obtained by compressing the audio data collected by each radio device;
acquiring volume information of each piece of audio data;
And matching the audio data acquired by the sound receiving devices with the installation position information aiming at each sound receiving device to acquire volume information of each audio data and the corresponding installation position information.
In one embodiment, the determining, for each of the audio data, a noise type corresponding to each of the whistling sound data in the audio data by using band samples of different audio types in a database includes:
for each piece of audio data, carrying out end point detection on the audio data, and determining a whistle wave band and an environmental noise wave band in the audio data;
according to the whistle wave band and the environmental noise wave band, scattered discontinuous audio wave bands in the audio data are removed, and filtered audio data are obtained;
matching the filtered audio data with band samples of different audio types in a database, and identifying the whistle sound data and the noise types of the whistle sound data in the filtered audio data;
and correlating each piece of whistle sound data with each piece of noise type to obtain the noise type corresponding to each piece of whistle sound data in the audio data.
In one embodiment, the endpoint detection of the audio data, determining a whistle band and an ambient noise band in the audio data, includes:
performing endpoint detection on the audio data to obtain a voice band to be processed and a noise band to be processed;
calculating the logarithmic spectrum distance of the voice wave band to be processed and the noise wave band to be processed;
calculating an average distance of the log spectral distances;
when the average distance is smaller than a preset distance threshold value, a noise mark position is obtained;
when the average distance is larger than the preset distance threshold value, obtaining a voice mark position;
and obtaining the whistle wave band and the environmental noise wave band in the audio data according to the noise mark position and the voice mark position.
In one embodiment, the determining, for each of the noise types, the location of the sound source corresponding to the sound data according to the volume information of the plurality of sound data belonging to the same noise type and the installation location information corresponding to each sound data includes:
sorting the volume information of a plurality of the whistle sound data belonging to the same noise type from big to small according to various noise types, and selecting target whistle sound data with the volume at a preset number of bits from the plurality of the whistle sound data;
And determining the positioning position of the whistle sound source according to the volume information of the plurality of target whistle sound data belonging to the same noise type and the target installation position information corresponding to each target whistle sound data.
In one embodiment, the determining the location of the sound source according to the volume information of the plurality of target whistle sound data belonging to the same noise type and the target installation position information corresponding to each target whistle sound data includes:
for each target whistle sound data, adjusting the radius of a circle generated based on the target installation position information by using the volume information of the target whistle sound data, wherein the volume information is proportional data;
when the circles generated by the target installation position information intersect at one point, acquiring the target radius of the circle generated by the target installation position information;
determining the imaging distance of the whistle sound source according to the installation height and the target radius of the target radio device corresponding to the target whistle sound data aiming at each target whistle sound data;
and determining the positioning position of the whistle sound source according to the target installation position information corresponding to each target whistle sound data and the imaging distance of the whistle sound source aiming at each noise type.
In one embodiment, after determining the location of the whistling sound source, the method further comprises:
and for each whistle sound source, after a plurality of positioning positions in a continuous time period are obtained, connecting the positioning positions in sequence to obtain a moving track of the whistle sound source.
In a second aspect, an embodiment of the present application provides a whistle sound source positioning system, including a sound receiving device, an information processing platform, and a supervision device, where the sound receiving device is provided with a plurality of sound receiving devices;
the sound receiving equipment is used for collecting sounds of external environments through the sound receiving devices to obtain audio data of the sound receiving devices;
the audio data of each sound receiving device is compressed to obtain sound receiving data;
the information processing platform is used for decompressing and classifying the radio data to obtain the audio data collected by each radio device;
the audio receiving device is further used for matching the audio data acquired by the audio receiving device with the installation position information for each audio receiving device after acquiring the volume information of each audio data to acquire the volume information of each audio data and the corresponding installation position information;
The method is also used for determining the noise type corresponding to each piece of whistle sound data in the audio data by utilizing band samples of different audio types in a database;
the method is also used for determining the positioning position of the whistle sound source corresponding to the whistle sound data according to the volume information of a plurality of whistle sound data belonging to the same noise type and the installation position information corresponding to each whistle sound data aiming at various noise types;
the method is also used for sequentially connecting the positioning positions after a plurality of positioning positions in a continuous time period are obtained for each whistle sound source to obtain a moving track of the whistle sound source;
the method is also used for displaying the positioning position and the moving track of each whistling sound source on a two-dimensional image;
the supervision device is used for storing and displaying the positioning position and the moving track of each whistling sound source.
In a third aspect, an embodiment of the present application provides an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, the processor implementing the method according to any one of the first aspects when executing the computer program.
In a fourth aspect, embodiments of the present application provide a computer readable storage medium storing a computer program which, when executed by a processor, implements a method as in any of the first aspects above.
In a fifth aspect, embodiments of the present application provide a computer program product for, when run on an electronic device, causing the electronic device to perform the method of any one of the first aspects.
Compared with the prior art, the embodiment of the application has the beneficial effects that:
the method comprises the steps of obtaining audio data collected by each radio device, volume information of each audio data and corresponding installation position information; for each piece of audio data, determining the noise type corresponding to each piece of whistling sound data in the audio data by utilizing band samples of different audio types in the database; determining the positioning position of a whistle sound source corresponding to the whistle sound data according to the volume information of a plurality of whistle sound data belonging to the same noise type and the installation position information corresponding to each whistle sound data aiming at various noise types; because the positioning position of the whistle sound source is determined through the audio data, only the sound receiving equipment is required to be arranged, and the sound receiving equipment and the camera are not required to be arranged, so that the cost can be reduced; meanwhile, only one type of data is required to be processed, and two types of data are not required to be processed, so that the data transmission quantity can be reduced, and the data operation efficiency can be improved.
It will be appreciated that the advantages of the second to fifth aspects may be found in the relevant description of the first aspect, and are not described here again.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are needed in the embodiments or the description of the prior art will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and that other drawings can be obtained according to these drawings without inventive effort for a person skilled in the art.
FIG. 1 is a schematic flow chart of a method for locating a sound source of a whistle according to an embodiment of the present application;
FIG. 2 is a schematic diagram illustrating the effect of endpoint detection according to an embodiment of the present application;
FIG. 3 is a diagram illustrating a change in volume decibel level according to an embodiment of the present application;
FIG. 4 is a schematic view of circles intersecting at a point according to an embodiment of the present application;
FIG. 5 is a schematic diagram of a positioning position according to an embodiment of the present application;
FIG. 6 is a schematic diagram of a second flow chart of a method for locating a sound source of a whistle according to an embodiment of the present application;
FIG. 7 is a schematic diagram of a third flow chart of a method for locating a sound source of a whistle according to an embodiment of the present application;
FIG. 8 is a schematic diagram of a fourth flow chart of a method for locating a sound source of a whistle according to an embodiment of the present application;
FIG. 9 is a schematic diagram of a whistling sound source localization system according to an embodiment of the present application;
fig. 10 is a schematic structural diagram of an electronic device according to an embodiment of the present application.
Detailed Description
In the following description, for purposes of explanation and not limitation, specific details are set forth such as the particular system architecture, techniques, etc., in order to provide a thorough understanding of the embodiments of the present application. It will be apparent, however, to one skilled in the art that the present application may be practiced in other embodiments that depart from these specific details. In other instances, detailed descriptions of well-known systems, devices, circuits, and methods are omitted so as not to obscure the description of the present application with unnecessary detail.
It should be understood that the terms "comprises" and/or "comprising," when used in this specification and the appended claims, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof.
It should also be understood that the term "and/or" as used in the present specification and the appended claims refers to any and all possible combinations of one or more of the associated listed items, and includes such combinations.
As used in the present description and the appended claims, the term "if" may be interpreted as "when..once" or "in response to a determination" or "in response to detection" depending on the context. Similarly, the phrase "if a determination" or "if a [ described condition or event ] is detected" may be interpreted in the context of meaning "upon determination" or "in response to determination" or "upon detection of a [ described condition or event ]" or "in response to detection of a [ described condition or event ]".
Furthermore, the terms "first," "second," "third," and the like in the description of the present specification and in the appended claims, are used for distinguishing between descriptions and not necessarily for indicating or implying a relative importance.
Reference in the specification to "one embodiment" or "some embodiments" or the like means that a particular feature, structure, or characteristic described in connection with the embodiment is included in one or more embodiments of the application. Thus, appearances of the phrases "in one embodiment," "in some embodiments," "in other embodiments," and the like in the specification are not necessarily all referring to the same embodiment, but mean "one or more but not all embodiments" unless expressly specified otherwise. The terms "comprising," "including," "having," and variations thereof mean "including but not limited to," unless expressly specified otherwise.
Fig. 1 is a schematic flow chart of a first method for locating a sound source of a whistle according to an embodiment of the application. As shown in fig. 1, the method includes:
s11: and acquiring the audio data acquired by each sound receiving device, the volume information of each audio data and the installation position information of each sound receiving device.
In one possible implementation, for more stable data transmission and higher efficiency, the audio data collected by each sound receiving device is compressed before the data is transmitted, so as to obtain sound receiving data. And receiving the radio data in the compressed state, decompressing and classifying the radio data, and obtaining the audio data collected by each radio device.
The sound receiving device can be a microphone. The radio devices are separated by a certain distance so as not to influence the normal radio.
Specifically, step S11 includes:
s111: and receiving the radio data sent by the radio equipment and the installation position information of each radio device in the radio equipment, wherein the radio data is obtained by compressing the audio data collected by each radio device.
The installation position information of the sound receiving device can be represented by codes, and the installation position of the sound receiving device can be obtained through code inquiry.
S112: and decompressing and classifying the radio data to obtain the audio data collected by each radio device.
In the application, after the radio data is decompressed, the decompressed data is classified according to the radio devices, and the audio data of each radio device is obtained.
S113: and acquiring volume information of each audio data.
S114: and matching the audio data collected by the sound collecting device with the installation position information aiming at each sound collecting device to obtain the volume information and the corresponding installation position information of each audio data.
In the application, according to the sound receiving device, matching and associating the audio data collected by the sound receiving device with the installation position information of the sound receiving device, so as to obtain the volume information of each audio data and the corresponding installation position information.
S12: and determining the noise type corresponding to each whistling sound data in the audio data by utilizing the band samples of different audio types in the database according to each audio data.
In an application, an audio data may include a whistle sound data and an ambient noise data or include a plurality of whistle sound data and an ambient noise data.
To accurately identify the whistle sound data in the audio data, audio sample matching may be utilized to identify the whistle sound data. And collecting the whistle sound data of different kinds of whistle sound sources in advance to obtain band samples of the whistle sounds of different audio kinds. And constructing a database according to the band samples of different audio types.
And matching the band sample with the audio data, and identifying each piece of whistle sound data and the noise type of the whistle sound data in the audio data.
S13: and determining the positioning position of the whistle sound source corresponding to the whistle sound data according to the volume information of a plurality of whistle sound data belonging to the same noise type and the installation position information corresponding to each whistle sound data aiming at various noise types.
In application, the volume information of the whistle sound data can characterize the distance of the whistle sound source from the sound receiving device. And determining a position of the whistle sound source according to the plurality of whistle sound data belonging to the same noise type and the corresponding installation position information. And determining the positioning position of the accurate whistle sound source according to the positions of the whistle sound sources.
After the audio data collected by each sound receiving device in a time period, the volume information of each audio data and the installation position information of each sound receiving device are obtained, the noise types corresponding to each whistle sound data in the audio data can be determined by utilizing band samples of different audio types in a database according to each audio data, and the positioning positions of whistle sound sources corresponding to the whistle sound data are determined according to the volume information of a plurality of whistle sound data belonging to the same noise type and the installation position information corresponding to each whistle sound data according to each noise type.
It can be understood that, through the band sample of different audio types in the database, confirm the noise type that each whistle sound data corresponds in the audio data, can distinguish different whistle sound sources, provide the basis for locating a plurality of whistle sound sources. And then according to the volume information of a plurality of whistle sound data belonging to the same noise type and the installation position information corresponding to each whistle sound data, the positioning position of the whistle sound source can be accurately determined, the positioning precision of the whistle sound source is improved, and the supervision reliability of illegal whistle vehicles is also enhanced. Meanwhile, various whistle vehicles can be monitored.
Meanwhile, because the radio receiving equipment and the camera are not required to be arranged, the sampling cost is reduced, a large number of radio receiving devices are conveniently distributed and controlled, and the positioning accuracy is improved.
The method comprises the steps of obtaining audio data collected by each radio device, volume information of each audio data and corresponding installation position information; for each piece of audio data, determining the noise type corresponding to each piece of whistling sound data in the audio data by utilizing band samples of different audio types in the database; determining the positioning position of a whistle sound source corresponding to the whistle sound data according to the volume information of a plurality of whistle sound data belonging to the same noise type and the installation position information corresponding to each whistle sound data aiming at various noise types; because the positioning position of the whistle sound source is determined through the audio data, only the sound receiving equipment is required to be arranged, and the sound receiving equipment and the camera are not required to be arranged, so that the cost can be reduced; meanwhile, only one type of data is required to be processed, and two types of data are not required to be processed, so that the data transmission quantity can be reduced, and the data operation efficiency can be improved.
In one embodiment, step S12 includes:
s121: and aiming at each audio data, carrying out end point detection on the audio data, and determining a whistle wave band and an environmental noise wave band in the audio data.
In application, step S121 includes:
s21: and detecting the end point of the audio data to obtain a voice band to be processed and a noise band to be processed.
In application, a threshold comparison method is used for extracting characteristic points of audio data on a time domain and a frequency domain, and a target characteristic point is selected through a threshold value to obtain a voice starting endpoint and a terminal endpoint so as to obtain a voice wave band to be processed and a noise wave band to be processed.
S22: and calculating the logarithmic spectrum distance of the voice wave band to be processed and the noise wave band to be processed.
S23: an average distance of the log-spectral distances is calculated.
In application, the log-spectral distance is divided by the duration of the audio data to obtain an average distance.
S24: and when the average distance is smaller than a preset distance threshold value, obtaining the noise mark position.
In the application, when the average distance is smaller than a preset distance threshold, the number of noise mark positions is increased, the noise mark positions are obtained, and the number of voice mark positions is set to zero.
S25: and when the average distance is greater than a preset distance threshold, obtaining the voice mark position.
In the application, when the average distance is larger than a preset distance threshold, the number of voice mark positions and noise mark positions is determined to be zero.
S26: and according to the noise mark position and the voice mark position, a whistling wave band and an environmental noise wave band in the audio data are obtained.
Fig. 2 is a schematic diagram illustrating an effect of endpoint detection according to an embodiment of the present application. As shown in fig. 2, from top to bottom, the first graph is the noisy audio data, the second graph is the non-noisy whistle data, and the third graph is the effect graph after endpoint detection based on log spectrum. The detected end point in the third graph corresponds to the start end point and the end point of the whistling sound data of the second graph.
Accurate detection of endpoints of the whistle wave band and the environmental noise wave band is achieved through utilizing the logarithmic spectrum distance, and the whistle wave band and the environmental noise wave band are effectively detected.
S122: and removing scattered discontinuous audio bands in the audio data according to the whistle band and the environmental noise band to obtain filtered audio data.
S123: and matching the filtered audio data with band samples of different audio types in a database, and identifying whistle sound data in the filtered audio data and noise types of the whistle sound data.
In the application, the filtered audio data is subjected to band matching with band samples of different audio types in a database or the bands of different audio types are subjected to database loading, and the whistle sound data and the noise types of the whistle sound data in the filtered audio data are identified.
Specifically, the frequency variation caused by different noise frequencies is different, and the band matching is performed by the peak value and the frequency of the band.
S124: and correlating each whistle sound data with each noise type to obtain the noise type corresponding to each whistle sound data in the audio data.
According to the embodiment, the scattered and discontinuous audio bands in the audio data are removed according to the whistle band and the environmental noise band, the filtered audio data are obtained, the filtered audio data are matched with band samples of different audio types in a database, the whistle sound data and the noise types of the whistle sound data in the filtered audio data are identified, and the noise types of the whistle sound data and the whistle sound data can be identified more accurately based on the clearer filtered audio data.
In one embodiment, step S13 includes:
s131: and ordering the volume information of the plurality of whistle sound data belonging to the same noise type from large to small according to various noise types, and selecting target whistle sound data with the volume at a preset number of bits from the plurality of whistle sound data.
In the application, for convenience of volume size sorting, sorting is performed through a change chart of volume decibel sizes. Correspondingly, step S113 includes: and drawing a volume decibel change chart of the audio data according to the time change to obtain volume information of the audio data.
Fig. 3 is a schematic diagram of a change chart of volume decibel according to an embodiment of the application. As shown in fig. 3, which is a graph of the volume decibel level of audio data over time.
And iterating the volume decibels of a plurality of whistle sound data belonging to the same noise type in a time period, and sequencing from big to small.
S132: and determining the positioning position of the whistle sound source according to the volume information of the plurality of target whistle sound data belonging to the same noise type and the target installation position information corresponding to each target whistle sound data.
The positioning position of the whistle sound source is determined according to the volume information of the target whistle sound data with the volume at the front preset number of positions and the target installation position information corresponding to each target whistle sound data, so that the positioning position of the whistle sound source can be accurately determined, and the reliability and the authenticity of the positioning position of the whistle sound source are high.
Step S132, including:
s31: for each target whistle sound data, the radius of a circle generated based on the target installation position information is adjusted by using the volume information of the target whistle sound data, and the volume information is the proportion data.
S32: when circles generated by the target installation position information intersect at one point, the target radius of the circles generated by the target installation position information is obtained.
In the application, the volume decibel size of the target whistle sound data is used as the proportion data, and the circle generated based on the target installation position information is scaled. When the circles generated by the respective target mounting position information intersect at a point, the point is the position of the sound source of the whistling. And the target radius is the distance value between the position of the whistle sound source and the sound receiving device, and is a fixed distance value.
FIG. 4 is a schematic diagram of a circle intersecting at a point according to an embodiment of the present application. As shown in fig. 4, the position of the radio device in the figure is a target installation position, the black circle in the figure is a circle generated based on the target installation position information, the black circle intersects at a point after scaling based on the proportion data, the vehicle at the intersection point is an illegal whistling vehicle, and the position of the vehicle in the figure is the position of a whistling sound source.
S33: and determining the imaging distance of the whistle sound source according to the installation height and the target radius of the target radio device corresponding to the target whistle sound data aiming at each target whistle sound data.
In application, the imaging distance of the whistling sound source is calculated by a formula:s is the imaging distance, L is the distance value, and h is the mounting height.
S34: and determining the positioning position of the whistle sound source according to the target installation position information corresponding to the whistle sound data of each noise type and the imaging distance of the whistle sound source.
Fig. 5 is a schematic diagram of a positioning position according to an embodiment of the present application. As shown in fig. 5, the target installation position information of the radio receiver corresponding to each target whistle sound data is converted into the imaging distance of the whistle sound source by using a sound source localization algorithm or an acoustic ranging technique, and the localization position of the whistle sound source is determined.
The positioning position of the whistle sound source can be accurately determined according to the target installation position information corresponding to the plurality of target whistle sound data and the imaging distance of the whistle sound source.
Fig. 6 is a schematic diagram of a second flow chart of a method for locating a sound source of a whistle according to an embodiment of the application. As shown in fig. 6, after determining the location of the whistling sound source, the method further includes:
S14: and connecting the positioning positions in sequence after obtaining a plurality of positioning positions in a continuous time period for each whistle sound source to obtain a moving track of the whistle sound source.
In an application, the continuous time period includes a plurality of time periods. And in different time periods in the continuous time period, the target whistle sound data with the volume at the preset number of positions is overlapped to acquire the positioning position of the whistle sound source. Namely, steps S131-S132 are executed: and ordering the volume information of a plurality of whistle sound data belonging to the same noise type from large to small according to various noise types, selecting target whistle sound data with the volume at a preset number of bits from the plurality of whistle sound data, and determining the positioning position of a whistle sound source according to the volume information of the plurality of target whistle sound data belonging to the same noise type and the target installation position information corresponding to each target whistle sound data.
After a plurality of positioning positions are obtained in a continuous time period, the positioning positions are sequentially and linearly connected, and a moving track can be obtained.
According to the embodiment, the moving track of the whistle sound source is determined according to the positioning position determined based on the audio, the moving track of the whistle sound source is not required to be determined based on two kinds of data, the data transmission amount is small, the data operation amount is small, and further the data operation efficiency is high.
Fig. 7 is a schematic diagram of a third flow chart of a method for locating a sound source of a whistle according to an embodiment of the application. As shown in fig. 7, after obtaining the moving track of the whistling sound source, the method further includes:
s15: the localization position and the movement track of each whistle sound source are displayed on the two-dimensional image.
According to the embodiment, the two-dimensional imaging is carried out on the positioning positions and the moving tracks of the sound sources of the whistle, so that a user can conveniently and uniformly manage illegal whistle vehicles.
Fig. 8 is a schematic diagram of a fourth flow chart of a method for locating a sound source of a whistle according to an embodiment of the application. As shown in fig. 8, after obtaining the moving track of the whistling sound source, the method further includes:
s16: and sending the positioning positions and the moving tracks of the sound sources of the whistle to the supervision equipment so that the supervision equipment stores and displays the positioning positions and the moving tracks of the sound sources of the whistle.
In one possible implementation, the localization position and the movement track of each whistle sound source are directly sent to the supervision device, and the supervision device performs two-dimensional imaging and displaying on the localization position and the movement track of each whistle sound source.
In one possible implementation, the image display information of the positioning position and the moving track of each whistle sound source may be sent to the supervision device, and the supervision device displays according to the image display information.
According to the embodiment, the positioning positions and the moving tracks of the sound sources of the whistle are sent to the supervision equipment, so that the supervision equipment stores the positioning positions and the moving tracks of the sound sources of the whistle, the backup storage of the positioning positions and the moving tracks is realized, and the follow-up supervision analysis and information processing of illegal whistle vehicles by a user are facilitated. And sending the positioning positions and the moving tracks of the sound sources of the whistle to the supervision equipment so that the supervision equipment displays the positioning positions and the moving tracks of the sound sources of the whistle, thereby facilitating the user to conduct on-site supervision treatment on illegal whistle vehicles in real time.
It should be understood that the sequence number of each step in the foregoing embodiment does not mean that the execution sequence of each process should be determined by the function and the internal logic, and should not limit the implementation process of the embodiment of the present application.
Corresponding to the methods described in the above embodiments, only those relevant to the embodiments of the present application are shown for convenience of explanation.
Fig. 9 is a schematic structural diagram of a whistling sound source positioning system according to an embodiment of the present application, and as shown in fig. 9, the system includes a sound receiving device 10, an information processing platform 11, and a supervision device 12, where the sound receiving device is provided with a plurality of sound receiving devices.
The sound receiving device 10 is used for acquiring sound of an external environment through each sound receiving device and obtaining audio data of each sound receiving device;
and the audio data compression device is also used for compressing the audio data of each sound receiving device to obtain sound receiving data.
The information processing platform 11 is used for decompressing and classifying the radio data to obtain audio data collected by each radio device;
the device is also used for matching the audio data collected by the sound collecting device with the installation position information for each sound collecting device after determining the volume information of each audio data to obtain the volume information of each audio data and the corresponding installation position information;
the method is also used for determining the noise type corresponding to each whistling sound data in the audio data by utilizing the band samples of different audio types in the database according to each audio data;
the method is also used for determining the positioning position of the whistle sound source corresponding to the whistle sound data according to the volume information of a plurality of whistle sound data belonging to the same noise type and the installation position information corresponding to each whistle sound data aiming at various noise types;
and the system is also used for connecting the positioning positions in sequence after obtaining a plurality of positioning positions in a continuous time period for each whistle sound source to obtain a moving track of the whistle sound source.
A supervisory device 12 for storing and displaying the location and movement track of each of the sound sources of the sirens.
In one embodiment, the information processing platform comprises a data processing module, a filtering classification module, a volume comparison module, a sound source positioning module and an imaging module.
The data processing module is used for decompressing and classifying the radio data to obtain the audio data collected by each radio device; after the volume information of each audio data is determined, matching the audio data collected by the sound collecting device with the installation position information according to each sound collecting device to obtain the volume information of each audio data and the corresponding installation position information.
The filtering classification module is used for carrying out end point detection on the audio data aiming at each audio data and determining a whistling wave band and an environmental noise wave band in the audio data; according to the whistling wave band and the environmental noise wave band, scattered discontinuous audio wave bands in the audio data are removed, and filtered audio data are obtained; matching the filtered audio data with band samples of different audio types in a database, and identifying whistle sound data in the filtered audio data and noise types of the whistle sound data; and correlating each whistle sound data with each noise type to obtain the noise type corresponding to each whistle sound data in the audio data.
The volume comparison module is used for sequencing volume information of a plurality of whistle sound data belonging to the same noise type from large to small according to various noise types, and selecting target whistle sound data with the volume at a preset number of bits from the plurality of whistle sound data.
The sound source positioning module is used for adjusting the radius of a circle generated based on the target installation position information by utilizing the volume information of the target whistle sound data aiming at each target whistle sound data, wherein the volume information is proportional data; when circles generated by the target installation position information intersect at one point, acquiring the target radius of the circles generated by the target installation position information; aiming at each target whistle sound data, determining the imaging distance of a whistle sound source according to the installation height and the target radius of the target radio device corresponding to the target whistle sound data; determining the positioning position of the whistle sound source according to the target installation position information corresponding to the whistle sound data of each noise type and the imaging distance of the whistle sound source; and connecting the positioning positions in sequence after obtaining a plurality of positioning positions in a continuous time period for each whistle sound source to obtain a moving track of the whistle sound source.
And the imaging module is used for displaying the positioning position and the moving track of each whistling sound source on the two-dimensional image.
In the application, the time synchronization with the data processing module is needed in the processing process of the volume comparison module, the time domain synchronization module is electrically connected with the volume comparison module and the data processing module, and the time synchronization of the volume comparison module and the data processing module can be controlled through the time domain synchronization module.
Fig. 10 is a schematic structural diagram of an electronic device according to an embodiment of the present application. As shown in fig. 10, the electronic apparatus 2 of this embodiment includes: at least one processor 20 (only one is shown in fig. 10), a memory 21 and a computer program 22 stored in the memory 21 and executable on the at least one processor 20, the processor 20 implementing the steps in any of the various method embodiments described above when executing the computer program 22.
The electronic device 2 may be a computing device such as a desktop computer or a cloud server. The electronic device 2 may include, but is not limited to, a processor 20, a memory 21. It will be appreciated by those skilled in the art that fig. 10 is merely an example of the electronic device 2 and is not meant to be limiting of the electronic device 2, and may include more or fewer components than shown, or may combine certain components, or different components, such as may also include input-output devices, network access devices, etc.
The processor 20 may be a central processing unit (Central Processing Unit, CPU), and the processor 20 may also be other general purpose processors, digital signal processors (Digital Signal Processor, DSP), application specific integrated circuits (Application Specific Integrated Circuit, ASIC), off-the-shelf programmable gate arrays (Field-Programmable Gate Array, FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, or the like. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.
The memory 21 may in some embodiments be an internal storage unit of the electronic device 2, such as a hard disk or a memory of the electronic device 2. The memory 21 may in other embodiments also be an external storage device of the electronic device 2, such as a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card) or the like, which are provided on the electronic device 2. Further, the memory 21 may also include both an internal storage unit and an external storage device of the electronic device 2. The memory 21 is used for storing an operating system, application programs, boot loader (BootLoader), data, other programs, etc., such as program codes of the computer program. The memory 21 may also be used for temporarily storing data that has been output or is to be output.
It should be noted that, because the content of information interaction and execution process between the above devices/units is based on the same concept as the method embodiment of the present application, specific functions and technical effects thereof may be referred to in the method embodiment section, and will not be described herein.
It will be apparent to those skilled in the art that, for convenience and brevity of description, only the above-described division of the functional units and modules is illustrated, and in practical application, the above-described functional distribution may be performed by different functional units and modules according to needs, i.e. the internal structure of the apparatus is divided into different functional units or modules to perform all or part of the above-described functions. The functional units and modules in the embodiment may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit, where the integrated units may be implemented in a form of hardware or a form of a software functional unit. In addition, the specific names of the functional units and modules are only for distinguishing from each other, and are not used for limiting the protection scope of the present application. The specific working process of the units and modules in the above system may refer to the corresponding process in the foregoing method embodiment, which is not described herein again.
Embodiments of the present application also provide a computer readable storage medium storing a computer program which, when executed by a processor, performs the steps of the respective method embodiments described above.
Embodiments of the present application provide a computer program product which, when run on an electronic device, causes the electronic device to perform the steps of the method embodiments described above.
The integrated units, if implemented in the form of software functional units and sold or used as stand-alone products, may be stored in a computer readable storage medium. Based on such understanding, the present application may implement all or part of the flow of the method of the above embodiments, and may be implemented by a computer program to instruct related hardware, where the computer program may be stored in a computer readable storage medium, and when the computer program is executed by a processor, the computer program may implement the steps of each of the method embodiments described above. Wherein the computer program comprises computer program code which may be in source code form, object code form, executable file or some intermediate form etc. The computer readable medium may include at least: any entity or device capable of carrying computer program code to a photographing device/terminal apparatus, recording medium, computer Memory, read-Only Memory (ROM), random access Memory (RAM, random Access Memory), electrical carrier signals, telecommunications signals, and software distribution media. Such as a U-disk, removable hard disk, magnetic or optical disk, etc. In some jurisdictions, computer readable media may not be electrical carrier signals and telecommunications signals in accordance with legislation and patent practice.
In the foregoing embodiments, the descriptions of the embodiments are emphasized, and in part, not described or illustrated in any particular embodiment, reference is made to the related descriptions of other embodiments.
Those of ordinary skill in the art will appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.
In the embodiments provided in the present application, it should be understood that the disclosed apparatus/network device and method may be implemented in other manners. For example, the apparatus/network device embodiments described above are merely illustrative, e.g., the division of the modules or units is merely a logical functional division, and there may be additional divisions in actual implementation, e.g., multiple units or components may be combined or integrated into another system, or some features may be omitted, or not performed. Alternatively, the coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection via interfaces, devices or units, which may be in electrical, mechanical or other forms.
The units described as separate units may or may not be physically separate, and units shown as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
The above embodiments are only for illustrating the technical solution of the present application, and not for limiting the same; although the application has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical scheme described in the foregoing embodiments can be modified or some technical features thereof can be replaced by equivalents; such modifications and substitutions do not depart from the spirit and scope of the technical solutions of the embodiments of the present application, and are intended to be included in the scope of the present application.

Claims (10)

1. A method of flute sound source localization comprising:
acquiring audio data acquired by each radio receiving device, volume information of each audio data and installation position information of each radio receiving device;
For each piece of audio data, determining the noise type corresponding to each piece of whistling sound data in the audio data by utilizing band samples of different audio types in a database;
and determining the positioning position of the whistle sound source corresponding to the whistle sound data according to the volume information of a plurality of whistle sound data belonging to the same noise type and the installation position information corresponding to each whistle sound data aiming at various noise types.
2. The method of claim 1, wherein the acquiring the audio data collected by each sound receiving device, the volume information of each audio data, and the installation position information of each sound receiving device comprises:
receiving radio reception data sent by radio reception equipment and the installation position information of each radio reception device in the radio reception equipment;
decompressing and classifying the radio data to obtain the audio data collected by each radio device, wherein the radio data is obtained by compressing the audio data collected by each radio device;
acquiring volume information of each piece of audio data;
and matching the audio data acquired by the sound receiving devices with the installation position information aiming at each sound receiving device to acquire volume information of each audio data and the corresponding installation position information.
3. The method of claim 1, wherein the determining, for each of the audio data, a noise type corresponding to each of the whistling sound data in the audio data using band samples of different audio categories in a database, comprises:
for each piece of audio data, carrying out end point detection on the audio data, and determining a whistle wave band and an environmental noise wave band in the audio data;
according to the whistle wave band and the environmental noise wave band, scattered discontinuous audio wave bands in the audio data are removed, and filtered audio data are obtained;
matching the filtered audio data with band samples of different audio types in a database, and identifying the whistle sound data and the noise types of the whistle sound data in the filtered audio data;
and correlating each piece of whistle sound data with each piece of noise type to obtain the noise type corresponding to each piece of whistle sound data in the audio data.
4. The method of claim 3, wherein the endpoint detection of the audio data to determine a whistle band and an ambient noise band in the audio data comprises:
Performing endpoint detection on the audio data to obtain a voice band to be processed and a noise band to be processed;
calculating the logarithmic spectrum distance of the voice wave band to be processed and the noise wave band to be processed;
calculating an average distance of the log spectral distances;
when the average distance is smaller than a preset distance threshold value, a noise mark position is obtained;
when the average distance is larger than the preset distance threshold value, obtaining a voice mark position;
and obtaining the whistle wave band and the environmental noise wave band in the audio data according to the noise mark position and the voice mark position.
5. The method according to any one of claims 1 to 4, wherein the determining, for each of the noise types, the location of the sound source corresponding to the sound data according to the volume information of the plurality of sound data belonging to the same noise type and the installation position information corresponding to each of the sound data, includes:
sorting the volume information of a plurality of the whistle sound data belonging to the same noise type from big to small according to various noise types, and selecting target whistle sound data with the volume at a preset number of bits from the plurality of the whistle sound data;
And determining the positioning position of the whistle sound source according to the volume information of the plurality of target whistle sound data belonging to the same noise type and the target installation position information corresponding to each target whistle sound data.
6. The method of claim 5, wherein determining the location of the blast sound source based on the volume information of the plurality of target blast sound data belonging to the same noise type and target installation position information corresponding to each of the target blast sound data comprises:
for each target whistle sound data, adjusting the radius of a circle generated based on the target installation position information by using the volume information of the target whistle sound data, wherein the volume information is proportional data;
when the circles generated by the target installation position information intersect at one point, acquiring the target radius of the circle generated by the target installation position information;
determining the imaging distance of the whistle sound source according to the installation height and the target radius of the target radio device corresponding to the target whistle sound data aiming at each target whistle sound data;
and determining the positioning position of the whistle sound source according to the target installation position information corresponding to each target whistle sound data and the imaging distance of the whistle sound source aiming at each noise type.
7. The method of claim 6, further comprising, after determining the location of the blast sound source:
and for each whistle sound source, after a plurality of positioning positions in a continuous time period are obtained, connecting the positioning positions in sequence to obtain a moving track of the whistle sound source.
8. The whistle sound source positioning system is characterized by comprising a sound receiving device, an information processing platform and a supervision device, wherein the sound receiving device is provided with a plurality of sound receiving devices;
the sound receiving equipment is used for collecting sounds of external environments through the sound receiving devices to obtain audio data of the sound receiving devices;
the audio data of each sound receiving device is compressed to obtain sound receiving data;
the information processing platform is used for decompressing and classifying the radio data to obtain the audio data collected by each radio device;
the audio receiving device is further used for matching the audio data acquired by the audio receiving device with the installation position information for each audio receiving device after acquiring the volume information of each audio data to acquire the volume information of each audio data and the corresponding installation position information;
The method is also used for determining the noise type corresponding to each piece of whistle sound data in the audio data by utilizing band samples of different audio types in a database;
the method is also used for determining the positioning position of the whistle sound source corresponding to the whistle sound data according to the volume information of a plurality of whistle sound data belonging to the same noise type and the installation position information corresponding to each whistle sound data aiming at various noise types;
the method is also used for sequentially connecting the positioning positions after a plurality of positioning positions in a continuous time period are obtained for each whistle sound source to obtain a moving track of the whistle sound source;
the method is also used for displaying the positioning position and the moving track of each whistling sound source on a two-dimensional image;
the supervision device is used for storing and displaying the positioning position and the moving track of each whistling sound source.
9. An electronic device comprising a memory, a processor and a computer program stored in the memory and executable on the processor, wherein the processor implements the method of any one of claims 1 to 7 when the computer program is executed.
10. A computer readable storage medium storing a computer program, characterized in that the computer program when executed by a processor implements the method according to any one of claims 1 to 7.
CN202311226357.7A 2023-09-22 2023-09-22 Method and system for positioning whistle sound source, electronic equipment and readable storage medium Pending CN116990755A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202311226357.7A CN116990755A (en) 2023-09-22 2023-09-22 Method and system for positioning whistle sound source, electronic equipment and readable storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202311226357.7A CN116990755A (en) 2023-09-22 2023-09-22 Method and system for positioning whistle sound source, electronic equipment and readable storage medium

Publications (1)

Publication Number Publication Date
CN116990755A true CN116990755A (en) 2023-11-03

Family

ID=88530410

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202311226357.7A Pending CN116990755A (en) 2023-09-22 2023-09-22 Method and system for positioning whistle sound source, electronic equipment and readable storage medium

Country Status (1)

Country Link
CN (1) CN116990755A (en)

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070159924A1 (en) * 2006-01-06 2007-07-12 Dieterich Vook Acoustic location and enhancement
CN101246690A (en) * 2007-02-15 2008-08-20 索尼株式会社 Sound processing apparatus, sound processing method and program
US20100111290A1 (en) * 2008-11-04 2010-05-06 Ryuichi Namba Call Voice Processing Apparatus, Call Voice Processing Method and Program
CN101740038A (en) * 2008-11-04 2010-06-16 索尼株式会社 Sound processing apparatus, sound processing method and program
US20130123962A1 (en) * 2011-11-11 2013-05-16 Nintendo Co., Ltd. Computer-readable storage medium storing information processing program, information processing device, information processing system, and information processing method
CN109448389A (en) * 2018-11-23 2019-03-08 西安联丰迅声信息科技有限责任公司 A kind of vehicle whistle intelligent detecting method
CN114690119A (en) * 2020-12-28 2022-07-01 浙江宇视科技有限公司 Vehicle whistle positioning method, device, medium and electronic equipment
CN115116232A (en) * 2022-08-29 2022-09-27 深圳市微纳感知计算技术有限公司 Voiceprint comparison method, device and equipment for automobile whistling and storage medium
CN116778963A (en) * 2023-06-20 2023-09-19 西北工业大学 Automobile whistle recognition method based on self-attention mechanism

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070159924A1 (en) * 2006-01-06 2007-07-12 Dieterich Vook Acoustic location and enhancement
CN101246690A (en) * 2007-02-15 2008-08-20 索尼株式会社 Sound processing apparatus, sound processing method and program
US20100111290A1 (en) * 2008-11-04 2010-05-06 Ryuichi Namba Call Voice Processing Apparatus, Call Voice Processing Method and Program
CN101740038A (en) * 2008-11-04 2010-06-16 索尼株式会社 Sound processing apparatus, sound processing method and program
US20130123962A1 (en) * 2011-11-11 2013-05-16 Nintendo Co., Ltd. Computer-readable storage medium storing information processing program, information processing device, information processing system, and information processing method
CN109448389A (en) * 2018-11-23 2019-03-08 西安联丰迅声信息科技有限责任公司 A kind of vehicle whistle intelligent detecting method
CN114690119A (en) * 2020-12-28 2022-07-01 浙江宇视科技有限公司 Vehicle whistle positioning method, device, medium and electronic equipment
CN115116232A (en) * 2022-08-29 2022-09-27 深圳市微纳感知计算技术有限公司 Voiceprint comparison method, device and equipment for automobile whistling and storage medium
CN116778963A (en) * 2023-06-20 2023-09-19 西北工业大学 Automobile whistle recognition method based on self-attention mechanism

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
刘璐: "音频信号的力触觉特征提取与渲染方法", 《中国优秀硕士学位论文全文数据库 信息科技辑》, no. 1, pages 43 - 52 *

Similar Documents

Publication Publication Date Title
CN110363076B (en) Personnel information association method and device and terminal equipment
US9659092B2 (en) Music information searching method and apparatus thereof
US20140282664A1 (en) Methods and apparatus to classify audio
CN111369799B (en) Method, device and system for detecting modified vehicle
CN111739542B (en) Method, device and equipment for detecting characteristic sound
CN110765823A (en) Target identification method and device
CN113009442B (en) Method and device for identifying multipath target of radar static reflecting surface
US20210160638A1 (en) Methods and apparatus for analyzing microphone placement for watermark and signature recovery
CN112969134A (en) Microphone abnormality detection method, device, equipment and storage medium
CN113674763B (en) Method, system, device and storage medium for identifying whistle by utilizing line spectrum characteristics
CN111128225A (en) Vehicle illegal whistle positioning and identifying method
CN109085624B (en) Indoor and outdoor positioning method and device based on positioning signal intensity and computer equipment
CN108805086B (en) Media control method and audio processing device
CN116990755A (en) Method and system for positioning whistle sound source, electronic equipment and readable storage medium
CN111210817B (en) Data processing method and device
Bisio et al. A television channel real-time detector using smartphones
CN113791386B (en) Sound source positioning method, device, equipment and computer readable storage medium
CN116990754B (en) Method and device for positioning whistle sound source, electronic equipment and readable storage medium
CN111292767B (en) Audio event detection method and device and equipment
CN104835500A (en) Method and device for acquiring audio information
CN116400302B (en) Radar signal receiving and processing method
CN117214819A (en) Sound signal acquisition system, method, device and computer readable storage medium
CN116665660A (en) Vehicle-mounted audio identification method, device, medium and equipment
CN116628481A (en) Electronic countermeasure information source identification method, system, computer and readable storage medium
Deowan et al. A Warning and Detection System for Elephant Intrusions utilizing Signal Processing and IoT

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination