JP2020034657A - Sound collection data display system - Google Patents

Abstract

To provide a sound collection data display system which easily and effectively visualizes an arriving direction of sound obtained by a 3D microphone for evaluating sound environment.SOLUTION: A sound collection data display system 100 comprises intensity calculation means 103, unit angle intensity calculation means 104, and intensity distribution chart creation means 111, which analyze sound collection data obtained by collecting sound for a prescribed period by a 3D microphone 101. The intensity distribution chart creation means 111 converts a polar coordinate of an arriving point of a unit angle intensity into a coordinate system consisting of a latitude and a longitude, which are set on a spherical surface, and creates an "intensity distribution chart" in which the intensity of the unit angle intensity is distributed in the coordinate system consisting of the latitude and the longitude.SELECTED DRAWING: Figure 1

Description

  The present invention is a technique relating to sound environment evaluation. More specifically, in order to evaluate a sound environment, data collected by a microphone having a plurality of channels can be analyzed, and the result can be effectively visualized. The present invention relates to a sound collection data display system.

  Conventionally, sound environment evaluation has been mainly performed by using a measurement result by a noise level meter. This noise level meter is equipped with one omnidirectional microphone and can measure the sound pressure level existing in the environment, but the sound source direction (arrival direction) of the sound and the sound source type of the sound (E.g., noise from construction, noise from driving, noise from home appliances, etc.) cannot be measured. Therefore, when implementing noise countermeasures, it was not possible to properly plan the locations where noise countermeasures should be implemented and the degree of noise countermeasures based only on the measurement results obtained with a noise level meter.

  By the way, in recent years, attention has been paid to an acoustic technique for reproducing a sound field in a three-dimensional manner. Ambisonics, developed by audio engineers, is one of them.For example, the sound field can be changed appropriately according to the rotation of the listener's head, and it is also possible to provide realistic content by combining it with video. It is possible. For this reason, technologies using ambisonics have been proposed in various fields. For example, Patent Document 1 uses ambisonics technology to reproduce sound fields corresponding to a plurality of persons in a vehicle. We propose a method to do it.

JP-A-2006-220032

  Generally, sound collection in ambisonics uses a 3D microphone (also referred to as an ambisonic microphone) having a plurality of individual microphones whose directions are known. For example, four individual microphones, ie, an individual microphone pointing forward and left upward from the center, an individual microphone pointing forward and downward right, an individual microphone pointing backward and left downward, and an individual microphone pointing backward and upper right (that is, from the inside of the tetrahedron to each wall) 3D microphones can be configured by the four individual microphones arranged in different positions.

  If the recording (sound collection data) collected by the 3D microphone is analyzed, the arrival direction of the sound can be obtained. In other words, the arrival direction of the sound, which cannot be measured by the noise level meter commonly used in the conventional sound environment evaluation, can be measured by the 3D microphone. Therefore, it is conceivable to use sound collection data by a 3D microphone to perform sound environment evaluation.

  However, sound environment evaluation using a 3D microphone has not been known so far. The direction of arrival of the sound can be obtained by analyzing the collected sound data by the 3D microphone. However, although there are examples in which the direction of arrival of the sound is visualized, the conventional method uses an expensive system and intuitively uses the sound. It was not possible to grasp the direction of arrival. Therefore, there has been a demand for the development of a method for easily and effectively visualizing sound environment evaluation.

  An object of the present invention is to solve the problems of the prior art, that is, to perform sound environment evaluation, and to easily and effectively visualize the arrival direction of a sound obtained by a 3D microphone, to display collected sound data. Is to provide a system.

  The present invention is based on the point that a reference sphere centered on a sound receiving point is set, and an intensity distribution diagram expressing intensity is created by using the reference sphere, This is an invention made based on an unprecedented idea.

  The sound collection data display system of the present invention is a system that analyzes sound collection data collected for a predetermined period by a 3D microphone, and displays the analysis result using a reference spherical surface. It is provided with calculation means intensity distribution diagram creation means. Note that the “reference sphere” here is a sphere set with a predetermined radius around the sound receiving point. The intensity calculating means is means for calculating “instantaneous intensity” for each sound collecting time from the collected sound data, and the unit angular intensity calculating means is a divided area (a small area obtained by dividing the reference spherical surface into a plurality of areas). ) Is assigned to the instantaneous intensity, and the “unit angle intensity” is obtained by dividing the sound intensity of the instantaneous intensity by the solid angle of the divided area. Further, the intensity distribution diagram creating unit is a unit that creates an “intensity distribution diagram” in which the unit angular intensity is distributed on the reference spherical surface.

  The sound collection data display system of the present invention converts the divided area into a rectangular coordinate system composed of latitude and longitude set on the reference spherical surface, and generates an “intensity distribution diagram” in which unit angular intensity is distributed in the rectangular coordinate system. It can also be created.

  The sound collection data display system of the present invention may further include an arrival angle-specific intensity calculation means. The angle-of-arrival-intensity calculating means is a means for setting the latitude and longitude on the reference spherical surface and calculating the “intensity-by-arrival angle” that is the unit angle intensity for each unit longitude width. In this case, an “intensity distribution diagram” is created in which the intensity at each arrival angle is distributed for each azimuth on the reference cross section that cuts the reference spherical surface. Further, the angle-of-arrival-intensity calculating means may be means for calculating the angle-of-arrival-intensity based on the instantaneous intensity within the designated latitude range.

  The sound collection data display system of the present invention may further include sound source type estimating means. The sound source type estimating means is a means for estimating the intensity sound source type based on the intensity and the temporal change of the intensity of the intensity sound and the sound source type information stored in advance. Note that the sound source type information includes the sound source type, the arrival direction of the sound, the sound intensity, and the time change of the sound. In this case, the intensity distribution chart creating means creates an "intensity distribution chart" in which the unit angular intensity is distributed based on the instantaneous intensity of the sound source type estimated by the sound source type estimating means. The sound source type estimating means may be a means for estimating the sound source type of the intensity based on the time change of the direction of arrival of the intensity, in addition to (or instead of) the time change of the intensity of the sound of the intensity. .

  The sound collection data display system of the present invention may further include a specific sound detection unit. The specific sound detection means is means for detecting an instantaneous intensity in a specific arrival direction range, the instantaneous intensity having a sound intensity exceeding a predetermined intensity threshold. In this case, the intensity distribution diagram creating means creates an “intensity distribution diagram” in which the unit angular intensity is distributed based on the instantaneous intensity detected on the specific sound detecting device surface. Further, the specific sound detecting means may be a means for detecting a predetermined instantaneous intensity on the condition of a specific frequency range.

  The sound collection data display system of the present invention may further include an intensity extraction unit. The intensity extracting means includes an instantaneous intensity of a specific arrival direction range and an intensity exceeding a predetermined intensity threshold among two or more instantaneous intensities obtained from the collected sound data collected for a predetermined period. It is a means to extract the city. In this case, the intensity distribution chart creating means creates an intensity distribution chart at the instant sound pickup time of the intensity extracted by the intensity extracting means.

  The sound collection data display system of the present invention obtains the "unit time intensity" which is the sound intensity of the instantaneous intensity in a predetermined time width, and may obtain the unit angle intensity based on the unit time intensity. it can.

  The sound collection data display system of the present invention may further include frequency condition setting means. The frequency condition setting means is a means for setting a frequency condition. In this case, the intensity calculating means calculates the instantaneous intensity based on the collected sound data extracted according to the frequency condition.

  The sound collection data display system of the present invention may further include time-series display means. The time-series display means is means for continuously displaying intensity distribution diagrams at a plurality of sound collection times in the order of the sound collection times.

The sound collection data display system of the present invention has the following effects.
(1) The direction of arrival of sound can be grasped by using sound collection data by a 3D microphone, and the direction of arrival of sound and the strength of sound can be grasped intuitively from an intensity distribution diagram. As a result. Appropriate sound environment evaluation can be performed, and effective noise countermeasures can be planned.
(2) If the arrival direction and frequency to be focused on are determined in advance, a specific sound (for example, a harmful sound requiring a countermeasure) can be detected by comparing with an intensity threshold.
(3) The sound source type of the collected sound data can be estimated by knowing in advance the characteristics of the sound of the ceiling ventilation in the office, the sound of the printer, etc. (the direction of arrival, the sound intensity, and changes over time). As a result, it is possible to efficiently detect a sound to be countered.

FIG. 1 is a block diagram showing a main configuration of a sound collection data display system according to the present invention. FIG. 4 is a flowchart showing a main processing flow of the sound collection data display system of the present invention. (A) is a mathematical expression showing the A format format sound collection data, and (b) is a mathematical expression showing the B format format sound collection data. The spectrogram figure showing the instantaneous intensity. FIG. 9 is a mathematical diagram for obtaining “sound intensity” and “sound arrival direction” of intensity based on sound pickup data in the B format. (A) is a model diagram showing an arbitrary vector on a reference spherical surface, (b) is a plan view of a vector projected on an equatorial plane (z = 0) of the reference spherical surface, and (c) is a vertical plane (z-axis Sectional view which projected the vector to (including section). FIG. 4 is a model diagram in which a number of divided regions MS are set on a reference spherical surface BF. FIG. 3 is a model diagram illustrating an arrival point. FIG. 3 is a model diagram showing an example of a rectangular coordinate system intensity distribution diagram. FIG. 4 is a mathematical diagram for calculating intensity sound intensity in a predetermined range (azimuth angles θ _{1 to} θ ₂ , elevation angles φ _{1 to} φ ₂ ) when creating a rectangular coordinate system intensity distribution diagram. (A) is a model diagram showing an example of a polar coordinate system intensity distribution diagram, and (b) is a model diagram illustrating a procedure for creating a polar coordinate system intensity distribution diagram. When creating a polar coordinate system intensity distribution diagram, this is a mathematical expression for calculating the sound intensity for each angle of arrival. When the XY plane is the equatorial plane, the XZ plane is the equatorial plane, and the YZ plane is the YZ plane. FIG. 3 is a mathematical expression diagram for each case where a plane is an equatorial plane. FIG. 9 is a flowchart showing the flow of a process in which a sound source type estimating unit estimates a sound source type. FIG. 4 is a flowchart showing the flow of a process in which a specific sound detection unit detects a specific sound.

  An example of an embodiment of a sound collection data display system according to the present invention will be described with reference to the drawings.

1. Overall Overview The sound pickup data display system of the present invention analyzes a record (hereinafter, referred to as “sound pickup data”) picked up for a predetermined period using a 3D microphone, and detects a picked up position (hereinafter, “sound receiving point”). This is a system that creates a so-called sound distribution map. By showing the distribution map, it is possible to intuitively understand from which direction and how loud the sound is coming from the sound receiving point, for example, effective soundproofing when taking noise countermeasures Facilities can be deployed.

  Here, the 3D microphone is a multi-channel microphone having a plurality of individual microphones whose directions are known. For example, an individual microphone pointing forward and upper left from the center, an individual microphone pointing forward and lower right, an individual microphone pointing backward and lower left, A three-dimensional microphone can be configured by four individual microphones of the individual microphones facing the upper right rear (that is, four individual microphones arranged from the inside of the regular tetrahedron toward each wall). The sound pickup data picked up by the 3D microphone is composed of information for each individual microphone, and includes an identifier of the individual microphone (which individual microphone was picked up), a time when the sound was picked up, a frequency and a sound pressure of the sound. Contains information.

  The main configuration of the sound collection data display system of the present invention will be described with reference to FIG. FIG. 1 is a block diagram showing a main configuration of the sound collection data display system 100. As shown in FIG. 1, the sound collection data display system 100 includes an intensity calculation unit 103, a unit angle intensity calculation unit 104, and an intensity distribution diagram creation unit 111, and further includes a 3D microphone 101 and a sound collection data storage unit. 102, frequency condition setting means 105, unit angle intensity storage means 106, specific sound detection means 107, target range storage means 108, sound source type estimation means 109, sound characteristic storage means 110, time series display means 112, intensity extraction means 113 And output means such as a display and a printer.

  In the sound collection data display system 100, the intensity calculating means 103 and the unit angular intensity calculating means 104, the frequency condition setting means 105, the specific sound detecting means 107, the sound source type estimating means 109, the intensity distribution diagram creating means 111, the time series display The means 112 and the intensity extracting means 113 can be manufactured as dedicated ones, or a general-purpose computer device can be used. This computer device can be configured by a personal computer (PC), a tablet PC such as an iPad (registered trademark), a portable terminal including a smartphone, a PDA (Personal Data Assistance), or the like. The computer device includes a processor such as a CPU and a memory such as a ROM and a RAM, and further includes an input unit such as a mouse and a keyboard and a display. Further, the sound pickup data storage unit 102, the unit angle intensity storage unit 106, the focused range storage unit 108, and the sound characteristic storage unit 110 can be constructed in a database server, for example, and can be connected to a local network (LAN: Local Area Network). It can be a cloud server that stores it via the Internet (that is, wireless communication or wired communication).

  Subsequently, main processing of the sound collection data display system 100 of the present invention will be described with reference to FIG. FIG. 2 is a flowchart showing a main processing flow of the sound pickup data display system 100. The processing to be performed is shown in the center column, input information necessary for the processing is shown in the left column, and input information necessary for the processing is shown in the right column. The output information resulting from the processing is shown.

  As shown in FIG. 2, first, “instantaneous intensity” is calculated (Step 10). More specifically, the intensity calculating means 103 reads out the collected sound data from the collected sound data storage means 102 and calculates the instantaneous intensity based on the collected sound data. The instantaneous intensity calculated here is a result for each sound collection time, and includes the sound arrival direction and the sound intensity.

  When the instantaneous intensity is calculated, the sound source type can be estimated by the sound source type estimating means 109 (Step 20). For example, if the characteristics (hereinafter simply referred to as “sound characteristics”) of sound sources (sounds from construction, sounds from driving a car, sounds from home electric appliances, etc.) existing around the sound receiving point are grasped in advance, instantaneous A device corresponding to a known device is extracted from among the intensities, and the sound source type can be estimated based on the extracted device. As a result, when noise reduction measures are taken, construction noise and automobile running noise are certified as sounds that need to be countermeasured, and the sounds of ceiling ventilation and printers installed in offices are recognized as sounds that need not be countermeasured. be able to. Here, the sound characteristics include information such as an arrival direction, a sound intensity, a time change of the arrival direction, and a time change of the sound intensity.

  Furthermore, when a sound source such as a construction noise or a car running sound which is likely to require countermeasures is grasped in advance, the specific sound detection means 107 detects a sound requiring a countermeasure (hereinafter, referred to as a “specific sound”). (Step 30). In this way, when noise measures are to be taken, it is only necessary to implement soundproof measures when the construction noise or vehicle running sound that has been noticed in advance exceeds an allowable sound intensity, that is, efficient soundproof measures can be taken. .

  When the instantaneous intensity is calculated, the unit angular intensity calculating means 104 calculates “unit angular intensity” based on the instantaneous intensity (Step 40). The unit angle intensity calculated here is a value obtained by assigning the instantaneous intensity to the “divided area” set in the “reference sphere” and dividing the instantaneous intensity sound intensity by the solid angle of the divided area. It is. Note that the “reference sphere” here is a sphere having a predetermined radius (the size of the predetermined radius can be appropriately designed) set around the sound receiving point. , A divided area (so-called mesh) obtained by dividing the reference spherical surface into a plurality.

  When the unit angular intensity is calculated, the intensity distribution diagram creating unit 111 creates an “intensity distribution diagram” based on the unit angular intensity (Step 50). When the sound source type estimation unit 109 estimates the sound source type (Step 20), the intensity distribution map can be created based on the unit angular intensity of the sound whose sound source type is estimated, and the specific sound detection unit 107 can When a specific sound is detected (Step 30), an intensity distribution map can be created based on the unit angular intensity of the detected sound. An intensity distribution map can be created for each sound pickup time, and an intensity distribution diagram (hereinafter, referred to as a “spherical intensity distribution diagram”) three-dimensionally expressed on a spherical surface, and a diagram showing a distribution of intensity. And an intensity distribution diagram expressed on a plane of a rectangular coordinate system (hereinafter referred to as an “intensity distribution diagram of a rectangular coordinate system”), and an intensity distribution diagram expressed on a plane of a polar coordinate system (hereinafter referred to as “intensity map of a curved coordinate system”). City distribution map ").

  When the intensity distribution chart for each sound pickup time is created, the intensity distribution chart can be displayed continuously by moving image or frame-by-frame by the time-series display unit 112 (Step 60). Specifically, the intensity distribution chart created at a plurality of sound collection times is displayed continuously in the order of the sound collection times for each preset display time. The display time can be set at relatively short intervals such as several seconds or minutes, or can be set at a relatively long period such as hourly, weekly, or monthly.

  Hereinafter, the main components of the sound collection data display system 100 will be described in detail.

2. Intensity calculating means As described above, the intensity calculating means 103 reads out the sound collecting data from the sound collecting data storage means 102 and, based on the sound collecting data, intensity for each sound collecting time (hereinafter referred to as sound collecting time). Is referred to as “instantaneous intensity”). Note that the collected sound data stored by the collected sound data storage unit 102 is data collected by the 3D microphone 101. Normally, the sound pickup data picked up by the 3D microphone 101 is data in a format called A format, and when the intensity calculating means 103 processes, the sound pickup data in A format is converted into B format by an encoder. . FIGS. 3A and 3B show mathematical expressions representing the sound pickup data in each format. FIG. 3A shows the A format format, and FIG. 3B shows the B format format. However, this figure shows a case of a 3D microphone 101 composed of four individual microphones arranged from the inside of the regular tetrahedron toward each wall.

  The instantaneous intensity obtained as a result of processing the collected sound data converted to the B format by the intensity calculation means 103 is information for each sound collecting time and for each frequency, and the arrival direction of the sound and the sound It is a vector of strength. Since there is a sound intensity for each sound collection time and for each frequency, the instantaneous intensity can be represented by a so-called spectrogram as shown in FIG. In this diagram, the sound intensity of each sound pickup data is represented by a color in a coordinate system in which the horizontal axis represents time and the vertical axis represents frequency. The "sound arrival direction" and "sound intensity" of the intensity can be calculated from the sound pickup data in the B format, as shown in FIG. In FIG. 5, a formula for calculating the “sound intensity” of the intensity based on the sound pickup data in the B format and a formula for calculating the “direction of arrival of the sound” of the intensity based on the sound pickup data in the B format. Is shown.

  Here, the azimuth angle θ and the elevation angle φ used in the formula of FIG. 5 will be described with reference to FIG. FIG. 6A is a model diagram showing an arbitrary vector VC on a reference spherical surface BF set at a radius r around the sound receiving point SP, and FIG. 6B is an equatorial plane (Z = 0) of the reference spherical surface BF. ) Is a plan view in which the vector VC is projected, and FIG. 6C is a cross-sectional view in which the vector VC is projected on a vertical plane (a section including the Z axis) including the vector VC. The azimuth angle θ is a horizontal angle formed by a predetermined reference direction (X axis in this figure) and the vector VC as shown in FIG. 6B. One elevation angle φ is a vertical angle between the XY plane (or the Z axis) and the vector VC as shown in FIG. 6C.

3. Unit Angle Intensity Calculation Unit As described above, the unit angle intensity calculation unit 104 is a unit that calculates the unit angle intensity based on the instantaneous intensity, and the unit angle intensity divides the instantaneous intensity sound intensity. The value is divided by the solid angle of the area. Hereinafter, the procedure for calculating the “strong unit angle” will be described in detail with reference to FIG.

  FIG. 7 is a model diagram in which a large number of divided areas MS are set on the reference spherical surface BF. For convenience, FIG. 7 shows a reference spherical surface BF partially cut. The divided region MS shown in this figure is a small region surrounded by a plurality of horizontal lines parallel to the XY plane (equatorial plane) and a plurality of vertical lines connecting both poles (upper and lower ends of the Z axis). Is an area surrounded by graticules. Note that the division area MS is not limited to the mode shown in FIG. 7 and can be set by various division methods as long as a plurality of small areas are set on the reference spherical surface BF.

  When the divided area MS is set, the instantaneous intensity obtained by the intensity calculation means 103 is assigned to the divided area MS. Specifically, as shown in FIG. 7, the instantaneous intensity IT (that is, the vector having the sound source as a starting point) is assigned to the divided region MS passing through the reference spherical surface BF. Although FIG. 7 shows only one instantaneous intensity IT for convenience, the instantaneous intensity IT is naturally obtained only for the sound collection time, and all (or a desired part) of these instantaneous intensity IT are obtained. Is assigned to the divided area MS. Then, the “unit angle strength” is calculated by dividing the instantaneous intensity of the sound of the intensity IT by the solid angle of the divided area.

  In allocating the instantaneous intensity to the divided area MS, it is also possible to obtain the “arrival point AP” shown in FIG. FIG. 8 is a model diagram illustrating an arrival point AP. As shown in this figure, the arrival point A is the intersection of the instantaneous intensity and the reference spherical surface BF. In this figure, the front and rear direction of the sound receiving point SP is defined as the X axis (the front is positive), the left and right direction of the sound receiving point SP is defined as the Y axis (the left is positive), and the vertical direction of the sound receiving point SP is defined as the Z axis (upward). Since the reference spherical surface BF is set in a three-axis coordinate system in which is positive, the coordinates of the arrival point AP can be represented by a three-axis coordinate system (X, Y, Z), but is not limited thereto. It can also be represented by a polar coordinate system using a radius and an angle (azimuth angle θ and elevation angle φ).

  The unit angular intensity is obtained based on the instantaneous intensity. Since the instantaneous intensity is obtained for each sound pickup time and each frequency, in other words, the instantaneous intensity is obtained as the sound pickup time and the frequency. They also have information. The unit angle intensity calculated by the unit angle intensity calculation unit 104 is stored in the unit angle intensity storage unit 106 together with such information (FIG. 1).

  The unit angular intensity can be obtained for each sound collection time, that is, based on the instantaneous intensity obtained for each sound collection time, or can be obtained within a predetermined time width (hereinafter, referred to as “unit time”). It can also be determined based on the instantaneous intensity. In this case, a desired time zone (start time to end time) is specified, or a unit time is set by specifying a predetermined interval (for example, one hour or one day) in advance, and the time is set within the unit time. It is preferable to calculate the unit angular intensity by synthesizing (integral value or sum value) the sound intensity of the instantaneous intensity to be obtained and dividing the synthesized sound intensity by the divided area MS.

  By the way, the intensity distribution chart is created based on the unit angular intensity.In some cases, the intensity distribution chart is limited to only a specific frequency range or after excluding a specific frequency range. Sometimes you want to create one. In this case, the operator sets a desired frequency range using the frequency condition setting means 105 (FIG. 1). Then, the intensity calculating means 103 extracts sound collecting data within the frequency range set by the frequency condition setting means 105 from the sound collecting data, and creates an instantaneous intensity based on the sound collecting data. As a result, a unit angular intensity corresponding to a desired frequency range is obtained, and an intensity distribution map corresponding to the desired frequency range is created.

4. Intensity distribution chart creating means As described above, the intensity distribution chart creating means 111 is a means for creating an intensity distribution chart based on the unit angular intensity. This intensity distribution diagram is a diagram showing the distribution of intensity of intensity, so to speak, and is classified into three types: a spherical intensity distribution diagram, an orthogonal coordinate system intensity distribution diagram, and a polar coordinate system intensity distribution diagram. Therefore, various intensity distribution diagrams will be described in detail.

(Spherical intensity distribution diagram)
The spherical intensity distribution diagram is a distribution diagram obtained by giving a unit angular intensity to the divided area MS set on the reference spherical surface BF, and is a distribution diagram expressing the distribution of the unit angular intensity in a three-dimensional manner. is there. Note that the unit angle intensity can be represented by a color model (for example, RGB or CMYK) having three attributes of hue, saturation, and lightness in accordance with the intensity (the magnitude of the value). Or a combination of a color model and shading.

(Intensity distribution map in rectangular coordinate system)
FIG. 9 is a model diagram showing an example of a rectangular coordinate system intensity distribution diagram. The rectangular coordinate system intensity distribution diagram is a distribution diagram in which the unit angular intensity is expressed on a plane of the rectangular coordinate system. Specifically, the divided area MS is defined by a rectangular coordinate system (from the latitude and longitude set on the reference spherical surface BF). FIG. 7 is a distribution diagram obtained by converting a coordinate system into a divided coordinate system MS and adding unit angular intensity to the divided region MS. In FIG. 9, the unit angular intensity is represented by a color in an orthogonal coordinate system in which the azimuth angle θ is the horizontal axis and the elevation angle φ is the vertical axis, but in this case also, the unit angular intensity is similar to the spherical intensity distribution diagram. Can be represented by a color model, shading, or a combination thereof.

Further, the unit angular intensity shown in the rectangular coordinate system intensity distribution diagram can be represented as a point (that is, for each divided region MS), or can be represented by an arbitrary range of unit angular intensity. FIG. 10 is a mathematical formula for calculating the intensity (in this case, the level) of the intensity sound in a predetermined range (azimuth angles θ _{1 to} θ ₂ , elevation angles φ _{1 to} φ ₂ ). Using the formula shown in this figure, the sound intensity of an intensity in an arbitrary range is obtained, and the unit angle intensity is obtained by dividing the intensity by the solid angle corresponding to the range. That is, an intensity distribution chart is created.

(Polar coordinate system intensity distribution map)
FIG. 11A is a model diagram showing an example of a polar coordinate system intensity distribution diagram. As shown in this figure, the polar coordinate system intensity distribution diagram is a distribution diagram showing the distribution of unit angular intensity on a plane of a polar coordinate system including a radius and a central angle. Hereinafter, a procedure for creating a polar coordinate system intensity distribution diagram will be described in detail with reference to FIG.

  When the unit angle intensity calculation unit 104 calculates the unit angle intensity, that is, when the unit angle intensity is obtained for each divided region MS, the arrival angle-specific intensity calculation unit calculates “incoming angle-specific intensity”. The intensity of each arrival angle is, for example, a divided area MS within a range surrounded by a vertical line (that is, a longitude line) shown in FIG. 7, that is, a predetermined azimuth interval Δθ (hereinafter, referred to as “unit longitude width”). This is a value obtained by synthesizing (integral value or total value) the unit angular intensities of a certain divided region MS. At this time, a desired elevation angle interval Δφ (hereinafter, referred to as “latitude range”) surrounded by a horizontal line (that is, a latitude line) shown in FIG. It is also possible to combine the unit angle intensities to obtain the intensity for each arrival angle.

  A polar coordinate system intensity distribution chart is created by distributing the intensity by angle of arrival calculated by the intensity by angle of arrival calculation means on the radar chart shown in FIG. Specifically, according to the azimuth information (azimuth and unit longitude width) possessed by the angle of arrival, the intensity by angle of arrival is arranged on the radar chart, and the region extending in the radial direction according to the intensity (the magnitude of the value). Is set, and a color or the like is applied to the area to create a polar coordinate system intensity distribution map. Also in this case, similarly to the spherical intensity distribution map and the rectangular coordinate system intensity distribution map, the unit angular intensity can be represented by a color model, shading, or a combination thereof.

  Note that the unit longitude width (or the latitude range orthogonal to the unit longitude width) when obtaining the intensity for each arrival angle can be changed as appropriate by changing the latitude and longitude directions set on the reference spherical surface BF. For example, when the XYZ coordinate system shown in FIGS. 6 and 8 is fixed, it is possible to obtain the intensity for each angle of arrival after setting the ZY plane as the equator plane and the X axis direction as the latitude direction. , The ZX plane is taken as the equatorial plane, and the Y-axis direction is taken as the latitude direction, and the intensity for each angle of arrival can be obtained. Alternatively, the arrival angle after setting the equatorial plane inclined with respect to XYZ. Another strength can be obtained. In FIG. 12, when the XY plane is the equatorial plane, when the XZ plane is the equatorial plane, and when the YZ plane is the equatorial plane, in each case, the sound intensity for each angle of arrival is shown. Equations to be obtained are shown, and the intensity of each arrival angle can be obtained by dividing the intensity of this sound by the solid angle.

5. Sound Source Type Estimating Means As described above, the sound source type estimating means 109 is a means for estimating a sound source type (such as noise caused by construction, a sound caused by driving a car, or a sound of a home appliance) based on instantaneous intensity. FIG. 13 is a flowchart showing the flow of processing in which the sound source type estimating means 109 estimates the sound source type. When the instantaneous intensity is calculated as shown in this figure, the sound source type estimating means 109 determines the sound characteristics of the instantaneous intensity (the arrival direction, the sound intensity, and the time change of the arrival direction and the sound intensity). And the sound characteristics of the known equipment. More specifically, as shown in FIG. 1, the sound source type estimating unit 109 reads out the sound characteristics of the known equipment from the sound characteristic storage unit 110 and compares the sound characteristics with the instantaneous intensity sound characteristics calculated by the intensity calculating unit 103. At this time, the sound characteristic can be compared with the sound characteristics of the known equipment based on the arrival direction of the instantaneous intensity, the sound intensity, and the time change of the sound intensity in the sound characteristics. The direction of arrival of the intensity, the intensity of the sound, and the time characteristic of the arrival direction can be compared with the sound characteristics of the known equipment, and the arrival direction of the instantaneous intensity, the intensity of the sound, Based on the time change of the arrival direction and the time change of the sound intensity, it is possible to compare the sound characteristics of the known equipment with the sound characteristics. If the sound characteristics of the instantaneous intensity and the sound characteristics of the known equipment are similar (or the same), the instantaneous intensity is recognized as using the known equipment as the sound source, and the sound source type is determined. It is estimated that if the sound characteristics of the instantaneous intensity differ from the sound characteristics of the known equipment, the instantaneous intensity is recognized as an unknown sound source.

  For example, ceiling ventilation installed in an office has a known direction (azimuth and elevation) with respect to the sound receiving point SP, and the intensity and frequency of the sound can be known. The time change (so-called periodic change) can be known. If an instantaneous intensity having the same or similar sound characteristics as the sound characteristics of the ceiling ventilation is detected, the instantaneous intensity is recognized as the sound source of the ceiling ventilation. Of course, not only the ceiling ventilation but also the sound characteristics of various types of known equipment can be stored in the sound characteristic storage unit 110, and various sound source types can be estimated by the sound source type estimation unit 109.

  When the sound source type is estimated by the sound source type estimating means 109, an intensity distribution map of only the instantaneous intensity at which the sound source type is estimated can be created. It is also possible to create an intensity distribution diagram represented by a different color or shade.

6. Specific Sound Detection Means As described above, the specific sound detection means 107 is a means for detecting a specific sound based on instantaneous intensity. In this case, the range of interest and the intensity threshold for detecting the specific sound are stored by the range of interest storage unit 108 (FIG. 1). Note that the range of interest is a range that includes a “set arrival direction range” set in advance to detect a specific sound, and may also be a range that further includes a “set frequency range”.

  FIG. 14 is a flowchart showing a flow of processing in which the specific sound detection unit 107 detects a specific sound. When the instantaneous intensity is calculated as shown in this figure, it is determined whether or not the instantaneous intensity is within the set arrival direction range. Specifically, the specific sound detection unit 107 reads the range of interest from the range of interest storage unit 108, and compares the set arrival direction range of the range of interest with the direction of arrival (or arrival point AP) of the instantaneous intensity. When the arrival direction is within the set arrival direction range (Yes), the process proceeds to the next process. When the arrival direction is not within the set arrival direction range (No), it is determined that the sound is not a specific sound. However, when the set frequency range is not included in the range of interest, and when the arrival direction is within the set arrival direction range (Yes), the process directly proceeds to the step of comparing with the intensity threshold.

  If it is determined that the arrival direction is within the set arrival direction range, next, the set frequency range in the range of interest is compared with the frequency of the instantaneous intensity. When the instantaneous intensity frequency is within the set frequency range (Yes), the process proceeds to the next process. When the instantaneous intensity frequency is outside the set frequency range (No), it is determined that the sound is not a specific sound.

  If it is determined that the instantaneous intensity frequency is within the set frequency range, then the intensity threshold is compared with the instantaneous intensity sound intensity (or unit angular intensity). When the intensity of the instantaneous intensity exceeds the intensity threshold (Yes), the sound is identified as a specific sound, and when the intensity of the instantaneous intensity falls below the intensity threshold (No), the sound is identified as not a specific sound. I do.

7. Intensity Extraction Means If an intensity distribution diagram is created at all the sound collection times in the sound collection data, the calculation cost to create it is increased, and the trouble of checking is increased. Thus, when noise measures are taken, it may take a lot of time to find a problem. Therefore, it is preferable to create an intensity distribution diagram after extracting only a noteworthy sound in advance.

  The intensity extracting means 113 is a means for extracting an instantaneous intensity of interest from two or more instantaneous intensities obtained from sound pickup data collected for a certain period. Specifically, a specific arrival direction range (hereinafter, “extraction arrival direction range”) and an intensity threshold (hereinafter, “extraction intensity threshold”) are determined in advance, and the instantaneous arrival of intensity is determined. When the direction is within the range of the arrival direction for extraction and the sound intensity exceeds the threshold value for extraction strength, the instantaneous intensity is extracted. Then, an instantaneous sound pickup time of the intensity extracted by the intensity extracting means 113 is selected, and an intensity distribution diagram is created based on the instantaneous intensity of the picked-up data relating to the selected sound pickup time. Note that an intensity distribution diagram can be created for all instantaneous intensities (including those not extracted by the intensity extracting unit 113) relating to the selected sound collection time, or the selected sound collection time can be created. It is also possible to create an intensity distribution diagram for those extracted by the intensity extracting means 113 among the instantaneous intensities according to (1).

8. Other Embodiments So far, an example has been described in which an “intensity distribution map” is created using “unit angle intensity” obtained by dividing the sound intensity by the solid angle of the divided area MS. The display system 100 obtains the “unit angle intensity” without dividing the sound intensity by the solid angle, and assigns the “unit angle intensity” to the corresponding divided region MS to obtain the “intensity distribution diagram”. Can also be created.

  The sound collection data display system of the present invention can be effectively used not only for facilities receiving noise, such as houses, schools, and hospitals, but also for facilities providing noise, such as event venues and construction sites. Considering that the present invention contributes to effective noise countermeasures, provides a good sound environment, and thus provides a comfortable living environment, it can be expected to make a great contribution not only to industrial use but also to society. An invention.

Reference Signs List 100 sound collection data display system 101 3D microphone (of sound collection data display system) 102 sound collection data storage means (of sound collection data display system) 103 intensity calculation means (of sound collection data display system) 104 (sound collection data display) Unit angular intensity calculation means 105 (of the sound collection data display system) Frequency condition setting means 106 (of the sound collection data display system) Unit angle intensity storage means 107 (of the sound collection data display system) Specific sound detection means 108 (of the sound collection data display system) 108 ( Range-of-interest storage means (of the sound collection data display system) 109 Sound source type estimation means (of the sound collection data display system) 110 Sound characteristic storage means (of the sound collection data display system) 111 Intensity distribution diagram (of the sound collection data display system) Creation means 112 Time-series display means (of sound collection data display system) 113 Intensity extraction means (of sound collection data display system) AP Arrival point BF Reference sphere SP Receiving point MS Division area IT Instantaneous intensity

Claims (12)

A sound collection data display system for analyzing sound collection data collected for a predetermined period by a 3D microphone and displaying an analysis result using a reference spherical surface,
The reference spherical surface is a spherical surface set at a predetermined radius around the sound receiving point,
From the sound pickup data, intensity calculation means for calculating an instantaneous intensity for each sound pickup time,
The instantaneous intensity is assigned to a divided region obtained by dividing the reference spherical surface into a plurality, and a “unit angular intensity” is obtained by dividing the instantaneous intensity sound intensity by the solid angle of the divided region. Unit angle intensity calculation means,
Intensity distribution diagram creating means for creating an `` intensity distribution diagram '' in which the unit angular intensity is distributed on the reference spherical surface,
A sound pickup data display system comprising: A sound collection data display system for analyzing sound collection data collected for a predetermined period by a 3D microphone and displaying an analysis result using a reference spherical surface,
The reference spherical surface is a spherical surface set at a predetermined radius around the sound receiving point,
From the sound pickup data, intensity calculation means for calculating an instantaneous intensity for each sound pickup time,
The instantaneous intensity is assigned to a divided region obtained by dividing the reference spherical surface into a plurality, and a “unit angular intensity” is obtained by dividing the instantaneous intensity sound intensity by the solid angle of the divided region. Unit angle intensity calculation means,
The intensity distribution map for converting the divided area into a rectangular coordinate system composed of latitude and longitude set on the reference spherical surface and creating an “intensity distribution map” in which the unit angular intensity is distributed in the rectangular coordinate system. Creation means,
A sound collection data display system comprising: A sound collection data display system for analyzing sound collection data collected for a predetermined period by a 3D microphone and displaying an analysis result using a reference spherical surface,
The reference spherical surface is a spherical surface set at a predetermined radius around the sound receiving point,
From the sound pickup data, intensity calculation means for calculating an instantaneous intensity for each sound pickup time,
The instantaneous intensity is assigned to a divided region obtained by dividing the reference spherical surface into a plurality, and a “unit angular intensity” is obtained by dividing the instantaneous intensity sound intensity by the solid angle of the divided region. Unit angle intensity calculation means,
While setting the latitude and longitude on the reference spherical surface, the angle-of-arrival intensity calculation means for calculating `` intensity by angle of arrival '' that is the unit angle intensity for each unit longitude width,
Intensity distribution diagram creating means for creating an `` intensity distribution diagram '' in which the intensity at each arrival angle is distributed for each azimuth on a reference cross section that cuts the reference spherical surface,
A sound pickup data display system comprising: The angle-of-arrival-intensity calculating means calculates the angle-of-arrival-intensity based on the instantaneous intensity within a designated latitude range,
The sound collection data display system according to claim 3, wherein: Sound intensity type estimating means for estimating the sound source type of the intensity based on the intensity and the time change of the sound intensity of the intensity, and the sound source type information stored in advance, further comprising:
The sound source type information includes a sound source type, a sound arrival direction, a sound intensity, and a time change of the sound,
The intensity distribution diagram creating unit creates an `` intensity distribution diagram '' that distributes the unit angular intensity based on the instantaneous intensity estimated by the sound source type by the sound source type estimating unit,
The sound collection data display system according to any one of claims 1 to 4, wherein: A sound source type estimating means for estimating the sound source type of the intensity based on the intensity and the time change of the direction of arrival of the intensity, and the sound source type information stored in advance,
The sound source type information includes a sound source type, a sound arrival direction, a sound intensity, and a time change of the arrival direction,
The intensity distribution diagram creating unit creates an `` intensity distribution diagram '' that distributes the unit angular intensity based on the instantaneous intensity estimated by the sound source type by the sound source type estimating unit,
The sound collection data display system according to any one of claims 1 to 5, wherein: Specific sound detection means for detecting the instantaneous intensity in the specific arrival direction range, wherein the intensity of the sound exceeds a predetermined intensity threshold,
The intensity distribution map creating means creates an `` intensity distribution map '' that distributes the unit angular intensity based on the instantaneous intensity detected on the specific sound detecting means surface,
The sound collection data display system according to any one of claims 1 to 6, wherein: The specific sound detection means further detects the instantaneous intensity in a specific frequency range,
The sound collection data display system according to claim 7, wherein: From the two or more instantaneous intensities obtained from the collected sound data collected for a predetermined period, the instantaneous intensity in a specific arrival direction range and in which the sound intensity exceeds a predetermined intensity threshold is extracted. Further comprising an intensity extraction means,
The intensity distribution diagram creating unit creates an intensity distribution diagram at the sound collection time of the instantaneous intensity extracted by the intensity extracting unit,
The sound collection data display system according to any one of claims 1 to 8, wherein: The unit angle intensity calculation means obtains a `` unit time intensity '' which is a sound intensity of the instantaneous intensity in a predetermined time width, and obtains the unit angle intensity based on the unit time intensity.
The sound collection data display system according to any one of claims 1 to 9, wherein: Frequency condition setting means for setting a frequency condition,
The intensity calculating means calculates the instantaneous intensity based on the sound collection data extracted according to the frequency condition,
The sound collection data display system according to any one of claims 1 to 10, wherein: A time-series display unit that continuously displays the intensity distribution diagram at a plurality of sound collection times in the order of the sound collection times;
The sound collection data display system according to any one of claims 1 to 11, further comprising:

Images