JP6759479B1 - Acoustic analysis support system and acoustic analysis support method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an acoustic analysis support system and an acoustic analysis support method for easily performing acoustic analysis by a user. SOLUTION: In an acoustic analysis support system 1, a portion of continuous sound satisfying a predetermined condition and a predetermined portion in each of a range of a plurality of spaces obtained by dividing the predetermined space from a spectrogram representing sound in a predetermined space. A qualitative judgment process that extracts the part of the intermittent sound that satisfies the conditions, and an acoustic that displays the direction, sound pressure, and frequency of the extracted continuous sound part, and the direction, sound pressure, and frequency of the extracted intermittent sound part. It has an acoustic data visualization support device 100 including a calculation device that executes visualization processing. .. [Selection diagram] Fig. 1

Description

The present invention relates to an acoustic analysis support system and an acoustic analysis support method.

A spectrogram display is known as a method for displaying the pitch, loudness, length, or the like of a sound. However, deciphering what this spectrogram shows requires accurate knowledge of the field. Therefore, in order to perform detailed acoustic analysis using the spectrogram, we had to ask an engineer or the like who has such knowledge.

In this regard, as a method for presenting sound analysis information to the user, for example, in Patent Document 1, an acoustic processing device for identifying a sound source when sound sources are close to each other and other sound signals are mixed is estimated. It is described that a spectrogram of sound source type information indicating the type of sound source in which the type of sound source is determined based on the direction of the sound source is output.

In Patent Document 2, a tone component included in a biological sound, which is target data as to whether or not the biological sound analyzer for analyzing noise contained in the biological sound is a continuous ra sound (sound to be detected). Is extracted based on the spectrogram, and it is described that the determination result of the continuous ra sound obtained by this is output to the result display unit.

In Patent Document 3, intermittent rales are determined based on the spectral entrainment and the sound spectrogram related to the sound spectrogram, and the determination result of the respiratory sounds of the living body (whether it is a normal respiration state or an abnormal respiration state) is displayed. It is disclosed to do.

JP-A-2018-40848 JP-A-2017-17000 Japanese Unexamined Patent Publication No. 2012-12608

However, Patent Document 1 displays a spectrum gram, and as described above, only a special engineer can decipher the contents.

Further, Patent Documents 2 and 3 analyze sound using a spectrogram, but only propose the result of determination of normality or abnormality as a result of spectrogram analysis, and the content of spectrogram analysis. Does not indicate.

The present invention has been made in view of such a current situation, and an object of the present invention is to provide an acoustic analysis support system and an acoustic analysis support method capable of easily performing acoustic analysis by a user.

One of the present inventions for solving the above-mentioned problems is a portion of continuous sound satisfying a predetermined condition in each of a range of a plurality of spaces obtained by dividing the predetermined space from a spectrogram representing sound in a predetermined space. And the qualitative determination process for extracting the intermittent sound part, the direction, sound pressure, and frequency of the extracted continuous sound part, and the direction, sound pressure of the extracted intermittent sound part.
It is an acoustic analysis support system including an arithmetic unit that executes an acoustic visualization process for displaying and a frequency.

Another one of the present invention for solving the above-mentioned problems is that the information processing apparatus determines from a spectrogram representing sound in a predetermined space in each of a range of a plurality of spaces obtained by dividing the predetermined space. A qualitative determination process for extracting a continuous sound portion satisfying the condition and an intermittent sound portion satisfying a predetermined condition, the direction, sound pressure, and frequency of the extracted continuous sound portion, and the extracted intermittent sound portion. It is an acoustic analysis support method that executes an acoustic visualization process that displays the direction, sound pressure, and frequency of.

According to the present invention, the user can easily perform acoustic analysis.

Issues, configurations and effects other than those described above will be clarified by the description of the following embodiments.

It is a figure explaining an example of the structure of the acoustic analysis support system which concerns on this embodiment. It is a figure explaining an example of the function which the acoustic data visualization support device has. It is a figure explaining an example of the hardware provided in the acoustic data visualization support device and a user terminal. It is a flowchart explaining the outline of the processing performed in the acoustic analysis support system. It is a flowchart explaining an example of a spectrogram creation process. It is a flowchart explaining an example of a qualitative determination process. It is a flowchart explaining an example of a qualitative determination process. It is a figure which shows an example of the parameter for continuous sound. It is a figure which shows an example of the parameter for intermittent sound. It is a figure which shows an example of the qualitative judgment result information. It is a flowchart explaining an example of acoustic data visualization processing. It is a figure which shows an example of an input / output screen. It is a figure which shows an example of the sound pressure distribution display screen which displays the sound pressure distribution. It is a figure which shows an example of the display screen of the spectrogram which displays the spectrogram which shows the display continuous sound (qualitative continuous sound). It is a figure which shows an example of the display screen of the spectrogram which displays the spectrogram which shows the display intermittent sound (qualitative intermittent sound).

Hereinafter, embodiments of the present invention will be described with reference to the drawings.

<System configuration>
FIG. 1 is a diagram illustrating an example of the configuration of the acoustic analysis support system 1 according to the present embodiment.

The acoustic analysis support system 1 is input to a sound source 10 that emits various sounds to the surrounding space, a voice input device 30 (microphone or the like) into which sounds emitted from the sound source 10 are input, and a voice input device 30. An acoustic data visualization support device 100 that creates information for visualizing the characteristics of the sound by analyzing a spectrometer created from a sound signal, and an acoustic data visualization support device 100 that creates information created by the acoustic data visualization support device 100 on a predetermined screen. It is configured to include a user terminal 20 for displaying.

The sound source 10 is, for example, a device, a machine, a musical instrument, or the like that emits sound. Further, the sound source 10 may be a person.

The acoustic analysis support system 1 is provided, for example, in a facility such as a factory where the sound source 10 is installed, an acoustic facility for performing a concert, or the like.

The acoustic data visualization support device 100 and the user terminal 20 are communicably connected by, for example, a wired or wireless network 5 such as a LAN (Local Area Network), WAN (Wide Area Network), the Internet, or a dedicated line. To.

<Acoustic visualization support device>
FIG. 2 is a diagram illustrating an example of a function included in the acoustic data visualization support device 100.

The acoustic data visualization support device 100 includes an acoustic data creation unit 101, a direction division unit 102, a spectrogram creation unit 103, a continuous sound extraction unit 104, an intermittent sound extraction unit 105, a qualitative determination unit 106, and an acoustic data visualization unit 107. ..

The acoustic data creation unit 101 converts the sound input from the audio input device 30 into audio data in a predetermined format (hereinafter referred to as acoustic data 200).

The direction dividing unit 102 divides the acoustic data 200 created by the acoustic data creating unit 101 into acoustic data in a plurality of spatial ranges.

In the present embodiment, the acoustic data (direction-specific acoustic data 300) is a range of a plurality of spaces in which the space through which the sound emitted by the sound source 10 is transmitted is divided into predetermined angles in the horizontal direction, centering on the sound source 10. It is assumed that it is the acoustic data of.

Further, the direction dividing unit 102 creates the direction-specific sound pressure data 350 that stores the sound pressure information in each of the plurality of space ranges corresponding to the direction-specific acoustic data 300.

The spectrogram creation unit 103 converts each of the direction-specific acoustic data 300 created by the direction division unit 102 into a spectrogram (hereinafter, referred to as a direction-specific spectrogram 400).

The continuous sound extraction unit 104 is a sound corresponding to continuous sounds (when there are continuous components in the horizontal direction (time direction) on the spectrogram) from each of the direction-specific spectrograms 400 created by the spectrogram creation unit 103. For example, a spectrogram (continuous sound spectrogram 500) extracted from a long-wave instrument sound such as a piano is created.

The intermittent sound extraction unit 105 is a sound corresponding to the intermittent sound (when there is a continuous component in the vertical direction (frequency direction) on the spectrogram) from each of the direction-specific spectrograms 400 created by the spectrogram creation unit 103. For example, a spectrogram (intermittent sound spectrogram 600) is created by extracting a percussion instrument sound.

From the spectrogram representing the sound in the predetermined space, the qualitative determination unit 106 determines the continuous sound satisfying the predetermined condition (hereinafter referred to as the qualitative continuous sound) in each of the ranges of the plurality of spaces divided by the predetermined space. A part (hereinafter referred to as a qualitative continuous sound spectrogram) and an intermittent sound part satisfying a predetermined condition (hereinafter referred to as a qualitative intermittent sound spectrogram) are extracted.

The qualitative determination unit 106 is an input parameter including a continuous sound parameter 720 which is a parameter for specifying a qualitative continuous sound and an intermittent sound parameter 740 which is a parameter for specifying a qualitative intermittent sound. Based on 700, the directions, sound pressures, and frequencies of the specified continuous and intermittent sounds are specified. These details will be described later.

The qualitative determination unit 106 stores information on the specified direction, sound pressure, and frequency as the qualitative determination result information 800.

Specifically, the qualitative determination unit 106 includes a continuous sound extraction unit 1061 and an intermittent sound extraction unit 1062.

The continuous sound extraction unit 1061 identifies a time zone in which the sound pressure continuously exceeds a predetermined threshold value from the spectrogram (continuous sound spectrogram 500) created by the spectrogram creation unit 103, and sets the specified time zone. The part is extracted as a part of a qualitative continuous sound.

The continuous sound extraction unit 1061 stores the spectrogram of the specified continuous sound portion as a qualitative continuous sound spectrogram.

The intermittent sound extraction unit 1062 identifies and identifies a portion having a predetermined frequency band and substantially the same sound pressure at a predetermined time interval from the spectrogram (intermittent sound spectrogram 600) created by the spectrogram creation unit 103. The part is extracted as a part of the qualitative intermittent sound.

The intermittent sound extraction unit 1062 stores the spectrogram of the specified intermittent sound portion as a qualitative intermittent sound spectrogram.

Next, the acoustic data visualization unit 107 creates screen information for displaying the contents of the qualitative determination result information 800 based on the qualitative determination result information 800 created by the qualitative determination unit 106.

After that, the user terminal 20 displays this screen information on a predetermined screen.

Further, the acoustic data visualization unit 107 receives and receives the designation of one of a plurality of space ranges (horizontal angle division range) in the space in which the sound emitted from the sound source 10 is distributed, and is designated. Display information indicating the distribution of acoustic sound pressure in a range.

Further, the acoustic data visualization unit 107 accepts the designation of the continuous sound extracted by the continuous sound extraction unit 1061, and displays a spectrogram having an axis indicating the frequency range of the designated continuous sound and a predetermined time axis.

Further, the acoustic data visualization unit 107 accepts the designation of the intermittent sound extracted by the intermittent sound extraction unit 1062, and displays a spectrogram having an axis indicating the frequency range of the designated intermittent sound and a predetermined time axis.

<Hardware>
Here, FIG. 3 is a diagram illustrating an example of hardware included in the acoustic data visualization support device 100 and the user terminal 20. The acoustic data visualization support device 100 and the user terminal 20 include a processor 11 (computing device) such as a CPU, a storage device 12 such as a RAM (Random Access Memory) and a ROM (Read Only Memory), an HDD (Hard Disk Drive), and an SSD (SSD). Solid State Drive), auxiliary storage device 13 such as flash memory, input device 14 such as keyboard or touch panel, output device 15 such as monitor or display, communication device 16 such as network interface card that communicates with other information processing devices. These are connected by an internal communication line such as a bus.

The functions of the acoustic data visualization support device 100 and the user terminal 20 described above are realized by dedicated hardware or by the processor 11 reading a program stored in the storage device 12 or the auxiliary storage device 13. To. In addition, each program may be pre-recorded on a recording medium that can be read by each device, or may be introduced when necessary via a storage medium or a predetermined communication network.

<Processing>
Next, the processing performed in the acoustic analysis support system 1 will be described.

FIG. 4 is a flowchart illustrating an outline of the processing performed in the acoustic analysis support system 1. The acoustic analysis support system 1 was created by a spectrogram creation process s1 that creates a spectrogram from the acoustic data 200 of the sound source 10, a qualitative determination process s3 that analyzes the spectrogram created by the spectrogram creation process s1, and a qualitative determination process s3. The acoustic data visualization process s6 that visualizes the result and displays it on the user terminal 20 is executed.

The details of these processes will be described below.

<Spectrogram creation process>
FIG. 5 is a flowchart illustrating an example of the spectrogram creation process s1. The spectrogram creation process s1 is started, for example, when sound is input from the sound source 10 to the acoustic data visualization support device 100 via the voice input device 30.

First, the acoustic data creation unit 101 of the acoustic data visualization support device 100 converts the electric signal of the sound input from the audio input device 30 into digital data in a predetermined data format (for example, WAV format), that is, acoustic data 200. (S11). The acoustic data creation unit 101 can create the acoustic data 200 by using a data generation algorithm for generating data in a predetermined format.

Next, the direction dividing unit 102 divides the acoustic data 200 into acoustic data (direction-specific acoustic data 300) of a plurality of direction components by analyzing the acoustic data 200 created in s11 (s12). Further, the direction dividing unit 102 creates the sound pressure data 350 for each direction by calculating the sound pressure in each direction component based on the sound data 300 for each direction (s12).

The direction dividing unit 102 can create the direction-specific acoustic data 300 and the direction-specific sound pressure data 350 by using a predetermined data generation algorithm related to sound source localization or sound source separation.

Further, the direction dividing unit 102 stores in advance the direction (reference direction) as a reference for dividing the direction and the dividing angle when creating the sound pressure data 300 for each direction and the sound pressure data 350 for each direction. To do.

Next, the spectrogram creation unit 103 converts each of the direction-specific acoustic data 300 created in s12 into a spectrogram, and stores the converted spectrogram as the direction-specific spectrogram 400 (s13).

For example, the spectrogram creation unit 103 can convert the direction-specific acoustic data 300 into a spectrogram by Fourier transform or the like.

The spectrogram creation unit 103 extracts a continuous sound portion from each of the direction-specific spectrograms 400 created in s13 (s14).

Specifically, for example, the spectrogram creation unit 103 uses HPSS (Harmonic / Percussive Sound Separation) / Harmonic or the like to continuously exist a sound pressure of a predetermined value or higher in the time direction for each of the spectrograms 400 for each direction. All the parts of the spectrogram 400 for each direction are extracted, and the extracted parts of the spectrogram are stored as the continuous sound spectrogram 500.

Further, the spectrogram creation unit 103 extracts an intermittent sound portion from the direction-specific spectrogram 400 created in s13 (s15). The spectrogram creation unit 103 extracts all the parts of the spectrogram 400 by direction in which continuous parts in the frequency direction appear intermittently by HPSS / Percussive or the like for each of the spectrograms 400 by direction, and the extracted spectrogram The part is stored as an intermittent sound spectrogram 600. This completes the spectrogram creation process (s16).

<Qualitative judgment processing>
6 and 7 are flowcharts for explaining an example of the qualitative determination process s3 (divided into two figures due to space limitations). The qualitative determination process s3 is started after the spectrogram creation process is completed.

First, as shown in FIG. 6, the continuous sound extraction unit 1061 of the acoustic data visualization support device 100 selects a certain range of directions (hereinafter, referred to as selection directions) from the range of each direction indicated by the direction-specific acoustic data 300. (S31).

Next, as shown in FIG. 6, the continuous sound extraction unit 1061 acquires the continuous sound parameter 720 (s32). For example, the continuous sound extraction unit 1061 may add an input of data related to the continuous sound parameter 720 from the user, or may read out the continuous sound parameter 720 stored in advance.

(Parameter for continuous sound)
FIG. 8 is a diagram showing an example of the continuous sound parameter 720. The continuous sound parameter 720 includes a sound pressure threshold (sound pressure threshold 721 for continuous sound) required for determining a qualitative continuous sound and a maximum value of a frequency that can be determined as a qualitative continuous sound (sound pressure threshold 721). It includes a continuous sound frequency maximum 722) and a minimum value of a frequency that can be determined to be a qualitative continuous sound (continuous sound frequency minimum 723).

The continuous sound extraction unit 1061 is qualitatively present in the spectrogram in the selection direction (hereinafter referred to as the selection spectrogram) among the continuous sound spectrograms 500 created by the continuous sound extraction unit 104 based on the continuous sound parameter 720 acquired in s32. All continuous sounds are extracted (s33).

Specifically, for example, the continuous sound extraction unit 1061 extracts from the selected spectrogram all the temporally continuous portions having a sound pressure of the continuous sound pressure threshold value 721 or more.

If the qualitative continuous sound can be extracted from the selected spectrogram (s33: YES), the continuous sound extraction unit 1061 performs the process of s34 described later, and if the qualitative continuous sound cannot be extracted from the selected spectrogram (s33). : NO), the continuous sound extraction unit 1061 performs the process of s37 described later.

In s34, the continuous sound extraction unit 1061 stores that a qualitative continuous sound exists in the selection direction. Further, the continuous sound extraction unit 1061 counts the total number of qualitative continuous sounds extracted in s33 (s35).

Further, the continuous sound extraction unit 1061 specifies the sound pressure and frequency band (maximum frequency and minimum frequency) of each qualitative continuous sound extracted in s33 (s36). After that, the process of s38 described later is performed.

In s37, the continuous sound extraction unit 1061 stores that there is no qualitative continuous sound in the selection direction. After that, the process of s38 described later is performed.

In s38, the continuous sound extraction unit 1061 determines whether or not there is a direction range other than the selection direction in which the extraction of the qualitative continuous sound is not attempted.

If there is another directional range that has not attempted to extract qualitative continuous sound (s38: YES), the continuous sound extraction unit 1061 selects one of the other directional ranges as the new selection direction, and s32 or later. Repeat the process of.

When there is no other directional range in which the extraction of the qualitative continuous sound is not attempted (s38: NO), the continuous sound extraction unit 1061 starts the process of s41 described below.

Next, as shown in FIG. 7, the intermittent sound extraction unit 1062 of the acoustic data visualization support device 100 selects a direction (selection direction) of a certain range from the range of each direction indicated by the direction-specific acoustic data 300 (selection direction). s41).

The intermittent sound extraction unit 1062 acquires the intermittent sound parameter 740 (s42). The intermittent sound extraction unit 1062 may, for example, attach data input related to the intermittent sound parameter 740 from the user, or may read out the intermittent sound parameter 740 stored in advance.

(Parameter for intermittent sound)
FIG. 9 is a diagram showing an example of the intermittent sound parameter 740. The intermittent sound parameter 740 is a sound pressure threshold required for determining a qualitative intermittent sound (intermittent sound pressure threshold 741) and a maximum value of a frequency that can be determined as a qualitative intermittent sound (intermittent sound parameter 740). It includes an intermittent sound frequency maximum 742) and a minimum value of a frequency that can be determined to be a qualitative intermittent sound (intermittent sound frequency minimum 743).

Next, as shown in FIG. 8, the intermittent sound extraction unit 1062 is a spectrogram in the selection direction among the intermittent sound spectrograms 600 created by the intermittent sound extraction unit 105 based on the intermittent sound parameter 740 acquired in s42 (hereinafter, selection). All qualitative intermittent sounds existing in the spectrogram) are extracted (s43).

Specifically, for example, the intermittent sound extraction unit 1062 identifies a plurality of portions having a sound pressure of the intermittent sound pressure threshold value 741 or more at predetermined time intervals from the selection spectrogram.

If the qualitative intermittent sound can be extracted from the selected spectrogram (s43: YES), the intermittent sound extraction unit 1062 performs the process of s44 described later, and if the qualitative intermittent sound cannot be extracted from the selected spectrogram (s43: NO). ), The intermittent sound extraction unit 1062 performs the process of s49 described later.

In s44, the intermittent sound extraction unit 1062 stores that a qualitative intermittent sound exists in the selection direction. Further, the intermittent sound extraction unit 1062 counts the total number of qualitative intermittent sounds extracted in s43 (s45).

Further, the intermittent sound extraction unit 1062 specifies the sound pressure and frequency band (minimum frequency and maximum frequency) of each intermittent continuous sound extracted in s43 (s46).

Further, the intermittent sound extraction unit 1062 calculates the time interval between each intermittent continuous sound specified in s43 (s47). After that, the processing of s48 is performed.

Specifically, for example, the intermittent sound extraction unit 1062 analyzes the sound pressure of each timing having the frequency band specified in s46 in time series, and determines the length of time between the timings at which the sound pressure is the same. The time interval between intermittent continuous sounds.

In s49, the intermittent sound extraction unit 1062 stores that there is no qualitative intermittent sound in the selection direction. After that, the process of s48 described later is performed.

In s48, the intermittent sound extraction unit 1062 determines whether or not there is another direction range other than the selection direction in which the extraction of the qualitative intermittent sound is not attempted.

If there is another directional range that has not attempted to extract the qualitative intermittent sound (s48: YES), the intermittent sound extraction unit 1062 selects one of the other directional ranges as the new selection direction (s51). The processing after s42 is repeated.

If there is no other directional range in which the extraction of the qualitative intermittent sound is not attempted (s48: NO), the intermittent sound extraction unit 1062 starts the process of s52 described below.

In s52, the intermittent sound extraction unit 1062 stores the result specified or calculated by the above processing in the qualitative determination result information 800.

(Qualitative judgment result information)
FIG. 10 is a diagram showing an example of the qualitative determination result information 800. The qualitative determination result information 800 is information that stores information on qualitative continuous sounds and qualitative intermittent sounds in each of the divided directions.

That is, the qualitative determination result information 800 includes information 801 indicating the presence or absence of qualitative continuous sounds, the total number of qualitative continuous sounds 802, the sound pressure of each qualitative continuous sound 803, and the maximum frequency 804 of each qualitative continuous sound. Minimum frequency 805 of qualitative continuous sound, information 806 indicating the presence or absence of qualitative intermittent sound, total number of qualitative intermittent sound 807, sound pressure 808 of each qualitative intermittent sound, maximum frequency 809 of each qualitative intermittent sound, each qualitative It has a minimum frequency of 810 intermittent sounds, a time interval of 811 for each qualitative intermittent sound, a reference direction of 812, and a division angle of 813.

The reference direction 812 and the division angle 813 may be set in advance by the direction division unit 102.

<Acoustic data visualization process>
FIG. 11 is a flowchart illustrating an example of the acoustic data visualization process s6. The acoustic data visualization process s6 is started, for example, after the execution of the qualitative determination process s3 is completed, or when a predetermined request is received from the user terminal 20.

First, the acoustic data visualization unit 107 of the acoustic data visualization support device 100 acquires the qualitative determination result information 800 created by the acoustic data visualization process and the sound pressure data 350 for each direction (s61).

The acoustic data visualization unit 107 is an output interface for displaying the analysis information of the spectrum related to the acoustic from the sound source 10 based on the qualitative determination result information 800 acquired in s61 and the sound pressure data 350 for each direction, and the user. Creates input / output screen information including an input interface for receiving the display of the spectrum related to the sound from the sound source 10 (s62).

Then, the acoustic data visualization unit 107 transmits the information of the input / output screen created in s62 to the user terminal 20 (s63).

After that, when the user terminal 20 receives the information on the input / output screen, the user terminal 20 displays the input / output screen on the screen and receives a predetermined input (described later) from the user.

When the user terminal 20 receives the predetermined input, the user terminal 20 transmits information requesting that the information corresponding to the input be displayed on the acoustic data visualization support device 100. When the acoustic data visualization support device 100 receives this request, it transmits information corresponding to the request to the user terminal 20, and the user terminal 20 displays this information on the screen.

(Input / output screen)
FIG. 12 is a diagram showing an example of the input / output screen 1000. The input / output screen 1000 has an item 1010 of information in each direction of the spectrogram (acoustic data), an item 1020 of qualitative continuous sound of the spectrogram (acoustic data) in each direction, and an item 1020 of qualitative continuous sound extracted by the qualitative determination process s3. It has a qualitative intermittent sound item 1030 of the spectrogram (acoustic data) in each direction.

In the direction information item 1010, the direction information 1011 (angle with respect to the reference direction) and the range 1012 in the direction (division angle) are displayed. A selection field 1013 may be provided for the direction information item 1010 so that the acoustic information of the direction specified by the user among the plurality of directions is displayed on the input / output screen 1000.

In the item 1020 of the qualitative continuous sound, the frequency band 1021 of the qualitative continuous sound and the sound pressure 1022 of the qualitative continuous sound are displayed. A selection field 1023 may be provided for the item 1020 of the qualitative continuous sound so that the information of the qualitative continuous sound specified by the user among the plurality of qualitative continuous sounds is displayed on the input / output screen 1000. ..

In the item 1030 of the qualitative intermittent sound, the frequency band 1031 of the qualitative intermittent sound and the sound pressure 1032 of the qualitative intermittent sound are displayed. A selection field 1033 may be provided for the item 1030 of the qualitative intermittent sound so that the information of the qualitative intermittent sound specified by the user among the plurality of qualitative intermittent sounds is displayed on the input / output screen 1000. ..

Next, as shown in s64 of FIG. 11, the acoustic data visualization unit 107 receives the displayed acoustic direction (display direction range) and continuous sound (continuous sound) from the user terminal 20 on which the input / output screen 1000 is displayed. Accepts the selection (input) of either the display continuous sound) or the intermittent sound (display intermittent sound).

Specifically, for example, the acoustic data visualization unit 107 includes an item 1010 for information on the direction of the input / output screen 1000 displayed on the user terminal 20, an item 1020 for qualitative continuous sound, and an item 1030 for qualitative intermittent sound. Accepts any of the inputs.

When the input of the item of the acoustic direction is received from the user terminal 20, the acoustic data visualization unit 107 performs the process of s65 described later. After that, the process of s64 is repeated.

When the input of the item of continuous sound of sound is received from the user terminal 20, the sound data visualization unit 107 performs the process of s66 described later. After that, the process of s64 is repeated.

When the input of the item of the intermittent sound of the sound is received from the user terminal 20, the sound data visualization unit 107 performs the process of s67 described later. After that, the process of s64 is repeated.

In s65, the acoustic data visualization unit 107 causes the user terminal 20 to display a sound pressure distribution display screen that displays the sound pressure distribution in the display range displayed on the input / output screen 1000.

FIG. 13 is a diagram showing an example of a sound pressure distribution display screen that displays the sound pressure distribution. On the sound pressure distribution display screen 2010, a graph of the sound pressure distribution in the display direction range is displayed.

Specifically, for example, on the sound pressure distribution display screen 2010, a graph 2016 showing the relationship between the direction axis 2012 in the display direction range and the sound pressure axis 2014 in each direction in the display direction range is displayed. To. The value of each sound pressure is based on the sound pressure data 350 for each direction.

In s66, the acoustic data visualization unit 107 causes the user terminal 20 to display a spectrogram display screen that displays a spectrogram showing the display continuous sound displayed on the input / output screen 1000.

FIG. 14 is a diagram showing an example of a spectrogram display screen for displaying a spectrogram showing a display continuous sound (qualitative continuous sound). On the spectrogram display screen 2020, the spectrogram corresponding to the qualitative continuous sound extracted in s3 is displayed.

Specifically, for example, on the spectrogram display screen 2020, the continuous sound 2028 (all) of the spectrogram 400 for each direction showing the relationship between the acoustic time axis 2022, the acoustic frequency axis 2024, and the sound pressure. The spectrogram 2026 including the portion (the qualitative continuous sound may be displayed, or only the qualitative continuous sound displayed on the input / output screen 1000 may be displayed) is displayed. The range of the frequency axis 2024 of this spectrogram 2026 corresponds to the range of the display frequency band (whether the lower and upper limits of the frequency axis 2024 match the range of the display frequency band, or the display frequency. Includes band range).

In s67, the acoustic data visualization unit 107 causes the user terminal 20 to display a spectrogram display screen that displays a spectrogram indicating the display intermittent sound displayed on the input / output screen 1000.

FIG. 15 is a diagram showing an example of a spectrogram display screen for displaying a spectrogram showing a display intermittent sound (qualitative intermittent sound). On the spectrogram display screen 2030, the spectrogram corresponding to the specified qualitative intermittent sound is displayed.

Specifically, for example, the spectrogram display screen 2030 relates to the display direction range of the spectrogram 400 for each direction, which shows the relationship between the acoustic time axis 2032, the acoustic frequency axis 2034, and the sound pressure. The spectrogram 2036 including the part of the display intermittent sound 2038 (all qualitative intermittent sounds may be displayed, or only the qualitative intermittent sound displayed on the input / output screen 1000 may be displayed) is displayed. The range of the frequency axis 2034 of this spectrogram 2036 corresponds to the range of the display frequency band (whether the lower and upper limits of the frequency axis 2034 match the range of the display frequency band, or the display frequency. Includes band range).

As described above, the acoustic analysis support system 1 of the present embodiment is a qualitative continuous sound satisfying a predetermined condition in each of a range of a plurality of spaces divided into a predetermined space from a spectrogram representing the sound in a predetermined space. And the qualitative intermittent sound part are extracted, and the direction, sound pressure, and frequency of the extracted qualitative continuous sound part and the direction, sound pressure, and frequency of the extracted qualitative intermittent sound part are displayed. To do.

Based on this display content, the user can easily know the continuous and intermittent sounds that can have an important influence on the acoustic analysis and the directions, sound pressures, and frequencies that characterize them, so that the user can easily know the direction, sound pressure, and frequency of the acoustic analysis. Even if you are not an expert and cannot decode the spectral gram, you can easily perform acoustic analysis without being aware of the spectrogram.

As described above, according to the acoustic analysis support system 1 of the present embodiment, the user can easily perform the acoustic analysis.

For example, when the sound source 10 is a device or a machine, the loudness, direction, or frequency of the sound emitted when they are operating normally, and the loudness, direction, or frequency of the sound emitted when there is some abnormality. May be different. In addition, these sounds that are not emitted in a normal operating state may be emitted in a certain direction or frequency in a state where there is some abnormality (or vice versa).

Therefore, according to the acoustic analysis support system 1 of the present embodiment, the acoustic data visualization support device 100 can easily detect the operating state (normal or abnormal) of such a sound source 10. For example, even a person who does not have specialized skills in decoding a spectrogram can easily infer the state of the sound source 10.

Further, for example, when the sound source 10 is provided in the acoustic facility, the acoustic effect of the acoustic facility can be easily verified.

Although the embodiment for carrying out the present invention has been specifically described above, the present invention is not limited to this, and various modifications can be made without departing from the gist thereof.

For example, some functions in the acoustic analysis support system 1 may be provided in an information processing device other than the acoustic data visualization support device 100. For example, the acoustic data creation unit 101, the direction division unit 102, the spectrogram creation unit 103, the continuous sound extraction unit 104, and the intermittent sound extraction unit 105 may use existing voice processing devices.

Further, in the present embodiment, as a method of dividing the space of the acoustic data (spectrogram), the division in the horizontal direction is performed, but the division in the vertical direction may be performed.

The above description of the present specification clarifies at least the following. That is, in the acoustic analysis support system 1 of the present embodiment, the arithmetic unit accepts the designation of any of the ranges of the plurality of spaces in the acoustic visualization process, and the acoustic in the designated range. Information indicating the distribution of the sound pressure of the sound pressure may be displayed.

In this way, the sound pressure distribution display that accepts the designation of any range (direction) from the range of a plurality of spaces (directions) from the user and shows the distribution of the sound pressure of the sound in the designated range (direction). By displaying the screen 2010, the user can know the distribution of the loudness of the sound in a specific direction. This makes it easy to know the spatial distribution of sound.

Further, in the acoustic analysis support system 1 of the present embodiment, the arithmetic unit receives the designation of the extracted continuous sound in the acoustic visualization process, and serves as an axis indicating the frequency range of the designated continuous sound. A spectrogram having a predetermined time axis may be displayed.

In this way, by accepting the designation of the continuous sound from the user and displaying the spectrogram display screen 2020 which displays the spectrogram having the axis showing the frequency range of the designated continuous sound and the predetermined time axis, the user Can grasp in detail the state of the acoustic part that emits a characteristic continuous sound.

Further, in the acoustic analysis support system 1 of the present embodiment, the arithmetic unit receives the designation of the extracted intermittent sound in the acoustic visualization process, and serves as an axis indicating the frequency range of the designated intermittent sound. A spectrogram having a predetermined time axis may be displayed.

In this way, by accepting the designation of the intermittent sound from the user and displaying the spectrogram display screen 2030 that displays the spectrogram having an axis indicating the frequency range of the designated intermittent sound and a predetermined time axis, the user Can grasp in detail the state of the acoustic part that emits the characteristic intermittent sound.

Further, in the acoustic analysis support system 1 of the present embodiment, the arithmetic device specifies a time zone in which the sound pressure continuously exceeds a predetermined threshold value from the spectrogram in the qualitative determination process. Then, a portion of the specified time zone is extracted as a portion of continuous sound satisfying the predetermined condition, and from the spectrogram, a plurality of parts having a predetermined frequency band and having substantially the same sound pressure at a predetermined time interval. A portion may be specified, and the specified plurality of portions may be extracted as an intermittent sound portion satisfying the predetermined condition.

In this way, the portion of the time zone in which the sound pressure continuously exceeds the threshold in time is extracted from the spectrogram as the portion of the qualitative continuous sound, and the spectrogram has a predetermined frequency band and a predetermined time. By extracting a plurality of parts having substantially the same sound pressure at intervals as qualitative intermittent sound parts, the user can ensure the acoustic characteristics based on the display of these qualitative continuous sounds and qualitative intermittent sounds. It is possible to easily perform accurate acoustic analysis.

Further, in the acoustic analysis support method of the present embodiment, the information processing apparatus receives the designation of any range of the plurality of spatial ranges in the acoustic visualization process, and the acoustics in the designated range. Information indicating the distribution of sound pressure may be displayed.

Further, in the acoustic analysis support method of the present embodiment, the information processing apparatus receives the designation of the extracted continuous sound in the acoustic visualization process, and the frequency of the continuous sound in the direction of the designated continuous sound. A spectrogram having an axis showing the range of and a predetermined time axis may be displayed.

Further, in the acoustic analysis support method of the present embodiment, the information processing device receives the designation of the extracted intermittent sound in the acoustic visualization process, and the frequency of the intermittent sound in the direction of the designated intermittent sound. A spectrogram having an axis showing the range of and a predetermined time axis may be displayed.

Further, in the acoustic analysis support method of the present embodiment, the information processing apparatus specifies a time zone in which the sound pressure continuously exceeds a predetermined threshold value from the spectrogram in the qualitative determination process. Then, the part of the specified time zone was extracted as the continuous sound part, and the part having a predetermined frequency band and substantially the same sound pressure at a predetermined time interval was specified and specified from the spectrogram. The portion may be extracted as a portion of the intermittent sound.

1 Acoustic analysis support system, 10 sound sources, 100 acoustic data visualization support device

Claims (8)

A qualitative extraction of a continuous sound portion satisfying a predetermined condition and an intermittent sound portion satisfying a predetermined condition in each of a range of a plurality of spaces obtained by dividing the predetermined space from a spectrogram representing sound in a predetermined space. Judgment processing and
An acoustic visualization process for displaying the direction, sound pressure, and frequency of the extracted continuous sound portion and the direction, sound pressure, and frequency of the extracted intermittent sound portion.
The execution,
In the acoustic visualization process,
The user accepts the designation of an arbitrary continuous sound part from the extracted plurality of continuous sound parts, displays a spectrogram having a frequency axis and a time axis in the range of the divided space, and displays the spectrogram in the spectrogram. Display information indicating the frequency range and time range of the continuous sound portion specified by the user.
An acoustic analysis support system equipped with an arithmetic unit. A qualitative extraction of a continuous sound portion satisfying a predetermined condition and an intermittent sound portion satisfying a predetermined condition in each of a range of a plurality of spaces obtained by dividing the predetermined space from a spectrogram representing sound in a predetermined space. Judgment processing and
An acoustic visualization process for displaying the direction, sound pressure, and frequency of the extracted continuous sound portion and the direction, sound pressure, and frequency of the extracted intermittent sound portion.
And
In the acoustic visualization process,
The user accepts the designation of an arbitrary intermittent sound part from the extracted plurality of intermittent sound parts.
A spectrogram having a frequency axis and a time axis in the divided space range is displayed, and information indicating the frequency range and the time range of the intermittent sound portion specified by the user is displayed in the spectrogram. To do,
An acoustic analysis support system equipped with an arithmetic unit. The arithmetic unit is used in the acoustic visualization process.
Accepts the designation of any range of the plurality of spatial ranges, and displays information indicating the distribution of the sound pressure of the acoustic in the designated range.
The acoustic analysis support system according to claim 1 or 2 . In the qualitative determination process, the arithmetic unit
From the spectrogram, a time zone in which the sound pressure continuously exceeds a predetermined threshold value is specified, and a portion of the specified time zone is extracted as the continuous sound portion.
From the spectrogram, a portion having a predetermined frequency band and having substantially the same sound pressure at a predetermined time interval is specified, and the specified portion is extracted as the intermittent sound portion.
The acoustic analysis support system according to claim 1 or 2 . Information processing device
A qualitative extraction of a continuous sound portion satisfying a predetermined condition and an intermittent sound portion satisfying a predetermined condition in each of a range of a plurality of spaces obtained by dividing the predetermined space from a spectrogram representing sound in a predetermined space. Judgment processing and
An acoustic visualization process for displaying the direction, sound pressure, and frequency of the extracted continuous sound portion and the direction, sound pressure, and frequency of the extracted intermittent sound portion.
The execution,
In the acoustic visualization process,
The user accepts the designation of an arbitrary continuous sound part from the extracted plurality of continuous sound parts, displays a spectrogram having a frequency axis and a time axis in the range of the divided space, and displays the spectrogram in the spectrogram. Display information indicating the frequency range and time range of the continuous sound portion specified by the user.
Acoustic analysis support method. Information processing device
A qualitative extraction of a continuous sound portion satisfying a predetermined condition and an intermittent sound portion satisfying a predetermined condition in each of a range of a plurality of spaces obtained by dividing the predetermined space from a spectrogram representing sound in a predetermined space. Judgment processing and
An acoustic visualization process for displaying the direction, sound pressure, and frequency of the extracted continuous sound portion and the direction, sound pressure, and frequency of the extracted intermittent sound portion.
And
In the acoustic visualization process,
A spectrogram having a frequency axis and a time axis within the range of the divided space is displayed in the spectrogram by accepting the designation of an arbitrary intermittent sound part from the extracted plurality of intermittent sound parts from the user. A region showing the frequency range and time range of the intermittent sound portion specified by the user is displayed.
Acoustic analysis support method. The information processing device performs the acoustic visualization process.
Accepts the designation of any range of the plurality of spatial ranges, and displays information indicating the distribution of the sound pressure of the acoustic in the designated range.
The acoustic analysis support method according to claim 5 or 6 . In the qualitative determination process, the information processing device
From the spectrogram, a time zone in which the sound pressure continuously exceeds a predetermined threshold value is specified, and a portion of the specified time zone is extracted as the continuous sound portion.
From the spectrogram, a portion having a predetermined frequency band and having substantially the same sound pressure at a predetermined time interval is specified, and the specified portion is extracted as the intermittent sound portion.
The acoustic analysis support method according to claim 5 or 6 .