JP6201292B2 - Audio information display device, audio information display method and program - Google Patents

Description

  The present invention relates to a sound information display device, a sound information display method, and a program for a device that acquires and visualizes surrounding sounds.

  There are cases where hearing is impaired, and even a normal person cannot recognize surrounding audio information by using headphones. There are also devices that acquire peripheral audio information and visually recognize the audio information by various displays corresponding to the acquired audio information (Patent Documents 1 and 2).

JP 2010-251916 A JP-A-2005-99418

  Examples of the sound information to be detected include sound information that requires urgency, such as a siren sound of an emergency vehicle, a car horn, and an alarm sound emitted by various alarm devices in a room. To recognize such urgent voice information, it is necessary to clearly recognize the direction in which the voice is emitted.

  The present invention has been made in view of such problems, and a voice information display device, a voice information display method, and a voice information display method capable of intuitively and appropriately recognizing a direction in which urgent voice is emitted. The purpose is to provide a program.

In order to achieve the above object, an audio information display device (100, 200) according to the present invention includes a display unit (140, 640) and a plurality of microphones arranged so as to surround the display unit (140, 640). 20), an input sound analysis unit (113, 613) for detecting a sound source direction based on audio signals input from the plurality of microphones (20), and a sound source direction detected by the input sound analysis unit (113, 613). A display control unit (111, 611) that causes the display unit (140, 640) to display a shape representing an audio signal input from the microphone (20), based on the arrangement direction of the arranged microphone (20). , wherein the display control unit (111,611), when detecting an audio signal on a predetermined sound pressure or higher, the display shape representing the speech signal To (140,640), characterized by Rukoto to display the predetermined sound audio signal on pressure or the detected time or more.

Also, the audio information display method according to the present invention includes an input sound analysis step of detecting a sound source direction based on audio signals input from a plurality of microphones (20) arranged so as to surround the display unit (140, 640), Based on the arrangement direction of the microphone (20) arranged in the sound source direction detected in the input sound analysis step, the shape representing the audio signal inputted from the microphone (20) is used as the display unit (140, 640). The display control step displays the shape representing the audio signal on the display unit (140, 640) when the audio signal having a predetermined sound pressure or higher is detected. characterized Rukoto to display the sound pressure or higher of the audio signal detected time or more.

A program according to the present invention is input from a plurality of microphones (20) arranged so as to surround the display unit (140, 640) to a computer (110, 610) included in the audio information display device (100, 200). Input sound analysis step for detecting the direction of the sound source based on the received sound signal, from the microphone (20) based on the arrangement direction of the microphone (20) arranged in the sound source direction detected in the input sound analysis step. A display control step of causing the display unit (140, 640) to display a shape representing the input audio signal, and the display control step detects the audio signal when an audio signal having a predetermined sound pressure or higher is detected. The shape representing the signal is displayed on the display unit (140, 640) for a time longer than the time when the sound signal having the predetermined sound pressure or higher is detected. It was characterized by Rukoto.

  According to the present invention, it is possible to intuitively and appropriately recognize the direction in which sound is emitted.

It is an external appearance perspective view of the audio | voice information display apparatus which concerns on this embodiment. It is the figure which showed the example of the sound source direction corresponding to the position of the microphone of the audio | voice information display apparatus which concerns on this embodiment. It is a block diagram of the configuration of the audio information display device according to the present embodiment. It is a flowchart which shows the operation example of the audio | voice information display apparatus which concerns on 1st Embodiment. It is a flowchart which shows the operation example of the audio | voice information display apparatus which concerns on 1st Embodiment. It is a flowchart which shows the operation example of the audio | voice information display apparatus which concerns on 1st Embodiment. It is a figure which shows the example of a display of the audio | voice information display apparatus which concerns on 1st Embodiment. It is a figure which shows the example of a display of the audio | voice information display apparatus which concerns on 1st Embodiment. It is a figure which shows the example of a display of the audio | voice information display apparatus which concerns on 1st Embodiment. It is a figure which shows the example of a display of the audio | voice information display apparatus which concerns on 2nd Embodiment. It is a figure which shows the example of a display of the audio | voice information display apparatus which concerns on 2nd Embodiment. It is a flowchart which shows the operation example of the audio | voice information display apparatus which concerns on 3rd Embodiment. It is a graph which shows the frequency analysis example of the audio | voice information display apparatus which concerns on 3rd Embodiment. It is a flowchart which shows the operation example of the audio | voice information display apparatus which concerns on 3rd Embodiment. It is the figure which showed the frequency corresponding to the display area which concerns on 3rd Embodiment. It is the figure which showed the frequency corresponding to the display area which concerns on 3rd Embodiment. It is the figure which showed the frequency corresponding to the display area which concerns on 3rd Embodiment. It is a figure which shows the example of a display of the audio | voice information display apparatus which concerns on 3rd Embodiment. It is a figure which shows the example of a display of the audio | voice information display apparatus which concerns on 3rd Embodiment. It is a figure which shows the example of a display of the audio | voice information display apparatus which concerns on 3rd Embodiment. It is a figure which shows the example of a display of the audio | voice information display apparatus which concerns on 3rd Embodiment. It is a flowchart which shows the operation example of the audio | voice information display apparatus which concerns on 4th Embodiment. It is a graph which shows the example of sound pressure analysis of the audio | voice information display apparatus which concerns on 4th Embodiment. It is a flowchart which shows the operation example of the audio | voice information display apparatus which concerns on 4th Embodiment. It is a figure which shows the display time of the audio | voice information display apparatus which concerns on 4th Embodiment. It is a figure which shows the example of a display of the audio | voice information display apparatus which concerns on 4th Embodiment. It is a figure which shows the example of a display of the audio | voice information display apparatus which concerns on 4th Embodiment. It is a flowchart which shows the operation example of the audio | voice information display apparatus which concerns on 5th Embodiment. It is a flowchart which shows the operation example of the audio | voice information display apparatus which concerns on 5th Embodiment. It is a flowchart which shows the operation example of the audio | voice information display apparatus which concerns on 5th Embodiment. It is a figure which shows the example of a display of the audio | voice information display apparatus which concerns on 5th Embodiment. It is a figure which shows the example of a display of the audio | voice information display apparatus which concerns on 5th Embodiment. It is an external appearance perspective view of the jacket microphone part which comprises the audio | voice information display apparatus which concerns on 6th Embodiment. It is a perspective view of the state with which the jacket microphone part and smart phone part which comprise the audio | voice information display apparatus which concerns on 6th Embodiment are mounted | worn. It is a structure block diagram of the audio | voice information display apparatus which concerns on 6th Embodiment. It is a flowchart which shows the operation example of the audio | voice information display apparatus which concerns on 6th Embodiment. It is a flowchart which shows the operation example of the audio | voice information display apparatus which concerns on 6th Embodiment.

  Hereinafter, an audio information display device 100 common to the first to fifth embodiments of the present invention will be described with reference to FIGS. 1 to 3.

  The voice information display device 100 is a device having a display function as shown in FIG. Specifically, it is preferable that the mobile phone terminal or the tablet terminal is small and easy to carry. The audio information display device 100 includes a display surface of the display unit 140 on a surface formed by the housing 10 and microphones 20 at four corners of the rectangular housing 10.

  For example, when the long side of the audio information display device 100 is in the vertical direction as shown in FIG. 2, the microphone 20 has a microphone 20A at the upper right corner, a microphone 20B at the lower right, a microphone 20C at the lower left, and a microphone 20D at the upper left. Prepare. The positions of the microphones 20 are not necessarily limited to the four corners of the casing 10, and may be any arrangement as long as the microphones 20 are provided in four directions when viewed from the center of the casing 10 and the direction of the sound source can be determined.

2 indicate examples of directions in which the direction of a sound source is specified by the microphone 20. In an actual usage mode, the display unit 140 is arranged or gripped so as to be horizontal with respect to the ground, so the directions A to H are oriented in the horizontal direction with respect to the ground with the audio information display device 100 as the center.

For this reason, it is preferable that the microphone 20 has directivity around the direction in which each microphone 20 is provided. For example, the microphone 20A has directivity around the B direction, and the microphone 20B has directivity around the D direction. Further, the microphone 20C has directivity around the F direction, and the microphone 20D has directivity around the H direction.

As shown in FIG. 1, the audio information display device 100 does not have to have a rectangular casing 10, and the microphones 20 need not have only four locations. For example, the audio information display device 100 may be circular or polygonal when the display unit 140 is the front. Moreover, the microphone 20 may be provided in the center of the edge | side which 6 places, 8 places, or the rectangular housing | casing 10 comprises. In any case, the microphone 20 is preferably disposed around the display unit 140.

  As shown in FIG. 3, the audio information display device 100 includes a control unit 110, an audio signal input unit 120, a storage unit 130, a display unit 140, an operation unit 150, a power supply unit 160, and a microphone 20. The audio information display apparatus 100 may include various necessary components that are not shown.

  The control unit 110 performs operation control of each unit constituting the audio information display device 100, processing or calculation of various data, and the like. The control unit 110 includes, for example, a CPU (Central Processing Unit), a RAM (Random Access Memory), a ROM (Read Only Memory), a DSP (Digital Signal Processor), and the like. Various programs stored in the ROM are stored on the RAM. By executing this, operation control of each part constituting the voice information display apparatus 100, processing or calculation of signals and data input from each part, file processing, and the like are performed.

  The control unit 110 implements various functions by executing programs. In the present embodiment, the control unit 110 implements a display control unit 111, an operation control unit 112, an input sound analysis unit 113, and a sound recognition unit 114.

  The display control unit 111 performs processing for displaying various types of information on the display unit 140. For example, various display forms and characters stored in the storage unit 130, various GUIs (Graphical User Interfaces) linked to a touch panel operation unit (not shown), and the like are displayed.

  The operation control unit 112 executes processing based on an operation signal generated when the operation unit 150 is operated.

  The input sound analysis unit 113 performs various analyzes on the sound data input from the microphone 20 and acquired from the sound signal input unit 120. Specific examples include analysis of sound pressure input to the microphones 20A to 20D, analysis of a sound source direction based on sound pressure, and analysis of frequency.

  The sound recognition unit 114 compares the sound data input from the microphone 20 and acquired from the sound signal input unit 120 with, for example, pattern data of various sounds stored in the storage unit 130, and specifies the input sound. I do.

  The audio signal input unit 120 converts the audio signal input from the microphone 20 under control of the control unit 110 into data for the control unit 110 to process. The audio signal input unit 120 includes, for example, an A / D conversion unit 121 and an amplification unit 122. The amplification unit 122 is, for example, an operational amplifier that amplifies the audio signal input from the microphone 20. The A / D conversion unit 121 performs A / D (Analog-Digital) conversion on the audio signal amplified by the amplification unit 122 and sends the audio data to the control unit 110.

  The storage unit 130 includes, for example, a flash memory or an HDD (Hard Disk Drive), and stores various data necessary for the audio information display device 100 and data to be recorded input from the outside such as the microphone 20. Through this process, a storage operation and a read operation are performed. The storage unit 140 is not limited to that built in the audio information display device 100, and may be an external storage device connected by a predetermined interface. Examples of the external storage device include a USB memory connected to a USB (Universal Serial Bus) terminal, an external HDD device, and a memory card connected by a predetermined memory card slot.

  The display unit 140 includes, for example, a liquid crystal display element, an organic EL (Electro Luminescence) display element, and a circuit unit that drives them, and displays various display contents and display forms under the control of the display control unit 111.

  The operation unit 150 is a user interface for the user to perform various processes and operation instructions to the audio information display device 100. For example, the operation unit 150 is provided so as to overlap the push button type or rotary type operation unit or the display unit 140. It is comprised by the touchscreen operation part which is not shown in figure. When the operation unit 150 is operated, a signal based on the operation is output to the operation control unit 112 described later, and the operation of each unit and various processes based on the operation are executed.

  The power supply unit 160 is a power supply circuit including a battery that supplies power to each unit constituting the audio information display device 100, and appropriately supplies power to each unit and charges the power supply unit 160 under the control of the control unit 110. Is controlled.

  Next, the first embodiment will be described based on FIGS. 4 to 9.

  The sound information display device 100 is always turned on by the operation of the operation unit 150 and receives sound input from the microphone 20 while operating with power supplied from the power supply unit 160. In this state, the input sound analysis unit 113 determines whether or not an audio signal having a predetermined sound pressure or higher is input to any one or a plurality of microphones 20 based on the audio data acquired from the audio signal input unit 120. Judgment is made (step S11).

The determination of the sound pressure in step S11 is, for example, PWM (Pulse Width Modulation) that changes the ratio of the H level and L level of the pulse width according to the level of the input signal with respect to the audio data input from the audio signal input unit 120. ) Convert and judge by the pulse width. This PWM conversion may be performed for each frequency band. In that case, audio data is selected for each desired frequency band by BPF (Band Pass Filter) before PWM conversion. The PWM conversion is performed for each of the plurality of microphones 20.

If it is determined in step S11 that no input has been made (step S11: No), the input of a sound signal having a predetermined sound pressure or higher is successively monitored by executing the process of step S11 again.

  The predetermined sound pressure determined in step S11 may be set arbitrarily, but as a specific example, the sound pressure level is 70 dB or more. This numerical value may be set in advance, or the setting may be changed according to the user's hearing level.

  When it is determined in step S11 that an audio signal having a predetermined sound pressure or higher has been input (step S11: Yes), the input sound analysis unit 113 analyzes the direction of the sound source based on the input audio data from each microphone 20. (Step S12).

  The process of step S12 is demonstrated based on FIG. First, the input sound analysis unit 113 identifies a microphone having the maximum sound pressure of the input sound signal based on the sound data corresponding to each of the microphones 20A to 20D (step S121). For the audio data of each microphone 20 to be compared when performing the process of step S121, the maximum value in a predetermined time zone may be detected, or the maximum value in the integrated value in a predetermined time zone may be detected. In addition, when the difference between the maximum values of the plurality of microphones 20 is smaller than a predetermined value, for example, when the difference between the maximum sound pressures is within 2 dB, the sound pressures of the microphones 20 may be the same.

  In step S121, when it is determined that the microphone 20 having the maximum sound pressure can be identified (step S121: Yes), the input sound analysis unit 113 determines that the direction of the microphone 20 identified as having the maximum sound pressure is the sound source direction. Judgment is made (step S122). For example, when the microphone 20A is identified as the microphone to which the maximum sound pressure is input in FIG. 2, it is determined that the direction B is the sound source direction. Similarly, it is determined that the direction is D in the case of the microphone 20B, the direction F in the case of the microphone 20C, and the direction H in the case of the microphone 20D.

  When it is determined in step S121 that the microphone 20 having the maximum sound pressure cannot be specified (step S121: No), the input sound analysis unit 113 can specify two microphones 20 having the same sound pressure that is higher than the other sound pressures. Whether or not (step S123). Also in the process of step S123, the error for determining the same sound pressure may be the same as in step S121. In step S123, when the two microphones 20 having the same sound pressure larger than the others can be identified (step S123: Yes), the input sound analysis unit 113 has two microphones 20 having the same sound pressure larger than the others. Is determined as the sound source direction (step S124).

  In the process of step S124, for example, in FIG. 2, since no microphones are arranged in the direction A, the direction C, the direction E, and the direction G, the two microphones 20 sandwiching these directions are changed to the direction A, the direction C, and the direction E. And a virtual microphone in the direction G.

  The determination in step S124 is, for example, when the microphone 20A and the microphone 20B in FIG. 2 are identified as two microphones 20 having the same sound pressure that is larger than the other, the direction C is determined to be the sound source direction. The Similarly, when it is determined that the microphone 20B and the microphone 20C are two microphones 20 having the same sound pressure that is larger than the other, the direction F is determined to be the sound source direction, and the microphone 20C and the microphone 20D are sounded. When it is specified that the two microphones 20 have the same sound pressure larger than the other, the direction G is determined to be the sound source direction, and the microphone 20D and the microphone 20A have the same sound pressure 2 larger than the other. When it is specified that there are two microphones 20, it is determined that the direction A is the sound source direction.

  In step S123, when the two microphones 20 having the same sound pressure larger than the others cannot be identified (step S123: No), the input sound analyzer 113 determines whether all the microphones 20 have the same sound pressure. Is determined (step S125). Also in the process of step S125, the error for determining the same sound pressure may be the same as in step S121. If it is determined in step S125 that all the microphones 20 have the same sound pressure (step S125: Yes), the input sound analysis unit 113 determines that the sound information display device 100 is above (step S126). The determination in step S126 defines that the sound source direction is above the voice information display device 100 because there are many situations where the voice information display device 100 is placed or held by the user. It may be determined that it is below the display device 100.

  In the process of step S126, for example, in FIG. 2, since no microphones facing upward of the display unit 140 are arranged, all the microphones 20 are virtual microphones facing upward of the display unit 140.

  If it is determined in step S125 that all the microphones 20 do not have the same sound pressure (step S125: No), the input sound analysis unit 113 determines that the direction of the sound source cannot be specified (step S127).

  Returning to FIG. 4, after the direction of the sound source is analyzed in step S12, based on the analyzed direction of the sound source, the display control unit 111 displays information indicating sound on the display unit 140 (step S13). The process of step S13 and a display example will be described with reference to FIGS.

  First, the display control unit 111 displays a radial pattern based on the arrangement direction of the microphones 20 in the sound source direction on the display unit 140 based on the sound source direction detected by the input sound analysis unit 113 (step S131). As an example displayed in the process of step S131, FIG. 7 shows a case where it is determined that the sound source direction is the direction of the microphone 20A. Similarly, FIG. 8 shows a case where the sound source direction is determined to be between the microphones 20A and 20D. Similarly, FIG. 9 shows a case where it is determined that the sound source direction is above the audio information display device 100.

  Next, the display control unit 111 changes the display parameters of the radial pattern displayed in step S131 in the order closer to the microphone 20 serving as the base point (step S132), and repeats until a predetermined time elapses (step S133). .

  The processing in step S132 will be specifically described. The radial patterns displayed in FIGS. 7 to 9 are based on the arrangement direction of the microphone 20 or the virtual microphone in the sound source direction as a base point, the display area 300A, the display areas 300R1, 300R2, and 300R3. , 300R4 are arranged in order. In these display areas 300, for example, the color and luminance are changed in the order of display areas 300R1, 300R2, 300R3, and 300R4. The change timing is, for example, every 0.5 seconds. The display control unit 111 repeats such display for a predetermined time period such as 5 seconds to 10 seconds. The predetermined repetition time may be a time from the time when the input sound analysis unit 113 determines that a sound signal having a predetermined sound pressure or higher is input, and a sound signal having a predetermined sound pressure or higher is input. It may be the time from the time when the sound signal is determined and becomes equal to or lower than a predetermined sound pressure.

  Further, the predetermined repetition time may vary depending on the sound pressure level. For example, when the sound pressure detected by the input sound analysis unit 113 is about 80 dB, it is 10 seconds, and when the sound pressure is about 90 dB, it is 15 seconds.

  In the display area 300A, for example, the sound pressure level of the maximum sound analyzed by the input sound analysis unit 113 is displayed as a numerical value. In the example of FIG. 7, an audio signal having a sound pressure of about 80 dB is input to the microphone 20A, and a sound source is present in the direction of the microphone 20A (direction B). In the example of FIG. 8, an audio signal having a sound pressure of about 80 dB is input to each of the microphone 20A and the microphone 20D, and a sound source exists in the direction of the virtual microphone (direction A) located between the microphone 20A and the microphone 20D. It shows that. In the example of FIG. 9, in all of the microphones 20 </ b> A to 20 </ b> D, an audio signal having a sound pressure of about 80 dB is input, and a sound source exists in the direction of the virtual microphone that detects the audio signal from above the audio information display device 100. Indicates to do.

  As described above, in the first embodiment, the shape representing the audio signal is displayed on the display unit 140 with the arrangement direction of the microphone 20 in the sound source direction as a base point, and thus the user intuitively detects the maximum sound of the microphone 20 that has detected the maximum sound. The sound source direction and its range can be grasped based on the position. Further, since the shape representing the audio signal is a radial shape based on the arrangement direction of the microphone 20 in the sound source direction, the user can intuitively grasp the sound source direction. In addition, since the display parameters of the shape representing the audio signal are sequentially changed in a plurality of display areas based on the arrangement direction of the microphone 20 in the sound source direction, the sound source direction can be grasped more clearly.

  In the first embodiment, the display area 300 having a radial shape based on the arrangement direction of the microphones 20 in the sound source direction is the four display areas 300 including the display areas 300R1, 300R2, 300R3, and 300R4. The number of 300 is not limited, and the radial display range is not limited.

  Next, a second embodiment will be described based on FIG. 10 and FIG. Since the process performed by the audio information display apparatus 100 in the second embodiment is the same as that in the first embodiment, the description thereof is omitted. The display form of the radial pattern executed in step S131 in FIG. 6 is different from the first embodiment.

  In the first embodiment, as described with reference to FIGS. 7 to 9, the shape representing the audio signal is displayed in a radial manner. In the second embodiment, the sound source identification in each of the microphones 20 is displayed on the radial display. Include range information.

As one specific example, the display form shown in FIG. 10 has a radial shape representing an audio signal as a radial shape having an angle of about 45 degrees with respect to the arrangement direction of the microphone 20 or the virtual microphone in the sound source direction. The reason why the angle of the radial shape is set to 45 degrees is that the sound source specifying range by the microphones 20A to 20D and the virtual microphone using these microphones 20 is 45 degrees, centering on the audio information display device 100.

  In the display form shown in FIG. 10, the radiation shape representing the audio signal is a radiation shape having an angle of 45 degrees. However, the sound source specifying ranges in the respective microphones 20 and virtual microphones are not strict, so the radiation form is 45 degrees or more. There may be.

  Furthermore, as a specific example, the display form shown in FIG. 11 includes information on the angle indicating the sound source specific range in addition to the display similar to that shown in FIGS. 7 and 8 described as the first embodiment. is there. Also in FIG. 11, the angle indicating the sound source identification range may be 45 degrees or more. Furthermore, the angle indicating the sound source identification range may be expressed as a line with respect to the radial shape representing the audio signal, or may be displayed with a different display color.

  Also in the second embodiment, the display form of the display area 300A and the display areas 300R1, 300R2, 300R3, and 300R4 is the same as that of the first embodiment.

  In this way, by displaying the sound source specifying direction as an angle, the user can more clearly grasp the direction of the sound source.

  Next, a third embodiment will be described with reference to FIGS. In the processing executed by the audio information display device 100 in the third embodiment, the description of the same processing as in the first embodiment is omitted.

  In FIG.12 S12, after the input sound analysis part 113 analyzes the direction of a sound source based on the audio | voice data by each input microphone 20, the input sound analysis part 113 is the sound input from the microphone 20 in the sound source direction. The frequency of the signal is analyzed (step S31). As described above, the processing in step S31 analyzes the sound pressure level for each frequency band based on the pulse width obtained by PWM conversion via the BPF for each predetermined frequency band. Further, an existing technique such as Fourier transform may be used.

FIG. 13 is an example showing the relationship between the sound pressure level of an input audio signal and the frequency band, where the vertical axis represents the sound pressure level and the horizontal axis represents the frequency. The sound pressure level threshold th on the vertical axis is the predetermined sound pressure in step S11, and processing is performed on an audio signal having a sound pressure level equal to or higher than the threshold th. The frequency band on the horizontal axis represents an example of a first frequency division and a second frequency division, which will be described later. The first frequency division, the frequency band from f ₁ to f _2, the frequency band from f ₂ to f _3, the frequency band from f ₃ to f _4, the frequency band from f ₄ to f _5, from f ₅ It is classified as a frequency band of up to f _6. The second frequency section is a section obtained by further subdividing the first frequency section. In the frequency band from f ₁ to f ₂ , the frequency band from f ₁ to f _1A and f _1A to f _1B. And the frequency band from f _1B to f ₂ . The same applies to the other first frequency sections. As shown in FIGS. 15 to 17 and Tables 1 and 2, the second frequency division partially overlaps within the first frequency division, but FIG. 13 does not overlap for convenience.

  FIG. 13 shows an example of two types of audio signals, an audio signal W1 and an audio signal W2, as an example. The audio signal detected by the audio information display device 100 is intended for any audio signal emitted in the vicinity of the user. Particularly, an audio signal having a sound pressure level equal to or higher than the threshold th is, for example, a siren sound, an alarm sound, or a notification sound. Since there are many audio signals specialized for a specific frequency band, for example, an audio signal having a small frequency bandwidth will be described as an example in FIG.

For example, when the sound pressure level is equal to or higher than the threshold th, the frequency distribution of the audio signal W1 is distributed in the frequency band from f ₂ to f ₃ as the first frequency section, and from f _2A as the second frequency section. Distributed between f _2B . Similarly the frequency distribution of the audio signal W2 is in the sound pressure level is above the threshold th, a first frequency division distributed in the frequency band from f ₃ to f _4, from the second f _3A is a frequency division Distributed between _f4 .

  Next, the display control unit 111 causes the display unit 140 to display information indicating sound based on the frequency distribution analyzed in step S31 (step S32). The process of step S32 and a display example will be described with reference to FIGS.

  First, the display control unit 111 displays the display area 300 corresponding to the frequency band of the audio signal input from the microphone 20 in the sound source direction analyzed by the input sound analysis unit 113 (step S321) until a predetermined time elapses. It is displayed (step S322).

  Display examples in step S321 are shown in FIGS. In these display examples, display areas 300F1 to 300F5 correspond to the second frequency division. FIG. 19 is an example in which the second frequency division is divided into five, and FIGS. 18, 20, and 21 are examples in which the second frequency division is divided into three. 20 and 21 also, the second frequency division may be divided into five. In addition to the second frequency division, the number of divisions and the frequency to be divided are not limited in the first frequency division.

  Here, examples of the first frequency division and the second frequency division will be described with reference to FIGS. 15 and 16.

  FIG. 15 shows an example in which the first frequency section is divided into five sections and the second frequency section is divided into three sections for each first frequency section. The frequency band to be classified is from 200 Hz to 7 kHz, but is not limited to this range. The frequency band from 200 Hz to 7 kHz is a frequency band centering on a band in which sounds such as siren sounds, alarm sounds, and notification sounds that the user needs to know immediately about their occurrence are distributed.

In the example of FIG. 15, the display areas corresponding to the frequency bands of the first frequency section and the second frequency section are as shown in Table 1.

  In the display examples shown in FIGS. 18 to 21, when the display area 300 is divided into five, the first frequency division of 200 Hz to 420 Hz shown in the example of FIG. 15 and Table 1 is a blue or green system. Each of the second frequency sections in the first frequency section may be the same color used as the first frequency section, or may be a different color of the same system. The first frequency section of 420 Hz to 950 Hz is displayed with a yellow color, and the first frequency section of 950 Hz to 2 kHz is displayed with an orange color. The first frequency section of 2 kHz to 3.7 kHz is displayed with a red color, and the first frequency section of 3.7 kHz to 7 kHz is displayed with a purple color.

  The above display color is an example. For example, since the frequency band of the emergency vehicle's siren sound is from 415 Hz to 1.9 kHz, the first frequency division of 420 Hz to 950 Hz including this frequency band and the first frequency range of 950 Hz to 2 kHz are included. The frequency classification is displayed in a color tone that makes it easy to recognize that the siren band is a dangerous or urgent audio signal, such as a yellow system or an orange system. Similarly, since the frequency band of the alarm sound of the gas alarm device or the fire alarm is 2 kHz to 7 kHz, the first frequency division of 2 kHz to 3.7 kHz including this frequency band and the first frequency range of 3.7 kHz to 7 kHz are included. The frequency classification is displayed in a color tone that is easy to recognize that the alarm signal band is a dangerous or urgent voice signal such as a red line or a purple line.

For example, the audio signal W1 shown in FIG. 13 belongs to the first frequency division of 420 Hz to 950 Hz and belongs to the second frequency division of 550 Hz to 730 Hz. For this reason, for example, in the example of FIG. 18, the display area 300F2 is displayed in a yellow color with the arrangement direction of the microphone 20 in the direction of the sound source as a base point. Similarly, the audio signal W2 belongs to the first frequency division of 950 Hz to 2 kHz, and belongs to the second frequency division of 1.2 kHz to 1.6 kHz and the second frequency division of 1.5 kHz to 2 kHz. . For this reason, for example, in the example of FIG. 18, the display area 300F2 and the display area 300F3 are displayed in orange colors with the arrangement direction of the microphone 20 in the sound source direction as a base point.

  FIG. 16 shows an example in which the first frequency division is divided into three and the second frequency division is divided into five for each first frequency division. The frequency band to be classified is from 200 Hz to 7 kHz as in FIG.

In the example of FIG. 16, the display area 300 corresponding to each frequency band of the first frequency section and the second frequency section is as shown in Table 2.

  In the display examples shown in FIGS. 18 to 21, when the display area 300 is divided into three, the first frequency division of 200 Hz to 420 Hz shown in the examples of FIG. 16 and Table 2 is a blue or green system. Each of the second frequency sections in the first frequency section may be the same color used as the first frequency section, or may be a different color of the same system. The first frequency section of 420 Hz to 2 kHz is displayed with a yellow color, and the first frequency section of 2 kHz to 7 kHz is displayed with a red color. The above display color is also an example, but as with the five categories, the siren band and alarm band are displayed in a color tone that makes it easy to recognize that the sound signal is dangerous or urgent, such as a yellow system or a red system. .

  The display examples of FIGS. 18 to 21 will be described. FIG. 18 illustrates a case where an audio signal is detected from the direction of the microphone 20A (direction B) and a direction between the microphone 20D and the microphone 20C for ease of explanation. The display when the audio signal is detected from (direction G) is shown at the same time.

  The display control unit 111 arranges the display areas 300 </ b> A, 300 </ b> F <b> 1, 300 </ b> F <b> 2, and 300 </ b> F <b> 3 in a radial pattern on the display unit 140 based on the arrangement direction of the microphone 20 in the sound source direction, Based on the above, the display areas 300F1, 300F2, and 300F3 corresponding to the second frequency division are displayed with the color tone corresponding to the first frequency division.

  The example of FIG. 19 is the same as that of FIG. 18, but is an example in which the second frequency division is five divisions and the display areas 300F1 to 300F5.

  The example of FIG. 20 is an example in which display areas 300F1 to 300F3 based on the second frequency division are arranged in the center of the display unit 140 in addition to the display based on the first embodiment. The display areas 300F1 to 300F3 based on the second frequency division are not limited to the form as shown in FIG. 20, and may be, for example, concentric circles or concentric angles. In the case of a concentric circle shape or a concentric angle shape, the center side is a second frequency segment having a low frequency and the outside is a second frequency segment having a high frequency.

  The example of FIG. 21 is an example in which the display areas 300F1 to 300F3 based on the second frequency division are represented by a plurality of dot shapes indicating that an audio signal is detected from the direction of the microphone 20A (direction B). As shown in FIG. 21, display areas 300F1 to 300F3 represented by a plurality of dot-shaped columns surrounded by broken lines are displayed with the arrangement direction of the microphone 20 in the sound source direction as a base point. A difference from the display examples of FIGS. 18 to 20 is that each of the display areas 300F1 to 300F3 based on the second frequency division is composed of a plurality of display shapes such as a dot shape. The plurality of display shapes are moved in the time corresponding to the predetermined time in step S322 from the side closer to the microphone 20 in the sound source direction. For this reason, any one or a plurality of displays in the display areas 300F1 to 300F3 based on the detected audio signal is a display that flows from the upper right to the lower left in the example of FIG.

  In the example of FIG. 21, the case where the display unit 140 uses, for example, a liquid crystal display element has been described. Also good.

  In the third embodiment, since the display position is different for each second frequency segment, for example, in the case of a sound that alternately repeats a plurality of center frequencies, such as an ambulance siren sound in Japan, Display areas 300 corresponding to the two frequency segments are alternately displayed. For this reason, it is easy to specify the type of sound for a display pattern in which a plurality of center frequencies are alternately repeated.

  As described above, in the third embodiment, the display representing the audio signal is displayed for a predetermined time based on the sound source direction and the frequency of the detected audio signal. For this reason, the user can grasp the frequency band in addition to the direction of the detected audio signal, and in particular, the frequency band such as siren sound, alarm sound, notification sound, etc. can be discriminated. Can be accurately grasped.

  In the third embodiment, as an example, the first frequency section is set according to the siren band and the alarm band, but the setting of the first frequency section is not limited to this. For example, there is a case where hearing in a predetermined frequency range is weakened or cannot be heard as hearing impairment. For this reason, as shown in FIG. 17, you may set a 1st frequency division according to a user's hearing. For example, a frequency band that can be heard to an extent that is not inconvenient on a daily basis is displayed as a green color, a frequency band that is somewhat inconvenient is displayed as a yellow color, and a frequency band that cannot be heard at all is displayed as a red color. . Such setting is set in advance so as to adapt to the user's hearing by operating the operation unit 150.

  In such an example, the user can accurately grasp the occurrence of sound that requires an emergency in a frequency band that is difficult to detect by his / her hearing.

  Next, a fourth embodiment will be described based on FIGS. In the processing executed by the audio information display device 100 according to the fourth embodiment, the description of the same processing as that of the first embodiment is omitted.

  In FIG.22 S12, after the input sound analysis part 113 analyzes the direction of a sound source based on the audio | voice data by each input microphone 20, the input sound analysis part 113 is the audio | voice input from the microphone 20 in a sound source direction. The sound pressure of the signal is analyzed (step S41).

  The process of step S41 will be specifically described with reference to FIG. The vertical axis in FIG. 23 is the sound pressure level, and the horizontal axis is time. The sound pressure level threshold th on the vertical axis is the predetermined sound pressure in step S11, and processing is performed on an audio signal equal to or higher than the sound pressure threshold th. The sound pressure analysis process in step S41 may be performed simultaneously with the process in step S11. First, the input sound analysis unit 113 obtains the sound pressure level for each time of the sound data input from the microphone 20 in the sound source direction. 23 and 25, an example of the audio signal W3 is described as an example.

  For example, the sound pressure distribution of the audio signal W3 exceeds the threshold th at time t1, exceeds the sound pressure level p1 at time t2, and exceeds the sound pressure level p4 at time t3. At time t4, the sound pressure level is p2 or less, at time t5, the sound pressure level p1 or less, and at time t6, the sound pressure level p2 or less.

  23, for example, when the threshold value th is 70 dB, p1 is 80 dB, p2 is 90 dB, p3 is 100 dB, and p4 is 110 dB. Therefore, it is indicated that the sound signal F3 has a sound pressure level of 80 dB or more and less than 90 dB at the peak time.

  Next, the display control unit 111 causes the display unit 140 to display information indicating sound based on the sound pressure level analyzed in step S41 (step S42). The process of step S42 and a display example will be described with reference to FIGS.

  First, the display control unit 111 displays a display area corresponding to the sound pressure of the audio signal input from the microphone 20 in the sound source direction analyzed by the input sound analysis unit 113 (step S421), and displays until a predetermined time elapses. (Step S422).

  The display time from step S421 to step S422 is a time during which the sound pressure level is equal to or higher than a predetermined sound pressure level. For example, from time t1 when the sound pressure level exceeds the threshold th to time t6 when the sound pressure level exceeds the threshold th, The display area 300P1 is displayed, and the display area 300P2 is displayed from time t2 when the sound pressure level exceeds p1 to time t5 when it is equal to or lower than p1. Similarly, the display area 300P3 is displayed from time t3 when the sound pressure level exceeds p3 to time t4 when it is equal to or lower than p3.

  Further, when the display corresponding to the temporal variation of the sound pressure is performed as described above, if the duration of the sound is short, the user is likely to miss the occurrence of the sound. Accordingly, the time when the sound pressure of the predetermined value is detected is multiplied by a coefficient to display the time longer than the actual sound duration.

  As shown in FIG. 25, each display area 300P is displayed at times T1 to T6 by multiplying the times t1 to t6 that are equal to or greater than the threshold th in the audio signal by a coefficient. In the example of FIGS. 26 and 27, display of the display area 300P1 is started at time T1, which is the same time as time t1, and then display of the display area 300P2 is started at time T2 corresponding to time t2. The Similarly, display of display area 300P3 is started at time T3 corresponding to time t3, and display of display area 300P3 is ended at time T4 corresponding to time t4. Similarly, display of display area 300P2 ends at time T5 corresponding to time t5, and display of display area 300P1 ends at time T6 corresponding to time t6.

  Thus, in the example of the audio signal W3 in FIG. 23, the display area 300P1 to the display area 300P3 are displayed for a predetermined time based on the sound source direction and the sound pressure level of the audio signal. Therefore, the user can sensibly grasp how loud the sound was made while specifying the sound source direction. In the present embodiment, it is effective that each display area 300P has a different displayed color. In addition, a frame indicating all the display areas from the display areas 300P1 to 300P4 is displayed, and the display area 300P corresponding to the sound pressure level analyzed by the input sound analysis unit 113 is displayed with a color. May be.

  Next, a fifth embodiment will be described with reference to FIGS. In the processing executed by the audio information display device 100 in the fifth embodiment, the description of the same processing as that in the first embodiment is omitted.

  In step S12 in FIG. 28, after the input sound analysis unit 113 analyzes the direction of the sound source based on the input sound data from each microphone 20, the sound recognition unit 114 receives the sound signal input from the microphone 20 in the sound source direction. The type of sound is analyzed (step S51).

  The process of step S51 will be described with reference to FIG. First, the sound recognizing unit 114 specifies an analysis range in sound data based on a sound signal to be dealt with (step S511). Specifically, it is a section where the sound pressure level in the sound data to be analyzed is continuously equal to or higher than the threshold th, but is not particularly limited, and various existing section determination methods are used.

  Next, the sound recognizing unit 114 collates the sound data in the analysis range with a sound database stored in the storage unit 130 or the like (step S512). The sound database in step S512 is not limited to the storage unit 130, and if the voice information display device 100 has a communication function, it is collated with a sound database stored in an external server or the like using the communication function. May be performed. Moreover, the collation process with the sound database in step S512 may utilize the collation process in an external server etc. using a communication function. In this case, the sound recognition unit 114 transmits the voice data to be analyzed to an external server or the like, and receives the collation result.

  Next, the sound recognizing unit 114 determines whether or not the type of sound is specified in the process of step S512 (step S513). As the collation result in step S512, for example, collation results such as “ambulance”, “fire alarm”, “earthquake alarm”, “microwave oven”, “human voice”, etc. can be obtained. When similar voice data is not included, a collation result indicating that the voice data cannot be specified is obtained.

  If it is determined in step S513 that the sound type has been specified (step S513: Yes), the sound recognition unit 114 notifies the display control unit 111 of information indicating the specified sound type (step S513). If it is determined in step S513 that the sound type has not been specified (step S513: No), the sound recognition unit 114 notifies the display control unit 111 of information indicating that the sound type is not specified (step S514). ). The notification in step S513 and step S514 is a process that allows the display control unit 111 to perform display based on the information by temporarily storing each information in the RAM.

  Returning to FIG. 28, the display control unit 111 causes the display unit 140 to display information indicating sound based on the type of sound analyzed in step S51 (step S52). The processing in step S52 and a display example will be described with reference to FIGS.

  First, the display control unit 111 displays information indicating the type of the audio signal input from the microphone 20 in the sound source direction analyzed by the sound recognition unit 114 (step S521), and displays the information until a predetermined time has elapsed (step S522). ).

  In the process of step S51, for example, when the audio signal input from the direction of the microphone 20A has a maximum sound pressure of 80 dB and the recognition result by the sound recognition unit 114 is the siren sound of an ambulance, as shown in FIG. In addition to the display of the radial pattern based on the arrangement direction of the microphone 20A, the letters “Ambulance” representing an ambulance are displayed. The radial pattern in FIG. 31 is the display area 300A based on the first embodiment, but the second to fourth embodiments may be applied.

Further, when the first embodiment, the second embodiment, or the fourth embodiment is applied to the display of the radial pattern, the display color of each display area 300A, 300P is associated with the recognition result of the sound recognition unit 114. It is good also as a color to make. For example, when the recognition result in the sound recognition unit 114 is a siren sound of a fire engine or an alarm sound of a fire alarm, the display color is red. In addition, although displayed with characters in FIG. 31, a diagram or icon representing the recognition result may be displayed. For example, when the recognition result is an ambulance siren sound, a figure representing an ambulance is displayed, and when the recognition result is a fire alarm warning sound, a figure representing flame is displayed.

  As shown in FIG. 32, when the recognition result by the sound recognition unit 114 is an urgent sound or an important sound, a radial pattern may be formed so that they can be distinguished. Even in such a case, each display area 300A, 300F, 300P corresponds to each embodiment.

  In this way, by combining the display based on the recognition result by the sound recognition unit 114, the user can accurately recognize the type of sound in addition to the direction of the sound source, and early detection that a dangerous sound has been detected. Can be recognized.

  The sound database referred to by the sound recognition unit includes a sound database in the storage unit 130 included in the voice information display device 100, particularly for sounds that require urgentness, even when collation is performed using a communication function. It is good also as a process which collates 130 sound databases preferentially. In this case, it is possible to perform a collation result of sound that requires an emergency more quickly than collation using the communication function. In addition, even when the communication function cannot be used, it is possible to perform collation for sounds that are particularly urgent.

  Next, a sixth embodiment will be described with reference to FIGS. The configuration of the audio information display device 100 in the sixth embodiment is different from the configuration of the audio information display device 100 in the first to fifth embodiments, but the description of the common configuration is omitted. Moreover, the display form in 1st Embodiment to 5th Embodiment is applicable to the display form in 6th Embodiment.

  Since the audio information display device 100 in the first to fifth embodiments includes the microphones 20 at the four corners of the housing 10, it becomes a dedicated device. In the sixth embodiment, a voice information display device 100 using common resources is configured using a general-purpose mobile phone or information terminal that does not include the microphones 20 at the four corners.

  FIG. 33 is a schematic perspective view of a jacket microphone unit 500 constituting the audio information display device 100. FIG. Jacket microphone unit 500 is not provided with a display function, and is provided with microphones 20 at four corners. FIG. 34 is a perspective view when the audio information display device 200 is configured by attaching the jacket microphone unit 500 to the general-purpose mobile phone 600. This voice information display device 200 has a shape of a voice signal based on the voice signal acquired by the microphone 20 provided in the jacket microphone unit 500 and representing the voice signal based on the arrangement direction of the microphone 20 in the sound source direction. 640 to display.

  The audio information display device 200 includes a jacket microphone unit 500 and a mobile phone 600, as shown in FIG. The mobile phone 600 may be an information terminal that does not have a telephone function as described above. Jacket microphone unit 500 has mobile phone 600 mounted on its upper surface, but it does not matter whether or not a mounting mechanism is provided.

  The jacket microphone unit 500 includes a first control unit 510, an audio signal input unit 120, a first operation unit 550, a first power supply unit 560, a first communication unit 570, and the microphone 20. In addition, the mobile phone 600 includes a second control unit 610, a storage unit 630, a display unit 640, a second operation unit 650, a second power supply unit 660, a second communication unit 670, and a third communication unit 680. Prepare.

The configuration of the first control unit 510 is the same as that of the control unit 110, and performs operation control of each unit constituting the jacket microphone unit 500, processing or calculation of various data, and the like. The first control unit 510 realizes the first operation control unit 512 and the first communication control unit 515 by a program to be executed.

The first operation control unit 512 executes processing based on an operation signal generated when the first operation unit 550 is operated. The first communication control unit 515 performs control to transmit audio data transmitted from the audio signal input unit 120 or data based on the audio data using the first communication unit 560.

  The first operation unit 550 is a user interface for the user to perform various processes and operation instructions to the jacket microphone unit 500, and the configuration thereof is the same as that of the operation unit 150. When the first operation unit 550 is operated, a signal based on the operation is output to a first operation control unit 512, which will be described later, and the operation of each unit and various processes based on the operation are executed.

The first power supply unit 560 is a power supply circuit including a battery that supplies power to each unit constituting the jacket microphone unit 500, and is controlled by the first control unit 510 to supply appropriate power to each unit, The charging of the first power supply unit 560 is controlled.

  The first communication unit 570 includes a communication unit that communicates with the mobile phone 600, and sends various data based on the audio input to the audio signal input unit 120 under the control of the first communication control unit 515. The first communication unit 570 can employ various wireless communication methods such as a communication unit that performs Bluetooth communication, a communication unit that performs infrared communication, and a communication method that uses an induction electric field. The first communication unit 570 is not limited to the wireless communication method, and may be an interface connected to the mobile phone 600 by wire.

  The second control unit 610 has the same configuration as that of the control unit 110. In addition to the functions of the mobile phone 600, the second control unit 610 performs operation control of various units constituting the mobile phone 600, processing of various data, or calculation. The voice information display device 200 performs various processes based on the data sent from the jacket microphone unit 500. The first control unit 510 includes a display control unit 611, a second operation control unit 612, an input sound analysis unit 613, a sound recognition unit 614, a second communication control unit 615, and a third communication control depending on the program to be executed. The unit 616 is realized.

  The display control unit 611 performs processing for displaying various types of information on the display unit 640. For example, various display forms and characters stored in the storage unit 130, various GUIs linked to a touch panel operation unit (not shown), and the like are displayed.

  The second operation control unit 612 executes processing based on an operation signal generated when the second operation unit 650 is operated.

  The input sound analysis unit 613 performs the same processing as the input sound analysis unit 113 on the voice data received from the jacket microphone unit 500 or data based on the voice data. Specific examples include analysis of sound pressure input to the microphones 20A to 20D, analysis of a sound source direction based on sound pressure, and analysis of frequency.

  The sound recognition unit 614 performs the same processing as the sound recognition unit 114 on the voice data received from the jacket microphone unit 500 or data based on the voice data.

The second communication control unit 615 uses the second communication unit 670 to perform control to receive audio data or data based on the audio data from the jacket microphone unit 500.

The third communication control unit 616 uses the third communication unit 680 to perform control for communication using a mobile phone line, a wireless LAN line, or the like.

  The second communication unit 670 is composed of a communication unit that communicates with the jacket microphone unit 500, and receives various data sent from the first communication unit 570 under the control of the second communication control unit 615. The communication method of the second communication unit 670 uses the same communication method as that of the first communication unit 570.

  The third communication unit 680 is a communication unit used when the mobile phone 600 is used alone as a telephone terminal or a communication terminal. Under the control of the third communication control unit 616, communication using a mobile phone line or wireless communication is performed. Communication using a LAN line is performed. When the jacket microphone unit 500 is attached to the mobile phone 600, the third communication unit 680 performs necessary communication as the voice information display device 200 in addition to the communication function as a normal telephone terminal or communication terminal. Good. For example, there is a case where collation with the sound database by the sound recognition unit 614 is performed by another server or the like via communication by the third communication unit 680.

The storage unit 630 has the same configuration as the storage unit 130, and performs a storage operation as the voice information display device 200 based on data transmitted from the jacket microphone unit 500 in addition to the storage operation necessary for the mobile phone 600. .

  The display unit 640 has the same configuration as the display unit 140, and the display content necessary for the audio information display device 200 is displayed in addition to the display content necessary for the mobile phone 600 under the control of the display control unit 611. .

  The second operation unit 650 is a user interface for the user to perform various processes and operation instructions on the mobile phone 600, and the configuration thereof is the same as that of the operation unit 150. When the second operation unit 650 is operated, a signal based on the operation is output to a second operation control unit 612, which will be described later, and the operation and various processes of each unit based on the operation are executed.

The second power supply unit 660 is a power supply circuit or the like including a battery that supplies power to each unit included in the mobile phone 600. Under the control of the second control unit 610, appropriate power supply to each unit, The charging of the power supply unit 660 is controlled.

  Next, processing executed by the jacket microphone unit 500 will be described with reference to FIG. The power source of jacket microphone unit 500 may be operated independently, or may be turned on by being attached to mobile phone 600. The jacket microphone unit 500 always accepts voice input from the microphone 20 while operating with power supplied from the first power supply unit 560. In this state, when the first control unit 510 determines that an audio signal is input (step S61: Yes), the first communication control unit 515 performs the audio signal input unit 120 based on the input audio signal. The A / D converted audio data is transmitted to the mobile phone 600 (step S62).

  Without performing the process of step S61, for example, audio data including silence may be transmitted to the mobile phone 600 regardless of whether or not an audio signal is input to the microphone 20, but in order to reduce power consumption, It is preferable to transmit each time an audio signal is input. Furthermore, the first control unit 510 determines whether the sound data acquired from the sound signal input unit 120 is sound data having a sound pressure equal to or higher than a predetermined value. The audio data may be transmitted to the mobile phone 600.

  Next, processing executed by the mobile phone 600 will be described with reference to FIG. First, the input sound analysis unit 613 determines whether audio data has been received from the jacket microphone unit 500 by the second communication unit (step S71). When it is determined that the audio data has been received (step S70: Yes), the input sound analysis unit 613 analyzes the sound source direction (step S72) as in the other embodiments. In addition, the input sound analysis unit 613 and the sound recognition unit 614 perform frequency analysis (step S73) of received voice, sound pressure analysis (step S74) of received voice, Sound type analysis (step S75) is executed. Next, based on these processes, the display control unit 611 displays information indicating sound on the display unit 640 as in other embodiments (step S76).

  With such a configuration, the voice information display device 200 can be easily configured using a general-purpose mobile phone or information terminal, instead of a dedicated device such as the voice information display device 100. The display form of the audio information display device 200 is common to the display forms in the first to fifth embodiments.

  The configuration of the audio information display device 200 is not limited to the shape shown in FIGS. 33 and 34. For example, the jacket microphone unit 500 may have a shape covering the periphery of the mobile phone 600. In this case, the microphones 20 are provided at the four corners of the portion covering the periphery of the mobile phone 600 in the jacket microphone unit 500.

  The embodiment of the present invention can be variously modified without departing from the gist thereof. In addition, the program for realizing the audio information display device 100 and the audio information display device 200 according to the present invention has the same function in addition to the audio information display device 100 or the mobile phone 600 by, for example, a network or a portable storage medium. May be installed in a device comprising:

20: Microphone, 100: Audio information display device, 110: Control unit, 111: Display control unit, 112: Operation control unit, 113: Input sound analysis unit, 114: Sound recognition unit, 120: Audio signal input unit

Claims (8)

Display,
A plurality of microphones arranged so as to surround the display unit;
An input sound analysis unit for detecting a sound source direction based on sound signals input from the plurality of microphones;
A display control unit that causes the display unit to display a shape representing an audio signal input from the microphone, based on the arrangement direction of the microphone arranged in the sound source direction detected by the input sound analysis unit;
With
When the display control unit detects a sound signal having a predetermined sound pressure or higher, the display control unit displays the shape representing the sound signal on the display unit for a time longer than the time when the sound signal having the predetermined sound pressure or higher is detected. A voice information display device.   The audio information display device according to claim 1, wherein the display control unit displays a shape representing the audio signal as a shape representing a sound source specific range of the microphone with respect to an arrangement direction of the microphone. . The input sound analysis unit analyzes a frequency band of an audio signal input from the microphone,
The display control unit displays information indicating an audio signal having the predetermined sound pressure or higher so that a display position is different for each frequency band analyzed by the input sound analysis unit from the base point. The audio information display device according to 1 or 2. The input sound analysis unit analyzes a sound pressure level of an audio signal input from the microphone,
The display control unit displays information indicating an audio signal equal to or higher than the predetermined sound pressure so that a display position is different for each sound pressure level analyzed by the input sound analysis unit from the base point. Item 3. The audio information display device according to Item 1 or 2. A sound recognizing unit that analyzes a type of an audio signal input from the plurality of microphones;
When it is determined that the audio signal input by the sound recognition unit is a predetermined audio signal having an emergency, the display control unit changes a display form of information indicating the audio signal equal to or higher than the predetermined sound pressure. The voice information display device according to any one of claims 1 to 4, wherein the voice information display device is displayed.   The sound according to any one of claims 1 to 3, wherein the display control unit displays a shape representing the sound signal in a dot shape with an arrangement direction of the microphone as a base point. Information display device. An input sound analysis step for detecting a sound source direction based on sound signals input from a plurality of microphones arranged so as to surround the display unit;
A display control step of displaying on the display unit a shape representing an audio signal input from the microphone, based on the arrangement direction of the microphone arranged in the sound source direction detected in the input sound analysis step;
Including
In the display control step, when an audio signal having a predetermined sound pressure or higher is detected, a shape representing the audio signal is displayed on the display unit for a time longer than the time when the audio signal having the predetermined sound pressure or higher is detected. A characteristic voice information display method. In the computer provided in the voice information display device,
An input sound analysis step for detecting a sound source direction based on sound signals input from a plurality of microphones arranged so as to surround the display unit;
A display control step of displaying on the display unit a shape representing an audio signal input from the microphone, based on the arrangement direction of the microphone arranged in the sound source direction detected in the input sound analysis step;
And execute
In the display control step, when an audio signal having a predetermined sound pressure or higher is detected, a shape representing the audio signal is displayed on the display unit for a time longer than the time when the audio signal having the predetermined sound pressure or higher is detected. A featured program.

Images