JP2013148791A - Sound analysis device, sound analysis system and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a sound analysis device capable of determining an intention of a device wearer from a type of sound acquired with a microphone when the acquired sound is assumed not to be a voice.SOLUTION: A terminal device 10 comprises: microphones 11 and 12 that are arranged at positions at different distances from a wearer's mouth for acquiring sound; a sound pressure comparison part for comparing sound pressure of the sound acquired by the microphone 11 closer to the wearer's mouth with that of the sound acquired by the microphone 12 farther from the wearer's mouth; and a determination part for determining whether or not the acquired sound coincides with a predetermined type when a result of the comparison by the sound pressure part shows that a proportion of the sound pressure of the sound acquired by sound acquisition means closer to the wearer's mouth to that of the sound acquired by the sound acquisition means farther to the wearer's mouth is greater than a predetermined value.

Description

  The present invention relates to a sound analysis device, a sound analysis system, and a program.

In Patent Literature 1, when a DSP selects and outputs a sound signal from one microphone based on sound pressure level data of sound collected from a plurality of microphones arranged uniformly in all directions, Peak hold processing (PH processing) is performed on the sound pressure level data from each microphone, and the sound pressure level data (peak value) subjected to PH processing and the peak average value obtained by averaging the peak value (filter processing, etc.) An audio processing device that performs a speech start determination and a switching process between microphones based on the difference value is disclosed.
In Patent Document 2, a first vibrating membrane constituting a first microphone, a second vibrating membrane constituting a second microphone, a first signal voltage acquired by the first microphone, And a differential signal generation circuit that receives a second signal voltage acquired by the two microphones and generates a differential signal indicating a difference between the first and second voltage signals. An integrated circuit device is disclosed.

JP 2005-229422 A JP 2009-284111 A

  An object of the present invention is to determine the intention of a device wearer from the acquired sound type when it is assumed that the sound acquired by the sound acquisition means is not a sound.

  The invention according to claim 1 is arranged at a position where the distance from the wearer's mouth is different, and a plurality of sound acquisition means for acquiring sound, and the distance from the wearer's mouth among the sound acquisition means is A sound pressure comparison unit that compares the sound pressure of the sound acquired by the closer sound acquisition unit and the sound pressure of the sound acquired by the sound acquisition unit farther away from the wearer's mouth, and the sound pressure comparison The sound pressure of the sound acquired by the sound acquisition means farther away from the wearer's mouth than the sound pressure of the sound acquired by the sound acquisition means closer to the wearer's mouth by comparison of the parts is determined in advance. A sound analysis apparatus comprising: a determination unit that determines whether or not the acquired sound matches a predetermined type when the sound is greater than a predetermined value.

The invention according to claim 2 is the sound analysis apparatus according to claim 1, wherein the mold is defined in accordance with a predetermined intention of the wearer.
The invention according to claim 3 further includes a transmission unit that transmits the determination result by the determination unit to the information aggregating device as information on the intention of the wearer. It is.
The invention according to claim 4 is characterized in that the discriminating unit discriminates whether or not it matches the pattern according to the number of sounds acquired within a predetermined time. It is a sound analysis device given in any 1 paragraph.

  The invention according to claim 5 is arranged at a position where the distance from the mouth of the wearer is different, and a plurality of sound acquisition means for acquiring sound, and the distance from the wearer's mouth among the sound acquisition means is A sound pressure comparison unit that compares the sound pressure of the sound acquired by the closer sound acquisition unit and the sound pressure of the sound acquired by the sound acquisition unit farther away from the wearer's mouth, and the sound pressure comparison The sound pressure of the sound acquired by the sound acquisition means farther away from the wearer's mouth than the sound pressure of the sound acquired by the sound acquisition means closer to the wearer's mouth by comparison of the parts is determined in advance. A discriminating unit that discriminates whether or not the acquired sound matches a predetermined type, and a transmitting unit that transmits the discrimination result by the discriminating unit as information on the intention of the wearer Sound analysis means comprising: the output from the transmitter And information collecting means comprises a receiver for receiving the information of the destination's intention, a sound analysis system comprising: a.

  The invention according to claim 6 is arranged at a position where the distance from the mouth of the wearer is different, and transmits a plurality of sound acquisition means for acquiring sound, and information of the sound acquired by the sound acquisition means A sound collection means comprising: a transmission section; a reception section that receives sound information transmitted by the transmission section; and a sound acquisition means that is closer to the mouth of the wearer among the sound acquisition means. The sound pressure comparison unit that compares the sound pressure of the sound and the sound pressure of the sound acquired by the sound acquisition means farther away from the wearer's mouth, and the mouth of the wearer by comparing the sound pressure comparison unit When the sound pressure of the sound acquired by the sound acquisition means farther away from the wearer's mouth than the sound pressure of the sound acquired by the sound acquisition means closer to the distance is greater than a predetermined value Determine if the acquired sound matches a predetermined type And information collecting means comprising a determination unit, a that a sound analysis system comprising: a.

  According to a seventh aspect of the present invention, the computer is provided with a function of acquiring sound information from a plurality of sound acquisition means that are arranged at different positions from the wearer's mouth and for acquiring sound, and the sound acquisition Compare the sound pressure of the sound acquired by the sound acquisition means closer to the wearer's mouth and the sound pressure of the sound acquired by the sound acquisition means farther from the wearer's mouth. The sound of the sound acquired by the sound acquisition means farther away from the wearer's mouth than the sound pressure of the sound acquired by the sound acquisition means closer to the wearer's mouth as a result of the comparison And a function for determining whether or not the acquired sound matches a predetermined type when the pressure is larger than a predetermined value.

According to the invention of claim 1, when it is assumed that the sound acquired by the sound acquisition means is not a voice, it is determined whether or not the type of the acquired sound matches a predetermined one. It is possible to provide a sound analysis apparatus that can
According to the second aspect of the present invention, the intention of the device wearer can be determined based on the acquired sound pattern.
According to the third aspect of the present invention, information about the intention of the device wearer can be added to the information aggregating apparatus as compared with the case where this configuration is not adopted.
According to the invention of claim 4, the process of determining the intention of the device wearer is simplified as compared with the case where this configuration is not adopted.
According to the fifth aspect of the present invention, it is possible to construct a sound analysis system that can manage the intention information of the device wearer determined by the sound analysis means by the information aggregation device.
According to the invention of claim 6, when it is assumed that the sound acquired by the sound acquisition means is not a voice, it is determined whether or not the type of the acquired sound matches a predetermined one. Sound analysis system can be constructed.
According to the invention of claim 7, when it is assumed that the sound acquired by the sound acquisition means is not a voice, the function of determining whether or not the type of the acquired sound matches a predetermined one Can be realized by a computer.

It is a figure which shows the structural example of the sound analysis system by this embodiment. It is a figure which shows the structural example of the terminal device in this embodiment. It is a figure which shows the positional relationship of a wearer and another person's mouth (speaking part), and a microphone. It is a figure which shows the relationship between the distance between a microphone and a sound source, and sound pressure (input sound volume). It is a figure which shows the identification method of a wearer's own speech voice and another person's speech sound. It is a block diagram of the sound analysis part in this embodiment. It is a flowchart which shows operation | movement of the terminal device in this embodiment. (A)-(b) is the figure which showed the specific example of the terminal device actually used.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.
<System configuration example>
FIG. 1 is a diagram illustrating a configuration example of a sound analysis system according to the present embodiment.
As shown in FIG. 1, the sound analysis system 1 according to the present embodiment includes a terminal device 10 that is an example of a sound analysis device (sound analysis unit, sound collection unit) and a host device 20 that is an example of information collection unit. It is prepared for. The terminal device 10 and the host device 20 are connected via a wireless communication line. As a type of the wireless communication line, a line using an existing method such as Wi-Fi (Wireless Fidelity), Bluetooth (registered trademark), ZigBee, or UWB (Ultra Wideband) may be used. In the illustrated example, only one terminal device 10 is described, but as will be described in detail later, the terminal device 10 is worn and used by each user and is actually used. There are as many terminal devices 10 as there are persons. Hereinafter, a user wearing the terminal device 10 is referred to as a wearer.

  The terminal device 10 includes a plurality of microphones (first microphone 11 and second microphone 12) and amplifiers (first amplifier 13 and second amplifier 14) as sound acquisition means for acquiring sound. In addition, the terminal device 10 includes a sound analysis unit 15 that analyzes the recorded sound, a data transmission unit 16 that transmits the analysis result to the host device 20, and further includes a power supply unit 17.

  The 1st microphone 11 and the 2nd microphone 12 are arranged in the position where the distance from a wearer's mouth (voice part) differs. Here, the first microphone 11 is arranged at a position (for example, about 35 cm) far from the mouth (speaking part) of the wearer, and the second microphone 12 is a position (for example, about 10 cm) near the mouth (speaking part) of the wearer. ). As the types of microphones used as the first microphone 11 and the second microphone 12 of the present embodiment, various existing types such as a dynamic type and a condenser type may be used. In particular, a non-directional MEMS (Micro Electro Mechanical Systems) type microphone is preferable.

  The first amplifier 13 and the second amplifier 14 amplify electrical signals (sound signals) that are output according to the sounds acquired by the first microphone 11 and the second microphone 12, respectively. As the amplifier used as the first amplifier 13 and the second amplifier 14 of the present embodiment, an existing operational amplifier or the like may be used.

  The sound analysis unit 15 analyzes the sound signal output from the first amplifier 13 and the second amplifier 14. As will be described in detail later, the sound analysis unit 15 identifies whether the sound acquired by the first microphone 11 and the second microphone 12 is a voice uttered by the wearer wearing the terminal device 10 or a voice uttered by another person. To do. Furthermore, the sound analysis unit 15 determines whether or not the sounds acquired by the first microphone 11 and the second microphone 12 match a predetermined pattern (pattern).

  The data transmission unit 16 transmits the acquired data including the analysis result by the sound analysis unit 15 and the terminal ID to the host device 20 via the wireless communication line. As information to be transmitted to the host device 20, in addition to the above analysis results, for example, the acquisition time of the sound by the first microphone 11 and the second microphone 12, and the acquired sound according to the contents of the processing performed in the host device 20. Information such as sound pressure may be included. Further, the terminal device 10 may be provided with a data storage unit for storing the analysis result by the sound analysis unit 15 and the stored data for a certain period may be transmitted collectively. It may be transmitted via a wired line. As will be described in detail later, in the present embodiment, the data transmission unit 16 determines this determination result when the sounds acquired by the first microphone 11 and the second microphone 12 by the sound analysis unit 15 match a predetermined pattern. It functions as a transmission part which transmits to the host apparatus 20 as information of a wearer's intention.

  The power supply unit 17 supplies power to the first microphone 11, the second microphone 12, the first amplifier 13, the second amplifier 14, the sound analysis unit 15, and the data transmission unit 16. As the power source, for example, an existing power source such as a dry battery or a rechargeable battery is used. Moreover, the power supply part 17 contains well-known circuits, such as a voltage conversion circuit and a charge control circuit, as needed.

  The host device 20 outputs a data reception unit 21 that receives data transmitted from the terminal device 10, a data storage unit 22 that stores the received data, a data analysis unit 23 that analyzes the stored data, and an analysis result. Output unit 24. The host device 20 is realized by an information processing device such as a personal computer. Further, as described above, a plurality of terminal devices 10 are used in the present embodiment, and the host device 20 receives data from each of the plurality of terminal devices 10.

  The data receiving unit 21 corresponds to the above-described wireless line, receives data from each terminal device 10, and sends it to the data storage unit 22. In the present embodiment, the data receiving unit 21 functions as a receiving unit that receives the wearer's intention information output by the data transmitting unit 16. The data storage unit 22 stores the reception data acquired from the data reception unit 21 for each speaker. Here, the speaker is identified by collating the terminal ID transmitted from the terminal device 10 with the name of the speaker registered in advance in the host device 20 and the terminal ID. Further, the wearer state may be transmitted from the terminal device 10 instead of the terminal ID.

  The data analysis unit 23 is realized by a program-controlled CPU of a personal computer, for example, and analyzes data stored in the data storage unit 22. The specific analysis content and analysis method can take various contents and methods depending on the purpose and use of the system of the present embodiment. For example, the frequency of dialogue between wearers of the terminal device 10 and the tendency of each wearer's dialogue partner may be analyzed, or the relationship between the dialogues may be inferred from information on individual utterance length and sound pressure in the dialogue. Done.

  The output unit 24 outputs the analysis result from the data analysis unit 23 or performs output based on the analysis result. The means for outputting the analysis result or the like can take various means such as display display, print output by a printer, voice output, and the like according to the purpose and use of the system and the content and format of the analysis result.

<Configuration example of terminal device>
FIG. 2 is a diagram illustrating a configuration example of the terminal device 10.
As described above, the terminal device 10 is used by being attached to each user. In order for the user to be able to wear the terminal device 10 according to the present embodiment, as shown in FIG. 2, the terminal device 10 includes a device main body 30 and a strap 40 connected to the device main body 30. In the configuration shown in the figure, the user puts the neck through the strap 40 and hangs the apparatus main body 30 from the neck.

  The apparatus main body 30 is a thin rectangular parallelepiped case 31 made of metal, resin, etc., and at least a first amplifier 13, a second amplifier 14, a sound analysis unit 15, a data transmission unit 16, and a power supply unit 17, and a circuit and a power supply. The power supply (battery) of the unit 17 is accommodated. The case 31 may be provided with a pocket for inserting an ID card or the like displaying ID information such as the name and affiliation of the wearer. Further, such ID information or the like may be printed on the surface of the case 31 itself, or a sticker describing the ID information or the like may be attached.

  The strap 40 is provided with a first microphone 11 and a second microphone 12 (hereinafter referred to as microphones 11 and 12 when the first microphone 11 and the second microphone 12 are not distinguished). The microphones 11 and 12 are connected to the first amplifier 13 and the second amplifier 14 accommodated in the apparatus main body 30 by cables (electric wires or the like) passing through the inside of the strap 40. As the material of the strap 40, various existing materials such as leather, synthetic leather, cotton and other natural fibers and synthetic fibers such as resin, metal, and the like may be used. Moreover, the coating process using a silicon resin, a fluororesin, etc. may be given.

  The strap 40 has a cylindrical structure, and the microphones 11 and 12 are housed inside the strap 40. By providing the microphones 11 and 12 inside the strap 40, the microphones 11 and 12 are prevented from being damaged and dirty, and the conversation person is prevented from being aware of the presence of the microphones 11 and 12. Note that the first microphone 11 disposed at a position far from the wearer's mouth (speaking site) may be provided in the apparatus main body 30. In the present embodiment, a case where the first microphone 11 is provided on the strap 40 will be described as an example.

  Referring to FIG. 2, the first microphone 11 is provided at an end (for example, a position within 10 cm from the connection site) of the strap 40 connected to the apparatus main body 30. Thus, the first microphone 11 is disposed at a position about 30 cm to 40 cm away from the wearer's mouth (speaking part) in a state where the wearer hangs the strap 40 around the neck and lowers the apparatus main body 30. . Even when the first microphone 11 is provided in the apparatus main body 30, the distance from the wearer's mouth (speaking part) to the first microphone 11 is approximately the same.

  The second microphone 12 is provided at a position away from the end of the strap 40 connected to the device main body 30 (for example, a position of about 20 cm to 30 cm from the connection site). Thus, the second microphone 12 is positioned at the wearer's neck (for example, a position corresponding to the clavicle) in a state where the wearer hangs the strap 40 on the neck and the apparatus main body 30 is lowered. From about 10 cm to 20 cm.

  In addition, the terminal device 10 of this embodiment is not limited to the structure shown in FIG. For example, in the microphones 11 and 12, the distance of the sound wave arrival path from the first microphone 11 to the wearer's mouth (speaking part) is the distance of the sound wave arrival path from the second microphone 12 to the wearer's mouth (speaking part). The positional relationship between the first microphone 11 and the second microphone 12 may be specified so as to be several times. Therefore, the first microphone 11 may be provided on the strap 40 on the back side of the neck. Further, the microphones 11 and 12 are not limited to the configuration provided on the strap 40 as described above, and may be attached to the wearer by various methods. For example, each of the first microphone 11 and the second microphone 12 may be configured to be individually fixed to clothes using pins or the like. Alternatively, a dedicated mounting tool designed so that the positional relationship between the first microphone 11 and the second microphone 12 is fixed at a desired position may be prepared and mounted.

  Further, as shown in FIG. 2, the apparatus main body 30 is not limited to the configuration that is connected to the strap 40 and is provided from the wearer's neck, but may be configured as an apparatus that can be easily carried. For example, instead of the strap as in the present embodiment, it may be configured to be attached to clothes or a body with a clip or a belt, or may be configured to be simply carried in a pocket or the like. In addition, a function of receiving, amplifying, and analyzing a sound signal from the microphones 11 and 12 may be realized in a mobile phone or other existing portable electronic information terminal.

  Furthermore, the microphones 11 and 12 and the apparatus main body 30 (or the sound analysis unit 15) may be connected by wireless communication instead of being connected by wire. The first amplifier 13, the second amplifier 14, the sound analysis unit 15, the data transmission unit 16, and the power supply unit 17 are housed in a single case 31 in the above configuration example, but are configured as a plurality of individuals. May be. For example, the power supply unit 17 may be used by being connected to an external power supply without being stored in the case 31.

<Identification of speakers (self and others) based on non-linguistic information of recorded speech>
Next, a speaker identification method according to this embodiment will be described.
The system according to the present embodiment distinguishes between the voice of the wearer of the terminal device 10 and the voice of the other person using the sound information recorded by the two microphones 11 and 12 provided in the terminal device 10. To do. In other words, the present embodiment identifies one another from the other regarding the speaker of the recorded sound. In the present embodiment, the utterance is based on non-linguistic information such as sound pressure (input volume to the microphones 11 and 12), not linguistic information obtained by using morphological analysis or dictionary information, among recorded sound information. Identify the person. In other words, the speaker of the sound is identified not from the utterance content specified by the linguistic information but from the utterance situation specified by the non-linguistic information.

  As described with reference to FIGS. 1 and 2, in the present embodiment, the first microphone 11 of the terminal device 10 is disposed at a position far from the mouth (speaking site) of the wearer, and the second microphone 12 is the wearer. It is arranged at a position close to the mouth (speaking part). That is, if the wearer's mouth (speaking part) is a sound source, the distance between the first microphone 11 and the sound source and the distance between the second microphone 12 and the sound source are greatly different. Specifically, the distance between the first microphone 11 and the sound source is about 1.5 to 4 times the distance between the second microphone 12 and the sound source. Here, the sound pressure of the recorded sound in the microphones 11 and 12 attenuates (distance attenuation) as the distance between the microphones 11 and 12 and the sound source increases. Therefore, regarding the voice of the wearer, the sound pressure of the recorded sound in the first microphone 11 and the sound pressure of the recorded sound in the second microphone 12 are greatly different.

  On the other hand, considering the case where the mouth (speaking part) of a person other than the wearer (other person) is used as the sound source, since the other person is away from the wearer, the distance between the first microphone 11 and the sound source, The distance between the second microphone 12 and the sound source does not change greatly. Depending on the position of the other person with respect to the wearer, a difference between both distances may occur, but the distance between the first microphone 11 and the sound source is the second as in the case where the mouth (speaking part) of the wearer is used as the sound source. It is never several times the distance between the microphone 12 and the sound source. Therefore, regarding the voice of another person, the sound pressure of the recorded sound in the first microphone 11 and the sound pressure of the recorded sound in the second microphone 12 are not significantly different from the case of the voice of the wearer.

FIG. 3 is a diagram illustrating a positional relationship between the mouths (speaking parts) of the wearer and the other person and the microphones 11 and 12.
In the relationship shown in FIG. 3, let La1 be the distance between the sound source a that is the mouth (speaking part) of the wearer and the first microphone 11, and let La2 be the distance between the sound source a and the second microphone 12. Further, the distance between the sound source b, which is the mouth (speaking part) of the other person, and the first microphone 11 is Lb1, and the distance between the sound source b and the second microphone 12 is Lb2. In this case, the following relationship holds.
La1> La2 (La1≈1.5 × La2 to 4 × La2)
Lb1≈Lb2

FIG. 4 is a diagram illustrating the relationship between the distance between the microphones 11 and 12 and the sound source and the sound pressure (input sound volume).
As described above, the sound pressure is attenuated according to the distance between the microphones 11 and 12 and the sound source. In FIG. 4, when the sound pressure G1 at the distance La1 and the sound pressure G2 at the distance La2 are compared, the sound pressure G2 is about four times the sound pressure G1. On the other hand, since the distance Lb1 and the distance Lb2 are approximate, the sound pressure G1 in the case of the distance Lb1 and the sound pressure G2 in the case of the distance Lb2 are substantially equal. Therefore, in the present embodiment, the difference between the sound pressure ratios is used to distinguish between the wearer's own speech and the other's speech in the recorded speech. In the example shown in FIG. 4, the distances Lb1 and Lb2 are 60 cm. However, here, it is meaningful that the sound pressure G1 and the sound pressure G2 are substantially equal, and the distances Lb1 and Lb2 are limited to the values shown in the figure. Not.

FIGS. 5A to 5B are diagrams showing a method for discriminating between the wearer's own speech and the other's speech.
As described with reference to FIG. 4, the sound pressure G <b> 2 of the second microphone 12 is several times (for example, about four times) the sound pressure G <b> 1 of the first microphone 11 with respect to the voice of the wearer himself / herself. Further, regarding the voice of another person, the sound pressure G2 of the second microphone 12 is substantially equal to the sound pressure G1 of the first microphone 11 (about 1 time). Therefore, in the present embodiment, a threshold value (first threshold value) is set to the ratio between the sound pressure G2 of the second microphone 12 and the sound pressure G1 of the first microphone 11. Then, the voice whose sound pressure ratio G2 / G1 is larger than the first threshold is determined as the voice of the wearer itself, and the voice whose sound pressure ratio G2 / G1 is smaller than the first threshold is not the voice of the wearer itself. Judge. In the example shown in FIG. 5 (a), the first threshold value is 2, and when the sound pressure ratio G2 / G1 exceeds the first threshold value 2, it is determined that the voice is the wearer's own speech, and the sound pressure ratio G2 / G1 is When it is smaller than the first threshold 2, it is determined that the voice is not the wearer's own speech.

On the other hand, when the sound pressure ratio G1 / G2 which is the reciprocal of the sound pressure ratio G1 / G2 is considered, this value may be larger than a predetermined threshold value (second threshold value). This is because when the sound pressures of sounds acquired by the microphones 11 and 12 are compared, the sound pressure of sounds acquired by the first microphone 11 is greater than the sound pressure of sounds acquired by the second microphone 12. In addition, the sound pressure of the sound acquired by the first microphone 11 and the sound pressure of the sound acquired by the second microphone 12 are greatly different.
One possible reason for this is noise generated near the first microphone 11 rather than the second microphone 12. That is, in this case, the distance from the sound source is smaller in the first microphone 11 than in the second microphone 12. Contrary to the case described above, the attenuation of the sound reaching the second microphone 12 is larger than that in the case of the first microphone 11. Therefore, the sound pressure ratio G1 / G2 becomes larger than a predetermined threshold value. As this noise, for example, there is a sound generated when the device body 30 or the strap 40 of the terminal device 10 collides with or wears the wearer's clothes.

  Therefore, in the present embodiment, for example, the second threshold is set to 2. When the sound pressure ratio G2 / G1 is smaller than the first threshold value 2, the sound pressure ratio G1 / G2 is compared with the second threshold value 2. If the sound pressure ratio G1 / G2 is smaller than the second threshold 2 as shown in FIG. On the other hand, when the sound pressure ratio G1 / G2 exceeds the second threshold 2, it is determined that the voice is not the voice of another person.

  Here, when the sound pressure ratio G2 / G1 exceeds the second threshold value, it is first considered to treat it as noise. However, in the present embodiment, when the sound pressure ratio G2 / G1 is larger than the second threshold, it is determined as the wearer's intention information (intention information) when the sound matches a predetermined pattern (pattern). And use this.

<Explanation of wearer's intention information>
Various contents of the intention of the wearer in this embodiment can be considered.
To explain an example, it is conceivable that the attendee of the conference wears the terminal device 10 in a place where the conference is being held and treats the intention of the attendee as the intention information when making a decision. .
In this case, as an agreement, for example, a case where the device main body 30 is tapped once is “agree”, a case where it is tapped twice is “opposite”, and a case where it is tapped three times is “abstain”.
When the wearer actually taps the apparatus main body 30, the sound is captured by the microphones 11 and 12. At this time, since the first microphone 11 is positioned closer to the apparatus body 30 than the second microphone 12, the sound pressure of the sound acquired by the first microphone 11 is the sound pressure of the sound acquired by the second microphone 12. Become bigger. That is, as a relationship between the sound pressures, the sound pressure ratio G1 / G2 exceeds the second threshold value. In such a case, as a sound pattern acquired by the microphones 11 and 12, the wearer's approval or disapproval depends on whether the sound of hitting the device body 30 is once, twice or three times. Can make decisions. Actually, when the sound pressure ratio G1 / G2 exceeds the second threshold, the determination is made by counting the number of sounds acquired within a predetermined time. Information on the approval / disapproval, which is information on the intention of the wearer, is transmitted to the host device 20 and is aggregated by the host device 20.

  In another example, the wearer who wears the terminal device 10 who is viewing the presentation at the place where the presentation using the slide is performed handles the intention to give a tag (tag) as intention information. It is possible. In this case, for example, an arrangement for giving a tag when the apparatus main body 30 is tapped twice is made in advance. For example, assume that the wearer is interested in a slide during a presentation. At this time, the wearer taps the apparatus main body 30 twice. In this case, the sound pressure ratio G1 / G2 acquired by the microphones 11 and 12 as described above exceeds the second threshold value. When it is determined that the sound of tapping the device main body 30 is twice, it is assumed that the wearer intends to give a sticky note at the time when the device main body 30 is tapped. 20 is transmitted. Further, the host device 20 records this time together with the terminal ID. As a result, a function of giving a sticky note at a specific time during the presentation is realized. The recorded information is made searchable. For example, by performing a search based on the terminal ID, a person who uses the terminal device 10 having the terminal ID can specify the time when the tag is attached, thereby improving search convenience. In this case, weighting information such as interest or interest can be added depending on the number of times the device main body 30 is tapped.

  Considering the case where the presenter who is giving a presentation wears the terminal device 10, the wearer who is the presenter can handle the intention of displaying the next slide as intention information. That is, when the wearer wants to display the next slide, an arrangement is made in advance to strike the apparatus main body 30 twice. When the apparatus body 30 is actually struck twice by the wearer, it is determined that the wearer is sending an intention to display the next slide. This intention information is transmitted to the host device 20. In the host device 20, for example, a signal indicating that the next slide is to be displayed is transmitted to a control device or the like displaying the slide, and the control device displays the next slide accordingly. In this case, when the apparatus main body 30 is tapped three times, a function such as returning to the previous slide may be further added.

As described above, in the present embodiment, it is determined whether or not the sounds acquired by the microphones 11 and 12 match a predetermined pattern. If they match, a predetermined wearing associated with the pattern is determined. It is treated as information that expresses the intention of the person. That is, this pattern is defined in accordance with a predetermined intention of the wearer.
Thus, the functions of the sensor, button, etc. can be realized without using, for example, a sensor, button, etc. other than the terminal device 10. This simplifies system design and reduces power consumption. Furthermore, if various patterns are arranged, the wearer can express more intentions.
In the example described above, the intention of the wearer is expressed by the number of sounds, but the present invention is not limited to this. For example, you may employ | adopt a pattern like the Morse signal which combined the length of sound. A predetermined rhythm may be used as this pattern. Furthermore, it is good also as a pattern which combined the strength of sound. Moreover, it is good also as a pattern which utilizes the change of a sound using the object which a wearer hits, and uses this change of a sound.

<Description of Sound Analysis Unit 15>
In the present embodiment, the function of comparing the sound pressures of the sounds acquired by the microphones 11 and 12 and whether or not the sounds acquired by the first microphone 11 and the second microphone 12 match a predetermined pattern. The sound analysis unit 15 performs the function of determining.

FIG. 6 is a block diagram of the sound analysis unit 15 in the present embodiment.
The sound analysis unit 15 illustrated in FIG. 6 includes a filtering unit 151 that removes noise from the signals amplified by the first amplifier 13 and the second amplifier 14, and the microphones 11 and 12 from the wearer's mouth. A sound pressure comparison unit 152 that compares the sound pressure of the sound acquired by the first microphone 11 closer to the distance and the sound pressure of the sound acquired by the second microphone 12 farther from the wearer's mouth; A determination unit 153 for determining whether or not sounds acquired by the first microphone 11 and the second microphone 12 match a predetermined type (pattern), and a predetermined basis for determination by the determination unit 153 And a storage unit 154 for storing the sound pattern.

FIG. 7 is a flowchart showing the operation of the terminal device 10 in the present embodiment.
Hereinafter, the operation of the terminal apparatus 10 will be described with reference to FIGS. 1, 6, and 7.
First, when the microphones 11 and 12 of the terminal device 10 acquire sound, an electrical signal (sound signal) corresponding to the acquired sound is sent from each microphone 11 and 12 to the first amplifier 13 and the second amplifier 14 (step 101). When the first amplifier 13 and the second amplifier 14 obtain the sound signal from the microphones 11 and 12, the first amplifier 13 and the second amplifier 14 amplify the signal and send it to the sound analysis unit 15 (step 102).

  The sound analysis unit 15 performs a filtering process on the signals amplified by the first amplifier 13 and the second amplifier 14 in the filtering unit 151, and removes noise components such as environmental sounds from the signal (step 103). ). Next, the sound analysis unit 15 uses the sound pressure comparison unit 152 to calculate the average sound of the recorded sounds of the microphones 11 and 12 every certain time unit (for example, tens of seconds to hundreds of seconds). The pressure is determined (step 104). Then, ratios (sound pressure ratios) G2 / G1 and G1 / G2 of the average sound pressure in the first microphone 11 and the average sound pressure in the second microphone 12 are calculated (step 105).

  Next, when there is a gain of the average sound pressure in each of the microphones 11 and 12 obtained in step 104 in the sound pressure comparison unit 152 (Yes in step 106), the sound analysis unit 15 has uttered speech (such as utterance). It was done). On the other hand, when there is no gain of the average sound pressure in each of the microphones 11 and 12 obtained in step 104 (No in step 106), the sound analysis unit 15 determines that there is no utterance voice (no utterance etc.). (Step 108). Note that the determination in step 106 takes into account the case where noise that could not be removed by the filtering processing in step 103 remains in the signal, and if there is a gain when the average sound pressure gain value is greater than or equal to a certain value. You may judge. The order of the step 105 for determining the sound pressure ratio and the step 106 for determining the presence or absence of gain may be reversed, and the sound pressure ratio may be determined only when there is a gain.

  When the sound pressure ratio G2 / G1 obtained in step 105 is larger than the first threshold value (Yes in step 107), the sound pressure comparison unit 152 determines that the speech voice or the like is a voice of the wearer's own speech ( Step 109). When the sound pressure ratio G2 / G1 obtained in step 105 is smaller than the first threshold (No in step 107), the sound pressure comparison unit 152 determines that the sound pressure ratio G1 / G2 obtained in step 105 is the second threshold. If it is smaller (Yes in Step 110), the sound pressure comparison unit 152 determines that the uttered voice or the like is a voice generated by another person's utterance (Step 111). When the sound pressure ratio G1 / G2 is larger than the second threshold (No in step 110), the sound analysis unit 15 and the microphones 11 and 12 that are stored in the storage unit 154 in the determination unit 153 and the predetermined patterns are stored. (Step 112). If they match (Yes in step 112), it is determined that the information is the wearer's intention information (step 113). On the other hand, if they do not match (No in step 112), it is determined that the noise is present (step 114).

  Thereafter, the sound analysis unit 15 uses the data transmission unit 16 as a host to analyze the information obtained by the processing of step 104 to step 114 (whether or not there is a speech, information about the speaker, intention of the wearer, etc.) as an analysis result. It is transmitted to the apparatus 20 (step 115). At this time, the length of the utterance time for each speaker (the wearer himself or another person), the gain value of the average sound pressure, and other additional information may be transmitted to the host device 20 together with the analysis result.

<Specific examples of terminal devices>
FIGS. 8A to 8B are diagrams illustrating specific examples of the terminal device 10 that is actually used.
Among these, FIG. 8A shows a configuration substantially the same as that of the terminal device 10 shown in FIG. 2, in which two microphones of a first microphone 11 and a second microphone 12 are arranged. However, the first microphone 11 is disposed in the apparatus main body 30. The distance between the first microphone 11 and the second microphone 12 is 35 cm.

  FIG. 8B shows a configuration in which three microphones of the third microphone 18 are arranged in addition to the first microphone 11 and the second microphone 12. The distance D between the first microphone 11 and the second microphone 12 and the distance D between the first microphone 11 and the third microphone 18 are both 35 cm. The distance between the second microphone 12 and the third microphone 18 is 10 cm.

  By using the terminal device 10 in which the microphones are arranged at three or more places as shown in FIG. 8B, the above-described determination of self-other identification and the intention of the wearer can be performed using different sets of microphones. Judgment can be made. In the terminal device 10 shown in FIG. 8B, a set of the first microphone 11, the second microphone 12, and a set of the second microphone 12 and the third microphone 18 can be selected. By using a plurality of sets of microphones in this way, the sound analysis unit 15 can perform self-other identification determination, wearer intention determination, and noise determination with higher accuracy. Further, in this case, the wearer can express more intentions by changing the microphone to knock the wearer's intentions.

  In the above-described example, the terminal device 10 performs the self-other identification determination and the wearer intention determination. However, the present invention is not limited to this, and the host device 20 may perform the determination. In the sound analysis system 1 in this embodiment, the determination of self-other identification and the determination of the wearer's intention performed by the sound analysis unit 15 with respect to that of FIG. Do. In this case, the data analysis unit 23 functions as a sound pressure comparison unit that compares the sound pressures of the sounds acquired by the microphones 11 and 12, and the sound acquired by the microphones 11 and 12 has a predetermined pattern (pattern). ) To function as a determination unit for determining whether or not they match. Further, in this case, the data transmission unit 16 of the terminal device 10 receives the sound information acquired by the microphones 11 and 12 without passing through the sound analysis unit 15 and transmits the information to the data reception unit 21. The data receiving unit 21 of the host device 20 receives the sound information transmitted by the data transmitting unit 16. That is, the data transmission unit 16 functions as a transmission unit that transmits sound information acquired by the microphones 11 and 12, and the data reception unit 21 functions as a reception unit that receives sound information transmitted by the data transmission unit 16. Function.

<Description of the program>
Note that the processing performed by the terminal device 10 in the present embodiment described with reference to FIG. 7 is realized by cooperation of software and hardware resources. That is, a CPU (not shown) inside the control computer provided in the terminal device 10 executes a program that realizes each function of the terminal device 10 and realizes each of these functions.

  Therefore, the processing performed by the terminal device 10 described with reference to FIG. 7 is a function of acquiring sound information from a plurality of microphones that are arranged at different distances from the wearer's mouth and that acquire sound. And the sound pressure of the sound acquired by the microphone closer to the wearer's mouth from the microphone and the sound pressure of the sound obtained by the microphone farther from the wearer's mouth And when the sound pressure acquired by the microphone farther from the wearer's mouth than the microphone closer to the wearer's mouth is greater than a predetermined value, the acquired sound is predetermined. It can also be understood as a program that realizes a function of determining whether or not it matches a given type.

DESCRIPTION OF SYMBOLS 1 ... Sound analysis system, 10 ... Terminal device, 11 ... 1st microphone, 12 ... 2nd microphone, 15 ... Sound analysis part, 16 ... Data transmission part, 18 ... 3rd microphone, 20 ... Host apparatus, 21 ... Data reception , 23 ... Data analysis unit, 30 ... Device main body, 40 ... Strap, 152 ... Sound pressure comparison unit, 153 ... Discrimination unit

Claims (7)

A plurality of sound acquisition means for acquiring sound, arranged at different positions from the wearer's mouth,
Among the sound acquisition means, the sound pressure of the sound acquired by the sound acquisition means closer to the wearer's mouth and the sound pressure of the sound acquired by the sound acquisition means farther from the wearer's mouth A sound pressure comparison unit for comparing
The sound of the sound acquired by the sound acquisition means farther away from the wearer's mouth than the sound pressure of the sound acquired by the sound acquisition means closer to the wearer's mouth by the comparison of the sound pressure comparison unit. A determination unit for determining whether or not the acquired sound matches a predetermined type when the pressure is larger than a predetermined value;
A sound analysis apparatus comprising:   The sound analysis apparatus according to claim 1, wherein the mold is defined in accordance with a predetermined intention of the wearer.   The sound analysis apparatus according to claim 1, further comprising a transmission unit configured to transmit a determination result by the determination unit to the information aggregation device as information on a wearer's intention.   The sound analysis according to any one of claims 1 to 3, wherein the determination unit determines whether or not the pattern matches the type based on the number of sounds acquired within a predetermined time. apparatus. The distance from the wearer's mouth is arranged at different positions, and a plurality of sound acquisition means for acquiring the sound and the sound acquisition means of which the distance from the wearer's mouth is closer among the sound acquisition means The sound pressure comparison unit that compares the sound pressure of the sound with the sound pressure of the sound acquired by the sound acquisition means farther from the wearer's mouth, and the comparison of the sound pressure comparison unit from the wearer's mouth If the sound pressure of the sound acquired by the sound acquisition means farther away from the wearer's mouth than the sound pressure of the sound acquired by the sound acquisition means closer to the distance is larger than a predetermined value, A sound analysis means comprising: a determination unit that determines whether or not the acquired sound matches a predetermined type; and a transmission unit that transmits a determination result by the determination unit as information on the intention of the wearer;
An information aggregating means comprising a receiving unit for receiving information on the intention of the wearer output by the transmitting unit;
A sound analysis system comprising: A sound collecting means comprising: a plurality of sound acquisition means arranged to be located at different positions from the wearer's mouth and acquiring sound; and a transmitter for transmitting information on the sound acquired by the sound acquisition means. When,
A receiving unit that receives information on the sound transmitted by the transmitting unit; a sound pressure of sound acquired by the sound acquiring unit that is closer to the mouth of the wearer among the sound acquiring units; and a mouth of the wearer The sound pressure comparison unit that compares the sound pressure of the sound acquired by the sound acquisition unit farther away from the sound source, and the sound acquisition unit that is closer to the mouth of the wearer by comparing the sound pressure comparison unit If the sound pressure of the sound acquired by the sound acquisition means that is farther from the wearer's mouth than the sound pressure of the sound is greater than a predetermined value, the acquired sound is a predetermined type. An information aggregating unit comprising: a determination unit that determines whether or not the
A sound analysis system comprising: On the computer,
A function of acquiring sound information from a plurality of sound acquisition means arranged at different positions from the wearer's mouth and acquiring sound;
Among the sound acquisition means, the sound pressure of the sound acquired by the sound acquisition means closer to the wearer's mouth and the sound pressure of the sound acquired by the sound acquisition means farther from the wearer's mouth And the ability to compare
As a result of the comparison, the sound pressure of the sound acquired by the sound acquisition means farther away from the wearer's mouth than the sound pressure of the sound acquired by the sound acquisition means closer to the wearer's mouth is predetermined. A function for determining whether or not the acquired sound matches a predetermined type when the value is greater than a given value;
A program that realizes

Images