JP2014048618A - Speech analyzing device, speech analyzing system, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a speech analyzing device or the like that can grasp whether or not a wearer wearing speech obtaining means is holding a conversation using a telephone.SOLUTION: A host device 20 includes: a data receiving unit 21 for receiving information on speech obtained by a first microphone 11 and a second microphone 12 that obtain speech and distinguish uttered speech of the wearer from uttered speech of a person other than the wearer; and a data analyzing unit 23 for determining whether or not the wearer is holding a conversation using a telephone using self-other distinguishing information, which is information on whether the speech obtained by the first microphone 11 and the second microphone 12 is the uttered speech of the wearer or the uttered speech of the other person.

Description

  The present invention relates to a voice analysis device, a voice analysis system, and a program.

In Patent Literature 1, a speaker detection circuit detects a level of a specific band audio band signal output from a filter that extracts a specific band component from the audio band signal input to the microphone, and the filter. And a microphone detection unit that compares the level of the voice band signal with a predetermined threshold, and the video conference device is configured to have a configuration for controlling the camera by the output signal of the speaker detection circuit. It is disclosed.
In Patent Document 2, when the main process is executed and the speaker's speech is detected, the volume level of the acquired voice data is detected, and then it is determined whether or not the volume level is smaller than the threshold value. If the volume level is smaller than the threshold value, the text is formed by voice recognition based on the voice data. Further, there has been disclosed a communication control device in which text data is transmitted to another communication control device when speech conversion by speech recognition is successful, and processing for detecting a speaker's speech is performed again.
In Patent Document 3, based on the result of the cepstrum analysis means, after the peak is detected by the peak detection means, the voice part is discriminated by the voice discrimination means. At this time, a cepstrum peak detection signal specific to the speaker is stored in the storage means. An audio signal processing device is disclosed that performs audio discrimination based on a maximum likelihood detection signal that is stored in advance and collated with subsequent audio input.

JP-A-9-163334 JP 2010-232780 A Japanese Patent Laid-Open No. 4-230796

  Here, it is desirable to be able to grasp whether or not the wearer wearing the voice acquisition means is talking using the telephone.

  According to the first aspect of the present invention, information related to the voice of the voice acquired by the voice acquisition means for acquiring the voice and identifying the voice of the wearer and the voice of the other person other than the wearer is acquired. Using the self-other identification information that is information identifying whether the voice acquired by the voice acquisition means is the voice of the wearer or the voice of the other person, And a determination unit that determines whether or not the wearer has a conversation using a telephone.

  According to a second aspect of the present invention, the determination unit acquires information related to the utterance voice of the wearer that matches the predetermined conversation pattern acquired by the voice acquisition unit. Determining that the wearer is having a conversation using the telephone when the information about the other person's utterance that synchronizes with the conversation pattern is not acquired at the place where the utterance of the wearer reaches. The speech analysis apparatus according to claim 1.

  According to a third aspect of the present invention, the voice information acquisition unit includes a voice of the second wearer in a place where the voice of the wearer does not reach and a voice of another person other than the second wearer. Further acquires information related to the voice of the voice acquired by the second voice acquisition unit that enables identification, and the determination unit is a predetermined information acquired by the voice acquisition unit by the voice information acquisition unit. When acquiring information related to the utterance voice of the wearer that conforms to the conversation pattern and acquiring information related to the utterance voice of the second wearer that is synchronized with the conversation pattern acquired by the second voice acquisition means The speech analysis apparatus according to claim 1, wherein the wearer and the second wearer are determined to have a conversation using a telephone.

  According to a fourth aspect of the present invention, the determination unit acquires the information related to the utterance voice of the wearer that matches the predetermined conversation pattern acquired by the voice acquisition unit. When acquiring information related to the other person's utterance voice synchronized with the conversation pattern and not acquiring information related to the voice of the other person's utterance voice as the self-utterance at the place where the wearer's utterance voice reaches, The speech analysis apparatus according to claim 1, further determining that the wearer has a telephone conference.

  According to a fifth aspect of the present invention, the voice information acquisition unit includes a voice of a second wearer in a place where the voice of the wearer does not reach and a voice of another person other than the second wearer. Further acquires information related to the voice of the voice acquired by the second voice acquisition unit that enables identification, and the determination unit is a predetermined information acquired by the voice acquisition unit by the voice information acquisition unit. The information about the utterance voice of the wearer conforming to the conversation pattern and the information about the utterance voice of the second wearer synchronized with the conversation pattern are acquired, and the predetermined information acquired by the second voice acquisition unit is acquired. When acquiring information related to the utterance voice of the second wearer that conforms to the conversation pattern and information related to the utterance voice of the wearer synchronized with the conversation pattern, A voice analysis device according to claim 1, characterized in that the second of the wearer further determines that have a conference call.

  The invention according to claim 6 is a voice acquisition unit that is worn by the wearer and acquires voice, and the voice acquired by the voice acquisition unit is the voice of the wearer or the speech of another person other than the wearer A self-other identification unit that generates self-other identification information that identifies whether it is a voice, and the wearer has a conversation using a telephone by using the self-other identification information generated by the self-other identification unit. And a determination unit that determines whether or not the voice analysis system is provided.

  The invention described in claim 7 relates to the voice of the voice acquired by the voice acquisition means for acquiring the voice in the computer and discriminating the voice of the wearer from the voice of the other person other than the wearer. Using the function for acquiring information and the self-other identification information that is information identifying whether the voice acquired by the voice acquisition means is the voice of the wearer or the voice of the other person, And a function for determining whether or not the wearer is talking using a telephone.

According to the first aspect of the present invention, it is possible to provide a speech analysis apparatus capable of grasping whether or not the wearer wearing the speech acquisition means is talking using the telephone.
According to the second aspect of the present invention, it becomes easier to determine whether or not the wearer wearing the voice acquisition means is making a phone call, as compared with the case where this configuration is not adopted.
According to the invention of claim 3, it can be determined that the two wearers wearing the voice acquisition means are talking using the telephone.
According to the invention of claim 4, it can be determined that the wearer wearing the voice acquisition means is in a conference call.
According to the invention of claim 5, it can be determined that the two wearers wearing the voice acquisition means are talking in the telephone conference.
According to the sixth aspect of the present invention, it is possible to provide a voice analysis system capable of grasping whether or not the wearer wearing the voice acquisition means is talking using the telephone.
According to the seventh aspect of the present invention, a computer can realize a function capable of grasping whether or not the wearer wearing the voice acquisition means is talking using the telephone.

It is a figure which shows the structural example of the audio | voice analysis system by this embodiment. It is a figure which shows the structural example of the terminal device in this embodiment. It is a figure which shows the positional relationship of a wearer and another person's mouth (speaking part), and a microphone. It is a figure which shows the relationship between the distance between a microphone and a sound source, and sound pressure (input sound volume). It is a figure which shows the identification method of a wearer's own speech voice and another person's speech sound. It is a flowchart which shows operation | movement of the terminal device in this embodiment. It is a figure which shows the condition where the several wearer who each mounted | wore with the terminal device of this embodiment is talking. It is a figure which shows the example of the speech information of each terminal device in the conversation condition of FIG. It is a figure which shows the example of the speech information of a terminal device when a wearer is talking with others using the telephone. It is a figure which shows the example of the speech information of a terminal device when two wearers are having conversation using the telephone. It is a figure which shows the example of the speech information of a terminal device when a wearer is talking with others in a telephone conference. It is a figure which shows the example of the speech information of a terminal device when two wearers are talking in a telephone conference. It is a flowchart which shows operation | movement of the host apparatus in this embodiment.

<System configuration example>
FIG. 1 is a diagram illustrating a configuration example of a speech analysis system according to the present embodiment.
As shown in FIG. 1, the speech analysis system 1 according to the present embodiment includes a terminal device 10 and a host device 20 that is an example of a speech analysis device. The terminal device 10 and the host device 20 are connected via a wireless communication line. As a type of the wireless communication line, a line using an existing method such as Wi-Fi (Wireless Fidelity), Bluetooth (registered trademark), ZigBee, or UWB (Ultra Wideband) may be used. Further, in the illustrated example, only one terminal device 10 is described, but the terminal device 10 is worn and used by each user, and actually the terminal devices 10 for the number of users. Is prepared. Hereinafter, a user wearing the terminal device 10 is referred to as a wearer.

  The terminal device 10 acquires a plurality of microphones (first microphone 11 and second microphone 12) as voice acquisition means for acquiring voice and discriminating between the voice of the wearer and the voice of another person other than the wearer. And amplifiers (first amplifier 13 and second amplifier 14). In addition, the terminal device 10 includes a voice analysis unit 15 that analyzes the acquired voice, a data transmission unit 16 that transmits the analysis result to the host device 20, and further includes a power supply unit 17.

  The 1st microphone 11 and the 2nd microphone 12 are arranged in the position where the distance from a wearer's mouth (voice part) differs. Here, the first microphone 11 is arranged at a position (for example, about 35 cm) far from the mouth (speaking part) of the wearer, and the second microphone 12 is a position (for example, about 10 cm) near the mouth (speaking part) of the wearer. ). As the types of microphones used as the first microphone 11 and the second microphone 12 of the present embodiment, various existing types such as a dynamic type and a condenser type may be used. In particular, a non-directional MEMS (Micro Electro Mechanical Systems) type microphone is preferable.

  The first amplifier 13 and the second amplifier 14 amplify electrical signals (audio signals) that are output according to the audio acquired by the first microphone 11 and the second microphone 12, respectively. As the amplifier used as the first amplifier 13 and the second amplifier 14 of the present embodiment, an existing operational amplifier or the like may be used.

  The voice analysis unit 15 analyzes the voice signal output from the first amplifier 13 and the second amplifier 14. Then, it is identified whether the voice acquired by the first microphone 11 and the second microphone 12 is a voice uttered by the wearer wearing the terminal device 10 or a voice uttered by another person. Details of specific processing for voice identification will be described later.

  The data transmission unit 16 sends the acquired data including the analysis result by the voice analysis unit 15 and the terminal ID via the wireless communication line or via a wired communication line such as the Internet in addition to the wireless communication line. 20 is transmitted. As information to be transmitted to the host device 20, in addition to the above analysis results, for example, the acquisition time of the sound by the first microphone 11 and the second microphone 12 and the acquired sound according to the contents of the processing performed in the host device 20 Information such as sound pressure may be included. Further, the terminal device 10 may be provided with a data storage unit for storing the analysis result by the voice analysis unit 15 and the stored data for a certain period may be transmitted collectively. Note that it may be transmitted only through a wired communication line.

  The power supply unit 17 supplies power to the first microphone 11, the second microphone 12, the first amplifier 13, the second amplifier 14, the voice analysis unit 15, and the data transmission unit 16. As the power source, for example, an existing power source such as a dry battery or a rechargeable battery is used. Moreover, the power supply part 17 contains well-known circuits, such as a voltage conversion circuit and a charge control circuit, as needed.

  The host device 20 outputs a data reception unit 21 that receives data transmitted from the terminal device 10, a data storage unit 22 that stores the received data, a data analysis unit 23 that analyzes the stored data, and an analysis result. Output unit 24. The host device 20 is realized by an information processing device such as a personal computer. In the present embodiment, when a plurality of terminal devices 10 are used, the host device 20 receives data from each of the plurality of terminal devices 10. Note that a relay device that relays data transfer may be provided between the terminal device 10 and the host device 20, and this relay device may have a function of adding data such as analysis, calculation, time, and relay device ID. .

  The data receiving unit 21 receives data from each terminal device 10 or the relay device and sends the data to the data storage unit 22. In the present embodiment, the data reception unit 21 functions as an audio information acquisition unit that acquires information related to the audio of the audio acquired by the first microphone 11 and the second microphone 12. The data storage unit 22 is realized by a storage device such as a magnetic disk device of a personal computer, for example, and stores received data acquired from the data receiving unit 21 for each speaker. Here, the speaker is identified by collating the terminal ID transmitted from the terminal device 10 with the name of the speaker registered in advance in the host device 20 and the terminal ID. Further, the wearer state may be transmitted from the terminal device 10 instead of the terminal ID.

  The data analysis unit 23 is realized by a program-controlled CPU of a personal computer, for example, and analyzes data stored in the data storage unit 22. The specific analysis content and analysis method can take various contents and methods depending on the purpose and use of the system of the present embodiment. For example, the frequency of dialogue between wearers of the terminal device 10 and the tendency of each wearer's dialogue partner may be analyzed, or the relationship between the dialogues may be inferred from information on individual utterance length and sound pressure in the dialogue. Done. As will be described in detail later, in the present embodiment, the data analysis unit 23 is an example of a determination unit, and determines the conversation relationship between the wearer and another person. Further, it is determined whether or not the wearer is conversing using the telephone as a conversation relationship.

  The output unit 24 outputs the analysis result from the data analysis unit 23 or performs output based on the analysis result. The means for outputting the analysis results and the like can take various means such as WEB display, display display, print output by a printer, audio output, etc., depending on the purpose and usage of the system and the contents and format of the analysis results. .

<Configuration example of terminal device>
FIG. 2 is a diagram illustrating a configuration example of the terminal device 10.
As described above, the terminal device 10 is used by being attached to each user. In order for the user to be able to wear the terminal device 10 according to the present embodiment, as shown in FIG. 2, the terminal device 10 includes a device main body 30 and a strap 40 connected to the device main body 30. In the configuration shown in the figure, the user puts the neck through the strap 40 and hangs the apparatus main body 30 from the neck.

  The apparatus main body 30 is a thin rectangular parallelepiped case 31 made of metal, resin, or the like, and a circuit and a power source for realizing at least the first amplifier 13, the second amplifier 14, the voice analysis unit 15, the data transmission unit 16, and the power supply unit 17. The power supply (battery) of the unit 17 is accommodated. The case 31 may be provided with a pocket for inserting an ID card or the like displaying ID information such as the name and affiliation of the wearer. Further, such ID information or the like may be printed on the surface of the case 31 itself, or a sticker describing the ID information or the like may be attached.

  The strap 40 is provided with a first microphone 11 and a second microphone 12 (hereinafter referred to as microphones 11 and 12 when the first microphone 11 and the second microphone 12 are not distinguished). The microphones 11 and 12 are connected to the first amplifier 13 and the second amplifier 14 accommodated in the apparatus main body 30 by cables (electric wires or the like) passing through the inside of the strap 40. As the material of the strap 40, various existing materials such as leather, synthetic leather, cotton and other natural fibers and synthetic fibers such as resin, metal, and the like may be used. Moreover, the coating process using a silicon resin, a fluororesin, etc. may be given.

  The strap 40 has a cylindrical structure, and the microphones 11 and 12 are housed inside the strap 40. By providing the microphones 11 and 12 inside the string 40, the microphones 11 and 12 are prevented from being damaged or soiled, and the conversation person is prevented from being aware of the presence of the microphones 11 and 12. Note that the first microphone 11 disposed at a position far from the wearer's mouth (speaking site) may be provided in the apparatus main body 30. In the present embodiment, a case where the first microphone 11 is provided on the strap 40 will be described as an example.

  Referring to FIG. 2, the first microphone 11 is provided at an end (for example, a position within 10 cm from the connection site) of the strap 40 connected to the apparatus main body 30. Thus, the first microphone 11 is disposed at a position about 30 cm to 40 cm away from the wearer's mouth (speaking part) in a state where the wearer hangs the strap 40 around the neck and lowers the apparatus main body 30. . Even when the first microphone 11 is provided in the apparatus main body 30, the distance from the wearer's mouth (speaking part) to the first microphone 11 is approximately the same.

  The second microphone 12 is provided at a position away from the end of the strap 40 connected to the device main body 30 (for example, a position of about 20 cm to 30 cm from the connection site). Thus, the second microphone 12 is positioned at the wearer's neck (for example, a position corresponding to the clavicle) in a state where the wearer hangs the strap 40 on the neck and the apparatus main body 30 is lowered. From about 10 cm to 20 cm.

  In addition, the terminal device 10 of this embodiment is not limited to the structure shown in FIG. For example, in the microphones 11 and 12, the distance of the sound wave arrival path from the first microphone 11 to the wearer's mouth (speaking part) is the distance of the sound wave arrival path from the second microphone 12 to the wearer's mouth (speaking part). The positional relationship between the first microphone 11 and the second microphone 12 may be specified so as to be several times. Therefore, the first microphone may be provided on the strap 40 on the back side of the neck. Further, the microphones 11 and 12 are not limited to the configuration provided on the strap 40 as described above, and may be attached to the wearer by various methods. For example, each of the first microphone 11 and the second microphone 12 may be configured to be individually fixed to clothes using pins or the like. Alternatively, a dedicated mounting tool designed so that the positional relationship between the first microphone 11 and the second microphone 12 is fixed at a desired position may be prepared and mounted.

  Further, as shown in FIG. 2, the apparatus main body 30 is not limited to the configuration that is connected to the strap 40 and is provided from the wearer's neck, but may be configured as an apparatus that can be easily carried. For example, instead of the strap as in the present embodiment, it may be configured to be attached to clothes or a body with a clip or a belt, or may be configured to be simply carried in a pocket or the like. In addition, a function of receiving, amplifying, and analyzing a voice signal from the microphones 11 and 12 may be realized in a mobile phone or other existing portable electronic information terminal.

  Furthermore, the microphones 11 and 12 and the apparatus main body 30 (or the voice analysis unit 15) may be connected by wireless communication instead of being connected by wire. The first amplifier 13, the second amplifier 14, the voice analysis unit 15, the data transmission unit 16, and the power supply unit 17 are housed in a single case 31 in the above configuration example, but are configured as a plurality of individuals. May be. For example, the power supply unit 17 may be used by being connected to an external power supply without being stored in the case 31.

<Identification of speakers (self and others) based on non-linguistic information of acquired speech>
Next, a speaker identification method according to this embodiment will be described.
The system of this embodiment uses the voice information acquired by the two microphones 11 and 12 provided in the terminal device 10, and the speech of the wearer of the terminal device 10 (self-speaking) and the speech of others. Identify audio. In other words, the present embodiment identifies one another from the other regarding the speaker of the acquired voice. Further, in the present embodiment, the utterance is based on non-linguistic information such as sound pressure (input sound volume to the microphones 11 and 12), not linguistic information obtained by using morphological analysis or dictionary information, among the acquired voice information. Identify the person. In other words, the voice speaker is identified not from the utterance content specified by the linguistic information but from the utterance situation specified by the non-linguistic information.

  As described with reference to FIGS. 1 and 2, in the present embodiment, the first microphone 11 of the terminal device 10 is disposed at a position far from the mouth (speaking site) of the wearer, and the second microphone 12 is the wearer. It is arranged at a position close to the mouth (speaking part). That is, if the wearer's mouth (speaking part) is a sound source, the distance between the first microphone 11 and the sound source and the distance between the second microphone 12 and the sound source are greatly different. Specifically, the distance between the first microphone 11 and the sound source is about 1.5 to 4 times the distance between the second microphone 12 and the sound source. Here, the sound pressure of the acquired sound in the microphones 11 and 12 attenuates (distance attenuation) as the distance between the microphones 11 and 12 and the sound source increases. Therefore, regarding the voice of the wearer, the sound pressure of the acquired sound in the first microphone 11 and the sound pressure of the acquired sound in the second microphone 12 are greatly different.

  On the other hand, considering the case where the mouth (speaking part) of a person other than the wearer (other person) is used as the sound source, since the other person is away from the wearer, the distance between the first microphone 11 and the sound source, The distance between the second microphone 12 and the sound source does not change greatly. Depending on the position of the other person with respect to the wearer, a difference between both distances may occur, but the distance between the first microphone 11 and the sound source is the second as in the case where the mouth (speaking part) of the wearer is used as the sound source. It is never several times the distance between the microphone 12 and the sound source. Therefore, regarding the voice of other person, the sound pressure of the acquired voice in the first microphone 11 and the sound pressure of the acquired voice in the second microphone 12 are not significantly different from the case of the voice of the wearer.

FIG. 3 is a diagram illustrating a positional relationship between the mouths (speaking parts) of the wearer and the other person and the microphones 11 and 12.
In the relationship shown in FIG. 3, let La1 be the distance between the sound source a that is the mouth (speaking part) of the wearer and the first microphone 11, and let La2 be the distance between the sound source a and the second microphone 12. Further, the distance between the sound source b, which is the mouth (speaking part) of the other person, and the first microphone 11 is Lb1, and the distance between the sound source b and the second microphone 12 is Lb2. In this case, the following relationship holds.
La1> La2 (La1≈1.5 × La2 to 4 × La2)
Lb1≈Lb2

FIG. 4 is a diagram illustrating the relationship between the distance between the microphones 11 and 12 and the sound source and the sound pressure (input sound volume).
As described above, the sound pressure is attenuated according to the distance between the microphones 11 and 12 and the sound source. In FIG. 4, when the sound pressure Ga1 at the distance La1 and the sound pressure Ga2 at the distance La2 are compared, the sound pressure Ga2 is about four times the sound pressure Ga1. On the other hand, since the distance Lb1 and the distance Lb2 are approximate, the sound pressure Gb1 in the case of the distance Lb1 and the sound pressure Gb2 in the case of the distance Lb2 are substantially equal. Therefore, in the present embodiment, the wearer's own speech and the other's speech are identified from the acquired speech using the difference in sound pressure ratio. In the example shown in FIG. 4, the distances Lb1 and Lb2 are 60 cm. However, here, it is meaningful that the sound pressure Gb1 and the sound pressure Gb2 are substantially equal, and the distances Lb1 and Lb2 are limited to the illustrated values. Not.

FIG. 5 is a diagram showing a method for discriminating between the wearer's own speech and the other's speech.
As described with reference to FIG. 4, the sound pressure Ga <b> 2 of the second microphone 12 is several times (for example, about four times) the sound pressure Ga <b> 1 of the first microphone 11 with respect to the voice of the wearer himself / herself. Further, regarding the voice of another person, the sound pressure Ga2 of the second microphone 12 is substantially equal to the sound pressure Ga1 of the first microphone 11 (about 1 time). Therefore, in the present embodiment, a threshold is set for the ratio between the sound pressure of the second microphone 12 and the sound pressure of the first microphone 11. Then, the voice whose sound pressure ratio is larger than the threshold is determined as the voice of the wearer, and the voice whose sound pressure ratio is lower than the threshold is determined as the voice of the other person. In the example shown in FIG. 5, the threshold value is 2, and the sound pressure ratio Ga2 / Ga1 exceeds the threshold value 2, so that it is determined as the wearer's own speech sound, and the sound pressure ratio Gb2 / Gb1 is smaller than the threshold value 2 so It is judged.

  By the way, the sound acquired by the microphones 11 and 12 includes so-called noise (noise) such as environmental sound in addition to the speech sound. The relationship of the distance between the noise source and the microphones 11 and 12 is similar to the case of the speech of another person. That is, according to the examples shown in FIGS. 4 and 5, the distance between the noise source c and the first microphone 11 is Lc1, and the distance between the noise source c and the second microphone 12 is Lc2. Then, the distance Lc1 and the distance Lc2 are approximated. Then, the sound pressure ratio Gc2 / Gc1 in the acquired sounds of the microphones 11 and 12 is smaller than the threshold value 2. However, such noise is separated and removed from the uttered voice by performing a filtering process using an existing technique using a bandpass filter, a gain filter, or the like.

<Operation example of terminal device>
FIG. 6 is a flowchart showing the operation of the terminal device 10 in the present embodiment.
As shown in FIG. 6, when the microphones 11 and 12 of the terminal device 10 acquire sound, electrical signals (audio signals) corresponding to the acquired sounds are transmitted from the microphones 11 and 12 to the first amplifier 13 and the second amplifier 14. (Step 101). When the first amplifier 13 and the second amplifier 14 acquire the audio signal from the microphones 11 and 12, the first amplifier 13 and the second amplifier 14 amplify the signal and send it to the audio analysis unit 15 (step 102).

  The voice analysis unit 15 performs a filtering process on the signals amplified by the first amplifier 13 and the second amplifier 14, and removes noise components such as environmental sounds from the signals (step 103). Next, the voice analysis unit 15 acquires the microphones 11 and 12 every certain time unit (for example, tens of seconds to hundreds of seconds) with respect to the signal from which the noise component has been removed. An average sound pressure in the voice is obtained (step 104). Then, a ratio (sound pressure ratio) between the average sound pressure in the first microphone 11 and the average sound pressure in the second microphone 12 is obtained (step 105).

  Next, when there is a gain of the average sound pressure in each of the microphones 11 and 12 obtained in step 104 (Yes in step 105), the voice analysis unit 15 determines that there is an utterance voice (utterance has been performed). If the sound pressure ratio obtained in step 106 is larger than the threshold (Yes in step 107), the voice analysis unit 15 determines that the uttered voice is a voice generated by the wearer's own utterance (step 108). When the sound pressure ratio obtained in step 105 is smaller than the threshold value (No in step 107), the voice analysis unit 15 determines that the uttered voice is a voice of another person's utterance (step 109). On the other hand, when there is no gain of the average sound pressure in each of the microphones 11 and 12 obtained in step 104 (No in step 105), the voice analysis unit 15 determines that there is no uttered voice (no utterance is performed) ( Step 110).

  Thereafter, the voice analysis unit 15 causes the data transmission unit 16 to transmit the information (the presence / absence of the utterance and the information of the utterer) obtained by the processing of Step 104 to Step 110 to the host device 20 as an analysis result ( Step 111). At this time, the length of the utterance time for each speaker (the wearer himself or another person), the gain value of the average sound pressure, and other additional information may be transmitted to the host device 20 together with the analysis result.

  In the present embodiment, the sound pressure of the first microphone 11 and the sound pressure of the second microphone 12 are compared to determine whether the speech sound is the sound of the wearer's own speech or the speech of another person's speech. . However, the speaker identification according to the present embodiment may be performed based on non-linguistic information extracted from the speech signals themselves acquired by the microphones 11 and 12, and is not limited to the comparison of sound pressures. For example, the voice acquisition time (voice signal output time) in the first microphone 11 and the voice acquisition time in the second microphone 12 may be compared. In this case, the spoken voice of the wearer has a large difference between the distance from the wearer's mouth (speaking part) to the first microphone 11 and the distance from the wearer's mouth (speaking part) to the second microphone 12. Therefore, a certain difference (time difference) occurs in the voice acquisition time. On the other hand, since the voice of the other person has a small difference between the distance from the wearer's mouth (speaking part) to the first microphone 11 and the distance from the wearer's mouth (speaking part) to the second microphone 12, The time difference of the voice acquisition time is smaller than that of the wearer's voice. Therefore, a threshold is set for the time difference of the voice acquisition time, and when the time difference of the voice acquisition time is larger than the threshold, it is determined that the wearer utters himself, and when the time difference of the voice acquisition time is smaller than the threshold, You may make it judge that it is an utterance of others.

  In the data receiving unit 21 of the host device 20, self-other identification information that is information identifying whether the voice acquired by the microphones 11 and 12 is the voice of the wearer or the voice of another person other than the wearer. Receive information about audio, including

<Explanation of wearer's conversational judgment>
In the terminal device 10 that has received the information about the voice, the data analysis unit 23 analyzes the voice sent from the plurality of terminal devices 10 and determines the conversation relationship of the wearer.
A specific method for determining the wearer's conversational relationship in the present embodiment will be described below. Here, a case will be described in which it is determined that two wearers are having a conversation when two wearers are having a conversation in the same area such as in the same room.

FIG. 7 is a diagram illustrating a situation in which two wearers each wearing the terminal device 10 of the present embodiment are having a conversation. FIG. 8 is a diagram illustrating an example of utterance information of each terminal device 10 in the conversation state of FIG. For convenience of explanation, one of the two wearers is referred to as a wearer A, and the terminal device 10 worn by the wearer A is referred to as a terminal device 10A. The other wearer is referred to as a wearer B, and the terminal device 10 worn by the wearer B is referred to as a terminal device 10B.
As shown in FIG. 7, consider a case where a wearer A and a wearer B wearing the terminal device 10 are talking. At this time, the wearer A and the wearer B are in the same area, and are at a distance where the uttered voices can reach each other. Therefore, the voices of the wearer A and the wearer B are captured by both the terminal device 10A of the wearer A and the terminal device 10B of the wearer B.

  The utterance information is sent to the host device 20 independently from the terminal device 10A and the terminal device 10B. At this time, as shown in FIG. 8, the utterance information acquired from the terminal device 10A and the utterance information acquired from the terminal device 10B are information indicating the utterance status such as the length of the utterance time and the timing at which the speaker is switched. It can be seen that there is a synchrony. Therefore, the host device 20 of this application example compares the information acquired from the terminal device 10A with the information acquired from the terminal device 10B, and determines the synchrony, so that these information indicate the same utterance situation. It is recognized that the wearer A and the wearer B are talking. Here, the information indicating the utterance state includes at least the length of the utterance time in each utterance for each utterer described above, the start time and end time of each utterance, and the time (timing) at which the utterer is switched. As described above, time information related to the utterance is used. Note that in order to determine the utterance situation related to a specific conversation, only part of the time information related to these utterances may be used, or other information may be additionally used.

  Here, the voice recognized as the self-utterance of the wearer A in the terminal device 10A of the wearer A is recognized as the speech of the other person in the terminal device 10B of the wearer B. On the other hand, the voice recognized as the wearer B's own utterance in the terminal device 10B is recognized as the utterance of the other person in the terminal device 10A. Therefore, the utterance information acquired from the terminal device 10A and the utterance information acquired from the terminal device 10B are opposite to each other in the utterance time, as shown in FIG. Information indicating the utterance status such as length and timing when the speaker is switched is approximated. Therefore, the host device 20 of this application example compares the information acquired from the terminal device 10A and the information acquired from the terminal device 10B to determine that these information indicate the same utterance situation, and wearers It can be recognized that A and the wearer B are talking.

As described above, in this embodiment, the self-other identification information described above is used to determine the synchrony of audio signals received from the plurality of terminal apparatuses 10 by the microphones 11 and 12.
In other words, because the self-other identification information is given, it is possible to determine in advance whether the acquired voice is due to the wearer's confidence or the other person other than the wearer. The timing can be clearly understood. If wearers whose speakers are reversed at this timing are found, it can be determined that the wearers are having a conversation.

  Here, consider a case where the wearer A has a conversation with another person using a telephone. At this time, the other person is not in the same area as the wearer A, and is not at a distance where the uttered voices can reach each other directly. Therefore, the voice of the wearer A is captured by the terminal device 10A of the wearer A, but the voice of the other person with whom the wearer A is talking can be captured by the terminal device 10A of the wearer A. Can not.

FIG. 9 is a diagram illustrating an example of utterance information of the terminal device 10A when the wearer A is talking to another person using a telephone.
As shown in the figure, the terminal device 10A of the wearer A intermittently captures the voice of the wearer A, and it can be seen that the voice of the wearer A matches the conversation pattern. Then, as described with reference to FIG. 8, if another person having a conversation with the wearer A is in the same area, the other person's utterance voice is synchronized with the utterance voice of the wearer A, for example, as shown by a dotted line. Should be captured by the terminal device 10A. However, the terminal device 10 </ b> A cannot catch the speech of another person with such a pattern.
That is, in this case, the data receiving unit 21 of the host device 20 acquires information related to the voice of the wearer A that matches the predetermined conversation pattern from the terminal device 10A, but the voice of the wearer A arrives. Information on the voice of another person that synchronizes with the conversation pattern of the wearer A within the same area as the place is not acquired. In this embodiment, at this time, the data analysis unit 23 of the host device 20 determines that the wearer A is talking using the telephone. In this case, the conversation pattern of the other person who does not synchronize with the conversation pattern of the wearer A may be captured by the terminal device 10A of the wearer A. However, in this case, it is clear that this other person is not the other party who is talking to the wearer A.

  On the other hand, when the wearer A is having a conversation using the telephone and wearing the terminal device 10, in another area such as another room where the voice of the wearer A does not reach. This speech can be captured. Here, a state is considered in which the wearer B (second wearer) wears the terminal device 10B in another area and the wearer A and the wearer B are talking using a telephone.

FIG. 10 is a diagram illustrating an example of utterance information of the terminal devices 10A and 10B when the wearer A and the wearer B have a conversation using a telephone.
As shown in the figure, the terminal device 10A of the wearer A intermittently captures the voice of the wearer A, and it can be seen that the voice of the wearer A matches the conversation pattern. Similarly, in the terminal device 10B of the wearer B, it is understood that the utterance voice of the wearer B is intermittently captured, and from this, the utterance voice of the wearer B matches the conversation pattern. Then, the utterance voice of the wearer B who is a conversation partner with the wearer A becomes a pattern synchronized with the utterance voice of the wearer A. However, the terminal device 10 </ b> A cannot capture the voice of another person in a pattern that synchronizes with the voice of the wearer A. Similarly, the terminal device 10B cannot capture the voice of another person in a pattern that synchronizes with the voice of the wearer B.
That is, in this case, first, the wearer A and the wearer B are in a place where the uttered voices do not reach each other. Then, the data receiving unit 21 of the host device 20 acquires information related to the uttered voice of the wearer A that matches a predetermined conversation pattern acquired by the microphone of the terminal device 10A, and at the same time acquires a microphone (second) of the terminal device 10B. Information on the uttered voice of the wearer B synchronized with the conversation pattern acquired by the voice acquisition means). In the present embodiment, at this time, the data analysis unit 23 of the host device 20 determines that the wearer A and the wearer B are having a conversation using the telephone. It can be determined from the fact that the wearer A and the wearer B are not in the same area, for example, through different data relay apparatuses.

  Next, consider a case where the wearer A has a telephone conference. At this time, the voice of the wearer A is captured by the terminal device 10A of the wearer A. And the wearer A's terminal device 10 can also capture the voice of another person who is the other party with whom the wearer A has a conversation. That is, the voice of the other person is output from the speaker of the telephone conference device used when the telephone conference is performed, so this voice is captured by the terminal device 10A of the wearer A.

FIG. 11 is a diagram illustrating an example of utterance information of the terminal device 10A when the wearer A has a conversation with another person in a telephone conference.
As shown in the figure, the utterance information of the wearer A and the utterance information of the other person are the same as those shown in FIG. However, unlike the case of FIG. 8, the other person having a conversation with the wearer A is not in the same area. Therefore, the terminal device 10 that identifies the other person's utterance voice captured by the terminal device 10 </ b> A as a self-utterance does not exist in the same area.
In other words, in this case, the data receiving unit 21 of the host device 20 acquires information on the uttered voice of the wearer A that conforms to a predetermined conversation pattern from the terminal device 10A, and is synchronized with the conversation pattern. Get information about the utterance voice. However, the data receiving unit 21 does not acquire information related to the voice that uses the other person's voice as the self-speak in the same area where the voice of the wearer A reaches. In the present embodiment, at this time, the data analysis unit 23 of the host device 20 determines that the wearer A has a telephone conference.

  On the other hand, when the wearer A has a conversation in a conference call and the terminal device 10 is worn, in other areas such as other rooms where the voice of the wearer A does not reach. Can capture utterances. Here, a state is considered in which the wearer B (second wearer) wears the terminal device 10B in another area, and the wearer A and the wearer B are talking in a conference call.

FIG. 12 is a diagram illustrating an example of speech information of the terminal devices 10A and 10B when the wearer A and the wearer B are having a conversation in a telephone conference.
As illustrated, in the terminal device 10A of the wearer A, the uttered voice of the wearer A is captured as a self utterance, and the uttered voice of the wearer B synchronized with this is captured as the utterance of another person. Similarly, in the terminal device 10B of the wearer B, the voice of the wearer B is captured as a self-speech, and the voice of the wearer A that synchronizes with the speech is captured as a speech of another person. That is, it is the same as the case described in FIG. However, unlike the case of FIG. 8, the wearer A and the wearer B are not in the same area. Therefore, the terminal device 10 that determines that the speech of the wearer B captured by the terminal device 10A is a self-speech is not present in the same area. Further, similarly, the terminal device 10 that identifies the speech of the wearer A captured by the terminal device 10B as a self-utterance does not exist in the same area.
That is, in this case, first, the wearer A and the wearer B are in a place where the uttered voices do not reach each other. The data receiving unit 21 of the host device 20 then receives information about the utterance voice of the wearer A that matches the predetermined conversation pattern acquired by the microphone of the terminal apparatus 10A and the utterance voice of the wearer B that synchronizes with the conversation pattern. And get information about. Further, the data receiving unit 21 is information about the voice of the wearer B that matches the predetermined conversation pattern acquired by the microphone (second voice acquisition unit) of the terminal device 10B, and the wearer who synchronizes with the conversation pattern. Information about the speech voice of A is acquired. In the present embodiment, at this time, the data analysis unit 23 of the host device 20 determines that the wearer A and the wearer B have a telephone conference.

<Operation example of host device>
FIG. 13 is a flowchart showing the operation of the host device 20 in this embodiment.
Hereinafter, the operation of the host device 20 according to the present embodiment will be described with reference to FIGS. 1 and 13.
First, the data receiving unit 21 receives information related to a voice signal including voice identification information from a plurality of terminal devices 10 (step 201). This information is once stored in the data storage unit 22 (step 202).

Next, the data analysis unit 23 analyzes voices sent from the terminal devices 10 of a plurality of wearers, and determines the conversation relationship of the wearers.
To determine the conversation relationship of the wearer, first, the data analysis unit 23 detects what is identified as self-utterance based on the self-other identification information transmitted from the terminal device 10 (step 203).
Next, the data analysis unit 23 determines whether or not the utterance voice detected as being a self-utterance is compatible with the conversation pattern (step 204). Specifically, the data analysis unit 23 determines whether or not the utterance voice that is a self-speech is intermittently acquired by the terminal device 10.
If it is not a conversation pattern (No in step 204), the data analysis unit 23 determines that the uttered voice is actually noise (step 205).

On the other hand, when it is a conversation pattern (Yes in Step 204), the data analysis unit 23 determines whether or not there is an utterance voice synchronized with the utterance voice in the same area (Step 206).
If there is no uttered voice to be tuned in the same area (No in step 206), then the data analysis unit 23 determines whether there is uttered voice to be tuned to this uttered voice in another area (step). 207).

  As a result, when there is no uttered voice to be synchronized in other areas (No in step 207), the data analysis unit 23 identifies that the wearer (wearer A) of the terminal device 10 identified as self-speaking is on the phone. (Step 208). That is, the case described with reference to FIG.

If there is an utterance voice synchronized with another area (Yes in Step 207), the data analysis unit 23 wears the terminal device 10 identified as a self-utterance (wearer A) and an utterance synchronized with this. It is determined that a conversation with the wearer (wearer B) of the terminal device 10 who has acquired the voice is in progress using the telephone (step 209). That is, the case described with reference to FIG.
In the case where the other party having a conversation using the telephone is wearing the terminal device 10, the case of step 209 is performed. For this reason, in the case of step 208, the other party having a conversation using the telephone does not wear the terminal device 10. Therefore, for example, determination that the other party is an outside person who does not wear the terminal device 10 may be performed.

On the other hand, if there is an uttered voice to be tuned in the same area (Yes in Step 206), the data analysis unit 23 next determines whether or not there is a terminal device 10 that identifies this uttered voice as a self-utterance in the same area. Judgment is made (step 210).
If there is a terminal device 10 that identifies this uttered voice as a self-speech in the same area (Yes in step 210), the data analysis unit 23 wears the terminal device 10 identified as a self-speech in step 203 (wearing) It is determined that the user A) and the wearer (wearer B) of the terminal device 10 identified as self-speaking in step 210 are in a face-to-face conversation in the same area (step 211). That is, the case described with reference to FIGS.

  If there is no terminal device 10 that identifies this speech as self-speech in the same area (No in step 210), the data analysis unit 23 further determines whether there is speech in synchronization with this speech in another area. Is determined (step 212).

As a result, when there is no uttered voice to be synchronized in other areas (No in step 212), the data analysis unit 23 determines that the wearer of the terminal device 10 identified as self-speaking is in a telephone conference. (Step 213). That is, the case described with reference to FIG.
Further, when there is an utterance voice synchronized with another area (Yes in step 212), the data analysis unit 23 determines in step 212 that the wearer (wearer A) of the terminal apparatus 10 identified as the self-utterance in step 203. It is determined that the wearer (wearer B) of the terminal device 10 identified as self-speaking has a telephone conference (step 214). That is, the case described with reference to FIG.

By determining the conversation relationship of the wearer wearing the terminal device 10 as described above, the communication tendency of each wearer can be analyzed.
In addition, based on the conversation relationship of the wearer determined by the above method, information such as “on the phone” or “during a conference call” can be disclosed on the groupware, for example. Thereby, the present situation of each wearer can be grasped more accurately.

  The voice analysis system 1 described in detail above is worn by a wearer and the microphones 11 and 12 that acquire voice, and the voice acquired by the microphones 11 and 12 is the voice of the wearer or other than the wearer. The self-other identification unit that generates the self-other identification information that identifies the voice of the wearer and the self-other identification information generated by the self-other identification unit It can also be grasped as a speech analysis system characterized by comprising a determination unit for determining whether or not. In the example described above, the self-other identification unit is realized by the voice analysis unit 15.

In the above-described example, voice identification is performed on the terminal device 10 side. However, the present invention is not limited to this, and may be performed on the host device 20 side. As the voice analysis system 1 in this embodiment, the voice analysis unit 15 of the host apparatus 20 performs, for example, the self-other identification of the voice performed by the voice analysis unit 15 with respect to that of FIG.
In the above-described example, the terminal device 10 is used as an example to identify the voice itself. However, the present invention is not limited to this. For example, by using a directional microphone and using the fact that the sound pressure acquired by the directional microphone is different from the direction in which the uttered voice comes, it is possible to identify the uttered voice. In this case, the directional microphone functions as a voice acquisition unit.

<Description of the program>
The processing performed by the host device 20 in the present embodiment described with reference to FIG. 13 is realized by cooperation of software and hardware resources. That is, a CPU (not shown) inside the control computer provided in the host device 20 executes a program that realizes each function of the host device 20 and realizes each of these functions.

  Therefore, the processing performed by the host device 20 described with reference to FIG. 13 is performed by using a microphone for acquiring a voice and discriminating between the voice of the wearer and the voice of another person other than the wearer. Using the self-other identification information, which is information identifying whether the voice acquired by the microphone is the voice of the wearer or the voice of the other person. It can also be understood as a program that realizes a function of determining whether or not a person is talking using a telephone.

DESCRIPTION OF SYMBOLS 1 ... Voice analysis system, 10 ... Terminal device, 15 ... Voice analysis part, 16 ... Data transmission part, 20 ... Host apparatus, 21 ... Data reception part, 23 ... Data analysis part, 30 ... Main part of apparatus

Claims (7)

A voice information acquisition unit for acquiring information related to the voice of the voice acquired by the voice acquisition means for acquiring the voice and identifying the voice of the wearer and the voice of the other person other than the wearer;
The wearer uses a telephone by using the self-other identification information that is information identifying whether the voice acquired by the voice acquisition means is the voice of the wearer or the voice of the other person. A determination unit that determines whether or not
A speech analysis apparatus comprising:   The determination unit acquires information on the utterance voice of the wearer that matches the predetermined conversation pattern acquired by the voice acquisition unit, and the utterance voice of the wearer arrives. 2. The voice according to claim 1, wherein it is determined that the wearer is having a conversation using a telephone when information on the voice of another person who is synchronized with the conversation pattern is not acquired at a place where the wearer is speaking. Analysis device. The voice information acquisition unit is capable of distinguishing between the voice of the second wearer in a place where the voice of the wearer does not reach and the voice of another person other than the second wearer. Further acquiring information related to the voice of the voice acquired by the voice acquisition means;
The determination unit acquires information on the utterance voice of the wearer that matches the predetermined conversation pattern acquired by the voice acquisition unit by the voice information acquisition unit, and uses the second voice acquisition unit. When acquiring information related to the voice of the second wearer that synchronizes with the acquired conversation pattern, it is determined that the wearer and the second wearer are having a conversation using a telephone. The speech analysis apparatus according to claim 1.   The determination unit obtains information related to the utterance voice of the wearer that conforms to the predetermined conversation pattern acquired by the sound acquisition unit and is synchronized with the conversation pattern. If the information about the voice of the wearer is acquired and the information about the voice of the other person's voice is not obtained at the place where the voice of the wearer arrives, the wearer has a conference call. The speech analysis apparatus according to claim 1, further determining that The voice information acquisition unit is capable of distinguishing between the voice of the second wearer in a place where the voice of the wearer does not reach and the voice of another person other than the second wearer. Further acquiring information related to the voice of the voice acquired by the voice acquisition means;
The determination unit includes the second wearer that the voice information acquisition unit synchronizes with the information about the wearer's utterance that matches the predetermined conversation pattern acquired by the voice acquisition unit and the conversation pattern. Information related to the uttered voice of the second wearer and the information about the uttered voice of the second wearer that matches the predetermined conversation pattern acquired by the second voice acquisition means and the conversation pattern 2. The speech analysis apparatus according to claim 1, wherein when acquiring information related to the voice of the wearer, it is further determined that the wearer and the second wearer are in a conference call. . A voice acquisition means that is worn by the wearer and acquires voice;
A self-other identification unit that generates self-other identification information that identifies whether the voice acquired by the voice acquisition unit is the voice of the wearer or the voice of another person other than the wearer;
A determination unit that determines whether or not the wearer is talking using the phone by using the self-other identification information generated by the self-other identification unit;
A voice analysis system characterized by comprising: On the computer,
A function of acquiring information related to the voice of the voice acquired by the voice acquisition means for acquiring the voice and identifying the voice of the wearer and the voice of the other person other than the wearer;
The wearer uses a telephone by using the self-other identification information that is information identifying whether the voice acquired by the voice acquisition means is the voice of the wearer or the voice of the other person. A function to determine whether or not
A program that realizes

Images